Chip Control Method, Control Terminal Device, and Computer-Readable Storage Medium

By incorporating a MEMS gyroscope into the image sensing chip, the offset data is detected and corrected, and the image quality problem of the camera device when moving the shooting is solved, the stable correlation of the image sensing chip is realized, and the effect of panoramic shooting is improved.

CN114885079BActive Publication Date: 2025-07-29HOSIN GLOBAL ELECTRONICS CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210454027.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-04-27
Publication Date
2025-07-29
Estimated Expiration
2042-04-27

AI Technical Summary

Technical Problem

Due to lens jitter and other reasons when existing camera devices are moving to shoot, the correlation points of the image sensing chip cannot be maintained, resulting in a degradation of image quality.

Method used

The MEMS gyroscope is built in the image sensing chip. The offset data is detected through the MEMS gyroscope and compared with the database in the memory to obtain the best correction parameters, correct the movement trajectory of the image sensing chip, and maintain the correlation points between multiple adjacent chips.

Benefits of technology

It improves the anti-interference ability of the equipment, ensures the image quality of panoramic shooting, and improves the efficiency and reliability of image acquisition.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114885079B_ABST
    Figure CN114885079B_ABST
Patent Text Reader

Abstract

The present invention provides a chip control method, a control terminal device and a computer-readable storage medium. The method is applied to the control terminal device, which includes a processor, a memory and multiple image sensing chips. Each image sensing chip is internally provided with a MEMS gyroscope. A database for storing the optimal correction parameters corresponding to the offset data of the MEMS gyroscope is set in the memory. The method includes: receiving the offset data of each MEMS gyroscope; comparing the offset data with the database to obtain the corresponding optimal correction parameters; and correcting the movement of the image sensing chip according to the optimal correction parameters. The chip control method proposed in the present invention can correct the movement of the image sensing chip, can realize the connection of the associated points between multiple adjacent image sensing chips, improves the anti-interference ability of the device, and improves the image quality.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of image acquisition and processing, and particularly relates to a chip control method, a control terminal device, and a computer-readable storage medium. Background Art

[0002] With the replacement of electronic products, the camera function has been basically popularized in various electronic products, enabling users to take pictures in various scenarios. In related art camera devices, multiple image sensor chips are usually provided, with connection points set between the image sensor chips. Each image sensor chip is responsible for photographing a different area, and the photographing results of all image sensor chips are integrated to obtain the final image.

[0003] However, these camera devices in related art can only complete the integration processing of images in the case of fixed-point shooting. In the scenario of moving shooting, the images taken will not be able to maintain the connection points due to reasons such as lens shake, and thus cannot complete the shooting well. Summary of the Invention

[0004] The following is an overview of the subject matter described in detail in this document. This overview is not intended to limit the scope of protection of the claims.

[0005] To solve the problem of reduced image quality caused by device shake during shooting in related art, embodiments of the present invention provide a chip control method, a control terminal device, and a computer-readable storage medium, which can appropriately control the movement trajectories of multiple image sensor chips, thereby ensuring the image quality of panoramic shooting and improving the anti-interference ability of shooting.

[0006] In a first aspect, embodiments of the present invention provide a chip control method, which is applied to a control terminal device. The control terminal device includes a processor, a memory, and multiple image sensor chips. Each image sensor chip is internally provided with a MEMS gyroscope. A database for storing the optimal correction parameters corresponding to the offset data of the MEMS (Micro Electro Mechanical Systems) gyroscope is set in the memory. The method includes:

[0007] Receiving the offset data of each of the MEMS gyroscopes;

[0008] Comparing the offset data with the database to obtain the corresponding optimal correction parameters;

[0009] Correcting the movement of the image sensor chip according to the optimal correction parameters.

[0010] In some embodiments, comparing the offset data with the database to obtain the corresponding optimal correction parameter specifically includes: comparing the offset data with the database according to a preset comparison criterion to obtain the corresponding optimal correction parameter.

[0011] In some embodiments, the step of comparing the offset data with the database according to a preset comparison criterion to obtain the corresponding optimal correction parameter includes:

[0012] Setting any one of the image sensing chips as a reference chip;

[0013] Determining the offset data of the other image sensing chips according to the offset data of the reference chip;

[0014] Comparing the offset data of the other image sensing chips with the database to obtain the optimal correction parameters of the other image sensing chips.

[0015] In some embodiments, the step of comparing the offset data with the database according to a preset comparison criterion to obtain the corresponding optimal correction parameter includes:

[0016] Presetting reference parameters, where the reference parameters include a reference axis point and a reference angle;

[0017] Determining the offset data of the image sensing chip according to the reference parameters;

[0018] Comparing the offset data with the database to obtain the optimal correction parameter.

[0019] In some embodiments, the control terminal device further includes a tachometer, and a register is set in the processor. After comparing the offset data with the database to obtain the corresponding optimal correction parameter, the following steps are further included:

[0020] Obtaining the real-time speed of the image sensing chip;

[0021] Caching the offset data and the real-time speed into the register;

[0022] Caching the optimal correction parameter corresponding to the offset data into the register;

[0023] Determining that the number of repetitions of the offset data and the real-time speed cached in the register reaches a preset threshold;

[0024] Invoking the optimal correction parameter corresponding to the offset data in the register.

[0025] In some embodiments, a voltmeter is provided in the MEMS gyroscope. Before receiving the offset data of each MEMS gyroscope, it further includes:

[0026] Obtain the input voltage measured by the MEMS gyroscope, and the input voltage carries the offset data;

[0027] Determine that the input voltage is different from the preset voltage.

[0028] In some embodiments, the method further includes:

[0029] Obtain the photography parameters of each image sensing chip;

[0030] According to the preset comparison benchmark, correct the photography parameters of the image sensing chip.

[0031] In a second aspect, an embodiment of the present invention provides a control terminal device, including:

[0032] A plurality of image sensing chips, and each image sensing chip is provided with a MEMS gyroscope;

[0033] A memory, and a database for storing the optimal correction parameters corresponding to the offset data of the MEMS gyroscope is provided in the memory;

[0034] A processor, which is configured to receive the offset data of the image sensing chip measured by the MEMS gyroscope, compare the offset data with the database, and correct the image sensing chip according to the corresponding optimal correction parameters.

[0035] In some embodiments, the control terminal device further includes a tachometer, and a register is further provided in the processor. The tachometer is configured to detect the real-time speed of each image sensing chip, and the register is configured to cache the real-time speed, the offset data, and the corresponding optimal correction parameters.

[0036] In a third aspect, an embodiment of the present invention provides a computer-readable storage medium, storing a computer program, and when the computer program is executed by a processor, it implements the chip control method as described in the first aspect above.

[0037] Embodiments of the present invention include: a processor, a memory, and multiple image sensing chips are provided in the control terminal device of the embodiments of the present invention. Among them, each image sensing chip is internally provided with a MEMS gyroscope, and a database is provided in the memory, and the optimal correction parameters corresponding to the offset data of the MEMS gyroscope are pre-stored in the database. When the user takes a photo, the MEMS gyroscope measures the offset data caused by shaking, etc. of the image sensing chip, and sends the offset data to the processor. The processor compares the received offset data with the data in the database, so as to obtain the optimal correction parameter corresponding to each image sensing chip, and corrects the moving trajectory of the image sensing chip according to the optimal correction parameter, so as to ensure that the shooting remains stable. The chip control method proposed in the present invention can correct the movement of the image sensing chip, ensure the stability of the correlation points between multiple adjacent image sensing chips, improve the anti-interference ability of the device, and improve the image quality.

[0038] Other features and advantages of the present invention will be described in the following specification, and part of them will become obvious from the specification, or be understood by implementing the present invention. The objectives and other advantages of the present invention can be achieved and obtained through the structures specifically pointed out in the specification, claims, and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The drawings are used to provide a further understanding of the technical solutions of the present invention, and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the technical solutions of the present invention, and do not constitute a limitation to the technical solutions of the present invention.

[0040] Figure 1 is a flowchart of the chip control method provided by the embodiments of the present invention;

[0041] Figure 2 is a flowchart of setting a reference chip provided by the embodiments of the present invention;

[0042] Figure 3 is a flowchart of setting reference parameters provided by the embodiments of the present invention;

[0043] Figure 4 is a flowchart of periodic data feedback provided by the embodiments of the present invention;

[0044] Figure 5 is a flowchart of comparing voltages provided by the embodiments of the present invention;

[0045] Figure 6 is a flowchart of correcting photography parameters provided by the embodiments of the present invention;

[0046] Figure 7 is a block diagram of the control terminal device provided by the embodiments of the present invention;

[0047] Figure 8 It is another block diagram of the control terminal device provided by the embodiment of the present invention. Detailed implementation manners

[0048] In order to make the objectives, technical solutions and advantages of the present invention more clear and understandable, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.

[0049] It should be noted that although the functional modules are divided in the module schematic diagram and the logical sequence is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order from the module division in the module or the sequence in the flowchart. Terms such as "first" and "second" in the description, claims and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily need to describe a specific order or sequence.

[0050] The present invention provides a chip control method, which is applied to a control terminal device. The control terminal device includes a processor, a memory and a plurality of image sensing chips. Each image sensing chip is internally provided with a MEMS (MicroElectro Mechanical systems) gyroscope, and a database is set in the memory. The database stores in advance the optimal correction parameters corresponding to the offset data of the MEMS gyroscope. When the user takes a picture, the processor receives the offset data measured by the MEMS gyroscope due to the shaking of the image sensing chip. The processor compares the received offset data with the data in the database to obtain the optimal correction parameter corresponding to each image sensing chip, and corrects the moving trajectory of the image sensing chip according to the optimal correction parameter, so as to ensure that the shooting remains stable. The chip control method proposed in the present invention can correct the movement of the image sensing chip, can realize the connection of the correlation points between multiple adjacent image sensing chips, improve the anti-interference ability of the device, and improve the image quality. The chip control method and the control terminal device described in the embodiments of the present invention are used to more clearly illustrate the technical solutions of the embodiments of the present invention, and do not constitute a limitation to the technical solutions provided by the embodiments of the present invention. Those skilled in the art can know that with the evolution of image acquisition and processing technology and the emergence of new application scenarios, the technical solutions provided by the embodiments of the present invention are also applicable to similar technical problems.

[0051] As Figure 1 shown, Figure 1It is a flowchart of the chip control method provided by the embodiments of the present invention. It can be understood that the present invention proposes a chip control method applied to a control terminal device. Among them, the control terminal device includes a processor, a memory, and multiple image sensing chips. Each image sensing chip is internally provided with a MEMS gyroscope, and a database is set in the memory. The optimal correction parameters corresponding to the offset data of the MEMS gyroscope are pre-stored in the database. The method includes but is not limited to steps S100, S200, and S300.

[0052] Step S100, receive the offset data of each MEMS gyroscope.

[0053] It can be understood that in a terminal device, multiple image sensing chips are usually set. Each image sensing chip is responsible for photographing a corresponding area. There are connection points between multiple adjacent image sensing chips, that is, the content photographed by multiple adjacent image sensing chips has an intersection. After each image sensing chip has finished photographing, the images photographed by all image sensing chips are combined through the connection points to obtain a panoramic image. However, when the user takes a photo, the image sensing chip may shake due to external factors, resulting in the corresponding connection points being unable to maintain contact. Therefore, a MEMS gyroscope is set in the image sensing chip. Through the MEMS gyroscope, the offset data of the image sensing chip can be detected, so as to judge whether the image sensing chip has shifted. It should be noted that the MEMS gyroscope used in the present invention has a faster response speed than other gyroscopes, can better complete information synchronization; and has a small volume, light weight, and is packaged on the same circuit board together with the image sensing chip. Moreover, the MEMS gyroscope has a large measurable range, good reliability, long working life, and can withstand large impacts, and is very suitable for the use scenario proposed by the present invention.

[0054] Furthermore, the MEMS gyroscope of the present invention can also be packaged on the same substrate as the image sensing chip. Compared with the existing one packaged on the same circuit board, the MEMS gyroscope has a faster response speed in transmitting data than being packaged on the same circuit board, can transmit information faster, and when the image sensing chip generates an offset, the processor can simultaneously obtain the offset data of the MEMS gyroscope and the image of the image sensing chip.

[0055] It should be noted that the offset data includes but is not limited to the axis points and angles of the image sensing chip offset during movement. According to the offset data of the image sensing chip, the current offset situation of the image sensing chip can be known and corresponding adjustments can be made.

[0056] Step S200, compare the offset data with the database to obtain the corresponding optimal correction parameters.

[0057] It can be understood that a database is set in the memory, and the offset data that may occur in the image sensing chip and the corresponding optimal correction parameters are pre-stored in the database. After receiving the offset data of the MEMS gyroscope, the processor will compare the offset data with the data in the database to obtain the optimal correction parameters corresponding to the current image sensing chip.

[0058] It should be noted that the database set in the memory in the present invention stores offset data and the corresponding optimal correction parameters. In the chip control method proposed in the present invention, it is necessary to continuously simulate and train multiple MEMS gyroscopes in advance through the processor, and use the processor to process and calculate the offset data measured by the MEMS gyroscope, and then store the best calculation result in the database. That is, by performing model training on multiple MEMS gyroscopes, in the process of actually taking pictures, the data transmission of multiple MEMS gyroscopes is realized, and at the same time, the processor obtains the calculation result according to the model trained in advance in the memory, that is, the corresponding optimal correction parameters, so as to maintain the association points between the image sensing chips.

[0059] Step S300, correct the movement of the image sensing chip according to the optimal correction parameters.

[0060] It can be understood that after obtaining the optimal correction parameters corresponding to each image sensing chip, the processor corrects the movement trajectories of the respective image sensing chips according to the optimal correction parameters, so that the association points between multiple adjacent image sensing chips return to the corresponding states, so that finally a panoramic image can be combined according to the association points. In the present invention, by obtaining the offset parameters of the image sensing chip and comparing them in the database to obtain the corresponding optimal correction parameters, and then correcting the offset trajectory of the image sensing chip according to the optimal correction parameters, the anti-interference ability of shooting is improved, the imaging quality is improved, and the efficiency and reliability of image acquisition are improved in the shooting of panoramic images.

[0061] It should be noted that the control terminal device proposed in the present invention includes a plurality of image sensing chips, and the plurality of image sensing chips are symmetrically arranged. That is, within the set photography area, the image sensing chips need to be arranged so that there are association points between multiple adjacent image sensing chips, and each image sensing chip has a corresponding image sensing chip, so as to ensure the panoramic nature of image acquisition.

[0062] It can be understood that in step S200, when comparing the offset data with the database to obtain the corresponding optimal correction parameters, specifically, according to the preset comparison benchmark, the offset data is compared with the database to obtain the corresponding optimal correction parameters. During the actual use by the user, a benchmark can be preset according to actual needs. With the benchmark unchanged, the movement trajectory of the image sensing chip is corrected according to the preset comparison benchmark, so as to achieve image acquisition.

[0063] As Figure 2 shown, Figure 2 is the flowchart of setting the reference chip provided by the embodiment of the present invention. It can be understood that the chip control method proposed by the present invention further includes, but is not limited to, step S410, step S420, and step S430.

[0064] Step S410, set any one image sensing chip as the reference chip.

[0065] Step S420, determine the offset data of other image sensing chips according to the offset data of the reference chip.

[0066] Step S430, compare the offset data of other image sensing chips with the database to obtain the optimal correction parameters of other image sensing chips.

[0067] It can be understood that in step S410, an image sensing chip can be selected as the reference chip. This reference chip will only be displaced passively due to reasons such as lens jitter, and the processor will not actively adjust the movement trajectory of this reference chip. After setting the reference chip, step S420 is executed. The reference chip is stationary, and other image sensing chips will also maintain their original axis points and angles, or the reference chip moves passively. According to the offset data of all image sensing chips, the offset data of other image sensing chips relative to the reference chip can be obtained, that is, the degree of axis point offset and the offset angle of other image sensing chips relative to the reference chip can be obtained. Then, based on these offset data, a comparison is made in the database to obtain the optimal correction parameters of other image sensing chips. Finally, step S430 is executed, and other image sensing chips correct their movement trajectories according to their respective optimal correction parameters, adjust the movement axis points, and then adjust the angles according to the axis points, so that the association points between other image sensing chips and the reference chip can be continuously maintained unchanged.

[0068] It can be understood that when selecting the reference chip, usually the one located in the middle position of multiple image sensing chips is selected as the reference chip. When determining the offset data of other image sensing chips based on this reference chip, since other image sensing chips are all arranged around the reference chip, the offset data can be quickly determined, so as to correct the movement trajectory of the image sensing chip and improve the anti-interference performance of the device.

[0069] As Figure 3 shown, Figure 3 FIG. is a flowchart for setting reference parameters provided by an embodiment of the present invention. It can be understood that the chip control method proposed by the present invention further includes, but is not limited to, steps S510, S520, and S530.

[0070] Step S510: Preset reference parameters, where the reference parameters include a reference axis point and a reference angle.

[0071] Step S520: Determine the offset data of the image sensor chip according to the reference parameters.

[0072] Step S530: Compare the offset data with the database to obtain the optimal correction parameters.

[0073] It can be understood that in step S510, a specific axis point and angle can also be selected as the reference, that is, set the reference axis point and the reference angle, and use the preset axis point and angle as the reference parameters. Since there are associated points between the image sensor chips, when any image sensor chip moves and offsets the reference axis point and the reference angle, the angle of the image sensor chip will change. When one or more image sensor chips offset the preset axis point or the preset angle, the offset image sensor chip will send its own offset data to the processor. At this time, the processor executes step S520 to determine the offset data of the image sensor chip according to the reference axis point and the reference angle, that is, to determine the degree of offset of the axis point and the angle of each image sensor chip relative to the reference axis point and the reference angle. Then, the processor executes step S530 to compare the received offset data with the data in the database, thereby determining the corresponding optimal correction parameters and sending these optimal correction parameters to the corresponding image sensor chips, so as to adjust the axis point and the angle of these offset image sensor chips, that is, to adjust their movement trajectories, so that they return to a specific image area, and keep the associated points stable between adjacent image sensor chips, thereby improving the panoramic image imaging quality.

[0074] It should be noted that the preset comparison reference proposed in the present invention can be to use a certain image sensor chip as the reference chip to adjust the movement trajectories of other image sensor chips; it can also be to use a specific axis point and angle as the reference to adjust all image sensor chips. Other comparison references can also be set, as long as it can meet the requirement of correcting the movement trajectories of the offset image sensor chips to ensure the stability of the associated points between multiple adjacent image sensor chips. The present invention does not make specific limitations on this.

[0075] As Figure 4 shown, Figure 4It is a flowchart of periodic data feedback provided by an embodiment of the present invention. It can be understood that the control terminal device proposed by the present invention further includes a tachometer, and a register is set in the processor. After comparing the offset data with the database according to a preset comparison benchmark to obtain the corresponding optimal correction parameter, it further includes but is not limited to steps S610, S620, S630, S640, and S650.

[0076] Step S610: Obtain the real-time speed of the image sensor chip.

[0077] Step S620: Cache the offset data and the real-time speed into the register.

[0078] Step S630: Cache the optimal correction parameter corresponding to the offset data into the register.

[0079] Step S640: Determine that the occurrence repetition times of the offset data and the real-time speed cached in the register reach a preset threshold.

[0080] Step S650: Call the optimal correction parameter corresponding to the offset data in the register.

[0081] It can be understood that the tachometer proposed in this embodiment is used to detect the real-time speed of each current image sensor chip, and the register is used to cache the data input by the MEMS gyroscope. First, step S610 is executed to measure the real-time speed of the image sensor chip by the tachometer, and then step S620 is executed to cache the offset data and the real-time speed of the image sensor chip into the register. At this time, after the processor compares with the database and obtains the optimal correction parameter, step S630 is executed to cache the optimal correction parameter corresponding to the offset data into the register. When the MEMS gyroscope in the image sensor chip moves back and forth, the offset data, real-time speed, and optimal correction parameter cached in the register will also appear periodically repeated. The image sensor chip moves until step S640 is executed to determine that the occurrence repetition times of the offset data and the real-time speed cached in the register reach a preset threshold, that is, the movement of each current image sensor chip is a periodic reciprocating movement, and the axis points, angles, and real-time speeds of each image sensor chip per frame remain unchanged. When it is determined that the periodic repetition times reach the preset threshold, in the subsequent data processing, the processor can directly grab the corresponding optimal correction parameter in the register, so as to directly adjust the image sensor chip. When it is determined that the occurrence repetition times of the offset data and the real-time speed cached in the register reach the preset threshold, when the processor receives new offset data, it can directly compare and call the corresponding optimal correction parameter in the register of the processor, without having to compare and call data from the database in the memory, improving the operation speed of the device.

[0082] It should be noted that a trigger module is also provided in the processor. The trigger module is used to determine whether the number of repetitions of the offset data and the real-time speed cached in the register has reached a preset threshold. When the trigger module is activated, the processor does not need to compare with the database in the memory anymore, but can directly grab the remaining optimal correction parameters in the register during this cycle and send the optimal correction parameters to the corresponding image sensor chip, so as to adjust its movement trajectory.

[0083] It should be noted that when the MEMS gyroscope stops inputting periodic offset data, there is no corresponding data cached in the register. Therefore, when the processor fails to compare successfully in the register, the processor re-compares with the database in the memory and completes the call of the optimal correction parameters.

[0084] It should be noted that the preset threshold proposed by the present invention refers to the number value set by the user according to actual needs, which can be two, three or a larger value. After the number of repetitions of data transmission reaches the preset threshold, the trigger module is activated, and the processor directly performs data comparison and call in the register. The present invention does not specifically limit the size of the preset threshold.

[0085] As Figure 5 shown, Figure 5 is a flowchart of comparing voltages provided by an embodiment of the present invention. It can be understood that the control terminal device of the present invention further includes a voltmeter. Before Figure 1 step S100, it further includes but is not limited to step S710 and step S720.

[0086] Step S710, obtain the input voltage measured by the MEMS gyroscope, and the input voltage carries offset data.

[0087] Step S720, determine that the input voltage is different from the preset voltage.

[0088] It can be understood that a voltmeter is provided in the MEMS gyroscope. The voltmeter is used to detect the current input voltage and compare the input voltage with a preset voltage. Since the input voltage carries the offset data of the MEMS gyroscope, that is, the input voltage carries information such as the axis point and angle of the MEMS gyroscope. Therefore, according to the axis point, angle, etc. information when the MEMS gyroscope has no offset, a preset voltage is set. Then, when the input voltage is detected, the input voltage is compared with the preset voltage. If the input voltage is the same as the preset voltage, it means that the image sensor chip has not moved during the shooting of this frame. Therefore, the MEMS gyroscope does not need to send data such as the axis point and angle corresponding to this frame to the processor; when the input voltage is different from the preset voltage, it means that the image sensor chip has shifted during the shooting of this frame. Therefore, the MEMS gyroscope needs to send the offset data of this frame to the processor so that the processor can correct the movement trajectory of the image sensor chip. The setting of the voltmeter enables a preliminary judgment on whether the image sensor chip has shifted inside the MEMS gyroscope. Only when it is determined that a shift has occurred, the offset data is sent to the processor for correction, improving the efficiency of the device in processing data.

[0089] As Figure 6 shown, Figure 6 is a flowchart of the photographic parameter correction provided by an embodiment of the present invention. It can be understood that the chip control method proposed by the present invention further includes, but is not limited to, step S810 and step S820.

[0090] Step S810: Obtain the photographic parameters of each image sensor chip.

[0091] Step S820: Correct the photographic parameters of the image sensor chip according to a preset comparison benchmark.

[0092] It can be understood that during the process of capturing images, since multiple images captured by multiple image sensing chips need to be combined, it is necessary to correct the offset data, associated point overlap, and color issues of these images in order to further export the images. Specifically, the offset data correction can be adjusted according to the corresponding optimal correction parameters. The problem of associated point overlap can be addressed by fusing the overlapping images within the associated points, and aligning multiple images based on the associated points among multiple image sensing chips. After removing the redundant image parts, a new image is formed by combination. For the correction of color issues, first step S810 is executed to obtain the photography parameters of each image sensing chip, and then adjustment is required through a preset comparison benchmark. For example, when selecting a certain image sensing chip as the reference chip, the image captured by the processor through this reference chip is used as the benchmark, and based on this, the color data of other image sensing chips is replaced. If a certain axis point and angle are selected as the benchmark, the image sensing chip closest to the benchmark axis point and with the closest benchmark parameters is used as the reference chip. Specifically, the photography parameters proposed by the present invention include, but are not limited to, aperture coefficient, sensitivity, and exposure compensation. After completing the correction of the photography parameters, the images captured by all image sensing chips are combined to obtain a panoramic image.

[0093] As Figure 7 shown, Figure 7It is a block diagram of a module for controlling a terminal device provided by an embodiment of the present invention. It can be understood that a second aspect of the present invention proposes a control terminal device 100, which includes a memory 120, a processor 110, and multiple image sensing chips 130. Among them, a MEMS gyroscope 131 is provided in each image sensing chip 130, and the MEMS gyroscope 131 can detect the offset data of the image sensing chip 130; a database for storing the optimal correction parameters corresponding to the offset data of the MEMS gyroscope 131 is provided in the memory 120; the processor 110 is configured to receive the offset data of the image sensing chip 130 measured by the MEMS gyroscope 131, compare the offset data with the database, and correct the image sensing chip 130 according to the corresponding optimal correction parameters. When the user takes a picture, the MEMS gyroscope 131 measures the offset data of the image sensing chip 130 caused by shaking and the like, and sends the offset data to the processor 110. The processor 110 compares the received offset data with the data in the database, so as to obtain the optimal correction parameters corresponding to each image sensing chip 130, and corrects the movement trajectory of the image sensing chip 130 according to the optimal correction parameters, so as to ensure that the shooting remains stable. The chip control method proposed in the present invention can correct the movement of the image sensing chip 130, so as to ensure the stability of the association points between multiple adjacent image sensing chips 130, improve the anti-interference ability of the device, and improve the image quality.

[0094] As Figure 8 shown, Figure 8It is another module block diagram of the control terminal device provided by the embodiments of the present invention. It can be understood that a tachometer is further included in the control terminal device 100, and a register 111 is further provided in the processor 110. The tachometer is used to detect the real-time speeds of the first image sensing chip 132 and the second image sensing chip 134, and the register 111 is used to cache the real-time speeds, offset data, and corresponding optimal correction parameters. During actual shooting, first, the real-time speeds of the first image sensing chip 132 and the second image sensing chip 134 are measured by the tachometer, and then the offset data and the real-time speeds of the first image sensing chip 132 and the second image sensing chip 134 are cached in the register 111. At this time, after the processor 110 obtains the optimal correction parameter from the database 121, the optimal correction parameter is cached in the register 111. When the first MEMS gyroscope 133 in the first image sensing chip 132 and the second MEMS gyroscope 135 in the second image sensing chip 134 move back and forth, the offset data, real-time speeds, and optimal correction parameters cached in the register 111 will also repeat periodically. When the first image sensing chip 132 and the second image sensing chip 134 move, at this time, the processor 110 makes a determination to determine that the number of repetitions of the offset data and the real-time speeds cached in the register 111 reaches a preset threshold, that is, the current movement of each image sensing chip 130 is a periodic reciprocating movement, and the axis points, angles, and real-time speeds of each movement of the first image sensing chip 132 and the second image sensing chip 134 remain unchanged. When it is determined that the number of periodic repetitions reaches the preset threshold, the processor 110 directly grabs the corresponding optimal correction parameter in the register 111 according to the received offset data, so as to directly adjust the movement trajectories of the first image sensing chip 132 and the second image sensing chip 134, thereby ensuring that the correlation points between the first image sensing chip 132 and the second image sensing chip 134 remain stable. When it is determined that the number of repetitions of the offset data and the real-time speeds cached in the register reaches the preset threshold, when the processor 110 receives new offset data, it can directly compare and call the corresponding optimal correction parameter in the register in the processor 110, without having to compare and call data from the database in the memory 120, which improves the operation speed of the device.

[0095] It should be noted that in the above embodiment, the first image sensing chip 132 and the second image sensing chip 134 are selected as examples to appropriately describe the working process of the control terminal device proposed by the present invention, which does not mean that there are only two image sensing chips in the embodiments of the present invention. The number of image sensing chips provided in the control terminal device of the present invention is not specifically limited.

[0096] The memory 120, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs and non-transitory computer-executable programs, such as the chip control method in the above embodiments of the present invention. The processor 110 realizes the chip control method in the above embodiments of the present invention by running the non-transitory software programs and instructions stored in the memory 120.

[0097] The memory may include a program storage area and a data storage area. Among them, the program storage area can store an operating system and application programs required for at least one function; the data storage area can store data required for implementing the chip control method in the above embodiments, etc. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state storage devices. It should be noted that the memory may optionally include memories remotely provided relative to the processor, and these remote memories can be connected to the terminal through a network. Examples of the above network include but are not limited to the Internet, an enterprise intranet, a local area network, a mobile communication network, and combinations thereof.

[0098] The non-transitory software programs and instructions required to implement the chip control method in the above embodiments are stored in the memory. When executed by one or more processors, the chip control method in the above embodiments is executed. For example, the method steps S100 to step S300 described above, Figure 1 the method steps S410 to step S430 in, Figure 2 the method steps S510 to step S530 in, Figure 3 the method steps S610 to step S650 in, Figure 4 the method steps S710 to step S720 in, Figure 5 and the method steps S810 to step S820 in, Figure 6 are executed, and at least one of them.

[0099] The present invention also provides a computer-readable storage medium. The computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to make a computer execute the chip control method in the above embodiments. For example, the method steps S100 to step S300 described above, Figure 1 the method steps S410 to step S430 in, Figure 2 the method steps S510 to step S530 in, Figure 3 the method steps S610 to step S650 in, Figure 4 the method steps S710 to step S720 in, Figure 5 and the method steps S810 to step S820 in, Figure 6 are executed, and at least one of them.

[0100] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0101] Those of ordinary skill in the art can understand that all or some of the steps and systems disclosed in the above methods can be implemented as software, firmware, hardware and their appropriate combinations. Some physical components or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application specific integrated circuit. Such software can be distributed on a computer-readable medium, which can include a computer storage medium (or non-transitory medium) and a communication medium (or transitory medium). As is well known to those of ordinary skill in the art, the term computer storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cassette, tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media typically includes computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and can include any information delivery medium.

[0102] The embodiments of the present invention have been described in detail above with reference to the accompanying drawings. However, the present invention is not limited to the above embodiments, and various changes can be made without departing from the spirit of the present invention within the scope of knowledge possessed by those of ordinary skill in the art.

Claims

1. A chip control method, which is applied to a control terminal device. The control terminal device includes a processor, a memory, and multiple image sensing chips. Each of the image sensing chips is internally provided with a MEMS gyroscope. A database for storing the optimal correction parameters corresponding to the offset data of each MEMS gyroscope is set in the memory. The method includes: Receiving the offset data of each of the MEMS gyroscopes; Comparing the offset data with the database to obtain the corresponding optimal correction parameters; The control terminal device further includes a tachometer, and a register is set in the processor. After comparing the offset data with the database to obtain the corresponding optimal correction parameters, it further includes: Obtaining the real-time speed of the image sensing chip; Caching the offset data and the real-time speed into the register; Caching the optimal correction parameters corresponding to the offset data into the register; Determining that the occurrence frequency of the offset data and the real-time speed cached in the register reaches a preset threshold; Invoking the optimal correction parameters corresponding to the offset data in the register; Correcting the movement of the image sensing chip according to the optimal correction parameters.

2. The chip control method according to claim 1, wherein The comparing the offset data with the database to obtain the corresponding optimal correction parameters specifically is: Comparing the offset data with the database according to a preset comparison criterion to obtain the corresponding optimal correction parameters.

3. The chip control method according to claim 2, characterized in that, The comparing the offset data with the database according to a preset comparison criterion to obtain the corresponding optimal correction parameters includes: Setting any one of the image sensing chips as a reference chip; Determining the offset data of other image sensing chips according to the offset data of the reference chip; Comparing the offset data of other image sensing chips with the database to obtain the optimal correction parameters of other image sensing chips.

4. The chip control method according to claim 2, characterized in that, The comparing the offset data with the database according to a preset comparison criterion to obtain the corresponding optimal correction parameters includes: Presetting a reference parameter, where the reference parameter includes a reference axis point and a reference angle; Determining the offset data of the image sensing chip according to the reference parameter; Comparing the offset data with the database to obtain the optimal correction parameters.

5. The chip control method according to claim 1, wherein, A voltmeter is set in the MEMS gyroscope. Before receiving the offset data of each MEMS gyroscope, it further includes: Obtaining the input voltage measured by the MEMS gyroscope, and the input voltage carries the offset data; Determining that the input voltage is different from a preset voltage.

6. The chip control method according to claim 2, wherein The method further includes: Obtaining the photography parameters of each of the image sensing chips; Correcting the photography parameters of the image sensing chip according to the preset comparison criterion.

7. A control terminal device for implementing the chip control method according to any one of claims 1-6, characterized in that, It includes: Multiple image sensing chips, and each of the image sensing chips is internally provided with a MEMS gyroscope; A memory, and a database for storing the optimal correction parameters corresponding to the offset data of each MEMS gyroscope is set in the memory; A processor, which is configured to receive the offset data of the image sensing chip measured by the MEMS gyroscope, compare the offset data with the database, and correct the image sensing chip according to the corresponding optimal correction parameters; The control terminal device further includes a tachometer, and a register is further provided in the processor. The tachometer is configured to detect the real-time speed of each image sensing chip, and the register is configured to cache the real-time speed, the offset data, and the corresponding optimal correction parameters.

8. A computer-readable storage medium, characterized in that, A computer program is stored, and when the computer program is executed by a processor, the chip control method according to any one of claims 1 to 6 is implemented.

Citation Information

Patent Citations

  • Processing method and device in panoramic shooting and mobile terminal

    CN106231180A

  • Video splicing method, device and system, computer equipment and storage medium

    CN112437253A