Table tennis path image acquisition method, image acquisition system and readable storage medium

Abstract

The invention belongs to the technical field of image data processing, and particularly relates to a table tennis path image acquisition method, an image acquisition system and a readable storage medium, the table tennis path image acquisition method comprises the following steps: an image sensor captures continuous multi-frame images in real time, and defines the continuous multi-frame images as real frames; constructing at least one virtual frame image before capturing a second real frame image by taking one real frame image as a starting point, and embedding the virtual frame image between the two real frame images to form a compact continuous real-time image; according to the invention, the pixel unit in the image sensor is arranged to collect the color of the pixel point and detect the change of the voltage value, through the combination of the two, the motion path of the table tennis ball is simulated between two real frame images, a plurality of virtual frame images between the two real frame images are synthesized, and a compact continuous real-time image is formed. Therefore, the detected motion trail of the ping-pong is more accurate, the requirement of high-speed shooting is met without the help of a high-speed sensor, and the motion trail of the ping-pong moving at a high speed is better restored.

Description

Technical Field

[0001] The present invention belongs to the technical field of image data processing, and specifically relates to a method for determining the posture of an object, and more particularly to a table tennis path image acquisition method, an image acquisition system, and a readable storage medium. Background Art

[0002] Table tennis balls are fast, spin strongly, and vary in many ways. The human eye and traditional camera equipment cannot fully reproduce the movement trajectory of a table tennis ball. However, accurate table tennis ball movement trajectory can identify technical deficiencies, objectively evaluate training effects and the degree of technical improvement, analyze the actual path effects of specific tactics (such as serve and attack, stalemate line combinations), and optimize tactical execution. This is very important for improving athletes' training level and efficiency, and optimizing coaches' guidance and decision-making.

[0003] At the same time, even in professional training venues, not every training table is equipped with a camera module with a high-speed sensor. When these devices need to shoot a high-speed moving table tennis ball, the camera identifies the red, yellow and blue areas through each pixel point and synthesizes the corresponding colors to form a complete image. Due to the calculation process, there is a time difference in the path tracking of such synthetic color moving objects, and traditional image recognition algorithms cannot fully reproduce the movement path of the table tennis ball.

[0004] The camera captures a yellow ping-pong ball, and each pixel point calculates the yellow area by combining the red area and the green area. The camera captures a white ping-pong ball, and each pixel point calculates the white area by combining the red area, the green area, and the blue area. This cannot fully reproduce the movement path of the ping-pong ball, which has an adverse effect on motion evaluation.

[0005] Therefore, there is an urgent need to develop a new table tennis path image acquisition method, image acquisition system and readable storage medium to solve the technical problem that the motion path of an object between two frames of images cannot be reproduced.

[0006] It should be noted that the above information disclosed in this background technology section is only used to understand the background technology of the present application concept, and therefore, the above description is not considered to constitute information of the prior art. Summary of the Invention

[0007] The embodiments of the present disclosure at least provide a table tennis path image acquisition method, an image acquisition system, and a readable storage medium.

[0008] In a first aspect, an embodiment of the present disclosure provides a table tennis path image acquisition method, comprising: a processor capturing multiple consecutive frames of images in real time through an image sensor and defining them as real frames; in the processor, starting from one of the real frame images, before capturing the next real frame image, constructing at least one virtual frame image to be embedded between the two real frame images to form a dense continuous real-time image; wherein, the method of constructing the virtual frame image comprises: the processor marking the table tennis outline in the initial real frame image, and selecting an area in the initial real frame image, and the selected area completely covers the table tennis outline; the processor controls each pixel unit in the selected area in the image sensor to perform real-time voltage acquisition; during the table tennis movement, the processor obtains the voltage changes of the corresponding pixel units around the table tennis outline in the selected area to simulate the movement path of the table tennis; the processor synthesizes the virtual frame image through the initial real frame image, the table tennis outline and the movement path.

[0009] In an optional embodiment, the method for capturing a real frame image includes: a processor controlling each pixel unit in an image sensor to collect corresponding colors respectively; and the processor arranging each color in sequence to form a real frame image.

[0010] In an optional embodiment, the method for real-time voltage acquisition by pixel units includes: four photosensitive areas are set in each pixel unit, and the four photosensitive areas are arranged in two rows and two columns; the four photosensitive areas are respectively a first green light photosensitive area, a first red light photosensitive area, a first blue light photosensitive area and a second green light photosensitive area, the first green light photosensitive area is diagonally arranged to the second green light photosensitive area, and the first red light photosensitive area is diagonally arranged to the first blue light photosensitive area; the pixel units respectively collect voltage values ​​corresponding to the first green light photosensitive area, the first red light photosensitive area, the first blue light photosensitive area and the second green light photosensitive area.

[0011] In an optional embodiment, the method for simulating the movement path of a table tennis ball includes: when part of the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area in any pixel unit, but not all of the areas are blocked by a moving object, the pixel unit respectively collects the voltage values ​​corresponding to the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area, that is, the pixel unit simulates the movement path of the table tennis ball by changing the voltage values ​​corresponding to the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area.

[0012] In an optional embodiment, the method for simulating the movement path of a table tennis ball further includes: taking one of the real frame images as a starting point in the processor, the processor controls each pixel unit to simulate the initial movement point and movement baseline of the object through the voltage values ​​corresponding to the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area; during the movement of the table tennis ball, the processor controls each pixel unit to simulate the movement path of the table tennis ball from the initial movement point relative to the movement baseline through the voltage value changes corresponding to the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area.

[0013] In an optional embodiment, the method for simulating the motion path of a table tennis ball further includes: each pixel unit overlaps the corresponding motion reference line and superimposes the motion path of each initial motion point relative to the motion reference line in time sequence to form a complete motion path.

[0014] In an optional embodiment, the method for synthesizing a virtual frame image includes: determining the center point of the ping-pong outline in the initial real frame image, and aligning the starting point of the motion path simulated during the table tennis movement with the center point of the ping-pong outline in the initial real frame image; after the end point of the motion path coincides with the center point of the ping-pong outline, eliminating the ping-pong outline and the motion path at the starting point of the motion path to synthesize the virtual frame image.

[0015] In an optional embodiment, the processor captures multiple consecutive frames of images through an image sensor and defines them as real frame images; between adjacent real frame images, at least one virtual supplementary frame image is constructed to be embedded between the two real frame images to form a continuous image; wherein, the method of constructing the virtual supplementary frame image includes: the processor marks the ping-pong outline in any real frame image, and selects an area in the real frame image, and the selected area completely covers the ping-pong outline; the processor retrieves historical data from the image sensor; the processor simulates the movement path of the ping-pong ball between two adjacent real frame images through the historical data; the processor synthesizes the virtual supplementary frame image through the corresponding real frame image, the ping-pong outline and the movement path.

[0016] In an optional implementation, the historical data includes: a voltage value of each pixel unit in the image sensor at each moment during voltage acquisition.

[0017] In a second aspect, an embodiment of the present disclosure also provides an image acquisition system that adopts the table tennis path image acquisition method as described above, comprising: a processor and an image sensor; the processor is configured to capture multiple consecutive frames of images in real time through the image sensor and define them as real frames; the processor is also configured to take one of the real frame images as a starting point and, before capturing the next real frame image, construct at least one virtual frame image to be embedded between the two real frame images to form a dense continuous real-time image.

[0018] In an optional embodiment, the image sensor includes a plurality of pixel units, and a color acquisition circuit and a chromaticity photosensitive circuit are respectively provided in each pixel unit; the processor is configured to control the color acquisition circuit in the pixel unit to acquire corresponding colors; the processor is also configured to control the chromaticity photosensitive circuit in the pixel unit to acquire voltage values ​​corresponding to the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area.

[0019] In a second aspect, an embodiment of the present disclosure further provides a readable storage medium having a computer program / instruction stored thereon, wherein the computer program / instruction, when executed by a processor, implements the steps of the above-mentioned table tennis path image acquisition method.

[0020] The beneficial effect of the present invention is that, by setting the pixel unit in the image sensor to collect the color of the pixel point and the detection voltage value change, the present invention can simulate the movement path of the table tennis ball between two real frame images through the combination of the two real frame images, synthesize several virtual frame images between the two real frame images, and form a dense continuous real-time image, so that the detected movement trajectory of the table tennis ball is more accurate, and the needs of high-speed shooting are met without the help of high-speed sensors, and the movement trajectory of high-speed moving table tennis can be better restored.

[0021] Other features and advantages of the present invention will be described in the following description, and in part will become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention are realized and obtained by the structures particularly pointed out in the description and the drawings.

[0022] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the specific embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0024] Figure 1 A flowchart of a table tennis path image acquisition method provided by an embodiment of the present disclosure; Figure 2 A flowchart of a method for constructing a virtual frame image provided by an embodiment of the present disclosure; Figure 3 A schematic diagram of a real frame image provided by an embodiment of the present disclosure; Figure 4 A schematic diagram of a pixel unit collecting voltage according to an embodiment of the present disclosure; Figure 5 A schematic diagram of a simulated motion path provided by an embodiment of the present disclosure; Figure 6 A block diagram of an image acquisition system according to an embodiment of the present disclosure; Figure 7 A schematic diagram of image acquisition of an image acquisition system provided in an embodiment of the present disclosure.

[0025] In the picture: 1. Real frame image; 2. Frame selection area; 3. Ping-pong outline; 4. Initial motion point; 5. Motion baseline; 6. Virtual frame image; 7. Virtual supplementary frame. DETAILED DESCRIPTION

[0026] To make the objectives, technical solutions, and advantages of the embodiments of the present invention more clear, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of them. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0027] The terms used herein are only used to describe specific exemplary configurations and are not intended to be limiting. As used herein, the singular articles "a", "an" and "the" may also be intended to include plural forms, unless otherwise clearly indicated herein. The terms "comprise", "include" and "have" are inclusive and therefore specify the presence of features, steps, operations, elements and / or components, but do not exclude the presence or addition of one or more other features, steps, operations, elements, components and / or combinations thereof. The method steps, processes and operations described herein should not be interpreted as necessarily requiring them to be performed in the particular order discussed or shown, unless specifically identified as an execution order. Additional or alternative steps may be adopted.

[0028] As used herein, the phrases "in one embodiment," "according to one embodiment," "in some embodiments," and the like generally refer to the fact that the particular feature, structure, or characteristic following the phrase may be included in at least one embodiment of the present disclosure. Thus, a particular feature, structure, or characteristic may be included in more than one embodiment of the present disclosure, such that these phrases do not necessarily refer to the same embodiment. As used herein, the terms "example," "exemplary," and the like are used to "serve as an example, instance, or illustration." Any implementation, aspect, or design described herein as "example" or "exemplary" is not necessarily to be construed as preferred or advantageous over other implementations, aspects, or designs. Instead, the use of the terms "example," "exemplary," and the like is intended to present concepts in a concrete manner.

[0029] Research has found that with the development of APPs for motion evaluation, it is necessary to combine motion paths to evaluate motion effects. However, general intelligent devices are not equipped with high-speed cameras, and traditional cameras capture each frame of images through Bayer arrangement. Therefore, they can only estimate the motion path of the object between the two frames of images through two frames of images. There is a certain error, and the motion path of the object cannot be fully reproduced.

[0030] Based on the above research, the embodiments of the present disclosure provide a table tennis path image acquisition method, an image acquisition system and a readable storage medium, which can realize high-speed shooting of the object's motion path without the help of a high-speed sensor, and can better restore the motion path of a high-speed moving object.

[0031] The defects in the above solutions are the results obtained by the inventors after practice and careful research. Therefore, the process of discovering the above problems and the solutions proposed by this disclosure for the above problems below should be the contributions made by the inventors to this disclosure during the disclosure process.

[0032] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, it does not need to be further defined or explained in subsequent drawings.

[0033] The following embodiments of the present invention are described in detail with reference to the accompanying drawings. In the absence of conflict, the following embodiments and features therein may be combined with each other.

[0034] like Figures 1 to 6As shown, at least one embodiment provides a table tennis path image acquisition method, which includes: a processor captures multiple consecutive frames of images in real time through an image sensor and defines them as real frames; in the processor, taking one of the real frame images 1 as a starting point, before capturing the next real frame image 1, constructs at least one virtual frame image to be embedded between the two real frame images 1 to form a dense continuous real-time image; wherein, the method of constructing the virtual frame image includes: the processor marks the table tennis outline 3 in the initial real frame image 1, and selects an area 2 in the initial real frame image 1, and the selected area 2 completely covers the table tennis outline 3; the processor controls each pixel unit located in the selected area 2 in the image sensor to perform real-time voltage acquisition; during the table tennis movement, the processor obtains the voltage changes of the corresponding pixel units located around the table tennis outline 3 in the selected area 2 to simulate the movement path of the table tennis; the processor synthesizes the virtual frame image through the initial real frame image 1, the table tennis outline 3 and the movement path.

[0035] In at least one embodiment, the present invention sets a pixel unit in an image sensor to collect the color of pixel points and detect changes in voltage values. By combining the two, it is possible to simulate the movement path of a table tennis ball between two real frame images 1, synthesize several virtual frame images between the two real frame images 1, and form a dense continuous real-time image, so that the detected movement trajectory of the table tennis ball is more accurate, and the needs of high-speed shooting are met without the help of high-speed sensors, and the movement trajectory of high-speed moving table tennis can be better restored.

[0036] In at least one embodiment, see Figure 3 The method for capturing a real frame image 1 includes: a processor controlling each pixel unit in the image sensor to collect corresponding colors respectively; and the processor arranging each color in sequence to form a real frame image 1.

[0037] Specifically, when the pixel unit performs color acquisition, each pixel point synthesizes the corresponding color through the percentage of the red area, the green area, and the blue area, that is, the color of the pixel point is obtained.

[0038] In at least one embodiment, see Figure 3 The processor controls each pixel unit in the frame selection area 2 of the image sensor to detect the voltage value change respectively.

[0039] The position of the framed area 2 should be smaller than 5% of the effective shooting area of ​​a traditional camera. If the effective shooting area exceeds 5%, the power consumption and heat generation of the traditional camera will be difficult to control.

[0040] Specifically, there is an interval between the two frames of real frame images 1, and the pixel unit needs this interval to calculate the color of the pixel point. Therefore, the movement path of the object between the two frames of real frame images 1 cannot be captured by the pixel unit when performing color acquisition. The pixel unit directly detects the change in voltage value during voltage detection, so it can simulate the movement path of the object in real time and realize the reproduction of the object's movement process.

[0041] In at least one embodiment, see Figure 3 、 Figure 4 The method for real-time voltage acquisition by a pixel unit includes: four photosensitive areas are respectively set in each pixel unit, and the four photosensitive areas are arranged in two rows and two columns; the four photosensitive areas are respectively a first green light photosensitive area, a first red light photosensitive area, a first blue light photosensitive area and a second green light photosensitive area, the first green light photosensitive area is diagonally arranged to the second green light photosensitive area, and the first red light photosensitive area is diagonally arranged to the first blue light photosensitive area; the pixel unit respectively collects voltage values ​​corresponding to the first green light photosensitive area, the first red light photosensitive area, the first blue light photosensitive area and the second green light photosensitive area.

[0042] Specifically, the first green light photosensitive area is G1, the first red light photosensitive area is R, the first blue light photosensitive area is B, and the second green light photosensitive area is G2.

[0043] Specifically, see Figure 3 In the figure, the solid line part and the dotted line part are the voltage values ​​corresponding to the first green light photosensitive area, the first red light photosensitive area, the first blue light photosensitive area, and the second green light photosensitive area at two moments respectively.

[0044] In at least one embodiment, see Figure 4 The method for simulating the movement path of a table tennis ball includes: when part but not all of the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area in any pixel unit are blocked by a moving object, the pixel unit respectively collects voltage values ​​corresponding to the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area, that is, the pixel unit simulates the movement path of the table tennis ball by changing the voltage values ​​corresponding to the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area.

[0045] Specifically, when the first green light photosensitive area, the first red light photosensitive area, the first blue light photosensitive area, and the second green light photosensitive area are blocked by the ping-pong ball, the voltage values ​​will change, so the movement path of the ping-pong ball can be simulated by the changes in the voltage values ​​of each photosensitive area.

[0046] In at least one embodiment, see Figure 5The method for simulating the movement path of a table tennis ball also includes: using one of the real frame images 1 as a starting point in the processor, the processor controls each pixel unit to simulate the initial movement point 4 and the movement reference line 5 of the object through the voltage values ​​corresponding to the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area; during the movement of the table tennis ball, the processor controls each pixel unit to simulate the movement path of the table tennis ball from the initial movement point 4 relative to the movement reference line 5 through the voltage value changes corresponding to the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area.

[0047] Specifically, the initial position of the motion path (initial motion point 4) and the simulated path (the simulated path points to the position at the next moment) are drawn, and the motion baseline 5 is drawn in yellow (requires synthesis of green and red) or blue (requires synthesis of three colors). At this time, based on the changes in the voltage of the two green areas, if the acquisition time is short enough and the number of acquisitions is large enough, the trend of the path pixel point offset of the simulated path at the current time will be calculated more accurately.

[0048] In at least one embodiment, see Figure 5 The method for simulating the motion path of a table tennis ball further includes: each pixel unit overlaps the corresponding motion reference line 5 and superimposes the motion paths of each initial motion point 4 relative to the motion reference line 5 in chronological order to form a complete motion path.

[0049] Specifically, each pixel unit is triggered at a different time, but the movement trend at the corresponding moment is consistent. Therefore, by superimposing the movement paths of each initial movement point 4 relative to the movement reference line 5 in chronological order, an accurate and complete movement path can be obtained.

[0050] In at least one embodiment, see Figure 5 The method for synthesizing a virtual frame image includes: determining the center point of a ping-pong outline 3 in an initial real frame image 1, aligning the starting point of a motion path simulated during table tennis movement with the center point of the ping-pong outline 3 in the initial real frame image 1; after the end point of the motion path coincides with the center point of the ping-pong outline 3, eliminating the ping-pong outline 3 and the motion path at the starting point of the motion path to synthesize the virtual frame image.

[0051] Specifically, the voltage value of each pixel unit is monitored in real time, and normal power-off is not involved. After entering the next frame, the photographed object is compared and the area that needs to enter special encoding is switched, while normal encoding processing is still performed in other places.

[0052] In at least one embodiment, see Figure 7The processor captures multiple consecutive frames of images through an image sensor and defines them as real frame images 1; between adjacent real frame images 1, at least one virtual supplementary frame 7 image is constructed to be embedded between the two real frame images 1 to form a continuous image; wherein, the method for constructing the virtual supplementary frame 7 image includes: the processor marks the ping-pong outline 3 in any real frame image 1, and selects an area 2 in the real frame image 1, and the selected area 2 completely covers the ping-pong outline 3; the processor calls the historical data of the image sensor; the processor simulates the movement path of the ping-pong ball between two adjacent real frame images 1 through the historical data; the processor synthesizes the virtual supplementary frame 7 image through the corresponding real frame image 1, the ping-pong outline 3 and the movement path.

[0053] Specifically, see Figure 7 , the remaining steps of synthesizing the virtual supplementary frame 7 image are the same as the steps of synthesizing the virtual frame image.

[0054] In at least one embodiment, the historical data includes: a voltage value of each pixel unit in the image sensor at each moment when the voltage is collected.

[0055] Based on the same technical concept, please refer to Figures 1 to 6 At least one embodiment also provides an image acquisition system using the table tennis path image acquisition method as described above, comprising: a processor and an image sensor; the processor is configured to capture multiple consecutive frames of images in real time through the image sensor and define them as real frames; the processor is further configured to use one of the real frame images 1 as a starting point and, before capturing the next real frame image 1, construct at least one virtual frame image to be embedded between the two real frame images 1 to form a dense continuous real-time image.

[0056] In at least one embodiment, the image sensor includes a plurality of pixel units, and a color acquisition circuit and a chromaticity photosensitive circuit are respectively provided in each pixel unit; the processor is configured to control the color acquisition circuit in the pixel unit to acquire corresponding colors; the processor is also configured to control the chromaticity photosensitive circuit in the pixel unit to acquire voltage values ​​corresponding to the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area.

[0057] Based on the same technical concept, at least one embodiment further provides a readable storage medium having a computer program / instruction stored thereon, characterized in that when the computer program / instruction is executed by a processor, the steps of the above-mentioned table tennis path image acquisition method are implemented.

[0058] In summary, the present invention sets the pixel unit in the image sensor to collect the color of the pixel point and detect the change of the voltage value. By combining the two, it can simulate the movement path of the table tennis ball between two real frame images, synthesize several virtual frame images between the two real frame images, and form a dense continuous real-time image, so that the detected movement trajectory of the table tennis ball is more accurate, and the needs of high-speed shooting are met without the help of high-speed sensors, and the movement trajectory of high-speed moving table tennis can be better restored.

[0059] The disclosure and other solutions, examples, embodiments, modules, and functional operations described in this document can be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this document and their structural equivalents, or any combination thereof. The disclosure and other embodiments can be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a tangible, non-volatile computer-readable medium, for execution by a data processing apparatus or to control the operation of the data processing apparatus. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a storage device, a composition of matter that effects a machine-readable propagated signal, or any combination thereof. The term "data processing unit" or "data processing apparatus" includes all devices, equipment, and machines for processing data, including, for example, a programmable processor, a computer, or a plurality of processors or computers. In addition to hardware, the apparatus may also include code that creates an execution environment for a computer program, such as code constituting processor firmware, a protocol stack, a database management system, an operating system, or any combination thereof. A propagated signal is an artificially generated signal, such as a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode information for transmission to a suitable receiver device.

[0060] A computer program (also referred to as a program, software, software application, script, or code) may be written in any form of programming language (including compiled or interpreted languages) and may be deployed in any form, including as a standalone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program does not necessarily correspond to a file in a file system. A program may be stored in a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program, or in multiple coordinated files (e.g., files storing one or more modules, subroutines, or portions of code). A computer program may be deployed for execution on one or more computers, located at one site or distributed across multiple sites and interconnected by a communications network.

[0061] The processes and logic flows described in this document can be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output. The processes and logic flows can also be performed by, and apparatus can also be implemented as, special-purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application-specific integrated circuit).

[0062] For example, processors suitable for executing computer programs include general-purpose and special-purpose microprocessors, as well as any one or more of any type of digital computer. Typically, a processor will receive instructions and data from read-only memory or random access memory, or both. The essential components of a computer are a processor that executes instructions and one or more memory devices that store instructions and data. Typically, a computer will also include one or more mass storage devices for storing data, such as magnetic, magneto-optical, or optical disks, or be operatively coupled to receive data from or transfer data to a mass storage device, or both. However, a computer need not have such devices. Computer-readable media suitable for storing computer program instructions and data include all forms of nonvolatile memory, media, and storage devices, including, for example, semiconductor memory devices, such as erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), and flash memory devices; magnetic disks, such as internal hard disks or removable disks; magneto-optical disks; and compact disk read-only memory (CD ROM) and digital versatile disk read-only memory (DVD-ROM) disks. The processor and memory may be supplemented by, or incorporated into, special-purpose logic circuitry.

[0063] While this patent document contains many specifics, they should not be construed as limitations on the scope of any invention or the claims, but rather as descriptions of features for particular embodiments of particular inventions. Certain features described in this patent document in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various functions described in the context of a single embodiment can also be implemented separately in multiple embodiments, or in any suitable subcombination. Furthermore, while the features described above may be described as functioning in certain combinations, or even initially claimed to be so, in some cases one or more features in a claim combination may be removed from the combination, and a claim combination may be directed to a subcombination or variations of a subcombination.

[0064] Likewise, while operations may be depicted in a particular order in the accompanying drawings, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, in order to achieve desired results. Furthermore, the separation of various system components in the embodiments of this patent document should not be understood as requiring such separation in all embodiments.

[0065] Only a few implementations and examples are described, and other implementations, enhancements, and variations can be made based on what is described and illustrated in this patent document.

[0066] A first component is directly coupled to a second component when there are no intervening components other than a line, trace, or another medium between the first and second components. A first component is indirectly coupled to a second component when there are intervening components other than a line, trace, or another medium between the first and second components. The term "coupled" and its variations encompass both direct and indirect couplings. Unless otherwise specified, the use of the term "about" is intended to include a range of 10% above and below the value.

[0067] Although several embodiments are provided in this disclosure, it should be understood that the disclosed systems and methods may be embodied in many other specific forms without departing from the spirit or scope of the present disclosure. The present examples are to be considered illustrative rather than restrictive, and the present invention is not to be construed as being limited to the details given. For example, various elements or components may be combined or integrated into another system, or certain features may be omitted or not implemented.

[0068] In the several embodiments provided herein, it should be understood that the disclosed devices and methods may also be implemented in other ways. The device embodiments described above are merely illustrative. For example, the flowcharts and block diagrams in the accompanying drawings show the possible architectures, functions, and operations of the devices, methods, and computer program products according to multiple embodiments of the present invention. In this regard, each box in the flowchart or block diagram may represent a module, program segment, or part of a code, which contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions marked in the boxes may also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, or they may sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, as well as the combination of boxes in the block diagram and / or flowchart, may be implemented using a dedicated hardware-based system that performs the specified functions or actions, or may be implemented using a combination of dedicated hardware and computer instructions.

[0069] In addition, without departing from the scope of the present disclosure, the discrete or separate techniques, systems, subsystems, and methods described and illustrated in the various embodiments may be combined or integrated with other systems, modules, techniques, or methods. Other items shown or discussed as coupled may be directly connected, or may be indirectly coupled or communicated through some interface, device, or intermediate component in an electrical, mechanical, or other manner. Other examples of changes, substitutions, and modifications may be determined by those skilled in the art without departing from the spirit and scope disclosed herein.

Claims

1. A table tennis path image acquisition method, characterized in that: include: The processor captures multiple continuous frames of images in real time through the image sensor and defines them as real frames; In the processor, taking one of the real frame images (1) as a starting point, before capturing the next real frame image (1), constructing at least one virtual frame image to be embedded between the two real frame images (1) to form a dense continuous real-time image; The method for constructing a virtual frame image includes: The processor marks a ping-pong outline (3) in the initial real frame image (1), and selects a region (2) in the initial real frame image (1), wherein the selected region (2) completely covers the ping-pong outline (3); The processor controls each pixel unit in the framed area (2) of the image sensor to collect voltage in real time; During the table tennis movement, the processor obtains the voltage changes of the corresponding pixel units located around the table tennis outline (3) in the frame selection area (2) to simulate the movement path of the table tennis ball; The processor synthesizes a virtual frame image through the initial real frame image (1), the ping-pong outline (3) and the motion path.

2. The table tennis path image acquisition method according to claim 1, wherein: Methods for capturing real frame images (1) include: The processor controls each pixel unit in the image sensor to collect corresponding colors respectively; The processor arranges the colors in sequence to form a real frame image (1).

3. The table tennis path image acquisition method according to claim 1, wherein: The method for real-time voltage acquisition of a pixel unit includes: Each pixel unit is provided with four photosensitive areas, and the four photosensitive areas are arranged in two rows and two columns; The four photosensitive areas are respectively a first green photosensitive area, a first red photosensitive area, a first blue photosensitive area and a second green photosensitive area, the first green photosensitive area and the second green photosensitive area are arranged diagonally, and the first red photosensitive area and the first blue photosensitive area are arranged diagonally; The pixel units respectively collect voltage values ​​corresponding to the first green light photosensitive area, the first red light photosensitive area, the first blue light photosensitive area, and the second green light photosensitive area.

4. The table tennis path image acquisition method according to claim 3, wherein: Methods for simulating the motion path of a table tennis ball include: When part of the first green light-sensitive area, the first red light-sensitive area, the first blue light-sensitive area, and the second green light-sensitive area in any pixel unit, but not all of the areas are blocked by a moving object, the pixel unit respectively collects the voltage values ​​corresponding to the first green light-sensitive area, the first red light-sensitive area, the first blue light-sensitive area, and the second green light-sensitive area, that is, the pixel unit simulates the movement path of the table tennis ball through the changes in the voltage values ​​corresponding to the first green light-sensitive area, the first red light-sensitive area, the first blue light-sensitive area, and the second green light-sensitive area.

5. The table tennis path image acquisition method according to claim 4, wherein: The method of simulating the motion path of the table tennis ball also includes: In the processor, one of the real frame images (1) is used as a starting point, and the processor controls each pixel unit to simulate the initial motion point (4) and the motion reference line (5) of the object through the voltage values ​​corresponding to the first green light sensitive area, the first red light sensitive area, the first blue light sensitive area, and the second green light sensitive area; During the table tennis movement, the processor controls each pixel unit to simulate the movement path of the table tennis ball from the initial movement point (4) relative to the movement reference line (5) through the voltage value changes corresponding to the first green light photosensitive area, the first red light photosensitive area, the first blue light photosensitive area, and the second green light photosensitive area.

6. The table tennis path image acquisition method according to claim 5, wherein: The method of simulating the motion path of the table tennis ball also includes: Each pixel unit overlaps the corresponding motion reference line (5) and superimposes the motion paths of each initial motion point (4) relative to the motion reference line (5) in time sequence to form a complete motion path.

7. The table tennis path image acquisition method according to claim 5, wherein: The method for synthesizing a virtual frame image includes: Determine the center point of the ping-pong outline (3) in the initial real frame image (1), and make the starting point of the motion path simulated during the ping-pong motion coincide with the center point of the ping-pong outline (3) in the initial real frame image (1); After the end point of the motion path coincides with the center point of the ping-pong outline (3), the ping-pong outline (3) at the starting point of the motion path and the motion path are eliminated to synthesize a virtual frame image.

8. The table tennis path image acquisition method according to claim 1, wherein: The processor captures multiple consecutive frames of images through the image sensor and defines them as real frame images (1); Between adjacent real frame images (1), construct at least one virtual supplementary frame image to be embedded between the two real frame images (1) to form a continuous image; The method for constructing a virtual supplementary frame image includes: The processor marks a ping-pong outline (3) in any real frame image (1), and selects a region (2) in the real frame image (1), wherein the selected region (2) completely covers the ping-pong outline (3); The processor retrieves historical data from the image sensor; The processor simulates the motion path of the table tennis ball between two adjacent real frame images (1) through historical data; The processor synthesizes a virtual supplementary frame image through the corresponding real frame image (1), the ping-pong outline (3) and the motion path.

9. The table tennis path image acquisition method according to claim 8, wherein: The historical data includes: the voltage value of each pixel unit in the image sensor at each moment when the voltage is collected.

10. An image acquisition system using the table tennis path image acquisition method according to any one of claims 1 to 9, characterized in that: include: processor and image sensor; The processor is configured to capture multiple consecutive image frames in real time through the image sensor and define the frames as real frames; The processor is further configured to take one of the real frame images (1) as a starting point and, before capturing the next real frame image (1), construct at least one virtual frame image to be embedded between the two real frame images (1) to form a dense continuous real-time image.

11. The image acquisition system according to claim 10, wherein: The image sensor includes a plurality of pixel units, and each pixel unit is provided with a color acquisition circuit and a chromaticity photosensor circuit; The processor is configured to control the color acquisition circuit in the pixel unit to acquire the corresponding color; The processor is also configured to control the chromaticity photosensor circuit in the pixel unit to collect voltage values ​​corresponding to the first green light photosensor area, the first red light photosensor area, the first blue light photosensor area, and the second green light photosensor area.

12. A readable storage medium having a computer program / instruction stored thereon, characterized in that: When the computer program / instruction is executed by a processor, the steps of the table tennis path image acquisition method according to claim 1 are implemented.

Images