Table tennis path image acquisition method, image acquisition system and readable storage medium

Abstract

The application belongs to the technical field of image data processing, and particularly relates to a table tennis path image acquisition method, an image acquisition system and a readable storage medium. The table tennis path image acquisition method comprises the following steps: an image sensor captures continuous multiple frames of images in real time, and the continuous multiple frames of images are defined as real frames; one of the real frames of images is taken as a starting point, at least one virtual frame of image is constructed before a second real frame of image is captured, and is embedded between the two real frames of images to form a dense continuous real-time image; the color and the detection voltage value change of a pixel unit in the image sensor are set to simulate the movement path of the table tennis between the two real frames of images, a plurality of virtual frame images between the two real frames of images are synthesized, the dense continuous real-time image is formed, the detected table tennis movement trajectory is more accurate, the demand of high-speed shooting is met without the aid of a high-speed sensor, and the movement trajectory of the high-speed moving table tennis is better restored.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of image data processing, and particularly relates to a method for determining the posture of an object, and in particular to a table tennis path image acquisition method, an image acquisition system, and a readable storage medium. BACKGROUND

[0002] Table tennis is fast, rotates strongly, and changes frequently. The moving track of table tennis cannot be completely reproduced by the naked eye of a human being and traditional camera equipment. However, the moving track of table tennis can be used to find the deficiency in action technology, objectively evaluate the training effect and the degree of technical improvement, analyze the actual path effect of a specific tactic (such as a serve attack, a holding line combination), and optimize the execution of the tactic, which is important for improving the training level and efficiency of athletes and optimizing the guidance and decision-making of coaches.

[0003] Meanwhile, even professional training sites do not equip every training platform with a camera module with a high-speed sensor. When these devices need to shoot high-speed table tennis, the camera recognizes the red, yellow, and blue regions through each pixel point to synthesize the corresponding color, and then forms a complete image. Since there is a calculation process, there is a time difference in tracking the route of such a synthetic color moving object, and the traditional image recognition algorithm cannot completely reproduce the moving path of table tennis.

[0004] The camera collects a yellow table tennis ball, and each pixel point realizes the calculation of the yellow region by combining the red region and the green region. The camera collects a white table tennis ball, and each pixel point calculates the white region by combining the red region, the green region, and the blue region. The moving path of table tennis cannot be completely reproduced, which has an adverse effect on the movement evaluation.

[0005] Therefore, it is urgent to develop a new table tennis path image acquisition method, an image acquisition system, and a readable storage medium to solve the technical problem that the moving path of an object between two images cannot be reproduced.

[0006] It should be noted that the above information disclosed in the background section of the present application is only used to understand the background of the present application, and therefore, the above description is not considered to constitute information of the prior art. SUMMARY

[0007] The embodiments of the present disclosure at least provide a table tennis path image acquisition method, an image acquisition system, and a readable storage medium.

[0008] In a first aspect, the embodiments of the present disclosure provide a table tennis path image acquisition method, which comprises: a processor capturing a plurality of continuous real-time images through an image sensor, and defining the images as real frames; in the processor, taking one of the real frames as a starting point, constructing at least one virtual frame image to be embedded between two real frames before capturing the next real frame, to form a dense continuous real-time image; wherein the method of constructing the virtual frame image comprises: the processor marking a table tennis contour in an initial real frame image, and framing an area in the initial real frame image, and the framed area completely covers the table tennis contour; the processor controls each pixel unit in the framed area in the image sensor to perform real-time voltage acquisition; during the movement of the table tennis, the processor acquires voltage changes of the corresponding pixel units in the framed area around the table tennis contour, to simulate the movement path of the table tennis; and the processor synthesizes the virtual frame image through the initial real frame image, the table tennis contour, and the movement path.

[0009] In an optional embodiment, the method of capturing the real frame image comprises: the processor controls each pixel unit in the image sensor to acquire a corresponding color respectively; and the processor arranges the colors in sequence to form the real frame image.

[0010] In an optional embodiment, the method of the pixel unit performing real-time voltage acquisition comprises: each pixel unit is provided with four light sensing areas respectively, and the four light sensing areas are arranged in two rows and two columns; the four light sensing areas are a first green light sensing area, a first red light sensing area, a first blue light sensing area, and a second green light sensing area, the first green light sensing area and the second green light sensing area are diagonally arranged, and the first red light sensing area and the first blue light sensing area are diagonally arranged; and the pixel unit acquires voltage values corresponding to the first green light sensing area, the first red light sensing area, the first blue light sensing area, and the second green light sensing area respectively.

[0011] In an optional embodiment, the method of simulating the movement path of the table tennis comprises: when part of the first green light sensing area, the first red light sensing area, the first blue light sensing area, and the second green light sensing area in any pixel unit are blocked by a moving object, the pixel unit acquires voltage values corresponding to the first green light sensing area, the first red light sensing area, the first blue light sensing area, and the second green light sensing area respectively, that is, the pixel unit simulates the movement path of the table tennis through voltage value changes corresponding to the first green light sensing area, the first red light sensing area, the first blue light sensing area, and the second green light sensing area.

[0012] In an alternative embodiment, the method for simulating the movement path of the ping-pong ball further comprises: in the processor, taking one of the real frame images as a starting point, the processor controls each pixel unit to simulate the initial movement point and the movement reference line of the object by the voltage values corresponding to the first green light sensing area, the first red light sensing area, the first blue light sensing area and the second green light sensing area respectively; during the movement of the ping-pong ball, the processor controls each pixel unit to simulate the movement path of the ping-pong ball from the initial movement point relative to the movement reference line by the voltage value changes corresponding to the first green light sensing area, the first red light sensing area, the first blue light sensing area and the second green light sensing area.

[0013] In an alternative embodiment, the method for simulating the movement path of the ping-pong ball further comprises: each pixel unit superimposes the corresponding movement reference line and the movement path of each initial movement point relative to the movement reference line in time sequence to form a complete movement path.

[0014] In an alternative embodiment, the method for synthesizing the virtual frame image comprises: determining the center point of the ping-pong outline in the initial real frame image, and superimposing the starting point of the simulated movement path during the movement of the ping-pong ball with the center point of the ping-pong outline in the initial real frame image; after the end point of the movement path coincides with the center point of the ping-pong outline, eliminating the ping-pong outline at the starting point of the movement path and the movement path to synthesize the virtual frame image.

[0015] In an alternative embodiment, the processor captures a plurality of continuous frame images through the image sensor, and defines them as real frame images; at least one virtual supplementary frame image is constructed between adjacent real frame images to be embedded between the two real frame images to form continuous images; wherein the method for constructing the virtual supplementary frame image comprises: the processor marks the ping-pong outline in any real frame image, and frames the area in the real frame image, and the framed area completely covers the ping-pong outline; the processor calls the historical data of the image sensor; the processor simulates the movement path of the ping-pong ball between the two adjacent real frame images through the historical data; and the processor synthesizes the virtual supplementary frame image through the corresponding real frame image, the ping-pong outline and the movement path.

[0016] In an alternative embodiment, the historical data comprises: the voltage values of each pixel unit in the image sensor at the time of voltage acquisition.

[0017] In a second aspect, the embodiments of the present disclosure further provide an image acquisition system adopting the ping-pong path image acquisition method as described above, which comprises: a processor and an image sensor; the processor is configured to capture a plurality of continuous frame images through the image sensor in real time, and define them as real frames; the processor is further configured to take one of the real frame images as a starting point, construct at least one virtual frame image before capturing the next real frame image, embed it between the two real frame images, and form dense continuous real-time images.

[0018] In an alternative embodiment, the image sensor comprises a plurality of pixel units, and a color acquisition circuit and a chroma sensing circuit are respectively arranged in each pixel unit; the processor is configured to control the color acquisition circuit in the pixel unit to acquire a corresponding color; and the processor is further configured to control the chroma sensing circuit in the pixel unit to acquire voltage values corresponding to a first green light sensing region, a first red light sensing region, a first blue light sensing region and a second green light sensing region.

[0019] In a second aspect, the embodiments of the present disclosure further provide a readable storage medium having a computer program / instruction stored thereon, wherein the computer program / instruction is executed by a processor to implement the steps of the ping-pong ball path image acquisition method.

[0020] The present application has the advantages that, by setting the color and detecting voltage value change of the pixel point acquired by the pixel unit in the image sensor, the movement path of the ping-pong ball between two real frame images can be simulated by combining the two, a plurality of virtual frame images between the two real frame images are synthesized, a dense continuous real-time image is formed, the detected ping-pong ball movement trajectory is more accurate, the demand for high-speed shooting is met without the aid of a high-speed sensor, and the movement trajectory of the high-speed moving ping-pong ball can be better restored.

[0021] Other features and advantages of the present application will be set forth in the following description, and in part will become apparent to those skilled in the art from the description, or can be learned by practice of the present application. The objects and other advantages of the present application will be realized and achieved by the structures particularly pointed out in the description and the appended drawings.

[0022] In order to make the above objectives, characteristics and advantages of the present application more apparent and easy to understand, the following preferred embodiments are specifically described below, and the accompanying drawings are referred to for detailed description. BRIEF DESCRIPTION OF DRAWINGS

[0023] In order to more clearly illustrate the specific embodiments of the present application or the technical solutions in the prior art, the following will briefly introduce the drawings needed to be used in the specific embodiments or the prior art description. Obviously, the drawings in the following description are some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor on the basis of these drawings.

[0024] Figure 1 A flowchart of a ping-pong ball path image acquisition method provided by the embodiments of the present disclosure is shown in the figure;

[0025] Figure 2 A flowchart of a method for constructing a virtual frame image provided by the embodiments of the present disclosure is shown in the figure;

[0026] Figure 3A schematic diagram of a real frame image provided for an embodiment of the present disclosure;

[0027] Figure 4 A schematic diagram of a pixel unit collecting voltage provided for an embodiment of the present disclosure;

[0028] Figure 5 A schematic diagram of a simulated motion path provided for an embodiment of the present disclosure;

[0029] Figure 6 A principle block diagram of an image acquisition system provided for an embodiment of the present disclosure;

[0030] Figure 7 An image acquisition schematic diagram of an image acquisition system provided for an embodiment of the present disclosure.

[0031] In the figure:

[0032] 1, real frame image; 2, frame selection area; 3, ping-pong outline; 4, initial motion point; 5, motion reference line; 6, virtual frame image; 7, virtual supplementary frame. DETAILED DESCRIPTION

[0033] In order to make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme of the present application will be described clearly and completely below with reference to the drawings. Obviously, the described embodiments are some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative labor fall within the scope of protection of the present application.

[0034] The terminology used herein is for the purpose of describing particular example configurations only and is not intended to be limiting. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. The terms "comprises", "comprising", "includes", "including" and "has", "having" are inclusive and therefore specify the presence of stated features, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, steps, operations, elements, components, and / or groups thereof. The method steps, processes, and operations described herein are not to be construed as necessarily requiring their performance in the particular order in which they are discussed or illustrated, unless specifically identified as an order of performance. Additional or alternative steps can be employed.

[0035] As used herein, the phrases “in one embodiment,” “according to one embodiment,” “in some embodiments,” and the like generally mean the particular feature, structure, or characteristic following the phrase can be included in at least one embodiment of the present disclosure. Thus, appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment. As used herein, the terms “example,” “exemplary,” and the like are utilized to merely indicate that an example, instance, or illustration is used to facilitate understanding of the present disclosure. Any implementation, aspect, or design described herein as “example” or “exemplary” is not necessarily to be construed as preferred or advantageous over other implementations, aspects, or designs. Rather, the use of the terms “example,” “exemplary,” and the like are intended to present concepts in a concrete manner.

[0036] It is found through research that, with the development of APP in sports evaluation, it is necessary to evaluate the sports effect in combination with the sports path, and general intelligent devices are not equipped with high-speed cameras, and a traditional camera collects each frame of image through Bayer arrangement, so that the motion path of an object between two frames of image can be estimated only through two frames of image, and there is a certain error, and the motion path of the object cannot be completely reproduced.

[0037] Based on the above research, the embodiment of the present disclosure provides a table tennis path image acquisition method, an image acquisition system and a readable storage medium, which realize high-speed shooting of the motion path of an object without the aid of a high-speed sensor, and can better reproduce the motion path of a high-speed moving object.

[0038] The defects of the above solutions are the results of the inventors after practice and careful research, and therefore, the discovery process of the above problems and the solutions proposed by the present disclosure to the above problems in the following should be the contributions of the inventors to the present disclosure in the process of the present disclosure.

[0039] It should be noted that: similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings.

[0040] Some embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. In the case of no conflict, the embodiments described below and the features in the embodiments can be combined with each other.

[0041] As Figures 1 to 6As shown, at least one embodiment provides a table tennis path image acquisition method, which comprises: a processor capturing a plurality of continuous real-time images through an image sensor, and defining the images as real frames; in the processor, taking one of the real frame images 1 as a starting point, constructing at least one virtual frame image to be embedded between two real frame images 1 before capturing the next real frame image 1, to form a dense continuous real-time image; wherein the method of constructing the virtual frame image comprises: the processor marking a table tennis contour 3 in the initial real frame image 1, and framing a region 2 in the initial real frame image 1, and the framed region 2 completely covers the table tennis contour 3; the processor controls each pixel unit located in the framed region 2 in the image sensor to perform real-time voltage acquisition; during the movement of the table tennis, the processor acquires voltage changes of the corresponding pixel units located around the table tennis contour 3 in the framed region 2 to simulate the movement path of the table tennis; and the processor synthesizes the virtual frame image through the initial real frame image 1, the table tennis contour 3 and the movement path.

[0042] In at least one embodiment, the present application sets the color and voltage value change of the pixel unit in the image sensor to acquire the pixel point, and through the combination of the two, the movement path of the table tennis between two real frame images 1 can be simulated, a plurality of virtual frame images between the two real frame images 1 are synthesized, and a dense continuous real-time image is formed, so that the detected table tennis movement trajectory is more accurate, the demand for high-speed shooting is met without the aid of a high-speed sensor, and the movement trajectory of the high-speed moving table tennis can be better restored.

[0043] In at least one embodiment, please refer to Figure 3 The method of capturing the real frame image 1 comprises: the processor controls each pixel unit in the image sensor to acquire the corresponding color respectively; and the processor arranges each color in sequence to form the real frame image 1.

[0044] Specifically, when the pixel unit acquires the color, each pixel point synthesizes the corresponding color through the percentage of the red area, the green area and the blue area, that is, the color of the pixel point is acquired.

[0045] In at least one embodiment, please refer to Figure 3 The processor controls each pixel unit located in the framed region 2 in the image sensor to detect the voltage value change respectively.

[0046] The position of the framed region 2 is less than 5% of the effective shooting area of the traditional camera, and more than 5% of the effective shooting area will cause the power consumption and heat of the traditional camera to be difficult to control.

[0047] Specifically, there is an interval between the two real frame images 1, and the pixel unit needs this interval to calculate the color of the pixel. Therefore, the motion path of the object between the two real frame images 1 cannot be captured by the pixel unit when performing color acquisition. However, the pixel unit directly detects the change in voltage value when performing voltage detection, so it can simulate the motion path of the object in real time and realize the reproduction of the motion process of the object.

[0048] In at least one embodiment, please refer to Figure 3 , Figure 4 The method for real-time voltage acquisition by a pixel unit includes: four photosensitive areas are set in each pixel unit, and the four photosensitive areas are arranged in two rows and two columns; the four photosensitive areas are a first green light photosensitive area, a first red light photosensitive area, a first blue light photosensitive area, and a second green light photosensitive area, the first green light photosensitive area and the second green light photosensitive area are set diagonally, and the first red light photosensitive area and the first blue light photosensitive area are set diagonally; the pixel unit acquires the voltage values ​​corresponding to the first green light photosensitive area, the first red light photosensitive area, the first blue light photosensitive area, and the second green light photosensitive area respectively.

[0049] Specifically, the first green light-sensitive area is G1, the first red light-sensitive area is R, the first blue light-sensitive area is B, and the second green light-sensitive area is G2.

[0050] Specifically, please refer to Figure 3 In the figure, the solid lines and dashed lines represent the voltage values ​​corresponding to the first green light-sensitive area, the first red light-sensitive area, the first blue light-sensitive area, and the second green light-sensitive area at two different time points.

[0051] In at least one embodiment, please refer to Figure 4 The method for simulating the movement path of a ping-pong ball includes: when a portion, but not all, of the first green light-sensitive area, the first red light-sensitive area, the first blue light-sensitive area, and the second green light-sensitive area in any pixel unit is occluded by a moving object, the pixel unit collects the voltage values ​​corresponding to the first green light-sensitive area, the first red light-sensitive area, the first blue light-sensitive area, and the second green light-sensitive area, respectively. That is, the pixel unit simulates the movement path of the ping-pong ball by changing the voltage values ​​corresponding to the first green light-sensitive area, the first red light-sensitive area, the first blue light-sensitive area, and the second green light-sensitive area.

[0052] Specifically, the voltage values ​​of the first green light-sensitive area, the first red light-sensitive area, the first blue light-sensitive area, and the second green light-sensitive area will change when they are blocked by a ping-pong ball. Therefore, the movement path of the ping-pong ball can be simulated by the change in the voltage value of each light-sensitive area.

[0053] In at least one embodiment, please refer to Figure 5, the method for simulating the movement path of the ping-pong ball further comprises: in the processor, taking one of the real frame images 1 as the starting point, the processor controls each pixel unit to simulate the initial movement point 4 and the movement reference line 5 of the object by the voltage values corresponding to the first green light sensing area, the first red light sensing area, the first blue light sensing area, and the second green light sensing area; during the movement of the ping-pong ball, the processor controls each pixel unit to simulate the movement path of the ping-pong ball from the initial movement point 4 relative to the movement reference line 5 by the voltage value changes corresponding to the first green light sensing area, the first red light sensing area, the first blue light sensing area, and the second green light sensing area.

[0054] Specifically, the initial position of the movement path (the initial movement point 4) and the simulated path (the simulated path points to the position at the next moment) are drawn, and the yellow (which needs to be synthesized with green and red) or blue (which needs to be synthesized with three colors) movement reference line 5 is drawn, at this time, according to the voltage changes of the two green areas, if the acquisition time is short enough and the number of acquisitions is enough, the trend of the path pixel point offset from the simulated path at the current time will be more accurate.

[0055] In at least one embodiment, referring to Figure 5 , the method for simulating the movement path of the ping-pong ball further comprises: each pixel unit superimposes the movement path of each initial movement point 4 relative to the movement reference line 5 in time sequence to form a complete movement path.

[0056] Specifically, each pixel unit is triggered at different times, but the movement trend at the corresponding moment is consistent, so superimposing the movement path of each initial movement point 4 relative to the movement reference line 5 in time sequence can obtain an accurate and complete movement path.

[0057] In at least one embodiment, referring to Figure 5 , the method for synthesizing the virtual frame image comprises: determining the center point of the ping-pong outline 3 in the initial real frame image 1, and superimposing the starting point of the simulated movement path during the movement of the ping-pong ball with the center point of the ping-pong outline 3 in the initial real frame image 1; after the end point of the movement path coincides with the center point of the ping-pong outline 3, eliminating the ping-pong outline 3 at the starting point of the movement path and the movement path to synthesize the virtual frame image.

[0058] Specifically, the voltage values of each pixel unit are monitored in real time, and are not involved in normal time power-off, after entering the next frame, the object being photographed is compared, the area needing to enter special coding is switched, and other places still perform normal coding processing.

[0059] In at least one embodiment, referring to Figure 7The processor captures a plurality of continuous images through the image sensor, and defines the images as real frame images 1; between adjacent real frame images 1, at least one virtual supplementary frame 7 image is constructed and embedded between two real frame images 1 to form continuous images; wherein the method for constructing the virtual supplementary frame 7 image comprises: the processor marks the ping-pong ball outline 3 in any real frame image 1, and frames the area 2 in the real frame image 1, and the framed area 2 completely covers the ping-pong ball outline 3; the processor calls historical data of the image sensor; the processor simulates the movement path of the ping-pong ball between two adjacent real frame images 1 through the historical data; and the processor synthesizes the virtual supplementary frame 7 image through the corresponding real frame image 1, ping-pong ball outline 3 and movement path.

[0060] Specifically, refer to Figure 7 The remaining steps of synthesizing the virtual supplementary frame 7 image are the same as those of synthesizing the virtual frame image.

[0061] In at least one embodiment, the historical data comprises: voltage values of each pixel unit in the image sensor at the time of voltage acquisition.

[0062] Based on the same technical concept, refer to Figures 1 to 6 At least one embodiment further provides an image acquisition system adopting the ping-pong ball path image acquisition method, which comprises: a processor and an image sensor; the processor is configured to capture a plurality of continuous images through the image sensor in real time, and define the images as real frames; the processor is further configured to take one real frame image 1 as a starting point, and construct at least one virtual frame image before capturing the next real frame image 1, so as to embed the virtual frame image between two real frame images 1 and form dense continuous real-time images.

[0063] In at least one embodiment, the image sensor comprises a plurality of pixel units, and color acquisition circuit and chrominance light sensing circuit are arranged in each pixel unit respectively; the processor is configured to control the color acquisition circuit in the pixel unit to acquire corresponding color; and the processor is further configured to control the chrominance light sensing circuit in the pixel unit to acquire voltage values corresponding to the first green light sensing area, the first red light sensing area, the first blue light sensing area and the second green light sensing area.

[0064] Based on the same technical concept, at least one embodiment further provides a readable storage medium having a computer program / instruction stored thereon, wherein the computer program / instruction is executed by the processor to realize the steps of the ping-pong ball path image acquisition method.

[0065] In summary, the application sets the color and detection voltage value change of the pixel unit in the image sensor to collect the pixel points, combines the two, can simulate the movement path of the ping-pong ball between the two real frame images, synthesize a plurality of virtual frame images between the two real frame images, form a dense continuous real-time image, so that the detected ping-pong ball movement trajectory is more accurate, and the demand for high-speed shooting is met without the aid of a high-speed sensor, and the movement trajectory of the high-speed moving ping-pong ball can be better restored.

[0066] The disclosures and other solutions, examples, embodiments, modules and functional operations described in this document can be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this document and their structural equivalents, or a combination of one or more of them. The disclosed content and other embodiments can be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a tangible and non-transitory computer readable medium for execution by or to control the operation of a data processing device. The computer readable medium can be a machine readable storage device, a machine readable storage substrate, a storage device, a material composition that affects a machine readable propagated signal, or a combination of one or more of them. The term "data processing unit" or "data processing device" includes all devices, equipment and machines for processing data, including, for example, programmable processors, computers or multi-processors or computer groups. In addition to hardware, the device can also include code that creates an execution environment for a computer program, such as code that constitutes processor firmware, protocol stack, database management system, operating system, or a combination of one or more of them. The propagated signal is a man-made signal, such as a machine-generated electrical, optical or electromagnetic signal, which is generated to encode information to be transmitted to a suitable receiver device.

[0067] A computer program (also known as a program, software, software application, script or code) can be written in any form of programming language (including compiled or interpreted languages) and can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. The computer program does not necessarily correspond to a file in the file system. The program can be stored in part of a file that stores other programs or data (for example, one or more scripts in a markup language document), a single file dedicated to the program, or multiple coordinated files (for example, files that store one or more modules, subprograms or parts of code). The computer program can be deployed on one or more computers for execution, which can be located on one site or distributed over multiple sites and interconnected by a communication network.

[0068] The processes and logic flows described in this document can be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output. The processes and logic flows can also be performed by special purpose logic circuitry, e.g., an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit), and / or by programmable data processing apparatuses that can be

[0069] Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and any one or more processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. The essential elements of a computer are a processor for performing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical disks, or optical disks. However, a computer need not have such devices. Computer readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices, including by way of example semiconductor memory devices, e.g., erasable programmable read only memory (EPROM), electrically erasable programmable read only memory (EEPROM), and flash memory devices; magnetic disks, e.g., internal hard disks or removable disks; magneto-optical disks; and compact disc read only memories (CD ROMs) and digital versatile disc read only memories (DVD ROMs). The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.

[0070] Although the present patent document contains many details, it is not to be limited to any specific embodiment disclosed herein, but intended to cover all legal equivalents. Various modifications, alterations, and permutations of the described embodiments can be made and fall within the scope of the present patent document. Although specific terms can be employed in the description and the appended claims, such terms are used in a generic and descriptive sense only and not for purposes of limitation. The scope of the present patent document is not intended to be limited to the particular illustrative embodiments disclosed in the specification and claims. Rather, the scope of the present patent document is to be understood as including any embodiments that fall within the scope of the claims, including any and all equivalents.

[0071] Also, although operations can be described as being performed in a certain order in the figures, this is not meant to be limiting. The operations can be performed in any order, or in parallel, or in any combination. Further, the separation of various system components in the embodiments described herein is for explanatory purposes only and should not be construed in a limiting manner. Therefore, the described embodiments should be understood to be merely illustrative of the many possible embodiments.

[0072] Only a few implementations and examples are described and other implementations, enhancements and variations can be made based on what is described and illustrated in this patent document.

[0073] A first component is directly coupled to a second component when there is no intervening component other than a wire, trace, or another medium between the first component and the second component. A first component is indirectly coupled to a second component when there is an intervening component other than a wire, trace, or another medium between the first component and the second component. The term “coupled” and variations thereof include both direct and indirect coupling. The use of the term “about” means a range of plus or minus 10% of the value unless otherwise indicated.

[0074] While several embodiments are provided in the present disclosure, it should be understood that the disclosed system and method might be carried out in many other ways than those specifically set forth herein without departing from the essence of the disclosure. The present examples are to be considered as illustrative and not restrictive, and the intention is that the disclosure be given with only the broadest scope of interpretation of the principles thereof. For example, the various elements or components can be combined or integrated in another system or certain features can be omitted or not implemented.

[0075] In several embodiments provided herein, it should be understood that the disclosed apparatus and methods might be implemented in other ways than those specifically set forth herein without departing from the spirit or scope of the present disclosure. The embodiments described above are to be considered in a descriptive sense only and not for purposes of limitation. For example, the various elements or components can be combined or integrated in another system or certain features can be omitted or not implemented.

[0076] Also, the various embodiments partly and methods described and illustrated herein can be combined or integrated with other systems, modules, techniques, or methods without departing from the scope of the present disclosure. Other items shown or discussed as separate from other items or devices can be combined. The same or equivalent parts can be combined in different ways to achieve substantially the same results. The description specifies functions across various examples to provide functionality to a user, but the functions can be combined in a single example or further separated into further examples.

Claims

1. A method for acquiring images of a ping-pong ball's path, characterized in that, include: The processor captures multiple consecutive frames of images in real time using an image sensor and defines them as real frames; Starting from one of the real frame images (1) in the processor, before capturing the next real frame image (1), at least one virtual frame image is constructed to be embedded between the two real frame images (1) to form a dense, continuous real-time image. The methods for constructing virtual frame images include: The processor marks the ping-pong outline (3) in the initial real frame image (1) and selects a region (2) in the initial real frame image (1), and the selected region (2) completely covers the ping-pong outline (3). The processor controls each pixel unit located in the selected area (2) of the image sensor to perform real-time voltage acquisition; During the table tennis game, the processor obtains the voltage changes of the corresponding pixel units located around the table tennis outline (3) within the selected area (2) to simulate the movement path of the table tennis ball; The processor synthesizes a virtual frame image using the initial real frame image (1), the ping-pong outline (3), and the motion path; Methods for real-time voltage acquisition of pixel units include: Each pixel unit has four photosensitive areas, which are arranged in two rows and two columns. The four photosensitive areas are a first green light photosensitive area, a first red light photosensitive area, a first blue light photosensitive area, and a second green light photosensitive area. The first green light photosensitive area and the second green light photosensitive area are set diagonally opposite each other, and the first red light photosensitive area and the first blue light photosensitive area are set diagonally opposite each other. The pixel unit respectively collects the voltage values ​​corresponding to the first green light-sensitive area, the first red light-sensitive area, the first blue light-sensitive area, and the second green light-sensitive area; Methods for simulating the motion path of a table tennis ball include: When a portion, but not all, of the first green light-sensitive area, first red light-sensitive area, first blue light-sensitive area, and second green light-sensitive area in any pixel unit is occluded by a moving object, the pixel unit collects the voltage values ​​corresponding to the first green light-sensitive area, first red light-sensitive area, first blue light-sensitive area, and second green light-sensitive area, respectively. The pixel unit simulates the movement path of a ping-pong ball by the changes in the voltage values ​​corresponding to the first green light-sensitive area, first red light-sensitive area, first blue light-sensitive area, and second green light-sensitive area. Methods for simulating the motion path of a table tennis ball also include: Starting from one of the real frame images (1) in the processor, the processor controls each pixel unit to simulate the initial motion point (4) and motion baseline (5) of the object by the voltage values ​​corresponding to the first green light sensing area, the first red light sensing area, the first blue light sensing area, and the second green light sensing area. During the table tennis game, the processor controls each pixel unit to simulate the movement path of the table tennis ball from the initial movement point (4) relative to the movement baseline (5) by changing the voltage values ​​corresponding to the first green light-sensitive area, the first red light-sensitive area, the first blue light-sensitive area, and the second green light-sensitive area. Methods for simulating the motion path of a table tennis ball also include: Each pixel unit will overlap the corresponding motion reference line (5) and superimpose the motion paths of each initial motion point (4) relative to the motion reference line (5) in time order to form a complete motion path.

2. The method for acquiring ping-pong ball path images as described in claim 1, characterized in that, Methods for capturing real frame images (1) include: The processor controls each pixel unit in the image sensor to acquire the corresponding color; The processor arranges the colors sequentially to form a real frame image (1).

3. The method for acquiring ping-pong ball path images as described in claim 1, characterized in that, Methods for synthesizing virtual frame images include: Determine the center point of the ping-pong outline (3) in the initial real frame image (1), and make the starting point of the simulated motion path during the ping-pong ball movement coincide with the center point of the ping-pong outline (3) in the initial real frame image (1); After the endpoint of the motion path coincides with the center point of the ping-pong contour (3), the ping-pong contour (3) and the motion path at the starting point of the motion path are eliminated to synthesize a virtual frame image.

4. The method for acquiring ping-pong ball path images as described in claim 1, characterized in that, The processor captures multiple consecutive frames of images through the image sensor and defines them as real frame images (1). Between adjacent real frame images (1), at least one virtual supplementary frame image is constructed to be embedded between the two real frame images (1) to form a continuous image; The methods for constructing virtual supplementary frame images include: The processor marks the ping-pong outline (3) in any real frame image (1) and selects a region (2) in the real frame image (1), and the selected region (2) completely covers the ping-pong outline (3). The processor retrieves historical data from the image sensor; The processor simulates the motion path of a ping-pong ball between two adjacent real frame images (1) using historical data; The processor synthesizes a virtual supplementary frame image using the corresponding real frame image (1), ping-pong outline (3), and motion path.

5. The method for acquiring ping-pong ball path images as described in claim 4, characterized in that, Historical data includes the voltage values ​​of each pixel unit in the image sensor at each time point during voltage acquisition.

6. An image acquisition system employing the ping-pong ball path image acquisition method as described in any one of claims 1-5, characterized in that, include: Processor and image sensor; The processor is configured to capture multiple consecutive frames of images in real time via an image sensor and define them as real frames; The processor is also configured to start from one of the real frame images (1) and construct at least one virtual frame image before capturing the next real frame image (1) to embed between the two real frame images (1) to form a dense, continuous real-time image.

7. The image acquisition system as described in claim 6, characterized in that, The image sensor includes several pixel units, and each pixel unit is equipped with a color acquisition circuit and a colorimetric photosensitive circuit. The processor is configured to control the color acquisition circuit in the pixel unit to acquire the corresponding color; The processor is also configured to control the chromaticity sensing circuit in the pixel unit to acquire the voltage values ​​corresponding to the first green light sensing area, the first red light sensing area, the first blue light sensing area, and the second green light sensing area.

8. A readable storage medium having a computer program / instructions stored thereon, characterized in that, When the computer program / instruction is executed by the processor, it implements the steps of the ping-pong ball path image acquisition method of claim 1.

Images