Jigsaw puzzle recognition method and device

Abstract

The application aims to provide a jigsaw puzzle recognition method and device, which specifically comprises: capturing an operation image of a user on a jigsaw puzzle block on a table by a camera device, wherein each corner of the jigsaw puzzle block is provided with a pointing mark of pointing information; based on the operation image, recognizing pointing position information of multiple pointing marks in the operation image on the operation table; and determining block position information of one or more jigsaw puzzle blocks contained in the operation image according to the pointing position information of the multiple pointing marks and the pointing information of the multiple pointing marks. The application improves the recognition efficiency and accuracy of the jigsaw puzzle block, and provides a good jigsaw puzzle interaction experience for the user.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of communication, and in particular to a jigsaw puzzle recognition technology. BACKGROUND

[0002] A jigsaw puzzle is a kind of puzzle game, which is to assemble various changing image patterns by using seven jigsaw puzzle pieces in various assembly methods. Operating a jigsaw puzzle is a divergent thinking activity, which is conducive to cultivating people's observation, attention, imagination and creativity, and therefore, it not only has entertainment value, but also has certain educational value. In the existing play method of jigsaw puzzle, there is no conversion from plane to space, and there is a lack of real-time verification and interaction, so the activity enthusiasm and interest are low. SUMMARY

[0003] An object of the present application is to provide a jigsaw puzzle recognition method and device.

[0004] According to an aspect of the present application, a jigsaw puzzle recognition method is provided, which is applied to a computer device including a camera device, and the method includes:

[0005] capturing, by the camera device, an operation image of a user on a jigsaw puzzle piece on an operation table, wherein each corner of the jigsaw puzzle piece is provided with a pointing mark of pointing information;

[0006] identifying, based on the operation image, pointing position information of a plurality of pointing marks in the operation image on the operation table;

[0007] determining, according to the pointing position information of the plurality of pointing marks and the pointing information of the plurality of pointing marks, piece position information of one or more jigsaw puzzle pieces contained in the operation image, wherein each piece position information includes piece identification information of a corresponding jigsaw puzzle piece and position information of the corresponding jigsaw puzzle piece on the operation table.

[0008] According to another aspect of the present application, a jigsaw puzzle recognition device is provided, which includes a camera device, and the device includes:

[0009] a first module for capturing, by the camera device, an operation image of a user on a jigsaw puzzle piece on an operation table, wherein each corner of the jigsaw puzzle piece is provided with a pointing mark of pointing information;

[0010] a second module for identifying, based on the operation image, pointing position information of a plurality of pointing marks in the operation image on the operation table;

[0011] a third module configured to determine one or more tile position information of the plurality of tiles in the operation image according to the plurality of pointing position information of the plurality of pointing identifiers and the plurality of pointing information of the plurality of pointing identifiers, wherein each tile position information comprises tile identifier information of a corresponding tile and position information of the corresponding tile on the operation desktop.

[0012] According to an aspect of the present application, there is provided a computer device, wherein the device comprises:

[0013] a processor; and

[0014] a memory arranged to store computer executable instructions which, when executed, cause the processor to perform the steps of any of the above methods.

[0015] According to an aspect of the present application, there is provided a computer readable storage medium having stored thereon computer programs / instructions which, when executed, cause a system to perform the steps of any of the above methods.

[0016] According to an aspect of the present application, there is provided a computer program product comprising computer programs / instructions which, when executed by a processor, implement the steps of any of the above methods.

[0017] Compared with the prior art, the present application sets a pointing identifier with pointing information at each corner of a tile of a jigsaw puzzle, and identifies corresponding pointing position information from a corresponding operation image, thereby determining one or more tile position information of the plurality of tiles in the operation image according to the plurality of pointing position information of the plurality of pointing identifiers and the plurality of pointing information of the plurality of pointing identifiers, improving the identification efficiency and accuracy of the tiles of the jigsaw puzzle and providing a good jigsaw puzzle interaction experience for users. BRIEF DESCRIPTION OF DRAWINGS

[0018] Other features, objects, and advantages of the present application will become more apparent from the following detailed description of non-limiting embodiments thereof as read in conjunction with the accompanying drawings:

[0019] Figure 1 a method flow chart illustrating a jigsaw puzzle identification method according to an embodiment of the present application;

[0020] Figure 2 an example diagram of an operation image according to an embodiment of the present application;

[0021] Figure 3 an example of projecting and rendering tile position information according to an embodiment of the present application;

[0022] Figure 4Fig. 1 shows functional modules of a puzzle identification device according to one embodiment of the present application;

[0023] Figure 5 Fig. 1 shows functional modules of a puzzle identification device according to one embodiment of the present application;

[0024] The same or similar reference signs in the drawings represent the same or similar elements. DETAILED DESCRIPTION

[0025] The present application is further described in detail by way of reference to the following figures.

[0026] In one typical configuration of the present application, the terminal, the device of the service network and the trusted party each includes one or more processors (e.g., a central processing unit (CPU)), an input / output interface, a network interface and a memory.

[0027] The memory can include a non-persistent memory, a random access memory (RAM), and / or a non-volatile memory, etc. in a form of a computer readable medium, such as a read only memory (ROM) or a flash memory. The memory is an example of the computer readable medium.

[0028] Computer-readable media includes permanent and non-permanent, moveable and non- moveable media that can be implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, without limitation, phase-change memory (PCM), programmable random access memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically-erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile discs (DVDs) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information for access by a computing device.

[0029] The devices referred to in this application include, but are not limited to, user equipment, network equipment, or devices formed by the integration of user equipment and network equipment through a network. The user equipment includes, but is not limited to, any mobile electronic product capable of human-computer interaction, such as smartphones, tablets, smart lamps, smart projectors, etc., and the mobile electronic product can use any operating system, such as Android or iOS. The network equipment includes an electronic device capable of automatically performing numerical calculations and information processing according to pre-set or stored instructions, and its hardware includes, but is not limited to, microprocessors, application-specific integrated circuits (ASICs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), digital signal processors (DSPs), embedded devices, etc. The network equipment includes, but is not limited to, computers, network hosts, single network servers, multiple network server sets, or clouds composed of multiple servers; here, the cloud consists of a large number of computers or network servers based on cloud computing, where cloud computing is a type of distributed computing, consisting of a virtual supercomputer composed of a group of loosely coupled computer sets. The network includes, but is not limited to, the Internet, wide area network, metropolitan area network, local area network, VPN network, wireless ad hoc network, etc. Preferably, the device can also be a program running on the user equipment, network device, or a device formed by integrating user equipment and network device, network device, touch terminal, or network device and touch terminal through a network.

[0030] Of course, those skilled in the art should understand that the above-described devices are merely examples, and other existing or future devices that are applicable to this application should also be included within the scope of protection of this application, and are hereby incorporated by reference.

[0031] In the description of this application, "multiple" means two or more, unless otherwise expressly and specifically defined.

[0032] Figure 1A jigsaw puzzle recognition method according to one aspect of the present application is shown, which is applied to a computer device including a camera device, and the method includes steps S101, S102 and S103. In step S101, an operation image of a user on a jigsaw puzzle on an operation table is captured by the camera device, wherein each corner of the jigsaw puzzle is provided with a pointing mark of pointing information; in step S102, based on the operation image, pointing position information of a plurality of pointing marks in the operation image on the operation table is recognized; and in step S103, according to the pointing position information of the plurality of pointing marks and the pointing information of the plurality of pointing marks, block position information of one or more jigsaw puzzle blocks contained in the operation image is determined, wherein each block position information includes block identification information of a corresponding jigsaw puzzle block and position information of the corresponding jigsaw puzzle block on the operation table. For example, the computer device includes a device with a data processing device, specifically including but not limited to a user device, or a device formed by integrating a user device and a network device through a network; in some cases, the computer device includes a camera device for collecting an operation image of a user on an operation table, such as a camera or a depth camera, etc. In some embodiments, the computer device further includes a projection device for projecting or projecting superimposed corresponding prompt information on the jigsaw puzzle blocks on the operation table, such as a projector, etc. The jigsaw puzzle refers to an ancient Chinese traditional intelligence toy, as the name implies, which is composed of seven jigsaw puzzle blocks; and the seven jigsaw puzzle blocks can be assembled into many patterns (more than 1600), such as a triangle, a parallelogram, an irregular polygon, a player can also assemble it into various characters, images, animals, bridges, houses, towers, etc. Generally speaking, the jigsaw puzzle is composed of the following seven jigsaw puzzle blocks, and the complete pattern is a square, five isosceles right triangles (two small triangles, one medium triangle and two large triangles) and one parallelogram. Those skilled in the art should understand that the above-mentioned jigsaw puzzle is only an example, and other existing or future jigsaw puzzles can be applicable to the present application and should be included in the protection scope of the present application, and are hereby incorporated by reference.

[0033] Specifically, in step S101, an operation image of a user on a jigsaw puzzle on an operation table is captured by the camera device, wherein each corner of the jigsaw puzzle is provided with a pointing mark of pointing information. For example, the user places one or more blocks of the jigsaw puzzle on the operation table, the camera device captures an operation image of the jigsaw puzzle on the operation table from the shooting angle of the camera device, and the computer device can collect the operation image of the jigsaw puzzle on the operation table by the camera device, such as Figure 2 、 Figure 3The corresponding operation images, etc. The operation desktop refers to the area where the user operates the tangram pieces, including desks, workbenches, office desks, etc. Specifically, such as... Figure 2 , Figure 3 The tangram puzzle pieces shown have directional markers at each corner, including directions pointing from the corresponding corner into the puzzle piece. For example, one marker might consist of two black dots of different sizes, indicating a direction from the larger dot to the smaller dot, or vice versa. Alternatively, the markers could be other directional symbols such as arrows, triangles, or polygons. Those skilled in the art should understand that these directional markers are merely examples, and other existing or future directional markers applicable to this application should also be included within the scope of protection of this application, and are hereby incorporated by reference.

[0034] In step S102, based on the operation image, the pointing position information of multiple directional markers in the operation image on the operation desktop is identified. For example, after the computer device acquires the corresponding operation image, it can identify the pointing image position information corresponding to multiple directional markers in the operation image through the identification features of the operation image and preset directional markers, and determine the pointing image position information as the pointing position information on the operation desktop. As another example, after the computer device acquires the corresponding operation image, it can identify the pointing image position information corresponding to multiple directional markers in the operation image through the identification features of the operation image and preset directional markers. The computer device can acquire the camera parameter information of the camera device, such as the intrinsic and extrinsic parameters when capturing the operation image. Based on the camera parameters, the computer device can determine the transformation of the pointing image position information of multiple directional markers from the image coordinate system to the coordinate system where the operation desktop is located, thereby determining the pointing position information on the operation desktop.

[0035] In step S103, the block position information of one or more jigsaw puzzle pieces included in the operation image is determined according to the pointing position information of the plurality of pointing identifiers and the pointing information of the plurality of pointing identifiers, wherein each block position information includes the block identifier information of the corresponding jigsaw puzzle piece and the position information of the corresponding jigsaw puzzle piece on the operation desktop. For example, after the computer device obtains the pointing position information of the plurality of pointing identifiers, the block position information of one or more jigsaw puzzle pieces included in the operation image is determined according to the pointing position information of the plurality of pointing identifiers and the pointing information of the plurality of pointing identifiers. The block position information includes the block identifier information of each jigsaw puzzle piece and the position information of the corresponding jigsaw puzzle piece on the operation desktop. The position information of the jigsaw puzzle piece on the operation desktop can be the pointing image position information of the jigsaw puzzle piece identified in the operation image, or the position information of the corresponding jigsaw puzzle piece in the coordinate system of the operation desktop. The block identifier information is used to identify the block type or unique identifier of the jigsaw puzzle piece, such as five block types: square, parallelogram, large isosceles right triangle, medium isosceles right triangle, and small isosceles right triangle, or further distinguished: square, parallelogram, large isosceles right triangle 1, large isosceles right triangle 2, medium isosceles right triangle, small isosceles right triangle 1, and small isosceles right triangle 2. Large isosceles right triangle 1 and large isosceles right triangle 2 can be distinguished by different pointing directions, different colors, or different types of pointing identifiers. Similarly, small isosceles right triangle 1 and small isosceles right triangle 2 can also be distinguished by different pointing directions, different colors, or different types of pointing identifiers.

[0036] In some cases, the pointing identifier of each jigsaw puzzle piece can be the same, for example, the pointing identifier of each jigsaw puzzle piece is composed of two black dots of different sizes, or different pointing identifiers can be set according to different piece identifier information, etc. For different pointing identifiers set according to different piece identifier information, the computer device can identify different pointing identifiers according to the pointing characteristics of the different pointing identifiers, thereby dividing them into different pointing identifier groups corresponding to the different piece identifier information, and then determining the piece position information of the corresponding jigsaw puzzle piece according to the pointing position information of the pointing identifiers in each pointing identifier group and the pointing rules of the pointing identifiers in the pointing identifier group (for example, corresponding pointing information pointing to the interior of the piece, etc.). For the case where the same pointing identifier is set for each jigsaw puzzle piece, we can compare the distance between each pointing identifier with the different piece preset distance of the jigsaw puzzle piece, thereby determining a plurality of line segment groups, and based on the plurality of line segment groups, determining the matching line segment group corresponding to the different piece identifier, and thereby determining the position information of the jigsaw puzzle piece on the operation desktop based on the matching line segment group. In some cases, the pointing identifier of each jigsaw puzzle piece points to the center of the corresponding piece, etc., then the computer device can directly determine the plurality of pointing identifiers pointing to the same position as a pointing identifier group according to the pointing information of the plurality of pointing identifiers, and determine the piece identifier information of the jigsaw puzzle piece and the position information of the piece on the operation desktop according to the number of pointing identifiers contained in each pointing identifier group and the pointing position information, etc. Wherein, the position information of the jigsaw puzzle piece on the operation desktop can be described by the plurality of pointing position information of the plurality of pointing identifiers matched by the jigsaw puzzle piece, or by the line segment position information of the plurality of line segments corresponding to the plurality of pointing identifiers constituting the jigsaw puzzle piece, or by the image center and outer frame contour corresponding to the plurality of pointing identifiers of the jigsaw puzzle piece, etc.

[0037] Reference Figure 2 , Figure 3 In some embodiments, the computer device sets a corresponding effective operation area on the operation desktop during the determination of the piece position information of the jigsaw puzzle piece, in some embodiments, the effective operation area can be presented by the projection device on the operation desktop as a corresponding area identifier, for example, the area corner identifier of a rectangular effective operation area, etc., at least three area corner identifiers can identify a clear jigsaw puzzle collection range, and the area outside the range is determined as an invalid jigsaw puzzle range, which is not considered during the determination of the piece position information. In other embodiments, the effective operation area is not presented on the operation desktop.

[0038] In some embodiments, the pointing identifier comprises a point group composed of at least two point identifiers of different sizes; wherein the method further comprises step S104 (not shown), in which the operation image is pre-processed to determine a corresponding optimized operation image; wherein in step S102, based on the optimized operation image, the pointing position information of the point group on the operation table is identified. For example, referring to Figure 2 , the pointing identifier comprises a point group composed of at least two point identifiers of different sizes, etc., the color of the point identifier in the corresponding point group is different from the color of the board, for example, the color of the board is white, and the color of the point identifier in the corresponding point group can be black, or the color of the board is black, and the color of the point identifier in the point group can be white, etc. Wherein the pointing position information of the point group on the operation table can be determined based on the position information of all point identifiers in the point group on the operation table, for example, the corresponding pointing position information can be described by the coordinates of all point identifiers in the at least two point identifiers, or it can be determined based on the position information of part of the point identifiers in the point group on the operation table, for example, the pointing position information of the point group can be described by the coordinates of the corresponding larger point identifier or smaller point identifier in the point group, etc., which is not limited here. Wherein the relative position of the larger point and the smaller point in the point group is not limited, which can be as shown in Figure 2 The pointing information is used to indicate the direction information of the larger point identifier pointing to the smaller point identifier, or the smaller point can be outside the larger point, and the pointing information is used to indicate the direction information of the smaller point identifier pointing to the larger point identifier. After the computer device obtains the corresponding operation image, the operation image is pre-processed to determine the corresponding optimized operation image, so as to identify the pointing position information of the plurality of point groups on the operation table based on the optimized operation image, etc. Wherein the image pre-processing includes but is not limited to one or more of image smoothing, sharpening, binarization or grayscale.

[0039] In some embodiments, the computer device further comprises a lighting device; wherein the method further comprises a step S105 (not shown) of turning on the lighting device to increase the ambient brightness information of the operation desktop. For example, the lighting device refers to a lighting source that emits light and heat by electricity, such as an incandescent lamp, an LED lamp, etc. In some cases, the computer device further comprises a lighting device similar to a desk lamp, which can be automatically or manually started when needed to increase the ambient brightness information of the operation desktop, etc. For example, the computer device detects the ambient brightness in the operation image after collecting the operation image, and if the ambient brightness is less than or equal to a preset brightness threshold, the computer device can send a starting instruction to the lighting device, thereby turning on the lighting device to increase the ambient brightness; or the computer device obtains a starting instruction of the lighting device from the user (for example, a voice instruction, a gesture instruction, or a touch on the key, etc.), and turns on the lighting device based on the starting instruction of the user to increase the ambient brightness information of the operation desktop, etc. The computer device can collect the corresponding real-time operation image after the ambient brightness information is increased, and perform subsequent recognition of the seven-piece puzzle blocks based on the real-time operation image, etc.

[0040] In some embodiments, the step S103 comprises a sub-step S1031 (not shown) and a sub-step S1032 (not shown). In the sub-step S1031, a plurality of line segment groups are determined according to the pointing position information of the plurality of pointing identifiers, wherein each line segment is determined based on two pointing identifiers, and each line segment group corresponds to at least one tile identifier information; in the sub-step S1032, one or more tile position information of the jigsaw tiles are determined according to the plurality of line segment groups and the pointing information of the plurality of pointing identifiers, wherein each tile position information comprises tile identifier information of a corresponding jigsaw tile and position information of the corresponding jigsaw tile on the operation desktop. For example, the computer device can construct a plurality of line segments according to the pointing position information of the plurality of pointing identifiers, and determine a plurality of line segment groups based on the constructed plurality of line segments. Specifically, each two pointing identifiers with different pointing positions can construct a line segment, and according to the length of the constructed line segment, the corresponding line segment is divided into different tile identifier information groups, for example, the length of the line segment is compared with the length corresponding to the tile identifier information of different jigsaw tiles, if the length difference between the length of the line segment and the length corresponding to the tile identifier information of a jigsaw tile is less than or equal to a preset difference threshold, the computer device can determine the line segment as one of the plurality of line segments in the line segment group of the tile identifier information. If there are multiple types of jigsaw tiles with the same or similar length corresponding to the tile identifier information, a line segment can be divided into a plurality of line segment groups corresponding to the tile identifier information, and when the line segment is determined as a matching line segment in a line segment group corresponding to the tile identifier information of the line segment group, the line segment is deleted from the line segment group of other tile identifier information, etc., to prevent waste of computing resources caused by repeated calculation, save computing resources and speed up data processing efficiency. The pointing position information of the pointing identifier can be determined based on the position information of part or all of the identifiers in the pointing identifier, for example, the corresponding pointing position information can be determined based on the point coordinates of any point in the point group, or the corresponding pointing position information can be determined based on the center coordinates of a plurality of point coordinates in the point group, etc., which is not limited herein. After the computer device determines the plurality of line segment groups, the corresponding matching line segments can be determined according to the plurality of line segment groups and the matching rules corresponding to the tile identifier information of each jigsaw tile, so as to determine the tile position information corresponding to the tile identifier information, etc.

[0041] In some embodiments, the jigsaw puzzle includes piece identification information of a plurality of jigsaw puzzle pieces, each piece identification information corresponds to at least one distance threshold; wherein in step S1031, a plurality of line segments are determined according to the pointing position information of the plurality of pointing marks two by two, if there is a line segment in the plurality of line segments that satisfies one of the distance thresholds corresponding to the plurality of piece identification information, the line segment is determined as a subset of a line segment group according to the line segment, and the line segment group is assigned the piece identification information corresponding to one of the distance thresholds. For example, according to the five types of pieces, square, parallelogram, large isosceles right triangle, medium isosceles right triangle and small isosceles right triangle, one or more distance thresholds can be set for each type of piece, wherein the set distance thresholds can be the same or different. Specifically, the corresponding distance threshold is determined by at least one line segment of the corresponding piece identification information (such as the length of the side of the figure, the diagonal line, etc.), the distance threshold can be set as the length of all the line segments of the corresponding piece identification information, and it can also be set as the length of the line segment that can determine the number of line segments required to determine the piece type information, for example, the length of the right angle side and / or the length of the hypotenuse of the isosceles right triangle, the length of the side and / or the length of the diagonal of the square, or the length of the two sets of parallel sides of the parallelogram. In some cases, after determining the corresponding plurality of line segments two by two from the plurality of pointing marks, each line segment in the plurality of line segments is grouped, the length of the line segment is compared with the distance threshold corresponding to different piece identification information, if the length of the line segment satisfies the distance threshold corresponding to the piece identification information of a certain jigsaw puzzle piece, for example, the difference between the length of the line segment and the distance threshold corresponding to the piece identification information of a certain jigsaw puzzle piece satisfies a predetermined difference threshold, etc., the computer device can determine the line segment as one of the plurality of line segments of the line segment group of the piece identification information, etc.

[0042] In some embodiments, each of the plurality of tile identification information has a corresponding tile matching rule; wherein in step S1032, a corresponding matching line segment group is determined from the plurality of line segment groups according to the plurality of line segment groups and the tile matching rule corresponding to the tile identification information of each line segment group, wherein each matching line segment group includes one or more sub-matching line segment groups, and at least one closed figure is determined based on each sub-matching line segment group; and the tile position information of one or more jigsaw puzzle tiles is determined based on the plurality of matching line segment groups and the pointing information of the plurality of pointing identifiers, wherein each tile position information includes the tile identification information of the corresponding jigsaw puzzle tile and the position information of the corresponding jigsaw puzzle tile on the operation desktop. For example, after the computer device determines the line segment group corresponding to the plurality of tile identification information, it can filter out the corresponding matching line segment group from the corresponding line segment group according to the different tile matching rules of each tile identification information. For example, when the corresponding tile identification information is a small isosceles right triangle, the corresponding matching rule includes at least one of the following: ① the included angle of two equal length line segments is a right angle; ② there are three line segments that satisfy the Pythagorean theorem; ③ there are two line segments with an included angle of about 45°; ④ there are two equal length line segments, etc. At least two line segments (for example, it may be two right angle side line segments, or it may be two right angle side line segments and one hypotenuse line segment) that form an isosceles right triangle can be determined according to the above tile matching rule, and the at least two line segments are determined as a sub-matching line segment group of the isosceles right triangle. The computer device can determine a plurality of sub-matching line segment groups from the line segment group of the small isosceles right triangle based on the foregoing manner. Similarly, the matching rules of medium isosceles right triangle and large isosceles right triangle are similar to those of small isosceles right triangle, and are not described again. Also, when the corresponding tile identification information is a square, the corresponding matching rule includes at least one of the following: ① the included angle of two equal length line segments is a right angle; ② there are four equal length line segments that form a closed figure; ③ all four corners of the foregoing closed figure are right angles, etc. At least two line segments (for example, it may be two diagonal line segments, or it may be four right angle side line segments, or four right angle side line segments and two diagonal line segments) that form a square can be determined according to the above tile matching rule, and the at least two line segments are determined as a sub-matching line segment group of the square. The computer device can determine a plurality of sub-matching line segment groups from the line segment group of the square based on the foregoing manner.For example, when the corresponding segment identifier is a parallelogram, the corresponding matching rules include at least one of the following: ① whether there are parallel and equal-length opposite sides; ② whether the diagonal angles of the closed figures formed by the two sets of parallel and equal opposite sides are consistent; the above segment matching rules can determine at least two line segments constituting the parallelogram (for example, it may be a set of two parallel and equal line segments, or it may be two sets of four parallel and equal line segments), etc., and the at least two line segments are determined as a sub-matching line segment group of the parallelogram. The computer device can determine multiple sub-matching line segment groups from the line segment group of the parallelogram based on the aforementioned method. Of course, those skilled in the art should understand that the above segment matching rules are only examples, and other existing or future segment matching rules that are applicable to this application should also be included within the scope of protection of this application, and are hereby incorporated by reference.

[0043] In some cases, a sub-matching line segment group can determine at least one closed shape. For example, a triangle can be formed by determining a hypotenuse based on two right-angled line segments; a square can be formed by determining four right-angled sides based on three line segments and two diagonal line segments; a parallelogram can be formed by determining two more parallel and equal-length line segments based on two parallel line segments; and a square or parallelogram can be formed based on four line segments. In other cases, a sub-matching line segment group can determine a closed shape based on multiple directional markers included in the line segment group. For example, a triangle can be determined by the positional information of three directional markers on two adjacent sides; a square can be determined by the positional information of three directional markers on two adjacent sides; and a parallelogram can be determined by the positional information of three directional markers on two adjacent sides. In other words, the number of line segments contained in a sub-matching line segment group can be configured differently depending on the matching rules.

[0044] In some embodiments, the determining the tile position information of the one or more jigsaw puzzle tiles based on the plurality of matched line segment groups and the pointing information of the plurality of pointing identifiers, wherein each tile position information comprises tile identifier information of a corresponding jigsaw puzzle tile and position information of the corresponding jigsaw puzzle tile on the operation desktop, comprises: if the pointing identifier of the line segment of a sub matched line segment group in a matched line segment group points to the inside of the closed figure determined by the sub matched line segment group, determining that the sub matched line segment group is a target line segment group corresponding to the tile identifier information of the matched line segment group; and determining the tile position information of the one or more jigsaw puzzle tiles according to the one or more target line segment groups, wherein each tile position information comprises tile identifier information of a corresponding jigsaw puzzle tile and position information of the corresponding jigsaw puzzle tile on the operation desktop. For example, after the computer device determines the matched line segment group corresponding to each tile identifier information, the computer device performs pointing verification on the closed figure formed by each sub matched line segment group in the matched line segment group based on the pointing identifier of the line segment of the sub matched line segment group, such as by determining whether the pointing identifier corresponding to the pointing information points to the inside of the closed figure. If yes, the computer device determines that the sub matched line segment group is a target line segment group corresponding to the tile identifier information. If no, the computer device determines that the sub matched line segment group is not a target line segment group corresponding to the tile identifier information. Through the pointing information, the sub matched line segment group that truly constitutes a jigsaw puzzle tile can be determined more simply and efficiently, thereby improving the accuracy of tile recognition.

[0045] In some embodiments, the method further comprises a step S106 (not shown) of acquiring preset jigsaw puzzle piece model information of the current operation of the user, wherein the preset jigsaw puzzle piece model information comprises model position information of a plurality of jigsaw puzzle pieces; determining a corresponding matching result according to the preset jigsaw puzzle piece model information and the piece position information of the one or more jigsaw puzzle pieces, wherein the matching result comprises puzzle success or puzzle failure. For example, the preset jigsaw puzzle piece model information is used to indicate a preset jigsaw puzzle pattern of the jigsaw puzzle for the current user operation, which can be randomly determined by the computer device from a template database, or selected by the user in a corresponding template selection page. Further, the computer device can present the preset jigsaw puzzle piece model information on the desktop through the projection device. In some cases, the computer device can present a corresponding puzzle classification on the desktop through the projection device, which includes but is not limited to "animals", "scenery", "daily necessities" and "vehicles", etc. Further, the user can click on an arbitrary classification to enter a sub-class template selection page, such as "penguins", "bears", "dogs", "cats", "roosters" puzzle templates under the animal classification, and select a puzzle template as the preset jigsaw puzzle piece model information for the current user operation, etc. The preset jigsaw puzzle piece model information comprises model position information of each jigsaw puzzle piece in the puzzle template, which can be absolute position information of each jigsaw puzzle piece on the operation desktop in the puzzle template, for example, by projecting the jigsaw puzzle piece at the corresponding position through the projection device to guide the user to assemble each jigsaw puzzle piece to the corresponding model position information, etc. If the piece position information of each jigsaw puzzle piece is at the absolute position information corresponding to the preset jigsaw puzzle piece model information (for example, the position difference between the piece position information of each jigsaw puzzle piece and the absolute position information of the preset jigsaw puzzle piece model information is less than or equal to a preset position difference threshold, etc.), it is determined that the matching result is puzzle success. Also, the model position information can also be relative position information of each jigsaw puzzle piece on the operation desktop in the puzzle template, for example, by projecting and presenting the puzzle template of the jigsaw puzzle piece outside the corresponding valid detection area through the projection device, and detecting the piece position information of the jigsaw puzzle piece inside the valid detection area. If the piece position information of each jigsaw puzzle piece satisfies the relative position information of each jigsaw puzzle piece in the preset jigsaw puzzle piece model information, it can be determined that the matching result is puzzle success, etc.In some embodiments, determining the corresponding matching result according to the preset tile model information and the tile position information of the one or more jigsaw tiles includes: determining initial tile position information of an initial jigsaw tile and corresponding initial offset information according to the preset tile model information and the tile position information of the one or more jigsaw tiles; determining offset position information of each remaining jigsaw tile according to the initial offset information and tile position information of the remaining jigsaw tiles; if the offset position information of a certain remaining jigsaw tile is less than or equal to a distance difference threshold value from model position information of a model tile corresponding to tile identification information of the certain remaining jigsaw tile in the preset tile model information, determining the tile position information of the certain remaining jigsaw tile as tile position information of a matched jigsaw tile; if the tile position information of the remaining jigsaw tiles are all determined as tile position information of a matched jigsaw tile, determining that the corresponding matching result includes a successful puzzle; otherwise, determining that the matching result includes a failed puzzle. In some cases, the planar coordinate system of the corresponding operation table top includes a reference coordinate system determined with the upper left corner of the effective detection area as the origin, the horizontal as the x-axis, and the vertical as the y-axis, and the position information of the preset tile model information in the reference coordinate system is determined as the model position information. The aforementioned reference coordinate system is only an example and is not limited. The computer device selects the tile position information of one (which can be randomly selected or selected according to a preset selection rule, such as selecting a triangle, a square, or a parallelogram) recognized jigsaw tile and the model position information of a model tile corresponding to the tile identification information of the jigsaw tile in the preset tile model information, and if they are aligned (for example, the position difference between the tile position information of the jigsaw tile and the model position information of the corresponding model tile is less than or equal to a position difference threshold value), the aligned jigsaw tile is determined as the initial jigsaw tile, and the corresponding initial offset information is 0. At this time, the tile position information of the remaining jigsaw tiles in the plurality of jigsaw tiles is the offset position information of the remaining jigsaw tiles. If the jigsaw tile is not aligned, the jigsaw tile is translated in the effective detection area until the position difference between the tile position information of the jigsaw tile and the model position information of the corresponding model tile is less than or equal to a position difference threshold value, the jigsaw tile is determined as the initial jigsaw tile, and the translation information is determined as the initial offset information.After obtaining the initial offset information of the initial tangram pieces, the offset position information of the remaining tangram pieces among multiple tangram piece position information is determined based on this initial offset information (e.g., translating the position information of the remaining tangram pieces according to the initial offset information, etc.). Based on the offset position information of the remaining tangram pieces, it is determined whether the remaining tangram piece is a matching tangram piece. For example, according to preset piece model information, the model position information of the model piece corresponding to the piece identifier information of the remaining tangram piece in the preset piece model information can be determined. If the distance difference between the offset position information of a certain remaining tangram piece and the model position information of the model piece corresponding to the piece identifier information of the remaining tangram piece in the preset piece model information is less than or equal to a distance difference threshold, then the position information of that remaining tangram piece is determined to be the position information of a matching tangram piece. If the position information of all remaining tangram pieces is determined to be the position information of a matching tangram piece, then the corresponding matching result is determined to include successful puzzle completion; otherwise, the matching result is determined to include puzzle failure.

[0046] In some embodiments, the computer device further includes a projection device, and the method further includes step S107 (not shown), in which, based on the position information of the matching tangram pieces, the projection device projects corresponding puzzle-solving reminder information onto the corresponding position of the operating desktop. For example, during the puzzle-solving process, for the position information of the matching tangram pieces, the computer device can project and render puzzle-solving reminder information at the corresponding position using the projection device. For example, the computer device projects the outline of the corresponding piece around the position information of the matching tangram pieces, such as... Figure 3 As shown, for a matching tangram piece, the user can be prompted that the tangram piece is a matching piece by changing the projected color of the piece's outline. Alternatively, the computer device can project the preset piece model information outside the effective detection area, and project the corresponding piece outline around the model position information of the model piece corresponding to the piece identifier information of the matching tangram piece within the preset piece model information. For example, different colors can be used to project and render the outline to prompt the user that the tangram piece is a matching piece. Of course, those skilled in the art should understand that the above-described puzzle-solving prompts are merely examples, and other existing or future puzzle-solving prompts that are applicable to this application should also be included within the scope of protection of this application, and are hereby incorporated by reference.

[0047] In some embodiments, the preset tile model information includes color information of the plurality of jigsaw puzzle tiles; wherein the method further includes step S108 (not shown), in which color information corresponding to at least one of the one or more jigsaw puzzle tiles is determined based on the operation image; wherein the determining the corresponding matching result based on the preset tile model and the position information of the one or more jigsaw puzzle tiles includes: determining the corresponding matching result based on the preset tile model information, the position information of the one or more jigsaw puzzle tiles, and the color information corresponding to the at least one of the one or more jigsaw puzzle tiles. For example, when the jigsaw puzzle tiles are provided with colors, for jigsaw puzzle tiles of different shapes, we can determine based on different tile matching rules and side length, etc. For two jigsaw puzzle tiles of the same shape and the same side length, we also need to distinguish them by color information, for example, the corresponding jigsaw puzzle tiles are provided with different colors, the preset tile model information includes color information of the plurality of jigsaw puzzle tiles, etc. In the matching process, after the position matching is successful, the color information corresponding to at least one of the one or more jigsaw puzzle tiles is determined (for example, the color information of two small right-angled isosceles triangles and / or two large right-angled isosceles triangles, etc.) based on the operation image, and the color information of the at least one jigsaw puzzle tile is matched with the color of the corresponding jigsaw puzzle model tile in the preset tile model information. If the corresponding colors are the same, it is determined that the jigsaw puzzle tile is a matched jigsaw puzzle tile; if the corresponding colors are not the same, it is determined that the jigsaw puzzle tile is an unmatched jigsaw puzzle tile, etc. Here, the color matching process can be before the position matching or after the corresponding position matching, etc.

[0048] In some embodiments, the computer device further includes a projection device, and the method further includes step S109 (not shown), in which, if the matching result includes a successful puzzle, the projection device is used to project tile model related information on the operation table. For example, if the computer device determines that the matching result is a successful puzzle, the tile model related information is projected on the operation table, such as superimposing the overall puzzle frame of the corresponding puzzle pattern on the position of the jigsaw puzzle tile in the current puzzle, etc. Or, the model animation information corresponding to the preset tile model information is projected and presented outside the effective detection area of the current operation table, such as projecting and presenting the tile animation information associated with the preset tile model information on the operation table by the projection device when it is determined that the puzzle is successful, such as the corresponding small animation of the "penguin" tile corresponding to the "penguin mini-encyclopedia", etc. Of course, those skilled in the art should understand that the above-mentioned tile model related information is only an example, and other existing or future jigsaw puzzle model related information, such as the jigsaw puzzle model related information, can be applicable to the present application, and should also be included in the protection scope of the present application, and is hereby included by reference.

[0049] In some embodiments, the computer device further comprises a projection device, and the method further comprises a step S110 (not shown) of projecting the piece position information of the one or more jigsaw puzzle pieces by the projection device. For example, as shown in FIG. 1, during the jigsaw puzzle process, for the piece position information of the determined jigsaw puzzle pieces, the computer device projects the corresponding piece contour around each jigsaw puzzle piece by the projection device, the corresponding piece contour being determined by the piece position information of each jigsaw puzzle piece, for example, the piece contour of each jigsaw puzzle piece is determined by expanding the corresponding piece edge outward by a preset distance based on the piece position information of each jigsaw puzzle piece, and the corresponding piece contour is projected and rendered by the projection device at the piece position information of each jigsaw puzzle piece, and the like. Figure 3

[0050] The above mainly introduces the embodiments of the jigsaw puzzle recognition method according to one aspect of the present application, in addition, the present application also provides specific devices capable of implementing the above methods, which will be introduced below in combination with Figure 4 .

[0051] Figure 4 A jigsaw puzzle recognition device according to one aspect of the present application is shown, the device comprises a camera device, and the device comprises a first module 101, a second module 102 and a third module 103. The first module 101 is configured to capture an operation image of a user's operation on a jigsaw puzzle piece on a desktop by the camera device, wherein each corner of the jigsaw puzzle piece is provided with a pointing identification of pointing information; the second module 102 is configured to identify the pointing position information of a plurality of pointing identifications in the operation image on the operation desktop based on the operation image; and the third module 103 is configured to determine the piece position information of one or more jigsaw puzzle pieces contained in the operation image according to the pointing position information of the plurality of pointing identifications and the pointing information of the plurality of pointing identifications, wherein each piece position information comprises piece identification information of a corresponding jigsaw puzzle piece and position information of the corresponding jigsaw puzzle piece on the operation desktop.

[0052] Here, the Figure 4 shown first module 101, second module 102 and third module 103 correspond to the same or similar specific embodiments as the above Figure 1 shown step S101, step S102 and step S103, and thus will not be described again, and are hereby included by reference.

[0053] ​In some embodiments, the pointing identifiers include point groups composed of at least two point identifiers of different sizes; wherein the device further comprises a fourth module (not shown) for image pre-processing the operation image to determine a corresponding optimized operation image; wherein a second module 102 is configured to identify, based on the optimized operation image, pointing position information of the point groups in the optimized operation image on the operation table.

[0054] In some embodiments, the device further comprises a lighting device; wherein the device further comprises a fifth module (not shown) for turning on the lighting device to improve the ambient brightness information of the operation table.

[0055] In some embodiments, the third module 103 comprises a third one unit (not shown) and a third two unit (not shown). The third one unit is configured to determine a plurality of line segment groups based on the pointing position information of the pointing identifiers, wherein each line segment is determined based on two pointing identifiers, and each line segment group has at least one tile identifier information corresponding thereto; the third two unit is configured to determine tile position information of one or more jigsaw tiles based on the plurality of line segment groups and the pointing information of the pointing identifiers, wherein each tile position information comprises tile identifier information of a corresponding jigsaw tile and position information of the corresponding jigsaw tile on the operation table.

[0056] In some embodiments, the jigsaw comprises tile identifier information of a plurality of jigsaw tiles, and each tile identifier information has at least one distance threshold corresponding thereto; wherein the third one unit is configured to determine a plurality of line segments based on the pointing position information of the pointing identifiers, and if there is a line segment in the plurality of line segments that satisfies one of the distance thresholds corresponding to the plurality of tile identifier information, then the line segment is determined as a subset of a line segment group based on the line segment, and the line segment group is assigned the tile identifier information corresponding to the distance threshold.

[0057] In some embodiments, each tile identifier information in the plurality of tile identifier information has a corresponding tile matching rule; wherein the third two unit is configured to determine a corresponding matching line segment group from the plurality of line segment groups based on the plurality of line segment groups and the tile matching rule corresponding to the tile identifier information of each line segment group, wherein each matching line segment group comprises one or more sub-matching line segment groups, and at least one closed figure is determined based on each sub-matching line segment group; and determine tile position information of one or more jigsaw tiles based on the plurality of matching line segment groups and the pointing information of the pointing identifiers, wherein each tile position information comprises tile identifier information of a corresponding jigsaw tile and position information of the corresponding jigsaw tile on the operation table.

[0058] In some embodiments, the determining the tile position information of the one or more jigsaw puzzle tiles based on the plurality of matched line segment groups and the pointing information of the plurality of pointing identifiers, wherein each tile position information comprises tile identifier information of a corresponding jigsaw puzzle tile and position information of the corresponding jigsaw puzzle tile on the operation table, comprises: if the pointing identifier of a line segment of a sub matched line segment group in a matched line segment group is within the closed figure determined by the sub matched line segment group, determining that the sub matched line segment group is a target line segment group corresponding to the tile identifier information of the matched line segment group; and determining the tile position information of the one or more jigsaw puzzle tiles based on the one or more target line segment groups, wherein each tile position information comprises tile identifier information of a corresponding jigsaw puzzle tile and position information of the corresponding jigsaw puzzle tile on the operation table.

[0059] In some embodiments, the device further comprises a sixth module (not shown) configured to obtain preset tile model information of the jigsaw puzzle currently operated by the user, wherein the preset tile model information comprises model position information of a plurality of jigsaw puzzle tiles; and determine a corresponding matching result based on the preset tile model information and the tile position information of the one or more jigsaw puzzle tiles, wherein the matching result comprises a successful puzzle or a failed puzzle.

[0060] In some embodiments, the determining the corresponding matching result based on the preset tile model information and the tile position information of the one or more jigsaw puzzle tiles comprises: determining initial tile position information of an initial jigsaw puzzle tile and corresponding initial offset information in the tile position information of the one or more jigsaw puzzle tiles based on the preset tile model information and the tile position information of the one or more jigsaw puzzle tiles; determining offset position information of each remaining jigsaw puzzle tile based on the initial offset information and the tile position information of the remaining jigsaw puzzle tiles in the position information of the plurality of jigsaw puzzle tiles; if the offset position information of a certain remaining jigsaw puzzle tile is less than or equal to a distance difference threshold value from the model position information of a model tile corresponding to the tile identifier information of the certain remaining jigsaw puzzle tile in the preset tile model information, determining that the tile position information of the certain remaining jigsaw puzzle tile is the tile position information of a matched jigsaw puzzle tile; and if the tile position information of the remaining jigsaw puzzle tiles are all determined to be the tile position information of the matched jigsaw puzzle tile, determining that the corresponding matching result comprises a successful puzzle; otherwise, determining that the corresponding matching result comprises a failed puzzle.

[0061] In some embodiments, the device further comprises a projection device, and the device further comprises a seventh module (not shown) configured to project corresponding puzzle correct reminding information on a corresponding position of the operation table by the projection device based on the tile position information of the matched jigsaw puzzle tile.

[0062] In some embodiments, the preset puzzle piece model information comprises color information of the plurality of puzzle pieces; wherein the device further comprises an eighth module (not shown) configured to determine color information corresponding to at least one of the one or more puzzle pieces based on the operation image; and wherein the determining the corresponding matching result based on the preset puzzle piece model and the position information of the one or more puzzle pieces comprises determining the corresponding matching result based on the preset puzzle piece model information, the position information of the one or more puzzle pieces, and the color information corresponding to the at least one of the one or more puzzle pieces.

[0063] In some embodiments, the device further comprises a projection device, and the device further comprises a ninth module (not shown) configured to project, by the projection device, puzzle piece model related information on the operation table if the matching result indicates that the puzzle is successfully completed.

[0064] In some embodiments, the device further comprises a projection device, and the device further comprises a tenth module (not shown) configured to project, by the projection device, the position information of the one or more puzzle pieces.

[0065] Here, the specific embodiments of the fourth to tenth modules are the same as or similar to the embodiments of the aforementioned steps S104 to S110, and thus will not be described again, but are incorporated herein by reference.

[0066] In addition to the methods and devices described in the above embodiments, the present application also provides a computer readable storage medium storing computer code, which, when executed, performs the method of any one of the preceding embodiments.

[0067] The present application also provides a computer program product, which, when executed by a computer device, performs the method of any one of the preceding embodiments.

[0068] The present application also provides a computer device, which comprises:

[0069] one or more processors;

[0070] a memory configured to store one or more computer programs;

[0071] When the one or more computer programs are executed by the one or more processors, the one or more processors implement the method of any one of the preceding embodiments.

[0072] Figure 5 An exemplary system that can be used to implement various embodiments described in the present application is shown;

[0073] As shown in FIG. 3, system 300 can include a system control module 310, a system memory 315, a NVM / storage device 320, and a communication interface(s) 325. System 300 can also include a processor(s) 305 coupled to system control module 310, system memory 315, NVM / storage device 320, and communication interface(s) 325. Figure 5 As shown in FIG. 3, system 300 can include a system control module 310, a system memory 315, a NVM / storage device 320, and a communication interface(s) 325. System 300 can also include a processor(s) 305 coupled to system control module 310, system memory 315, NVM / storage device 320, and communication interface(s) 325.

[0074] For one embodiment, system control module 310 can include any suitable interface controllers to provide for any suitable interface to at least one of processor(s) 305 and / or any suitable device or component in communication with system control module 310.

[0075] System control module 310 can include a memory controller module 330 to provide an interface to system memory 315. Memory controller module 330 can be a hardware module, a software module, and / or a firmware module.

[0076] System memory 315 can be used, for example, to load and store data and / or instructions for system 300. For one embodiment, system memory 315 can include any suitable volatile memory, such as suitable DRAM. In some embodiments, system memory 315 can include double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).

[0077] For one embodiment, system control module 310 can include one or more input / output (I / O) controller(s) to provide an interface to NVM / storage device 320 and communication interface(s) 325.

[0078] For example, NVM / storage device 320 can be used to store data and / or instructions. NVM / storage device 320 can include any suitable non-volatile memory (e.g., flash memory) and / or can include any suitable non-volatile storage device(s) (e.g., one or more hard disk drives (HDDs), one or more compact disk (CD) drives, and / or one or more digital versatile disk (DVD) drives).

[0079] NVM / storage device 320 can include a storage resource that is physically part of a device on which system 300 is installed or that is accessed via the device but not physically a part of the device. For example, NVM / storage device 320 can be accessed over a network via communication interface(s) 325.

[0080] The communication interface(s) 325 can provide an interface for the system 300 to communicate through one or more networks and / or with any other suitable device. The system 300 can communicate wirelessly with one or more components of a wireless network in accordance with any of one or more wireless network standards and / or protocols.

[0081] For one embodiment, at least one of the processor(s) 305 can be packaged together with logic of one or more controllers of the system control module 310 (e.g., the memory controller module 330). For one embodiment, at least one of the processor(s) 305 can be packaged together with logic of one or more controllers of the system control module 310 to form a system in a package (SiP). For one embodiment, at least one of the processor(s) 305 can be integrated in the same die with logic of one or more controllers of the system control module 310. For one embodiment, at least one of the processor(s) 305 can be integrated in the same die with logic of one or more controllers of the system control module 310 to form a system on a chip (SoC).

[0082] In various embodiments, the system 300 can be, but is not limited to, a server, a workstation, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.). In various embodiments, the system 300 can have more or less components, and / or different architectures. For example, in some embodiments, the system 300 includes one or more cameras, a keyboard, a liquid crystal display (LCD) screen (including touch screen displays), non- volatile memory ports, multiple antennas, graphics chips, application specific integrated circuits (ASICs), and speakers.

[0083] It is noted that the present application can be implemented in software and / or in a combination of software and hardware, e.g., application specific integrated circuits (ASIC), general purpose computers or any other similar devices. In one embodiment, the software program of the present application is implemented by a processor to perform the steps or functions described above. Also, the software program of the present application (including related data structures) can be stored in a computer readable storage medium, e.g., RAM memory, magnetic or optical drive or diskette, and so on. Additionally, some steps or functions might be performed in hardware, e.g., as circuitry that cooperates with the processor to perform the various steps or functions described above.

[0084] In addition, part of the present application can be applied as a computer program product, for example, computer program instructions, when executed by a computer, through the operation of the computer, the method and / or technical solutions according to the present application can be called or provided. Those skilled in the art should understand that the form of computer program instructions in computer readable medium includes but is not limited to source file, executable file, installation package file and the like, and accordingly, the way of computer program instructions executed by computer includes but is not limited to: the computer directly executes the instructions, or the computer compiles the instructions and then executes the corresponding compiled program, or the computer reads and executes the instructions, or the computer reads and installs the instructions and then executes the corresponding installed program. Here, the computer readable medium can be any available computer readable storage medium or communication medium accessible to the computer.

[0085] Communication media includes any medium through which computer readable instructions, data structures, program modules, or other data is communicated from one system to another, e.g., according to the present application. Communication media can include wired media such as a wired network or direct-wired connection carrying one or more data signals, and wireless media such as acoustic, electromagnetic, RF, microwave, and infrared, capable of propagating energy patterns into space. Computer readable instructions, data structures, program modules, or other data can be embodied as modulated data signals, e.g., carrier waves, such as those implemented as part of an extended spectrum technique. The term "modulated data signal" refers to a signal that has one or more of its characteristics changed or set in a manner to encode information in the signal. The modulation can be analog, digital, or a combination of the two.

[0086] By way of example, and not limitation, computer readable storage media can include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. For example, computer readable storage media includes, but is not limited to, random access memory (RAM), such as dynamic RAM (DRAM), static RAM (SRAM), and / or non-volatile memory, such as read only memory (ROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), flash memory, magnetic and / or optical disks, other magnetic media, and / or optical media. The computer readable storage media can also be other means for storing information, such as cache, network accessible storage, or the like. However, the computer readable storage media does not include communication media.

[0087] Here, according to one embodiment of the present application includes a device, the device includes a memory for storing computer program instructions and a processor for executing program instructions, wherein when the computer program instructions are executed by the processor, the device is triggered to run the method and / or technical solutions based on the foregoing according to the plurality of embodiments of the present application.

[0088] It will be obvious to a person skilled in the art that the application is not limited to the details of the above-described exemplary embodiments, but that the application can be implemented in other embodiments without departing from the scope of the application. The embodiments are to be considered in all respects as illustrative and not restrictive, the scope of the application being indicated by the appended claims rather than by the above description, and all changes which come within the meaning and range of equivalents of the claims are therefore intended to be embraced therein. Any reference signs in the claims should not be construed as limiting the scope of the claims. The word "comprising" does not exclude other elements or steps not mentioned. The singular is not excluded from the plural. Multiple units or devices also can be presented by one unit or device, either by software or hardware. The words "first", "second", etc. are used to identify names, not to indicate any particular order.

Claims

1. A method for recognizing tangram pieces, wherein, Applied to a computer device, the computer device including a camera device, the method includes: The camera captures images of the user's operation on the tangram pieces on the operating table. Each corner of the tangram pieces is equipped with a directional marker, which includes a direction pointing from the corresponding corner into the interior of the tangram piece. Based on the operation image, identify the pointing position information of multiple pointing markers in the operation image on the operation desktop; The position information of one or more tangram pieces contained in the operation image is determined based on the pointing position information of the plurality of pointing marks and the pointing information of the plurality of pointing marks, wherein each piece position information includes the piece mark information of the corresponding tangram piece and the position information of the corresponding tangram piece on the operation desktop.

2. The method according to claim 1, wherein, The pointing identifier includes a dot group consisting of at least two dot identifiers of different sizes; wherein, the method further includes: The operation image is preprocessed to determine the corresponding optimized operation image; The step of identifying the pointing position information of multiple pointing markers in the operation image on the operation desktop based on the operation image includes: Based on the optimized operation image, identify the pointing position information of multiple point groups in the optimized operation image on the operation desktop.

3. The method according to claim 1, wherein, The computer device further includes a lighting device; wherein the method further includes: Turn on the lighting device to increase the ambient brightness of the operating desktop.

4. The method according to claim 1, wherein, Determining the position information of one or more tangram pieces in the operation image based on the pointing position information of the plurality of pointing markers and the pointing information of the plurality of pointing markers includes: Multiple line segment groups are determined based on the pointing position information of the multiple pointing identifiers, wherein each line segment is determined based on two pointing identifiers, and each line segment group has at least one plate identifier information corresponding to it; The position information of one or more tangram pieces is determined based on the pointing information of the multiple line segment groups and the multiple pointing identifiers, wherein each piece position information includes the piece identifier information of the corresponding tangram piece and the position information of the corresponding tangram piece on the operating table.

5. The method according to claim 4, wherein, The tangram set includes the identification information of multiple tangram pieces, and each piece identification information has at least one distance threshold corresponding to it; wherein, determining multiple line segment groups based on the pointing position information of the multiple pointing identifiers includes: Multiple line segments are determined in pairs based on the pointing position information of the multiple pointing identifiers. If there is a line segment among the multiple line segments that satisfies one of the distance thresholds corresponding to the multiple plate identifier information, then the line segment will be determined as a subset of the line segment group, and the plate identifier information corresponding to one of the distance thresholds will be assigned to the line segment group.

6. The method according to claim 4, wherein, Each of the multiple piece identifiers has a corresponding piece matching rule; wherein, determining the piece position information of one or more tangram pieces based on the pointing information of the multiple line segment groups and the multiple pointing identifiers includes: Based on the multiple line segment groups and the corresponding plate matching rules corresponding to the plate identification information of each line segment group, the corresponding matching line segment group is determined from the multiple line segment groups. Each matching line segment group includes one or more sub-matching line segment groups, and at least one closed shape is determined based on each sub-matching line segment group. Based on the pointing information of the multiple matching line segment groups and the multiple pointing identifiers, the position information of one or more tangram pieces is determined, wherein each piece position information includes the piece identifier information of the corresponding tangram piece and the position information of the corresponding tangram piece on the operating desktop.

7. The method according to claim 6, wherein, The step of determining the position information of one or more tangram pieces based on the pointing information of the multiple matching line segment groups and the multiple pointing identifiers includes: If the pointing information corresponding to the pointing identifier of a segment in a sub-matching segment group of a certain matching segment group is inside the closed shape determined by the sub-matching segment group, then the sub-matching segment group is determined to be the target segment group corresponding to the plate identifier information of the certain matching segment group. The position information of one or more tangram pieces is determined based on one or more target line segment groups, wherein each piece position information includes the piece identification information of the corresponding tangram piece and the position information of the corresponding tangram piece on the operating table.

8. The method according to claim 1, wherein, The method further includes: Obtain the preset panel model information of the user's current operation, wherein the preset panel model information includes the model position information of multiple tangram panels; The matching result is determined based on the preset panel model information and the panel position information of one or more tangram panels, wherein the matching result includes whether the puzzle is successfully completed or not.

9. The method according to claim 8, wherein, The step of determining the corresponding matching result based on the preset tile model information and the tile position information of one or more tangram tiles includes: Based on the preset panel model information and the position information of one or more tangram panels, determine the initial panel position information and corresponding initial offset information of the initial tangram panel that match the position information of the one or more tangram panels. The offset position information of each remaining tangram piece is determined based on the initial offset information and the position information of the remaining tangram pieces among the multiple tangram pieces. If the distance difference between the offset position information of a certain remaining tangram piece and the model position information of the model piece corresponding to the piece identifier information of the remaining tangram piece in the preset piece model information is less than or equal to the distance difference threshold, then the piece position information of the remaining tangram piece is determined to be the piece position information of the matching tangram piece. If the position information of the remaining tangram pieces is determined to be the position information of a matching tangram piece, then the corresponding matching result is determined to include a successful puzzle; otherwise, the matching result is determined to include a failed puzzle.

10. The method according to claim 9, wherein, The computer device further includes a projection device, and the method further includes: Based on the position information of the matching tangram pieces, the corresponding puzzle piece correctness reminder information is projected onto the corresponding position on the operating table via the projection device.

11. The method according to claim 8, wherein, The preset panel model information includes color information for multiple tangram panels; wherein, the method further includes: Based on the operation image, determine the color information corresponding to at least one tangram piece among the one or more tangram pieces; The step of determining the corresponding matching result based on the preset panel model and the position information of one or more tangram panels includes: The corresponding matching result is determined based on the preset panel model, the panel position information of the one or more tangram panels, and the color information of at least one tangram panel among the one or more tangram panels.

12. The method according to any one of claims 8 to 11, wherein, The computer device further includes a projection device, and the method further includes: If the matching result includes a successful puzzle, the relevant information of the tile model is projected onto the operating desktop via the projection device.

13. The method according to claim 1, wherein, The computer device further includes a projection device, and the method further includes: The projection device projects and renders the position information of one or more of the tangram pieces.

14. A tangram recognition device, the device comprising a camera, the device including: The module is used to capture images of the user's operation on the tangram pieces on the operating table using a camera device. Each corner of the tangram pieces is provided with a directional marker, which includes a direction pointing from the corresponding corner into the interior of the tangram piece. The first and second modules are used to identify the pointing position information of multiple pointing markers in the operation image on the operation desktop based on the operation image; The first and third modules are used to determine the position information of one or more tangram pieces contained in the operation image based on the pointing position information of the plurality of pointing marks and the pointing information of the plurality of pointing marks, wherein each tangram piece position information includes the piece mark information corresponding to the tangram piece and the position information of the corresponding tangram piece on the operation desktop.

15. A computer device, wherein, The device includes: Processor; and A memory configured to store computer-executable instructions, which, when executed, cause the processor to perform the steps of the method as described in any one of claims 1 to 13.

16. A computer-readable storage medium having a computer program / instructions stored thereon, characterized in that, When executed, the computer program / instruction causes the system to perform the steps of the method as described in any one of claims 1 to 13.

17. A computer program product comprising a computer program / instructions, characterized in that, When the computer program / instructions are executed by the processor, they implement the steps of the method described in any one of claims 1 to 13.

Images