Program, reading apparatus, and reading system

Abstract

To provide a program, a reading apparatus, and a reading system capable of obtaining a card ID without reading the card ID directly and one by one.SOLUTION: A card reading apparatus 10 comprises: a camera 25 for photographing a transmitting mount table tangent to a side of a code image that each of at least one card has from the opposite side of a side tangent to the cards; an image acquisition section 13 for acquiring a frame image from the camera 25 at a predetermined time interval; an area acquisition section 14 for detecting a card area from the frame image and acquiring it; a tracking ID imparting section 15 for performing tracking processing to a card area that the latest-photographed image acquired and imparting a TID; an area confirmation section 16 for confirming an increase / decrease in the acquired card area by the TID; and a correlation section 19 for correlating the TID already imparted to the card area and a CID already read from the code image of a card in the card area to the card area acquired by the area acquisition section 14 when confirming no increase / decrease in the card area.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a program, a reading device, and a reading system. [Background technology]

[0002] In a conventional card game device using game cards, multiple game cards are arranged on a card table of the device, and their positions, orientations (angles) and IDs (IDentification) are read, and the read results are used to control the game. There are multiple such card game devices available, regardless of manufacturer or genre. Among them, for example, a card game device is disclosed that uses game cards printed with unique dedicated markers to detect the position, orientation (angle) and ID of the cards, and repeatedly performs card checking processes at high speed (see, for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 3736440 Summary of the Invention [Problem to be solved by the invention]

[0004] The system described in Patent Document 1 uses a unique dedicated marker on a game card to read the ID. However, when a player moves a card, it can be difficult to directly read the ID from the card due to blurring caused by factors such as camera performance, or because the player's hand overlaps the card. Furthermore, reading the ID from a card takes longer than other processes.

[0005] Therefore, an object of the present invention is to provide a program, a reading device, and a reading system that make it possible to obtain the ID of a card without directly reading the ID of the card one by one. [Means for solving the problem]

[0006] The present invention solves the above problems by the following means. The first invention is a computer comprising: an image acquisition means for acquiring captured images by continuously capturing images of a placement area where one or more media each having a medium image are placed at a predetermined time interval; an area acquisition means for detecting and acquiring a medium area that is an area of ​​the medium from the photographed image acquired by the image acquisition means; a tracking information assigning means for performing a tracking process on the medium area included in the most recently acquired photographed image and assigning tracking identification information that is identification information of the medium area; an area confirmation means for confirming an increase or decrease in the medium area acquired by the area acquisition means using the tracking identification information; an association means for associating the tracking identification information already assigned to the medium area and the code identification information already read from the medium image of the medium in the medium area with the medium area acquired by the area acquisition means when the area confirmation means confirms that there is no increase or decrease in the medium area; It is a program that enables the system to function as such. The second invention is a program according to the first invention, in which the computer is made to function as a code reading means that reads the medium image of the new medium area when the area confirmation means confirms that the medium area has increased or decreased and the new medium area has newly assigned tracking identification information, and the association means associates the tracking identification information assigned by the tracking information assignment means and the code identification information obtained by reading the code reading means with the new medium area acquired by the area acquisition means. A third invention is a program according to the first or second invention, which causes the computer to function as a code reading means that reads the medium image of the medium area acquired by the area acquisition means when the area confirmation means confirms that the medium area has increased or decreased and the medium area does not have newly assigned tracking identification information, and causes the association means to associate the tracking identification information assigned by the tracking information assignment means and the code identification information obtained by reading the code reading means with the new medium area acquired by the area acquisition means. A fourth invention is a program according to the second or third invention, wherein the medium image is a code image including a two-dimensional code or a barcode, and the code reading means is caused to perform a decoding process on an image of only the medium area cut out from the captured image, and to obtain the code identification information. The fifth invention is a program for causing a computer to function as a medium position acquisition means for acquiring the position of the medium area acquired by the area acquisition means in the captured image, an angle acquisition means for acquiring the angle of the medium area from its normal position, and an information output means for outputting the position, the angle, and the code identification information of the medium area, in any of the programs from the first to fourth inventions. A sixth invention is a program according to the fifth invention, which causes a computer to function as a display information output means for outputting to a display device confirmation information including the captured image acquired by the image acquisition means, the position relative to the medium area, the angle, the code identification information, and the tracking identification information. The seventh invention is a program that causes any of the programs from the first to sixth inventions to function so as to photograph the medium placed on a stand from the side where the medium image is visible and obtain the photographed image. An eighth invention is a reading device comprising: an imaging unit that photographs a table on which one or more media are placed from a side where a media image on the media can be seen; an image acquisition means that acquires from the imaging unit the photographed images obtained by the imaging unit by continuously photographing at a predetermined time interval; an area acquisition means that detects and acquires a media area that is an area of ​​the media from the photographed images acquired by the image acquisition means; a tracking information assignment means that performs a tracking process on the media area in the most recently acquired photographed image and assigns tracking identification information that is identification information of the media area; an area confirmation means that uses the tracking identification information to confirm an increase or decrease in the media area acquired by the area acquisition means; and an association means that, when the area confirmation means confirms that there is no increase or decrease in the media area, associates the tracking identification information that has been assigned to the media area and code identification information that has already been read from the media image of the media in the media area with the media area acquired by the area acquisition means. A ninth invention is a reading system comprising the reading device of the eighth invention and a medium having the medium image, wherein the medium image is a code image including a two-dimensional code or a barcode. The tenth invention is a reading system according to the ninth invention, wherein the photographing unit photographs under irradiation with infrared light, and the medium image is invisible and formed using transparent ink containing an infrared-absorbing material. [Effects of the Invention]

[0007] According to the present invention, it is possible to provide a program, a reading device, and a reading system that make it possible to obtain the ID of a card without directly reading the ID of the card one by one. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram showing an overview of a card reading system according to an embodiment of the present invention; [Figure 2] FIG. 2 is a diagram showing functional blocks of the game machine according to the present embodiment. [Figure 3]1 is a diagram for explaining a card used in a card reading system according to an embodiment of the present invention; [Figure 4] 5 is a flowchart showing a reading process of the card reading device according to the embodiment. [Figure 5] This is a continuation of Figure 4. [Figure 6] 5A and 5B are diagrams for explaining the reading process of the card reading device according to the embodiment. [Figure 7] 10 is a flowchart showing a card area process of the card reading device according to the embodiment. [Figure 8] 5A and 5B are diagrams for explaining the reading process of the card reading device according to the embodiment. [Figure 9] 5A and 5B are diagrams for explaining the reading process of the card reading device according to the embodiment. [Figure 10] 5A and 5B are diagrams for explaining the reading process of the card reading device according to the embodiment. [Figure 11] 5A and 5B are diagrams for explaining the reading process of the card reading device according to the embodiment. [Figure 12] 10A and 10B are diagrams for explaining the effect of the reading process of the card reading device according to the embodiment. [Figure 13] FIG. 10 is a diagram showing an example of a confirmation screen for confirming the reading process of the card reading device according to the modified embodiment. [Figure 14] FIG. 10 is a diagram simply showing the structure of a card reading device according to a modified embodiment. [Figure 15] FIG. 10 is a diagram showing an overview of a card reading system according to a modified embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, this is merely an example, and the technical scope of the present invention is not limited to this example. (Embodiment) <Card reading system 100> FIG. 1 is a diagram showing an overview of a card reading system 100 according to this embodiment. The card reading system 100 is a system in which, for example, a camera 25 (photographing unit) of a card reading device 10 (described later) provided inside the game machine 1 reads cards 30A (medium) and cards 30B arranged by a player P on a placing stand 4 provided in the housing 2 of the game machine 1, and causes the game machine 1 to perform play control according to the reading results. In the following, the card 30 will be described without the final reference numeral except when describing the individual cards 30A and 30B. When describing the configuration of the individual cards 30A, etc., the final reference numerals will be the same as those of the individual cards 30A, etc. (A, B, ...).

[0010] In this embodiment, the card reader 10 is described as being used for play control of the game machine 1, but is not limited to this. The card reader 10 may be used for purposes other than the game machine 1, such as reading a card 30 and outputting the results. The card reading system 100 shown in FIG. 1 includes a game machine 1 and one or more cards 30.

[0011] <Game Console 1> The game machine 1 is a large-scale device installed in, for example, a game center, a shopping mall, or the like, and is a video game machine in which a game is played according to the placement of cards 30 by a player P. The housing 2 of the game machine 1 has a display 3 arranged in a position visible to the player P so that the player P can play while looking at the display 3. The display 3 is a display device that functions as a display unit and is configured, for example, with a liquid crystal panel or the like.

[0012] Furthermore, the cabinet 2 is provided with a table 4 for placing cards 30 at a position where the player P can place the cards 30 in his / her left and right hands to play. The mounting base 4 has a mounting area made of, for example, a transparent acrylic plate having transparency, and the card 30 can be seen from inside the housing 2. Inside the housing 2, a camera 25 is provided at a position where it can capture an image of the entire placement area of ​​the placement table 4 from below to above in the Z direction. The camera 25 captures an image of the back side of the card 30 placed on the placement table 4, and obtains a frame image (photographed image) including the card 30.

[0013] Next, the functional blocks of the game machine 1 will be described. FIG. 2 is a diagram showing functional blocks of the game machine 1 according to this embodiment. The game machine 1 includes a card reader 10 and a game controller 40. The card reader 10 and the game controller 40 are provided inside the housing 2.

[0014] <Card reader 10> The card reader 10 includes a control unit 11, a storage unit 21, a camera 25, and a communication IF (interface) unit 29. The control unit 11 is a central processing unit (CPU) that controls the entire card reading device 10. The control unit 11 works in cooperation with the above-mentioned hardware to execute various functions by appropriately reading and executing the operating system (OS) and application programs stored in the storage unit 21.

[0015] The control unit 11 includes a signal receiving unit 12, an image acquiring unit 13, an area acquiring unit 14, a tracking ID assigning unit 15, an area confirmation unit 16, an angle acquiring unit 17, a code reading unit 18, a matching unit 19, and an information output unit 20. The signal receiving unit 12 receives a control signal from the game control device 40. Specifically, the signal receiving unit 12 receives a control signal requesting information from the game control device 40. The signal receiving unit 12 also receives a control signal from the game control device 40 to stop the request for information.

[0016] The image acquisition unit 13 functions as an image acquisition means. In response to the signal receiving unit 12 receiving a control signal requesting information, the image acquisition unit 13 controls the camera 25 to acquire frame images. The image acquisition unit 13 continues to acquire frame images continuously until it receives a control signal from the game control device 40 to stop the request for information. Here, the number of frames per second of frame images acquired by the image acquisition unit 13 is based on the performance etc. of the camera 25. Therefore, the shooting interval is a predetermined time interval corresponding to the number of frames. Furthermore, the image acquisition unit 13 performs processing such as rotating or flipping the frame image as necessary to match the state as seen by the player P. By doing so, the frame image is an image in which the card 30 is placed in the position as seen by the player P, and an image in which the card 30 is face down can be obtained.

[0017] The area acquisition unit 14 functions as an area acquisition means and a medium position acquisition means. The area acquisition unit 14 detects and acquires the card area (medium area) of the card 30 from the frame image acquired by the image acquisition unit 13. The area acquisition unit 14 also acquires the position of the card area. Various known methods can be used for the area acquisition unit 14 to detect the area of ​​the card 30. As one example, the area acquisition unit 14 detects rectangular edges from the frame image and detects the outline within the image. The area acquisition unit 14 then filters the detected outline using the number of vertices, area, and vertex angles of the card's shape to detect the rectangle of the card 30.

[0018] As another example, the area acquisition unit 14 may register the rectangular shape of the card 30 as a template and detect the position of the card through template matching processing, or may read the card image into AI and perform detection using an object detection algorithm using AI. Note that AI is an abbreviation for Artificial Intelligence. Examples of object detection algorithms using AI include YOLO (You Only Look Once), SSD (Single Shot MultiBox Detector), and MediaPipe.

[0019] Whichever of the above methods is used, the area acquisition unit 14 can perform the process at high speed by taking advantage of the fact that the shapes of the cards 30 are common. The area acquisition unit 14 also calculates the position of the detected card area. The position of the card area can be expressed, for example, by XY coordinates with the top left corner of the placing table 4 as the reference point.

[0020] The tracking ID assigning unit 15 functions as a tracking information assigning unit. The tracking ID assigning unit 15 performs tracking processing on the card area included in the most recently acquired frame image and assigns TID (tracking identification information). For example, the tracking process can use an algorithm used in a technique called MOT (Multiple Object Tracking). This is a technique for tracking multiple objects in a video, and assigns the same tracking ID (TID) to the same object in the video. In other words, if an object that has already been assigned a TID in a previous frame image is detected again, the same TID is assigned and tracked. TID is an abbreviation for Tracking ID. The tracking process determines whether the object is the same object area based on the positional relationship and motion vector of the object area between the frame acquired on the current time axis and the frame acquired before that (on the past time axis). If the area has already been assigned a TID, the same TID is assigned, and if it is a new area, a new TID is assigned. Among MOT techniques, those that separate object detection and object tracking are called Tracking-by-Detection techniques, but here we will use object tracking.

[0021] Note that there are well-known MOT algorithms for the Tracking-by-Detection method, such as ByteTrack, SORT, and FastMOT, and the tracking ID assigning unit 15 may use any of them. Furthermore, if the tracking process determines that the card is a new object within the frame image, the tracking ID assigning unit 15 assigns a new TID to the card area.

[0022] The area confirmation unit 16 functions as an area confirmation means. The area confirmation unit 16 confirms an increase or decrease in the card area acquired by the area acquisition unit 14 through tracking processing. More specifically, the area confirmation unit 16 confirms an increase or decrease in the card area by, for example, checking the TID between the card area in the most recently acquired frame image and the card area acquired by the area acquisition unit 14. For example, if an action is performed to remove one card and add another card at the same time, the TIDs will be different even if the number of card areas is the same. Therefore, the area confirmation unit 16 confirms that there has been an increase or decrease in the card area.

[0023] The angle acquisition unit 17 functions as an angle acquisition unit. The angle acquisition unit 17 acquires the angle from the normal position for each card area acquired by the area acquisition unit 14. Various known methods can be used for the angle acquisition unit 17 to detect the angle of the card 30. As one example, the card 30 has an angle detection marker, and the angle acquisition unit 17 detects the angle detection marker and then calculates the angle at which the card 30 is facing from its position relative to the center coordinates of the card 30. As another example, when the rectangular shape of the card is obtained by detecting the position of the card 30, the angle acquisition unit 17 may calculate the angle from the inclination of the center line of the rectangle. Any of the above methods may be used, but methods using the code image (medium image) of the card 30 are excluded in order for the control unit 11 to perform high-speed processing.

[0024] The code reading unit 18 functions as a code reading means. When the area checking unit 16 confirms that the card area has increased or decreased and the tracking ID assigning unit 15 has a card area to which a new TID has been assigned, the code reading unit 18 reads the code image of the card area to which a new TID has been assigned. Also, when the area checking unit 16 confirms that the card area has increased or decreased and the tracking ID assigning unit 15 has a card area to which a new TID has been assigned, the code reading unit 18 reads the code image of the card area acquired by the area acquiring unit 14. At this time, the code reading unit 18 trims (cuts out) the card area of ​​the corresponding card from the frame image, performs a decoding process on the image of only the card area, reads the code image, and acquires the CID (code identification information). In this way, by reducing the reading range, processing efficiency is improved. The code reading unit 18 may also perform preprocessing before decoding. The preprocessing is, for example, processing to improve decoding accuracy, such as contrast enhancement or noise removal. Preprocessing may be performed arbitrarily. Here, the code image refers to, for example, a two-dimensional code such as a QR Code (registered trademark), which represents data such as letters and numbers as a graphic pattern.

[0025] The associating unit 19 functions as an associating means. When the area checking unit 16 confirms that there is no increase or decrease in the card area, the associating unit 19 associates the TID already assigned to the card area and the CID already read from the code image of the card in the card area with the card area acquired by the area acquiring unit 14. Furthermore, when the area confirmation unit 16 confirms that the card area has increased or decreased, and the tracking ID assignment unit 15 has assigned a new TID to the card area, the association unit 19 associates the TID assigned by the tracking ID assignment unit 15 and the CID obtained by reading the code reading unit 18 with the card area acquired by the area acquisition unit 14 for the card area to which the new TID has been assigned. On the other hand, for other card areas, the association unit 19 associates the TID already assigned to the card area and the CID already read from the code image of the card in the card area with the card area acquired by the area acquisition unit 14.

[0026] Furthermore, when the area confirmation unit 16 confirms that the card area has increased or decreased, and there is no card area to which a new TID has been assigned, the association unit 19 associates the TID assigned to the card area by the tracking ID assignment unit 15 and the CID obtained by reading the code reading unit 18 with the card area acquired by the area acquisition unit 14. The information output unit 20 functions as an information output means and outputs card information, including the position, angle, and CID of the card area, to the game control device 40. Details of each process will be described later.

[0027] The storage unit 21 is a storage area such as a hard disk or semiconductor memory element for storing programs, data, etc. required for the control unit 11 to execute various processes. Here, a computer refers to an information processing device equipped with a control unit, a storage device, etc., and the card reading device 10 is an information processing device equipped with a control unit 11, a storage unit 21, etc., and is included in the concept of a computer. The storage unit 21 includes a program storage unit 22 and an association storage unit 23.

[0028] The program storage unit 22 is a storage area that stores various programs. The program storage unit 22 stores programs (not shown) for performing various functions executed by the control unit 11 of the card reader 10. The correspondence storage unit 23 is a storage area that stores TIDs and CIDs in association with each other for the card area. The correspondence storage unit 23 stores the correspondence between TIDs and CIDs for the card area in chronological order.

[0029] The camera 25 is an imaging device. The camera 25 is provided below the mounting table 4 in the Z direction so that a lens (not shown) faces the mounting table 4, and captures an image of the mounting table 4 from inside the housing 2. The communication IF unit 29 is an interface for exchanging signals and information with the game control device 40, for example.

[0030] <Game control device 40> The game control device 40 is a device that controls play. The game control device 40 includes a game control unit 41, a game storage unit 42, a display 3, and a communication IF unit 49. The game control unit 41 is a CPU that controls the entire game control device 40. The game control unit 41 appropriately reads and executes the OS and application programs stored in the game storage unit 42, thereby cooperating with the above-mentioned hardware and executing various functions.

[0031] The game control unit 41 controls play by receiving card information, which is the card reading result output by the card reader 10. The game control unit 41 also performs various controls in accordance with the progress of the game, such as generating and directing character images to be displayed on the display 3, and outputting music, character voices, and sound effects, but as these controls are not directly related to the present invention, detailed explanations of them will be omitted. The game storage unit 42 is a storage area such as a hard disk or semiconductor memory device for storing programs, data, etc. required for the game control unit 41 to execute various processes. The communication IF unit 49 is, for example, an interface for exchanging signals and information with the card reader 10. The game control device 40 is equipped with various devices necessary for playing, such as a speaker and operation buttons, but a description thereof will be omitted.

[0032] <Card 30> Next, the card 30 read by the card reader 10 will be described. FIG. 3 is a diagram for explaining a card 30 used in the card reading system 100 according to this embodiment. 3A shows an example of the front side 31 of the card 30, and FIG. 3B shows an example of the back side 32 of the card 30. As shown in FIG. 3(A) is the side that is visible to the player P when the player P places the card on the table 4. On the surface 31, for example, various pictures related to play are written. In this example, the surface 31A of the card 30A has a character resembling a dog drawn on it, and the surface 31B of the card 30B has a character of a man playing the guitar drawn on it.

[0033] 3(B) is the surface that contacts the table 4. The back surface 32 has a code image 33 and an angle detection marker . The code image 33 is, for example, a two-dimensional code such as a QR code (registered trademark). The code image 33 may be an image of a general code, for example, a barcode. The code image 33A on the back surface 32A of the card 30A and the code image 33B on the back surface 32B of the card 30B are decoded to obtain different CIDs. The angle detection marker 34 is used to detect the angle of the card 30 .

[0034] 3(B) illustrates a card 30 having a code image 33 and an angle detection marker 34 on the back surface 32 thereof, but the angle detection marker 34 need not be present. Even if the card 30 has an angle detection marker 34 on the back surface 32 thereof, the shape, placement position, etc. are not limited to this. Furthermore, although the code image 33 is provided at the center of the back surface 32 thereof, the code image 33 does not need to be at the center of the card 30.

[0035] Fig. 3(C) shows the structure of card 30 when front surface 31 faces upward in the Z direction. As shown in Fig. 3(C), card 30 has a first ink layer 36, on the front surface 31 side of base 35, which may be, for example, paper or any film substrate, gravure printed with a picture image such as a character. Also, a second ink layer 37, on the back surface 32 side of base 35, gravure printed with a code image such as a two-dimensional code. The inks used to draw the first ink layer 36 and the second ink layer 37 may be, for example, colored printing inks used in ordinary printing for forming designs.

[0036] <Processing Description> Next, the processing performed by the card reader 10 will be described. 4 and 5 are flowcharts showing the reading process of the card reading device 10 according to this embodiment. FIG. 6 is a diagram for explaining the reading process of the card reading device 10 according to this embodiment. FIG. 7 is a flowchart showing the card area processing of the card reading device 10 according to this embodiment.

[0037] In step S (hereinafter, "step S" will be simply referred to as "S") 11 of FIG. 4, the signal receiving unit 12 of the card reading device 10 determines whether or not it has received an information request control signal requesting information from the game control device 40. For example, after the start of play, the game control device 40 transmits an information request control signal to the card reading device 10. If it has received an information request control signal from the game control device 40 (S11: YES), the signal receiving unit 12 moves the process to S12. On the other hand, if it has not received an information request control signal from the game control device 40 (S11: NO), the control unit 11 remains in this process and waits until it receives an information request control signal from the game control device 40. In S12, the image acquisition unit 13 controls the camera 25 to acquire a frame image.

[0038] In S13, the area obtaining unit 14 obtains the card area from the frame image. Then, when the area obtaining unit 14 obtains the card area, it calculates the card position. FIG. 6A shows an example of processing in a frame image 50. The area acquisition unit 14 detects card images 51 and 52 from the frame image 50, and acquires a card area 53 corresponding to card image 51 and a card area 54 corresponding to card image 52. Various methods may be used to acquire each card area, such as the edge detection method described above or a template matching method. Furthermore, the acquired card area only needs to acquire the position of the card area, so the rectangle representing the card area is not limited to the example shown in FIG. 6(A). For example, the card area may be an area that matches the inclination of the card image, in which case it may be a rectangle surrounded by a frame parallel to each side of the card image.

[0039] 4, the area acquisition unit 14 determines whether or not the card area has been acquired. If the card area has been acquired (S14: YES), the area acquisition unit 14 moves the process to S15. On the other hand, if the card area has not been acquired (S14: NO), the control unit 11 moves the process to S11. If the card area has not been acquired, this refers to, for example, a case where no card 30 is placed on the placing table 4. In S15, the angle acquisition unit 17 acquires the angle from the normal position for the card area acquired in the process of S13.

[0040] FIG. 6B shows an example of the angle calculation process for the card image 52. The angle acquisition unit 17 generates a rectangle 55 formed by lines in the X and Y directions that surrounds the detected card image 52. Then, the angle acquisition unit 17 calculates an angle 56 between the X direction and a line segment connecting the center 55a of the generated rectangle 55 and the center 52b of the angle detection marker 52a. In S16 of FIG. 4, the tracking ID assigning unit 15 performs tracking processing of the card area. In S17, the tracking ID assigning unit 15 assigns the assigned TID to the same card area as the immediately preceding frame image. If the tracking ID assigning unit 15 determines that the card area is a new card area within the frame image, it assigns a new TID to the card area. Thereafter, the control unit 11 proceeds to S21 in FIG. 5.

[0041] 5, the area confirmation unit 16 determines whether or not there has been an increase or decrease in the card area. If it has confirmed that there has been an increase or decrease in the card area (S21: YES), the area confirmation unit 16 proceeds to S22. On the other hand, if it has not confirmed that there has been an increase or decrease in the card area (S21: NO), the area confirmation unit 16 proceeds to S23. In S22, the control unit 11 performs card area processing. Here, the card area processing will be described with reference to FIG.

[0042] In S31 of Fig. 7, the area confirmation unit 16 determines whether a new TID has been assigned to the card area. If a new TID has been assigned (S31: YES), the area confirmation unit 16 proceeds to S32. On the other hand, if a new TID has not been assigned (S31: NO), the area confirmation unit 16 proceeds to S33. Here, "a new TID has been assigned to the card area" refers to "a card area has been added," for example, "a new card has been placed on the placing table 4." On the other hand, "a new TID has not been assigned to the card area" refers to "a card area has been reduced," for example, "a card placed on the placing table 4 has been removed."

[0043] In S32, the area confirmation unit 16 processes the additional card area to which the new TID has been assigned, and then the area confirmation unit 16 moves the process to S34. On the other hand, in S33, the area confirmation unit 16 processes all card areas. Here, when the card area is reduced, the area confirmation unit 16 processes all card areas because the card area is reduced when cards are positioned close to each other, such as when cards overlap each other, and the tracking ID assignment unit 15 may assign an incorrect TID to the card area.

[0044] In S34, the code reading unit 18 trims the card area to be processed to produce an image of only the card area. In S35, the code reading unit 18 performs pre-decoding processing, such as contrast enhancement and noise removal. In S36, the code reading unit 18 performs a decoding process on the code image of the image processed in S35 to obtain a CID. After that, the control unit 11 moves the process to S23 in FIG.

[0045] 5, the association unit 19 associates the TID and CID with the card area, and stores the association in the association storage unit 23. In S24, the information output unit 20 transmits the card information, including the position, angle and CID of the card, to the game control device 40. In the game control device 40, the game control unit 41 controls play based on the card information received from the card reading device 10. In S25, the signal receiving unit 12 determines whether or not an information stop control signal for stopping the request for information has been received from the game control device 40. If an information stop control signal has been received (S25: YES), the control unit 11 shifts the processing to S11 in Fig. 4. On the other hand, if an information stop control signal has not been received (S25: NO), the control unit 11 shifts the processing to S12 in Fig. 4.

[0046] The above-described processing by the card reader 10 will now be described using a specific example. 8 to 11 are diagrams for explaining the reading process of the card reading device 10 according to this embodiment. FIG. 8(A) shows a frame image 61 acquired by the image acquisition unit 13 in the process of S12 in FIG. 4 at time t=1.

[0047] The area acquisition unit 14 acquires one card area 61a from the frame image 61 (S13 in FIG. 4). Since the card area has been acquired, the tracking ID assignment unit 15 performs tracking processing (S16 in FIG. 4). Since the frame image 61 is the first image from which the card area 61a has been acquired, the immediately preceding frame image (not shown) does not have a card area, and the tracking ID assignment unit 15 assigns a new TID (S17 in FIG. 4). Furthermore, the area confirmation unit 16 confirms that the card area has increased or decreased (YES in S21 in FIG. 5). Next, the area confirmation unit 16 confirms that a new TID has been assigned to the card area (YES in S31 in FIG. 7), and therefore the card area 61a to which the new TID has been assigned becomes the processing target (S32 in FIG. 7), and the code reading unit 18 decodes the code image of the card area 61a to acquire a CID (S36 in FIG. 7). FIG. 8(B) shows a frame image 61 from which the TID and CID have been acquired. Then, the association unit 19 associates the TID and CID with the card area 61a, as shown in FIG. 8(C), and stores the association in the association storage unit 23.

[0048] Next, when the player P places an added card, the image acquisition unit 13 acquires the frame image 62 shown in FIG. 9(A) at time t=2 (S12 in FIG. 4). The area acquisition unit 14 acquires two card areas 62a and 62b from the frame image 62 (S13 in FIG. 4). Now that the card areas have been acquired, the tracking ID assignment unit 15 performs tracking processing (S16 in FIG. 4). Since the frame image 62 is an image acquired after the frame image 61 (FIG. 8), the same TID as the card area 61a (FIG. 8) is assigned to the card area 62a in comparison with the immediately preceding frame image 61. Furthermore, the CID of the card area 62a is associated with the TID. On the other hand, the tracking ID assignment unit 15 assigns a new TID to the card area 62b (S17 in FIG. 4) (see FIG. 9(B)).

[0049] The area confirmation unit 16 confirms that the card area has increased or decreased (YES in S21 of FIG. 5). Next, the area confirmation unit 16 confirms that a new TID has been assigned to the card area (YES in S31 of FIG. 7), and therefore processes only the card area 62b to which the new TID has been assigned (S32 of FIG. 7), and the code reading unit 18 decodes the code image in the card area 62b to obtain the CID (S36 of FIG. 7).

[0050] 9(C) shows the frame image 62 from which the TID and CID have been acquired. As described above, the CID in the card area 62a is associated with the TID, so the control unit 11 does not need to perform a decoding process on the code image in the card area 62a. Then, the association unit 19 associates the TID and CID with the card areas 62a and 62b, as shown in FIG. 9(D), and stores the association in the association storage unit 23.

[0051] Thereafter, when the position of the card is changed by player P, at time t=3, the image acquisition unit 13 acquires the frame image 63 shown in FIG. 10(A) (S12 in FIG. 4). The area acquisition unit 14 acquires two card areas 63a and 63b from the frame image 63 (S13 in FIG. 4). As the card areas have been acquired, the tracking ID assignment unit 15 performs tracking processing (S16 in FIG. 4). Since frame image 63 is an image acquired after frame image 62 (FIG. 9), compared with the immediately preceding frame image 62, the same TID as card area 62a (FIG. 9) is assigned to card area 63a, and the same TID as card area 62b (FIG. 9) is assigned to card area 63b (S17 in FIG. 4) (see FIG. 10(A)). Furthermore, the area checker 16 checks that the card area has not increased or decreased (NO in S21 of FIG. 5), and therefore associates the TID and CID with the card areas 63a and 63b (S23 of FIG. 5).

[0052] 10(B) shows a frame image 63 from which the TID and CID have been acquired. Since the CIDs associated with the card areas 62a and 62b can be assigned to the card areas 63a and 63b, the control unit 11 does not need to perform decoding processing on the code images one by one. Then, the association unit 19 associates the TID and CID with the card areas 63a and 63b, as shown in FIG. 10(C), and stores the association in the association storage unit 23.

[0053] Thereafter, when one of the placed cards is removed by player P, at time t=4, the image acquisition unit 13 acquires the frame image 64 shown in FIG. 11(A) (S12 in FIG. 4). The area acquisition unit 14 acquires the card area 64a from the frame image 63 (S13 in FIG. 4). Now that the card area has been acquired, the tracking ID assignment unit 15 performs tracking processing (S16 in FIG. 4). Because frame image 64 is an image acquired after frame image 63 (FIG. 10), the same TID as card area 63b (FIG. 10) is assigned to card area 64a in comparison with the immediately preceding frame image 63 (S17 in FIG. 4) (see FIG. 11(A)).

[0054] The area checking unit 16 confirms that the card area has increased or decreased (YES in S21 of FIG. 5). Next, the area checking unit 16 confirms that a new TID has not been assigned to the card area (NO in S31 of FIG. 7), and therefore the card area 64a, which is the entire card area, is targeted for processing (S33 of FIG. 7), and the code reading unit 18 decodes the code image in the card area 64a to obtain a CID (S36 of FIG. 7). In this example, since there is one card area 64a, the process of decoding the code image and obtaining the CID is performed only for the card area 64a, but if there are multiple card areas, the process of decoding the code image and obtaining the CID is performed for all of the multiple card areas.

[0055] FIG. 11(B) shows a frame image 64 from which the TID and CID have been acquired. Then, the association unit 19 associates the TID and CID with the card area 64a, as shown in FIG. 11(C), and stores the association in the association storage unit 23.

[0056] Next, the difference in processing time between the tracking process method described above and the method of acquiring a CID each time will be described. FIG. 12 is a diagram for explaining the effect of the reading process of the card reading device 10 according to this embodiment. FIG. 12 shows a processing time result table 80.

[0057] Here, the preconditions for the processing time results shown in the result table 80 are as follows. Input resolution: 1920 x 1080 Information code used for code image: QR code (ver.1) Computing CPU: Intel(R) Core(TM) i7-11700F Position detection method: As a process performed by the area acquisition unit 14, a method was used in which the outline was detected, and then filtering (area, vertex angle) was performed to detect the card area. Angle detection method: The angle acquisition unit 17 performs the process of calculating the angle from the relative position between the center of the angle detection marker and the center of the card. Decoding method: The code reading unit 18 performs processing by trimming the detected card area and performing decoding processing on the trimmed area.

[0058] The result table 80 in Figure 12 shows the processing time according to the number of cards for the decoding process and the tracking process. Here, the decoding process refers to the process of reading the code image when acquiring the CID. The tracking process refers to the process of associating the CID with the CID in the card area of ​​the immediately preceding frame image when acquiring the CID. In both processes, the process is carried out from acquiring the frame image to obtaining the card information. According to the results table 80, the difference in processing time becomes more pronounced as the number of cards increases. As shown in the result table 80, by performing the reading process using the card reading device 10 of this embodiment, it is possible to reduce the processing time involved in the decoding process, and player P can more strongly experience real-time processing without having to directly read the card ID one by one.

[0059] As described above, the card reading system 100 of this embodiment has the following advantages. (1) The card reading device 10 acquires frame images of a mounting stand 4, which can hold one or more cards 30 having code images, successively photographed at predetermined time intervals, detects and acquires the card area of ​​the card 30 from the frame images, performs a tracking process on the most recently acquired frame image to assign a TID, checks whether the acquired card area has increased or decreased using the assigned TID, and if it is confirmed that there has been no increase or decrease in the card area, associates the TID already assigned to the card area with the CID already read from the code image of the card 30 in the card area. Therefore, even if the card area does not increase or decrease, the TID and CID already assigned to the card area of ​​the card 30 can be associated with each other. As a result, the CID of the card area can be obtained without directly reading the CID from the code image of the card. Moreover, this process allows the process of obtaining the CID to be performed quickly. In addition, since the increase or decrease in the card area can be confirmed by the assigned TID, the increase or decrease in the card area can be confirmed by simple processing.

[0060] (2) When the card reading device 10 confirms that the card area has increased or decreased and has a newly assigned TID, it reads the code image of the new card area and associates the TID and the CID obtained by reading the code image with the new card area. Therefore, if it is confirmed that the card area has increased or decreased and a newly assigned TID has been added, that is, if the number of cards has increased, the CID read from the card corresponding to the card area can be associated with the newly assigned TID.

[0061] (3) When the card reading device 10 confirms that the card area has increased or decreased, and the card does not have a newly assigned TID, it reads the code image of the acquired card area and associates the TID and the CID obtained by reading the code image with the newly acquired card area. Therefore, if it is confirmed that the card area has increased or decreased, and there is no newly assigned TID, i.e., if the number of cards has decreased, it is possible to associate the CID read from the card corresponding to the acquired card area with the TID.

[0062] (4) The code image is a two-dimensional code or a barcode, and the card reader 10 performs a decoding process on an image of only the card area cut out from the frame image to acquire the CID. Therefore, since it can be realized with a general code such as a two-dimensional code or a barcode, it is possible to reduce the cost of creation, etc. Also, since an image of only the card area is used to obtain the CID, processing can be performed faster than if the entire frame image is used.

[0063] (5) The card reader 10 acquires the position of the card area in the frame image, acquires the angle of the card area from the normal position, and outputs the position, angle, and CID of the card area. Therefore, processing using card information including the position, angle, and CID of the card area can be performed at the output destination. As an example, if the position, angle, and CID of the card area are output to the game control device 40, a play can be realized in which, for example, the movement of a character is controlled by the position, angle, and CID of the card area.

[0064] (6) The card reading device 10 is provided with a camera 25 that photographs the transparent mounting base 4 that contacts the side of the code image on each of one or more cards 30 from the side opposite to the side contacted by the card 30, and acquires a frame image from the camera 25. Therefore, a frame image can be obtained by photographing a card 30 having a code image on its back side from a position where the back side can be photographed. Then, the card area and code image can be obtained from the frame image. As a result, even if player P places the card 30 face up on the table 4 and moves the card 30, there are no obstacles to the card area and code image, and the code image can be easily obtained.

[0065] Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments. Furthermore, the effects described in the embodiments are merely a list of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments. Note that the above-described embodiments and the modified embodiments described below can be used in appropriate combinations, but detailed description thereof will be omitted.

[0066] (Variations) (1) In the present embodiment, the card reader 10 transmits acquired information to the game control device 40, but this is not limiting. For example, the card reader 10 may have a function for checking the information to be transmitted to the game control device 40. FIG. 13 is a diagram showing an example of a confirmation screen 90 for confirming the reading process by the card reading device 10 according to the modified embodiment. 13 is a screen for confirming that the reading process is being performed correctly. By connecting a display 9 (display device) to the card reading device 10, the confirmation screen 90 can be displayed on the display 9, allowing the user to confirm the reading process performed by the card reading device 10.

[0067] The control unit 11 (display information output means) of the card reading device 10 outputs the frame image and confirmation information to the display 9, for example, at a timing either before or after the information output unit 20 outputs information to the game device. In this way, a confirmation screen 90 is output on the display 9. The confirmation screen 90 includes a frame image portion 91 and confirmation information portions 94 and 95 . The frame image section 91 is an area for outputting a frame image. The frame image output to the frame image section 91 may be a frame image that has been processed by adding a rectangular area used when the area acquisition section 14 acquires the card area. For example, this corresponds to rectangular area 92a for card image 92 and rectangular area 93a for card image 93.

[0068] The confirmation information sections 94 and 95 are areas that output confirmation information that visualizes the tracking status of the card images 92 and 93. The confirmation information section 94 outputs confirmation information related to the card image 92, and the confirmation information section 95 outputs confirmation information related to the card image 93. In this way, by connecting the display 9 to the card reader 10 and visualizing and outputting the status of the reading process, it becomes possible to check whether the card reading process is being performed correctly.

[0069] (2) In this embodiment, the camera 25 is described as an example of a camera that captures the entire mounting area of ​​the mounting table 4 inside the housing 2 from below to above in the Z direction, but this is not limited to this. FIG. 14 is a diagram showing a simplified structure of a card reader 10-2 according to a modified embodiment. 14, a mirror M may be installed at an angle inside the housing 2 of the game machine 1-2, and the camera 25-2 may be positioned so as to capture a reflected image. In this way, even if the space inside the housing 2 is small, the camera 25-2 can capture an image of the entire mounting area of ​​the mounting table 4, which is useful.

[0070] Furthermore, the camera 25 does not have to be located inside the housing 2. FIG. 15 is a diagram showing an overview of a card reading system 100-3 according to a modified embodiment. 15, a camera 25-3 of a card reader 10-3 provided in a game machine 1-3 photographs a table 4-3 provided on a housing 2 of the game machine 1 from above in the Z direction. Then, the card reader 10-3 reads cards 30-3A and 30-3B arranged on the table 4-3 by a player P, and causes the game machine 1-3 to perform play control according to the reading result. In such a configuration, a code image for reading the CID or the like is printed on the surface of the card 30-3 placed on the placing stand 4-3 by the player P, so that the frame image acquired by the camera 25-3 can include the code image.

[0071] 15, the platform 4-3 may also serve as a display for the player P to watch while playing. Alternatively, the display for the player P to watch while playing may be provided separately from the platform 4-3. In the case of such a card reading system 100-3, for example, in a competitive play, the display may reflect and display card information including the position, angle, and CID of the opponent's card.

[0072] (3) In this embodiment, when it is confirmed that the card area has not increased or decreased in comparison with the most recent frame image, the TID already assigned to the card area and the CID already read from the code image are associated with the card area. However, this is not limited to this. For example, decoding processing from the code image of the detected code area may be performed for each frame image, and if the decoding processing fails and a CID cannot be obtained, a process may be performed to associate the TID already assigned to the card area with the CID already read from the code image. When such processing is performed, it is possible to prevent erroneous determination of the CID due to erroneous recognition caused by the tracking processing. However, since performing the decoding process for each frame image increases the processing time, it may be possible to perform the decoding process from the code image of the detected code area, for example, once every predetermined number of image frames (e.g., 30 frames).

[0073] (4) Although not specifically mentioned in this embodiment, various processes may be performed in parallel. For example, parallel processing may be applied to card area detection and angle calculation processes, decoding from a code image, etc., thereby shortening processing time.

[0074] (5) In the present embodiment, an example has been described in which the card angle is acquired after the card area is acquired, and the code image is decoded, but this is not limiting. Because the decoding process takes time, for example, the decoding process and the process of acquiring the card angle may be interchanged. Furthermore, while trimming the card area and pre-decoding process are optional processes, performing such processes can shorten the decoding process time and improve real-time performance.

[0075] (6) In the present embodiment, the frame image is inverted or otherwise processed to match the state seen by the player P before the area acquisition process and subsequent processes are performed, but this is not limiting. The frame image may be subjected to area acquisition or the like without any special processing, and the position and angle may be changed to match the state seen by the player P before information is output.

[0076] (7) In this embodiment, the second ink layer 37 on the back surface of the card 30 is described as an example in which a code image is printed using ordinary colored ink, but this is not limiting. For example, the code image may be printed using transparent ink containing an infrared-absorbing material. Furthermore, the back surface of the card 30 may also be printed with a design such as character information using colored ink. In this case, the back surface of the card 30 is printed with transparent ink and colored ink overlapping each other. By doing so, the code image becomes invisible under normal visible light, which contributes to preventing card counterfeiting. Also, player P can concentrate on playing the card without being aware of the code image on the back of the card.

[0077] (8) In this embodiment, a typical code image such as a two-dimensional code has been described as an example, but the present invention is not limited to this. In addition to typical code images, complex codes with larger data volumes or codes that require time for decoding to prevent counterfeiting, or codes with unique, dedicated markers printed thereon, may also be used. Alternatively, other images may be used as long as they can uniquely identify the card and determine a uniquely identifiable CID from the card. Techniques for uniquely identifying cards include, for example, those that use image processing such as image histograms, those that use image recognition such as AI, and those that use character recognition such as OCR (Optical Character Recognition / Reader).

[0078] (9) In the present embodiment, the mounting base 4 has been described as being transparent, but this is not limiting. The mounting base 4 does not need to be transparent as long as it allows the camera 25 to capture an image of the card 30. Specifically, for example, the camera 25 may be an infrared camera with an infrared function, and a sheet that transmits infrared light may be attached to the face of the mounting base 4.

[0079] (10) In the present embodiment, a circle is attached to the card 30 as the angle detection marker 34, but this is not a limitation. Markers of other shapes may be used, and the positions are not limited to these.

[0080] (11) In the present embodiment, the card reader 10 is provided in the game machine 1, but this is not limiting. The card reader 10 can be used in devices for other purposes as long as it reads cards and performs processing. [Explanation of symbols]

[0081] 1, 1-2, 1-3 game console 3, 9 Display 4, 4-3 Mounting table 10, 10-2, 10-3 Card reader 11 Control section 12 Signal receiving unit 13 Image acquisition unit 14 Area acquisition part 15 Tracking ID assignment section 16 Area confirmation part 17 Angle acquisition section 18 Code reader 19 Mapping section 20 Information output section 21 Memory section 22 Program memory section 23 Correspondence memory unit 25, 25-2, 25-3 Camera 30, 30A, 30B, 30-3, 30-3A, 30-3B card 32, 32A, 32B back side 33, 33A, 33B code images 34, 52a Angle detection marker 35 base 36 First ink layer 37 Second ink layer 40 Game control device 41 Game control unit 42 Game Memory Section 50, 61, 62, 63 frame images 51, 52 Card images 53, 54, 61a, 62a, 62b, 63a, 63b card area 55 rectangle 56 angle 80 Results table 90 Confirmation Screen 91 Frame image section 94, 95 Confirmation Information Department 100, 100-3 card reading system P Player

Claims

1. Computer, an image acquisition means for acquiring captured images by successively capturing images at predetermined time intervals of a placement area in which one or more media each having a medium image is placed; an area acquisition means for detecting and acquiring a medium area that is an area of ​​the medium from the photographed image acquired by the image acquisition means; a tracking information assigning means for performing a tracking process on the medium area included in the most recently acquired photographed image and assigning tracking identification information that is identification information of the medium area; an area confirmation means for confirming an increase or decrease in the medium area acquired by the area acquisition means using the tracking identification information; an association means for associating the tracking identification information already assigned to the medium area and the code identification information already read from the medium image of the medium in the medium area with the medium area acquired by the area acquisition means when the area confirmation means confirms that there is no increase or decrease in the medium area; A program to make it function as such.

2. 2. The program according to claim 1, When the area confirmation means confirms that the medium area has increased or decreased and the computer has newly added tracking identification information, the computer is made to function as a code reading means for reading the medium image of the new medium area; A program that causes the association means to associate the tracking identification information assigned by the tracking information assignment means and the code identification information obtained by reading the code reading means with the new medium area acquired by the area acquisition means.

3. 2. The program according to claim 1, When the area confirmation means confirms that the medium area has increased or decreased and the medium does not have newly added tracking identification information, the computer is made to function as a code reading means that reads the medium image of the medium area acquired by the area acquisition means; A program that causes the association means to associate the tracking identification information assigned by the tracking information assignment means and the code identification information obtained by reading the code reading means with the new medium area acquired by the area acquisition means.

4. The program according to claim 2 or 3, the medium image is a code image including a two-dimensional code or a barcode, a program that causes the code reading means to perform a decoding process on an image of only the medium area cut out from the captured image, and acquire the code identification information;

5. 2. The program according to claim 1, Computer, a medium position acquisition means for acquiring the position of the medium area acquired by the area acquisition means in the captured image; An angle acquisition means for acquiring an angle from the normal position of the medium area; an information output means for outputting the position, the angle, and the code identification information of the medium area; A program to make it function as such.

6. 6. The program according to claim 5, A program that causes a computer to function as a display information output means that outputs to a display device the captured image acquired by the image acquisition means, confirmation information including the position relative to the medium area, the angle, the code identification information, and the tracking identification information.

7. 2. The program according to claim 1, A program that causes the image acquisition means to function to acquire the captured image by photographing the medium placed on a stand from a side where the medium image is visible.

8. an image capturing unit configured to capture an image of a table on which one or more media are placed from a side where a media image on the media can be viewed; an image acquisition means for acquiring, from the photographing unit, photographed images obtained by the photographing unit by continuously photographing at predetermined time intervals; an area acquisition means for detecting and acquiring a medium area that is an area of ​​the medium from the photographed image acquired by the image acquisition means; a tracking information assigning means for performing a tracking process on the medium area included in the most recently acquired photographed image and assigning tracking identification information that is identification information of the medium area; an area confirmation means for confirming an increase or decrease in the medium area acquired by the area acquisition means using the tracking identification information; an association means for associating the tracking identification information already assigned to the medium area and the code identification information already read from the medium image of the medium in the medium area with the medium area acquired by the area acquisition means when the area confirmation means confirms that there is no increase or decrease in the medium area; A reading device comprising:

9. A reading device according to claim 8; the medium having the medium image; A reading system comprising: A reading system, wherein the medium image is a code image including a two-dimensional code or a barcode.

10. 10. The reading system according to claim 9, The photographing unit photographs the object while being irradiated with infrared light, A reading system, wherein the medium image is invisible and formed by transparent ink containing infrared absorbing material.

Images