Program, information processing method, and information processing apparatus

Abstract

To provide a program, an information processing method, and an information processing apparatus capable of acquiring a situation of a game. A program causes a computer to execute an information processing method including: detecting a position of a card in an image that is obtained by photographing a range in which game cards are to be disposed by a camera; generating a cropped image by cropping a region of the card from the image on the basis of the position of the card; and acquiring a situation of the game on the basis of the cropped image.

Description

PROGRAM, INFORMATION PROCESSING METHOD, AND INFORMATION PROCESSING APPARATUS

[0001] The present technology relates to a program, an information processing method, and an information processing apparatus.

[0002] In recent years, trading card games (TCG) have become widespread. A TCG is a card game in which a plurality of players battle each other in accordance with a predetermined rule by using a plurality of cards having different various types of pictures and character strings printed thereon.

[0003] To make the TCG more enjoyable for players, a technology has been proposed in which plays of players in the TCG are photographed by an electronic device such as a smartphone, arranged cards are sensed, and the progression of the TCG is supported in accordance with the sensing result (PTL 1).

[0004] JP 2023-154018ASummary

[0005] To support the progression of a TCG, it is important to precisely acquire a situation of a game.

[0006] The present technology has been made in view of such a problem, and it is an object thereof to provide a program, an information processing method, and an information processing apparatus capable of acquiring a situation of a game.

[0007] In order to solve the above-mentioned problem, a first technology is a program for causing a computer to execute an information processing method including: detecting a position of a card in an image that is obtained by photographing a range in which game cards are to be disposed by a camera; generating a cropped image by cropping a region of the card from the image on the basis of the position of the card; and acquiring a situation of the game on the basis of the cropped image.

[0008] Furthermore, a second technology is an information processing method including: detecting a position of a card in an image that is obtained by photographing a range in which game cards are to be disposed by a camera; generating a cropped image by cropping a region of the card from the image on the basis of the position of the card; and acquiring a situation of the game on the basis of the cropped image.

[0009] Furthermore, a third technology is an information processing apparatus including: a card position detection unit configured to detect a position of a card in an image that is obtained by photographing a range in which game cards are to be disposed by a camera; a crop unit configured to generate a cropped image by cropping a region of the card from the image on the basis of the position of the card; and a situation acquisition unit configured to acquire a situation of the game on the basis of the cropped image.

[0010] Fig. 1 is a diagram illustrating a configuration of a TCG system 1000.Fig. 2 is a diagram illustrating cards C used for TCG.Fig. 3 is a diagram illustrating cards C used for TCG.Fig. 4 is a diagram illustrating information objects P used for TCG.Fig. 5 is a block diagram illustrating a hardware configuration of an information processing apparatus 100.Fig. 6 is a diagram illustrating a processing block of an information processing apparatus 100 in a first embodiment.Fig. 7 is a flowchart illustrating processing in the information processing apparatus 100.Fig. 8 is an explanatory diagram of processing for recognizing a mat 10.Fig. 9 is an explanatory diagram of keystone correction of an image.Fig. 10 is a diagram illustrating an image that has been subjected to keystone correction.Fig. 11 is a diagram illustrating states in which a card is placed on a card.Fig. 12 is an explanatory diagram of generation of output results.Fig. 13 is an explanatory diagram of generation of output results.Fig. 14 is an explanatory diagram of processing using output results.Fig. 15 is an explanatory diagram of a TCG system 1000 in a case where an online TCG is played.Fig. 16 is a diagram illustrating a processing block of an information processing apparatus 100 in a second embodiment.Fig. 17 is a flowchart illustrating processing based on a motion detection result.Fig. 18 is a flowchart illustrating processing based on a foreign object detection result.Fig. 19 is a diagram illustrating modifications of design of cards C.

[0011] Referring to the drawings, embodiments of the present technology are described below. Note that descriptions are given in the following order. ＜First Embodiment＞ (Configuration of TCG System 1000) (Configuration of Information Processing Apparatus 100) (Processing in Information Processing Apparatus 100) ＜Second Embodiment＞ (Configuration of Information Processing Apparatus 100) (Processing in Information Processing Apparatus 100) ＜Modifications＞

[0012] ＜First Embodiment＞ (Configuration of TCG System 1000) Referring to Fig. 1, a configuration of a TCG system 1000 is described. The TCG system 1000 includes an information processing apparatus 100 and a display apparatus 200.

[0013] In the present technology, a battle of a TCG by a plurality of players is photographed by a camera 106 in the information processing apparatus 100, and processing is performed on the basis of the photographing result.

[0014] For a battle of a TCG by a plurality of players, a mat 10 having a rectangular shape for specifying positions and regions to place cards is placed on a flat surface such as a floor or a table. Two players 1 and 2 are opposed to each other across the mat 10, and a battle of a TCG is performed in a manner that each player places a card on the mat 10 in accordance with a predetermined rule.

[0015] The mat 10 has a square shape with the same vertical and horizontal dimensions, for example, 60 cm × 60 cm. However, the size and shape of the mat 10 are not limited to the particular ones, and the present technology can be implemented even when the mat 10 is not used.

[0016] A left half region of the mat 10 is a region in which the player 1 places cards, and a right half region is a region in which the player 2 places cards.

[0017] Cards C include cards as illustrated in Fig. 2 that indicate information on postures, names, skills, features, and physical strengths of characters (not limited; such as humans, animals, monsters, robots, vehicles, and structures) and cards as illustrated in Fig. 3 that give particular effects, influences, meanings (hereinafter referred to as "effects and the like") to another card C. Note that, in a rule of a TCG, a card C indicating a character may give effects and the like to another card C. In some cases, one TCG has about 5,000 types of cards C.

[0018] Note that the character is merely an example. What is indicated by a card C is not limited to the character, and may be a picture, a mark, a numeral, a text, a pattern, or a combination thereof. A card C can indicate any information as long as a player can recognize that the card C is different from another card C.

[0019] The card C is given identification information for identifying a type. The identification information is any one of a character, a picture, a mark, and a pattern or a combination thereof, but may be any information with which a player can recognize that a card C is different from another card C. Note that cards C may be colored in different colors depending on types or all cards C may be colored in the same color.

[0020] A TCG in the present embodiment has a rule in which various effects and the like can be produced by stacking a plurality of cards C.

[0021] The shape of a card C may be a quadrangular shape, a disc shape, a triangular shape, a polygonal shape with more vertices, or a free form. The material of a card C is not limited, and may be paper, metal, or synthetic resin such as plastic or acrylic.

[0022] Furthermore, the TCG in the present embodiment has, as illustrated in Fig. 4, objects (hereinafter referred to as "information objects P") indicating information on the TCG in addition to cards. Information on the TCG indicated by an information object P in the present embodiment is a numerical value indicating an effect and the like given to a card C. The information object P indicates an effect and the like given to a card C, and hence the information object P is used by being put on top of the card C as an example of use. Note that the information object P is not limited to a numerical value indicating an effect and the like, and may be another information about the TCG, such as a numerical value indicating an amount of money, a score, or a point.

[0023] In the present embodiment, information objects P have a plurality of types of different numerical values, such as 100, 50, and 10. Information objects P may be colored in different colors depending on types or all information objects P may be colored in the same color. Examples of information objects P include a card, a sheet, a medal, a seal, and a stone. Furthermore, the shape of an information object P may be a flat plate shape, a disc shape, a spherical shape, a cubic shape, a rectangular parallelepiped shape, or a free form. Furthermore, the material of an information object P is not limited, and may be paper, metal, or synthetic resin such as plastic or acrylic.

[0024] The information processing apparatus 100 includes the camera 106, and is placed at a position higher than the mat 10 by using a tripod or a stand such that the mat 10 can be photographed by the camera 106. In the present embodiment, the information processing apparatus 100 is a smartphone.

[0025] The display apparatus 200 is a device capable of displaying video, such as a television set, a display apparatus, a personal computer, or a tablet terminal. The display apparatus 200 is provided with a function capable of outputting voice from a built-in speaker or an external speaker connected.

[0026] The display apparatus 200 is connected to the information processing apparatus 100 by wired or wireless connection. Examples of wired connection include HDMI (registered trademark) (High-Definition Multimedia Interface), USB (Universal Serial Bus), and MHL (Mobile High-Definition Link). Examples of wireless connection include Wi-Fi and wireless LAN (Local Area Network). Any method can be used as long as the display apparatus 200 and the information processing apparatus 100 can be connected.

[0027] In the example in Fig. 1, the information processing apparatus 100 is placed on one side of the mat 10 and the display apparatus 200 is placed on the other side, but the information processing apparatus 100 and the display apparatus 200 may be placed on the same side. In this case, it is preferred that video displayed on the display apparatus 200 be flipped horizontally. In this manner, the state of the mat 10 in the real world and the state of the mat 10 displayed on the display apparatus 200 match each other, thus making it more comfortable for players to play a TCG while viewing the display on the display apparatus 200.

[0028] The information processing apparatus 100 has TCG application installed therein. The TCG application has functions of displaying video taken by the camera 106 in the information processing apparatus 100 on a display unit 109 in the information processing apparatus 100 in real time and outputting the video to the display apparatus 200. In this manner, video of the mat 10 taken by the camera 106 is displayed on the display unit 109 in the information processing apparatus 100 and the display apparatus 200, and the players can view the video.

[0029] (Configuration of Information Processing Apparatus 100) Next, a hardware configuration of the information processing apparatus 100 is described with reference to Fig. 5.

[0030] A CPU 101 functions as an arithmetic processing unit configured to perform various kinds of processing, and controls the entire information processing apparatus 100 and each unit. The CPU 101 executes various kinds of processing in accordance with a program stored in a ROM 102 or a non-volatile memory unit 104 or a program loaded from a storage unit 111 to a RAM 103. For the non-volatile memory unit 104, for example, an EEPROM (Electrically Erasable Programmable Read Only Memory) is used. Furthermore, data necessary for executing various kinds of processing by the CPU 101 is stored in the RAM 103 as appropriate.

[0031] The CPU 101, the ROM 102, the RAM 103, and the non-volatile memory unit 104 are connected to one another through a bus. Furthermore, an input / output interface 105 is connected to the bus.

[0032] The input / output interface 105 is connected to the camera 106, an IMU 107 (Inertial Measurement Unit), a distance sensor 108, the display unit 109, an input unit 110, the storage unit 111, a communication unit 112, and a drive 113.

[0033] The camera 106 includes an image pickup device and a signal processing circuit, and takes RGB (Red, Green, Blue) or single-color video and images. As the image pickup device, a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) is used.

[0034] The camera 106 may be a stand-alone camera that is connected to the information processing apparatus 100 by wired or wireless connection, such as a digital still camera or an action camera independent from the information processing apparatus 100.

[0035] In a TCG, a card C is sometimes inserted in a transparent protective film called sleeve for use. However, if a card C is inserted in a sleeve, light is reflected such that a part or whole of the card C does not appear in an image, and identification accuracy of the card C by the information processing apparatus 100 may decrease. Furthermore, the card C itself rather than the sleeve may reflect light. In addition, some cards C may be subjected to treatment on their surfaces such that the surface becomes luminescent, such as holography. Due to the causes, the identification accuracy of the card C by the information processing apparatus 100 may decrease. Thus, by mounting a polarizing filter to a lens of the camera 106, light reflected components can be removed to prevent the decrease in identification accuracy of the card C by the information processing apparatus 100. For treatment to make the surface luminescent in rainbow colors, it is conceivable to reduce reflected components by augmentation of learning data.

[0036] Furthermore, in order to solve such a problem caused by reflection, a polarized image sensor may be used in the camera 106. The polarized image sensor is an image sensor in which polarizers in four directions are mounted. In the polarized image sensor, four-polarization polarizers for 0 degrees, 45 degrees, 90 degrees, and 135 degrees are provided for each pixel, and polarized images in four directions can be acquired by every photography. Thus, the polarized image sensor has a feature that photography does not need to be performed for each filter with different polarizations as in the case of using a polarizing filter and hence has an advantage on photography of moving objects. By using a polarized image sensor, light reflected by a sleeve or a card C itself can be reduced or removed. If a polarizing filter is used to take four polarized images, photography needs to be repeated four times while changing a polarizing filter, with the result that a player may lose immersion or the atmosphere may be spoilt. However, by using a polarized image sensor, polarized images in four directions can be acquired by single photography, and hence there is an effect that the real-time progress can be secured to prevent a player from losing immersion or prevent the atmosphere from being spoilt.

[0037] The IMU 107 acquires the motion and posture of the information processing apparatus 100 by an acceleration sensor, an angular velocity sensor, or a gyroscope sensor in two or three axis directions.

[0038] The distance sensor 108 measures a distance to a subject, and outputs a depth (depth information) as sensing data. As a ranging sensor, a ToF (Time of Flight), a LiDAR (Light Detection And Ranging), an infrared sensor, an ultrasonic sensor, a color stereo camera, an IR (Infrared) stereo camera, or a monocular camera can be used. Furthermore, the distance sensor 108 may employ triangulation by a single IR camera and structured light. As the distance sensor 108, a plurality of sensors may be used in combination.

[0039] The display unit 109 is a display device included in the information processing apparatus 100, such as a liquid crystal display or an organic EL (Electroluminescence) or an independent display device connected to the information processing apparatus 100.

[0040] The input unit 110 is, for example, various kinds of operators and operation devices such as a touch panel and a touch pad. The input unit 110 may be a keyboard, a mouse, a key, a dial, or a remote controller. Operation from a player is detected by the input unit 110, and a signal according to the input operation is interpreted by the CPU 101.

[0041] The storage unit 111 is, for example, a large-capacity storage medium such as a hard disk or a flash memory. In the storage unit 111, various kinds of application, data, and information are stored.

[0042] The communication unit 112 is a terminal or a communication module for various kinds of communication, such as communication processing through a transmission path such as the Internet, wired / wireless communication with various kinds of devices, and communication by bus communication.

[0043] The drive 113 is connected to the input / output interface 105 as necessary. The removable storage medium 114 is mounted as appropriate through the drive 113. The removable storage medium 114 includes a magnetic disk, an optical disc, a magneto-optical disc, and a semiconductor memory.

[0044] By using the drive 113, data files such as programs used for each piece of processing can be read from the removable storage medium 114. The read data files are stored in the storage unit 111. Furthermore, computer programs read from the removable storage medium 114 are installed on the storage unit 111 as necessary.

[0045] In the information processing apparatus 100, for example, programs and application for the processing in the present technology can be installed through network communication by the communication unit 112 or through the removable storage medium 114. Furthermore, programs and application may be stored in the ROM 102 or the storage unit 111 in advance. Furthermore, images taken by the camera 106 and processing results by AI image processing may be received, and the images and the processing results may be stored in the storage unit 111 or the removable storage medium 114.

[0046] Next, a processing block of the information processing apparatus 100 in the first embodiment is described with reference to Fig. 6.

[0047] The image processing unit 151 crops an image of a region of the mat 10 from a frame image constituting video taken by the camera 106, and performs keystone correction processing on the image of the mat 10. In the present technology, each of consecutive frame images constituting video taken by the camera 106 is a unit of processing.

[0048] The card position detection unit 152 detects a position at which a card is present from an image of the mat 10. By detecting positions of cards, the card position detection unit 152 can also detect the number of cards placed on the mat 10.

[0049] The crop unit 153 generates a cropped image by cropping, from the frame image, a region of a card whose position has been detected by the card position detection unit 152.

[0050] The card identification unit 154 identifies the type of a card C placed on the mat 10 on the basis of the cropped image. The type and number of cards C correspond to a situation of a game recited in the claims. The card identification unit 154 includes a first card identification unit 155 and a second card identification unit 156.

[0051] The first card identification unit 155 performs processing for identifying the type of a card C on every cropped image.

[0052] The second card identification unit 156 performs processing for identifying the type of a card C on a cropped image for which the first card identification unit 155 has failed to identify the type of the card C. The case where the first card identification unit 155 has failed to identify the type of a card C is a case where another card C is stacked on top of a card C and a part of the card C is hidden. Thus, the second card identification unit 156 identifies the type of a card C on the basis of not the entire surface of the card C but identification information on an exposed part of the surface of the card C.

[0053] The output generation unit 157 generates an output result in the latest frame image on the basis of an identification result of the type of a card C in the latest frame image and an output result in the past frame image (previous frame image). The output generation unit 157 may hold an output result in the previous frame image, or output results in the past frame images may be stored in the storage unit 111 and an output result in the previous frame image may be read from the storage unit 111 when processing is performed.

[0054] The object detection unit 158 detects an information object P present on the card C of which the type has been identified by the first card identification unit 155. The type and number of information objects P also correspond to a situation of a game as recited in the claims.

[0055] The total calculation unit 159 sums up numerical values indicated by a plurality of information objects P detected by the object detection unit 158 in the same cropped image.

[0056] The card identification unit 154 and the object detection unit 158 correspond to a situation acquisition unit configured to acquire a situation of a TCG as recited in the claims.

[0057] The information processing apparatus 100 is configured as described above. In the present embodiment, the information processing apparatus 100 is configured by a smartphone. However, the information processing apparatus 100 may be configured by an electronic device such as a personal computer or a tablet terminal. When a smartphone or such an electronic device executes the program according to the present technology, the processing block and the information processing method of the information processing apparatus 100 are implemented. The program may be installed in a smartphone or such an electronic device in advance, or may be downloaded or distributed by a storage medium and installed by a player. Furthermore, the processing block of the information processing apparatus 100 may be configured on a cloud server.

[0058] The cloud server is not limited to the one configured by a single computer apparatus, and may be configured by a plurality of computer apparatus integrated as a system. A plurality of computer apparatus are integrated as a system through, for example, a LAN (Local Area Network). Furthermore, a plurality of computer apparatus arranged at remote locations may be integrated as a system through a VPN (Virtual Private Network) using the Internet. A plurality of computer apparatus may include computer apparatus as a server group (cloud) available by cloud computing service.

[0059] (Processing in Information Processing Apparatus 100) Processing in the information processing apparatus 100 is described. First, it is assumed that, as illustrated in Fig. 1, the mat 10 indicating a region to place cards C is placed on a flat surface such as a floor, and the information processing apparatus 100 is placed so as to photograph the mat 10 with the camera 106.

[0060] The information processing apparatus 100 recognizes the mat 10 from video taken by the camera 106. The recognition of the mat 10 can be implemented by DNN (Deep Neural Network). Furthermore, the recognition of the mat 10 may be implemented by machine learning or artificial intelligence such as CNN (Convolutional Neural Network) or RF (Random Forest). As a learning method of machine learning, for example, a neural network or deep learning is used. Furthermore, publicly known object recognition technologies such as a method by template matching and a matching method based on luminance distribution information on a subject may be used.

[0061] When the information processing apparatus 100 recognizes the mat 10, as illustrated in Fig. 8, the information processing apparatus 100 displays a trapezoidal frame F for specifying a region in video corresponding to the mat 10 on the display unit 109 on the basis of the recognition result. The frame F is used to specify a region (sometimes referred to as "target region") for which a situation of the TCG is to be acquired by the information processing apparatus 100. It is desired that the information processing apparatus 100 be placed such that the front side (base) of the frame F is aligned with the lower edge of the display unit 109 (lower edge of displayed video). Note that video taken by the camera 106 in the information processing apparatus 100 is displayed on the display apparatus 200 in real time, and hence the frame F is also displayed on the display apparatus 200.

[0062] The mat 10 is a product for sale, and the size and shape are known. Thus, how the mat 10 is viewed on the display unit 109 as a trapezoid in terms of the shape and size can be specified on the basis of a distance between the camera 106 and a flat surface on which the mat 10 is placed, an inclined angle of the camera 106 with respect to the flat surface, and the FoV (Field of View) of the camera 106. The information processing apparatus 100 renders and displays a frame F on the basis of the specifying result. The distance between the camera 106 and the flat surface can be acquired by the distance sensor 108. Furthermore, the inclined angle of the camera 106 with respect to the flat surface can be acquired by the IMU 107.

[0063] Note that a method in which markers serving as guides are placed at four corners of the mat 10 and the markers are detected from video taken by the camera 106 to display a frame F may be used. Furthermore, corners of the mat 10 may be detected from video taken by the camera 106, and a frame F may be displayed on the basis of the corners. Furthermore, a frame F may be displayed on the basis of position estimation results and map creation results by SLAM (Simultaneous Localization and Mapping).

[0064] Note that a TCG-dedicated camera device having a fixed field of angle may be placed with a particular inclined angle at a particular position with reference to the mat 10 with a TCG-dedicated camera fixed base such that a positional relation between a target region and the mat 10 can be fixed to an optimal state. In this case, the above-mentioned processing using the frame F is unnecessary.

[0065] The function of recognizing the mat 10 may be included in the information processing apparatus 100 or may be included in the TCG application.

[0066] Note that the present technology can be used also in a case where the mat 10 is not used and cards C are directly placed on a floor.

[0067] A flowchart in Fig. 7 is described. First, at Step S11, the image processing unit 151 crops a region of the mat 10 indicated by the frame F from a frame image constituting video taken by the camera 106, and performs keystone correction processing on the cropped image of the mat 10.

[0068] As illustrated in Fig. 9, the keystone correction processing can be performed on the basis of the posture of the camera 106 that can be acquired by the IMU 107, the distance (depth) to a flat surface on which the mat 10 is placed that can be acquired by the distance sensor 108, and the FoV (field of view) of the camera 106. As a result of performing the keystone correction processing, as illustrated in Fig. 10, the trapezoidal image of the mat 10 is converted into a rectangular image as if the mat 10 is taken from directly above. Note that the keystone correction processing can also be performed on the basis of only the distance to the flat surface that can be acquired by the distance sensor 108 and the FoV of the camera 106.

[0069] As described above, in a TCG, the positions and regions to place cards C are determined depending on the mat 10. Thus, the information processing apparatus 100 does not need to acquire a situation of the TCG (such as identification of type of card C) for the entire frame image taken by the camera 106, and only needs to acquire a situation only for a target region defined by the mat 10.

[0070] Next, at Step S12, the card position detection unit 152 detects the position of a card C from the image of the mat 10 that has been subjected to keystone correction. The card position detection unit 152 detects corners of the card C to detect the positions and number of cards C present on the mat 10. The corners of the card C can be detected by using, for example, a Harris corner detection method or a feature detection method. Alternatively, the detection can be implemented by machine learning or artificial intelligence such as DNN, CNN, or RF. The card position detection unit 152 supplies the detected positions and number of cards C to the crop unit 153 as a detection result.

[0071] Next, at Step S13, the crop unit 153 crops a region of the card C from the frame image on the basis of the position of the card C detected by the card position detection unit 152, thereby generating a cropped image. Furthermore, the crop unit 153 performs keystone correction processing on the cropped image. The crop unit 153 supplies the cropped image to the card identification unit 154. The number of cropped images is the same as the number of cards C detected by the card position detection unit 152.

[0072] Next, at Step S14, the card identification unit 154 performs processing for identifying the type of a card C on the cropped image. The card identification unit 154 first identifies the type of the card C by the first card identification unit 155. The first card identification unit 155 performs processing for identifying the type of the card C on every cropped image. The first card identification unit 155 identifies the type of the card C on the basis of features of the entire surface of the card C.

[0073] The first card identification unit 155 can identify the type of a card C by DNN. By identifying the type of a card C by DNN, several thousands of types of cards C can be identified almost in real time unlike conventional methods such as feature matching. The first card identification unit 155 may identify the type of a card C by machine learning or artificial intelligence such as CNN or RF.

[0074] The first card identification unit 155 needs to learn in advance all cards C to be identified. For example, in a case where a TCG has 5,000 types of cards C, the first card identification unit 155 needs to learn the 5,000 types of cards C in advance. Note that it is desired that the learning be performed by using both photos of real cards C and CG (Computer Graphics) images indicating design of the cards C. In this manner, identification accuracy can be enhanced.

[0075] The second card identification unit 156 performs processing for identifying the type of a card C on a cropped image for which the first card identification unit 155 has failed to identify the type of the card C. The case where the first card identification unit 155 has failed to identify the type of a card C is a case where another card C is stacked on top of a card C and a part of the lower card C is hidden. Thus, the second card identification unit 156 identifies the type of the lower card C on the basis of not the entire surface of the card C but features of an exposed part of the card C that is not hidden by another card C stacked upward.

[0076] The second card identification unit 156 can identify the type of a card C by DNN. Furthermore, the second card identification unit 156 may identify the type of a card C by machine learning or artificial intelligence such as CNN or RF.

[0077] For example, in a TCG, in the case where a card C whose part is only exposed when a plurality of cards C are stacked and the card C is placed under another card C is only a particular card C, the second card identification unit 156 does not need to learn all cards C, but only needs to learn only particular cards C to be placed under other cards C. For example, when there are 5,000 types of cards C in total, and of those, particular cards C to be placed under other cards C have four types, the second card identification unit 156 only needs to learn only the four types of the particular cards C in advance. Thus, the number of types of cards C to be identified by the second card identification unit 156 is small, and hence erroneous identification can be prevented. However, if there is a possibility that all cards C may be placed under other cards C according to a rule of the TCG, the second card identification unit 156 needs to learn all cards C.

[0078] The second card identification unit 156 identifies the type of a card C on the basis of not the entire surface of the card C but, as illustrated in Fig. 11, identification information that is present in an exposed range that is not hidden by another card C stacked upward.

[0079] In a TCG, in the case where there is a rule that "when cards are stacked, a card is placed such that an upper part of the lower card C is exposed" or there is such tradition among players, as illustrated in Fig. 3 and Fig. 11, large identification information is preferably disposed at an upper part of a lower card C. In this manner, identification accuracy of the type of a card C by the second card identification unit 156 can be enhanced. This changes depending on how cards C are stacked, and hence, for example, in a TCG, in the case where there is a rule that "when cards are stacked, an upper card C is placed such that a lower part of a lower card C is exposed" or there is such tradition among players, large identification information is preferably disposed at a lower part of a card C.

[0080] Note that even when a card indicating another character is stacked on top of a card indicating a character illustrated in Fig. 2, the second card identification unit 156 can identify the type of the card C placed at the bottom on the basis of identification information (in the example in Fig. 2, a character string indicating the name of the character). Furthermore, when a picture indicating a character is exposed, the second card identification unit 156 can identify the type of a card C on the basis of the picture.

[0081] Furthermore, when different colors are colored depending on the types of cards C, the types of cards C can be identified by color detection. The types of cards C may be identified on the basis of both identification information and color.

[0082] Thus, the second card identification unit 156 can identify the type of a card C at the bottom even in the state in which cards C are stacked upward as illustrated in Fig. 11A. Note that the cards C may be stacked in the horizontal direction as illustrated in Fig. 11B, or may be diagonally stacked as illustrated in Fig. 11C. Furthermore, three or more cards C may be stacked as illustrated in Fig. 11D. In this case, each of a plurality of cards C placed upward can be identified.

[0083] Note that it is desired that a card C placed at the bottom when stacked be such that a range of at least about 1 / 3 of the upper part be exposed, but this is merely an example. Owing to improvements of identification accuracy by DNN, the type of a card C can be identified even with a smaller part of the exposed range.

[0084] The card identification unit 154 outputs identification results by the first card identification unit 155 and the second card identification unit 156 to the output generation unit 157. Furthermore, the card identification unit 154 supplies the cropped image for which the type of a card C has been identified by the first card identification unit 155 to the object detection unit 158.

[0085] The first card identification unit 155 and the second card identification unit 156 identify the type of a card C in each cropped image, and hence even when there are a plurality of the same cards C on the mat 10, the cards C can be identified.

[0086] For some TCGs, new types of cards additionally come to market regularly or irregularly. When a new card comes to market, the new card can be identified by learning the card by the card identification unit 154. Furthermore, when a player plays a TCG different from the TCG in the present embodiment, the card identification unit 154 needs to learn cards of the TCG in advance.

[0087] Next, at Step S15, the output generation unit 157 combines an identification result of a card C in the latest frame image and an output result in the past frame image (previous frame image) to generate an output result indicating the type and number of cards C in the latest frame image.

[0088] Referring to Fig. 12 and Fig. 13, the generation of output results by the output generation unit 157 is described. As illustrated in Fig. 12A, for example, an identification result by the card identification unit 154 in a frame (n) indicates a card C1, a card C2, and a card C3, and an output result by the output generation unit 157 in the previous frame (n-1) indicates the card C1 and the card C2.

[0089] In this case, the card C3, which has not been present in the frame (n-1), has newly been identified in the frame (n), and hence the likelihood of the card C3 occurs in a combined result (output result of frame (n)) by the output generation unit 157. In this case, as an example, a change width of the likelihood in each frame is ±20. When the likelihood has exceeded a predetermined threshold, the card is considered present and the type of the card is included in the output result. The threshold is 50, for example. Thus, in the output result of the frame (n), the card C3 is not present and has not been identified yet.

[0090] Next, as illustrated in Fig. 12B, an output result of the frame (n) indicates the card C1, the card C2, and the card C3 (likelihood 20), and an identification result of the next frame (n+1) indicates the card C1, the card C2, and the card C3.

[0091] In this case, the card C3 has been identified in the frame (n+1), and hence in a combined result (output result of frame (n+1)), the likelihood of the card C3 increases to 40. At this time point, the likelihood has not exceeded the threshold, and hence in the output result of the frame (n+1), the card C3 is not present and has not been identified yet.

[0092] Next, as illustrated in Fig. 12C, an output result of the frame (n+1) indicates the card C1, the card C2, and the card C3 (likelihood 40) and an identification result of the next frame (n+2) indicates the card C1, the card C2, and the card C3.

[0093] In this case, the card C3 has been identified in the frame (n+2), and hence in a combined result (output result of frame (n+2)), the likelihood of the card C3 increases to 60. The likelihood of the card C3 has exceeded the threshold, and hence the card C3 is present and has been identified, and the output result of the frame (n+2) indicates the card C1, the card C2, and the card C3.

[0094] On the other hand, as illustrated in Fig. 13A, it is assumed that an output result of the frame (n) indicates the card C1, the card C2, and the card C3 (likelihood 20) and an identification result of the next frame (n+1) indicates that the card C1 and the card C2 are present and the card C3 has not been identified.

[0095] In this case, in an output result of the frame (n+1), the card C1 and the card C2 are present, and the likelihood of the card C3 decreases from 20 to 0. The likelihood is equal to or lower than the threshold, and hence in the output result of the frame (n+1), the card C3 is considered not present.

[0096] Furthermore, as illustrated in Fig. 13B, it is assumed that an output result of the frame (n+2) indicates the card C1, the card C2, and the card C3 (likelihood 60) and an identification result of the next frame (n+3) indicates that the card C1 and the card C2 are present and the card C3 has not been identified.

[0097] In this case, in an output result of the frame (n+3), the card C1 and the card C2 are present, and the likelihood of the card C3 decreases from 60 to 40. In this manner, the likelihood of the card C3 becomes equal to or lower than the threshold, and hence in the output result of the frame (n+3), the card C3 is not present and has not been identified.

[0098] As described above, in both cases where the type of a card C has been identified by the card identification unit 154 and where the type of a card C has not been identified by the card identification unit 154, without using a result of single identification directly, the likelihood is increased or decreased depending on the identification result, and the likelihood and the threshold are compared to determine an output result. The identification result may include erroneous detection or erroneous recognition, and hence this processing can enhance the reliability of the output result.

[0099] Then, the identified types and number of cards C are output to the outside as output results in the latest frame image. The output results are output to, for example, TCG application.

[0100] The description is given back to the flowchart in Fig. 7. Next, at Step S16, the object detection unit 158 detects an information object P in a cropped image for which the type of a card C has been identified by the first card identification unit 155. The detection of the information object P can be implemented by DNN. Alternatively, the detection may be implemented by machine learning or artificial intelligence such as CNN or RF.

[0101] The object detection unit 158 needs to learn in advance all information objects P to be detected. An information object P is intended to be used while being put on a card C, and hence an information objects P is present in a cropped image that has been cropped as a region of the card C. Thus, the detection of the information object P is performed on the cropped image. When information objects P are colored with different colors depending on numerical values, the positions and types of the information objects P can be specified by color detection. Note that an information object P has not been used yet at the stage of processing depending on the progress of the TCG. The object detection unit 158 outputs a detection result to the total calculation unit 159.

[0102] Next, at Step S17, the total calculation unit 159 sums up numerical values indicated by a plurality of information objects P detected by the object detection unit 158 in the same cropped image. For example, in the case where two information objects P each indicating a numerical value "100", one information object P indicating a numerical value "50", and one information object P indicating a numerical value "10" are present on one cropped image for which the type of a card C has been identified, the total of the numerical values is calculated as 260. In this manner, the total of numerical values indicating effects and the like given to the card C on which the information objects P are placed can be output as information.

[0103] Note that Step S15, Step S16, and Step S17 may be performed in the reverse order, or may be performed simultaneously or substantially simultaneously.

[0104] The processing in the first embodiment is performed as described above. According to the first embodiment, the type of a card C located on the mat 10 can be identified. Furthermore, the number of cards C can be detected. Furthermore, an information object P used in a TCG can be detected. In this manner, the situation of the TCG can be acquired.

[0105] By outputting identification results of cards C to the outside such as TCG application, the identification results can be used for various kinds of processing. For example, identification results of cards C can be used such that a TCG interface as illustrated in Fig. 14 is displayed on the display apparatus 200.

[0106] The TCG interface is configured by a video display region VD at the center, a first card display region D1 on the left side, and a second card display region D2 on the right side.

[0107] The video display region VD displays video taken by the camera 106 in the information processing apparatus 100 in real time. The first card display region D1 displays a display card image CP corresponding to a card C placed in a left half region of the mat 10. The second card display region D2 displays a display card image CP corresponding to a card C placed in a right half region of the mat 10. Thus, in the example in Fig. 14, in the first card display region D1, display card images CP corresponding to cards C placed on the mat 10 by the player 1 are displayed. Furthermore, in the second card display region D2, display card images CP corresponding to cards C placed on the mat 10 by the player 2 are displayed.

[0108] The display card image CP is image data created by CG, which represents the same design as that of a real card C. To display a display card image CP in the first card display region D1 or the second card display region D2, the type of a real card C and the display card image CP are associated with each other in advance. Display card images CP are prepared in advance for all cards C used in the TCG and stored in the storage unit 111.

[0109] Then, a display card image CP corresponding to a card C placed on the mat 10 is read on the basis of an identification result of the card C, and is displayed in the first card display region D1 or the second card display region D2.

[0110] In Fig. 14, the first card display region D1 and the second card display region D2 can display eight display card images CP each, but may display a larger number of the display card images CP. For example, a large number of display card images CP may be displayed by scrolling in the up-down direction or left-right direction, or when the number of the display card images CP is eight or more, the display size of the display card images CP may be reduced such that a large number of the display card images CP can be displayed.

[0111] In the present technology, the position of a card C can be detected, and hence a display card image CP corresponding to a card C placed in a left half region of the mat 10 is displayed in the first card display region D1. Furthermore, a display card image CP corresponding to a card C placed in a right half region of the mat 10 is displayed in the second card display region D2. In this manner, a player can check the situation of the TCG on a large screen of the display apparatus 200.

[0112] As illustrated in Fig. 14, the display card image CP can be displayed in the video display region VD. For example, a display card image CP corresponding to a card C placed on the mat 10 can be displayed, and the display card image CP can be moved or rotated to produce the atmosphere of the TCG.

[0113] Furthermore, if the type of a card C and detailed information on the card C are associated with each other in advance in TCG application, the detailed information on the card C can be displayed on the TCG interface in accordance with an identification result of the card C. This is useful when an opponent player puts down a card C that is unknown to a player. Detailed information on a card C may be displayed at a position corresponding to the card C displayed in the video display region VD, or may be displayed at a position corresponding to a display card image CP displayed in the first card display region D1 or the second card display region D2. Examples of the detailed information on the card C include effects and the like and the state of the card C.

[0114] Furthermore, if the type of a card C and voice are associated with each other in advance in TCG application, particular voice can be output from the display apparatus 200 in accordance with the type of the card C. Examples of voice include BGM (Back Ground Music), sound effects, voice effects, voice guidance, and automatic play-by-play commentary. For example, voice may be output in synchronization with a timing at which a player places a card C or a timing at which a player flips a card C. In this manner, the atmosphere of the TCG can be produced.

[0115] Furthermore, if the type of a card C and video are associated with each other in advance in TCG application, particular video can be displayed on a TCG interface in accordance with the type of the card C. Examples of video include CG effects and movie. For example, video may be displayed in synchronization with a timing at which a player places a card C or a timing at which a player flips a card C. In this manner, the atmosphere of the TCG can be produced.

[0116] The present technology is also useful for the case where a TCG is played in online by using the Internet. For example, as illustrated in Fig. 15, a case where a TCG is played in online by a player 1 and a player 2 located in remote spaces is considered. The player 1 places a mat 10A, and prepares an environment to play the TCG with an information processing apparatus 100A and a display apparatus 200A. Furthermore, the player 2 places a mat 10B, and arranges an environment to play the TCG with an information processing apparatus 100B and a display apparatus 200B. The information processing apparatus 100A and the information processing apparatus 100B are connected through the Internet.

[0117] The information processing apparatus 100A and the information processing apparatus 100B are provided with functions of online battle application. The online battle application may be installed in the information processing apparatus 100A and the information processing apparatus 100B in advance, or may be downloaded or distributed by a storage medium and installed by a player.

[0118] The online battle application has a communication processing function using the communication unit 112 in the information processing apparatus 100. In this manner, the information processing apparatus 100A and the information processing apparatus 100B can transmit and receive video taken by the camera 106 and information on identification results of cards C.

[0119] Furthermore, the online battle application has a function of combining video of the mat 10A taken by the camera 106 in the information processing apparatus 100A and video of the mat 10B taken by the camera 106 in the information processing apparatus 100B to generate video as if the player 1 and the player 2 are present in the same space.

[0120] The information processing apparatus 100A on the player 1 side combines video taken by its own camera 106 and video of the mat 10B on the player 2 side taken by the camera 106 in the information processing apparatus 100B, and displays the resultant on the display apparatus 200A. Furthermore, the information processing apparatus 100B on the player 2 side combines video taken by its own camera 106 and video of the mat 10 on the player 1 side taken by the camera 106 in the information processing apparatus 100A, and displays the resultant on the display apparatus 200B.

[0121] In such a case, if the image quality of video taken by the camera 106 in the information processing apparatus 100A is low or the size of a letter on a card C placed on the mat 10A is small, there is a problem in that the card C on the mat 10A displayed on the display apparatus 200B is difficult to see, and it is difficult for the player 2 to grasp the situation of the game.

[0122] Furthermore, in some TCGs, information (sometimes referred to as "text") on a card C of an opponent needs to be checked, but there is a problem in that it is difficult in an online battle to check information on a card C with an eye even if the card is taken by the camera 106, and a player needs to investigate information on the card C by him / herself.

[0123] By using the present technology, a card C of the player 1 can be identified by the information processing apparatus 100A, and a result of the identification can be transmitted to the information processing apparatus 100B on the player 2 side, so that information on the card C of the player 1 can be displayed on the display apparatus 200B. On the other hand, a card C of the player 2 can be identified by the information processing apparatus 100B, and a result of the identification can be transmitted to the information processing apparatus 100A on the player 1 side, so that information on the card C of the player 2 can be displayed on the display apparatus 200A. In this manner, even in an online TCG, players can easily check information on cards C of their respective opponents.

[0124] Note that online battle application may be configured to operate on a server and the information processing apparatus 100A and the information processing apparatus 100B may be configured to be connected to the server through the Internet.

[0125] Furthermore, in the case of distributing how to play a TCG by streaming service, output results of the information processing apparatus 100 can be used to create streaming video such that the TCG is played by a virtual talent such as a V Tuber and how the TCG is played can be distributed without using video in the real world taken by the camera 106. If video in the real world taken by the camera 106 is used for streaming, there is a risk that the face of a player erroneously appears in the streaming video, but this method can eliminate the risk.

[0126] Furthermore, by combining a display terminal to be worn by a player (such as glasses-type wearable device or head mount display) for AR (Augmented Reality) or MR (Mixed Reality) having a camera installed therein with the present technology, TCG application using AR or MR can be implemented.

[0127] Furthermore, a display terminal for AR or MR can be used together with the above-mentioned online TCG application. Furthermore, if the relative position of a player with respect to the mat 10 is known, a virtual opponent can be made stand on the opposite side of the player across the mat 10.

[0128] A display terminal to be worn by a player, such as a glasses-type wearable device or a head mount display, may be provided with the functions of the information processing apparatus 100 in advance.

[0129] According to the present technology, the level of entertainment of games can be extended to provide novel game experiments to players while keeping the advantages of analog games using real objects such as cards.

[0130] ＜Second Embodiment＞ (Configuration of Information Processing Apparatus 100) Next, a second embodiment of the present technology is described. First, a processing block of an information processing apparatus 100 in the second embodiment is described with reference to Fig. 16. Note that the configurations of the TCG and the TCG system 1000 are the same as in the first embodiment.

[0131] The information processing apparatus 100 in the second embodiment is different from the first embodiment in including a motion determination unit 160, a foreign object determination unit 161, and a hand detection unit 162.

[0132] The motion determination unit 160 determines whether the information processing apparatus 100 is moving on the basis of sensing data supplied from the IMU 107. The motion determination unit 160 determines that the information processing apparatus 100 is moving, for example, when the value of acceleration as sensing data from the IMU 107 exceeds a predetermined threshold. Examples of the case where the information processing apparatus 100 is moving include a case where a player is carrying the information processing apparatus 100 with a hand and a case where a player is moving a stand supporting the information processing apparatus 100.

[0133] The foreign object determination unit 161 generates a three-dimensional point group of a foreign object from depth information supplied from the distance sensor 108, and measures whether the three-dimensional point group is included in a space between the mat 10 and the camera 106 (predetermined distance (for example, several cm above) of mat 10), thereby determining whether there is a foreign object. Foreign objects may be any object such as a box and a cup in addition to a part of the body of a player such as a hand.

[0134] Note that it may be determined that a foreign object is present at a time point at which a three-dimensional point group of the foreign object is detected in a space between the mat 10 and the camera 106, or it may be determined that a foreign object is present when a detection amount of the three-dimensional point group in the space is equal to or more than a predetermined threshold.

[0135] A foreign object is three-dimensionally detected by using depth information as described above, and hence a foreign object present in a space between the mat 10 and the camera 106 can be detected. Furthermore, by using depth information, various objects without being limited to a particular type of object can be detected as foreign objects.

[0136] The hand detection unit 162 detects, on the basis of one or both of depth information and a frame image configuring video taken by the camera 106, information on a hand present in a space between the mat 10 and the camera 106, such as the position of the hand, the shape of the hand, and the number of hands. The detection of information on the hand can be performed by a method by machine learning or deep learning, a method by template matching, a matching method based on luminance distribution information on a subject, or a method using artificial intelligence.

[0137] The information processing apparatus 100 in the second embodiment is configured as described above. The other processing block and hardware configuration of the information processing apparatus 100 are the same as in the first embodiment.

[0138] (Processing in Information Processing Apparatus 100) Next, processing in the information processing apparatus 100 in the second embodiment is described. Note that processing for identifying the type of a card C and processing for detecting an information object P are the same as in the first embodiment.

[0139] First, processing based on a determination result of the motion determination unit 160 is described with reference to Fig. 17.

[0140] At Step S21, the information processing apparatus 100 executes processing for identifying the type of a card C.

[0141] Next, at Step S22, the motion determination unit 160 determines whether the information processing apparatus 100 is moving. When the information processing apparatus 100 is not moving, the processing proceeds to Step S21 (No at Step S22), and the card identification unit 154 continues the identification processing of the card C. In this manner, the card identification unit 154 continues the identification processing unless the motion determination unit 160 determines that the information processing apparatus 100 is moving.

[0142] On the other hand, when the motion determination unit 160 determines that the information processing apparatus 100 is moving, the motion determination unit 160 notifies the card identification unit 154 of the fact, and the processing proceeds to Step S23 (Yes at Step S22).

[0143] Next, at Step S23, the card identification unit 154 stops the identification processing of the card C.

[0144] Next, at Step S24, when the motion determination unit 160 determines that the information processing apparatus 100 is moving, the motion determination unit 160 notifies the card identification unit 154 of the fact, and the processing proceeds to Step S23 (Yes at Step S24). Then, at Step S23, the card identification unit 154 continues stopping the identification processing of the card C.

[0145] On the other hand, when the motion determination unit 160 determines that the information processing apparatus 100 is not moving, the motion determination unit 160 notifies the card identification unit 154 of the fact, and the processing proceeds to Step S21 (No at Step S24). Then, at Step S21, the card identification unit 154 executes the identification processing of the card C, that is, restarts the identification processing of the card C that has been stopped.

[0146] In this manner, in the second embodiment, identification processing on a card C is performed when the information processing apparatus 100 is not moving, and identification processing of a card C is stopped when the information processing apparatus 100 is moving. In this manner, identification processing on a card C is executed only in the state in which the information processing apparatus 100 is not in motion and video with no blur can be taken, and hence identification accuracy can be enhanced.

[0147] Next, processing based on a determination result of the foreign object determination unit 161 is described with reference to Fig. 18.

[0148] First, at Step S31, the information processing apparatus 100 executes processing for identifying the type of a card C.

[0149] Next, at Step S32, the foreign object determination unit 161 determines whether a foreign object is present in a space between the mat 10 and the camera 106. When there is no foreign object, the processing proceeds to Step 31 (No at Step S32), and the card identification unit 154 continues identification processing of the card C. In this manner, the card identification unit 154 continues identification processing unless the foreign object determination unit 161 determines that a foreign object is present.

[0150] On the other hand, when the foreign object determination unit 161 determines that a foreign object is present, the foreign object determination unit 161 notifies the card identification unit 154 of the fact, and the processing proceeds to Step S33 (Yes at Step S32).

[0151] Next, at Step S33, the card identification unit 154 stops identification processing of the card C.

[0152] Next, at Step S34, when the hand detection unit 162 detects a hand present in the space between the mat 10 and the camera 106, the processing proceeds to Step S35 (Yes at Step S34).

[0153] Then, at Step S35, the hand detection unit 162 outputs detection information, such as the position of the hand, the shape of the hand, and the number of hands, to the outside.

[0154] On the other hand, at Step S34, when the hand detection unit 162 does not detect a hand in the space between the mat 10 and the camera 106, the processing proceeds to Step S36 (No at Step S34).

[0155] Next, at Step S36, the foreign object determination unit 161 determines whether a foreign object is present in the space between the mat 10 and the camera 106. When a foreign object is present, the processing proceeds to Step S33 (Yes at Step S36), and the card identification unit 154 continues stopping the identification processing.

[0156] On the other hand, when the foreign object determination unit 161 determines that there is no foreign object, the foreign object determination unit 161 notifies the card identification unit 154 of the fact, and the processing proceeds to Step S31 (No at Step S36). Then, at Step S31, the card identification unit 154 executes identification processing of the card, that is, restarts the identification processing of the card that has been stopped.

[0157] In this manner, in the second embodiment, identification processing of a card C is performed when no foreign object is present in a space between the mat 10 and the camera 106, and the identification processing is stopped when a foreign object is present. Accordingly, a foreign object can be prevented from being photographed by the camera 106 to decrease identification accuracy of a card C or to prevent erroneous identification.

[0158] Furthermore, when a foreign object is present, the hand detection unit 162 performs processing for detecting a hand. TCG application can execute various kinds of processing by using detection information output from the hand detection unit 162. For example, by using the pointing of a finger of a player as UI (User Interface), the TCG can be progressed or particular processing can be executed in the TCG application.

[0159] Furthermore, in the case where a player extends his / her particular finger (for example, index finger) of the hand and the finger points a card C that can be specified by position information, the TCG application can execute effects and the like indicated by the card C on the TCG and reflect the effects and the like to the progress of the game. Furthermore, the finger may designate another card C to be influenced by the effects and the like of the card C.

[0160] Furthermore, in the case where a player extends his / her particular finger of the hand and the finger points a card C that can be specified by position information, the TCG application can display video or output voice corresponding to effects and the like indicated by the card C pointed by the finger.

[0161] Furthermore, options for a card C indicated by the finger of a player are displayed on the display apparatus 200 such that the player can select the options. The selection of the options by the player may be performed by detection of the finger.

[0162] Furthermore, instructions to TCG application may be performed by particular motion or shape of a hand or a finger. Examples of the instructions include the finish of his / her own turn and surrender (determination of winning or losing of game). The turn is a unit of game progress in a game in which a plurality of players participate, and the turn comes to each player in a fixed order.

[0163] ＜Modifications＞ While the embodiments of the present technology have been specifically described above, the present technology is not limited to the above-mentioned embodiments, and can be variously modified on the basis of the technical concept of the present technology.

[0164] In the embodiments described above, the cards C include cards indicating information such as postures, names, skills, features, and physical strengths of characters (such as humans, animals, monsters, robots, and vehicles) and cards indicating parameters necessary for characters indicated by cards C to use skills, but the card C may be a card that represents another element, such as equipment or an item. The card C may be any card that indicates information on a TCG.

[0165] In the present embodiment, as an example, a card stacked under a card C is a card that gives a special effect and the like to another card C. However, the card C stacked downward is not limited thereto, and may be any card such as a card indicating another information.

[0166] Furthermore, a card C indicating a character may be stacked on a card C indicating a character. In this case, the second card identification unit 156 identifies the type of a card on the basis of a feature of an exposed part of the card C placed at the bottom. To implement this, the second card identification unit 156 needs to learn all cards C indicating characters in advance.

[0167] In the embodiments described above, there is a rule that when cards C are stacked, a card C can be given particular effects and the like, but the present technology can be used in other rules. Examples of the rules include a rule that when a card indicating a change is placed under a card C of a character, the character is changed and a rule that when a card indicating an item is placed under a card of a character, the item can be used for the character.

[0168] The design of the cards C illustrated in Fig. 3 is merely an example, and may be any design as long as identification information is rendered as large as possible so as to be easily recognized. For example, as illustrated in Fig. 19A and Fig. 19B, identification information may be larger than that in Fig. 3, or as illustrated in Fig. 19C, identification information may be rendered at the upper center of a card C.

[0169] Information on a TCG indicated by an information object P may be, in addition to a numerical value indicating effects and the like given to a card C, any information used in the TCG, such as a numerical value, a letter, a picture, and a mark indicating the state of the card C. Furthermore, the information object P may indicate effects and the like given to the card C by any one of a letter, a picture, a mark, a color, and a pattern or a combination thereof other than the numerical value.

[0170] A TCG is not necessarily required to use an information object P. When no information object P is used, the object detection unit 158 and the total calculation unit 159 are necessary. Thus, the object detection unit 158 and the total calculation unit 159 are not essential configuration in the present technology.

[0171] The present technology is applicable to card games other than a TCG, such as playing cards, flower cards, karuta, and UNO. In such cases, the types of cards used for the card games need to be learned by the card identification unit 154 in advance. Thus, the present technology is applicable to games in which playing cards with pictures are stacked and arranged. Furthermore, the present technology is applicable to games in which a plurality of playing cards are used, such as poker. In this case, an information object P may be a coin indicating bet money. In the case of games using playing cards, every card may be placed under another card, and hence the second card identification unit 156 needs to all cards in advance.

[0172] Furthermore, the present technology can be applied to games other than card games, for example, board games and table games such as Mahjong. In this case, the types of pieces, cards, items, and the tiles used in the games need to be learned by the card identification unit 154 in advance.

[0173] The present technology can employ the following configurations. (1) A program for causing a computer to execute an information processing method including: detecting a position of a card in an image that is obtained by photographing a range in which game cards are to be disposed by a camera; generating a cropped image by cropping a region of the card from the image on the basis of the position of the card; and acquiring a situation of the game on the basis of the cropped image. (2) The program according to (1), in which the situation of the game is a type of the card. (3) The program according to (2), in which the type of the card in the cropped image is identified by first identification processing and second identification processing. (4) The program according to (3), in which the first identification processing includes identifying types of cards in all the cropped images. (5) The program according to (3) or (4), in which the second identification processing includes identifying a type of the card in the cropped image for which the first identification processing has failed to identify the type of the card. (6) The program according to (5), in which: the card of which the type has failed to be identified is a card placed under another card; and the second identification processing comprises identifying the type of the card on the basis of identification information in an exposed range of the card placed under the other card. (7) The program according to any one of (2) to (6), in which an output result in a latest image is generated on the basis of an identification result of the type of the card in the latest image and an output result in a past image. (8) The program according to any one of (1) to (7), in which the situation of the game is a number of the cards. (9) The program according to any one of (1) to (8), in which the situation of the game is a type of an object indicating information on the game. (10) The program according to (9), in which processing for detecting an object indicating information on the game is performed on the cropped image for which the type of the card has been identified by the first identification processing. (11) The program according to (10), in which the information on the game is a numerical value in the game. (12) The program according to (11), in which a total of the numerical values indicated by all the objects detected in the same cropped image is calculated. (13) The program according to any one of (1) to (12), in which keystone correction is performed on the image before the position of the card is detected. (14) The program according to any one of (1) to (13), in which processing is stopped when motion of the camera is detected. (15) The program according to any one of (1) to (14), in which processing is stopped when a foreign object present in a space between a surface on which the card is placed and the camera is detected. (16) The program according to (15), in which, when the foreign object is a hand, detection information on the hand is output to outside. (17) An information processing method, including: detecting a position of a card in an image that is obtained by photographing a range in which game cards are to be disposed by a camera; generating a cropped image by cropping a region of the card from the image on the basis of the position of the card; and acquiring a situation of the game on the basis of the cropped image. (18) An information processing apparatus, including: a card position detection unit configured to detect a position of a card in an image that is obtained by photographing a range in which game cards are to be disposed by a camera; a crop unit configured to generate a cropped image by cropping a region of the card from the image on the basis of the position of the card; and a situation acquisition unit configured to acquire a situation of the game on the basis of the cropped image.

[0174] 106 Camera 100 Information processing apparatus 152 Card position detection unit 153 Crop unit 154 Card identification unit 158 Object detection unit

Claims

1. A program for causing a computer to execute an information processing method comprising: detecting a position of a card in an image that is obtained by photographing a range in which game cards are to be disposed by a camera; generating a cropped image by cropping a region of the card from the image on the basis of the position of the card; and acquiring a situation of the game on the basis of the cropped image.

2. The program according to claim 1, wherein the situation of the game is a type of the card.

3. The program according to claim 2, wherein the type of the card in the cropped image is identified by first identification processing and second identification processing.

4. The program according to claim 3, wherein the first identification processing comprises identifying types of cards in all the cropped images.

5. The program according to claim 3, wherein the second identification processing comprises identifying a type of the card in the cropped image for which the first identification processing has failed to identify the type of the card.

6. The program according to claim 3, wherein: the card of which the type has failed to be identified is a card placed under another card; and the second identification processing comprises identifying the type of the card on the basis of identification information in an exposed range of the card placed under the other card.

7. The program according to claim 2, wherein an output result in a latest image is generated on the basis of an identification result of the type of the card in the latest image and an output result in a past image.

8. The program according to claim 1, wherein the situation of the game is a number of the cards.

9. The program according to claim 1, wherein the situation of the game is a type of an object indicating information on the game.

10. The program according to claim 9, wherein processing for detecting an object indicating information on the game is performed on the cropped image for which the type of the card has been identified by the first identification processing.

11. The program according to claim 10, wherein the information on the game is a numerical value in the game.

12. The program according to claim 11, wherein a total of the numerical values indicated by all the objects detected in the same cropped image is calculated.

13. The program according to claim 1, wherein keystone correction is performed on the image before the position of the card is detected.

14. The program according to claim 1, wherein processing is stopped when motion of the camera is detected.

15. The program according to claim 1, wherein processing is stopped when a foreign object present in a space between a surface on which the card is placed and the camera is detected.

16. The program according to claim 15, wherein, when the foreign object is a hand, detection information on the hand is output to outside.

17. An information processing method, comprising: detecting a position of a card in an image that is obtained by photographing a range in which game cards are to be disposed by a camera; generating a cropped image by cropping a region of the card from the image on the basis of the position of the card; and acquiring a situation of the game on the basis of the cropped image.

18. An information processing apparatus, comprising: a card position detection unit configured to detect a position of a card in an image that is obtained by photographing a range in which game cards are to be disposed by a camera; a crop unit configured to generate a cropped image by cropping a region of the card from the image on the basis of the position of the card; and a situation acquisition unit configured to acquire a situation of the game on the basis of the cropped image.

Images