Game systems and toy sets

Abstract

To give high amusement to an easy-to-play toy.SOLUTION: As for a portable terminal device 1 having a display part 14 and an imaging part 15, an object 91 of a computer game 90 is displayed on the display part 14, and a marker 221 stuck on a toy 2 grasped and moved by a user is read as needed through the fixed and arranged imaging part 15, and processing for executing processing related to the computer game 90 is executed based on the read and moved marker 221 and on the object 91.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a program, a toy and a toy set. [Background technology]

[0002] Conventionally, a game device has been known in which the user operates the aim on the display based on the positional relationship between a camera attached to a simulated gun that the user holds and moves, and a marker fixedly positioned on the display side in front of the user, which is imaged by the camera (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 3626711 Summary of the Invention [Problem to be solved by the invention]

[0004] The game device described in Patent Document 1 allows a user to simulate the experience of a game by holding and manipulating a simulated gun, and has a high level of playability. However, the game device described in Patent Document 1 is limited to users who can hold and freely operate a simulated gun that has the weight of a camera or the like, and is not easy for infants and children to play with.

[0005] Furthermore, the game device described in Patent Document 1 is a stationary type, so players must go to the installation location each time they want to play, making it difficult to play casually. In particular, infants and children prefer to play with their guardians, so if their guardians are busy, they cannot play casually.

[0006] Small toys such as models, dolls, and blocks for infants and children can be played with intuitively and easily, but due to their simple structure, they are not very playful.

[0007] The present invention has been made in view of the above points, and its object is to provide a program or the like that can give a high level of playability to a toy that is played casually. [Means for solving the problem]

[0008] In one aspect of the present invention, a portable terminal device having a display unit and an imaging unit displays computer game objects on the display unit, reads markers attached to a toy that a user holds and moves at any time through the fixedly positioned imaging unit, and executes a process for executing processing related to the computer game based on the markers that are read and moved and the objects. [Effects of the Invention]

[0009] According to one aspect of the present invention, a toy that is easy to play with can be given high playability. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a schematic diagram showing a configuration of a toy system according to an embodiment; [Figure 2] 1 is a block diagram showing a configuration of a mobile terminal device according to an embodiment; [Figure 3] FIG. 2 is a block diagram showing a configuration of a server according to the embodiment. [Figure 4] FIG. 2 is a conceptual diagram illustrating processing related to a program according to an embodiment. [Figure 5] FIG. 2 is a conceptual diagram illustrating processing related to a program according to an embodiment. [Figure 6] FIG. 10 is a conceptual diagram illustrating a process related to a shooting game. [Figure 7] FIG. 10 is a conceptual diagram illustrating a process related to a shooting game. [Figure 8] 10 is a flowchart showing a processing procedure of a program according to an embodiment. [Figure 9] FIG. 10 is a conceptual diagram illustrating processing related to a spaceship operation game. [Figure 10] 10 is a flowchart showing the procedure of processing of a program according to the second embodiment. [Figure 11] FIG. 10 is a conceptual diagram illustrating a process related to a calculation game. [Figure 12] 11 is a flowchart showing the procedure of processing of a program according to the third embodiment. [Figure 13] FIG. 10 is a conceptual diagram illustrating the processing of a program according to a fourth embodiment. [Figure 14] 10 is a flowchart showing the procedure of processing of a program according to the fourth embodiment. [Figure 15] FIG. 13 is a conceptual diagram illustrating the processing of a program according to the fifth embodiment. [Figure 16] 13 is a flowchart showing the procedure of processing of a program according to the fifth embodiment. [Figure 17] 10 is a flowchart showing the procedure of processing of a subroutine relating to a first state. [Figure 18] 10 is a flowchart showing the procedure of processing of a subroutine relating to a second state. DETAILED DESCRIPTION OF THE INVENTION

[0011] Embodiment 1 A toy system according to an embodiment will be described in detail below with reference to the drawings showing the embodiment. Fig. 1 is a schematic diagram showing the configuration of a toy system 100 according to the embodiment. The toy system 100 includes a mobile terminal device 1, a toy 2, and a server computer 3 (hereinafter referred to as "server 3").

[0012] The mobile terminal device 1 and the server 3 are communicatively connected via a network NW such as the Internet. Although one mobile terminal device 1 is shown in the drawing, the present invention is not limited to this.

[0013] For example, there may be provided a plurality of mobile terminal devices 1. In such a case, the plurality of mobile terminal devices 1 may be communicatively connected to one another via a network NW.

[0014] In the toy system 100, the server 3 reads out a game program and transmits it to the mobile terminal device 1. The mobile terminal device 1 starts the game program or the like via the web browser 141 or application software.

[0015] The mobile terminal device 1 displays an object 91 of the game program on the display unit 14 of the mobile terminal device 1. The mobile terminal device 1 reads, as needed, a marker 221 attached to the toy 2 that the user holds and moves, through the imaging unit 15 of the fixedly placed mobile terminal device 1.

[0016] The mobile terminal device 1 executes processing related to the game program based on the coordinates of the marker 221 that is read and moves.

[0017] As a result, in the toy system 100, when the user grips and operates the toy 2, the coordinates corresponding to the marker 221 move, and the user can operate the object 91 of the computer game 90 in accordance with the movement of the marker 221, thereby providing a simulated experience of the game space. The toy system 100 provides the toy 2 with a high level of playability.

[0018] The configuration of the toy 2 in the drawing will be described. In this embodiment, the toy 2 is a toy that is held and moved by a user, and has a marker 221 attached thereto. The toy 2 is a small toy manufactured by resin molding, for example.

[0019] The toy 2 is, for example, a toy for infants and children, and is a general-purpose toy distributed as a prize or promotional item, such as a toy gun, a toy spaceship model, a toy doll, or a toy racket. The toy 2 is not limited to these, and may be a specialized toy.

[0020] The toy 2 comprises a main body 20, a grip part 21, and a marker 221. The main body 20 has a weight and size that allows it to be held and moved by infants and children. The grip part 21 is provided on the main body 20 and has a shape that makes it easy for infants and children to hold. The grip part 21 makes it easy to move the toy 2 when held, but parts other than the grip part 21 may also be held.

[0021] The marker 221 is attached to the muzzle of a toy gun, for example, and when read by the imaging unit 15 of the mobile terminal device 1, it triggers the effects of the computer game 90, etc.

[0022] The marker 221 has a design for the presentation of the computer game 90. The design refers to optically recognizable communication means such as figures, letters, and symbols. The marker 221 is not limited to being made of paper or resin, and may be made of any material that can be read by a device.

[0023] In the figure, an example in which the marker 221 is attached to the main body 20 is shown, but this is not limiting and the marker 221 may be printed or engraved on the main body 20. In the figure, an example in which the marker 221 is attached to the main body 20 is shown, but in consideration of damage or loss of the marker 221, a spare marker 221 may be attached to the packaging container of the toy 2 or to a sheet of paper enclosed therewith. Other forms of the marker 221 will be described later.

[0024] 2 is a block diagram showing the configuration of a mobile terminal device 1 according to an embodiment. The mobile terminal device 1 is a portable smartphone, a tablet terminal, a smartwatch terminal, a wearable terminal, or any other computer.

[0025] The mobile terminal device 1 includes a control unit 10, a main memory unit 11, a ROM (Read Only Memory) 12, a wireless communication unit 13, a display unit 14, an imaging unit 15, an operation unit 16, a microphone 17, and a speaker 18.

[0026] The control unit 10 includes an arithmetic processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), a timer, etc. The control unit 10 executes various control processes, information processes, etc. in accordance with instructions from a control program P1 stored in a ROM 12 and a web browser 141, etc.

[0027] The main memory unit 11 is a temporary storage area such as a static random access memory (SRAM) or a dynamic random access memory (DRAM), and temporarily stores data generated when the control unit 10 executes processing.

[0028] The ROM 12 is a non-volatile storage area and built-in storage that stores the control program P1, the web browser 141, other application software, and various data. The ROM 12 is not limited to this, and may be an external semiconductor memory (not shown) that can be read by the mobile terminal device 1.

[0029] The web browser 141 is application software for rendering a scene including an object 91 of a computer game 90 of a game program.

[0030] The control program P1 is a program for controlling the display unit 14, the imaging unit 15, and various other controls. The various data includes the unique ID of the mobile terminal device 1, information about the user and owner, and the like.

[0031] For example, the mobile terminal device 1 starts a game program or the like received from the server 3, expands it in the main memory unit 11, and executes processing related to the game program or the like by running a Java applet or the like on the web browser 141.

[0032] The wireless communication unit 13 is a communication module for executing processes related to wireless communication, and includes a voice communication unit 131 for voice calls and a data communication unit 132 for sending and receiving data.

[0033] The voice communication unit 131 establishes a call connection with another mobile terminal device 1 through a voice communication line VN. The data communication unit 132 establishes a communication connection with the outside including the server 3 through the network NW.

[0034] The wireless communication unit 13 may include a short-range wireless communication unit 133. The short-range wireless communication unit 133 performs wireless communication using, for example, NFC (Near Field Communication) and reads and writes data to and from an NFC tag with a built-in IC chip. Alternatively, wireless communication may be performed using Wi-Fi (registered trademark) or Bluetooth (registered trademark).

[0035] The display unit 14 is a liquid crystal display, an organic EL (Electro Luminescence) display, or the like, and sequentially displays a plurality of scenes including an object 91 of the computer game 90. The display unit 14 dynamically displays the presentation of the object 91 of the computer game 90 by sequentially displaying a plurality of different scenes.

[0036] The imaging unit 15 is a small camera equipped with an imaging element such as a CMOS (Complementary MOS) sensor and captures images. The imaging unit 15 sends the captured images to the control unit 10. The imaging unit 15 is, for example, built into the main body of the mobile terminal device 1. However, the imaging unit 15 is not limited to this and may be externally attached.

[0037] In this embodiment, the imaging unit 15 is fixedly disposed and reads the marker 221 attached to the movable toy 2. For example, the imaging unit 15 is fixedly disposed when the mobile terminal device 1 is held by the user and held still in the air, and the fixedly disposed imaging unit 15 reads the marker 221 attached to the movable toy 2.

[0038] For example, when the mobile terminal device 1 is laid on a desk with the display unit 14 facing upward, the imaging unit 15 is fixedly arranged, and the fixedly arranged imaging unit 15 reads the marker 221 attached to the movable toy 2.

[0039] For example, the mobile terminal device 1 is placed against a wall or a stand, so that the imaging unit 15 is fixedly disposed, and the fixedly disposed imaging unit 15 reads the marker 221 attached to the movable toy 2.

[0040] The imaging unit 15, while fixedly positioned, reads the moving marker 221. The mobile terminal device 1 detects the position or movement of the marker 221 through the reading of the marker 221 by the imaging unit 15. However, the mobile terminal device 1 is not limited to this, and may also detect the attitude of the marker 221, including the tilt thereof, or the distance to the marker 221.

[0041] Although the drawing shows an example in which the imaging unit 15 is composed of one camera, the present invention is not limited to this and multiple cameras may be provided. The imaging unit 15 may also include an infrared sensor, a ToF (Time Of Flight) sensor, a LiDAR (Light Detection And Ranging) sensor, or the like to improve distance measurement.

[0042] The imaging unit 15 includes, for example, an in-camera 151 arranged on the display unit 14 side of the mobile terminal device 1, and an out-camera 152 arranged on the opposite side of the in-camera 151. The in-camera 151 is used for taking selfies, video calls, etc. While the drawing shows an example in which the in-camera 151 reads the marker 221 of the toy 2, this is not limiting, and the out-camera 152 may also read the marker 221 of the toy 2.

[0043] The operation unit 16 is an input interface for receiving operations from the owner of the mobile terminal device 1 or the user of the toy 2 and sending them to the control unit 10. The operation unit 16 is, for example, a touch panel integrated with the display unit 14, and receives operations via a displayed soft keyboard, cursor, etc.

[0044] The operation unit 16 is not limited to this, and may include a mechanical keyboard and a pointing device. The microphone 17 receives voices for calls and operations of the computer game 90 and sends them to the control unit 10.

[0045] The speaker 18 outputs sounds for calls and computer games 90. The mobile terminal device 1 may include a GPS (Global Positioning System) unit, a biometric authentication sensor, and other units.

[0046] 3 is a block diagram showing the configuration of the server 3 according to the embodiment. The server 3 causes the mobile terminal device 1 to execute processes related to each of the game programs 321 of multiple titles and processes related to the program according to the embodiment.

[0047] The server 3 is a server computer or a personal computer, and may be a cloud computer. In this embodiment, the server 3 is an example of a cloud server that provides an ASP (Application Service Provider) service.

[0048] The mobile terminal device 1 displays the effects of the computer game 90 based on the game program 321 etc. received from the server 3 via the web browser 141 etc. Although the figure shows an example in which one server 3 executes the processing, the present invention is not limited to this, and the processing may be executed in a distributed manner by a plurality of servers 3.

[0049] The server 3 includes a control unit 30, a main memory unit 31, an auxiliary memory unit 32, and a communication unit 33. The control unit 30 includes an arithmetic processing device such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a GPU (Graphics Processing Unit), a timer, etc., and executes various information processing or control processing, etc., in accordance with instructions from a control program P2, a game program 321, and a program according to the embodiment, which are stored in the auxiliary memory unit 32.

[0050] The main memory unit 31 is a temporary storage area such as a static random access memory (SRAM), a dynamic random access memory (DRAM), or a flash memory, and temporarily stores data generated when the control unit 30 executes processing.

[0051] The auxiliary storage unit 32 is a non-volatile storage area such as a hard disk or SSD (Solid State Drive), and stores the control program P2, the game program 321, programs according to the embodiment, and various data.

[0052] The game program 321 includes, for example, game scene data 322, game object data 323, texture data 324, effect data 325, sound data 326, and various components 327. These will be described in detail later.

[0053] The control program P2, the game program 321, the programs related to the embodiments, and various data may be recorded on a portable recording medium M1 or a semiconductor memory M2, read out by a reading unit, and stored in the auxiliary storage unit 32. Alternatively, these may be downloaded from an external device connected for communication via the network NW and stored in the auxiliary storage unit 32.

[0054] The communication unit 33 is a communication module for executing a process of establishing a communication connection with the outside, including the mobile terminal device 1, via the network NW. The server 3 may include a display unit, an operation unit, and a reading unit (not shown).

[0055] The server 3 having the above configuration mainly causes the mobile terminal device 1 to execute processing related to the program according to the embodiment and processing related to the computer game 90. Figures 4 and 5 are conceptual diagrams illustrating processing related to the program according to the embodiment.

[0056] 4A illustrates an example in which a request is made by transmitting a signal based on a touch operation on the operation unit 16 of the mobile terminal device 1 to the server 3. The server 3 reads out the game program 321 and the like from the auxiliary storage unit 32 in response to the request from the mobile terminal device 1.

[0057] FIG. 4B illustrates an example in which the server 3 reads out the requested game program 321 in response to a request for one of a plurality of game program titles 321.

[0058] However, the server 3 is not limited to this, and may read a portal site for multiple game programs 321 in response to a request from the mobile terminal device 1, and read the game program 321 selected through the portal site.

[0059] The server 3 transmits the read game program 321 etc. to the mobile terminal device 1. The mobile terminal device 1 starts the game program 321 etc. received via the web browser 141 etc., and, in accordance with the instructions of the started game program 321 etc., matches the world coordinate system C1 of the game program 321 with the screen coordinate system C2 of the display unit 14 of the mobile terminal device 1 and the marker coordinate system C3 of the marker 221, as shown in Fig. 4C .

[0060] FIG. 4C shows an example of matching two-dimensional coordinate systems, but the present invention is not limited to this, and three-dimensional coordinate systems may also be matched.

[0061] 4C, the mobile terminal device 1 aligns the origin O of the coordinate systems while capturing an image of the marker 221 with the imaging unit 15. Next, when moving from the origin O to a predetermined destination position P, the mobile terminal device 1 performs preprocessing such as enlarging, reducing, moving, and rotating each of these coordinate systems to match the coordinates of the destination position P in one coordinate system and the coordinates of the destination position P in another coordinate system so that they are the same.

[0062] The marker coordinate system C3 indicates the coordinates of the position of the marker 221 when the image captured by the imaging unit 15 is taken as a whole. The position of the marker 221 is detected based on pixel features of the captured image. The world coordinate system C1 indicates the coordinates of the position of the object 91 when the scene 92 of the computer game 90 is taken as a whole.

[0063] The position of the object 91 is detected based on pixel features of the displayed image of the scene 92. The screen coordinate system C2 is superimposed on the screen of the display unit 14 and indicates the coordinates of the positions of the marker 221 and the object 91 when the screen of the display unit 14 is taken as the entire screen.

[0064] By the above-described matching, the marker 221 moves in the same state in the marker coordinate system C3 and the screen coordinate system C2.

[0065] The mobile terminal device 1 executes various information processes and the like in accordance with the commands of the game program 321. The game program 321 generates a scene 92 of the computer game 90 based on game scene data 322.

[0066] The game program 321 generates a scene 92 in which one or more objects 91 are arranged based on game object data 323. The game program 321 attaches various components 327 to the object 91, thereby imparting, for example, textures represented by texture data 324 and effects represented by effect data 325 to the object 91.

[0067] The texture gives the object 91 the feel of, for example, paper, wood, or metal. The effects give the object 91 a wide variety of effects, such as a bullet impact effect, a target tilting effect, a moving object being guided effect, objects colliding with each other effect, a fire effect, smoke being emitted effect, an object exploding effect, numbers protruding effect, a fishing hook being thrown effect, and the like.

[0068] By attaching various components 327 to the object 91, other properties, functions, or physical behaviors may be imparted to the object 91. This enriches the presentation of the object 91 and improves playability. For example, sounds from sound data 326 may be imparted to the object 91. This imparts sound effects to the object 91, improving playability.

[0069] The mobile terminal device 1 displays a scene 92 including an object 91 of a computer game 90 on the display unit 14 based on the matched screen coordinate system C2 and world coordinate system C1.

[0070] The mobile terminal device 1 displays the rendering of an object 91 of a computer game 90 that changes by sequentially drawing each of a plurality of scenes 92 on the web browser 141. The user can render the object 91 in the virtual space of the computer game 90 by moving the marker 221 of the toy 2 that exists in real space, thereby achieving a sense of realism.

[0071] The mobile terminal device 1 reads the marker 221 of the toy 2 held by the user through the imaging unit 15 that is fixedly arranged.

[0072] Based on the data of the read marker 221, the mobile terminal device 1 specifies the position of the marker 221 in the matching marker coordinate system C3 and screen coordinate system C2.

[0073] The mobile terminal device 1 generates a scene 92 in which an icon indicating the position of the specified marker 221 is arranged, and displays the scene 92 including the generated icon on the display unit 14.

[0074] Thereafter, the mobile terminal device 1 detects the relationship between the position of the marker 221 specified in the matched marker coordinate system C3 and the screen coordinate system C2 and the position of the object 91 specified in the screen coordinate system C2 and the world coordinate system C1, and executes processing related to the computer game 90 according to the detection results.

[0075] Next, a description will be given of processing related to the computer game 90. Since the computer game 90 has a plurality of different contents, the processing related to the computer game 90 will be described below using a shooting game as an example. Figures 6 and 7 are conceptual diagrams for explaining processing related to the shooting game.

[0076] The mobile terminal device 1 generates a scene 92 including a target ta (object 91) in accordance with commands in a shooting game (computer game 90), and displays the generated scene 92 on the display unit .

[0077] The figure shows an example of displaying a scene 92 in which targets ta resembling beverage cans are arranged in a horizontal row. The targets ta are not limited to a shape resembling a beverage can, and may have other shapes. The mobile terminal device 1 reads the moving markers 221 as needed using the fixedly disposed imaging unit 15.

[0078] In the figure, the toy 2 is a toy gun, and an example is shown in which the marker 221 is affixed to the muzzle of the body 20 of the toy gun. Based on the data of the read marker 221, the mobile terminal device 1 performs a hit determination to determine whether or not the position of the marker 221 specified in the matched marker coordinate system C3 and the screen coordinate system C2, i.e., the aim of the toy gun, matches the position of the target ta specified in the screen coordinate system C2 and the world coordinate system C1.

[0079] The mobile terminal device 1 executes a hit determination based on the game program 321. In the drawing, the hit determination is made based on whether or not the coordinates of the icon i representing the marker 221 match any of the coordinates within the rectangular area representing the target ta.

[0080] The hit detection is not limited to this, but includes multiple types of hit detection such as the coincidence of a point with a point, the coincidence of a point with a line segment, the coincidence of a point with a circle, the coincidence of a circle with a circle, the coincidence of a rectangle with a rectangle, and the coincidence of a circle with a line segment, depending on the shape of the icon i or the target ta.

[0081] For example, a hit is determined to occur when the position of marker 221 exactly matches the position of object 91, but this is not limited to this, and a hit may also occur when the position of marker 221 matches any coordinate within a specified area centered on the position of object 91.

[0082] As a result, the game is operated with a lower level of difficulty depending on the dexterity of the infant or child. The criteria for whether or not these match are defined in the game program 321.

[0083] If it is determined that there is a match, the mobile terminal device 1 outputs an event (request signal) triggered (conditioned) by the match of positions. The mobile terminal device 1 executes processing related to the computer game 90 corresponding to the output event.

[0084] The association between the trigger and the event is defined in the game program 321. Based on the game program 321, the mobile terminal device 1 outputs the event corresponding to the trigger.

[0085] The figure shows an example in which the mobile terminal device 1 outputs an event in which the icon i is changed from a dot shape to a cross shape to notify the user that the target ta has been captured with the sights. The present embodiment is not limited to this, and other events in which the icon i changes may also be used, or an event in which the background changes instead of the icon i. Also, the icon i may not change even when the target ta is captured with the sights.

[0086] The mobile terminal device 1 uses a timer in the control unit 10 to measure the elapsed time from when it is determined that there is a match, and when the elapsed time reaches a predetermined time, this triggers an event that transitions the target ta from an upright position to a backward leaning position, as shown in Figure 7.

[0087] The mobile terminal device 1 generates a scene 92 including the target ta in a tilted state in accordance with the event, and displays the generated scene 92 on the display unit 14.

[0088] 7 shows an example of outputting an event in which the target ta transitions to a tilted state, but the present invention is not limited to this. For example, an event in which the target ta transitions to an explosion state or an event in which the target ta transitions to a rotation state may be output.

[0089] The mobile terminal device 1 repeats hit detection, and when all of the targets ta have transitioned to a tilted state, it triggers output of a game end event, and in accordance with the event, ends the running computer game 90. Prior to the end, the mobile terminal device 1 may display an end notice screen on the display unit 14 of the mobile terminal device 1.

[0090] Alternatively, a timer in the control unit 10 may be used to measure the time elapsed since the start of play, and when the elapsed time reaches a predetermined play time limit, this may be used as a trigger to output an event for ending the game.

[0091] The play time limit is set to, for example, 60 seconds from the start of play, thereby preventing infants or children from becoming absorbed in the game. The mobile terminal device 1 may resume the computer game 90 in response to reception of a touch operation on the operation unit 16.

[0092] When the number of times the computer game 90 has been played in one day reaches the play limit, the mobile terminal device 1 may use this as a trigger to output an event that denies resumption of the computer game 90.

[0093] The processing procedure of the program according to the embodiment will be described below with reference to the flowchart of FIG.

[0094] The control unit 10 of the mobile terminal device 1 reads the marker 221 of the toy 2 at any time through the fixedly arranged imaging unit 15 (step S101).

[0095] The control unit 10 specifies the position of the marker 221 in the marker coordinate system C3 and the screen coordinate system C2 based on the data of the read marker 221 (step S102). The control unit 10 displays an icon i on the display unit 14 based on the specified position of the marker 221.

[0096] The control unit 10 performs a collision determination to determine whether the position of the marker 221 specified in the marker coordinate system C3 and the screen coordinate system C2 coincides with the position of the object 91 specified in the screen coordinate system C2 and the world coordinate system C1 (step S103).

[0097] If the control unit 10 determines that there is no match (NO in step S103), it returns to step S101 and newly reads the marker 221. On the other hand, if the control unit 10 determines that there is a match (YES in step S103), it outputs an event triggered by the match between the position of the marker 221 and the position of the object 91, based on the game program 321 (step S104).

[0098] The control unit 10 changes the shape of the icon i from a dot to a cross shape based on the output event (step S105). The control unit 10 executes processing related to the computer game 90 corresponding to the output event (step S106), and ends the series of processing. Note that step S105, in which the shape of the icon i is changed from a dot to a cross shape, is an example, and the present invention is not limited to this.

[0099] In addition, in embodiment 1, an example is given in which a world coordinate system C1, etc. is matched and a collision detection is performed between the position of the marker 221 and the position of the object 91 through the matched world coordinate system C1, etc., but this is not limited to this.

[0100] The processing may be performed based on the positional relationship between the coordinates of the marker 221 on the display unit 14 and the coordinates of the object 91 on the display unit 14. For example, the control unit 10 acquires an image including the marker 221 via the imaging unit 15.

[0101] The control unit 10 determines whether the acquired marker 221 matches the marker 221 previously stored in the ROM 12. If the control unit 10 determines that they do not match, it determines that the marker 221 is a different computer game 90 that does not correspond to the marker 221, and ends the process.

[0102] On the other hand, if the control unit 10 determines that there is a match, it determines that the marker 221 corresponds to the computer game 90 being executed, and identifies the coordinates of the marker 221 on the display unit 14.

[0103] The control unit 10 determines whether the coordinates of the identified marker 221 are included in the coordinate area of ​​the object 91 on the display unit 14. If the control unit 10 determines that the coordinates are included, it performs a collision determination and executes an action such as tilting the object 91 on the display unit 14.

[0104] At this time, the control unit 10 superimposes an image of the icon i corresponding to the marker 221 on the object 91. On the other hand, if the control unit 10 determines that the object 91 is not included, it determines that there is no hit on the object 91 and continues the process of acquiring an image including the marker 221.

[0105] Note that the above description shows an example of specifying two-dimensional coordinates on the display unit 14, but the present invention is not limited to this. For example, three-dimensional coordinates of the marker 221 on the display unit 14 may be specified, and it may be determined that there is a hit if one of the three-dimensional coordinates (Z coordinate indicating the depth direction) is within a predetermined range set in advance, and the other two coordinates (Y coordinate indicating the up-down direction and X coordinate indicating the left-right direction) are included in the coordinate area of ​​the object 91.

[0106] In addition, although the first embodiment shows an example of a two-dimensional shooting game in which the targets ta are lined up in a row in the horizontal direction, the present invention is not limited to this. For example, a three-dimensional shooting game in which the targets ta are lined up in a row in the horizontal direction and in the depth direction may be used.

[0107] Specifically, a more advanced effect may be achieved by placing another target ta in the blind spot of one target ta, and by tilting the first target ta, the other target ta is exposed. In addition, although a shooting game is described as an example in the first embodiment, the present invention is not limited to this, and a computer game 90 other than a shooting game may also be used.

[0108] Embodiment 2 The second embodiment relates to the execution of processing related to a computer game 90 based on the tilt of a marker 221.

[0109] The following describes the differences from embodiment 1, taking a spaceship operation game as an example, and omits the parts common to embodiment 1. Figure 9 is a conceptual diagram for explaining the processing related to the spaceship operation game.

[0110] In the figure, the toy 2 is a spaceship model toy, and an example is shown in which the marker 221 is attached to the bottom surface of the body 20 of the spaceship model toy. Also shown is an example in which the screen scrolls vertically and a scene 92 is displayed on the display unit 14 in which a spaceship ss (object 91) on the screen moves to avoid multiple obstacles ob (objects 91).

[0111] The mobile terminal device 1 generates a scene 92 in which a moving spaceship and obstacles (objects 91) are arranged in accordance with commands in a spaceship operation game (computer game 90), and displays the generated scene 92 on the display unit .

[0112] The user checks the spaceship ss and a plurality of obstacles ob displayed on the display unit 14, and controls the spaceship ss by tilting the toy 2 that he or she is holding.

[0113] The mobile terminal device 1 detects the tilt of the marker 221 based on the data of the marker 221 read by the imaging unit 15. The tilt of the marker 221 is a rotational movement of the marker 221 around the current position, and is a rotational movement of the marker 221 within a plane that approximately coincides with the tilt of the plane of the display screen of the display unit 14.

[0114] The mobile terminal device 1 detects some of the vertices of the design of the rotating and moving marker 221 based on pixel feature amounts of the captured image captured by the imaging unit 15, and specifies the coordinates of the detected vertices in the marker coordinate system C3.

[0115] The figure shows an example of detecting three vertices, vertex 221a, vertex 221b, and vertex 221c, included in marker 221. The reason three of the four vertices included in the rectangle are detected is to make it easier to detect the inclination of marker 221 by making it asymmetric.

[0116] The mobile terminal device 1 detects the tilt of the marker 221 by detecting the amount of movement of each of the multiple vertices specified in the marker coordinate system C3. Alternatively, the tilt of the marker 221 may be detected using a learning model that has been trained to output the rotation angle of the marker 221 when image data of the marker 221 is input.

[0117] Furthermore, mobile terminal device 1 may not detect the tilt of marker 221 when the tilt of marker 221 is a rotational movement on a plane different from the tilt of the plane of the display screen of display unit 14. Furthermore, mobile terminal device 1 may determine that the rotational movement of marker 221 is on a different plane when the distances between points provided at the four corners of marker 221 are different from one another.

[0118] When the mobile terminal device 1 detects the tilt (clockwise) of the marker 221, it uses this as a trigger to output an event that the spaceship ss turns right and moves to the right. Also, when the mobile terminal device 1 detects the tilt (counterclockwise) of the marker 221, it uses this as a trigger to output an event that the spaceship ss turns left and moves to the left.

[0119] The mobile terminal device 1 specifies the position of the spaceship ss (one object 91) that has moved in the screen coordinate system C2 and the world coordinate system C1 in accordance with the event. The mobile terminal device 1 performs a collision determination to determine whether or not the position of the spaceship ss specified in the screen coordinate system C2 and the world coordinate system C1 matches the positions of multiple obstacles ob (other objects 91) also specified in the screen coordinate system C2 and the world coordinate system C1.

[0120] The collision determination is performed by determining whether or not any coordinates within a rectangular area representing the spaceship ss match any coordinates within a rectangular area representing the obstacle ob. If the mobile terminal device 1 determines that they match, it uses this as a trigger to output an event that causes the spaceship ss to transition to an explosion state.

[0121] In response to the event, the mobile terminal device 1 generates a scene 92 in which the spaceship ss is in an exploding state, and displays the generated scene 92 on the display unit 14. However, the present invention is not limited to this, and may output, for example, an event in which the spaceship ss transitions to an ignition state, or an event in which the spaceship ss transitions to a slow-moving state.

[0122] When the spaceship ss transitions to the explosion state, the mobile terminal device 1 uses this as a trigger to output a game end event, and ends the computer game 90 being executed in accordance with the event.

[0123] However, without being limited to this, an event may be output in which, after the spaceship ss has transitioned to the exploded state, a remaining spaceship ss appears, the remaining spaceship resumes moving from the explosion position, and the computer game 90 continues. Furthermore, the remaining space may be counted, and when the counted remaining space reaches zero, this may be used as a trigger to output an event to end the game.

[0124] Furthermore, without being limited to the above example, the position of the moving marker 221 may be recognized in addition to detecting the tilt of the marker 221. For example, the spaceship ss may be caused to turn in accordance with the tilt of the marker 221, and the spaceship ss may be accelerated or decelerated in accordance with the movement of the marker 221 in the Y-axis direction.

[0125] 10 is a flowchart showing the procedure of the processing of the program according to embodiment 2. The control unit 10 of the mobile terminal device 1 reads the marker 221 of the toy 2 at any time through the fixedly arranged imaging unit 15 (step S101).

[0126] The control unit 10 detects the tilt of the marker 221 based on the data of the read marker 221 (step S201). The control unit 10 changes the position of one object 91 (spaceship ss) in accordance with the detected tilt of the marker 221 (step S202).

[0127] The control unit 10 executes a collision determination to determine whether the position of one object 91 (spaceship ss) after the change matches the position of another object 91 (obstacle ob) (step S203). If the control unit 10 determines that they do not match (NO in step S203), the control unit 10 returns to step S101 and reads the marker 221 anew.

[0128] On the other hand, when it is determined that there is a match (YES in step S203), the control unit 10 outputs an event triggered by the match between the position of one object 91 and the position of another object 91 based on the game program 321 (step S204).

[0129] The control unit 10 executes processing related to the computer game 90 corresponding to the output event (step S205), and ends the series of processes. Note that, although a spaceship operation game is described as an example in the second embodiment, the present invention is not limited to this, and the computer game 90 may be a game other than a spaceship operation game.

[0130] Embodiment 3 The third embodiment relates to the execution of processing related to the computer game 90 based on whether or not the marker 221 can be recognized through the imaging unit 15. In this embodiment, if the marker 221 cannot be recognized through the imaging unit 15, this may be used as a trigger to change the state of the computer game 90.

[0131] Hereinafter, a calculation play game using arithmetic operations will be taken as an example, and differences from embodiment 1 will be explained, while omitting parts common to embodiment 1. Fig. 11 is a conceptual diagram for explaining the processing related to the calculation play game.

[0132] The mobile terminal device 1 generates a scene 92 in which an arithmetic problem nc (object 91) based on arithmetic operations is arranged in accordance with the commands of the arithmetic play game (computer game 90), and displays the generated scene 92 on the display unit .

[0133] In the figure, the toy 2 is a racket-shaped toy, and an example is shown in which the marker 221 is attached to the racket body 20. The mobile terminal device 1 reads the marker 221 of the toy 2 with the imaging unit 15 that is fixedly arranged.

[0134] The user moves the toy 2 in his / her hand, thereby moving the marker 221 so that the position of the marker 221 is on the display screen of the display unit 14.

[0135] The mobile terminal device 1 determines whether the position of the marker 221 is on the display screen of the display unit 14 or not.

[0136] When the mobile terminal device 1 determines that the position of the marker 221 is on the display screen of the display unit 14, this triggers the mobile terminal device 1 to sequentially display a plurality of answer candidates aw (objects 91) in a predetermined display area (first state). The figure shows an example in which a plurality of answer candidates aw are sequentially displayed in a predetermined display area by adding 1 to the preceding number, such as the numbers 0, 1, 2, and 3.

[0137] However, multiple answer candidates aw may be displayed sequentially by adding a number other than 1 to the preceding number, such as the numbers 0, 1, and 3. Multiple answer candidates aw may also be displayed sequentially at random, such as the numbers 1, 12, 5, and 3. The control unit 10 displays multiple answer candidates aw sequentially while reading of the marker 221 continues.

[0138] When an answer candidate aw that the user considers to be the correct answer is displayed in a designated display area, if the user moves the marker 221 of the toy 2 outside the area that can be captured by the fixedly positioned imaging unit 15, or turns the racket-shaped toy over onto the side opposite to the side on which the marker 221 is attached, and the marker 221 cannot be recognized through the imaging unit 15, the mobile terminal device 1 transitions from the first state to a state (second state) in which the sequential display of multiple answer candidates aw in the designated display area is stopped.

[0139] The term "outside the imageable area" refers to, for example, a deviation from the image capturing limit area (for example, the angle of view) of the imaging performance of the imaging unit 15.

[0140] When the mobile terminal device 1 is no longer able to recognize the marker 221 of the toy 2 using the fixedly placed imaging unit 15, this triggers the device to stop sequentially displaying the multiple answer candidates aw, and compares the stopped answer candidates aw with the correct answer to the calculation problem nc.

[0141] The matching is performed, for example, by referring to correct answer data (not shown) held by the server 3. In the drawing, when the mobile terminal device 1 matches the number 3, which is the correct answer, it displays a notification display "in" on the display unit 14 to congratulate the user for the correct answer. On the other hand, when the mobile terminal device 1 does not match the correct answer, it displays a notification display "in" on the display unit 14 to encourage the user to reconsider.

[0142] In addition to the above example, the toy 2 may be moved so that the display surface of the marker 221 is not facing the imaging unit 15, for example, by laying the racket body 20 down, thereby placing the marker 221 outside the imaging area of ​​the imaging unit 15.

[0143] Furthermore, the marker 221 on the racket body 20 may be outside the imaging area of ​​the imaging unit 15 by being positioned outside the angle of view that the imaging unit 15 can achieve.

[0144] 12 is a flowchart showing the procedure of processing of the program according to embodiment 3. The control unit 10 of the mobile terminal device 1 reads the marker 221 of the toy 2 at any time through the fixedly arranged imaging unit 15 (step S101).

[0145] The control unit 10 outputs an event triggered by reading the marker 221, and transitions the computer game 90 to a first state in response to the output event (step S301).

[0146] The control unit 10 determines whether or not the marker 221 has been recognized through the imaging unit 15 (step S302). Specifically, the control unit 10 determines whether or not the marker 221 has been recognized through the imaging unit 15, or whether or not the coordinates corresponding to the recognized marker 221 are present within a predetermined area. If the control unit 10 determines that the marker 221 has been recognized (YES in step S302), the process returns to step S301, and the first state continues.

[0147] If the control unit 10 determines that the marker 221 has not been recognized (NO in step S302), it transitions the computer game 90 to the second state (step S303) and ends the series of processes.

[0148] This embodiment is not limited to this, and the control unit 10 may transition the computer game 90 to the second state in response to a determination that the marker 221 has not been recognized, and then transition the computer game 90 to the first state if the marker 221 moves again into the imageable area of ​​the imaging unit 15 and it is determined that the marker 221 has been recognized.

[0149] Also, as an example, the figure shows a transition from a state in which multiple answer candidates aw are displayed sequentially in a designated display area (first state) to a state in which the sequential display of multiple answer candidates aw in a designated display area is stopped (second state), but this is not limited to this.

[0150] For example, the numbers of the multiple answer candidates aw are arranged horizontally in advance and displayed on the display screen of the display unit 14. If the control unit 10 can recognize the marker 221, it puts the device in a state (first state) in which one of the arranged numbers can be selected. The user moves the marker 221 attached to the toy 2 to select the number corresponding to the position of the marker 221 on the display screen of the display unit 14.

[0151] Next, if the marker 221 cannot be recognized by, for example, laying the racket-shaped toy down, this triggers a transition to a state (second state) in which the numbers of the selected answer candidate aw are compared with the correct answer to the calculation problem nc. If the correct answer is matched, the control unit 10 displays a notification display in on the display unit 14 to congratulate the player for the correct answer, and if the correct answer is not matched, it displays a notification display in on the display unit 14 to encourage the player to reconsider. This allows the player to play a calculation game with a different feel from the calculation game in which the player selects numbers displayed sequentially in a predetermined display area. In addition, although a calculation game is described as an example in the third embodiment, the present invention is not limited to this, and a computer game 90 other than a calculation game may also be used.

[0152] Embodiment 4 The fourth embodiment relates to accessing a portal site of a computer game 90 using a two-dimensional code attached to the main body 20 of the toy 2. In this embodiment, the portal site of the computer game 90 may be accessed using the two-dimensional code attached to the main body 20 of the toy 2.

[0153] Hereinafter, using a toy set of a toy gun and a model toy spaceship as an example, differences from the first embodiment will be explained, and parts common to the first embodiment will be omitted. Fig. 13 is a conceptual diagram for explaining the processing of a program according to the fourth embodiment.

[0154] The toy set 50 is sold as a combination of multiple types of toys 2, for example, a combination of a toy pistol as a first toy 2A and a model toy spaceship as a second toy 2B. While the figure shows an example in which each of the multiple toys 2 is packaged in a packaging bag 50A and a packaging bag 50B, the present invention is not limited to this, and multiple toys 2 may be packaged in a single packaging bag. Furthermore, the toys are not limited to packaging bags, and may be packaged in a packaging container such as a paper box.

[0155] In the first toy 2A, a marker 221A and a two-dimensional code 222A are affixed to the main body 20A of the toy gun, and a spare two-dimensional code 222A is affixed to the packaging bag 50A. In the second toy 2B, a marker 221B and a two-dimensional code 222B are affixed to the main body 20B of the spaceship model toy, and a spare two-dimensional code 222B is affixed to the packaging bag 50B.

[0156] In the figure, an example is shown in which the markers 221A etc. and the two-dimensional code 222A etc. are different stickers, but this is not limiting, and the markers 221A etc. and the two-dimensional code 222A etc. may be integrated into one sticker. In addition, the spare two-dimensional code 222A etc. may not be attached to the packaging bag 50A etc.

[0157] The two-dimensional code 222A etc. is a code pattern in which information is coded vertically and horizontally, and is a code pattern in which information for accessing a portal site of a predetermined computer game 90 is coded. The two-dimensional code 222A etc. is, for example, a QR Code (registered trademark) or a Data Matrix (registered trademark).

[0158] The mobile information terminal 1 analyzes each of the two-dimensional codes 222A, etc., and thereby acquires information for accessing the portal site from each of the two-dimensional codes 222A, etc. The mobile information terminal 1 accesses the portal site through the web browser 141 in accordance with the acquired information.

[0159] In this embodiment, the analysis of each of the two-dimensional codes 222A, etc. is performed by the mobile terminal device 1, but this is not limiting, and the server 3 may analyze the two-dimensional codes 222A, etc. received from the mobile terminal device 1. While the figure shows an example of using the two-dimensional codes 222A, etc., this is not limiting, and a transmission means in which information is coded and optically recognizable may also be used.

[0160] The portal site allows the user to select any one of a number of computer game titles 90, such as a shooting game and a spaceship operation game. For example, the user can select any one of the computer game titles 90 by checking one of the selection boxes for the computer game titles 90 on the portal site on the display screen through a touch operation on the operation unit 16 of the mobile information terminal 1.

[0161] Access to the game program 321 of the selected computer game 90 is performed, for example, through a deep link written on the portal site.

[0162] Deep linking is a technique that uses, for example, a custom URL scheme to define the game program 321 to be launched in the URL of the linked page. Alternatively, a universal link may be used to match the linked web page with the game program 321 to be launched.

[0163] The mobile information terminal 1 transmits the selection of the computer game 90 to the server 3 via the deep link, and receives the game program 321 of the computer game 90 from the server 3 in response to the transmission. The mobile information terminal 1 starts the received game program 321.

[0164] However, the present invention is not limited to this, and the mobile information terminal 1 may assign different URLs to the two-dimensional code 222A and the two-dimensional code 222B, respectively, so that the mobile information terminal 1 can immediately receive the computer game 90 corresponding to the URLs from the server 3 via a portal site. The data of the portal site is stored, for example, in the auxiliary storage unit 32 of the server 3. However, the present invention is not limited to this, and the data may be stored in a device other than the server 3.

[0165] The markers 221A and the like may have different designs depending on the type of computer game 90. In the drawing, an example is shown in which the marker 221A has a design for a shooting game, and the marker 221B has a design for a spaceship operation game. The design differs depending on the genre of the computer game 90, such as action, shooting, racing, or puzzle. However, the design is not limited to this, and may also differ depending on the title of the computer game 90.

[0166] The mobile information terminal 1 analyzes the design to acquire information corresponding to the type of computer game 90 from each of the markers 221A, etc. The mobile information terminal 1 executes processing related to the computer game 90 based on the acquired information.

[0167] The mobile information terminal 1 executes processing related to a computer game 90 that is a shooting game, for example, by using a marker 221A for the shooting game.

[0168] Similarly, by using the marker 221B of the spaceship operation game, the processing related to the computer game 90 of the spaceship operation game is executed. On the other hand, when the mobile information terminal 1 uses the marker 221A of the shooting game, the processing related to the computer game 90 of the spaceship operation game is not executed.

[0169] One genre may include one computer game 90 title, or may include multiple computer games 90 titles.

[0170] For example, when using a marker 221A corresponding to a first genre, the mobile information terminal 1 executes processing related to a computer game 90 belonging to the first genre, but may not execute processing related to a computer game 90 belonging to a second genre that does not correspond to the first marker 221A.

[0171] This prevents the user from playing the computer game 90 using the toy 2 with the incompatible marker 221 in the toy set 50, for example, and prevents playing in a way that differs from the original way of playing that is assigned to the toy 2.

[0172] 14 is a flowchart showing the procedure of processing of the program according to embodiment 4. The control unit 10 of the mobile terminal device 1 reads the two-dimensional code 222A or the like attached to the main body 20A or the like of the toy 2A or the like (step S401).

[0173] The control unit 10 acquires information from the read two-dimensional code 222A etc., and accesses the corresponding portal site. The control unit 10 displays the screen of the accessed portal site on the display unit 14.

[0174] The user selects an arbitrary computer game 90 from the multiple titles of computer games 90 included in the displayed portal site by performing a touch operation on the operation unit 16 of the mobile terminal device 1.

[0175] The control unit 10 accepts selection of a computer game 90 in response to a user operation (step S402). After starting the selected computer game 90, the control unit 10 determines whether or not the marker 221 corresponding to the selected computer game 90 matches the marker 221 read by the imaging unit 15 (step S403). Specifically, it determines whether or not the marker 221 specified in the computer program 321 matches the marker 221 read by the imaging unit 15.

[0176] If the control unit 10 determines that there is a match (YES in step S403), it executes processing related to the selected computer game 90, such as collision detection between the object 91 and the recognized marker 221 (step S404), and ends the series of processes.

[0177] If it is determined that there is no match (NO in step S403), the control unit 10 outputs an alert indicating that the markers 221 do not match (step S405), and ends the series of processes.

[0178] The process is not limited to the above, and if it is determined that there is no match, the series of processes may be terminated without outputting an alert indicating that the markers 221 do not match. Also, if it is determined that there is no match, the process may return to step S402 and accept a new selection of a computer game 90. In the fourth embodiment, a toy set including a toy gun and a spaceship operation game is described as an example, but the present invention is not limited to this and a toy set including a combination of other computer games 90 may also be used.

[0179] Fifth embodiment The fifth embodiment relates to a computer game 90 using a blowback whistle. In this embodiment, the computer game 90 may be played using a blowback whistle.

[0180] Below, using a computer game 90 using a blowback whistle as an example, differences from the first embodiment will be explained, and parts common to the first embodiment will be omitted. Figure 15 is a conceptual diagram explaining the processing of a program according to the fifth embodiment.

[0181] The mobile terminal device 1 generates a scene 92 in which multiple targets ta (objects 91) and destinations md (objects 91) corresponding to each of the multiple targets ta are arranged in accordance with instructions from a computer game 90, and displays the generated scene 92 on the display unit 14.

[0182] In the figure, the toy 2 is a whistle, and an example is shown in which the marker 221 is attached to the expandable portion of the main body 20 of the whistle.

[0183] By attaching the marker 221 to the tip of the expandable part, it is exposed when the expandable part is fully expanded by the user's exhalation (breathing) and is covered when the expandable part contracts due to an interruption in exhalation. In other words, the marker 221 is exposed when the expandable part is fully expanded as the user continues to exhale, and is imaged by the imaging unit 15 of the mobile terminal device 1 in the direction extending in the axial direction of the blowback whistle.

[0184] The targets ta have a variety of shapes. A destination md having the same shape is set for each of the targets ta, and each destination md is placed at a predetermined position in the scene 92.

[0185] By continuing to exhale, the user extends the extendable portion of the blowback whistle, thereby continuing to expose the marker 221. The mobile terminal device 1 continues to recognize, through the imaging unit 15, the marker 221 that is continuously exposed.

[0186] The mobile terminal device 1 executes a collision check between the position of the read marker 221 and the position of the target ta in the scene 92, and identifies the target ta that matches the position of the marker 221. The collision check is as described above.

[0187] The mobile terminal device 1 outputs an event to move the identified target ta, triggered by the identification of the target ta. The user moves the whistle with the telescopic part of the whistle extended, thereby moving the marker 221.

[0188] The mobile terminal device 1 reads the moving marker 221 through the imaging unit 15, and based on the movement of the marker 221, puts the identified target ta into a state (first state) of tracking. That is, the control unit 10 puts the state of recognizing the marker 221 into the first state. The mobile terminal device 1 moves the identified target ta to a predetermined destination md and fits it in, completing the movement of the target ta. The mobile terminal device 1 may notify the user that the movement to the destination md has been completed.

[0189] When the mobile terminal device 1 moves the identified target ta to a predetermined destination md, if it determines that the shape of the target ta differs from the shape of the destination md, it returns the target ta to its original position and marks the movement of the target ta as incomplete. The mobile terminal device 1 reads a new marker 221.

[0190] The mobile terminal device 1 repeats the above process until all of the targets ta have moved to their corresponding destinations md. The mobile terminal device 1 is triggered by the completion of the movement of all of the targets ta to their destinations md, and outputs a game end event, and ends the running computer game 90. Prior to the end, the mobile terminal device 1 may notify the user that the movement of all of the targets ta to their destinations md has been completed.

[0191] When the user stops breathing out, the telescopic part of the whistle contracts and blocks the marker 221. For example, when the mobile terminal device 1 is in the first state, i.e., when the user stops breathing out while the target ta is moving and the marker 221 is not recognized through the imaging unit 15, the mobile terminal device 1 may transition from the above-mentioned first state to a state (second state) in which the target ta is returned to its original position, and the movement of the target ta may not be completed. In other words, the control unit 10 defines the state in which the marker 221 is recognized as the first state. This encourages the user to continue breathing into the whistle for a longer period of time in an attempt to move the target ta smoothly.

[0192] 16 is a flowchart showing the processing steps of the program according to embodiment 5. The user fully extends the retractable part of the whistle by exhaling, thereby exposing the marker 221 attached to the tip of the retractable part. The control unit 10 of the mobile terminal device 1 determines whether or not the exposed marker 221 is recognized through the imaging unit 15 (step S501).

[0193] When the control unit 10 determines that the marker 221 is recognized (YES in step S501), the control unit 10 transitions to the first state and executes a subroutine related to the first state (step S502). The processing procedure of the subroutine will be described later.

[0194] On the other hand, if the control unit 10 determines that the marker 221 is not recognized (NO in step S501), the control unit 10 transitions to the second state and executes a subroutine related to the second state (step S503). The processing procedure of the subroutine will be described later.

[0195] If it is determined in step S502 that the marker 221 is not recognized during execution of the subroutine related to the first state, the first state may be interrupted and transition may be made to the second state.

[0196] After executing the subroutine related to the first state in step S502, the control unit 10 determines whether the shape of the destination md and the shape of the target ta match (step S504). If the control unit 10 determines that the shape of the destination md and the shape of the target ta do not match (NO in step S504), the control unit 10 transitions to step S503 and executes the subroutine related to the second state.

[0197] When the control unit 10 determines that the shape of the destination md matches the shape of the target ta (YES in step S504), it completes the movement of the target ta by fitting the target ta into the destination md. The control unit 10 determines whether the movement of all the targets ta has been completed (step S505).

[0198] If the control unit 10 determines that the movement of all targets ta has not been completed (NO in step S505), the process returns to step S501 and reads the next exposed marker 221. Based on the movement of the read marker 221, the user moves the targets ta whose movement has not been completed to the movement destination md.

[0199] When the control unit 10 determines that the movement of all the targets ta has been completed (YES in step S505), it ends the computer game 90 (step S506) and ends the series of processes.

[0200] 17 is a flowchart showing the procedure of the processing of the subroutine relating to state 1. The control unit 10 identifies a target ta corresponding to the position of the marker 221 being recognized (step S601).

[0201] The control unit 10 causes the specified target ta to track the movement of the recognized marker 221 (step S602), and ends the series of processes. As described above, if it is determined that the marker 221 is not recognized during execution of the subroutine related to the first state, the first state may be interrupted and a transition to the second state may be made.

[0202] 18 is a flowchart showing the procedure of the processing of the subroutine relating to the second state. When the control unit 10 determines in step S501 that the marker 221 is not recognized, it interrupts the movement of the target ta and returns the target ta to its original position (step S701). The control unit 10 then determines that the movement of the target ta is incomplete (step S702) and ends the series of processes.

[0203] If it is determined that the marker 221 is recognized while the subroutine relating to the second state is being executed, the target ta may be returned to its original position and then moved again to the predetermined destination md.

[0204] In the fifth embodiment, the user keeps the telescopic part of the whistle fully extended for a longer period of time in order to expose the marker 221 and have it recognized by the imaging unit 15, thereby applying a load to the user's respiratory muscles and training the user's breathing power. The computer game 90 according to the fifth embodiment has the purpose of training the user's breathing power.

[0205] In the above embodiment, an example is shown in which one marker 221 is attached to one toy 2, but the present invention is not limited to this, and a plurality of markers 221 may be attached to one toy 2.

[0206] Furthermore, in the above embodiment, an example is shown in which one toy 2 is used for one computer game title 90, but this is not limiting, and multiple toys 2 may be used for one computer game title 90. In this way, multiple users play a game in a battle format.

[0207] Furthermore, the above-described embodiment shows an example in which one user plays the computer game 90 using one mobile terminal device 1, but this is not limited to this. A large number of users may gather together and connect their respective mobile terminal devices 1 to each other via short-range wireless communication, thereby allowing the large number of users to play the computer game 90 in a cooperative manner.

[0208] Furthermore, in the above-described embodiment, examples of computer games 90 for entertainment purposes, such as shooting games and puzzle games, are shown, but the present invention is not limited to these, and the computer games 90 may be for learning purposes, simulated cooking experiences, simulated crafting experiences, simulated sports experiences, etc.

[0209] In this case, the toys 2 may be items that are not primarily intended for play but can be used in play with the computer game 90, such as stationery, cooking utensils, tools, and sports equipment.

[0210] In addition, in the above-described embodiment, an example is shown in which the marker 221 is attached to the toy 2 and a spare marker 221 is attached to the packaging container of the toy 2 or the enclosed paper, but this is not limited to this. For example, the marker 221 printed on the packaging container of the toy 2 or the enclosed paper may be cut out, and the user may attach the cut-out marker 221 to any location on the toy 2.

[0211] For example, the user may attach a sticker of the marker 221 to any location on the toy 2. Alternatively, the user may attach a two-dimensional code 222 instead of the marker 221 to any location on the toy 2. Alternatively, the user may attach a sticker of the marker 221 or the two-dimensional code 222 to a substitute for the toy 2, and temporarily execute the processing related to the computer game 90 described above by holding and moving the substitute.

[0212] Furthermore, the above embodiment shows an example in which information corresponding to each type of computer game 90 is acquired from the marker 221 by analyzing the design contained in each of the markers 221, but the present invention is not limited to this. For example, the marker 221 may contain a mark indicating the provider of the computer game 90, and the computer game 90 may be played only when the mark is read.

[0213] In the above example, the program executed by the mobile terminal device 1 is a program separate from the game program 321, but this is not limiting, and the program described above may be incorporated into the game program 321.

[0214] The program may also be deployed to run on a single computer, or located at one website, or distributed across multiple websites and executed on multiple computers connected to each other through a communications network.

[0215] Furthermore, the embodiments disclosed above should be considered to be illustrative in all respects and not restrictive. Furthermore, the technical features (constituent elements) described in each embodiment can be combined with each other, and when combined, new technical features are formed.

[0216] Furthermore, the scope of the present invention is intended to include all modifications within the scope of the claims and the equivalent scope of the claims. [Explanation of symbols]

[0217] 1. Mobile terminal device 10 Control Unit 11 Main memory 12 ROM 13 Radio Communication Department 131 Voice Communication Department 132 Data Communications Department 133 Near Field Wireless Communication Department 14 Display section 141 Web Browser 15 Imaging unit 151 In-camera 152 Outer Camera 16 Control section 17. Mike 18 speakers 2 toys 20 Main Unit 21 Gripping part 221 Marker 222 QR Code 3. Server Computer 30 Control Unit 31 Main memory 32 Auxiliary storage 321 Game Program 322 Game Scene Data 323 Game Object Data 324 texture data 325 Production Data 326 Sound Data 327 Various Components 33 Communications Department 50 toy sets 90 Computer Games 91 objects 92 scenes 100 Toy System

Claims

1. A whistle having an expandable portion that expands when a user exhales, the whistle having a marker attached to a tip of the expandable portion so as to be exposed when the expandable portion expands; a mobile terminal device including a display unit and an imaging unit; The mobile terminal device displaying a computer game object on the display unit; when the marker, which is exposed as a result of the extension of the expandable portion due to the user's exhalation, is continuously read by the imaging unit, transitioning the computer game to a first state in which a plurality of selection candidates related to the object are sequentially displayed in a predetermined display area; when the user stops exhaling and the expandable portion contracts, blocking the marker and making it impossible for the imaging unit to read the marker, transitioning the computer game to a second state in which the sequential display of the plurality of selection candidates in the predetermined display area is stopped and any one of the selection candidates is displayed in the predetermined display area; When the state transitions to the second state, the selection candidates displayed in the predetermined display area are compared with the correct answer; Notify the match result Game system.

2. A blowback whistle having an expandable portion that expands when a user exhales, a marker attached to a tip of the expandable portion so as to be exposed when the expandable portion expands; a mobile terminal device including a display unit and an imaging unit; The mobile terminal device displaying a computer game object on the display unit; when the marker, which is exposed as a result of the extension of the expandable portion due to the user's exhalation, is continuously read through the imaging unit, transitioning the computer game to a first state in which an object displayed on the display unit follows the movement of the marker; When the user stops breathing in, the expandable portion contracts, shielding the marker and making it impossible for the imaging unit to read the marker, the computer game is transitioned to a second state in which the object is placed in its original position. Game system.

3. A two-dimensional code for accessing the portal site of the computer game is attached to the whistle.

3. The game system according to claim 1 or 2.

4. The marker has a different design depending on the type of the computer game.

4. A game system according to claim 1.

5. a first toy in which a first marker is attached in an exposed state to a toy body that is held and moved by a user, the first marker being such that when the first marker is read by an imaging unit of a fixedly disposed portable terminal device while a first computer game is running, the first computer game can proceed, but when the first marker is read by the imaging unit while a second computer game different from the first computer game is running, the second computer game cannot proceed; a second toy, wherein a second marker, which allows the second computer game to progress when read through the imaging unit while the second computer game is running, but prevents the first computer game from progressing when read through the imaging unit while the first computer game is running, is attached to a tip of a telescopic part of a whistle having an extendable part that extends when a user exhales, so as to be exposed when the extendable part is extended; A toy set comprising:

Images