Information processing system, information processing method, and program

Abstract

We provide amusement facilities that offer services combining digital point management and motion capture technology. [Solution] In the CPU 11 of the management server 1, the information management unit 32 manages identification information associated with each predetermined medium, the generation unit 33 generates skeletal information about the user's skeleton from the detection results of the user's body movements, the point management unit 35 assigns predetermined points according to the content of the skeletal information, and the information management unit 32 manages the generated skeletal information and the assigned point values ​​in association with the identification information of the medium presented by the user. This solves the above problem.

Description

Technical Field

[0001] The present invention relates to an information processing system, an information processing method, and a program.

Background Art

[0002] In amusement facilities, which are commercial facilities that provide games and the like to customers, digital point management for managing users' points using IC cards, electronic money, etc. has become widespread, and related technologies have also been proposed (for example, see Patent Document 1). In addition, digital sports and attractions using motion capture technology that records and analyzes the movements of the human body and objects as digital data are also increasing. For example, a technology that recognizes the physical movements of users and advances a game is known (for example, see Patent Document 2).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, amusement facilities that can provide a service that combines digital point management and motion capture technology are not known.

[0005] The present invention has been made in view of such a situation, and an object thereof is to provide an amusement facility that can provide a service that combines digital point management and motion capture technology.

Means for Solving the Problems

[0006] To achieve the above objective, one aspect of the present invention is: An identification information management means that manages identification information by associating it with each predetermined medium, A detection means for detecting the user's physical movements, A generation means for generating skeletal information relating to the user's skeleton from the detection results of the aforementioned body movements, A means for awarding predetermined points according to the content of the aforementioned skeletal information, A skeleton management means that manages the generated skeleton information and the assigned point values ​​in association with the identification information of the medium presented by the user, It is an information processing system that has [a certain feature].

[0007] An information processing method and program corresponding to the above-mentioned information processing system according to one aspect of the present invention are also provided as an information processing method and program corresponding to the information processing system according to one aspect of the present invention. [Effects of the Invention]

[0008] According to the present invention, it is possible to provide an amusement facility that can offer a service combining digital point management and motion capture technology. [Brief explanation of the drawing]

[0009] [Figure 1] This figure shows an example of the overall configuration of an information processing system according to one embodiment of the present invention. [Figure 2] Figure 1 is a block diagram showing an example of the hardware configuration of the management server that makes up the information processing system. [Figure 3] This is a functional block diagram showing an example of the functional configuration of the management server. [Figure 4] This flowchart shows an example of the process from user authentication to point awarding on the management server. [Figure 5] Figure 4 is a flowchart illustrating a detailed example of the process for awarding points to a user. [Figure 6]This figure shows a specific example of skeletal information generated by the management server. [Modes for carrying out the invention]

[0010] This embodiment will be described below with reference to the drawings. <Information Processing System S> Figure 1 shows an example of the overall configuration of an information processing system S according to one embodiment of the present invention.

[0011] The information processing system S is configured to include a management server 1, user terminals 2-1 to 2-n (where n is an integer value of 1 or more), and amusement devices 3-1 to 3-m (where m is an integer value of 1 or more). The management server 1, user terminals 2-1 to 2-n, and amusement devices 3-1 to 3-m are interconnected via a network N by wired or wireless connections. Network N is, for example, the Internet, a LAN (Local Area Network), or a VPN (Virtual Private Network). Hereinafter, when it is not necessary to explain each of the user terminals 2-1 to 2-n individually, they will be collectively referred to as "user terminal 2." Similarly, when it is not necessary to explain each of the amusement devices 3-1 to 3-m individually, they will be collectively referred to as "amusement device 3."

[0012] The information processing system S implements a point management service (hereinafter referred to as "this service") using a predetermined medium that enables the use of amusement devices 3 installed in an amusement facility. The provider of this service is, for example, the manager of the amusement facility. The users of this service are the users of the amusement devices 3 installed in the facility.

[0013] The management server 1 that constitutes the information processing system S is an information processing device as a server that manages the entire information processing system S. The management server 1 can execute a predetermined application program that enables the use of the information processing system S. The management server 1 can transmit various types of information to each of the user terminal 2, the amusement device 3, and the external, and can cause various types of processing to be executed. Also, the management server 1 can acquire various types of information transmitted from each of the user terminal 2, the amusement device 3, and the external, and can execute various types of processing.

[0014] The user terminal 2 that constitutes the information processing system S is an information processing device that is operated by a user who uses this service. The user terminal 2 is composed of, for example, a smartphone, a tablet terminal, etc. The user terminal 2 can execute a predetermined application program (hereinafter referred to as "this application") that enables the use of this service. The user terminal 2 can execute various types of processing based on various types of information transmitted from the management server 1, the amusement device 3, and the external, and various types of information input by the user. Also, the user terminal 2 can transmit various types of information to each of the management server 1, the amusement device 3, and the external.

[0015] The amusement device 3 that constitutes the information processing system S is an information processing device that is used by a user who uses this service at an amusement facility. Specifically, the amusement device 3 is one of the devices that provide entertainment and play to the user at the amusement facility and involves the physical movements of the user. Examples of the amusement device 3 include a gaming device for digital sports, a conventional game machine, etc.

[0016] In addition to the detection means for detecting the user's body movements, the amusement device 3 may be configured by combining other sensors and input devices. For example, the amusement device 3 may include a handheld device that the user holds and operates. The handheld device incorporates an acceleration sensor, a gyro sensor, a pressure sensor, etc., and can detect shaking movements, tilting movements, pressing movements, etc. by the user. Examples of the handheld device include controllers shaped like a sword, a stick, a racket, a bat, etc.

[0017] Furthermore, the amusement device 3 may further include a floor sensor installed on the floor surface. The floor sensor is composed of, for example, a pressure sensor, a load sensor, a capacitance sensor, etc., and can detect the position of the user's feet, weight transfer, jumping movements, stepping movements, etc. Thereby, it becomes possible to detect the user's body movements more comprehensively.

[0018] Moreover, the amusement device 3 may be configured in cooperation with exercise equipment. Examples of the exercise equipment include gym equipment such as an air bike (registered trademark), a rowing machine, a running machine, etc. By combining the signals output from these exercise equipment (for example, the rotation speed of the pedals, the rowing speed, the running speed, etc.) with the detection results of the user's body movements, it becomes possible to provide a more diverse gaming experience. For example, it is possible to realize coordinated actions such as a character in the screen moving forward by the user's pedaling action on an air bike (registered trademark) and the character in the screen performing an attack action by the user's hand movement.

[0019] <Processing of the management server 1, the user terminal 2, and the amusement device 3> Management Server 1 manages points, which serve as economic benefits (incentives) for users, at predetermined values ​​and awards points at predetermined values ​​to users who meet predetermined awarding conditions. In this service, the content of physical movements detected when a user uses the amusement device 3 is used as one of the conditions for awarding points. Therefore, when a user uses the amusement device 3, Management Server 1 detects the user's physical movements, and if the detection result meets the predetermined awarding conditions, it awards the user points at predetermined values.

[0020] Furthermore, in this service, in addition to points, usage rights for the amusement device 3 (e.g., number of uses, usage time, or number of credits) may be managed in association with media identification information. Usage rights and points may be managed separately or as the same value. For example, a predetermined value of usage rights may be consumed to use the amusement device 3 once, and a predetermined value of points may be awarded according to the evaluation of physical movements during use. Alternatively, usage rights and points may not be distinguished and may be managed as the same value, with a predetermined value being deducted when the amusement device 3 is used and a predetermined value being added according to the evaluation of physical movements.

[0021] Management Server 1 enables the use of amusement devices 3 installed in amusement facilities and other services provided at amusement facilities, depending on the value of the points. "Other services" refer to various goods or services offered at shops and restaurants located within amusement facilities. In this case, "use of other services" includes payment for goods or services using points. Management Server 1 also enables the issuance of predetermined coupons and vouchers depending on the value of the points.

[0022] This service enables the use of the amusement device 3 by having it read identification information (hereinafter referred to as "media identification information") that has been pre-associated with each predetermined medium. The "medium" is not particularly limited. For example, it may be an IC card or an RFID (Radio Frequency Identification) tag, or it may be a user terminal 2 on which this application is installed. This application may be one that can be downloaded from a predetermined website managed by the amusement facility. In this embodiment, we will describe the case where the medium used by the user is a user terminal 2 on which this application is installed.

[0023] A user visiting an amusement facility presents user terminal 2, on which this application is installed, to amusement device 3. Specifically, the user presents an identifier (e.g., a one-dimensional code or two-dimensional code) associated with media identification information, which is displayed when the application is launched on user terminal 2, to amusement device 3. The amusement device 3 then reads the media identification information associated with the identifier using a predetermined reading means. This enables the user to use amusement device 3. The amusement device 3 associates the read media identification information with the results of detecting the user's body movements using a predetermined detection means and transmits them to management server 1. Examples of detection means for detecting the user's body movements include markerless motion capture cameras, depth sensors, pressure sensors, and LiDAR sensors. Furthermore, the predetermined detection means may include an acceleration sensor, gyroscope sensor, or pressure sensor built into a handheld device operated by the user, a floor sensor installed on the floor, or a sensor that acquires signals output from exercise equipment. These detection means may be used individually or in combination.

[0024] Management Server 1 acquires the detection results of the user's body movements and generates information about the user's skeleton (hereinafter referred to as "skeletal information") based on the acquired detection results. Skeletal information includes, for example, the joint positions of the user's body, the length of the skeleton, and body proportions. The generated skeletal information may also include information about the quality of the user's body movements (hereinafter referred to as "movement quality information"). Examples of movement quality information include the form, speed, and precision of the user's body movements. A specific example of skeletal information including movement quality information will be described later with reference to Figure 6.

[0025] When the management server 1 generates skeletal information based on the detection results of body movements transmitted from the amusement device 3, it performs processing according to the type of detection means. For example, when generating skeletal information based on image data from a markerless motion capture camera, the management server 1 extracts the human body region from the image data and generates skeletal information by estimating joint positions using a deep learning model or the like.

[0026] Furthermore, when detection results are obtained from multiple types of detection means, the management server 1 integrates them to generate skeletal information. For example, when detection results of body movements are obtained from a markerless motion capture camera and detection results from an acceleration sensor and gyroscope sensor built into a handheld device, the management server 1 generates skeletal information of the entire body based on the image data from the camera, and also analyzes the movement of the hand and arm in more detail based on the sensor data of the handheld device, and generates skeletal information that integrates both. Specifically, by adding information on the acceleration and angular velocity of the wrist calculated from the sensor data of the handheld device to the joint positions of the wrist and elbow in the skeletal information from the camera, more accurate skeletal information can be generated.

[0027] Similarly, when detection results for body movements by a camera and detection results by a floor sensor are obtained, the management server 1 integrates the skeletal information from the camera with information such as foot position, weight transfer, and ground reaction force obtained from the floor sensor. This improves the accuracy of evaluation of jumping and stepping movements. The management server 1 may also improve the accuracy of the generated skeletal information by using the detection results from the floor sensor to generate the skeletal information.

[0028] Furthermore, when signals output from exercise equipment and detection results of body movements by cameras or the like are acquired, the management server 1 manages the movement data from the exercise equipment (e.g., pedal rotation speed, pedaling speed, running speed, load, etc.) in association with skeletal information. In this case, the generated skeletal information is associated with movement data from the exercise equipment (e.g., data indicating exercise performance). The management server 1 may also improve the accuracy of the generated skeletal information by using movement data to generate the skeletal information.

[0029] Management Server 1 assigns a predetermined number of points according to the content of the generated skeletal information. If Management Server 1 generates motion quality information as skeletal information, it may also assign a predetermined number of points according to the content of the motion quality information. When points are assigned to a user, Management Server 1 manages the media identification information presented by the user by associating the detection results of the user's body movements, the generated skeletal information, and the value of the assigned points.

[0030] Furthermore, the management server 1 may estimate the user's physical characteristics from the generated skeletal information and adjust the point awarding conditions according to the estimated physical characteristics. Examples of physical characteristics include height, limb length, the ratio of limb length to torso length, and range of motion of joints. These physical characteristics are related to the user's age, build, and physical ability, and even when using the same amusement device, the difficulty of performing the same physical movements may differ depending on the physical characteristics.

[0031] For example, in a game that requires reaching for a target at a high position, the difficulty of reaching the same target will differ between tall and short users. Similarly, in a game that requires quick foot movements, the difficulty of moving feet at the same speed will differ between adults and children. In such cases, the management server 1 adjusts the point awarding conditions according to the user's physical characteristics estimated from skeletal information.

[0032] Specifically, the management server 1 sets target values ​​or evaluation criteria appropriate for each user based on their physical characteristics. For example, for a short user, the standard for the target height to be reached is set lower, or the evaluation for reaching the same height target is increased. Similarly, for a user with short limbs, the standard for movement speed is relaxed, or the evaluation for moving at the same speed is increased. This ensures that users with different physical characteristics receive fair evaluations according to their individual physical abilities and can acquire appropriate points.

[0033] Furthermore, the management server 1 may adjust the point awarding conditions by considering both the skill level estimated from the user's skeletal information history and the physical characteristics estimated from the skeletal information. For example, it may apply more lenient evaluation criteria to short beginner users and stricter evaluation criteria to taller advanced users. This allows users of a wide range of ages and body types to enjoy the amusement equipment at a difficulty level suitable for them, thereby promoting continued use.

[0034] Management Server 1 manages the user's usage history of the amusement device 3 by associating it with media identification information. Specifically, Management Server 1 generates skeletal information from the body movements detected each time a user presents media identification information and uses the amusement device 3, and manages this as a history of skeletal information. Based on the user's history of skeletal information, Management Server 1 determines the user's skill level with respect to the amusement device 3 and assigns a predetermined number of points according to the determination result.

[0035] In this embodiment, user authentication (hereinafter referred to as "skeletal authentication") is performed using the user's skeletal information. Skeletal information includes the joint positions of the user's body, the length of the skeleton, body proportions, etc., and these have characteristics that differ from person to person. For example, height, limb length, the ratio of torso to limb length, and the ratio of shoulder width to hip width are effective features for identifying an individual. Therefore, by using skeletal information, it is possible to determine whether the person is the legitimate owner of the media identification information. This prevents unauthorized use through lending or borrowing of media or impersonation, and suppresses the fraudulent acquisition or use of points.

[0036] Management Server 1 performs user authentication using the user's skeletal information. This allows it to determine whether a user who presents media identification information is the legitimate owner (the person) of the skeletal information associated with that media identification information. When a user presents media identification information and uses the amusement device 3, and bodily movements are detected, Management Server 1 generates new skeletal information from the detected bodily movements. Then, Management Server 1 performs user authentication using the newly generated skeletal information. Specifically, Management Server 1 performs user authentication by comparing the newly generated skeletal information with the history of managed skeletal information. If the authentication result affirms that the user is the legitimate owner of the media identification information, Management Server 1 considers user authentication successful and awards points to the user who presented the media identification information. Conversely, if the authentication result denies that the user is the legitimate owner of the media identification information, Management Server 1 considers user authentication failed and restricts the awarding of points to the user who presented the media identification information. This type of skeletal authentication prevents lending or borrowing media, and attempts to obtain points by illegally acquiring media belonging to others.

[0037] Management Server 1 detects the existence of multiple media identification pieces associated with the same user's skeletal information based on the results of comparing the skeletal information associated with multiple media identification pieces. For example, if the skeletal information associated with each of two media identification pieces matches, it is detected that the two media identification pieces are owned by the same user.

[0038] The processing performed by the management server 1, user terminal 2, and amusement device 3, which constitute the information processing system S, is merely an example. In other words, as long as the information processing system S as a whole has the functionality to implement the above-mentioned processing, some or all of the functions to implement the above-mentioned processing may be shared or performed collaboratively within the information processing system S.

[0039] For example, some or all of the functions of the management server 1 may be assigned to other information processing devices within the information processing system S. Alternatively, some or all of the functions of other information processing devices within the information processing system S may be assigned to the management server 1. Furthermore, some or all of the functions of the management server 1 may be transferred to other servers, etc., not shown in the diagram. This facilitates processing within the entire information processing system S and allows for complementary processing.

[0040] <Hardware Configuration> [Hardware configuration of management server 1] Figure 2 is a block diagram showing an example of the hardware configuration of the management server 1 that constitutes the information processing system S shown in Figure 1. The management server 1 comprises a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20.

[0041] The CPU 11 executes various processes according to the program stored in the ROM 12 or the program loaded from the storage unit 18 into the RAM 13. The RAM 13 also stores data necessary for the CPU 11 to execute various processes. The CPU 11, ROM 12, and RAM 13 are interconnected via a bus 14. An input / output interface 15 is also connected to this bus 14.

[0042] The input / output interface 15 is connected to an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20. The output unit 16 consists of a display, speaker, etc., and outputs various information as images, sounds, etc. The input unit 17 consists of a keyboard, mouse, touch panel, etc., and accepts input of various information. The storage unit 18 consists of a hard disk, DRAM (Dynamic Random Access Memory), etc., and stores various data. The communication unit 19 communicates with other devices via the aforementioned network N, which is configured as the Internet, etc.

[0043] The drive 20 is appropriately equipped with removable media 21, such as a magnetic disk, optical disk, magneto-optical disk, or semiconductor memory. Programs read from the removable media 21 by the drive 20 are installed in the storage unit 18 as needed. The removable media 21 can also store various types of data stored in the storage unit 18, just like the storage unit 18.

[0044] [Hardware configuration of user terminal 2 and amusement device 3] The user terminal 2 and the amusement device 3 have a hardware configuration similar to that of the management server 1 shown in Figure 2 above. That is, the user terminal 2 and the amusement device 3 each have a CPU, ROM, RAM, bus, input / output interface, output unit, input unit, storage unit, communication unit, drive, and removable media, respectively, corresponding to the CPU 11, ROM 12, RAM 13, bus 14, input / output interface 15, output unit 16, input unit 17, storage unit 18, communication unit 19, drive 20, and removable media 21 in Figure 2, respectively.

[0045] In addition to the hardware configuration described above, the amusement device 3 also has a reader unit that reads various types of information. When the medium is an IC card, the reader unit reads the medium identification information stored in the medium either by contact or contact. In this case, the reader unit reads the medium identification information by, for example, the following configuration. That is, the reader unit has an electrical communication interface with the IC chip of the IC card. Specifically, it has terminals in the case of contact type and an antenna in the case of contactless type. The reader unit also requests medium identification information based on the IC card's communication protocol (for example, ISO / IEC 14443 or FeliCa®), receives response data from the IC card, and decodes it.

[0046] Furthermore, if the medium is RFID, the reader unit uses RFID technology to read the medium identification information stored in the medium wirelessly and without contact. In this case, the reader unit reads the medium identification information using, for example, the following configuration: The reader unit has an antenna for transmitting and receiving radio waves and an RF module for generating and processing radio frequency signals. The reader unit also communicates with the tag based on a communication protocol (e.g., ISO / IEC 18000 series) in a specific frequency band (e.g., UHF band, HF band), and extracts and decodes the unique identification information (e.g., EPC code) that the tag possesses.

[0047] Furthermore, if the medium is the user terminal 2 on which this application is installed, the reading unit optically reads the medium identification information associated with the identifier displayed on the screen of the user terminal 2. In this case, the reading unit reads the medium identification information using, for example, the following configuration: The reading unit is equipped with a camera, an image sensor, and illumination to capture an image of the identifier. The reading unit also detects the area of ​​the identifier from the captured image data, decodes the symbol according to a code system (e.g., JIS X 0510), and extracts the medium identification information associated with the card.

[0048] <Functional Configuration of Management Server 1> Figure 3 is a functional block diagram showing an example of the functional configuration of the management server 1. In the CPU 11 of the management server 1, the following functions operate during operation: information acquisition unit 31, information management unit 32, generation unit 33, authentication unit 34, point management unit 35, detection unit 36, and transmission control unit 37.

[0049] Furthermore, the storage unit 18 of the management server 1 is equipped with various databases. For example, the storage unit 18 contains a media identification information DB 41 which stores information that associates the user's skeletal information with the value of points assigned to the user, and a point assignment condition DB 42 which stores predetermined point assignment conditions.

[0050] The information acquisition unit 31 acquires various types of information. For example, the information acquisition unit 31 acquires media identification information transmitted from the amusement device 3. The information acquisition unit 31 also acquires the detection results of the user's physical movements transmitted from the amusement device 3.

[0051] The media identification information DB41 stores the user's skeletal information history, associated with the media identification information. The skeletal information may also include information indicating the type of detection means. For example, it may include information such as whether the skeletal information is from a camera alone, from the integration of a camera and a handheld device, from the integration of a camera and a floor sensor, or from skeletal information associated with exercise equipment data. This allows for understanding what kind of amusement equipment the user has used and for appropriately managing the history of skeletal information for each amusement equipment.

[0052] The media identification information DB41 may store physical characteristics estimated from the user's skeletal information (e.g., height, limb length, body proportions, etc.) associated with it. This allows the management server 1 to quickly apply evaluation criteria tailored to the user's physical characteristics when the user uses the amusement device 3.

[0053] Furthermore, the awarding conditions DR42 may store point awarding conditions for each range of physical characteristics. For example, different evaluation criteria may be set for each height range, such as height less than 120 cm, 120 cm or more but less than 150 cm, and 150 cm or more. The point management unit 35 calculates points by referring to the appropriate awarding conditions according to the user's physical characteristics.

[0054] Furthermore, the point awarding conditions DB42 stores the point awarding conditions for each type of amusement device. For example, it stores evaluation criteria for games using cameras and handheld devices, evaluation criteria for games using cameras and floor sensors, and evaluation criteria for games linked with exercise equipment. The point management unit 35 calculates points by referring to the appropriate awarding conditions according to the type of amusement device associated with the generated skeletal information.

[0055] The information management unit 32 stores and manages various types of information in the database of the storage unit 18. For example, the information management unit 32 stores and manages information in the media identification information DB 41 that associates the user's skeletal information with the number of points the user has acquired with the media identification information.

[0056] The generation unit 33 generates skeletal information from the detection results of the user's body movements acquired by the information acquisition unit 31. The authentication unit 34 performs user authentication by comparing the skeletal information managed by the information management unit 32 with the skeletal information generated by the generation unit 33.

[0057] The point management unit 35 awards points to the user according to the authentication result of the user authentication performed by the authentication unit 34. Specifically, if the authentication unit 34 successfully authenticates the user, it awards points to the user. Conversely, if the authentication unit 34 fails to authenticate the user, it limits the number of points awarded to the user.

[0058] Furthermore, the point management unit 35 is capable of assigning predetermined points according to the content of the skeletal information generated by the generation unit 33. Additionally, if the skeletal information generated by the generation unit 33 includes operational quality information, the point management unit 35 is capable of assigning predetermined points according to the content of the operational quality information. Specific examples of assigning points according to the content of operational quality information will be described later.

[0059] Furthermore, the point management unit 35 estimates the user's physical characteristics (height, limb length, body proportions, etc.) from the skeletal information generated by the generation unit 33, and adjusts the point awarding conditions according to the estimated physical characteristics. This ensures fair evaluation and point awarding according to each user's physical abilities, even for users with different physical characteristics.

[0060] The point management unit 35 calculates points by integrating evaluations based on each detection result if the skeletal information generated by the generation unit 33 is an integration of detection results from multiple types of detection means. For example, if skeletal information is generated by integrating whole-body skeletal information from a camera and detailed hand and arm movement information from sensors of a handheld device, the point management unit 35 may calculate a first point based on the evaluation of the whole-body form and a second point based on the accuracy evaluation of the hand and arm movements, and then calculate the final point by summing them up or using a weighted average.

[0061] Furthermore, if skeletal information is generated associated with exercise data from exercise equipment, the point management unit 35 may integrate the exercise performance evaluation based on the exercise data and the quality evaluation of body movements based on the skeletal information to calculate an overall score. For example, in a game using an exercise bike (registered trademark), if the pedal rotation speed is above a predetermined threshold and the form evaluation of the user's hand throwing motion is high, bonus points can be awarded. This makes it possible to provide appropriate incentives to users who perform both full-body exercise using the exercise equipment and operation using body movements at a high level. Alternatively, for example, the system may determine whether user authentication and the content of the exercise are appropriate based on skeletal authentication, and then calculate incentives based on the exercise data acquired by the exercise equipment. This makes it possible to avoid awarding incentives when the exercise equipment is operated due to unintended use, and also improves the accuracy of calculating the amount of incentives.

[0062] Furthermore, the point management unit 35 determines the user's skill level with respect to the amusement device 3 based on the history of the user's skeletal information managed by the information management unit 32, and awards a predetermined value of points according to the determination result. For example, if the point management unit 35 determines that the user's skill level has improved, it can award an additional predetermined value of bonus points. A specific example of the process for determining the user's skill level will be described later.

[0063] Furthermore, the point management unit 35 enables users to pay with points when using other services. The point management unit 35 also enables the issuance of predetermined coupons and vouchers based on the value of the points.

[0064] The detection unit 36 ​​detects the existence of multiple media identification pieces associated with the same user's skeletal information based on the results of comparing the skeletal information associated with multiple media identification pieces. For example, if the skeletal information associated with each of two media identification pieces matches, the detection unit 36 ​​detects that the two media identification pieces are owned by the same user.

[0065] The transmission control unit 37 controls the communication unit 19 (see Figure 2) to transmit various types of information to the user terminal 2, the amusement device 3, and external sources. For example, the transmission control unit 37 controls the transmission of user authentication results and information regarding points assigned to the user to the user terminal 2. The transmission control unit 37 also controls the transmission of user authentication results to the amusement device 3.

[0066] <Processing flow of Management Server 1> Figure 4 is a flowchart showing an example of the process from user authentication to point awarding within the management server 1's processing. In the example shown in Figure 4, it is assumed that the management server 1 has already associated the user's skeletal information and the number of points acquired with the media identification information and manages them accordingly. When media identification information read by the amusement device 3 is transmitted to the management server 1 (YES in step S1), the management server 1 acquires the transmitted media identification information (step S2). If no media identification information has been transmitted (NO in step S1), the management server 1 repeats the decision process in step S1.

[0067] The management server 1 identifies the skeletal information associated with the media identification information acquired in step S2 (step S3). When the management server 1 receives a detection result of the user's body movement from the amusement device 3 (YES in step S4), it acquires the transmitted detection result (step S5). If, however, no detection result of the user's body movement has been transmitted (NO in step S4), the management server 1 repeats the decision process in step S4.

[0068] Management Server 1 generates skeletal information from the body movement detection results obtained in step S5 (step S6). Management Server 1 performs user authentication by comparing the user's skeletal information identified in step S3 with the skeletal information generated in step S6 (step S7). If user authentication is successful (YES in step S8), Management Server 1 awards points to the user according to the content of the skeletal information generated in step S6 (step S9) and terminates the process (END). Conversely, if user authentication fails (NO in step S8), Management Server 1 terminates the process (END) without awarding points to the user (step S10).

[0069] Figure 5 is a flowchart showing a detailed example of the process for awarding points to the user in Figure 4. Management Server 1 manages the skeletal information generated in step S6 of Figure 4 in its history (step 91). Based on the history of the user's skeletal information, Management Server 1 determines the user's skill level with respect to the amusement device 3 (step 92). If Management Server 1 determines that the user's skill level has improved (YES in step 93), it awards bonus points (step 94) and terminates the process (END). Conversely, if Management Server 1 determines that the user's skill level has not improved (NO in step 93), Management Server 1 terminates the process (END) without awarding bonus points (step 95).

[0070] <Specific example> [Specific examples of skeletal information] Figure 6 shows a specific example of skeletal information generated by the management server 1. Figure 6 shows a specific example of a skeleton image 200, which is an example of skeletal information. The skeleton image 200 shown in Figure 6 includes the joint positions, skeletal length, and body proportions of user U. In the example in Figure 6, the skeleton image 200 includes the appearance of user U, but it does not necessarily have to include the appearance of user U itself. That is, it is sufficient for the skeleton image 200 to provide information such as the joint positions, skeletal length, and body proportions of user U. Furthermore, the skeleton image 200 generated as skeletal information can be generated as a still image or a moving image.

[0071] [Specific examples of user authentication] For example, suppose user U, visiting an amusement facility, holds the identifier displayed on user terminal 2 (see Figure 1), on which this application is installed, over amusement device 3 (see Figure 1) in order to use the amusement device 3, allowing the device to read the media identification information. The amusement device 3 then transmits the media identification information to management server 1 (see Figure 1). When the user begins using amusement device 3, the amusement device 3 detects the user's physical movements and transmits the detection result to management server 1. User authentication is then performed at management server 1.

[0072] In user authentication performed by management server 1, for example, if the matching rate is determined to be 80% or higher, user authentication may be considered successful and points may be awarded according to the usage of amusement device 3. On the other hand, if the matching rate in user authentication is determined to be less than 80%, user authentication may be considered failed, and a warning message indicating this may be displayed on amusement device 3, and even if the user continues to use amusement device 3, the awarding of points may be restricted.

[0073] For example, consider a case where the first user lends their media (linked to media identification information) to the second user, and the second user uses the amusement device 3 by presenting that media identification information. In this case, the skeletal information generated from the second user's physical movements does not match (or matches poorly) the history of the first user's skeletal information, so the management server 1 determines that user authentication has failed. As a result, points are not awarded to the second user for using the amusement device 3, or the points awarded are limited. This prevents fraudulent point acquisition through lending and borrowing of media.

[0074] Furthermore, consider a case where a service is offered in which a voucher for a free drink is issued to a user who achieves a predetermined goal (for example, successfully taking five consecutive penalty kicks in soccer). In this case, it is conceivable that User 1, who is skilled at using the amusement device 3, could borrow media (linked to media identification information) from several friends, such as User 2 and User 3, and then use the amusement device 3 to achieve the goal while sequentially presenting the media identification information of each user, thereby attempting to fraudulently obtain vouchers for User 2, User 3, and others.

[0075] In this embodiment, such fraudulent activity can be prevented by skeletal authentication. Specifically, when a first user uses the amusement device 3 by presenting the media identification information of a second user, the skeletal information generated from the first user's body movements does not match the history of the second user's skeletal information, and the management server 1 determines that user authentication has failed. As a result, even if the first user achieves the goal, points or vouchers will not be awarded to the second user's media identification information, or their awarding will be restricted. Similarly, if the first user uses the media identification information of a third user or the like, user authentication will fail, and fraudulent acquisition of vouchers will be prevented. This prevents skilled users from fraudulently acquiring vouchers or points for multiple people, and ensures fairness in incentive management.

[0076] [Specific examples of point allocation based on skeletal information] For example, suppose amusement device 3 is a gaming device for performing penalty kicks in soccer, a digital sport. In this case, the skeletal information generated by management server 1 includes motion quality information such as the trajectory of the kicking foot and the overall balance of the body. In this case, the user's skill level may be determined, for example, based on an evaluation result (out of 100 points) of the form of body movements.

[0077] Furthermore, the points awarded may be determined, for example, based on the evaluation results of the physical movement form. Specifically, if the evaluation result of the physical movement form is 90 points or higher, 1.5 times the normal points may be awarded. If the evaluation result of the physical movement form is between 70 and 89 points, 1.2 times the normal points may be awarded. If the evaluation result of the physical movement form is less than 70 points, the normal points may be awarded.

[0078] Furthermore, bonus points awarded when it is determined that User U's skill level has improved may be awarded according to rules defined as follows, for example. That is, suppose User U's first visit to the amusement facility and playing the digital sport of soccer penalty kicks resulted in a score of 60 points for evaluating their physical form, and they were awarded 100 points at that time. Suppose that when User U visits the amusement facility a second time and plays the digital sport of soccer penalty kicks, their physical form was evaluated at 65 points (an increase of 5 points from the first time), and they were awarded 110 points at that time. Suppose that when User U visits the amusement facility a third time and plays the digital sport of soccer penalty kicks, their physical form was evaluated at 75 points (an increase of 15 points from the first time), and they were awarded 130 points at that time. In this case, it is determined that User U's skill level has improved, so for example, a bonus of 50 points may be awarded.

[0079] [Specific examples of point rewards in ninja games] For example, suppose amusement device 3 is a gaming device that provides a ninja-themed action game. In this game, when the user extends their hand forward, the ninja character on the screen performs the action of throwing a shuriken. The skeletal information generated by management server 1 includes motion quality information such as the trajectory of the arm, the speed of the wrist snap, and the stability of the torso.

[0080] In this case, the user's skill level may be determined, for example, based on the evaluation result (out of 100 points) of the throwing motion form. The points awarded may also be determined, for example, according to the evaluation result of the throwing motion form. Specifically, if the evaluation result of the throwing motion form is 90 points or higher, double the usual points may be awarded. Alternatively, if the evaluation result of the throwing motion form is between 70 and 89 points, 1.5 times the usual points may be awarded.

[0081] Furthermore, in games where the ninja character on screen avoids obstacles when the user performs jumping or crouching actions, skeletal information such as the vertical movement distance of the user's body, movement speed, and stability of posture upon landing is detected. Points are awarded based on this motion quality information.

[0082] [Specific examples of point rewards in games using handheld devices] For example, suppose amusement device 3 is a gaming device that combines a handheld device shaped like a sword with a markerless motion capture camera. In this case, the sensor in the handheld device detects the sword swing motion, and at the same time, the camera detects the user's body movements (e.g., stepping forward, weight shifting, etc.). Management server 1 integrates the detection results from these multiple sensors to generate skeletal information and comprehensively evaluates the form of the sword technique. Points are awarded according to the evaluation result.

[0083] [Specific examples of point awarding in exercise equipment coordination games] For example, suppose amusement device 3 is a device that links an exercise bike (registered trademark) (an example of exercise equipment) with a screen. When the user pedals the exercise bike (registered trademark), the character on the screen moves forward, and at the same time, when the user moves their hands, the character on the screen performs throwing or attacking actions. In this case, management server 1 integrates the exercise data output from the exercise bike (registered trademark) (pedal rotation speed, load, etc.) with skeletal information generated from the detection results of the user's body movements to evaluate the user's overall exercise performance. Points are awarded according to the evaluation results.

[0084] [Effects of a combined sensor configuration] As described in the embodiment above, various types of detection means can be used individually or in combination. This allows for the selection of the optimal sensor configuration depending on the type and purpose of the amusement device. For example, in games that primarily involve large whole-body movements, a camera alone can ensure sufficient detection accuracy; in games where fine hand and arm movements are important, a combination of a camera and a handheld device can acquire detailed movement information; and in games where foot movements are important, a combination of a camera and a floor sensor can accurately detect foot movements. In this way, the necessary sensor configuration can be selected for each game, eliminating the need to install expensive multi-camera configurations or numerous sensors in every game, thus reducing the overall equipment investment cost of the facility.

[0085] Furthermore, by integrating detection results from multiple types of detection methods to generate skeletal information and assigning points based on that information, it is possible to appropriately evaluate the user's multifaceted performance. For example, in exercise equipment-linked games, both the performance of full-body exercise using the equipment and the performance of operation using body movements can be evaluated, promoting overall improvement in athletic ability. This allows for the provision of a new experience that fuses fitness and entertainment, achieving both improved user health and continued use of amusement facilities.

[0086] Furthermore, by adjusting the point awarding conditions according to the user's physical characteristics estimated from skeletal information, fair evaluations can be provided to users of a wide range of ages and body types. In conventional amusement facilities, the same game settings are applied to all users, which often leads to unfairness based on body type and age. In this embodiment, evaluation criteria optimized for each user's physical characteristics can be automatically applied, allowing people of all ages and body types to enjoy the game at a difficulty level appropriate for them. This can promote family use and group use by a wide range of age groups, improving the amusement facility's ability to attract customers. In addition, fair evaluations and incentives can be provided to users with physical disabilities, realizing inclusive service provision.

[0087] <Other> Although one embodiment of the present invention has been described above, the present invention is not limited to the embodiments described above, and any modifications, improvements, etc. that can achieve the objectives of the present invention are included in the present invention.

[0088] For example, in the above-described embodiment, the amusement device 3 is configured to include detection means, but the invention is not limited to this. For example, the detection means may be independently installed at the location where the amusement device 3 is installed.

[0089] Furthermore, the skeletal information shown in Figure 6 is an example and is not particularly limited.

[0090] Furthermore, the series of processes described above can be executed by hardware or by software. In other words, the functional configuration described above is merely illustrative and not particularly limiting. That is, it is sufficient for the information processing system to have the functionality to execute the series of processes described above as a whole, and the functional blocks used to realize this functionality are not particularly limited to the examples given above.

[0091] Furthermore, the location of a functional block is not particularly limited and can be arbitrary. For example, a functional block from management server 1 may be transferred to another device, or a functional block from another device may be transferred to a server. Also, a single functional block may consist of hardware alone, software alone, or a combination of both.

[0092] When a series of processes are executed by software, the programs that make up that software are installed on a computer or other device from a network or storage medium. The computer may be a computer built into dedicated hardware. Alternatively, the computer may be a computer capable of performing various functions by installing various programs, such as a server, a general-purpose smartphone, or a personal computer.

[0093] Such recording media containing programs may consist not only of removable media (not shown) distributed separately from the main device to provide programs to users, but also of recording media provided to users in a state where they are pre-installed in the main device. Since programs can be distributed via a network, the recording media may be installed on or accessible from a computer connected to or capable of connecting to a network.

[0094] In this specification, the step of describing a program to be recorded on a recording medium includes not only processes that are performed chronologically in that order, but also processes that are not necessarily performed chronologically, but are executed in parallel or individually. Furthermore, in this specification, the term "system" refers to an overall system composed of multiple devices, means, etc.

[0095] In other words, the information processing system to which the present invention is applied can take various forms having the following configurations. (1) That is, the information processing system S to which the present invention is applied is an information processing system having: an identification information management means (for example, the information management unit 32 in Figure 3) that manages identification information (for example, the media identification information described above) associated with each predetermined medium (for example, the user terminal 2 on which the above application is installed or an IC card); a detection means (for example, the detection unit of the amusement device 3) that detects the physical movements of the user; a generation means (for example, the generation unit 33 in Figure 3) that generates skeletal information relating to the user's skeleton from the detection results of the physical movements; a granting means (for example, the point management unit 35 in Figure 3) that grants predetermined points according to the content of the skeletal information; and a skeletal management means (for example, the information management unit 32 in Figure 3) that manages the generated skeletal information and the value of the granted points associated with the identification information of the medium presented by the user. This enables the provision of amusement facilities that can offer services combining digital point management and motion capture technology.

[0096] (2) The system further includes a reading means (for example, a reading unit of the amusement device 3) for reading the identification information from the medium presented by the user, and the skeleton management means can manage the read identification information in association with the skeleton information and the point values. This makes it possible to manage skeletal information using the read identification information as a key.

[0097] (3) The skeletal management means manages motion quality information relating to the quality of the body movements by including it in the skeletal information, and the assigning means can assign predetermined points according to the motion quality information. This makes it possible to manage skeletal information, including operational quality information.

[0098] (4) The motion quality information may also include at least one of the form, speed, or precision of the body movement. This makes it possible to manage motion quality information, including the form, speed, and precision of body movements.

[0099] (5) The skeletal management means further manages the usage history of a predetermined amusement device that enables use by presenting the medium, in association with the identification information of the medium; the detection means detects the physical movements of the user who presented the medium each time the amusement device is used; the generation means generates the skeletal information of the user each time the physical movements of the user are detected; and the granting means determines the user's skill level with respect to the amusement device based on the history of the generated skeletal information, and can grant predetermined points according to the result of the skill level determination. This makes it possible to award points based on skeletal information.

[0100] (6) Furthermore, if the granting means determines that the skill level has improved, it may grant a predetermined additional point. This allows for point rewards to be given according to the user's skill level, thereby increasing the user's motivation to earn points.

[0101] (7) The system may also have an authentication means (for example, the authentication unit 34 in Figure 3) that determines whether the user is the legitimate owner of the medium or the identification information based on the result of comparing the skeleton information of the user to be authenticated, newly generated by the generation means, with the history of the skeleton information, which is managed in association with the identification information of the medium possessed by the user. This enables user authentication based on skeletal information.

[0102] (8) The granting means may also restrict the granting of points if the authentication result of the authentication means denies that the user is the legitimate owner of the medium or the identification information. This will enable the awarding of points based on the results of user authentication.

[0103] (9) The system may also have detection means (for example, the detection unit 36 ​​in Figure 3) that detects the existence of multiple media or identification information associated with the same user's skeletal information based on the results of comparing the skeletal information associated with each of the multiple media. This enables the efficient management of identification information.

[0104] (10) The system may also further include a payment management means (for example, the point management unit 35 in Figure 3) for managing the settlement of goods or services using the points associated with the identification information of the medium. This expands the range of ways points can be used, thereby increasing users' motivation to earn points.

[0105] (11) The system may also further include an issuing means (for example, the point management unit 35 in Figure 3) for issuing a predetermined coupon or voucher according to the skeletal information or the value of the points associated with the identification information of the medium. This expands the range of ways points can be used, thereby increasing users' motivation to earn points.

[0106] (12) The skeletal information may also include at least one of the joint positions of the user's body, the length of the skeleton, or body proportions. This makes it possible to manage users based on skeletal information, including the position of their joints, the length of their skeleton, and their body proportions.

[0107] (13) The generation means can generate the skeletal information based on data acquired from at least one of a motion capture camera, a depth sensor, a pressure sensor, or a LiDAR sensor. This makes it possible to generate skeletal information using various methods.

[0108] (14) The medium may be an IC card, an RFID tag, or an information processing device on which a predetermined application software is installed. This will enable the use of amusement devices in a variety of ways.

[0109] Furthermore, the information processing method to which the present invention is applied can take various forms having the following configurations. (15) That is, an information processing method to which the present invention is applied includes the steps of: managing identification information in association with each predetermined medium; detecting the user's physical movements; generating skeletal information relating to the user's skeleton from the results of detecting the physical movements; assigning predetermined points according to the content of the skeletal information; and managing the generated skeletal information and the assigned point values ​​in association with the identification information of the medium presented by the user. This enables the provision of amusement facilities that can offer services combining digital point management and motion capture technology.

[0110] Furthermore, the program to which the present invention is applied can take various forms having the following configurations. (16) That is, a program to which the present invention is applied is a program for causing a computer that controls an information processing device to execute a control process that includes the steps of: managing identification information associated with each predetermined medium; detecting the physical movements of a user; generating skeletal information relating to the user's skeleton from the results of detecting the physical movements; assigning predetermined points according to the content of the skeletal information; and managing the generated skeletal information and the assigned point values ​​associated with the identification information of the medium presented by the user. This enables the provision of amusement facilities that can offer services combining digital point management and motion capture technology. [Explanation of Symbols]

[0111] 1: Management server, 2: User terminal, 3: Amusement device, 11: CPU, 16: Output unit, 17: Input unit, 18: Storage unit, 19: Communication unit, 31: Information acquisition unit, 32: Information management unit, 33: Generation unit, 34: Authentication unit, 35: Point management unit, 36: Detection unit, 37: Transmission control unit, 41: Media identification information DB, 42: Assignment condition DB, 200: Skeleton image, N: Network, S: Information processing system, U: User

Claims

1. An identification information management means that manages identification information by associating it with each predetermined medium, A detection means for detecting the user's physical movements, A generation means for generating skeletal information relating to the user's skeleton from the detection results of the aforementioned body movements, A means for awarding predetermined points according to the content of the aforementioned skeletal information, A skeleton management means that manages the generated skeleton information and the assigned point values ​​in association with the identification information of the medium presented by the user, An information processing system having

2. The system further includes a reading means for reading the identification information from the medium presented by the user, The aforementioned skeleton management means manages the read identification information by associating it with the skeleton information and the point values. The information processing system according to claim 1.

3. The skeletal management means manages motion quality information relating to the quality of the body movements by including it in the skeletal information. The awarding means awards predetermined points according to the operation quality information. The information processing system according to claim 1.

4. The aforementioned motion quality information includes at least one of the form, speed, or precision of the body movement. The information processing system according to claim 3.

5. The aforementioned skeletal management means further manages the usage history of a predetermined amusement device that enables use by presenting the medium, by associating it with the identification information of the medium. The detection means detects the physical movements of the user presenting the medium each time the amusement device is used. The generation means generates the user's skeletal information each time the user's physical movement is detected. The awarding means determines the user's skill level with respect to the amusement device based on the history of the generated skeletal information, and awards predetermined points according to the result of the skill level determination. The information processing system according to claim 1.

6. The granting means grants predetermined additional points when it determines that the skill level has improved. The information processing system according to claim 5.

7. The system further includes an authentication means that determines whether the user is the legitimate owner of the medium or the identification information, based on the result of comparing the newly generated skeletal information of the user subject to authentication with the history of the skeletal information managed in association with the identification information of the medium possessed by the user. The information processing system according to claim 1.

8. The granting means restricts the granting of points if the authentication result of the authentication means denies that the user is the legitimate owner of the medium or the identification information. The information processing system according to claim 7.

9. The system further includes detection means for detecting the existence of multiple media or identification information associated with the same user's identification information, based on the result of comparing the skeletal information associated with each of the multiple media, The information processing system according to claim 1.

10. The system further includes a payment management means for managing the settlement of goods or services using points associated with the identification information of the medium, The information processing system according to claim 1.

11. The system further includes an issuing means for issuing a predetermined coupon or voucher according to the skeletal information or the value of the points associated with the identification information of the medium, The information processing system according to claim 1.

12. The skeletal information includes at least one of the joint positions, skeletal length, or body proportions of the user's body. The information processing system according to claim 1.

13. The generation means generates the skeletal information based on data acquired from at least one of a motion capture camera, a depth sensor, a pressure sensor, or a LiDAR sensor. The information processing system according to claim 1.

14. The aforementioned medium is one of the following: an IC card, an RFID tag, or an information processing device on which a predetermined application software is installed. The information processing system according to claim 1.

15. An information processing method performed by an information processing system, A step of associating and managing identification information for each designated medium, Steps to detect the user's body movements, The steps include generating skeletal information relating to the user's skeleton from the results of detecting the aforementioned body movements, The steps include assigning predetermined points according to the content of the aforementioned skeletal information, A step of managing the generated skeletal information and the assigned point values ​​in association with the identification information of the medium presented by the user, Information processing methods including

16. In the computer that controls the information processing device, A step of associating and managing identification information for each designated medium, Steps to detect the user's body movements, The steps include generating skeletal information relating to the user's skeleton from the results of detecting the aforementioned body movements, The steps include assigning predetermined points according to the content of the aforementioned skeletal information, A step of managing the generated skeletal information and the assigned point values ​​in association with the identification information of the medium presented by the user, A program that executes control processes, including those mentioned above.

Images