System, information processing device, and program

The system addresses the challenge of varying user exercise abilities by using exercise sensors to adjust video playback speeds based on individual contributions, facilitating synchronized exercise experiences for users with different fitness levels.

JP2024179855APending Publication Date: 2024-12-26RICOH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023099102
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-06-16
Publication Date
2024-12-26

AI Technical Summary

Technical Problem

Existing systems struggle to accommodate users with varying exercise abilities by setting a uniform or tailored video playback speed, making it difficult for multiple users with different exercise levels to participate in exercises simultaneously.

Method used

A system that includes exercise sensors to detect individual exercise levels and adjusts video playback speed based on a contribution rate specific to each user, ensuring the playback speed aligns with each user's athletic ability, allowing for synchronized exercise experiences.

Benefits of technology

Enables multiple users with diverse exercise abilities to participate in synchronized exercises by dynamically adjusting video playback speeds to match individual fitness levels, enhancing inclusivity and engagement.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024179855000001_ABST
    Figure 2024179855000001_ABST
Patent Text Reader

Abstract

To provide a system for allowing a plurality of users to easily take part in exercise at the same time.SOLUTION: According to one aspect of the present invention, a system includes an exercise device provided with an exercise sensor for outputting information about an exercise amount of a user doing exercise while viewing a video, and an information processing device provided with a display control part for controlling a display of the video. The display control part reproduces the video at a reproduction speed determined on the basis of information related to the movement amount of each of a plurality of users outputted from the exercise sensor and a contribution rate of the exercise amount to the reproduction speed of the video set in each of the plurality of users when there are the plurality of users.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a system, an information processing device, and a program. [Background technology]

[0002] 2. Description of the Related Art A system is known that changes a playback image displayed on a display device in accordance with a user's walking state, thereby allowing a user viewing the playback image to have a variety of outing experiences.

[0003] Furthermore, in order to make it easy to use a system that supports a user's exercise, a system has been disclosed that displays on a screen an image that changes according to the user's walking condition information (see, for example, Patent Document 1). Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the system described in Patent Document 1, when multiple users exercise while watching one screen, the playback speed of the video is set to be uniform or to be tailored to a specific person. Therefore, for example, if the athletic abilities of multiple users are different, the user with high athletic ability will view a video displayed at a slow playback speed relative to the amount of exercise he or she exercises when the playback speed is tailored to a user with low athletic ability. On the other hand, the user with low athletic ability will view a video displayed at a fast playback speed relative to the amount of exercise he or she exercises when the playback speed is tailored to a user with high athletic ability. In this way, in the system described in Patent Document 1, since the video is displayed at a playback speed that does not match the amount of exercise he or she exercises, there is room for improvement in that it is difficult for multiple users with different athletic abilities to participate in the exercise at the same time.

[0005] The present invention aims to provide a system that allows multiple users to easily participate in exercise at the same time. [Means for solving the problem]

[0006] A system according to one embodiment of the present invention comprises an exercise device equipped with a motion sensor that outputs information regarding the amount of exercise of a user exercising while viewing a video, and an information processing device equipped with a display control unit that controls the display of the video, and when there are multiple users, the display control unit plays the video at a playback speed determined based on information regarding the amount of exercise of each of the multiple users output from the motion sensor and a contribution rate of the amount of exercise to the playback speed of the video, which is set for each of the multiple users. Effect of the Invention

[0007] According to the present invention, a system can be provided that allows multiple users to easily participate in exercise at the same time. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating a first example of a system according to an embodiment. [Diagram 2] FIG. 13 is a diagram illustrating a second example of a system according to an embodiment. [Diagram 3] FIG. 13 is a diagram illustrating a third example of a system according to an embodiment. [Figure 4] 1 is a block diagram showing a configuration of a system according to an embodiment. [Diagram 5] 1 is a block diagram showing a functional configuration of an information processing device according to an embodiment; [Figure 6] FIG. 4 is a diagram showing a first example of a method for displaying a degree of contribution according to the embodiment. [Figure 7] FIG. 11 is a diagram showing a second example of a method for displaying a degree of contribution according to the embodiment. [Figure 8] FIG. 2 is a flow diagram showing the operation of the system according to the embodiment. [Figure 9] FIG. 4 is a diagram illustrating a contribution rate setting method according to a first example. [Figure 10] FIG. 11 is a first diagram illustrating a contribution rate setting method according to a second example. [Figure 11] FIG. 2 is a second diagram illustrating the contribution rate setting method according to the second example. [Figure 12]FIG. 13 is a diagram showing a message display function of the system according to the first modified example. [Figure 13] FIG. 11 is a diagram showing a voice output function of a system according to a second modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same components are designated by the same reference numerals, and duplicated descriptions will be omitted where appropriate.

[0010] <Overall configuration of the system according to the embodiment> The overall configuration of a system according to an embodiment will be described with reference to Figures 1 to 4. Figures 1 to 3 are diagrams illustrating a system 100 according to an embodiment. Figure 1 shows a first example of the system 100, Figure 2 shows a second example of the system 100, and Figure 3 shows a third example of the system 100. Figure 4 is a block diagram showing an example of the overall configuration of the system 100.

[0011] As shown in Figs. 1 to 4, the system 100 includes an exercise machine 1 equipped with an exercise sensor 11 that outputs information related to the amount of exercise of a user 200 exercising while viewing a video Mv, and an information processing device 2 equipped with a display control unit 24 that controls the display of the video Mv. In the example shown in Figs. 1 to 4, the system 100 also includes a display device 3, an operation unit 4, and a speaker 5. The system 100 supports the exercise of a plurality of users 200.

[0012] 1 to 3, a plurality of users 200 are performing walking exercise using a corresponding exercise machine 1 while viewing a video Mv. In the example shown in FIG. 1, four users 200 are using the system 100. One of the four users is performing walking exercise in a standing position, and three of the four users is performing walking exercise in a sitting position. In the example shown in FIG. 2, all three users 200 are using the system 100 in a standing position. In the example shown in FIG. 3, all three users 200 are using the system 100 in a sitting position.

[0013] In the example shown in Figs. 1 and 2, a moving image Mv is displayed on a display device 3 such as a liquid crystal display. In the example shown in Fig. 3, the moving image Mv is displayed on a display device 3 that is a pair of VR (Virtual Reality) glasses. The VR glasses are an example of a head-mounted display device. A user wearing the VR glasses can experience VR while viewing the moving image Mv displayed on the VR glasses. The display device 3 may be an organic EL (Electro Luminescence) display or a head mounted display (HMD), which is another example of a head-mounted display device. The display device 3 may display still images, characters, figures, etc. in addition to the moving image Mv, or may display a combination of moving images, still images, characters, figures, etc.

[0014] 1 to 3, the speaker 5 generates sounds corresponding to the footsteps of the user 200 when he / she steps, sounds that match the video Mv being played, and the like. The operation unit 4 is a user interface that allows the operator 300 to perform operation input to the information processing device 2. For example, the operator 300 can use the operation unit 4 to specify the video Mv to be displayed on the display device 3, select users who will participate in the exercise, and specify the contribution rate for each of multiple users.

[0015] The user 200 is, for example, an elderly person who requires assistance with exercise. The exercise equipment 1 is a stepping mat with a built-in motion sensor 11. The motion sensor 11 includes a pressure sensor, and outputs information about the amount of exercise of the user 200 based on the user's 200 stepping to the information processing device 2. The display control unit 24 has a functional configuration for controlling communication with the display device 3 to cause the display device 3 to display a video Mv. The display control unit 24 varies the playback speed of the video Mv displayed on the screen of the display device 3 based on the information about the amount of exercise of the user 200 from the motion sensor 11.

[0016] For example, the system 100 displays a video Mv showing scenery at a tourist spot on the display device 3 in response to the walking movement of the user 200. This allows the user 200 to walk on the foot mat with the feeling as if he or she were taking a walk in a tourist spot.

[0017] Furthermore, in this embodiment, when there are multiple users 200, the display control unit 24 plays the video Mv at a playback speed determined based on information regarding the amount of motion of each of the multiple users 200 output from the motion sensor 11 and the contribution rate of the amount of motion to the playback speed of the video Mv, which is set for each of the multiple users 200.

[0018] Here, the contribution rate refers to a ratio at which the amount of exercise detected by the exercise sensor 11 is converted into the playback speed of the video. For example, for a user 200 with low athletic ability, the contribution rate is set high to increase the playback speed relative to the amount of exercise. On the other hand, for a user 200 with high athletic ability, the contribution rate is set low to decrease the playback speed relative to the amount of exercise. In this way, by setting the contribution rate for each of the multiple users 200, even if the multiple users 200 have different athletic abilities, the video Mv can be played at a playback speed that suits the athletic abilities of all of the multiple users 200, rather than a playback speed that suits only a specific user. In addition, the user 200 can participate in an exercise performed by multiple users 200 while watching one screen, without worrying about the difference in athletic ability between the user 200 and the other users. As described above, a system 100 can be provided in which multiple users 200 can easily participate in an exercise at the same time.

[0019] From another perspective, if the playback speed of the video Mv when the user 200 with the contribution rate set to 100% walks at the reference speed V is Vm, the user 200 with the contribution rate set to 50% can achieve the playback speed Vm by walking at a speed of 2×V. Therefore, the system 100 can impart a high exercise load to the user 200 with high athletic ability in accordance with the athletic ability. On the other hand, the user with the contribution rate set to 200% can achieve the playback speed Vm by walking at a speed of 0.5×V. Therefore, the system 100 can impart a low exercise load to the user 200 with low athletic ability in accordance with the athletic ability. In this way, the system 100 can impart an appropriate exercise load to each of the multiple users 200 in accordance with the athletic ability of each of the multiple users 200.

[0020] Exercise load refers to the amount of activity. The amount of activity Ex can be expressed by the following formula using METs (Metabolic Equivalents) values. Ex = METs value × exercise time

[0021] The MET value is a characteristic value that indicates the intensity of physical activity, and is a number that indicates how many times the intensity of physical activity corresponds to the intensity of resting.<https: / / www.mhlw.go.jp / shingi / 2006 / 11 / s1109-5g.html> Table 1 shows the portion of the walking exercise summary (see ). As shown in Table 1, there is a proportional relationship between MET value and walking speed. For this reason, when expressing exercise load as the amount of activity, a faster walking speed results in a greater exercise load when compared for the same exercise duration.

[0022] [Table 1]

[0023] The display control unit 24 can also display a characteristic value obtained based on the amount of exercise and the contribution rate. Such a characteristic value can include the degree of contribution to the playback speed of a video, which is the product of the contribution rate and the amount of exercise. By displaying the degree of contribution on the screen, each of the multiple users 200 can recognize the amount of exercise that he or she aims for, and therefore can participate in the exercise while maintaining motivation for the exercise. In addition, by displaying the difference in the amount of exercise with other users 200 as a characteristic value based on the contribution rate, the user 200 can participate in the exercise without feeling guilty.

[0024] In this specification, the contribution rate is set according to the athletic ability of the multiple users 200 as an example, but the contribution rate can also be set according to physical strength, physical condition, or the presence or absence of a physical handicap.

[0025] 4, the system 100 includes an exercise machine 1 and an information processing device 2. The information processing device 2 is communicatively connected to an external server 400 via a network N such as the Internet or a LAN (Local Area Network). The external server 400 stores video set files, setting files, and the like.

[0026] The system 100 inputs a moving image Mv stored in an external server 400 via the network N and displays it on the display device 3. The system 100 can also display a moving image Mv stored in the information processing device 2 on the display device 3. The system 100 can also store the moving image Mv in the information processing device 2 via a recording medium such as a Universal Serial Bus (USB) memory. The system 100 can also download the moving image Mv from a content server into the information processing device 2. Furthermore, the system 100 can play the moving image Mv by streaming without storing the moving image Mv in the information processing device 2.

[0027] The information processing device 2 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, a HDD (Hard Disk Drive) / SSD (Solid State Drive) 204, and an I / F (Interface) 205. These are electrically connected to each other via a bus line L.

[0028] The CPU 201 is an arithmetic device that executes sequential branch processing, iterative processing, and the like by executing a program stored in the ROM 202. The ROM 202 is a non-volatile memory that stores the programs and the like to be executed by the CPU 201. The RAM 203 is a memory that functions as a work area for the operation of the CPU 201. The bus line L is an address bus, a data bus, or the like for electrically connecting each component of the CPU 201, etc.

[0029] The I / F 205 transmits and receives information such as data and signals by controlling communications with the exercise machine 1, the display device 3, the operation unit 4, and the speaker 5 connected to the information processing device 2. The I / F 205 can also transmit and receive information to and from an external server 400 via the network N.

[0030] <Example of functional configuration of information processing device 2> 5 is a block diagram showing an example of a functional configuration of the information processing device 2. The information processing device 2 can have an exercise amount evaluation unit 21, a rhythm provision unit 22, and a storage unit 23 in addition to the display control unit 24 described above.

[0031] The functions of the exercise amount evaluation unit 21, the rhythm provision unit 22, and the display control unit 24 are realized by the CPU 201 in Fig. 4 executing processes defined in the programs stored in the ROM 202, etc. The function of the storage unit 23 is realized by the HDD / SSD 204 in Fig. 4, etc.

[0032] The exercise amount evaluation unit 21 inputs information related to the amount of exercise output from the exercise sensor 11 and executes a process of evaluating the exercise of the user 200. The rhythm providing unit 22 periodically generates sounds and vibrations so that the user 200 can walk at a predetermined rhythm while viewing the video Mv, thereby providing a rhythm to the user 200. Depending on the evaluation result by the exercise amount evaluation unit 21, the information processing device 2 can give the user 200 a pace for walking by providing a rhythm using vibrations and sounds by the rhythm providing unit 22.

[0033] The storage unit 23 can store a moving image set file 231, a setting file 232, a user data file 233, and an audio assist file 234. The moving image set file 231 is a file that records a moving image Mv. The setting file 232 is a file that records the display conditions and contribution rate of the display device 3, the reference value for the motion sensor 11, etc. The user data file 233 is a file that records the past exercise amount for each of the multiple users 200. The audio assist file 234 is a file that records audio to be played in accordance with information about the moving image Mv and information about the exercise amount.

[0034] The information processing device 2 can receive the video set file 231 and the setting file 232 stored in the external server 400 shown in Fig. 4 via the network N and store them in the storage unit 23. The information processing device 2 can also transmit the user data file 233 via the network N and store it in the external server 400. The method for sending and receiving this information is not limited to via the network N, and a USB memory, a memory card, or the like may also be used.

[0035] <Example of how to control video playback speed> A method for controlling the playback speed of the video Mv by the display control unit 24 will be described using as an example a walking motion in which the walking speed of stepping is a measurement value. The display control unit 24 controls the playback speed of the video Mv displayed on the display device 3 based on the stepping speed of the user 200 detected by the motion sensor 11 of the exercise tool 1, i.e., the walking speed.

[0036] Here, the reference motion speed is V, the playback speed of the video Mv is Vm, and the contribution rate is P. If the three users 200 are classified as A, B, and C, and their respective contribution rates are P_A, P_B, and P_C, and their walking speeds are V_A, V_B, and V_C, the display control unit 24 can calculate the playback speed Vm' of the video Mv from the following formula (1). Vm'=(P_A×V_A+P_B×V_B+P_C×V_C) / 3V×Vm ···(1)

[0037] (Pattern 1) If the contribution rate P_A is set to 50%, the contribution rate P_B to 100%, and the contribution rate P_C to 100%, then unless Person A walks at twice the walking speed of Persons B and C, the playback speed of the video Mv will not reach the reference playback speed. Therefore, the exercise load on Person A can be increased.

[0038] (Pattern 2) The contribution rate P_A is set to 200%, the contribution rate P_B to 100%, and the contribution rate P_C to 100%. By doubling the contribution rate of Person A, when Person A walks at a walking speed of 0.5×V and Persons B and C walk at a walking speed of V, the contributions to the playback speed of the video Mv will be equal among Persons A, B, and C. This makes it possible to reduce the excessive exercise load on Person A, who has low physical ability.

[0039] (Pattern 3) Set the contribution rate P_A to 100%, the contribution rate P_B to 100%, and the contribution rate P_C to 50%. If C is 1.4×V, A is 0.3×V, and B is 0.2×V, the playback speed will be slower than patterns 1 and 2.

[0040] Table 2 below shows a list of the walking speeds, contribution rates, contribution degrees, and video playback speeds for the above-mentioned patterns 1 to 3. [Table 2]

[0041] As described above, by changing the contribution rate of each of the multiple users 200's walking speed, the exercise of all users is reflected in the playback speed of the video Mv, and it is possible to raise the awareness of each individual's exercise. In addition, by making the contribution rates different, a user 200 with a high contribution rate plays a role in manipulating the playback speed more than other users 200, and therefore, an effect of being more aware of exercise is obtained.

[0042] 6 and 7 are diagrams showing a method of displaying the degree of contribution to the playback speed of a video Mv. Fig. 6 is a first example showing the degree of contribution of each of A, B, and C with an indicator. Fig. 7 is a second example showing the degree of contribution of each of A, B, and C with characters including a numerical value.

[0043] The indicator shown in Fig. 6 includes a graphic that visually displays the degree of contribution of each of Persons A, B, and C. The degree of contribution increases as the position of line 31 moves in the direction of arrow 32. Characters 33 such as 45 points shown in Fig. 7 represent the degree of contribution numerically. The larger the value of character 33, the higher the degree of contribution.

[0044] By displaying the degree of contribution by the indicator line 31 or the characters 33, the user 200 can compare his / her own exercise status with the exercise status of other users. The user 200 can participate in the exercise without feeling nervous because the comparison can be made based on the characteristic value of the degree of contribution.

[0045] The system 100 can control the exercise load by setting a standard walking speed for each individual. For example, the system 100 can use each individual's average walking speed as a standard and reflect the degree of exercise load in the playback speed of the video Mv. If the average walking speed of person A is (V_A), the average walking speed of person B is (V_B), and the average walking speed of person C is (V_C), then the playback speed Vm' of the video Mv can be expressed by the following formula (2). Vm'=(P_A×V_A / (V_A)'+P_B×V_B / (V_B)'+P_C×V_C / (V_C)') / 3×Vm ···(2)

[0046] The exercise equipment 1 is not limited to a stepping mat, but may be a stepper, an exercise bike (registered trademark), a running machine, a walking machine, etc. The motion sensor 11 detects the walking speed in walking exercise or a stepper, etc., the rotation speed of the pedals in an exercise bike, the rotation speed of the belt in a walking machine, etc. The system 100 can vary the playback speed of the video Mv according to the output of the motion sensor 11. Table 3 below shows a list of detection targets for the amount of exercise for each of the various exercise equipment 1. [Table 3]

[0047] It is possible to control the load in steppers, exercise bikes, walking machines, etc. In steppers, the load can be controlled by pressure, in exercise bikes, the weight of the pedals, and in walking machines, the load can be controlled by the rotational speed of the conveyor that rotates and runs with the user 200 on it. In the system 100, the contribution rate can also be set to reflect such exercise load.

[0048] Furthermore, multiple users 200 may exercise using multiple types of exercise equipment 1 on one screen of the display device 3. In this case, the average of the stepping mat is (V_A)', the average of the stepper is (V_B)', and the average of the exercise bike is (V_C)', and the playback speed of the video Mv can be varied based on the detected values ​​of each, using the above-mentioned formula (2). In other words, the display control unit 24 can vary the contribution rate based on the amount of exercise detected when multiple types of exercise equipment 1 are used. This makes it possible to provide a system 100 that makes it easy for multiple users 200 to participate in exercise at the same time, even when multiple types of exercise equipment 1 are used. The contribution rate is not limited to the calculation result by the display control unit 24, and any numerical value may be freely set.

[0049] <Example of operation of system 100> Fig. 8 is a flowchart showing an example of the operation of the system 100. Fig. 8 shows an example of the operation of the system 100 to support exercise of a plurality of users 200. The system 100 starts the operation of Fig. 8 when an operation to start exercise by an operator using the operation unit 4 is accepted as a start condition.

[0050] First, in step S11, the system 100 acquires, via the operation unit 4, information such as the name of each of the multiple users 200 who will participate in the exercise using the system 100.

[0051] Next, in step S12, the system 100, through the display control unit 24, refers to the setting file 232 of the storage unit 23 based on the information of each of the multiple users 200 to acquire the reference value, the contribution rate, and the user name. Note that the display control unit 24 may randomly acquire the contribution rate from the setting file 232 and assign it to each of the multiple users 200, or may assign it to each of the multiple users 200 according to an input using the operation unit 4.

[0052] Next, in step S13, the system 100 starts playing the video Mv on the display device 3 under the control of the display control unit 24. Thereafter, the display device 3 continuously plays the video Mv until the playback of the video Mv is stopped in accordance with an end condition.

[0053] Next, in step S14, the system 100 starts generating sound or vibration from the speaker 5 under the control of the rhythm providing unit 22 or the display control unit 24. After that, the speaker 5 continues generating sound or vibration until the generation of sound or vibration is stopped in accordance with the end condition.

[0054] Next, in step S15, the system 100 detects the amount of exercise of each of the multiple users 200 using the motion sensor 11, and outputs information related to the amount of exercise to the information processing device 2. Thereafter, the motion sensor 11 performs detection and output of the amount of exercise at a predetermined cycle until detection of the amount of exercise of the users 200 is stopped in accordance with a termination condition.

[0055] The order of steps S13 to S15 may be changed as appropriate, or each step may be performed in parallel.

[0056] Next, in step S16, the system 100 determines the playback speed of the video Mv by the display control unit 24 based on information on the amount of exercise of each of the multiple users 200 output from the motion sensor 11 and the contribution rate of the amount of exercise to the playback speed of the video Mv set for each of the multiple users 200. When multiple types of exercise equipment 1 are used, the playback speed of the video Mv is determined according to information from the motion sensors 11 of the different types of exercise equipment 1.

[0057] Next, in step S17, the system 100 changes the playback speed of the video Mv on the display device 3 to the playback speed determined in step 16, by the display control unit 24. The multiple users 200 can view the video Mv displayed on the display device 3 at the changed playback speed. Note that if the playback speed determined in step S16 is the same as before the change, the display control unit 24 does not need to change the playback speed of the video Mv.

[0058] Next, in step S18, the system 100 calculates the degree of contribution of each of the multiple users 200 by integrating the contribution rate and the amount of exercise of each of the multiple users 200 using the display control unit 24.

[0059] Next, in step S19, the system 100 displays the degree of contribution calculated in step S18 by the display control unit 24. The multiple users 200 can visually recognize the degree of contribution displayed on the display device 3.

[0060] Next, in step S20, the system 100 determines whether or not to end the operation of the system 100 using the information processing device 2. For example, the information processing device 2 can determine whether or not to end the operation of the system 100 in response to an operation input by the operator via the operation unit 4 to end exercise, etc.

[0061] If it is determined in step S20 that the process should not end (step S20, NO), system 100 performs the operations from step S15 onwards again. System 100 repeats the operations from step S15 onwards until it is determined in step S20 that the process should end. When performing the operations from step S15 onwards, the determination of the playback speed (step S16) and the calculation of the contribution degree (step S17) are performed periodically, for example, when 1 / 4 of the entire playback time of the video Mv has elapsed, when 1 / 2 of the entire playback time of the video Mv has elapsed, when 3 / 4 of the entire playback time of the video Mv has elapsed, etc.

[0062] On the other hand, if it is determined in step S20 that the process is to end (step S20, YES), system 100 stops detection of the amount of activity of each of multiple users 200 by motion sensor 11 in step S21.

[0063] Next, in step S22, the system 100 causes the speaker 5 to stop generating sound or vibration.

[0064] Next, in step S23, the system 100 stops the playback of the moving image Mv on the display device 3.

[0065] The order of steps S21 and S22 may be changed as appropriate, or each step may be performed in parallel.

[0066] When the detection of the amount of movement by the movement sensor 11, the generation of sound or vibration by the speaker 5, and the reproduction of the moving image Mv by the display device 3 all stop, the system 100 ends its operation.

[0067] In this manner, the system 100 can assist a plurality of users 200 in exercising.

[0068] <Examples of how to set various contribution rates> (Example 1) In the first example, the contribution rate of each of the multiple users 200 participating in the exercise is varied for each playback period into which a video Mv is divided. Fig. 9 is a diagram for explaining the contribution rate setting method according to the first example.

[0069] In FIG. 9, playback periods T1 to T4 are four periods obtained by dividing the playback period of the video Mv. For example, by setting the largest contribution rate for each of the playback periods to different users 200, each of the users 200 can recognize which playback period he or she should work hard on walking. Also, by setting a playback period with a contribution rate of 0% as a rest period, the users 200 can clearly recognize the period in which they should take a rest. The contribution rate for each of the playback periods may be set randomly by the system 100, or may be set manually by the user 200 via the operation unit 4.

[0070] Table 4 shown below shows an example of setting the contribution rate for each of the three users 200, A, B, and C, for each of a plurality of playback periods T1 to T4. [Table 4]

[0071] In the playback period T4, the system 100 allocates the contribution rate equally. In other words, the display control unit 24 controls the playback speed of the video Mv using the average value of the amount of exercise of each of the multiple users 200. This can improve everyone's awareness of exercise.

[0072] In the playback periods T1 to T3, the system 100 sets the contribution rate of the user 200 with the fastest or slowest walking speed to 100%, and the contribution rates of the other users 200 to 0%. In other words, the display control unit 24 controls the playback speed of the video Mv using the maximum amount of exercise of each of the multiple users 200. This makes it possible to make the playback speed of the video Mv dependent on the users 200, and have them compete to see who will take on that role. Alternatively, the system can make them exercise in accordance with the person with the slowest walking speed.

[0073] In addition, a threshold may be used to change the amount of exercise to 0% for users 200 who are too slow, so that the video can be played back continuously using the amount of exercise that excludes users 200 who stopped exercising midway.

[0074] The system 100 may change the contribution rate based on the type of exercise equipment 1 and the scene of the video Mv. For example, on a paved road, the contribution rate of bicycle exercise (exercise bike) is set to 1.1 times that of walking exercise (foot mat, walking machine, etc.), thereby making the exercise load lighter compared to 200 users walking. On the other hand, on a mountain path where it is difficult to ride a bicycle, the contribution rate is set to 0.5 times, thereby making the exercise load heavier compared to 200 users walking. In this way, by changing the contribution rate based on the type of exercise equipment 1 and the scene of the video Mv, an exercise load can be applied to the user 200.

[0075] Table 5 below shows the relationship between video scenes, types of exercise equipment 1, and contribution rates. [Table 5]

[0076] The system 100 can set the contribution rate for each playback period after detecting the amount of exercise in step S15 of the flowchart shown in Fig. 8. Furthermore, when referring to the amount of exercise of the user 200 who exercises the most among the multiple users 200 in setting the contribution rate, the system 100 can set the contribution rate of the user 200 who exercises the most to 100% and the contribution rates of the other users to 0%.

[0077] (Example 2) In the second example, the contribution rate set for each of the multiple users 200 is varied depending on the state of stepping during the walking motion of each of the multiple users 200.

[0078] 10-11 are diagrams illustrating differences in detection signals by motion sensor 11 according to the state of stepping during exercise using a stepping mat. In Figs. 10-11, the horizontal axis represents time t (ms) and the vertical axis represents detection signals (mV) by motion sensor 11. The solid line graph shows the detection signal when the right foot contacts the stepping mat, and the dashed line graph shows the detection signal when the left foot contacts the stepping mat.

[0079] Fig. 10 shows a detection signal by the motion sensor 11 when walking so that the entire sole of the foot is in contact with the stepping mat. Fig. 11 shows a detection signal by the motion sensor 11 when walking so that only the tip of the foot (toe) is in contact with the stepping mat.

[0080] As shown in Figs. 10-11, in the exercise using the stepping mat, the detection signal by the motion sensor 11 is different between the case where the user walks with the entire sole of the foot in contact with the stepping mat and the case where the user walks with only the toes in contact with the stepping mat. For example, the system 100 stores in advance in the storage unit a specified voltage value (in Figs. 10-11, the change in voltage value with the pressure of the stepping: voltage waveform) corresponding to the standard correct exercise as a reference value. The system 100 compares the voltage value / voltage waveform of the detection signal by the motion sensor 11 with the specified voltage value / voltage waveform, and sets the contribution rate low according to the deviation from the specified voltage value / voltage waveform. In other words, the system 100 stores in advance a reference value, which is information on the amount of exercise associated with the standard exercise, and the display control unit 24 performs control to compare the information on the amount of exercise output from the motion sensor 11 with the reference value and set the contribution rate low for users with deviations. This allows a lower contribution rate to be set for users who walk with only the toes in contact with the stepping mat than for users who walk with the entire sole of the foot in contact with the stepping mat. From another perspective, the display control unit 24 can control the playback speed of the video Mv based on the contribution rate according to the exercise state of the user 200. By displaying the set contribution rate on the display device 3, the system 100 can make each of the multiple users 200 recognize whether or not he or she is walking in an appropriate state, and can encourage the users to walk in an appropriate state.

[0081] This example is applicable not only to exercise using a stepping mat, but also to exercise using an exercise bike or a walking machine, and the contribution rate can be varied based on the state of the exercise, such as variations in progress speed.

[0082] <Other preferred modifications> The system 100 can output information encouraging the user 200 to take action based on the information on the amount of exercise of the user 200 and the contribution rate through the display control unit 24. This "output" includes display by the display device 3, audio output by the speaker 5, and the like.

[0083] (First Modification) The system 100 can encourage the user 200 to perform additional actions according to the contribution rate. If the user 200 has a low contribution rate, even if the user 200 slows down his / her stepping, this does not have a large effect on the playback speed of the video Mv. Therefore, by instructing the user to move his / her hands or do mental exercises, the system 100 can encourage the user 200 to perform actions other than walking.

[0084] FIG. 12 is a diagram for explaining the message display function of the system 100 according to the first modified example. In FIG. 12, if the user 200 (person A), who is the only one exercising at a walking speed much faster than the reference speed, is asked to slow down his walking speed, the playback speed of the video Mv can be slowed down. Therefore, the system 100 displays a message on the display device 3 saying, "Person A, you're doing a great job. Let's try stretching a little. There's an apple on the ground, let's pick it up!". By displaying a message encouraging person A to stretch, the system 100 can make person A stretch and slow down his walking speed. In addition, the system 100 can encourage the user 200 to do mental exercises by displaying a question together with the video Mv on the display device 3, thereby improving cognitive function.

[0085] (Second Modification) The system 100 can also support the exercise of each of the multiple users 200 by outputting sound based on the biometric information (heart rate, blood pressure, respiration, etc.), exercise information (walking speed, etc.), and usage history information of the users 200. That is, the display control unit 24 can output information encouraging the users 200 to perform an action based on the biometric information of the users 200, information related to the amount of exercise, and the contribution rate.

[0086] To obtain biometric information of the user 200, the system 100 can use a pulse sensor attached to the ear, a blood pressure sensor attached to the fingertip, a respiratory rate sensor attached to the chest, and the like. For example, based on an increase or decrease in walking speed compared to the previous detection value by each sensor, a message according to the degree of fatigue can be output as voice to support exercise. The voice output may be a pre-recorded one, or a mechanical sound generated at any time may be output.

[0087] Fig. 13 is a diagram illustrating the audio output function of the system 100 according to the second example. In the example shown in Fig. 13, the system 100 outputs a message such as "Mr. C, hang in there a little longer!" by the speaker 5.

[0088] For example, after detecting the amount of exercise in step S15 of the flowchart shown in Fig. 8, the system 100 compares the detected amount of exercise with a predetermined target value by the display control unit 24. If the amount of exercise deviates from the target value by a predetermined threshold or more, a corresponding message can be displayed by the display device 3 or audibly output by the speaker 5. On the other hand, if the detected amount of exercise is less than the predetermined threshold with respect to the target value, the walking motion can be continued as is.

[0089] The display control unit 24 can prompt the user 200 to perform an action other than walking by outputting information for prompting the user 200 to perform an action based on the bio-information of the user 200, information related to the amount of exercise, and the contribution rate.

[0090] Although the embodiments have been described above, the present invention is not limited to the above specifically disclosed embodiments, and various modifications and changes are possible without departing from the scope of the claims.

[0091] The information processing system according to the embodiment may be configured so that some or all of the functions of the information processing device 2 are realized by an external device such as a cloud server. Also, the information processing system according to the embodiment may be configured so that some or all of the functions of the information processing device 2 are realized by multiple computers performing distributed processing.

[0092] The ordinal numbers, quantities, and other numbers used in the description of the embodiments are all provided as examples to specifically explain the technology of the present invention, and the present invention is not limited to the exemplified numbers. Furthermore, the connection relationships between the components are provided as examples to specifically explain the technology of the present invention, and do not limit the connection relationships that realize the functions of the present invention.

[0093] Each function of the embodiment can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and a device such as an ASIC (Application Specific Integrated Circuit), a DSP (digital signal processor), an FPGA (field programmable gate array), or a conventional circuit module designed to execute each function described above.

[0094] For example, aspects of the present invention are as follows. <1> The system comprises an exercise machine equipped with a motion sensor that outputs information regarding the amount of exercise of a user exercising while viewing a video, and an information processing device equipped with a display control unit that controls the display of the video, wherein when there are multiple users, the display control unit plays the video at a playback speed determined based on information regarding the amount of exercise of each of the multiple users output from the motion sensor and a contribution rate of the amount of exercise to the playback speed of the video, which is set for each of the multiple users. <2> the display control unit displays a characteristic value obtained based on the amount of exercise and the contribution rate. <1> The system is as described in <3> The display control unit varies the contribution rate based on the amount of exercise detected when a plurality of types of exercise equipment are used. <1> or the above <2> The system is as described in <4> the display control unit controls a playback speed of the video by using either an average value or a maximum value of the amount of exercise of each of the users. <1> From the above <3> The system according to any one of the above items. <5> The display control unit controls a playback speed of the video based on the contribution rate according to the exercise state of the user. <1> From the above <4> The system according to any one of the above items. <6> The display control unit varies the contribution rate depending on a scene in the video. <1> From the above <5> The system according to any one of the above items. <7> the display control unit sets the contribution rate, for the user in which there is a discrepancy between the information on the amount of exercise output from the exercise sensor and a predetermined reference value of the amount of exercise corresponding to a reference exercise, to be lower than a case in which there is no discrepancy; <1> From the above <6> The system according to any one of the above items. <8> the display control unit outputs information that prompts the user to take an action based on at least the information regarding the amount of exercise and the contribution rate. <1> From the above <7> The system according to any one of the above items. <9> The user exercises while viewing the video displayed on a head-mounted display device. <1> From the above <8> The system according to any one of the above items. <10> The information processing device is equipped with a display control unit that controls the display of the video based on information regarding the amount of exercise of a user exercising while viewing a video, and when there are multiple users, the display control unit plays the video at a playback speed determined based on information regarding the amount of exercise of each of the multiple users and a contribution rate of the amount of exercise to the playback speed of the video, which is set for each of the multiple users. <11> The display control unit controls the display of the video based on information regarding the amount of exercise of a user exercising while viewing the video, and when there are multiple users, the display control unit plays the video at a playback speed determined based on information regarding the amount of exercise of each of the multiple users and the contribution rate of the amount of exercise to the playback speed of the video, which is set for each of the multiple users. [Explanation of symbols]

[0095] 1 exercise equipment 2. Information processing equipment 21 Momentum Evaluation Section 22 Rhythm Provision Department 23 Memory section 231 Video Set File 232 Configuration File 233 User Data File 234 Voice Assist File 24 Display control section 201 CPU 202 ROM 203 RAM 204 HDD / SSD 205 Interface 3 Display device 31 Line 32 Arrow 33 characters 4 Control section 5 Speakers 100 Systems 200 users 300 Operator 400 External Server L Bus Line Mv video N Network T1~T4 period [Prior art documents] [Patent documents]

[0096] [Patent Document 1] JP 2023-008123 A

Claims

1. An exercise machine having an exercise sensor that outputs information about the amount of exercise of a user who exercises while viewing a video; an information processing device including a display control unit that controls display of the video; The display control unit, when there are multiple users, plays the video at a playback speed determined based on information regarding the amount of movement of each of the multiple users output from the motion sensor and the contribution rate of the amount of movement to the playback speed of the video, which is set for each of the multiple users.

2. The system according to claim 1 , wherein the display control unit displays a characteristic value obtained based on the amount of exercise and the contribution rate.

3. The system according to claim 1 , wherein the display control unit varies the contribution rate based on the amount of exercise detected when a plurality of types of exercise equipment are used.

4. The system according to claim 1 , wherein the display control unit controls a playback speed of the video by using either an average value or a maximum value of the amount of activity of each of the users.

5. The system according to claim 1 , wherein the display control unit controls a playback speed of the video based on the contribution rate according to an exercise state of the user.

6. The system according to claim 1 , wherein the display control unit varies the contribution rate depending on a scene in the video.

7. The system described in claim 1, wherein the display control unit sets the contribution rate for a user for whom there is a discrepancy between the information regarding the amount of exercise output from the exercise sensor and a predetermined reference value for the amount of exercise corresponding to a reference exercise to a lower rate than when there is no discrepancy.

8. The system according to claim 1 , wherein the display control unit outputs information encouraging the user to take an action based on at least the information regarding the amount of exercise and the contribution rate.

9. The system according to claim 1 , wherein the user exercises while viewing the video displayed on a head-mounted display device.

10. a display control unit that controls display of the video based on information about an amount of exercise of a user who exercises while viewing the video; The display control unit, when there are multiple users, plays the video at a playback speed determined based on information regarding the amount of exercise of each of the multiple users and a contribution rate of the amount of exercise to the playback speed of the video, which is set for each of the multiple users.

11. A display control unit controls display of the video based on information regarding an amount of exercise of the user who is exercising while viewing the video; The display control unit is a program that, when there are multiple users, plays the video at a playback speed determined based on information regarding the amount of exercise of each of the multiple users and a contribution rate of the amount of exercise to the playback speed of the video, which is set for each of the multiple users.

Citation Information

Patent Citations

  • Information processing system, exercise supporting system, information processing method, and program

    JP2023008123A