PROGRAM AND INFORMATION PROCESSING APPARATUS

Abstract

To provide a technology that can further increase interest when a user uses exercise equipment. [Solution] The program causes the computer to function as a tempo acquisition unit that acquires information indicating the tempo of the movements of a user using exercise equipment, and a determination unit that determines the music to be played or the playback speed of the music being played when it is determined that the tempo has become constant.

Description

[Technical field]

[0001] The present invention relates to a program and an information processing device.

[0002] Patent Document 1 discloses a technology which includes a feature point detection unit which detects feature points in a series of movements of an exercise apparatus using the output of a sensor unit, a feature point calculation unit which calculates the time difference between each detection timing (feature point interval), an average value calculation unit which calculates the average value aAV of feature point intervals for a predetermined number of times, and a music data selection unit which selects appropriate music data based on the average value aAV, and which further includes a playback speed adjustment unit which, when beat data associated with the selected music data indicates a beat interval b1 that does not satisfy aAV=b×m (m is a positive natural number), detects a beat interval b1' that is closest to the beat interval b1 among beat intervals that satisfy the formula, and sets the music data to be played back at a playback speed equivalent to this beat interval b1'. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2010-005040 Summary of the Invention [Problem to be solved by the invention]

[0004] The technology disclosed in Patent Document 1 can provide an exercise device that can improve the appeal of the exercise device and increase the user's motivation to continue using the exercise device.

[0005] Meanwhile, there is a demand for technology that can further increase the interest of users when using exercise equipment.

[0006] The present invention has been made in consideration of the above circumstances, and an object of the present invention is to provide a technique that can further increase the interest of a user when using exercise equipment. [Means for solving the problem]

[0007] In order to solve the above problem, a program according to a first aspect of the present invention causes a computer to function as a tempo acquisition unit that acquires information indicating the tempo of a user's movements using exercise equipment, and a determination unit that determines the music to be played or the playback speed of the music being played when it is determined that the tempo has become constant.

[0008] In a second aspect of the present invention, the music to be played or the playback speed is stored in association with the tempo, and the determination unit determines the music or the playback speed according to the tempo.

[0009] In addition, in a third aspect of the present invention, a tempo determination section is provided which determines that the tempo has become constant depending on whether or not the continuously acquired tempo satisfies a time condition or a number of times condition.

[0010] In addition, in a fourth aspect of the present invention, an image acquisition unit is provided that continuously acquires images including the user as a subject from an imaging device, and the tempo acquisition unit acquires the tempo by analyzing the images.

[0011] In a fifth aspect of the present invention, the exercise equipment further includes a vibration acquisition unit that acquires vibrations from a vibration sensor attached to the exercise equipment or the user, and the tempo acquisition unit converts the vibrations into the tempo.

[0012] In a sixth aspect of the present invention, the exercise equipment is a treadmill, and includes a speed acquisition unit that acquires the speed at which the user is moving forward from a speed sensor attached to the treadmill, and a display control unit that controls the position at which the lyrics of the music appear or the size of the lyrics of the music depending on the speed.

[0013] In addition, an information processing device according to a seventh aspect of the present invention includes a tempo acquisition unit that acquires information indicating the tempo of the movements of a user using exercise equipment, and a determination unit that determines the music to be played or the playback speed of the music being played when it is determined that the tempo has become constant. Effect of the Invention

[0014] According to the present invention, it is possible to provide a technique that can further increase a user's interest when using exercise equipment. [Brief description of the drawings]

[0015] [Figure 1] 1 is a diagram illustrating an example of a hardware configuration of an information processing device 10 and devices connected to the information processing device 10. FIG. [Diagram 2] FIG. 2 is a diagram illustrating an example of an overview of a service according to an embodiment. [Diagram 3] 1 is a block diagram illustrating an example of functional means of an information processing device 10 according to an embodiment. [Figure 4] 11 is a flowchart showing an example of a processing flow of control of music or the playback speed of music performed by each functional unit in the information processing device 10 according to the first specific example of the embodiment. [Diagram 5] FIG. 2 is a diagram showing an example of a table TB that stores a user's tempo in association with the playback speed of music to be played or music being played. [Figure 6] FIG. 13 is a diagram for conceptually explaining tempo determination. [Figure 7] 11 is a flowchart showing an example of a processing flow of control of music or the playback speed of music performed by each functional unit in an information processing device 10 according to a specific example 2 of the embodiment. [Figure 8] 4 is a flowchart showing an example of a flow of display control processing performed by each functional unit in the information processing device 10 according to the embodiment. [Figure 9]FIG. 13 is a diagram showing an example of how information displayed on a display device 38 changes over time when a user US using a treadmill TM moves forward at a fast speed. [Figure 10] 13 is a diagram showing an example of how information displayed on a display device 38 changes over time when a user US using a treadmill TM moves forward slowly. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings.

[0017] ---Embodiment--- First, an embodiment will be described.

[0018] <Hardware configuration> FIG. 1 is a diagram illustrating an example of a hardware configuration of an information processing device 10 and devices connected to the information processing device 10. As shown in FIG.

[0019] 1, the information processing device 10 includes a control device 20, a communication device 26, and a storage device 28. The information processing device 10 is a computer. The control device 20 mainly includes a CPU (Central Processing Unit) 22 and a memory 24.

[0020] In the control device 20, the CPU 22 executes a predetermined program stored in the memory 24 or the storage device 28, etc., to function as various functional means. The details of these functional means will be described later.

[0021] The communication device 26 is configured with an interface for communicating with devices such as the sound output device 30, the imaging device 32, the vibration sensor 34, the speed sensor 36, and the display device 38 by wired communication or wireless communication. In the case of wired communication, the communication device 26 may use a connection standard such as a wired LAN network based on IEEE 802.3, USB, or Thunderbolt. In the case of wireless communication, the communication device 26 may use a wireless communication standard such as Bluetooth (registered trademark) or Wi-Fi (registered trademark) or the TCP / IP protocol used in these communications.

[0022] The storage device 28 is configured with a hard disk, etc. This storage device 28 stores various programs and various information required for executing the processes in the control device 20, and information on the results of the processes.

[0023] The sound output device 30 refers to a general acoustic device for outputting music, and may include acoustic equipment such as speakers, headphones, and earphones as specific examples. These devices as the sound output device 30 may be further subdivided according to their applications or functions. For example, the sound output device 30 may include devices that emphasize portability or convenience of installation, such as sound bars, portable speakers, and Bluetooth speakers, equipment for providing a high-quality acoustic environment, such as sound systems and home theater systems, and multi-function devices such as smart speakers. The sound output device 30 may also include devices for special applications, such as bone conduction headphones, noise canceling headphones, canal-type earphones, and completely wireless earphones. Furthermore, the sound output device 30 may include specialized acoustic equipment that is used by connecting to a music amplifier, such as a monitor speaker for musical instruments.

[0024] The imaging device 32 is a device that captures an image of a subject and generates an image, and is configured, for example, by a camera module equipped with an imaging element such as a CCD or a CMOS. The imaging device 32 can capture images continuously or can capture moving images, and may have a zoom function as necessary.

[0025] The vibration sensor 34 is a sensor for detecting vibrations applied to an object. The vibration sensor 34 is attached to, for example, an exercise machine or a user US. The vibration sensor 34 may be configured by, for example, an acceleration sensor, a gyro sensor, a piezoelectric sensor, a microphone, an optical fiber sensor, a MEMS sensor, a resonant sensor, a capacitance sensor, a cantilever, or the like.

[0026] The speed sensor 36 is a sensor for detecting the speed at which the user US advances. The speed sensor 36 may be provided in the exercise equipment, may not be provided in the exercise equipment, or may be attached to the user US. When provided in the exercise equipment, the speed sensor 36 is attached to a movable part of the exercise equipment and outputs as an electric signal. This electric signal is used to convert the speed. For example, when the exercise equipment is a treadmill TM, a rotary encoder is used for the speed sensor 36, and the rotation of a motor, roller, pulley, etc. may be output as an electric signal. When not provided in the exercise equipment, the speed sensor 36 may detect data observing the user US by a camera, LiDAR, RADAR, etc. The observed data is used to convert to speed. When attached to the user US, the speed sensor 36 may detect data such as the frequency and intensity of the user US's exercise using an acceleration sensor, switch, etc. These data are used to convert to speed.

[0027] The exercise equipment is equipment used by the user US to exercise the body. In the embodiment, the exercise equipment is described as a treadmill TM, but is not limited to this. The exercise equipment may be equipment that is expected to be used by the user US without significantly disrupting the tempo, and may be, for example, a rodeo bike, an exercise bike, a cross trainer, a stepper, a vibration machine, a rowing machine, a fitness chair, an elliptical machine, or the like. The treadmill TM may include the concept of a treadmill and a running machine.

[0028] The display device 38 is, for example, a display, a projector, or the like, and is configured to be able to display information visually recognized by the user US. The display may include a head-mounted display worn by the user US. The display may be performed in the form of AR (Augmented Reality), VR (Virtual Reality), or the like.

[0029] <Business model overview> FIG. 2 is a diagram showing an example of an outline of a service according to an embodiment. In the example of FIG. 2, a user US uses a treadmill TM as an exercise machine, listens to music emitted from a speaker as a sound output device 30, and sees lyrics displayed on a display as a display device 38. In the example of FIG. 2, an image of the user US is captured by an imaging device 32, vibrations are acquired by a vibration sensor 34 attached to the treadmill TM, and speed is acquired by a rotary encoder as a speed sensor 36. These exercise machines, devices, and sensors are merely examples, and any of the exercise machines, devices, and sensors described above may be used. The music changes in accordance with the tempo of the movement of the user US, as described later. The lyrics change in accordance with the speed of the treadmill TM, as described later.

[0030] <Functional means> FIG. 3 is a block diagram illustrating an example of functional means of the information processing device 10 according to the embodiment.

[0031] As shown in FIG. 3, the information processing device 10 has, as its functional configuration, a playback unit 40, an image acquisition unit 42, a vibration acquisition unit 44, a tempo acquisition unit 46, a tempo determination unit 48, a determination unit 50, a speed acquisition unit 52, a speed determination unit 54, a display control unit 56, and a memory control unit 58.

[0032] The playback unit 40 controls at least one of the music to be played and the playback speed.

[0033] The image acquisition unit 42 acquires the image captured by the imaging device 32 .

[0034] The vibration acquisition unit 44 acquires the vibration detected by the vibration sensor .

[0035] The tempo acquisition unit 46 analyzes the tempo of the subject's movement from the image acquired by the image acquisition unit 42, and acquires the tempo. The tempo acquisition unit 46 also analyzes the tempo of the movement of the user US from the vibration acquired by the vibration acquisition unit 44, and acquires the tempo. The tempo acquired by the tempo acquisition unit 46 is information indicating the tempo of the movement of the user US. The tempo acquired by the tempo acquisition unit 46 is, for example, the rhythm of a user's behavior with a certain periodicity (for example, swinging arms, moving legs, shaking the head at a certain cycle, etc.). In this specification, the tempo may include the concept of BPM (Beat Per Minute).

[0036] The tempo determination unit 48 determines whether the acquired tempo has become constant.

[0037] The determination unit 50 determines the playback speed of the music or music.

[0038] The speed acquisition unit 52 acquires the speed detected by the speed sensor 36 .

[0039] The speed determination unit 54 determines whether the acquired speed has become constant.

[0040] The display control unit 56 has a function of controlling an image to be displayed on the display device 38 based on the display information. This display information is a concept including not only the information itself generated in a form visible to the user US, such as a screen, an image, an icon, and text, but also rendering information for displaying the information.

[0041] The memory control unit 58 has a function of storing various information in the memory device 28. The memory control unit 58 is realized by one or more memory devices 28. Functional means other than the memory control unit 58 are realized by the control device 20 executing programs stored in the memory device 28 or the like.

[0042] <Processing flow> The following describes the process flow of changing music or changing the playback speed performed by each functional unit in the information processing device 10 according to the embodiment. Note that the order and contents of the steps in the flowchart shown below can be changed as appropriate. In the following, it is assumed that the user US starts using the exercise equipment when the information processing starts.

[0043] (Example 1) In this embodiment, FIG. 4 is a flowchart showing an example of a process flow of music or playback speed control performed by each functional unit in the information processing device 10 according to the specific example 1 of the embodiment.

[0044] (Step SP10) First, the playback unit 40 plays music from the sound output device 30. The music to be played may be determined in advance, or may be determined by an instruction from the user US. Then, the process proceeds to step SP12.

[0045] (Step SP12) Next, the playback unit 40 determines whether or not the music playback end condition is satisfied. If the playback unit 40 determines that the music playback end condition is not satisfied, it shifts the process to step SP14. On the other hand, if the playback unit 40 determines that the music playback end condition is satisfied, it ends the information process shown in Fig. 4. The end condition is to stop the music playback, to stop using the treadmill TM, etc. The information process of step SP12 may be incorporated into the loop process of SP14, SP16, and SP18, and is not limited to the position in Fig. 4.

[0046] (Step SP14) Next, data for acquiring the tempo of the user US is acquired. Specifically, for example, the imaging device 32 continuously captures images including the user US as a subject in real time. Then, the image acquisition unit 42 continuously acquires the images from the imaging device 32 in real time. Then, the process proceeds to the process of step SP16.

[0047] (Step SP16) Next, the tempo acquisition unit 46 acquires information indicating the tempo of the movement of the user US using the exercise equipment. In the specific example 1, the tempo acquisition unit 46 acquires the tempo by analyzing the image. For example, in this analysis, the position change and the movement pattern of the subject between consecutive image frames are analyzed to quantify the tempo. The tempo acquisition unit 46 may focus on the movement of the joints of the user US, for example, to detect the speed and / or rhythm of the bending and extending movement of the knee and / or elbow. In addition, when analyzing the image, the focus may be on the movement of the main parts of the body of the user US, such as the movement of the legs, the swing of the arms, and the up and down movement of the head. Furthermore, by attaching a marker to a specific part of the user US and tracking the movement of that part, it is possible to acquire the tempo with higher accuracy. Then, the process proceeds to the process of step SP18.

[0048] (Step SP18) Next, the tempo determination unit 48 determines whether the continuously acquired tempo has become constant. If the tempo determination unit 48 determines that the tempo has become constant, it shifts the process to step SP20. If the tempo determination unit 48 determines that the tempo has not become constant, it shifts the process to step SP12.

[0049] A constant tempo is determined based on whether or not the tempo satisfies a time condition or a number of conditions.

[0050] The time condition indicates that the fluctuation range of the tempo acquired within a certain period of time in the recent past falls within a specific range. The time until it is judged to be constant can be set by, for example, a fixed value, customized by the user, or dynamically set in conjunction with the speed of the treadmill TM. In the fixed value setting, a fixed time (e.g., 2 seconds, 5 seconds, etc.) pre-installed in the system is used. In the user US customization, the user can set any time according to his / her preference. In the dynamic setting linked to the speed of the treadmill TM, the judgment time is automatically adjusted according to the running speed. For example, the judgment time may be set longer as the exercise intensity increases, such as 3 seconds when walking at 6 km / h, 5 seconds when jogging at 12 km / h, and 7 seconds when running at 18 km / h, so that minute fluctuations at high speeds can be absorbed and more stable judgment can be made.

[0051] The number of times condition is a criterion for judging whether or not the tempo fluctuation width of a predetermined number of times (e.g., 8 times) among the most recent multiple (e.g., 10) acquired tempos falls within a specific range. The predetermined number of times may be set to be equal to the number of acquired tempos.

[0052] The tempo fluctuation range may be set according to the user US's preference, or may be automatically changed depending on the speed at which the user US exercises. For example, when the user US exercises at a speed of 6 km / h, the fluctuation range is set to within 5 BPM, whereas when the user US exercises at a speed of 12 km / h, a larger fluctuation range is permitted due to the increased exercise intensity, and the fluctuation range may be set to within 10 BPM. Also, the fluctuation range may be composed of only one value and may not have a range as a practical value.

[0053] (Step SP20) Next, when it is determined that the tempo of the movements of the user US has become constant, the determination unit 50 determines the music to be played back or determines the playback speed of the music being played back, depending on the tempo.

[0054] For example, if the user US has a high tempo of movement, the determination unit 50 may determine to play up-tempo music or to increase the playback speed of the music being played. For example, if the user US has a low tempo of movement, the determination unit 50 may determine to play down-tempo music or to decrease the playback speed of the music being played. This is expected to match the rhythm of the user US's movement and the music, improving exercise performance.

[0055] The music or playback speed may be determined based on data previously stored in the storage device 28 in association with the tempo of the movements of the user US, as shown in FIG. 5. When the determination unit 50 uses the value of the tempo of the movements of the user US by referring to the table TB, etc., the determination unit 50 uses, as the tempo value, any statistical value among multiple tempo values ​​that fall within the fluctuation range when determined to be constant. The statistical value is the average value, median value, mode value, maximum value, minimum value, etc. The storage control unit 58 stores the table TB in the storage device 28.

[0056] FIG. 5 is a diagram showing an example of a table TB that stores the tempo of the user US in association with the playback speed of the music to be played or the music being played. As shown in FIG. 5, when the tempo of the user US's movements is within the range of 0 BPM to 80 BPM, the determination unit 50 increases the playback speed of the current music by 0.8 times. When the tempo of the user US's movements is within the range of 81 BPM to 96 BPM, the determination unit 50 plays song A. When the tempo of the user US's movements is within the range of 97 BPM to 120 BPM, the determination unit 50 increases the playback speed of the current music by 1.3 times. When the tempo of the user US's movements is within the range of 121 BPM to 132 BPM, the determination unit 50 plays song B and increases the playback speed by 1.5 times.

[0057] (Step SP22) The playback section 40 then plays back the music as determined by the determination section 50. Thereafter, the process proceeds to step SP12, where the tempo of the movement of the user US is obtained again.

[0058] Fig. 6 is a diagram for conceptually explaining tempo determination. The graph in Fig. 6 has tempo on the vertical axis and time on the horizontal axis.

[0059] When the user US exercises on the treadmill TM, the tempo fluctuates as the speed is gradually increased, and then when the speed stabilizes, the tempo also tends to settle at a constant level. During this process, the tempo determination unit 48 continuously monitors the change in tempo and determines whether the tempo is constant or not based on the number of times or time condition described above.

[0060] The tempo determination unit 48 analyzes the data shown in Fig. 6 and determines that the tempo is constant between t1 and t2 and between t3 and t4. It is considered that the tempo fluctuation is within a preset tolerance range during these periods. On the other hand, the tempo determination unit 48 determines that the tempo is not constant during other time periods, particularly between t1 and t2 and t3, and further in the region after t4. This suggests that the user US may be in the process of adjusting the forward speed or that unstable movement due to fatigue may be occurring.

[0061] The determination unit 50 receives the determination result from the tempo determination unit 48 and takes appropriate action for the period in which the tempo is determined to be constant. More specifically, for example, in response to the determination that the tempo is constant between t1 and t2 and between t3 and t4 in Fig. 6, the determination unit 50 determines music and / or music playback speeds optimized for the respective periods. In this way, by adapting the rhythm of the music to the user's movements, an environment that improves the user experience can be provided.

[0062] (Example 2) In Specific Example 1, the tempo is obtained from image data, but in Specific Example 2, the tempo is obtained from vibration. Fig. 7 is a flowchart showing an example of the processing flow of the control of the music to be played or the music playback speed performed by each functional means in the information processing device 10 according to Specific Example 2 of the embodiment. The information processing of steps SP30, SP32, SP38, SP40, and SP42 in Specific Example 2 is substantially the same as the information processing of steps SP10, SP12, SP18, SP20, and SP22 in Specific Example 1, and therefore a description of these information processing will be omitted.

[0063] (Step SP34) First, the vibration acquisition unit 44 acquires vibrations generated from the exercise equipment and the body of the user US via the vibration sensor 34. More specifically, for example, the vibration sensor 34 detects a wide range of vibrations, from minute vibrations caused by the structure of the exercise equipment and the body movement of the user US to large shocks and rhythms. These vibration signals are then transmitted to the vibration acquisition unit 44, where signal processing is performed. This signal processing includes identifying the type and pattern of vibration, and analyzing the frequency and intensity, thereby grasping the characteristics of the exercise and the movement rhythm of the user. Then, the process proceeds to the process of step SP36.

[0064] (Step SP36) Next, the tempo acquisition unit 46 converts the information indicating the vibration acquired from the vibration sensor 34 into a tempo, thereby acquiring a tempo according to the rhythm of the exercise or movement. More specifically, for example, the tempo acquisition unit 46 acquires the tempo by analyzing two elements: the timing at which the vibration is detected and the strength of the vibration. More specifically, for example, the tempo acquisition unit 46 detects the timing of the moment when the vibration occurs, measures the interval, and converts it into a tempo indicating the rhythm or pace. Then, the process proceeds to step SP38.

[0065] In the embodiment, the processing of the flowchart shown in Fig. 8 may be executed independently of or in parallel with the processing of the flowchart shown in Fig. 4 or Fig. 7. Fig. 8 is a flowchart showing an example of the flow of display control processing performed by each functional unit in the information processing device 10 according to the embodiment.

[0066] (Step SP50) First, the display control unit 56 displays the lyrics of the music so that the lyrics move according to a default setting. At this time, there may be a default setting for each piece of music. Then, the process proceeds to step SP52.

[0067] (Step SP52) Next, the display control unit 56 determines whether or not the condition for ending the display of lyrics is satisfied. If the display control unit 56 determines that the condition for ending the display of lyrics is not satisfied, it shifts the process to the process of step SP54. On the other hand, if the display control unit 56 determines that the condition for ending the display of lyrics is satisfied, it terminates the information process shown in Fig. 8. The termination conditions include stopping the playback of music, stopping the use of the treadmill TM, and stopping the display of lyrics. The information process of step SP52 may be incorporated into the process of SP54 and SP56, which are loop processes, and is not limited to the position in Fig. 8.

[0068] (Step SP54) Next, the speed acquisition unit 52 acquires the forward speed of the user US from the speed sensor 36 attached to the treadmill TM. As described above, the speed is acquired by any speed sensor 36, but in this embodiment, it is acquired by a rotary encoder. Furthermore, by using a rotary encoder as the speed sensor 36, it is possible to implement this embodiment by attaching it to any treadmill TM. Then, the process proceeds to the process of step SP56.

[0069] (Step SP56) Next, the speed determination unit 54 determines whether the forward speed of the user US has become constant. If the speed determination unit 54 determines that the speed has become constant, it shifts the process to the process of step SP58. On the other hand, if the speed determination unit 54 determines that the speed has not become constant, it shifts the process to the process of step SP52.

[0070] (Step SP58) Next, the display control unit 56 controls the position where the lyrics of the music appear or the size of the lyrics of the music to be displayed on the display device 38 according to the speed at which the user US moves forward. For example, the display control unit 56 synchronizes the timing of displaying the lyrics with the speed at which the user US is running. More specifically, for example, the display control unit 56 displays lyrics that change quickly for a user US running at a fast pace, and displays lyrics that change slowly for a user US running at a slow pace. More specifically, the display control unit 56 may control the display as shown in Figs. 9 and 10.

[0071] Fig. 9 is a diagram showing an example of the change over time of information displayed on display device 38 when the user US using the treadmill TM moves forward quickly. Meanwhile, Fig. 10 is a diagram showing an example of the change over time of information displayed on display device 38 when the user US using the treadmill TM moves forward slowly. These figures visually represent how the displayed information changes depending on the forward moving speed of the user US. In the examples of Figs. 9 and 10, the following differences can be seen in the way lyrics are displayed depending on the forward moving speed of the user US using the treadmill TM.

[0072] Specifically, when the user US using the treadmill TM moves forward at a faster speed as shown in FIG. 9, the display control unit 56 controls the initial display position of the lyrics to be further back on the screen than in the case of FIG. 10. When the lyrics appear, the lyrics are displayed small to create a sense of distance, depth, and the like. The display control unit 56 also controls the speed at which the lyrics are enlarged to be relatively faster than in the case of FIG. 10. In other words, the display control unit 56 controls the characters to become larger more rapidly than in the case of FIG. 10. The display control unit 56 also controls the display time of each lyric to be relatively shorter than in the case of FIG. 10. When one second has elapsed since the lyrics appeared, the lyrics are displayed larger and lower than they were one second ago.

[0073] On the other hand, specifically, when the user US using the treadmill TM moves forward slowly as shown in FIG. 10, the display control unit 56 controls the initial display position of the lyrics to be displayed from the back of the screen as in FIG. 9, but controls the initial size to be larger than in FIG. 9. The display control unit 56 also controls the speed at which the lyrics are enlarged to be relatively slower than in FIG. 9. In other words, the display control unit 56 controls the size of the characters to be larger more slowly than in FIG. 9. The display control unit 56 also controls the display time of each lyric to be relatively longer than in FIG. 9. At the point in time when two seconds have passed since the lyrics appeared, the lyrics are displayed lower and more enlarged than they were two seconds ago, thereby creating a sense of distance, depth, and the like.

[0074] In another example, the display control unit 56 may control the characters to expand without moving on the screen. In another example, the display control unit 56 may display the characters with a different visual effect, such as by changing the color of the characters.

[0075] <Effects> In the above embodiment, a program causes a computer to function as a tempo acquisition unit that acquires information indicating the tempo of a user's movements using exercise equipment, and as a determination unit that determines the music to be played or the playback speed of the music being played when it is determined that the tempo has become constant.

[0076] According to this configuration, the playback speed of the music to be played or the music being played is selected in accordance with the tempo of the user's movements, allowing the user to enjoy music in sync with their exercise movements.

[0077] Further, the music to be played or the playback speed is stored in correspondence with the tempo, and the determination unit determines the music or the playback speed according to the tempo.

[0078] According to this configuration, the music to be played or the playback speed of the music to be played is selected in accordance with the tempo of the user's movements, so that the user can enjoy music that matches their exercise movements.

[0079] The program according to (1) further includes a tempo determination unit that determines that the tempo has become constant depending on whether the continuously acquired tempo satisfies a time condition or a number of times condition.

[0080] According to this configuration, it is possible to determine whether the tempo has become constant based on a time condition or a number of times condition.

[0081] The program according to (1) further includes an image acquisition unit that continuously acquires images including the user as a subject from an imaging device, and the tempo acquisition unit acquires the tempo by analyzing the images.

[0082] According to this configuration, the tempo can be determined from the image, so no special device is required.

[0083] The program according to (1) further includes a vibration acquisition unit that acquires vibrations from a vibration sensor attached to the exercise equipment or the user, and the tempo acquisition unit converts the vibrations into the tempo.

[0084] According to this configuration, the tempo can be determined by vibration, so no special device is required.

[0085] The program according to any one of (1) to (5), further comprising: a speed acquisition unit that acquires the speed at which the user is moving forward from a speed sensor attached to the treadmill; and a display control unit that controls the position at which the lyrics of the music appear or the volume of the lyrics of the music depending on the speed.

[0086] With this configuration, it is possible to change the display of lyrics of music that the user is listening to according to the speed at which the user is moving forward using the treadmill, and it is also possible to provide a technology that can further increase the user's interest when using the treadmill.

[0087] The information processing device also includes a tempo acquisition unit that acquires information indicating the tempo of the movements of a user using exercise equipment, and a determination unit that determines the music to be played or the playback speed of the music being played when it is determined that the tempo has become constant.

[0088] According to this configuration, the playback speed of the music to be played or the music being played is selected in accordance with the tempo of the user's movements, allowing the user to enjoy music in sync with their exercise movements.

[0089] ---Variations--- The present invention is not limited to the above-described embodiment. In other words, the above-described embodiment may be modified by a person skilled in the art as appropriate, and the modifications may be included within the scope of the present invention as long as they include the characteristics of the present invention. In addition, the elements of the above-described embodiment and the modifications described below may be combined to the extent technically possible, and the combinations of these may be included within the scope of the present invention as long as they include the characteristics of the present invention.

[0090] In a modified example, the processes executed by the tempo acquisition unit 46, the tempo determination unit 48, the determination unit 50, the speed determination unit 54, and the display control unit 56 may be performed using a trained model. For example, the tempo acquisition unit 46 may output information indicating the tempo of the user's motion based on data indicating an image or vibration and the trained model. The tempo determination unit 48 determines whether the tempo of the user's motion is constant or not based on the acquired tempo of the user's motion and the trained model. The determination unit 50 determines the optimal music and / or music playback speed based on the value of the tempo of the user's motion and the trained model. The speed determination unit 54 determines whether the speed is constant or not based on the acquired speed of the exercise equipment and the trained model. The display control unit 56 controls the information to be displayed on the display device 38 based on the trained model.

[0091] The trained model is generated using acquired data such as images, vibrations, tempo, and speed as training data. The trained model may be constructed by a learning method such as supervised learning, unsupervised learning, or self-supervised learning. In supervised learning, machine learning is performed using training data (training data). The training data is composed of pairs of input data for learning and output data (correct answer data). The trained model may be a general-purpose natural language processing learning model such as Large Language Models (LLM) that have been trained with a huge amount of data.

[0092] In a variant, the music may not include lyrics, in which case the information processing shown in FIG.

[0093] (Appendix 1) Computer, a speed acquisition unit that acquires the forward speed of the user from a speed sensor attached to the treadmill; functioning as a display control unit that controls the position at which lyrics of the music appear or the volume of the lyrics of the music according to the speed; program.

[0094] (Appendix 2) The program described in Appendix 1, wherein the display control unit, when it is determined that the user using the treadmill is moving forward at an increased speed, controls the size of the lyrics when they appear to be smaller, increases the speed at which the lyrics are enlarged, and reduces the display time of the lyrics relatively.

[0095] The present disclosure may be an information processing method for causing an information processing device to execute the program of the embodiment. [Explanation of symbols]

[0096] 10: Information processing device 32: Imaging device 34: Vibration sensor 36: Speed ​​sensor 42: Image acquisition unit 44: Vibration acquisition section 46: Tempo acquisition section 48: Tempo judgment section 50: Decision section 54: Speed ​​acquisition section 56: Display control section TM: Treadmill US :User

Claims

1. Computer, a tempo acquisition unit that acquires information indicating a tempo of a user's movement using the treadmill; a determination unit that determines a piece of music to be played or determines a playback speed of the music being played when it is determined that the tempo has become constant; a speed acquisition unit that acquires an operating speed of the treadmill from a speed sensor attached to the treadmill; functioning as a display control unit that controls a position where lyrics of the music appear or a size of the lyrics of the music according to the motion speed; program.

2. A computer, a tempo acquisition unit that acquires information indicating a tempo of a user's movement using the treadmill; a tempo determination unit that determines that the tempo has become constant based on whether or not the continuously acquired tempo satisfies a time condition; When it is determined that the tempo has become constant, the device functions as a determination unit that determines the music to be played or determines the playback speed of the music being played; The time condition is adjusted in conjunction with the speed of the treadmill. program.

3. The music to be played or the playback speed is stored in association with the tempo, The determination unit determines the music or the playback speed according to the tempo.

3. The program according to claim 1 or 2.

4. an image acquisition unit that continuously acquires images including the user as a subject from an imaging device; the tempo acquisition unit acquires the tempo by analyzing the image.

3. The program according to claim 1 or 2.

5. a vibration acquisition unit that acquires vibrations from a vibration sensor attached to the treadmill or the user; The tempo acquisition unit converts the vibration into the tempo.

3. The program according to claim 1 or 2.

6. A tempo acquisition unit that acquires information indicating the tempo of a user's movement using a treadmill; a determination unit that determines a piece of music to be played or determines a playback speed of the music being played when it is determined that the tempo has become constant; a speed acquisition unit that acquires an operating speed of the treadmill from a speed sensor attached to the treadmill; a display control unit that controls a position where lyrics of the music appear or a size of the lyrics of the music according to the motion speed; An information processing device comprising:

7. A tempo acquisition unit that acquires information indicating the tempo of a user's movement using a treadmill; a tempo determination unit that determines that the tempo has become constant based on whether or not the continuously acquired tempo satisfies a time condition; a determination unit that determines the music to be played or determines the playback speed of the music being played when it is determined that the tempo has become constant; The time condition is adjusted in conjunction with the speed of the treadmill. Information processing device.

Images