Program and Information Processing Device

Abstract

This technology provides the ability to further enhance the enjoyment users experience when using exercise equipment. [Solution] The program causes the computer to function as a tempo acquisition unit that acquires information indicating the tempo of the movements of a user using exercise equipment, and a determination unit that determines the music to be played or the playback speed of the music being played when it is determined that the tempo has become constant.

Description

Technical Field

[0001] The present invention relates to a program and an information processing apparatus.

[0002] In Patent Document 1, there are provided a feature point detection unit that detects feature points in a series of movements of an exercise apparatus using the output of a sensor unit, a feature point interval calculation unit that calculates the time difference (feature point interval) between each detection timing, an average value calculation unit that calculates an average value aAV of the feature point intervals for a predetermined number of times, and a music data selection unit that selects appropriate music data based on the average value aAV. Also, when the beat data associated with the selected music data indicates a beat interval b1 that does not satisfy aAV = b×m (m is a positive natural number), a beat interval b1' that most closely approximates the beat interval b1 among the beat intervals that satisfy the above formula is detected, and a playback speed adjustment unit is provided that is set to perform a playback process of the music data at a playback speed corresponding to this beat interval b1'.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] With a technique such as that of Patent Document 1, it is possible to provide an exercise apparatus that can improve the attractiveness of the exercise apparatus and enhance the user's continuous willingness to use the exercise apparatus.

[0005] By the way, there is a demand for a technique that can further improve the interest when a user uses an exercise device.

[0006] This invention has been made in view of these circumstances, and aims to provide a technology that can further enhance the enjoyment users experience when using exercise equipment. [Means for solving the problem]

[0007] To solve the above problems, the program according to the first aspect of the present invention causes the computer to function as a tempo acquisition unit that acquires information indicating the tempo of the movements of a user using an exercise machine, and a determination unit that determines the music to be played or the playback speed of the music being played when it is determined that the tempo has become constant.

[0008] Furthermore, in a second aspect of the present invention, the music to be played or the playback speed is stored in association with the tempo, and the determination unit determines the music or the playback speed according to the tempo.

[0009] Furthermore, in a third aspect of the present invention, a tempo determination unit is provided that determines whether the continuously acquired tempo has become constant based on whether or not it satisfies a time condition or a count condition.

[0010] Furthermore, in a fourth aspect of the present invention, an image acquisition unit is provided that continuously acquires images including the user as the subject from an imaging device, and the tempo acquisition unit acquires the tempo by analyzing the images.

[0011] Furthermore, in a fifth aspect of the present invention, a vibration acquisition unit is provided that acquires vibrations from the exercise equipment or a vibration sensor attached to the user, and the tempo acquisition unit converts the vibrations into a tempo.

[0012] Furthermore, in a sixth aspect of the present invention, the exercise equipment is a treadmill, and comprises a speed acquisition unit that acquires the speed at which the user moves forward from a speed sensor attached to the treadmill, and a display control unit that controls the position where the lyrics of the music appear or the volume of the lyrics of the music according to the speed.

[0013] Furthermore, an information processing device according to a seventh aspect of the present invention includes a tempo acquisition unit that acquires information indicating the tempo of a user's movements using an exercise device, and a determination unit that determines the music to be played or the playback speed of the music being played when it is determined that the tempo has become constant. [Effects of the Invention]

[0014] According to the present invention, it is possible to provide a technology that can further enhance the user's enjoyment when using exercise equipment. [Brief explanation of the drawing]

[0015] [Figure 1] This diagram schematically shows the hardware configuration of the information processing device 10 and an example of each device connected to the information processing device 10. [Figure 2] This figure shows an example of the service outline according to the embodiment. [Figure 3] This is a schematic block diagram showing an example of the functional means of the information processing device 10 according to the embodiment. [Figure 4] This flowchart shows an example of the processing flow for controlling music or the playback speed of music performed by each functional means in the information processing device 10 according to specific example 1 of the embodiment. [Figure 5] This figure shows an example of a table TB that stores a correspondence between the user's tempo and the music being played or the playback speed of the music currently being played. [Figure 6] This is a diagram to conceptually explain how tempo is determined. [Figure 7] This flowchart shows an example of the processing flow for controlling music or the playback speed of music performed by each functional means in the information processing device 10 according to specific example 2 of the embodiment. [Figure 8] This flowchart shows an example of the processing flow for display control performed by each functional means in the information processing device 10 according to the embodiment. [Figure 9]FIG. is a diagram showing an example of the temporal change of the information displayed on the display device 38 when the user US using the treadmill TM moves forward at a high speed. [Figure 10] FIG. is a diagram showing an example of the temporal change of the information displayed on the display device 38 when the user US using the treadmill TM moves forward at a low speed.

BEST MODE FOR CARRYING OUT THE INVENTION

[0016] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0017] ---EMBODIMENT--- First, the embodiment will be described.

[0018] <HARDWARE CONFIGURATION> FIG. 1 is a diagram schematically showing an example of the hardware configuration of the information processing apparatus 10 and each apparatus connected to the information processing apparatus 10.

[0019] As shown in FIG. 1, the information processing apparatus 10 includes a control apparatus 20, a communication apparatus 26, and a storage apparatus 28. The information processing apparatus 10 is a computer. The control apparatus 20 mainly includes a CPU (Central Processing Unit) 22 and a memory 24.

[0020] In the control apparatus 20, the CPU 22 functions as various functional means by executing a predetermined program stored in the memory 24 or the storage apparatus 28 or the like. Details of this functional means will be described later.

[0021] The communication device 26 is configured with interfaces to communicate with devices such as the sound output device 30, imaging device 32, vibration sensor 34, speed sensor 36, and display device 38 via wired or wireless communication. In the case of wired communication, the communication device 26 may use connection standards such as a wired LAN network based on IEEE 802.3, USB, or Thunderbolt. In the case of wireless communication, the communication device 26 may use wireless communication standards such as Bluetooth® or Wi-Fi®, or the TCP / IP protocol used for these communications.

[0022] The storage device 28 is composed of a hard disk or the like. This storage device 28 stores various programs and information necessary for executing processing in the control device 20, as well as information on the processing results.

[0023] The sound output device 30 refers to all audio devices for outputting music, and may include, for example, audio equipment such as speakers, headphones, and earphones. These devices as sound output devices 30 may be further subdivided depending on their application or function. For example, the sound output device 30 may include devices that prioritize portability or ease of installation, such as soundbars, portable speakers, and Bluetooth speakers; equipment that provides a high-quality acoustic environment, such as sound systems and home theater systems; and multi-functional devices such as smart speakers. The sound output device 30 may also include devices for special applications, such as bone conduction headphones, noise-canceling headphones, in-ear earphones, and true wireless earphones. Furthermore, the sound output device 30 may include specialized audio equipment used in conjunction with a music amplifier, such as monitor speakers for musical instruments.

[0024] The imaging device 32 is a device that captures a subject and generates an image, and is composed of a camera module equipped with an image sensor such as a CCD or CMOS. The imaging device 32 can capture images continuously or capture video, and may have a zoom function as needed.

[0025] The vibration sensor 34 is a sensor for detecting vibrations applied to an object. The vibration sensor 34 is attached, for example, to exercise equipment or a user US. The vibration sensor 34 may be composed of, for example, an acceleration sensor, a gyro sensor, a piezo sensor, a microphone, an optical fiber sensor, a MEMS sensor, a resonant sensor, a capacitive sensor, a cantilever, etc.

[0026] The speed sensor 36 is a sensor for detecting the speed at which the user US moves forward. The speed sensor 36 may be installed on the exercise equipment, or it may not be installed on the exercise equipment, or it may be attached to the user US. When installed on the exercise equipment, the speed sensor 36 is attached to a movable part of the exercise equipment and outputs an electrical signal. This electrical signal is used to convert speed. For example, if the exercise equipment is a treadmill™, a rotary encoder may be used for the speed sensor 36, and the rotation of the motor, rollers, pulleys, etc. may be output as an electrical signal. When not installed on the exercise equipment, the speed sensor 36 may detect data observing the user US using a camera, LiDAR, RADAR, etc. The observed data is used to convert speed. When attached to the user US, the speed sensor 36 may use an accelerometer, switch, etc. to detect data such as the frequency and intensity of the user US's movements. This data is used to convert speed.

[0027] Exercise equipment is equipment used by a user (US) to move their body. In this embodiment, the exercise equipment is described as a treadmill™, but is not limited to this. The exercise equipment may also be equipment that the user (US) is expected to use without significantly disrupting their tempo, such as a rodeo machine, exercise bike, fitness bike, elliptical trainer, stepper, vibration machine, rowing machine, fitness chair, elliptical machine, etc. The treadmill™ may also include the concepts of a running runner and a running machine.

[0028] The display device 38 is, for example, a display, a projector, etc., and is configured to display information that the user US can see. The display may include a head-mounted display worn by the user US. The display may be performed using AR (Augmented Reality), VR (Virtual Reality), etc.

[0029] <Business Model Overview> Figure 2 shows an example of the service outline according to the embodiment. In the embodiment, in the example shown in Figure 2, the user US uses a treadmill TM as exercise equipment, listens to music emitted from a speaker (sound output device 30), and views lyrics displayed on a display device 38. Also in the example shown in Figure 2, an image of the user US is captured by an imaging device 32, vibrations are acquired by a vibration sensor 34 attached to the treadmill TM, and speed is acquired by a rotary encoder (speed sensor 36). These exercise equipment, devices, and sensors are merely examples, and any of the aforementioned exercise equipment, devices, and sensors may be used. The music changes in accordance with the tempo of the user US's movements, as described later. The lyrics change in accordance with the speed of the treadmill TM, as described later.

[0030] <Functional means> Figure 3 is a schematic block diagram showing an example of the functional means of the information processing device 10 according to the embodiment.

[0031] As shown in Figure 3, the information processing device 10 has the following functional configuration: a playback unit 40, an image acquisition unit 42, a vibration acquisition unit 44, a tempo acquisition unit 46, a tempo determination unit 48, a determination unit 50, a speed acquisition unit 52, a speed determination unit 54, a display control unit 56, and a storage control unit 58.

[0032] The playback unit 40 controls at least one of the following: the music to be played and the playback speed.

[0033] The image acquisition unit 42 acquires the image captured by the imaging device 32.

[0034] The vibration acquisition unit 44 acquires the vibrations detected by the vibration sensor 34.

[0035] The tempo acquisition unit 46 analyzes the tempo of the subject's movement from the image acquired by the image acquisition unit 42 and acquires that tempo. The tempo acquisition unit 46 also analyzes the tempo of the user's (US) movement from the vibration acquired by the vibration acquisition unit 44 and acquires that tempo. The tempo acquired by the tempo acquisition unit 46 is information indicating the tempo of the user's (US) actions. The tempo acquired by the tempo acquisition unit 46 is, for example, the rhythm of a certain periodic behavior performed by the user (for example, swinging arms, moving legs, shaking head, etc., at a constant frequency). In this specification, tempo may include the concept of BPM (Beats Per Minute).

[0036] The tempo determination unit 48 determines whether the acquired tempo has become constant.

[0037] The determination unit 50 determines the music or the playback speed of the music.

[0038] The speed acquisition unit 52 acquires the speed detected by the speed sensor 36.

[0039] The speed determination unit 54 determines whether the acquired speed has become constant.

[0040] The display control unit 56 has the function of controlling the image to be displayed on the display device 38 based on the display information. This display information is a concept that includes not only the information itself that is generated in a manner that can be seen by the user US, such as screens, images, icons, and text, but also rendering information for display.

[0041] The memory control unit 58 has the function of storing various information in the storage device 28. The memory control unit 58 is implemented using one or more storage devices 28. Functional means other than the memory control unit 58 are implemented by the control device 20 executing programs stored in the storage device 28, etc.

[0042] <Processing flow> The following describes the processing flow for changing music or playback speed performed by each functional means in the information processing device 10 according to this embodiment. Note that the order and content of the steps in the flowchart shown below can be changed as appropriate. In the following, it is assumed that when information processing begins, the user US starts using the exercise equipment.

[0043] (Specific example 1) In this embodiment, Figure 4 is a flowchart showing an example of the processing flow for controlling music or playback speed performed by each functional means in the information processing device 10 according to specific example 1 of the embodiment.

[0044] (Step SP10) First, the playback unit 40 plays music from the sound output device 30. The music to be played may be predetermined or determined by instructions from the user US. Then, the process moves on to step SP12.

[0045] (Step SP12) Next, the playback unit 40 determines whether the conditions for ending music playback are met. If the playback unit 40 determines that the conditions for ending music playback are not met, it proceeds to the processing in step SP14. On the other hand, if the playback unit 40 determines that the conditions for ending music playback are met, it terminates the information processing shown in Figure 4. The termination conditions include stopping music playback, stopping the use of the treadmill™, etc. The information processing in step SP12 can be incorporated into the loop processing of SP14, SP16, and SP18, and is not limited to the position shown in Figure 4.

[0046] (Step SP14) Next, data is acquired to obtain the user US's tempo. Specifically, for example, the imaging device 32 continuously captures images including the user US as the subject in real time. The image acquisition unit 42 then continuously acquires these images from the imaging device 32 in real time. Then, the process moves on to step SP16.

[0047] (Step SP16) Next, the tempo acquisition unit 46 acquires information indicating the tempo of the movements of the user US using the exercise equipment. In specific example 1, the tempo acquisition unit 46 acquires the tempo by analyzing images. For example, this analysis analyzes the positional changes and movement patterns of the subject between consecutive image frames and quantifies the tempo. The tempo acquisition unit 46 may focus on the joint movements of the user US and, for example, detect the speed and / or rhythm of the flexion and extension movements of the knees and / or elbows. Also, during image analysis, the unit may focus on the movements of major body parts such as the user US's leg movements, arm swings, and head up and down movements. Furthermore, by assigning markers to specific parts of the user US and tracking the movements of those parts, it becomes possible to acquire a more accurate tempo. Then, the process moves on to the processing of step SP18.

[0048] (Step SP18) Next, the tempo determination unit 48 determines whether the continuously acquired tempo has become constant. If the tempo determination unit 48 determines that the tempo has become constant, it moves the process to step SP20. If the tempo determination unit 48 determines that the tempo has not become constant, it moves the process to step SP12.

[0049] A consistent tempo is determined by whether or not the tempo satisfies the time or repetition requirements.

[0050] The time condition refers to the fact that the tempo fluctuation range obtained within a recent period falls within a specific range. The time required to determine a constant tempo can be set using methods such as a fixed value, user customization, or dynamic settings linked to the treadmill™ speed. Fixed value settings use a pre-programmed fixed time (e.g., 2 seconds, 5 seconds). User customization allows users to set any time according to their preferences. Dynamic settings linked to the treadmill™ speed automatically adjust the judgment time according to the running speed. For example, the judgment time could be set to be longer as the exercise intensity increases, such as 3 seconds for walking at 6 km / h, 5 seconds for jogging at 12 km / h, and 7 seconds for running at 18 km / h. This configuration allows for absorption of minute fluctuations at high speeds and more stable judgments.

[0051] The count condition is a criterion for determining whether, out of the most recent multiple tempo acquisitions (e.g., 10 times), a predetermined number of times (e.g., 8 times) the tempo fluctuation range falls within a specific range. The predetermined number may be set to be equal to the number of tempo acquisitions.

[0052] The tempo variation range may be set according to the user's preference, or it may be automatically changed depending on the speed at which the user is exercising. For example, if the user is exercising at 6 km / h, the variation range may be set to within 5 BPM, while if the user is exercising at 12 km / h, a larger variation range may be allowed due to the increased exercise intensity, and the variation range may be set to stay within 10 BPM. Furthermore, the variation range may consist of only one value and may not have a numerical range in substance.

[0053] (Step SP20) Next, when the decision unit 50 determines that the tempo of the user US's actions has become constant, it determines the music to be played or the playback speed of the music currently being played, according to that tempo.

[0054] For example, if the user US's movements are at a fast tempo, the decision unit 50 may decide to play uptempo music or increase the playback speed of the music currently being played. For example, if the user US's movements are at a slow tempo, the decision unit 50 may decide to play downtempo music or decrease the playback speed of the music currently being played. This is expected to synchronize the user US's movements with the rhythm of the music and improve exercise performance.

[0055] The music or playback speed to be determined may be based on data pre-stored in the storage device 28, corresponding to the tempo of the user US's actions, as shown in Figure 5. When the determination unit 50 uses the tempo value of the user US's actions for referencing table TB, etc., it uses an arbitrary statistical value from among several tempo values ​​that fall within the fluctuation range when determined to be constant as the tempo value. The statistical value is the mean, median, mode, maximum, minimum, etc. The storage control unit 58 stores table TB in the storage device 28.

[0056] Figure 5 shows an example of a table TB that stores the user's tempo and the music to be played or the playback speed of the music currently being played in association with each other. As shown in Figure 5, if the user's tempo is within the range of 0 BPM to 80 BPM, the determination unit 50 sets the playback speed of the current music to 0.8 times. If the user's tempo is within the range of 81 BPM to 96 BPM, the determination unit 50 plays song A. If the user's tempo is within the range of 97 BPM to 120 BPM, the determination unit 50 sets the playback speed of the current music to 1.3 times. If the user's tempo is within the range of 121 BPM to 132 BPM, the determination unit 50 plays song B and sets the playback speed to 1.5 times.

[0057] (Step SP22) Then, the playback unit 40 plays the music as determined by the decision unit 50. After that, the process proceeds to step SP12, and the tempo of the user US's actions is obtained again.

[0058] Figure 6 is a diagram that conceptually explains how tempo is determined. In the graph in Figure 6, the vertical axis represents tempo and the horizontal axis represents time.

[0059] When a user (US) exercises on the treadmill (TM), the tempo fluctuates as the speed is gradually increased, and then tends to settle at a constant speed. During this process, the tempo determination unit (48) continuously monitors the tempo changes and determines whether the tempo is constant or not based on the aforementioned conditions of the number of repetitions or time.

[0060] The tempo determination unit 48 analyzes the data shown in Figure 6 and determines that the tempo is constant between t1 and t2, and between t3 and t4. During these periods, it is considered that the tempo fluctuations are within a preset tolerance range. On the other hand, during other time periods, particularly up to t1, between t2 and t3, and in the region from t4 onward, the tempo determination unit 48 determines that the tempo is not constant. This suggests the possibility that the user US is adjusting their forward speed or that unstable movements are occurring due to fatigue.

[0061] The determination unit 50 receives the determination result from the tempo determination unit 48 and takes appropriate action for the period during which the tempo is determined to be constant. More specifically, for example, if the tempo is determined to be constant between t1 and t2 and between t3 and t4 in Figure 6, the determination unit 50 determines music and / or music playback speed optimized for each period. In this way, by adapting the rhythm of the music to the user's actions, an environment that improves the user experience can be provided.

[0062] (Specific example 2) In Specific Example 1, the tempo was obtained from image data, but in Specific Example 2, the tempo is obtained from vibration. Figure 7 is a flowchart showing an example of the processing flow for controlling the music to be played or the playback speed of the music performed by each functional means in the information processing device 10 according to Specific Example 2 of the embodiment. The information processing in steps SP30, SP32, SP38, SP40, and SP42 of Specific Example 2 is substantially the same as the information processing in steps SP10, SP12, SP18, SP20, and SP22 of Specific Example 1, so the explanation of these information processing steps is omitted.

[0063] (Step SP34) First, the vibration acquisition unit 44 acquires vibrations generated from the exercise equipment and the user's body via the vibration sensor 34. More specifically, for example, the vibration sensor 34 senses a wide range of vibrations, from minute vibrations caused by the structure of the exercise equipment and the user's body movements to large impacts and rhythms. These vibration signals are then transmitted to the vibration acquisition unit 44 for signal processing. This signal processing includes identification of the type and pattern of vibrations, and analysis of frequency and intensity, thereby understanding the characteristics of the exercise and the user's movement rhythm. The processing then proceeds to step SP36.

[0064] (Step SP36) Next, the tempo acquisition unit 46 obtains a tempo corresponding to the rhythm of the movement or action by converting the vibration information acquired from the vibration sensor 34 into a tempo. More specifically, for example, the tempo acquisition unit 46 obtains the tempo by analyzing two elements: the timing of vibration detection and the intensity of vibration. More specifically, for example, the tempo acquisition unit 46 detects the moment when vibration occurs and measures the interval between them, converting it into a tempo that indicates rhythm or pace. Then, the process moves on to the processing of step SP38.

[0065] In this embodiment, the process shown in the flowchart in Figure 8 may be executed independently of or in parallel with the process shown in the flowchart in Figure 4 or Figure 7. Figure 8 is a flowchart showing an example of the flow of display control processing performed by each functional means in the information processing device 10 according to this embodiment.

[0066] (Step SP50) First, the display control unit 56 displays the song lyrics so that they move according to the default settings. At this time, there may be a default setting for each song. Then, the process moves on to the process of step SP52.

[0067] (Step SP52) Next, the display control unit 56 determines whether the conditions for terminating the display of lyrics are met. If the display control unit 56 determines that the conditions for terminating the display of lyrics are not met, it proceeds to the processing in step SP54. On the other hand, if the display control unit 56 determines that the conditions for terminating the display of lyrics are met, it terminates the information processing shown in Figure 8. The termination conditions include stopping music playback, stopping the use of the treadmill™, stopping the display of lyrics, etc. The information processing in step SP52 can be incorporated into the processing of SP54 and SP56, which are loop processes, and is not limited to the position shown in Figure 8.

[0068] (Step SP54) Next, the speed acquisition unit 52 acquires the speed at which the user US moves forward from the speed sensor 36 attached to the treadmill TM. As mentioned above, the speed is acquired by any speed sensor 36, but in this embodiment, it is acquired by a rotary encoder. Furthermore, by using a rotary encoder as the speed sensor 36, this embodiment can be implemented by attaching it to any treadmill TM. Then, the process moves on to step SP56.

[0069] (Step SP56) Next, the speed determination unit 54 determines whether the speed at which the user US moves forward has become constant. If the speed determination unit 54 determines that the speed has become constant, it proceeds to the process of step SP58. On the other hand, if the speed determination unit 54 determines that the speed has not become constant, it proceeds to the process of step SP52.

[0070] (Step SP58) Next, the display control unit 56 controls the position or volume of the song lyrics displayed on the display device 38 according to the speed at which the user US is moving forward. For example, the display control unit 56 synchronizes the timing of the lyrics display with the speed at which the user US is traveling. More specifically, for example, the display control unit 56 displays rapidly changing lyrics to a user US traveling at a fast pace, and slowly changing lyrics to a user US traveling at a slow pace. More specifically, the display control unit 56 may control the display as shown in Figures 9 and 10.

[0071] Figure 9 shows an example of how the information displayed on the display device 38 changes over time when the user US using the treadmill TM moves forward at a fast speed. On the other hand, Figure 10 shows an example of how the information displayed on the display device 38 changes over time when the user US using the treadmill TM moves forward at a slow speed. These figures visually represent how the displayed information changes depending on the user US's forward speed. In the examples of Figures 9 and 10, the following differences can be seen in how the lyrics are displayed depending on the speed at which the user US using the treadmill TM moves forward.

[0072] Specifically, as shown in Figure 9, when the user US using the treadmill™ moves forward at a fast speed, the display control unit 56 controls the initial position of the lyrics to be further back on the screen than in Figure 10. When the lyrics first appear, they are displayed small to create a sense of distance and depth. The display control unit 56 also controls the speed at which the lyrics enlarge relatively faster than in Figure 10. In other words, the display control unit 56 controls the characters to enlarge more rapidly than in Figure 10. Furthermore, the display control unit 56 controls the display time of each lyric to be relatively shorter than in Figure 10. One second after the lyrics first appear, they are displayed larger and lower down than they were one second earlier.

[0073] Specifically, as shown in Figure 10, when the user US using the treadmill™ moves forward slowly, the display control unit 56 displays the lyrics from the back of the screen, similar to Figure 9, but controls them to be larger in initial size than in Figure 9. The display control unit 56 also controls the speed at which the lyrics are enlarged to be relatively slower than in Figure 9. In other words, the display control unit 56 controls the characters to enlarge more slowly than in Figure 9. The display control unit 56 also controls the display time of each lyric to be relatively longer than in Figure 9. Two seconds after the lyrics appear, they are displayed lower and more enlarged than two seconds prior, creating a sense of distance and depth.

[0074] In other examples, the display control unit 56 may control the characters to enlarge without moving them on the screen. In other examples, the display control unit 56 may add different visual effects to the display, such as changing the color of the characters.

[0075] <Effects> In the above embodiment, the computer functions as a tempo acquisition unit that acquires information indicating the tempo of a user's movements using exercise equipment, and a program that determines the music to be played or the playback speed of the music being played when it is determined that the tempo has become constant.

[0076] With this configuration, the music to be played, or the playback speed of the music being played, is selected to match the tempo of the user's movements, allowing the user to enjoy music in sync with their exercise.

[0077] The program according to (1), wherein the music to be played or the playback speed is stored in association with the tempo, and the determination unit determines the music or the playback speed according to the tempo.

[0078] With this configuration, the music played or the playback speed of the music is selected to match the tempo of the user's movements, allowing the user to enjoy music in sync with their exercise.

[0079] The program according to (1) further includes a tempo determination unit that determines whether the continuously acquired tempo has become constant based on whether or not it satisfies a time condition or a number of times condition.

[0080] With this configuration, it is possible to determine whether the tempo has become constant based on a time condition or a number of repetitions condition.

[0081] The program according to (1) further includes an image acquisition unit that continuously acquires images from an imaging device that include the user as the subject, and the tempo acquisition unit acquires the tempo by analyzing the images.

[0082] With this configuration, the tempo can be determined by the image, eliminating the need for any special equipment.

[0083] The program described in (1) also includes a vibration acquisition unit that acquires vibrations from the exercise equipment or a vibration sensor attached to the user, and the tempo acquisition unit converts the vibrations into a tempo.

[0084] With this configuration, the tempo can be determined by vibration, eliminating the need for any special equipment.

[0085] The program according to any one of (1) to (5), wherein the exercise equipment is a treadmill, and comprises a speed acquisition unit that acquires the speed at which the user moves forward from a speed sensor attached to the treadmill, and a display control unit that controls the position where the lyrics of the music appear or the volume of the lyrics of the music according to the speed.

[0086] This configuration allows the display of music lyrics to be changed according to the user's forward speed while using a treadmill. Furthermore, it provides a technology that can further enhance the user's enjoyment while using the treadmill.

[0087] The information processing device also includes a tempo acquisition unit that acquires information indicating the tempo of a user's movements when using exercise equipment, and a determination unit that determines the music to be played or the playback speed of the music being played when it is determined that the tempo has become constant.

[0088] With this configuration, the music to be played, or the playback speed of the music being played, is selected to match the tempo of the user's movements, allowing the user to enjoy music in sync with their exercise.

[0089] ---Variations--- It should be noted that the present invention is not limited to the embodiments described above. That is, any design modifications made to the above embodiments by those skilled in the art are also included within the scope of the present invention, as long as they retain the features of the present invention. Furthermore, the elements of the embodiments described above and the modifications described later can be combined to the extent that it is technically possible, and any combination thereof is also included within the scope of the present invention, as long as it retains the features of the present invention.

[0090] In a modified example, the processes performed by the tempo acquisition unit 46, tempo determination unit 48, determination unit 50, speed determination unit 54, and display control unit 56 may be performed using a trained model. For example, the tempo acquisition unit 46 may output information indicating the tempo of the user's movements based on image or vibration data and a trained model. The tempo determination unit 48 determines whether the user's movements are constant based on the acquired user's movements and a trained model. The determination unit 50 determines the optimal music and / or music playback speed based on the user's movements and a trained model. The speed determination unit 54 determines whether the speed is constant based on the acquired speed of the exercise equipment and a trained model. The display control unit 56 controls the information to be displayed on the display device 38 based on the trained model.

[0091] A pre-trained model generates training data from acquired images, vibrations, tempo, velocity, etc. The pre-trained model may be constructed using supervised learning, unsupervised learning, or self-supervised learning. In supervised learning, machine learning is performed using training data. Training data consists of pairs of input and output data (ground truth data). The pre-trained model may also be a general-purpose natural language processing model, such as a Large Language Model (LLM) trained on a vast amount of data.

[0092] In the modified version, the music does not need to include lyrics. In that case, the information processing shown in Figure 8 may be omitted.

[0093] (Note 1) Computers, A speed acquisition unit that obtains the user's forward speed from a speed sensor attached to the treadmill, It functions as a display control unit that controls the position where the lyrics of the music appear or the volume of the lyrics of the music according to the aforementioned speed. program.

[0094] (Note 2) The program described in Appendix 1 controls the display control unit, when it is determined that the user using the treadmill is moving forward at an increased speed, to reduce the size of the lyrics when they appear, increase the speed at which the lyrics are enlarged, and relatively shorten the display time of the lyrics.

[0095] This disclosure may also be an information processing method that causes an information processing device to execute the program of the embodiment. [Explanation of Symbols]

[0096] 10: Information Processing Device 32: Imaging device 34: Vibration sensor 36: Speed ​​sensor 42: Image acquisition unit 44: Vibration acquisition section 46: Tempo acquisition section 48: Tempo determination unit 50: Decision-making section 54: Speed ​​acquisition section 56: Display Control Unit TM: Treadmill US: User

Claims

1. Computers, A tempo acquisition unit that acquires information indicating the tempo of a user's movements when using exercise equipment, When it is determined that the tempo has become constant, the unit functions as a determination unit that determines the music to be played or the playback speed of the music being played. program.

2. The music to be played or the playback speed is stored in correspondence with the tempo. The determination unit determines the music or playback speed according to the tempo. The program according to claim 1.

3. The program according to claim 1, further comprising a tempo determination unit that determines whether the continuously acquired tempo satisfies a time condition or a count condition.

4. The imaging device includes an image acquisition unit that continuously acquires images including the user as the subject, The tempo acquisition unit acquires the tempo by analyzing the image. The program according to claim 1.

5. The system includes a vibration acquisition unit that acquires vibrations from the exercise equipment or a vibration sensor attached to the user, The tempo acquisition unit converts the vibration into the tempo. The program according to claim 1.

6. The aforementioned exercise equipment is a treadmill, A speed acquisition unit that acquires the speed at which the user moves forward from a speed sensor attached to the treadmill, The system includes a display control unit that controls the position where the lyrics of the music appear or the volume of the lyrics of the music according to the aforementioned speed. The program according to any one of claims 1 to 5.

7. A tempo acquisition unit that acquires information indicating the tempo of a user's movements when using exercise equipment, The system includes a determination unit that determines the music to be played or the playback speed of the music being played when it is determined that the tempo has become constant. Information processing device.

Images