Information processing device, voice information output control method, and program

Abstract

The output of audio information is flexibly controlled according to the user's level of security. [Solution] The CPU 21 of the smartphone 20 outputs audio information to the user while they are running (exercising) from the wireless earphones (output means) 30. The CPU 21 also determines the level of danger around the user based on the information about the user's surroundings obtained from the sound input unit (external situation acquisition means) 26. The CPU 21 also determines the user's running situation (exercise situation). The CPU 21 stops outputting audio information as long as the determined level of danger satisfies the audio playback stop condition (predetermined condition) set according to the running situation.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a voice information output control method, and a program.

Background Art

[0002] Conventionally, an information processing apparatus has been disclosed that determines a user's safety state using an external audio input microphone or the like, and controls an audio signal or the like so that external sounds can be recognized when the user is determined to be in an unsafe state (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the information processing apparatus disclosed in Patent Document 1 above, audio signals and the like are not controlled according to the degree of user safety. For this reason, even when the user is in a state where they can listen to content relatively safely, there is a risk that audio signals and the like will be unnecessarily controlled.

[0005] The present invention has been made in view of such problems, and an object thereof is to flexibly control the output of voice information according to the degree of user safety.

Means for Solving the Problems

[0006] To solve the above problems, the information processing device according to the present invention comprises: an output control means for outputting audio information to a user during exercise from an output means; a level determination means for determining the level of danger around the user based on the situation information around the user obtained from an external situation acquisition means; and an exercise situation determination means for determining the exercise status of the user. The output control means stops outputting the audio information as long as the level of danger determined by the level determination means satisfies predetermined conditions set according to the exercise status determined by the exercise situation determination means. Here, the situation information around the user refers to information that shows the state of the user's surroundings (e.g., external sounds, external images, etc.). The danger level indicates the level (degree) of danger around the user during exercise. [Effects of the Invention]

[0007] According to the present invention, the output of voice information can be flexibly controlled according to the user's level of safety. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing an exercise advice system according to an embodiment of the present invention. [Figure 2] This is a block diagram showing the functional configuration of a motion sensor. [Figure 3] This is a block diagram showing the functional configuration of a smartphone. [Figure 4] This figure shows an example of the contents of a risk level determination table. [Figure 5] This diagram shows an example of the contents of the audio playback stop condition table. [Figure 6] This figure shows an example of the contents of a playback priority table. [Figure 7] This is a block diagram showing the functional configuration of wireless earphones. [Figure 8] This is a flowchart showing the control procedure for the audio information output control process. [Modes for carrying out the invention]

[0009] The embodiments of the present invention will be described below with reference to the drawings. First, the configuration of the exercise advice system according to the embodiment of the present invention will be described with reference to Figure 1. The exercise advice system is a system that can provide users with advice to improve their running form, etc., through voice output while they are running. As shown in Figure 1, the exercise advice system 1 comprises a motion sensor 10, a smartphone (information processing device) 20, and wireless earphones (output means) 30.

[0010] The motion sensor 10 is a wearable device used by users of the exercise advice system 1 while running, attached to their body (for example, around their waist). The smartphone 20 is a portable device carried by the user while running. The wireless earphones 30 are ear devices used by the user while running, similar to the motion sensor 10, attached to their ears. The smartphone 20 is connected to both the motion sensor 10 and the wireless earphones 30 via BLE (Bluetooth® Low Energy).

[0011] Next, the functional configuration of the motion sensor 10 will be explained with reference to Figure 2. As shown in Figure 2, the motion sensor 10 comprises a CPU (Central Processing Unit) 11, RAM (Random Access Memory) 12, a storage unit 13, a display unit 14, an operation unit 15, a sensor unit 16, a sound output unit 17, and a communication unit 18. Each part of the motion sensor 10 is connected via a bus 19.

[0012] The CPU 11 controls each part of the motion sensor 10. The CPU 11 reads a specified program from the system programs and application programs stored in the memory unit 13, loads it into the RAM 12, and executes various processes in cooperation with that program. The CPU 11 also includes a timing circuit (not shown) and obtains the current time measured by this timing circuit. The RAM 12 is a volatile memory and forms a work area for temporarily storing various data and programs. The memory unit 13 is composed of flash memory, EEPROM (Electrically Erasable Programmable ROM), etc. The memory unit 13 stores system programs and application programs executed by the CPU 11, as well as data necessary for the execution of these programs.

[0013] The display unit 14 is composed of multiple LED lamps and is capable of displaying the ON / OFF status of the power supply, the data acquisition status (e.g., whether data is being acquired or not), the data transmission status (e.g., whether data is being transmitted or not), and the ON / OFF status of the GPS receiver. The operation unit 15 is equipped with a power button (not shown) for switching the power supply ON / OFF, and the CPU 11 controls each part based on instructions from this operation unit 15. The sensor unit 16 is equipped with an acceleration sensor, an angular velocity sensor, a geomagnetic sensor, a GPS receiver, a pulse wave sensor, etc., and outputs the measurement results to the CPU 11. Here, the measurement results include, for example, the values ​​of acceleration in three axes, which are the detection results of the acceleration sensor; the values ​​of angular velocity in three axes, which are the detection results of the angular velocity sensor; the values ​​of geomagnetics in three axes, which are the detection results of the geomagnetic sensor; information about the current location (latitude, longitude, altitude, etc.), which are the detection results of the GPS receiver; and the value of the heart rate, which is the detection result of the pulse wave sensor. The sensor unit 16 outputs measurement results to the CPU 11 at predetermined intervals (for example, every second, every step). The CPU 11 then uses the input measurement results to derive index values ​​(form index values) related to running form indicators (such as trunk posterior tilt, hip sinking, deceleration amount, contact time ratio, etc.) during exercise (for example, running). The sensor unit 16 may also have other sensors, such as an electromyography sensor, a skin surface thermometer, a sweat component analysis sensor, a muscle oxygen concentration sensor, etc. The sound output unit 17 is composed of a DA converter, an amplifier, a speaker, etc. When outputting sound, the sound output unit 17 converts the sound data input from the CPU 11, memory unit 13, etc. into analog audio data and outputs it from the speaker. The communication unit 18 is, for example, a communication unit employing a wireless standard such as Bluetooth, or a wired communication unit such as a USB terminal. The communication unit 18 transmits the derived form index values ​​for each form indicator and data related to heart rate to the smartphone 20. Alternatively, the communication unit 18 may transmit the measurement results from the sensor unit 16 to the smartphone 20, and the CPU 21 of the smartphone 20, described later, may derive the form index values ​​for each of the above form indexes.

[0014] Next, the functional configuration of the smartphone 20 will be explained with reference to Figure 3. As shown in Figure 3, the smartphone 20 includes a CPU 21, RAM 22, storage unit 23, display unit 24, operation unit 25, sound input unit 26, sound output unit 27, and communication unit 28. Each part of the smartphone 20 is connected via a bus 29.

[0015] The CPU (output control means, level determination means, motion status determination means, acquisition means) 21 is a processor that controls the operation of each part of the smartphone 20 by reading and executing the program 231 stored in the memory unit 23 and performing various calculations. Although a single CPU 21 is shown in Figure 3, it is not limited to this. Two or more processors such as CPUs may be provided, and the processing performed by the CPU 21 in this embodiment may be shared among these two or more processors. The RAM 22 provides the CPU 21 with a working memory space and stores temporary data. The memory unit 23 stores the program 231 and running app 232 executed by the CPU 21, as well as various data such as a danger level determination table 233, an audio playback stop condition table 234, and a playback priority table 235.

[0016] Program 231 is stored in the memory unit 23 in the form of computer-readable program code. The running application 232 is an application for recording, calculating, and displaying running data such as the running trajectory, distance, time, pace, and cadence when the user runs. This running data is derived based on the measurement results acquired sequentially from the motion sensor 10 during running. The running application 232 also has a running advice function that provides advice to the user during running via voice. Specifically, the running application 232 outputs voice advice related to running form based on the form index values ​​corresponding to each of the multiple form index values ​​transmitted from the motion sensor 10. For example, it outputs voice advice on how to improve the form index with the largest difference from the reference value among the multiple form index values.

[0017] The risk level determination table 233 is a table that is referred to when determining the risk level around the user. As shown in FIG. 4, in the risk level determination table 233, a risk level corresponding to the ambient sound (the sound heard by the user while running) is set for each type of ambient sound. Specifically, a risk level of "5" is set for each of the ambient sounds of "sound emitted by multiple vehicles", "sound emitted by a vehicle approaching the user", and "sound of 80 dB (decibels) or more". Also, a risk level of "4" is set for each of the ambient sounds of "siren, police siren, crossing sound" and "sound of 70 dB or more and less than 80 dB". Also, a risk level of "3" is set for each of the ambient sounds of "sound emitted by one vehicle", "sound emitted by a vehicle moving away from the user", "sound emitted by a bicycle", and "sound of 60 dB or more and less than 70 dB". Also, a risk level of "2" is set for each of the ambient sounds of "footsteps of a person (runner)" and "sound of 50 dB or more and less than 60 dB". Also, a risk level of "1" is set for the ambient sound of "sound of 40 dB or more and less than 50 dB (ambient sound)". Also, a risk level of "0" is set for the ambient sound of "sound of less than 40 dB (ambient sound)".

[0018] Here, each of the above-mentioned ambient sounds of "sound emitted by multiple vehicles", "sound emitted by a vehicle approaching the user", "siren, police siren, crossing sound", "sound emitted by one vehicle", "sound emitted by a vehicle moving away from the user", "sound emitted by a bicycle", and "footsteps of a person (runner)" can be specified by performing known sound recognition processing on the ambient sound input to the sound input unit 26 (described later). Also, the sound pressure level (dB) of the ambient sound is measured by the sound input unit 26 when the ambient sound is input to the sound input unit 26. That is, the ambient sound in the present embodiment represents the sound generated around the smartphone 20 (around the user carrying the smartphone 20).

[0019] The audio playback stop condition table 234 is a table that defines the conditions for stopping the playback (output) of audio information (audio information to the user while running) provided by the running advice function described above. As shown in Figure 5, the audio playback stop condition table 234 sets audio playback stop conditions according to the user's running situation (exercise situation). Specifically, for the "high-speed, high-intensity running" situation, the audio playback stop condition is set to be any of the above-mentioned danger level "5" to "1". In other words, under the "high-speed, high-intensity running" situation, the playback of audio information will stop when the danger level is any of the above-mentioned danger level "5" to "1". Furthermore, for the "high-speed, medium-intensity running" situation, the audio playback stop condition is set to be any of the above-mentioned danger level "5" to "2". Furthermore, for the "medium-speed, medium-intensity running" situation, the audio playback stop condition is set to be any of the above-mentioned danger level "5" to "3". Furthermore, for “running (low speed, low load)” or “walking (medium load)” situations, the above-mentioned risk level being one of “5” to “4” is set as the condition for stopping audio playback. Also, for “walking (low load)” situations, the above-mentioned risk level being “5” is set as the condition for stopping audio playback. Also, for “stopped” situations, no condition for stopping audio playback is set. In other words, in the “stopped” situation, that is, when the user is standing still, the playback of audio information will not stop regardless of whether the risk level is “5” to “0”. Here, “high speed” as written in the audio playback stop condition table 234 can be set to different values ​​depending on the exercise level of the person exercising, but for a person with a general exercise level, it is generally a speed of 190 m / min or more, “medium speed” is a speed of 140 m / min or more but less than 190 m / min, and “low speed” is a speed of less than 140 m / min. Furthermore, "high load" refers to an exercise intensity of 80% or more, "moderate load" refers to an exercise intensity of 60% or more but less than 80%, and "low load" refers to an exercise intensity of less than 60%. Here, exercise intensity may also be derived from the heart rate value.For example, the maximum heart rate may be derived from the formula maximum heart rate = 220 (any reference value) - age (years), and the exercise intensity may be determined from the ratio (%) of the acquired heart rate to the maximum heart rate. For example, when the above ratio is 80% or more, it may be determined as "high load", when the above ratio is 60% or more and less than 80%, it may be determined as "medium load", and when the above ratio is less than 60%, it may be determined as "low load". However, the method for determining the exercise intensity is not limited to this. The exercise intensity may be determined based on the form index value and information regarding the current position. When determining the exercise intensity based on the form index value, the three load states may be determined by the value of the number of times a predetermined form index value continuously exceeds (or may be less than depending on the type of index value) a certain reference value within a specific interval. When determining the exercise intensity based on information regarding the current position, when the degree of slope (gradient) obtained from altitude information is 10% or more, it may be determined as "high load", when it is 3% or more and less than 10%, it may be determined as "medium load", and when it is less than 3%, it may be determined as "low load". Note that in the present embodiment, the audio information provided by the running advice function is not limited to voice messages (for example, advice information regarding the running form of the user during running). A beep sound may be output from the sound output units 17, 27, 36 according to instructions from the CPUs 11, 21, 31. In the present embodiment, the beep sound is also included in the above audio information. When the beep sound is notified, the content corresponding to the voice message is displayed on the display units 14, 24, 34.

[0020] The playback priority table 235 is a table that defines the playback priority of audio information when resuming playback of audio information provided by the running advice function described above. The playback priority is determined based on criteria such as information that is most effective when provided in real time, information that is expected to be somewhat effective even if not completely real time, and information that does not necessarily require real time to be effective. As shown in Figure 6, in the playback priority table 235, audio information belonging to the categories of "information per lap," "instructions on training content," and "form improvement advice" is set to a playback priority of "high." Audio information belonging to the categories of "feedback after form improvement advice" and "encouragement / cheers" is set to a playback priority of "medium." Audio information belonging to the categories of "encouragement for effort," "pace drop notification," and "form disorder notification" is set to a playback priority of "low." As a result, for example, when playback of audio information is resumed, that is, when playback of audio information transitions from a stopped state to a state where the stop is released, if playback of two audio pieces of audio information belonging to the "lap-by-lap information" genre and audio information belonging to the "pace reduction notification" genre are pending, the audio information belonging to the "lap-by-lap information" genre, which has a higher playback priority, will be played first. In other words, the audio pieces will be played in the order of "lap-by-lap information" followed by "pace reduction notification". Each piece of audio information is stored in a predetermined database (not shown) in the storage unit 23, linked to attribute information indicating the above genre.

[0021] Returning to Figure 3, the display unit 24 is composed of an LCD (Liquid Crystal Display) or the like, and displays information on the screen according to display control signals from the CPU 21. A touch sensor is also provided on the display screen of the display unit 24, and functions as a touch panel type operation display means. The operation unit 25 is composed of push button switches and the touch sensor provided on the display unit 24, and receives user input operations, converts the operation content into electrical signals, and outputs them to the CPU 21. The sound input unit (external situation acquisition means) 26 is composed of a microphone, an AD converter, etc. The sound input unit 26 receives input such as external sound from the microphone, converts the input sound into digital sound data, and outputs it to the CPU 21. In addition, when the sound input unit 26 receives input such as external sound from the microphone, it measures the sound pressure level (dB) and outputs the measurement result to the CPU 21. The sound output unit 27 is composed of a DA converter, an amplifier, a speaker, etc. The sound output unit 27 converts the sound data into analog audio data and outputs it from the speaker. The communication unit 28 is, for example, a communication unit that employs a wireless standard such as Bluetooth, or a wired communication unit such as a USB terminal. The communication unit 28 performs wireless data communication with, for example, the communication unit 18 of the motion sensor 10 or the communication unit 37 of the wireless earphone 30, which will be described later.

[0022] Next, the functional configuration of the wireless earphone 30 will be explained with reference to Figure 7. As shown in Figure 7, the wireless earphone 30 includes a CPU 31, RAM 32, storage unit 33, display unit 34, operation unit 35, sound output unit 36, and communication unit 37. Each part of the wireless earphone 30 is connected via a bus 38.

[0023] The CPU 31 controls various parts of the wireless earphone 30. The CPU 31 reads a specified program from the system programs and application programs stored in the memory unit 33, loads it into the RAM 32, and executes various processes in cooperation with that program. The RAM 32 is a volatile memory and forms a work area for temporarily storing various data and programs. The memory unit 33 is composed of, for example, flash memory or EEPROM. The memory unit 33 stores system programs and application programs executed by the CPU 31, as well as data necessary for the execution of these programs.

[0024] The display unit 34 is composed of multiple LED lamps and is capable of displaying the power ON / OFF status, battery level, etc. The operation unit 35 is equipped with a power button (not shown) for switching the power ON / OFF, an adjustment button (not shown) for adjusting the level of sound output from the sound output unit 36, etc. Based on the instructions from this operation unit 35, the CPU 31 controls each unit. The sound output unit 36 ​​is composed of a DA converter, amplifier, speaker, etc. The sound output unit 36 ​​converts sound data into analog audio data and outputs it from the speaker. The communication unit 37 is a communication unit that employs a wireless standard such as Bluetooth.

[0025] Next, the operation of the exercise advice system 1 will be described. Specifically, the voice information output control process performed by the CPU 21 of the smartphone 20 will be described. This voice information output control process is executed, for example, when a user starts running, based on the user's actions, when the running advice function of the running app 232 is enabled.

[0026] As shown in Figure 8, when the voice information output control process is started, the CPU 21 of the smartphone 20 first determines whether a predetermined timing has been reached (step S1). Here, the predetermined timing includes, for example, each timing where one second is counted up from the start time of the voice information output control process (the timing when one second has elapsed, the timing when two seconds have elapsed, ...), and the timing when the voice information to be output from the wireless earphone 30 is determined. If it is determined in step S1 that the predetermined timing has not been reached (step S1; NO), the CPU 21 repeatedly performs the determination process of step S1 until the predetermined timing is reached. If it is determined in step S1 that the predetermined timing has been reached (step S1; YES), that is, every time one second has elapsed from the start time of the voice information output control process, or when the voice information to be output from the wireless earphone 30 is determined, the CPU 21 determines the user's risk level and the user's running status (step S2).

[0027] Here, we will explain how to determine the danger level. The danger level is determined by referring to the danger level determination table 233 shown in Figure 4. Specifically, if the sound recognition process described above identifies "sound emitted by a vehicle (approaching the user)", the CPU 21 refers to the danger level determination table 233 and determines that the danger level is "5". Also, if the sound pressure level of the external sound measured by the sound input unit 26 is 80 dB or higher, the CPU 21 also refers to the danger level determination table 233 and determines that the danger level is "5". Next, we will explain how to determine the running situation. The running situation is determined, for example, based on the user's speed and exercise intensity derived by the CPU 21. Specifically, if the user's speed is 190 m / min or faster (high speed) and the exercise intensity is 80% or higher (high load), the CPU 21 determines that the running situation is "running (high speed, high load)" (see Figure 5). The user's speed and exercise intensity are derived based on the above measurement results (acceleration, heart rate, etc.; exercise data) sequentially acquired from the motion sensor 10 during running.

[0028] Next, the CPU 21 determines whether the risk level determined in step S2 satisfies the audio playback stop condition (see Figure 5) which is set according to the running situation determined in step S2 (step S3). For example, if the running situation determined in step S2 is "running (low speed, low load)", then, as shown in Figure 5, the risk level is set to "5" or "4" as the audio playback stop condition. Therefore, if the risk level determined in step S2 is "5" or "4", it is determined that the audio playback stop condition is met. On the other hand, if the risk level determined in step S2 is any of "3" to "0", it is determined that the audio playback stop condition is not met.

[0029] In step S3, if it is determined that the condition for stopping audio playback (see Figure 5) is met (step S3; YES), the CPU 21 determines whether there is any audio information that is scheduled to be played (output) from the wireless earphone 30, or audio information that is currently being played from the wireless earphone 30 (step S4). In step S4, if it is determined that there is neither any audio information that is scheduled to be played from the wireless earphone 30 nor any audio information that is currently being played from the wireless earphone 30 (step S4; NO), the CPU 21 returns to step S1 and repeats the subsequent processing.

[0030] Furthermore, in step S4, if it is determined that there is audio information that is scheduled to be played (output) from the wireless earphone 30, or audio information that is currently being played from the wireless earphone 30 (step S4; YES), the CPU 21 stops playback of the audio information from the wireless earphone 30 (step S5). In other words, if it is determined that there is audio information that is scheduled to be played from the wireless earphone 30, the CPU 21 prevents the playback of that audio information from starting. Also, if it is determined that there is audio information that is currently being played from the wireless earphone 30, the CPU 21 stops playback of that audio information midway through. After performing the process in step S5, the CPU 21 returns to step S1 and repeats the subsequent processes.

[0031] Furthermore, if it is determined in step S3 that the audio playback stop condition (see Figure 5) is not met (step S3; NO), the CPU 21 determines whether or not there is audio information that is currently not playing (step S6). If it is determined in step S6 that there is no audio information that is currently not playing (step S6; NO), the CPU 21 returns to step S1 and repeats the subsequent processing. If it is determined in step S6 that there is audio information that is currently not playing (step S6; YES), the CPU 21 resumes playback of the audio information from the wireless earphone 30 (step S7). Then, the CPU 21 returns to step S1 and repeats the subsequent processing.

[0032] In step S5, if the audio information is stopped midway through playback, in step S7, playback of the audio information is restarted from the beginning. Alternatively, playback of the audio information may be restarted from the point where it was stopped. For example, if the time during which playback of the audio information is stopped in step S5 (stop period) is longer than a predetermined time, playback is restarted from the beginning of the audio information. However, if the time during which playback of the audio information is stopped in step S5 (stop period) is less than or equal to the predetermined time, playback of the audio information may be restarted from the point where it was stopped.

[0033] Furthermore, if there are multiple audio pieces of information whose playback has been stopped in step S5, in step S7, when resuming playback of the audio pieces of information from the wireless earphones 30, the CPU 21 refers to the playback priority table 235 and resumes playback of the audio pieces of information in order of highest playback priority. Specifically, if in step S5 playback of two audio pieces of information, one belonging to the "information per lap" genre (see Figure 5) and the other belonging to the "encouragement for hard work" genre (see Figure 5), has been stopped, in step S7, when resuming playback of the audio pieces of information from the wireless earphones 30, the audio piece belonging to the "information per lap" genre, which has a higher playback priority, will be played first, followed by the audio piece belonging to the "encouragement for hard work" genre.

[0034] Furthermore, if in step S5 the playback of audio information with a playback priority set to "high," audio information with a playback priority set to "medium," and audio information with a playback priority set to "low" has been stopped, in step S7 the playback of audio information with a playback priority of "medium" (a predetermined threshold) or higher may be restarted from the wireless earphone 30. Also, for example, if the playback of audio information has been stopped for 10 minutes or more in step S5, playback of only audio information with a playback priority of "high" may be restarted from the wireless earphone 30 in step S7, and if the stopped time is 5 minutes or more but less than 10 minutes, playback of only audio information with a playback priority of "medium" or higher may be restarted from the wireless earphone 30.

[0035] As described above, the CPU 21 of the smartphone 20 in this embodiment outputs audio information to the user while they are running (exercising) from the wireless earphones (output means) 30. The CPU 21 also determines the level of danger around the user based on the information about the user's surroundings obtained from the sound input unit (external situation acquisition means) 26. The CPU 21 also determines the user's running situation (exercise situation). Furthermore, the CPU 21 stops outputting audio information as long as the determined danger level satisfies the audio playback stop condition (see Figure 5) which is set according to the running situation. Therefore, with the smartphone 20, the audio playback stop condition is set according to the user's running situation, so the output (playback) of audio information can be flexibly controlled according to the user's level of safety.

[0036] Furthermore, the CPU 21 resumes outputting audio information when the determined risk level no longer meets the audio playback stop conditions set according to the running situation. Therefore, according to the smartphone 20, the output (playback) of audio information can be flexibly controlled according to the user's level of safety.

[0037] Furthermore, if the output of audio information is interrupted, the CPU 21 resumes outputting the audio information from the beginning when resuming outputting the audio information. Therefore, according to the smartphone 20, since outputting the audio information resumes from the beginning when resuming outputting the audio information, it is possible to prevent the audio message indicated by the audio information from being missed by the user who is running.

[0038] Furthermore, if there are multiple audio information items to resume output, the CPU 21 resumes outputting the audio information in order of highest playback priority. Therefore, according to the smartphone 20, it can prioritize and resume playback of audio information that requires real-time performance, thereby preventing the playback of unnecessary, or rather, outdated, audio information for users who are running.

[0039] Furthermore, the CPU 21 determines the level of danger around the user based on information about external sounds around the user obtained from the sound input unit (external situation acquisition means) 26. Therefore, the smartphone 20 can appropriately determine the level of danger around the user.

[0040] Furthermore, the CPU 21 acquires measurement results (exercise data) from the motion sensor 10 obtained when the user is running (exercising), and determines the user's running status based on these measurement results. Therefore, the smartphone 20 can appropriately determine the user's running status.

[0041] The above description of the embodiment is merely an example of the information processing device, voice information output control method, and program according to the present invention, and is not limited thereto. For example, in the above embodiment, the exercise advice system 1 consisted of a motion sensor 10, a smartphone 20, and a wireless earphone 30, but it may also consist of, for example, a motion sensor 10 and a wireless earphone 30. In this case, the wireless earphone 30 is provided with a sound input unit corresponding to the sound input unit 26. In this case, the CPU 31 of the wireless earphone 30 is configured to function as an output control means that outputs voice information to the user while running (exercising) from the sound output unit (output means) 36. The CPU 31 is also configured to function as a level determination means that determines the level of danger around the user based on the situation information around the user acquired from an external situation acquisition means (sound input unit provided in the wireless earphone 30). The CPU 31 is also configured to function as an exercise situation determination means that determines the user's running situation (exercise situation). The CPU 31 is then configured to execute the voice information output control process shown in Figure 8.

[0042] Furthermore, the exercise advice system 1 may be composed of, for example, a smartphone 20 and wireless earphones 30. In this case, the smartphone 20 is assumed to have all the functions of the motion sensor 10. In this case, a smartwatch may be used instead of the smartphone 20. In other words, the exercise advice system 1 may be composed of a smartwatch, which is a substitute for the smartphone 20, and wireless earphones 30. Furthermore, the exercise advice system 1 may be composed of the motion sensor 10 alone. In this case, the motion sensor 10 is assumed to have an audio input unit corresponding to the audio input unit 26. In this case, the CPU 11 of the motion sensor 10 is configured to function as an output control means that outputs audio information to the user while running (exercising) from the audio output unit (output means) 17. Furthermore, the CPU 11 is configured to function as a level determination means that determines the level of danger around the user based on the situation information around the user acquired from the external situation acquisition means (audio input unit provided by the motion sensor 10). Furthermore, the CPU 11 is configured to function as an exercise situation determination means that determines the user's running situation (exercise situation). Then, the CPU 11 is configured to execute the audio information output control process shown in Figure 8.

[0043] Furthermore, in the above embodiment, the user's running status is determined based on the user's speed and exercise intensity derived by the CPU 21 of the smartphone 20, but it may also be determined based on either one of the pieces of information.

[0044] Furthermore, in the audio information output control processing of the above embodiment (see Figure 8), while playback of audio information is stopped, the CPU 21 may perform enhancement processing on the external sound (including danger information) input to the sound input unit 26, and output the enhanced external sound from the wireless earphone 30. Alternatively, instead of the above external sound, an alarm sound or the type of external sound (or danger level) may be output as audio from the wireless earphone 30.

[0045] Furthermore, in the above embodiment, the CPU 21 determines the level of danger around the user based on information related to external sounds around the user obtained from the sound input unit (external situation acquisition means) 26, but the method for determining the level of danger is not limited to the above. For example, the level of danger around the user may be determined based on external video footage obtained from a camera that is communicated with the smartphone 20 (for example, a camera provided on smart glasses worn by a user while running). Alternatively, the level of danger around the user may be determined based on road conditions, etc., obtained using the GPS function installed in the smartphone 20.

[0046] Furthermore, although the above embodiment shows an example of the audio information output control process (see Figure 8) being executed when the running advice function is enabled, it may also be made executable during normal running when the running advice function is disabled. In such a case, the playback priority set in the playback priority table 235 (see Figure 6) may be made variable depending on whether the running advice function is enabled or disabled.

[0047] Furthermore, it goes without saying that the detailed configuration and operation of each component of the motion sensor 10, smartphone 20, and wireless earphone 30 in the above embodiment can be appropriately modified without departing from the spirit of the present invention. [Explanation of Symbols]

[0048] 1 Exercise advice system, 20 Smartphone (information processing device), 21 CPU (output control means, level determination means, exercise status determination means, acquisition means), 26 Sound input unit (external status acquisition means), 30 Wireless earphone (output means)

Claims

1. An output control means that causes the output means to output audio information to the user during exercise, A level determination means that determines the level of danger around the user based on the information about the user's surroundings obtained from an external situation acquisition means, The system includes a means for determining the user's exercise status, The output control means stops outputting the audio information as long as the danger level determined by the level determination means satisfies predetermined conditions set according to the motion conditions determined by the motion conditions determination means. An information processing device characterized by the following:

2. The output control means restarts outputting the voice information when the danger level determined by the level determination means no longer satisfies predetermined conditions set according to the motion conditions determined by the motion conditions determination means. The information processing apparatus according to feature 1.

3. If the output control means stops outputting the audio information midway through, it restarts the output of the audio information from the beginning when restarting the output of the audio information. The information processing apparatus according to feature 2.

4. If the output of the audio information is stopped midway through output, the output control means will resume outputting the audio information from where it stopped when resuming outputting the audio information. The information processing apparatus according to feature 2.

5. The aforementioned audio information consists of multiple types, and a playback priority is predetermined for each type. The output control means, when there are multiple audio information items to resume output, resumes outputting the audio information in order of the highest playback priority, or resumes outputting the audio information for which the playback priority is equal to or greater than a predetermined threshold. The information processing apparatus according to feature 2.

6. The level determination means determines the level of danger around the user based on the information relating to external sounds around the user obtained from the external situation acquisition means. The information processing apparatus according to feature 1.

7. The system includes means for acquiring exercise data obtained when the user is performing the exercise, The exercise status determination means determines the user's exercise status based on the exercise data acquired by the acquisition means. The information processing apparatus according to feature 1.

8. A method for controlling the output of audio information, which is performed by a computer of an information processing device, An output control process that causes audio information to be output from an output device to the user during exercise, A level determination step that determines the level of danger around the user based on the information about the user's surroundings obtained from the external situation acquisition means, This includes a movement status determination step for determining the user's movement status, The output control step stops the output of the voice information as long as the danger level determined by the level determination step satisfies predetermined conditions set according to the motion conditions determined by the motion conditions determination step. A method for controlling the output of audio information, characterized by the following features.

9. The computer of the information processing device, Output control means that causes the output means to output audio information to the user during exercise. A level determination means that determines the level of danger around the user based on the information about the user's surroundings obtained from an external situation acquisition means. This is configured to function as a motion status determination means for determining the user's motion status, The output control means stops outputting the audio information as long as the danger level determined by the level determination means satisfies predetermined conditions set according to the motion conditions determined by the motion conditions determination means. A program characterized by the following features.

Images