Music selection device, music selection method, and program

Abstract

To provide a music selection device that enables appropriate music selection in accordance with a surrounding environment.SOLUTION: A terminal (music selection device) 200 according to the present disclosure includes: an environment information acquisition unit 210 that acquires environment information concerning an environment surrounding a user; a calculation unit 230 that calculates an activity level of a human flow based on a human pace and a density of people obtained from the environment information; and a music selection unit 240 that selects music based on the activity level of the human flow and attribute information indicating an attribute of music.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present disclosure relates to a music selection device, a music selection method, and a program.

Background Art

[0002] In recent years, with the spread of subscription-based music distribution services, it has become possible to easily enjoy music of various genres. Also, due to technological advancements in smartphones, earphones, and headphones, etc., users can enjoy immersive music appreciation in various scenarios regardless of time or place.

[0003] From such a background, technologies for automatically selecting music in various scenarios are known. For example, Patent Document 1 discloses a music selection and playback device that selects a selection value from the surrounding situation of a vehicle, etc., as a keyword, determines the degree of match between the music attribute value of each parameter of music data and the keyword, scores, and selects and plays music data with a high score.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] When mounting a device as disclosed in Patent Document 1 on a vehicle or the like, the parameters used for automatic music selection may be those with little change over time. However, when the user moves on foot and the surrounding environmental changes over time become diverse, it is difficult to apply the technology as disclosed in Patent Document 1.

[0006] The purpose of this disclosure is to provide a music selection device, music selection method, and program that can appropriately select music in response to changes in the surrounding environment, in light of the problems described above. [Means for solving the problem]

[0007] The music selection device relating to this disclosure is An environmental information acquisition unit that acquires environmental information about the user's surroundings, A calculation unit calculates the degree of activity of human flow based on the speed of people and the density of people obtained from the aforementioned environmental information, The system includes a song selection unit that selects songs based on the level of activity of the pedestrian flow and attribute information indicating the attributes of the songs.

[0008] The method of selecting songs for this disclosure is as follows: An environmental information acquisition step to acquire environmental information about the user's surrounding environment, A calculation step to calculate the degree of activity of human flow based on the speed of people and the density of people obtained from the aforementioned environmental information, The system includes a song selection step, which involves selecting a song based on the level of activity of the aforementioned flow of people and attribute information indicating the attributes of the song.

[0009] The program related to this disclosure is An environmental information acquisition step to acquire environmental information about the user's surrounding environment, A calculation step to calculate the degree of activity of human flow based on the speed of people and the density of people obtained from the aforementioned environmental information, The computer is instructed to perform a song selection step, which involves selecting a song based on the level of activity of the aforementioned pedestrian flow and attribute information indicating the attributes of the song. [Effects of the Invention]

[0010] The music selection device, music selection method, and program described herein enable appropriate music selection in response to changes in the surrounding environment. [Brief explanation of the drawing]

[0011] [Figure 1]This is a schematic diagram of the song selection system according to an embodiment. [Figure 2] This is a block diagram showing the configuration of a song selection system according to an embodiment. [Figure 3] This figure shows an example of parameter information related to the embodiment. [Figure 4] This figure shows an example of attribute information for song selection according to the embodiment. [Figure 5] This figure shows an example of music information according to the embodiment. [Figure 6] This is a flowchart showing the song selection process performed by the terminal according to the embodiment. [Modes for carrying out the invention]

[0012] Embodiments of the present disclosure will be described in detail below with reference to the drawings. In each drawing, the same or corresponding elements are denoted by the same reference numerals. For clarity of explanation, redundant explanations will be omitted where necessary.

[0013] First, an overview of the song selection system 1000 according to this embodiment will be described with reference to Figure 1. Figure 1 is a schematic diagram of the song selection system 1000 according to this embodiment. As shown in Figure 1, the song selection system 1000 comprises a playback device 100 and a terminal 200.

[0014] The playback device 100 and the terminal 200 are connected in a way that allows them to communicate via a communication network (not shown). The communication network may be configured using wireless standards such as Bluetooth® or Wi-Fi®. Alternatively, the playback device 100 and the terminal 200 may be configured to communicate via a wired connection.

[0015] The playback device 100 is a playback device that plays music. The playback device 100 is, for example, a wireless earphone that receives an audio signal from the terminal 200 and plays music. The user can listen to the played music by wearing the playback device 100 in their ears.

[0016] In addition, the playback device 100 has a detection function for detecting environmental information regarding the environment around the user. The environmental information may include, for example, imaging information obtained by imaging the surroundings of the user, voice information of the voice emitted around the user, and the like. Therefore, the playback device 100 is provided with a small camera capable of imaging the surroundings of the user, a microphone capable of detecting the voice around the user, and the like.

[0017] The playback device 100 transmits the detected environmental information to the terminal 200. The terminal 200 receives the environmental information and selects a piece of music according to the surrounding environment of the user by performing a predetermined music selection process. The terminal 200 transmits an audio signal for playing the selected music to the playback device 100. The playback device 100 receives the audio signal and plays the music selected on the terminal 200. Thereby, the user can listen to the music selected on the terminal 200.

[0018] The user's surrounding environment may change as the user moves, such as by walking. In the music selection system 1000, the playback device 100 detects environmental information at a predetermined time interval and transmits it to the terminal 200. When the terminal 200 acquires the environmental information from the playback device 100, it can perform music selection again according to this. With such a configuration, in the music selection system 1000, it is possible to appropriately select music according to the environmental changes around the user on the terminal 200 that has acquired the information from the playback device 100.

[0019] Subsequently, referring to FIG. 2, the configuration of the music selection system 1000 according to the present embodiment will be described. FIG. 2 is a block diagram showing the configuration of the music selection system 1000. As shown in FIG. 2, the music selection system 1000 includes a playback device 100 and a terminal (music selection device) 200. Note that the one-way arrows shown in FIG. 2 simply indicate the flow of information (data, signals, etc.), and do not exclude the bi-directionality of the information.

[0020] First, the configuration of the playback device 100 will be described. The playback device 100 is a playback device that can receive audio signals from the terminal 200 and play music. The playback device 100 is, for example, an earphone, headphones, or a shoulder speaker. However, it is not limited to these, and various devices capable of playing music may be used as the playback device 100. In this embodiment, the playback device 100 will be described as an earphone as shown in Figure 1. Figure 1 shows an example in which the playback device 100 is worn on one ear, but the playback device 100 may be worn on both ears. By wearing the playback device 100 on their ears, the user can listen to the music being played while moving. The music may have lyrics or it may not have lyrics.

[0021] Referring to Figure 2, the components of the playback device 100 will be described. As shown in Figure 2, the playback device 100 includes an imaging unit 110, a sound collection unit 120, a sensor unit 130, and an output unit 140.

[0022] The imaging unit 110 is an imaging device that images the area around the user. The imaging unit 110 is, for example, a visible light camera. The imaging unit 110 may also be an infrared camera or other imaging device. The imaging unit 110 is provided in the playback device 100 to image the area in front of the user. This allows the imaging unit 110 to image a range equivalent to the user's field of view in accordance with the user's movement. However, the imaging unit 110 may be configured to image the area to the left or right of the user or behind them. The imaging unit 110 transmits the captured image obtained by imaging, along with date and time information, to the terminal 200. The captured image may be a still image or a moving image. The imaging unit 110 may transmit captured images at predetermined time intervals.

[0023] The sound collection unit 120 is a sound collection device that detects sounds around the user. The sound collection unit 120 is, for example, a microphone. The sound collection unit 120 detects sounds such as people's voices, sounds emitted by vehicles, and sounds emitted from buildings such as shops that are present around the user. The sound collection unit 120 transmits the audio information of the detected sounds to the terminal 200. The sound collection unit 120 may transmit the audio information at predetermined time intervals.

[0024] The sensor unit 130 is a detection device that detects user information about the user. User information may include, for example, the user's biometric information. Biometric information may include, for example, the user's body temperature, heart rate, or blood pressure. User information is not limited to these and may include other biometric information. The sensor unit 130 transmits the detected biometric information to the terminal 200. The sensor unit 130 may transmit biometric information at predetermined time intervals. In this embodiment, the sensor unit 130 will be described as detecting the user's heart rate as biometric information and transmitting the detection result to the terminal 200.

[0025] In Figure 2, the sensor unit 130 is shown inside the playback device 100, but the sensor unit 130 may be located outside the playback device 100. For example, the sensor unit 130 may be a wearable terminal capable of detecting biometric information such as heart rate. Furthermore, the sensor unit 130 may be configured to detect multiple different types of biometric information. For example, the sensor unit 130 may detect heart rate and body temperature and transmit both detection results to the terminal 200.

[0026] The output unit 140 is an output device that outputs the music selected by the terminal 200. The output unit 140 is, for example, a speaker. The output unit 140 plays the selected music according to the audio signal transmitted from the terminal 200.

[0027] The configuration of terminal 200 will now be explained with reference to Figure 2. Terminal 200 is an information processing device that receives environmental information and user information from the playback device 100 and performs predetermined music selection processing based on some or all of this information. Terminal 200 may be a smartphone, mobile phone, tablet, or PC (Personal Computer), etc. Terminal 200 may also be a wearable device such as a smartwatch. By performing predetermined music selection processing, terminal 200 selects music that is appropriate to the user's surrounding environment. Terminal 200 transmits the audio signal of the selected music to the playback device 100 and plays the selected music on the playback device 100.

[0028] As shown in Figure 2, the terminal 200 includes an environmental information acquisition unit 210, a user information acquisition unit 220, a calculation unit 230, a music selection unit 240, an input / output unit 270, an imaging unit 280, and a storage unit 290.

[0029] The environmental information acquisition unit 210 acquires environmental information about the environment surrounding the user. The environmental information may include imaging information and audio information. Here, imaging information is information including images acquired by imaging the area around the user. Audio information is audio information acquired by detecting sounds emitted around the user. The environmental information acquisition unit 210 acquires imaging information, including images captured by the imaging unit 110, from the playback device 100. The environmental information acquisition unit 210 also acquires audio information acquired by the sound collection unit 120 from the playback device 100.

[0030] In addition to acquiring captured images acquired by the imaging unit 110 as described above, the environmental information acquisition unit 210 may also acquire captured images acquired by the imaging unit 280 provided by the terminal 200. For example, the environmental information acquisition unit 210 determines whether or not it can acquire captured images from the imaging unit 110. If it determines that it can acquire captured images from the imaging unit 110, it acquires the captured images as environmental information as described above. If it determines that it cannot acquire captured images from the imaging unit 110, the environmental information acquisition unit 210 switches the acquisition destination of the captured images from the imaging unit 110 to the imaging unit 280 and acquires the captured images acquired by the imaging unit 280 as environmental information.

[0031] For example, the environmental information acquisition unit 210 may determine that it cannot acquire an image from the imaging unit 110 if the imaging unit 110 is obstructed by an obstruction such as the user's hair. The environmental information acquisition unit 210 compares, for example, the average brightness value of each pixel in the image acquired by the imaging unit 110 with a predetermined threshold. Based on the comparison result, the environmental information acquisition unit 210 determines that the imaging unit 110 is obstructed and that it cannot acquire an image from the imaging unit 110. The obstruction is not limited to the user's hair; for example, a hat or umbrella could be used. The environmental information acquisition unit 210 may also use other determination conditions to determine whether or not an image can be acquired from the imaging unit 110.

[0032] In this way, if it is not possible to acquire an image from the imaging unit 110, the environmental information acquisition unit 210 can reliably acquire an image as environmental information by switching the acquisition destination of the image to the imaging unit 280. Similarly, the environmental information acquisition unit 210 may also determine whether or not it can acquire audio information from the sound collection unit 120, and depending on the determination result, switch the acquisition destination of the audio information to the sound collection unit (not shown) of the terminal 200.

[0033] The user information acquisition unit 220 acquires user information about the user. User information may include, for example, the user's biometric information, browsing information, or mood information. Biometric information is such as the user's heart rate detected by the sensor unit 130. The user information acquisition unit 220 receives the biometric information detected by the sensor unit 130 from the playback device 100 and acquires it as user information.

[0034] Browsing information is information such as text and images that the user is viewing. Browsing information may include information related to the user's mood. Browsing information is, for example, display information contained in the display screen shown on the input / output unit 270. For example, display information may include information on fields that the user likes or dislikes. The fields can be anything, such as food, sports, or movies. The user information acquisition unit 220 acquires, for example, text information and image information contained in the display information as user information. The user information acquisition unit 220 may also acquire browsing information acquired from images captured by the imaging unit 110 as user information. The user information acquisition unit 220 may also acquire browsing information from, for example, the content of posters or digital signage that the user is viewing.

[0035] Mood information is information that indicates the user's own feelings about their mood. Mood information may be expressed as, for example, "Low" or "High". For example, if the user's mood is "calm," "relaxed," or "sad," the mood information will be expressed as "Low". Also, for example, if the user's mood is "exhilarated," "active," or "happy," the mood information will be expressed as "High". Mood information may also indicate the degree of the mood, such as "somewhat Low" or "somewhat High".

[0036] The user information acquisition unit 220 displays a selection screen on the input / output unit 270 for receiving user mood information. The selection screen may include, for example, "Low" and "High" buttons. The user information acquisition unit 220 displays a message on the input / output unit 270, for example, "Please select your current mood," and receives the user's response to acquire the mood information. Although two options, "Low" and "High," are used here, three or more options may be provided. Furthermore, the mood information may be represented numerically or in a way other than those described above.

[0037] The calculation unit 230 uses the environmental information acquired by the environmental information acquisition unit 210 and the user information acquired by the user information acquisition unit 220 to calculate parameter values ​​for multiple parameters related to song selection. These multiple parameters related to song selection are stored in the storage unit 290 as parameter information 291.

[0038] Figure 3 shows an example of parameter information 291. For example, parameter information 291 is information that associates a parameter ID, parameter name, parameter value, score, and song selection attribute name. The parameter ID is information used to identify the parameter. The parameter name is information that indicates the name of the parameter. The parameter value is a value that can be selected for each parameter. As shown in the figure, multiple parameter values ​​can be selected for a single parameter. The score is a score associated with each parameter value. The score is used to identify the song selection attribute for song selection. The song selection attribute name is information that indicates the name of the song selection attribute.

[0039] As shown in Figure 3, parameter information 291 includes the following parameters: P1 "Atmosphere of people", P2 "Atmosphere of buildings", P3 "Speed ​​of people", P4 "Density of people", P5 "Density of buildings", and P6 "Mood information". In the following, each parameter may be indicated only by the sign of P1 to P6.

[0040] The calculation unit 230 calculates the parameter values ​​P1 to P5 based on environmental information. The calculation unit 230 also calculates the parameter value P6 based on user information. Here, the calculation method for each parameter value in the calculation unit 230, along with the content of each parameter, will be explained.

[0041] The parameter value for P1, "Person's Atmosphere," has four options: "Casual," "Business," "Japanese Style," and "Western Style," with each parameter value corresponding to a score of 1 to 4 points. For "Other," which does not fall into any of these categories, the corresponding score is 0 points. The calculation unit 230 calculates the parameter values ​​based on environmental information using well-known machine learning methods.

[0042] Furthermore, P2 "Building Atmosphere" has the same parameter values ​​and scores as P1. The calculation unit 230 calculates the parameter values ​​based on environmental information, using well-known machine learning methods, similar to P1.

[0043] The parameter value for P3 "Person's Speed" has three options: "Slow," "Normal," and "Fast," with each parameter value corresponding to a score of 1 to 3 points. For example, the calculation unit 230 determines the speed of a person based on the motion vector of the person detected from the captured image. Specifically, first, the calculation unit 230 recognizes the person included in the captured image using well-known image recognition technology. Next, the calculation unit 230 calculates the difference in the motion vector of the person at a predetermined time interval and determines the degree of change in the motion vector from this difference. As a result, the calculation unit 230 calculates the speed of the person recognized in the captured image. If multiple people are recognized in the captured image, the calculation unit 230 performs the same process for each person to determine the speed of multiple people in the captured image.

[0044] The calculation unit 230 calculates the parameter value of P3 by, for example, comparing the requested speed of the person with a threshold. For example, the calculation unit 230 calculates the parameter value by comparing the requested speed of the person with two thresholds. For example, the calculation unit 230 calculates the parameter value as follows: if the requested speed of the person is greater than or equal to the first threshold, it is "fast" if it is less than the second threshold, and it is "normal" if it does not fall into either category. The calculation unit 230 is not limited to this and may also calculate the parameter value using well-known machine learning methods.

[0045] The parameter value for P4 "Person density" has three settings: "Scattered," "Normal," and "Dense," with each parameter value corresponding to 1 to 3 points. The calculation unit 230 determines the person density based on at least one of the imaging information and the audio information. For example, when the calculation unit 230 determines the person density based on an image, it recognizes people included in the image using image recognition technology or the like. The calculation unit 230 then determines the person density based on the number of people recognized.

[0046] The calculation unit 230 calculates the parameter value of P4 by, for example, comparing the number of recognized people with a threshold. For example, the calculation unit 230 calculates the parameter value by comparing the number of recognized people with two thresholds. For example, the calculation unit 230 calculates the parameter value as follows: if the number of recognized people is equal to or greater than the first threshold, it is "densely clustered" if it is less than the second threshold, and it is "normal" if it does not fall into either category. The calculation unit 230 is not limited to this and may calculate the parameter value using well-known machine learning methods.

[0047] The calculation unit 230 may also determine the density of people using voice information. The calculation unit 230 can determine the density of people using well-known voice recognition technology. For example, the calculation unit 230 may calculate the sum of the intensities of voice information in frequency bands where conversation sounds, crowd noises, or other noises are abundant, and then determine the density of people around the user according to the magnitude of the calculated sum. The calculation unit 230 may also calculate parameter values ​​by comparing them with thresholds in the same manner as described above. The calculation unit 230 may also calculate parameter values ​​using well-known machine learning or the like.

[0048] The calculation unit 230 may also use both imaging information and audio information to determine the density of people in the surrounding area. This allows the calculation unit 230 to determine the density of people in the surrounding area with greater accuracy.

[0049] P5, "Building density," has the same parameter values ​​and scores as P4. The calculation unit 230 may calculate the parameter value of P5 by, for example, using the area of ​​the sky in the captured image acquired by the environmental information acquisition unit 210 to determine the proportion of buildings in the captured image. Alternatively, the calculation unit 230 may calculate the parameter value using well-known machine learning methods.

[0050] The P6 "Mood Information" parameter has two values, "Low" and "High," and each parameter value corresponds to a score of 1 to 2 points. The calculation unit 230 calculates the P6 parameter value using the user's biometric information, browsing information, or mood information acquired as user information. The calculation unit 230 may use multiple pieces of this information as user information. The calculation unit 230 may also calculate the parameter value using well-known machine learning methods.

[0051] In this embodiment, it is assumed that a pre-trained model for calculating each parameter value has been generated in advance through machine learning. For machine learning, well-known machine learning methods such as deep learning may be used. When environmental information (e.g., imaging information) is acquired by the environmental information acquisition unit 210, the calculation unit 230 can calculate the parameter values ​​of P1 to P5 using the pre-trained model that has been generated in advance. Similarly, when user information (e.g., biometric information) is acquired by the user information acquisition unit 220, the calculation unit 230 can calculate the parameter value of P6 using the pre-trained model that has been generated in advance.

[0052] Furthermore, as shown in Figure 3, each parameter is associated with a song selection attribute name. The song selection attribute name indicates the name of the song selection attribute used for song selection. In this embodiment, three song selection attributes are set: "Genre," "Tempo," and "Key." Here, we will briefly explain the correspondence between each parameter and the song selection attribute.

[0053] P1 "Atmosphere of people" and P2 "Atmosphere of buildings" are associated with the "genre" related to the atmosphere of the music. Additionally, P3 "Tempo of people" is associated with the "tempo" related to the speed of the music.

[0054] Furthermore, P4 "Density of people" and P5 "Density of buildings" are associated with "tempo." For example, it is assumed that when there are many people and buildings around, one will feel busy and hectic, and when there are few people and buildings, one will feel lonely and quiet. As a result, the music selection unit 240 is more likely to select songs such as uptempo songs when the density of people and buildings is high, and ballads when the density is low.

[0055] P6 "Mood Information" is associated with "Tempo" and "Key". The "Tempo" is associated with the user's mood level, as it is assumed that the speed of the music suitable for that mood is related. Similarly, the "Key" is associated with the user's mood level, as it is assumed that the key of the music suitable for that mood is related. For example, high-pitched music has a high frequency, which is assumed to stimulate the user and further amplify an excited mood. Therefore, when the "Mood Information" is "High", the music selection unit 240 is more likely to select music with a high key. Low-pitched music has a low frequency, which is assumed to induce drowsiness and relaxation, and further stabilize the user's calm mood. Therefore, when the "Mood Information" is "Low", the music selection unit 240 is more likely to select music with a low key.

[0056] Note that the parameter information 291 shown in Figure 3 is just an example, and the correspondence between each parameter and the song selection attribute is not limited to those shown in the figure. For example, P1 "Personal Atmosphere" is associated with "Genre," but it could also be associated with "Tempo" or "Key." Furthermore, P1 could be associated with two or more of these. The same applies to other parameters.

[0057] The calculation unit 230 sums the scores corresponding to each parameter P1 to P6 for each song selection attribute. Here, if we represent the scores corresponding to each parameter P1 to P6 as S1 to S6, then the score for P1 "Atmosphere of people" is S1, the score for P2 "Atmosphere of buildings" is S2, the score for P3 "Speed ​​of people" is S3, the score for P4 "Density of people" is S4, the score for P5 "Density of buildings" is S5, and the score for P6 "Mood information" is S6.

[0058] The score corresponding to each song selection attribute is expressed by the following formula. The calculation unit 230 calculates the total score corresponding to each song selection attribute by performing the following formulas (1) to (3). "Genre" = S1 + S2 ... (1) "Tempo" = S3 + S4 + S5 + S6 ... (2) "Key" = S6 ···(3)

[0059] The calculation unit 230 refers to the song selection attribute information 292 stored in the memory unit 290 and obtains the song selection attribute value corresponding to each song selection attribute based on the total score calculated by the above calculation.

[0060] Figure 4 shows an example of song selection attribute information 292. Song selection attribute information 292 is information that associates, for example, a song selection ID, a song selection attribute name, a total score, and a song selection attribute value. The calculation unit 230 refers to the song selection attribute information 292 and obtains the song selection attribute values ​​for each attribute, "genre," "tempo," and "key." For example, if the total score for "genre" is 2 points, the calculation unit 230 obtains "J-POP, K-POP" as the song selection attribute value. Also, for example, if the total score for "tempo" is 6 points, the calculation unit 230 obtains "mid-ballad" as the song selection attribute value. Also, for example, if the total score for "key" is 1 point, the calculation unit 230 obtains "low key song" as the song selection attribute value.

[0061] In this way, the calculation unit 230 can obtain song selection attribute values ​​for the song selection unit 240 for each attribute of "genre," "tempo," and "key."

[0062] In the above explanation, the calculation unit 230 calculated parameter values ​​for all parameters P1 to P6 shown in Figure 3 and calculated song selection attribute values ​​based on the calculation results, but this is not limited to this. For example, the calculation unit 230 may calculate song selection attribute values ​​using only some of the parameters P1 to P6.

[0063] For example, the calculation unit 230 may calculate only the parameters P3 "human speed" and P4 "density of people" shown in Figure 3. By using P3 and P4 as parameters, the calculation unit 230 can calculate the degree of human flow activity in the user's surrounding environment. This makes it possible for the music selection unit 240 to select music according to the degree of human flow activity. In the following explanation, P3 and P4 may be combined and referred to as P10 "degree of human flow activity."

[0064] Returning to Figure 2, the explanation continues. The song selection unit 240 selects a song from the song information 293 stored in the storage unit 290 based on the song selection attribute values ​​obtained by the calculation unit 230. The song information 293 is information about songs that can be selected by the song selection unit 240.

[0065] Figure 5 shows an example of song information 293. Song information 293 is information that associates, for example, a song ID, song title, artist name, song data, and attribute information. The song ID is information used to identify the song. The song title is information that indicates the title of the song. The artist name is information that indicates the name of the artist performing the song. The song data is information that indicates the sound source data of the song.

[0066] Attribute information is information that indicates the attributes of a song. Attribute information may include, for example, "genre," "tempo," and "key." The attribute information corresponds to the content of the song selection attribute information 292 described above. "Genre" is information indicating the genre of the song, such as J-POP, K-POP, Enka, and Classical. "Tempo" is information indicating the tempo of the song, such as Ballad, Mid-Ballad, and Up-Tempo. "Key" is information regarding the pitch of the song's key.

[0067] In this embodiment, the music information 293 is described as being pre-stored in the storage unit 290, but this is not limited to this. The music information 293 may also be stored in a predetermined server located outside the terminal 200.

[0068] The song selection unit 240 identifies the song selection attribute values ​​obtained by the calculation unit 230 as song selection conditions. The song selection unit 240 refers to the song information 293 and determines whether or not there is a song that matches the identified song selection conditions. For example, in the example of the total score described above, the song selection unit 240 identifies the following as song selection conditions: "Genre" is "J-POP, K-POP", "Tempo" is "Mid-ballad", and "Key" is "Low-pitched song". The song selection unit 240 determines whether or not there is a song in the song information 293 that matches the song selection conditions.

[0069] The song selection unit 240 identifies a song as a selection candidate if it determines that a song exists that matches the song selection criteria. The song selection unit 240 may identify multiple song selection candidates. The song selection unit 240 may also identify songs as selection candidates if their degree of matching with the song selection criteria is equal to or greater than a predetermined value. Therefore, the song selection unit 240 may also select songs as selection candidates that do not perfectly match the song selection criteria.

[0070] If there are multiple song selection candidates, the song selection unit 240 selects the song to be played on the playback device 100. For example, the song selection unit 240 may select the song that best matches the selection criteria as the song to be played. The song selection unit 240 then transmits the audio signal of the selected song to the playback device 100 in order to play it on the playback device 100. As a result, the playback device 100 plays the song selected on the terminal 200.

[0071] Furthermore, the song selection unit 240 may monitor changes in the user's surrounding environment and change the currently playing song in accordance with the changes in the user's surrounding environment. For example, the calculation unit 230 determines whether or not a song is currently playing, and if a song is currently playing, it newly calculates a parameter value for a parameter indicating the user's surrounding environment after the start of playback of that song (for example, P10 "level of pedestrian traffic"). The song selection unit 240 compares the attribute information for song selection obtained from the newly calculated parameter value with the attribute information of the currently playing song. If the degree of agreement between the two is less than a predetermined value, the song selection unit 240 ends the currently playing song at a predetermined timing, selects a new song that is appropriate for the user's current surrounding environment, and plays it on the playback device 100.

[0072] The predetermined timing could be, for example, the time when the currently playing song ends, or the time when a specific section of the song ends. A specific section of the song could be, for example, the verse, pre-chorus, or chorus. However, it is not limited to these; any appropriate timing can be set to switch between songs being played.

[0073] For example, suppose song a is playing on playback device 100. The calculation unit 230 newly calculates the parameter value of P10 at the present time, after playback of song a has started. The calculation unit 230 sums up the points corresponding to the newly calculated parameter value of P10 and calculates the total score. Based on the total score, the calculation unit 230 newly acquires song selection attribute values ​​(song selection attribute information).

[0074] The song selection unit 240 compares newly acquired song selection attribute values ​​with the attribute values ​​(attribute information) of song a while song a is playing. The song selection unit 240 determines the degree of agreement between the two, and if the degree of agreement is less than a predetermined value, it terminates song a, which is currently playing, at a predetermined timing. If the degree of agreement is equal to or greater than the predetermined value, the song selection unit 240 does not perform any special processing and continues playing song a. When terminating the playback of song a, the song selection unit 240 selects a new song b based on the newly acquired song selection attribute values ​​and starts playing song b at the same time as song a ends.

[0075] In this way, if the terminal 200 is not playing music that is appropriate for the user's surrounding environment, it can select music that is appropriate for the surrounding environment information and play it on the playback device 100. Note that although the P10 parameter was used here, other parameters may also be used.

[0076] Returning to Figure 2, let's continue the explanation. The input / output unit 270 is an input device that receives input from the user. For example, the input / output unit 270 receives mood information from the user. The input / output unit 270 is also an output device for outputting text, images, etc. The input / output unit 270 may be, for example, a touch panel that can be operated by the user touching it with their finger. The imaging unit 280 is an imaging device capable of imaging the area around the terminal 200. The imaging unit 280 is, like the imaging unit 110, for example, a visible light camera.

[0077] The memory unit 290 is a storage device that stores programs for realizing each function of the terminal 200. The memory unit 290 also stores the parameter information 291, song selection attribute information 292, and song information 293 mentioned above. Although Figure 2 shows the memory unit 290 inside the terminal 200, the memory unit 290 may be located on a predetermined server connected to the terminal 200 via a communication network. The terminal 200 can perform the song selection process described above by communicating with the server via the network.

[0078] Note that the configuration shown in Figure 2 is merely an example, and the music selection system 1000 may be configured using a device that integrates multiple components. For example, the functions of the playback device 100 and the terminal 200 may be integrated into the same device. For example, the playback device 100 may have all the functions of the terminal 200. In this way, the user can select and play music according to the surrounding environment simply by wearing the playback device 100, without having to carry the terminal 200.

[0079] Furthermore, for example, each functional unit in the playback device 100 and terminal 200 may be processed in a distributed manner using multiple devices. As mentioned above, the storage unit 290 may be located on an external server. The same applies to functional units other than the storage unit 290. Also, for example, a device other than the terminal owned by the user may be equipped with each functional unit of terminal 200. In this way, the same effect can be obtained even if the user does not carry terminal 200 with them.

[0080] Next, with reference to Figure 6, the processing performed by terminal 200 will be explained. Figure 6 is a flowchart showing the music selection process performed by terminal 200. It is assumed that the playback device 100 constantly detects environmental information around the user while they are walking and transmits this environmental information to terminal 200. The environmental information includes image information and audio information. It is also assumed that the playback device 100 detects user information and constantly transmits this user information to terminal 200.

[0081] First, the environmental information acquisition unit 210 acquires environmental information transmitted from the playback device 100 (S101). Next, the user information acquisition unit 220 acquires user information transmitted from the playback device 100 (S102). Note that the order of steps S101 and S102 may be reversed.

[0082] Next, the calculation unit 230 calculates parameter values ​​corresponding to each parameter based on environmental information and user information (S103). The calculation unit 230 may use well-known machine learning methods to calculate parameter values ​​from environmental information and user information. For example, the calculation unit 230 calculates P10 "activity level of human flow" from P3 "speed of people" and P4 "density of people" shown in Figure 3, and calculates the parameter value corresponding to P10.

[0083] Next, the calculation unit 230 calculates the score for each parameter based on the parameter values ​​(S104). The calculation unit 230 sums the scores for each parameter to calculate the total score for each song selection attribute and obtains the song selection attribute value from the total score (S105). Then, the song selection unit 240 refers to the song information 293 and selects a song using the song selection attribute value as the song selection condition (S106). Specifically, the song selection unit 240 determines whether or not there is a song in the song information 293 that matches the song selection condition.

[0084] The song selection unit 240 transmits an audio signal corresponding to the selected song to the playback device 100, causing the selected song to play (S107). Through this song selection process, the song selection system 1000 can appropriately select and play songs according to the user's surrounding environment.

[0085] Furthermore, although not shown in Figure 6, the song selection unit 240 may monitor whether the currently playing song corresponds to the user's surrounding environment and continuously play a song appropriate to the user's surrounding environment. For example, if a song is currently playing, the calculation unit 230 newly calculates P10 after the start of song playback and newly acquires song selection attribute values. The song selection unit 240 compares the newly acquired song selection attribute values ​​with the attribute values ​​of the currently playing song. If the degree of agreement between the two is less than a predetermined value, the song selection unit 240 ends the currently playing song at a predetermined timing and plays the newly selected song on the playback device 100.

[0086] As described above, in the song selection system 1000 according to this embodiment, the terminal 200 has an environmental information acquisition unit 210 and a user information acquisition unit 220 which acquire environmental information and user information, respectively. The environmental information may include at least imaging information among imaging information and audio information. The calculation unit 230 calculates various parameters as shown in Figure 3 and the parameter values ​​of each parameter based on the environmental information and user information.

[0087] For example, the calculation unit 230 determines the speed of people based on the motion vectors of people detected from the imaging information. The calculation unit 230 also determines the density of people based on at least one of the imaging information and the audio information. The calculation unit 230 calculates the activity level of the pedestrian flow based on the speed of people and the density of people. The calculation unit 230 obtains song selection attribute values ​​used for song selection from the sum of the scores corresponding to the parameter values ​​corresponding to the activity level of the pedestrian flow. In addition to the activity level of the pedestrian flow, the calculation unit 230 may also obtain song selection attribute values ​​using some or all of the surrounding atmosphere of people, the atmosphere of the building, the density of the building, and the user's mood information.

[0088] The song selection unit 240 uses the song selection attribute values ​​obtained by the calculation unit 230 as selection criteria and selects a song that matches the selection criteria. The song selection unit 240 transmits an audio signal corresponding to the selected song to the playback device 100, causing the playback device 100 to play the song. With this configuration, the terminal 200 can automatically select an appropriate song according to the user's surrounding environment and mood, and play it on the playback device 100.

[0089] Furthermore, while music is playing, terminal 200 can select a new song that suits the user's surrounding environment, end the currently playing song at a predetermined time, and play the newly selected song. This enables the song selection system 1000 to achieve automatic song selection that responds to subtle changes in the surrounding environment.

[0090] <Example Hardware Configuration> Each functional component of the playback device 100 and terminal 200 described above may be implemented by hardware (e.g., hardwired electronic circuits) or by a combination of hardware and software (e.g., a combination of an electronic circuit and a program to control it). For example, this disclosure can also be implemented by having a CPU (Central Processing Unit) execute a computer program.

[0091] The program, when loaded into a computer, includes a set of instructions (or software code) for causing the computer to perform one or more of the functions described in the embodiments. The program may be stored on a non-temporary computer-readable medium or a physical storage medium. Examples, but not limited to, include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray® disc or other optical disc storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage devices. The program may be transmitted over a temporary computer-readable medium or a communication medium. Examples, but not limited to, include temporary computer-readable medium or a communication medium that includes electrically, optically, acoustically or otherwise propagating signals.

[0092] This disclosure is not limited to the embodiments described above, and can be modified as appropriate without departing from its intent. For example, in the above description, up-tempo songs were set to correspond when the level of activity of people flowing was high, but conversely, ballad songs could be set to correspond instead. In addition, the parameters used for song selection and the points corresponding to each parameter may be set as appropriate according to the user's preferences. [Explanation of Symbols]

[0093] 100 playback equipment 110 Imaging Unit 120 Sound collection section 130 Sensor section 140 Output section 200 terminals (song selection devices) 210 Environmental Information Acquisition Department 220 User Information Acquisition Unit 230 Calculation Unit 240 Music Selection Department 270 Input / output section 280 Imaging Unit 290 Storage section 291 Parameter Information 292 Attribute information for song selection 293 Song Information 1000 Song Selection System

Claims

1. an environmental information acquisition unit that acquires environmental information regarding an environment surrounding a user; A calculation unit that calculates a parameter based on the environmental information obtained from people or buildings around the user, the parameter being obtained from the environmental information; a music selection unit that selects a song based on the parameters calculated by the calculation unit and attribute information that indicates attributes of the song. Music selection device.

2. The calculation unit calculates the parameter from any one of a speed of people around the user, a density of people around the user, an atmosphere of people around the user, a density of buildings around the user, and an atmosphere of buildings around the user, which are obtained from the environmental information. The music selection device according to claim 1.

3. The calculation unit, when the music piece is being played, newly calculates the parameter after the start of playback of the music piece, The music selection unit compares music selection attribute information obtained from the newly calculated parameters with attribute information of the music being played, and if the degree of match between the two is less than a predetermined value, ends the music being played at a predetermined timing, and selects and plays a music piece corresponding to the newly calculated parameters.

3. The music selection device according to claim 1 or 2.

4. The environmental information acquisition unit acquires the environmental information from imaging information captured by an imaging unit provided in a playback device worn by the user, The music selection unit outputs the selected music piece to an output unit provided in the playback device.

3. The music selection device according to claim 1 or 2.

5. A music selection system comprising a playback device worn by a user and a terminal communicably connected to the playback device, The playback device includes: An imaging unit that captures an image of the user's surroundings; an output unit for outputting a voice to the user; Equipped with The terminal includes: an environmental information acquisition unit that acquires environmental information related to an environment around the user based on image information captured by the imaging unit; A calculation unit that calculates a parameter based on the environmental information obtained from people or buildings around the user, the parameter being obtained from the environmental information; a music selection unit that selects a song based on the parameters calculated by the calculation unit and attribute information indicating attributes of the song, and outputs the selected song to the output unit; Equipped with Song selection system.

6. An environmental information acquisition step of acquiring environmental information regarding an environment surrounding a user; A calculation step of calculating a parameter based on the environmental information obtained from people or buildings around the user, the parameter being obtained from the environmental information; and a music selection step of selecting a music piece based on the parameters and attribute information indicating attributes of the music piece. A music selection method executed by a music selection device.

7. An environmental information acquisition step of acquiring environmental information regarding an environment surrounding a user; A calculation step of calculating a parameter based on the environmental information obtained from people or buildings around the user, the parameter being obtained from the environmental information; and selecting a song based on the parameters and attribute information indicating attributes of the song. program.

Images