Device and method for music selection during operation of a motor vehicle

Abstract

The invention relates to a device (1) for selecting music during operation of a motor vehicle (10). The device (1) is designed to obtain (S1) sensor data from at least one sensor device (2) of the motor vehicle (10) while a piece of music is output by an output device (3) of the motor vehicle (10), to determine (S2) a behavior and / or a mood of a vehicle occupant on the basis of the obtained sensor data, to ascertain (S3), on the basis of the determined behavior and / or the determined mood, whether the vehicle occupant likes the output piece of music, and to add (S4a) the output piece of music to a favorites list (S4a) and / or to use the output piece of music as a basis for the selection of future pieces of music output by the output device (3) provided that it has been established that the vehicle occupant likes the output piece of music.

Description

[0001] DEVICE AND METHOD FOR MUSIC SELECTION IN A MOTOR VEHICLE OPERATION

[0002] The present disclosure relates to a device for selecting music in the operation of a motor vehicle, a motor vehicle comprising the device, and / or a method for selecting music in the operation of a motor vehicle. Additionally, or alternatively, a computer program is provided which includes instructions that, when executed by a computer, cause the computer to execute the method, at least partially. Additionally, or alternatively, a computer-readable medium is provided which includes instructions that, when executed by a computer, cause the computer to execute the method, at least partially.

[0003] In today's digital age, music streaming services have become an integral part of daily life. These services have revolutionized the way we listen to music, providing access to millions of songs at the touch of a button. However, with such a vast selection, it can be challenging for users to discover new music they enjoy. To address this, popular streaming services utilize artificial intelligence algorithms to analyze user data such as listening history, search queries, and playlists, and to determine personalized music recommendations. These algorithms are constantly being improved to optimize the user experience and provide more accurate recommendations. This includes experimenting with new features such as personalized radio stations and mood-based playlists.The algorithms used by well-known streaming services currently focus mainly on analyzing user behavior, such as skipping songs or the user's music history.

[0004] Against the background of this prior art, the object of the present disclosure is to specify a device and / or a method, each of which is suitable for enriching the prior art. This object is achieved by the features of the independent claims. The dependent and subordinate claims each contain optional further developments of the disclosure.

[0005] The task is then solved by a device for music selection in the operation (e.g. ferry operation) of a motor vehicle.

[0006] The device is designed to receive sensor data from at least one sensor device of the motor vehicle while a piece of music is being output by an output device of the motor vehicle.

[0007] The device is designed to determine the behavior and / or mood of a vehicle occupant (of the motor vehicle, e.g., a driver of the motor vehicle) based on the sensor data received.

[0008] The device is designed to determine, based on specific behavior and / or mood, whether the played music piece pleases the vehicle occupant.

[0009] The device is designed to add the played music track to a favorites list (e.g., personalized for the vehicle occupant) if it has been determined that the vehicle occupant likes the played music track. Alternatively, or additionally, the device is designed to use the played music track as the basis for selecting future music tracks played by the output device (e.g., personalized for the vehicle occupant), if it has been determined that the vehicle occupant likes the played music track.

[0010] The device can be a control device (or control unit) for the output device. The output device can be an audio system and / or an infotainment system of the vehicle, wherein music (or music tracks) can be output via at least one loudspeaker of the output device. Music tracks (including the music track being played) can be made available from at least one music streaming service. The device (and / or the output device) can include a communication interface for wireless communication (e.g., via cellular communication) with the at least one music streaming service. The output device can have an input or selection unit, e.g., a touchscreen, by means of which the vehicle occupant can manually select music tracks for playback. The device can be configured to control the output device (e.g., automatically) to play music tracks.

[0011] The control device or control unit can be part of the driver assistance system or constitute the system itself. The control device can, for example, be an electronic control unit (ECU). The electronic control unit can be an intelligent, processor-controlled unit that can communicate with other modules via a central gateway (CGW) and may form the vehicle's electrical network via fieldbuses such as CAN bus, LIN bus, MOST bus, FlexRay, and / or Automotive Ethernet, for example, together with telematics control units and / or environmental sensors.

[0012] It is conceivable that the control unit manages functions relevant to the vehicle's driving behavior, such as steering, engine control, power transmission, and / or the braking system. Furthermore, driver assistance systems, such as a parking assistant, adaptive cruise control (ACC), lane keeping assist, lane change assist, traffic sign recognition, light signal recognition, hill start assist, night vision assist, and / or intersection assist, can be controlled by the control unit.

[0013] The device described above offers a number of advantages. Among other things, it provides improved technology that enables the automated determination of personalized music recommendations. This is achieved by observing and analyzing the behavior of a vehicle occupant, such as the driver, to determine whether or not the occupant likes the currently playing piece of music. For this purpose, sensor devices already installed in the vehicle for other functions, such as driver assistance systems, can be used to detect the occupant.

[0014] This special implementation in the vehicle makes it possible to automatically determine which pieces of music positively influence the mood of the vehicle occupants, especially the driver, and thus have a calming effect. This knowledge can then be used, for example, to positively influence the vehicle occupants, particularly the driver, in various operating and driving situations, which can have a beneficial effect on the vehicle's road safety.

[0015] Possible further developments of the device described above are explained in detail below.

[0016] The device can be designed (e.g., to use the output piece of music for selecting future music pieces output by the output device) to control the output device to repeat the output piece of music after it has been output.

[0017] The device can be designed (e.g., for using the output piece of music to select future music pieces output by the output device) to control the output device to output at least one further piece of music by the same performer and / or the same music genre as the output piece of music.

[0018] The device can be designed (e.g., after adding the output music piece) to control the output device and output music pieces listed in the favorites list.

[0019] The device can be designed to determine, based on sensor data from at least one sensor unit, whether the vehicle occupant (e.g., the driver) is unhappy, angry, and / or stressed (or in a bad mood). The device can be designed to control the output device to positively and / or calmly influence the vehicle occupant's mood when it has been determined that the vehicle occupant is unhappy, angry, and / or stressed (or in a bad mood).

[0020] The vehicle occupant may be the driver of the motor vehicle. The device may be designed to control the output device for positively and / or calmingly influencing the driver's mood during operation of the motor vehicle.

[0021] The device can be designed to determine, based on the received sensor data, whether the vehicle occupant is singing and / or humming along to the music being played. The received sensor data can include, for example, data on the facial and / or mouth movements of the vehicle occupant. Furthermore, it is conceivable, for example, that the received sensor data could include acoustic data.

[0022] The device can be designed to determine that the music played is to the occupant's liking, provided it has been determined that the occupant sings and / or hums along to the music played.

[0023] The device can be designed to determine, based on the received sensor data, whether the vehicle occupant is moving rhythmically to the music being played. The received sensor data can include, for example, data (or motion data) relating to at least one part of the vehicle occupant's body (e.g., the occupant's head).

[0024] The device can be designed to determine that the played music is pleasing to the vehicle occupant, provided it has been determined that the vehicle occupant moves rhythmically to the played music.

[0025] The device can be designed to determine the mood of the vehicle occupant based on the received sensor data, specifically whether the occupant is happy and / or energetic. The received sensor data can include, for example, data on the facial expression and / or facial movements of the vehicle occupant.

[0026] The device can be designed to determine that the music played pleases the vehicle occupant, provided that it has been determined that the vehicle occupant is happy and / or energetic.

[0027] The sensor data obtained may include image data from an interior camera system of the vehicle. The device may be configured to determine the behavior and / or mood of the vehicle occupant by evaluating the image data using an image recognition function to detect facial expressions (or facial movements) and / or body movements of the vehicle occupant. The image recognition function may include image recognition software executable by the device and / or at least a machine learning algorithm. The image recognition function may be configured to extract data about the vehicle occupant.

[0028] The at least one sensor device can be configured to record the vital signs (or vital parameters) of the vehicle occupant. In other words, the sensor data obtained can include data on the vital signs (or vital parameters) of the vehicle occupant. The device can be configured to determine the behavior and / or mood of the vehicle occupant by evaluating the vital signs (or vital parameters). The vital signs can include, for example, pulse and / or blood pressure values ​​of the vehicle occupant.

[0029] The device can be configured to add the played music track to the favorites list depending on the driving context of the vehicle and / or to use it as a basis for selecting future music tracks played by the output device. The driving context could be, for example, a (family) outing or a (recurring) commute to or from work. The above can be summarized in other words, and in a possible more concrete embodiment of the disclosure, as described below, which is to be interpreted as not being restrictive for the disclosure.

[0030] The vehicle may be equipped with an interior camera that can capture images of a vehicle occupant, such as the driver. The images from the interior camera can be processed using machine learning algorithms to extract data about the vehicle occupant, such as their current mood and / or activity (e.g., driving, talking, dancing, etc.).

[0031] If a vehicle occupant's mood suddenly improves when a new piece of music starts, and this is noticed, then it is very likely that the piece of music or artist being played is one of the occupant's favorites, which also has a positive effect on their mood. The piece of music can then be played more often, for example, when it is noticed that the occupant's mood (or emotional level) is low and should be improved.

[0032] The same positive behavior can be applied if the vehicle occupant suddenly starts humming along to a piece of music or moving rhythmically to the beat of the music.

[0033] According to the present disclosure, a mood and / or behavior or activity profile of a vehicle occupant can be derived in order to provide personalized (or user-specific) music recommendations to the vehicle occupant.

[0034] For example, a process according to the present disclosure can proceed as follows: The vehicle occupant listens to music in the motor vehicle, whereupon, via the interior camera, at least one of the following pieces of information about the vehicle occupant can be determined:

[0035] - Mood: happy, neutral, sad, disgusted, frightened, etc., - State of mind: energetic, peaceful, distracted, etc.,

[0036] - Aging or activity: speaking, driving, singing, humming, dancing, etc., and / or

[0037] - Driving context: Family outing, daily commute to work, etc.

[0038] If the mood changes, for example, to become too happy or too energetic, or if the activity involves singing, humming, and / or dancing, the piece of music, the performer, and / or the genre can receive a positive rating. Subsequent pieces of music can then be selected based on this positive rating.

[0039] The next time the vehicle occupant's mood is negative, a piece of music with a positive rating can be started.

[0040] Furthermore, a motor vehicle will be provided that includes the device described above.

[0041] The motor vehicle may include at least one sensor device. This sensor device may include at least one sensor, which may be located inside the vehicle. The sensor may be located in the vicinity of the vehicle occupant and / or directed towards the vehicle occupant.

[0042] The at least one sensor device may include or be a camera device. The at least one sensor device and / or the camera device may include at least one camera, which may be located inside the vehicle. The at least one camera may be directed towards the vehicle occupant, e.g., to detect a face (or facial expression) and / or body movement (e.g., a head movement) of the vehicle occupant.

[0043] The at least one sensor device can include at least one sensor for recording vital signs (or vital parameters), e.g., of the vehicle occupant. The at least one sensor can be, for example, a pulse sensor and / or a blood pressure sensor. The at least one sensor can be located in the vicinity of the vehicle occupant and / or be wearable (or worn) by the vehicle occupant.

[0044] The motor vehicle may include the output device. The output device may be the vehicle's audio system (or infotainment system) and / or may include at least one loudspeaker for playing music (or the music track).

[0045] The device can be connected to the at least one sensor device and the output device (optionally directly or indirectly, e.g. via a vehicle's electrical system) via signal technology.

[0046] The above description with reference to the device also applies analogously to the motor vehicle and vice versa.

[0047] Furthermore, a procedure for music selection in the operation (e.g. ferry operation) of a motor vehicle is provided.

[0048] The method involves receiving sensor data from at least one sensor device of the motor vehicle while a piece of music is output by an output device of the motor vehicle.

[0049] The procedure involves determining the behavior and / or mood of a vehicle occupant based on the sensor data obtained.

[0050] The procedure involves determining, based on specific behavior and / or mood, whether the played music piece appeals to the vehicle occupant.

[0051] The procedure includes adding the played music to a favorites list and / or using the played music as a basis for selecting future music pieces played by the output device, provided it has been determined that the played music is to the occupant's liking.

[0052] The (control) procedure can be a computer-implemented procedure, i.e., one, several or all steps of the procedure can be at least partially carried out by a computer or a data processing device, optionally the device itself.

[0053] What has been described above with reference to the device and the motor vehicle also applies analogously to the procedure and vice versa.

[0054] Furthermore, a computer program comprising commands that, when executed by a computer, cause it to at least partially execute the procedure described above is provided.

[0055] The program code of a computer program can be in any type of code, especially code suitable for controlling motor vehicles.

[0056] What has been described above with reference to the device, the motor vehicle and the process also applies analogously to the computer program and vice versa.

[0057] Furthermore, a computer-readable medium, in particular a computer-readable storage medium, is provided. The computer-readable medium comprises instructions which, when executed by a computer, cause it to at least partially execute the procedure described above.

[0058] This means that a computer-readable medium containing a computer program as defined above can be provided. The computer-readable medium can be any digital data storage device, such as a USB flash drive, hard drive, CD-ROM, SD card, or SSD card (or SSD drive / SSD hard drive). The computer program does not necessarily have to be stored on such a computer-readable storage medium to be made available to the vehicle; it can also be obtained via the internet or from other external sources.

[0059] The above description with reference to the method, the device, the computer program and the motor vehicle also applies analogously to the computer-readable medium and vice versa.

[0060] An optional embodiment is described below with reference to Figures 1 and 2.

[0061] Fig. 1 schematically shows a motor vehicle according to the disclosure with a device for selecting music in an operation of the motor vehicle, and

[0062] Fig. 2 schematically shows a flowchart of a method for selecting music in a motor vehicle operation according to the disclosed procedure.

[0063] The motor vehicle 10 shown only schematically in Figure 1 comprises the device 1, at least one sensor device 2 and an output device 3, wherein the device 1 can be connected to the at least one sensor device 2 and the output device 3 via signal technology.

[0064] The at least one sensor device 2 can include (or be) an interior camera device, wherein the interior camera device can have at least one camera which can be arranged in an interior space 11 of the motor vehicle. The at least one camera can, for example, be directed towards a vehicle occupant, e.g., the driver of the motor vehicle 10.

[0065] Furthermore, other sensor types are also conceivable. For example, the at least one sensor device 2 can include at least one sensor for recording vital signs (or vital parameters), e.g., a pulse sensor and / or a blood pressure sensor. The output device 3 can be an audio system and / or an infotainment system of the motor vehicle 10, whereby music (or musical pieces) can be output via at least one loudspeaker of the output device 3.

[0066] Music tracks can be made available for retrieval from at least one music streaming service, wherein the device 1 and / or the output device 3 may include a communication interface for wireless communication, e.g., via mobile communication, with the at least one music streaming service. Music tracks can be selected for output, e.g., manually via an input or selection unit, e.g., a touchscreen, of the output device 3. Furthermore, the device 1 may be a control device for the output device 3 and may be configured to automatically control the output device 3 to output music tracks.

[0067] For music selection in an operation (e.g. ferry operation) of the motor vehicle 10, the device 1 is designed to carry out the method 100 described in detail below, also with reference to Figure 2.

[0068] In the first step S1, sensor data from at least one sensor device 2 is received, while a piece of music, e.g. a song, is output by the output device 3.

[0069] In the second step S2, the behavior and / or mood of a vehicle occupant is determined based on the sensor data received.

[0070] Based on the sensor data received, the behavior of the vehicle occupant can be determined, for example, whether the vehicle occupant sings and / or hums along to the music being played, and / or whether the vehicle occupant moves rhythmically to the music being played.

[0071] Alternatively, or additionally, it is conceivable that the received sensor data could be used to determine the mood of the vehicle occupant, specifically whether the occupant is happy and / or energetic. If at least one sensor device 2 includes the interior camera system, the behavior and / or mood of the vehicle occupant could be determined by evaluating image data captured by the interior camera system using an image recognition function to detect facial expressions and / or body movements of the vehicle occupant.

[0072] If at least one sensor device 2 includes, for example, at least one sensor for recording vital signs (or vital parameters) of the vehicle occupant, then the behavior and / or mood of the vehicle occupant can be determined by evaluating the vital signs, which may include, for example, pulse values ​​and / or blood pressure values ​​of the vehicle occupant.

[0073] In the third step S3, it is determined, based on the specific behavior and / or mood, whether the played music piece pleases the vehicle occupant.

[0074] This allows it to be determined that the vehicle occupant likes the music being played, provided that, for example, sensor data has shown that the vehicle occupant sings and / or hums along to the music being played and / or moves rhythmically to the music being played.

[0075] Alternatively, or additionally, it is conceivable that it can be determined that the played music is pleasing to the vehicle occupant, provided that the sensor data has determined that the vehicle occupant is happy and / or energetic.

[0076] The fourth step, S4, comprises two alternative steps, S4a and S4b. At least one of these steps, S4a and S4b, is performed if it has been determined that the played music is to the vehicle occupant's liking. In step S4a, the played music is added to a favorites list. In step S4b, the played music is used as the basis for selecting future music played by the output device. If, in the fourth step, S4, it has been determined that the played music is to the vehicle occupant's liking, the music can be used after playback to positively influence the occupant's mood.

[0077] Output device 3 can be controlled to repeat the output track after it has finished playing. Alternatively, or additionally, output device 3 can be controlled to play at least one more track by the same artist and / or in the same genre as the output track.

[0078] Alternatively, or additionally, output device 3 can be used to output music tracks listed in the favorites list.

[0079] The mood of the vehicle occupant can be positively influenced, for example, in the manner described above, if sensor data indicates that the occupant is unhappy and / or stressed. This is particularly relevant if the occupant is the driver of the vehicle 10. In this way, the driver's mood can be positively and / or calmly influenced during operation of the vehicle 10, especially when the vehicle 10 is operating as a ferry.

[0080] Reference symbol list

[0081] 1 Device

[0082] 2 Sensor system, interior camera system 3 Output system

[0083] 10 motor vehicle

[0084] 11 Interior of the motor vehicle

[0085] 100 Procedure S1-S4b Procedure steps

Claims

Patent claims 1. Device (1 ) for music selection in an operation of a motor vehicle (10), characterized in that the device (1 ) is designed to: - to obtain sensor data from at least one sensor device (2) of the motor vehicle (10) (S1) while a piece of music is output from an output device (3) of the motor vehicle (10); - to determine the behavior and / or mood of a vehicle occupant based on the sensor data received (S2); - to determine, based on specific behavior and / or mood (S3), whether the played music piece is to the vehicle occupant's liking; and - to add the output music to a favorites list (S4a) and / or to use it as a basis for selecting future music outputs from the output device (3) (S4b), provided it has been determined that the output music is to the occupant's liking.

2. Device (1) according to claim 1, characterized in that - the device (1 ) for using (S4b) the output music piece for selecting future music pieces output by the output device (3) is designed to control the output device (3), - to repeat the played music track after it has finished playing, and / or - to play at least one more piece of music by the same artist and / or of the same music genre as the played piece of music, and / or - the device (1 ) is designed after adding (S4a) the output music piece to control the output device (3) to output music pieces listed in the favorites list.

3. Device (1) according to claim 2, characterized in that the vehicle occupant is a driver of the motor vehicle (10), and the device (1) is designed to control the output device (3) to positively and / or calmly influence the mood of the driver during operation of the motor vehicle (10).

4. Device (1) according to one of claims 1 to 3, characterized in that the device (1) is designed to: - to determine, based on the received sensor data, the behavior of the vehicle occupant (S2), whether the vehicle occupant sings and / or hums along to the played music; and - to ascertain (S3) that the music played pleases the vehicle occupant, provided it has been determined that the vehicle occupant sings and / or hums along to the music played.

5. Device (1 ) according to one of claims 1 to 4, characterized in that the device (1 ) is designed to: - to determine, based on the received sensor data, the behavior of the vehicle occupant (S2), whether the vehicle occupant moves rhythmically to the music being played; and - to ascertain (S3) that the music played pleases the vehicle occupant, provided it has been determined that the vehicle occupant moves rhythmically to the music played.

6. Device (1 ) according to one of claims 1 to 5, characterized in that the device (1 ) is designed to: - to determine the mood of the vehicle occupant based on the received sensor data (S2), specifically whether the vehicle occupant is happy and / or energetic; and - to determine (S3) that the music played pleases the vehicle occupant, provided that it has been determined that the vehicle occupant is happy and / or energetic.

7. Device (1) according to one of claims 1 to 6, characterized in that the sensor data obtained comprise image data from an interior camera device (2) of the motor vehicle (10) and the device (1) is designed to: - to determine the behavior and / or mood of the vehicle occupant by evaluating the image data using an image recognition function to detect a facial expression and / or body movement of the vehicle occupant.

8. Motor vehicle (10), characterized in that the motor vehicle (10) comprises the device (1 ) according to one of claims 1 to 7.

9. Method (100) for selecting music in an operation of a motor vehicle (10), characterized in that the method (100) comprises: Receiving (S1 ) sensor data from at least one sensor device (2) of the motor vehicle (10) while a piece of music is output from an output device (3) of the motor vehicle (10); - Determining (S2) a behavior and / or mood of a vehicle occupant based on the sensor data received; - Determine (S3) based on specific behavior and / or mood whether the played music is to the occupant's liking; and - Adding (S4a) the output music piece to a favorites list and / or using (S4b) the output music piece as a basis for selecting future music pieces output by the output device (3), provided that it has been determined that the output music piece is to the occupant's liking.

10. Computer program and / or computer-readable medium, characterized in that the computer program and / or the computer-readable medium comprises instructions which, when executed by a computer, cause it to execute the method (100) according to claim 9.

Images