A voice assistant system

Abstract

The present invention relates to a system (1) for playing a music content in the background during the time the application is running, and the users are interacting with the application, in particular in voice digital assistant applications (3) run in vehicles.

Description

[0001] DESCRIPTION

[0002] A VOICE ASSISTANT SYSTEM

[0003] Technical Field

[0004] The present invention relates to a system for playing a music content in the background during the time the application is running, and the users are interacting with the application, in particular in voice digital assistant applications run in vehicles.

[0005] Background of the Invention

[0006] Applications known as virtual assistants or digital assistants are a collection of software that responds to drivers in audio and / or written form by interacting with drivers in vehicles and making sense of what they write and / or speak, retrieving data from multiple sources and contextualizing the data. Only voice or written communication is established while using the said applications in the vehicle. This situation leads to a monotonous process on the user side and decreases satisfaction. Today, it is tried to create a difference by changing the way the assistant speaks, the accent and the gender of the person speaking, yet this does not change the content of the application. For this reason, today, there is a need for different solutions that will enable the use of digital assistants in vehicles to create satisfaction on the vehicle user side.

[0007] The United States patent document no. US2018121432, an application included in the state of the art, discloses a digital assistant system with music. In the invention subject to the said patent document, a digital assistant supported across devices, such as smartphones, tablets, personal computers, wearable computing devices, game consoles, and the like, is configured to interact with music or search services in a way that enhances various user experiences, content, or features that increase user interaction with music and other media content. The digital assistant is configured to act as the personal radio host of the user, for example, by determining the intent and preferences of the user, being aware of history and context, preparing personalized playlists and presenting them at contextually relevant times and places, providing information, recommendations, content and commentary relating to the music of the user, and interacting with the user.

[0008] Summary of the Invention

[0009] An object of the present invention is to realize a system which enables a music content to be played in the background of the application depending on the emotional state of the user during the interaction of the user with the assistant in the voice digital assistant applications running in vehicles.

[0010] Detailed Description of the Invention

[0011] “A Voice Assistant System” realized to fulfil the objective of the present invention is shown in the figure attached, in which:

[0012] Figure 1 is a schematic view of the inventive system.

[0013] The components illustrated in the figure are individually numbered, where the numbers refer to the following:

[0014] 1. System

[0015] 2. Vehicle computer

[0016] 3. Assistant application

[0017] 4. Camera

[0018] 5. Server A system (1) which enables music content determined depending on the emotional state of the user to be played in the background of the application during the interaction of the vehicle user with the assistant application in the vehicle comprises at least one vehicle computer (2) which is positioned inside the vehicle and is configured to have speakers for providing audio output, at least one microphone for receiving audio input and an input unit in the form of a keypad and / or touch screen; to establish communication with remote servers by using a data bus in the form of the Internet; and to run at least one application thereon; at least one assistant application (3) which is configured to be run on the vehicle computer (2); to start operating with a voice command from the vehicle user; and to communicate with the vehicle user by voice; at least one camera (4) which is located inside the vehicle and is configured to collect images and share them with the vehicle computer (2) in order to detect the emotional state of the driver; and at least one server (5) which is configured to establish communication with the vehicle computer (2) and the assistant application (3) run on the vehicle computer (2) and the camera (4) sharing images through any remote communication protocol; to keep a record of music content matched with emotional states therein; to be triggered upon activation of the assistant application (3) run on the vehicle computer (2) with a voice command by the vehicle user; to process images of the vehicle user in order to detect his / her emotional state through the communication established with the camera (4); and to determine the emotional state of the vehicle user and to play any of the stored music content during the use of the assistant application (3).

[0019] The vehicle computer (2) included in the inventive system (1) is positioned anywhere in the vehicle where the driver and / or passengers can interact and is configured to establish communication and exchange data with the server (5). The vehicle computer (2) is configured to establish communication with the camera (4), to collect images of the vehicle user through the established communication and to share them with the server (5). The said vehicle computer (2) has speakers for providing audio output, at least one microphone for receiving audio input and an input unit in the form of a key and / or a touch screen. The vehicle computer (2) runs an assistant application (3) thereon that is configured to at least automatically process data, generate meaningful results and provide meaningful responses to the speech of the driver by communicating with the driver by voice. The vehicle computer (2) is configured to transmit the information input by the vehicle user on the assistant application (3) to the server (5). The vehicle computer (2) is configured to enable communication to be established and to exchange data with the server (5) through a communication protocol in the form of the Internet. The vehicle computer (2) is configured to collect weather data through remote servers or sensors located in the vehicle and to share it with the server (5) together with time information, and to enable it to be used in deciding the music content to be played when the assistant application (3) is running.

[0020] The assistant application (3) included in the inventive system (1) is run on the vehicle computer (2) and is a voice digital assistant application that users activate by voice and interact with voice. The assistant application (3) is configured to establish communication with the server (5) through the vehicle computer (2) and to provide voice responses to the speech of the vehicle user through this established communication. The assistant application (3) is configured to play the music content determined according to the emotional state of the vehicle user in the background during the time it is active on the vehicle computer (2). The assistant application (3) is configured to enable the vehicle user to enter inputs to turn off or change the music content during the operation of the application.

[0021] The camera (4) included in the inventive system (1) is located inside the vehicle and is configured to establish communication with the vehicle computer (2), to exchange data through this communication and to share the images of the vehicle user with the server (5). The camera (4) is configured to share the images of the vehicle user from inside the vehicle with the server (5) by being triggered by the operation of the assistant application (3).

[0022] The server (5) included in the inventive system (1) is configured to establish communication with the vehicle computer (2) and to exchange data with the assistant application (3) through the vehicle computer (2) by using any remote communication protocol included in the state of art. The server (5) is configured to collect images of the driver captured by the camera (4) of the vehicle user through the communication established with the vehicle computer (2) and to analyze them with image processing techniques for the detection of the emotional state. The server (5) is configured to keep a record of music content matched with emotional states therein and to play the appropriate music content on the running assistant application (3) depending on the detection of the emotional state. The server (5) is configured to run the music content detected according to the emotional state of the vehicle user together with the assistant application (3) and to enable it to be listened to in the vehicle. In the preferred embodiment, the server (5) is configured to enable the type of music to be played together with the assistant application (3) to be decided by including the emotional state of the driver as well as weather and time information in the analysis.

[0023] In the inventive system (1), upon a voice command given by the vehicle user to the assistant application, a music content starts to play in the background of the application depending on the emotional state, weather and time information of the vehicle user. In this way, customer satisfaction is increased by filling the pauses that occur during voice interaction in the assistant application with music content. For this, the server (5) processes the images received from the camera (4) after the vehicle user gives a voice command to the assistant application (3) and plays the music content with the assistant application (3) depending on the emotional state. Within these basic concepts; it is possible to develop various embodiments of the inventive “A Voice Assistant System (1)”; the invention cannot be limited to examples disclosed herein and it is essentially according to claims.

Claims

CLAIMS1. A system (1) which enables music content determined depending on the emotional state of the user to be played in the background of the application during the interaction of the vehicle user with the assistant application in the vehicle; characterized by at least one vehicle computer (2) which is positioned inside the vehicle and is configured to have speakers for providing audio output, at least one microphone for receiving audio input and an input unit in the form of a keypad and / or touch screen; to establish communication with remote servers by using a data bus in the form of the Internet; and to run at least one application thereon; at least one assistant application (3) which is configured to be run on the vehicle computer (2); to start operating with a voice command from the vehicle user; and to communicate with the vehicle user by voice; at least one camera (4) which is located inside the vehicle and is configured to collect images and share them with the vehicle computer (2) in order to detect the emotional state of the driver; and at least one server (5) which is configured to establish communication with the vehicle computer (2) and the assistant application (3) run on the vehicle computer (2) and the camera (4) sharing images through any remote communication protocol; to keep a record of music content matched with emotional states therein; to be triggered upon activation of the assistant application (3) run on the vehicle computer (2) with a voice command by the vehicle user; to process images of the vehicle user in order to detect his / her emotional state through the communication established with the camera (4); and to determine the emotional state of the vehicle user and to play any of the stored music content during the use of the assistant application (3).

2. A system (1) according to Claim 1; characterized by the vehicle computer (2) which is positioned anywhere in the vehicle where the driver and / or passengers can interact and is configured to establish communication and exchange data with the server (5).

3. A system (1) according to Claim 1 or 2; characterized by the vehicle computer (2) which is configured to establish communication with the camera (4), to collect images of the vehicle user through the established communication and to share them with the server (5).

4. A system (1) according to any one of the preceding claims; characterized by the vehicle computer (2) which runs an assistant application (3) thereon that is configured to at least automatically process data, generate meaningful results and provide meaningful responses to the speech of the driver by communicating with the driver by voice.

5. A system (1) according to any one of the preceding claims; characterized by the vehicle computer (2) which is configured to transmit the information input by the vehicle user on the assistant application (3) to the server (5).

6. A system (1) according to any one of the preceding claims; characterized by the vehicle computer (2) which is configured to enable communication to be established and to exchange data with the server (5) through a communication protocol in the form of the Internet.

7. A system (1) according to any one of the preceding claims; characterized by the vehicle computer (2) which is configured to collect weather data through remote servers or sensors located in the vehicle and to share it with the server (5) together with time information, and to enable it to be used in deciding the music content to be played when the assistant application (3) is running.

8. A system (1) according to any one of the preceding claims; characterized by the assistant application (3) which is run on the vehicle computer (2) and is a voice digital assistant application that users activate by voice and interact with voice.

9. A system (1) according to any one of the preceding claims; characterized by the assistant application (3) which is configured to establish communication with the server (5) through the vehicle computer (2) and to provide voice responses to the speech of the vehicle user through this established communication.

10. A system (1) according to any one of the preceding claims; characterized by the assistant application (3) which is configured to play the music content determined according to the emotional state of the vehicle user in the background during the time it is active on the vehicle computer (2).

11. A system (1) according to any one of the preceding claims; characterized by the assistant application (3) which is configured to enable the vehicle user to enter inputs to turn off or change the music content during the operation of the application.

12. A system (1) according to any one of the preceding claims; characterized by the camera (4) which is located inside the vehicle and is configured to establish communication with the vehicle computer (2), to exchange data through this communication and to share the images of the vehicle user with the server (5).

13. A system (1) according to any one of the preceding claims; characterized by the camera (4) which is configured to share the images of the vehicle user from inside the vehicle with the server (5) by being triggered by the operation of the assistant application (3).

14. A system (1) according to any one of the preceding claims; characterized by the server (5) which is configured to establish communication with the vehiclecomputer (2) and to exchange data with the assistant application (3) through the vehicle computer (2) by using any remote communication protocol included in the state of art.

15. A system (1) according to any one of the preceding claims; characterized by the server (5) which is configured to collect images of the driver captured by the camera (4) of the vehicle user through the communication established with the vehicle computer (2) and to analyze them with image processing techniques for the detection of the emotional state.

16. A system (1) according to any one of the preceding claims; characterized by the server (5) which is configured to keep a record of music content matched with emotional states therein and to play the appropriate music content on the running assistant application (3) depending on the detection of the emotional state.

17. A system (1) according to any one of the preceding claims; characterized by the server (5) which is configured to run the music content detected according to the emotional state of the vehicle user together with the assistant application (3) and to enable it to be listened to in the vehicle.

18. A system (1) according to any one of the preceding claims; characterized by the server (5) which is configured to enable the type of music to be played together with the assistant application (3) to be decided by including the emotional state of the driver as well as weather and time information in the analysis.

Images