AUTONOMOUS DRIVING VEHICLE WITH Karaoke FUNCTION AND METHOD FOR SAID VEHICLE

Abstract

The invention provides an autonomous vehicle with karaoke function and a method for the vehicle. The autonomous vehicle includes: a karaoke system configured to be enabled to provide a karaoke function for a user of the autonomous vehicle when the autonomous vehicle is in an autonomous driving mode; the action capturing device is configured to be suitable for capturing action data representing actions of the user in real time when the karaoke system is started; and an image presentation device configured to be suitable for receiving motion data representing the motion of the user in real time and generating and presenting an image simulating the motion of the user based on the motion data in real time. According to the technical scheme, an in-vehicle karaoke function can be provided for a user of an automatic driving vehicle, and meanwhile better karaoke experience can be provided for the user by presenting a visual image simulating the action of the user when the user uses the function to singe.

Description

Technical Field

[0001] The present invention relates to the field of autonomous driving vehicles, and more particularly, to an autonomous driving vehicle with a karaoke function and a method for use in the vehicle. Background Art

[0002] With the development of social economy and the improvement of people's living standards, vehicles are becoming more and more popular as daily means of transportation. In addition to the basic function of being a means of transportation, the comfort, convenience and entertainment of vehicles are gradually becoming new standards for measuring vehicles.

[0003] In order to meet people's demand for in-car entertainment, vehicles usually have infotainment systems to provide functions such as Internet access, audio and video playback, games, telephone, navigation, etc. The emergence of autonomous vehicles allows more entertainment possibilities to be provided to drivers. Summary of the invention

[0004] An object of the present invention is to provide an autonomous driving vehicle with a karaoke function and a method for the vehicle.

[0005] In a first aspect of the present invention, there is provided an autonomous driving vehicle with a karaoke function, comprising:

[0006] a karaoke system configured to be enabled when the autonomous vehicle is in the autonomous driving mode to provide a karaoke function to a user of the autonomous vehicle;

[0007] a motion capture device configured to capture motion data representing the user's motion in real time when the karaoke system is enabled; and

[0008] The image presentation device is configured to receive motion data representing the user's motion in real time, and to generate and present an image imitating the user's motion based on the motion data in real time.

[0009] In a second aspect of the present invention, there is provided a method for an autonomous driving vehicle according to the first aspect of the present invention, comprising:

[0010] When the autonomous driving vehicle is in the autonomous driving mode, enabling the karaoke system to provide a karaoke function to a user of the autonomous driving vehicle;

[0011] When the karaoke system is enabled, capturing motion data representing the user's motion in real time through the motion capture device; and

[0012] The image presentation device receives motion data representing the user's motion in real time, and generates and presents an image imitating the user's motion based on the motion data in real time.

[0013] The technical solution according to the present invention can provide an in-car karaoke function for users of autonomous driving vehicles, and at the same time, by presenting visual images that imitate the user's movements when the user sings using this function, a better karaoke experience can be provided to the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Non-limiting and non-exhaustive embodiments of the present invention are described, by way of example, with reference to the following drawings, in which:

[0015] Figure 1 A schematic block diagram of an autonomous driving vehicle with a karaoke function according to the present invention is shown;

[0016] Figure 2 A schematic block diagram of an autonomous driving vehicle with a karaoke function according to an embodiment of the present invention is shown;

[0017] Figure 3 is a schematic diagram showing the interaction between two autonomous vehicles according to the present invention; and

[0018] Figure 4 A flow chart of a method for an autonomous vehicle according to the present invention is shown. DETAILED DESCRIPTION

[0019] In order to make the above and other features and advantages of the present invention clearer, the present invention is further described below in conjunction with the accompanying drawings. The accompanying drawings constitute a part of this application and are used to illustrate the present invention together with the embodiments of the present invention. For the purpose of clarity and simplification, detailed specific descriptions of known functions and structures of the devices, devices and / or equipment described herein will be omitted when they may obscure the subject matter of the present invention. It should be understood that the specific embodiments given herein are for the purpose of explaining to those skilled in the art and are only exemplary and non-restrictive.

[0020] The features described herein may be embodied in different forms and should not be construed as being limited to the embodiments described herein. Rather, the embodiments described herein are provided only to illustrate some of the many possible ways of implementing the devices and / or systems described herein, which will be apparent after understanding the disclosure of the present application.

[0021] As used herein, the term "and / or" includes any one of the associated listed items and any combination of any two or more of the associated listed items.

[0022] Although terms such as "first," "second," and "third" may be used herein to describe various components, parts, portions, or elements, these components, parts, portions, or elements are not limited by these terms. Rather, these terms are only used to distinguish one component, part, portion, or element from another component, part, portion, or element. Therefore, without departing from the teachings of the present invention, a first component, part, portion, or element mentioned herein may also be referred to as a second component, part, portion, or element.

[0023] The terms used herein are only used to describe various embodiments and are not used to limit the present disclosure. Unless the context clearly indicates otherwise, "a", "an" and "the" are intended to include plural forms as well. The terms "include", "comprise" and "have" specify the presence of stated features, operations, components, elements and / or combinations thereof, but do not exclude the presence or addition of one or more other features, operations, components, elements and / or combinations thereof.

[0024] In the following description, many specific details are set forth to provide a thorough understanding of the present invention. However, it will be apparent to one of ordinary skill in the art that the present invention does not need to be practiced using the specific details. In other cases, well-known steps or operations are not described in detail to avoid obscuring the present invention.

[0025] The present invention is described below by way of example only with reference to the accompanying drawings.

[0026] like Figure 1 As schematically shown in FIG. 1 , the autonomous driving vehicle 10 with karaoke function according to the present invention includes a karaoke system 101 , a motion capture device 102 , and an image presentation device 103 .

[0027] The karaoke system 101 is configured to be enabled when the autonomous driving vehicle 10 is in the autonomous driving mode to provide a karaoke function for a user of the autonomous driving vehicle 10. The motion capture device 102 is configured to be able to capture motion data representing the user's motion in real time when the karaoke system 101 is enabled. The image presentation device 103 is configured to be able to receive the motion data representing the user's motion in real time, and to generate and present an image imitating the user's motion based on the motion data in real time.

[0028] The karaoke system 101 can be implemented in various possible ways as long as it can receive and play back the user's voice. For example, depending on the situation, the karaoke system 101 can be implemented partially or completely using existing components of the vehicle (e.g., central control system, audio system, microphone, etc.), or can be implemented as a system dedicated to the karaoke function as a whole.

[0029] The motion capture device 102 may be a camera or any other sensor suitable for capturing motion data representing the user's motion, and may be set at one or more suitable locations inside the vehicle according to the vehicle users (such as the driver, front seat passengers, rear seat passengers, etc.) who are expected to use the karaoke function. By way of example and not limitation, the motion capture device 102 may include a camera set in front of the cab of the vehicle and suitable for capturing motion data representing the motion of the vehicle driver. Alternatively, the motion capture device 102 may include a camera set at other suitable locations in the vehicle and suitable for capturing motion data representing the motion of the vehicle occupants.

[0030] The image presentation device 103 can be implemented in various possible ways, as long as it can receive motion data representing the user's motion and generate and present images that imitate the user's motion based on the motion data. For example, depending on the situation, the image presentation device 103 can be partially implemented using existing components of the vehicle (for example, an electronic control unit (ECU)), or can be implemented as a whole as a device dedicated to the karaoke function. By way of example and not limitation, the image presentation device 103 can be partially implemented by the ECU of the autonomous driving vehicle 10, specifically, the ECU can receive motion data representing the user's motion in real time, and generate image data representing images that imitate the user's motion based on the motion data in real time; and the image presentation device 103 further includes a projector, such as a holographic projector, for presenting a stereoscopic image that imitates the user's motion in a free space within the autonomous driving vehicle.

[0031] The image presented may be located in front of a vehicle user who is expected to use the in-car karaoke function. By way of example and not limitation, the image presented may be located at or near the center console of the vehicle. In addition, it is advantageous for the image presented to be a stereoscopic image.

[0032] Figure 2 A schematic block diagram of an autonomous driving vehicle 20 with a karaoke function according to a preferred embodiment of the present invention is shown.

[0033] like Figure 2 As shown in FIG. 1 , the autonomous driving vehicle 20 includes an electronic control unit (ECU) 200 , a microphone 202 , an audio system 203 , a motion capture device 204 , and a projector 205 .

[0034] The electronic control unit (ECU) 200 may also be referred to as a driving computer or a vehicle-mounted computer, and has capabilities similar to those of a conventional computer, such as communication capabilities, data processing capabilities, data storage capabilities, application program installation and operation capabilities, etc. Figure 2 As shown in FIG. 1 , a karaoke application 201 is installed on an electronic control unit (ECU) 200 .

[0035] The microphone 202 is configured to be communicatively connected to the electronic control unit (ECU) 200 to convert the sound emitted by the user (e.g., the driver or the passenger) of the autonomous driving vehicle 20 received into an electric signal and transmit the electric signal to the electronic control unit (ECU) 200. The electronic control unit (ECU) 200 processes the electric signal and outputs the processed electric signal. The sound system 203 is configured to be communicatively connected to the electronic control unit (ECU) 200 to receive the processed electric signal from the electronic control unit (ECU) 200 and convert the processed electric signal into a sound signal for playback. In this embodiment, the karaoke application 201, the microphone 202, and the sound system 203 form a karaoke system, which can be Figure 1 An example of a karaoke system 101 in FIG.

[0036] The karaoke system is configured to be enabled when the autonomous driving vehicle 20 is in the autonomous driving mode to provide a karaoke function for a user of the autonomous driving vehicle. By way of example and not limitation, the karaoke system may be configured to be enabled via the central control system of the autonomous driving vehicle, such as by a user input inputted by a user via a touch-controlled central control screen of the autonomous driving vehicle, for example, by a user via a karaoke system enable button displayed on the touch-controlled central control screen of the autonomous driving vehicle. Alternatively, the karaoke system may be configured to be enabled by the user in other possible ways, such as by a voice command inputted by the user via a voice input device of the autonomous driving vehicle.

[0037] In one embodiment, the microphone 202 is a wireless microphone. In this case, after the karaoke system is activated, the wireless microphone can be automatically connected to the electronic control unit (ECU) 200 of the autonomous driving vehicle 20.

[0038] The motion capture device 204 is configured to capture motion data representing the user's motion in real time when the karaoke system is enabled. Figure 2 As shown in , the motion capture device 204 is configured to be communicatively connected to the electronic control unit (ECU) 200. The electronic control unit (ECU) 200 is configured to be suitable for receiving motion data representing the user's motion in real time, and generating image data representing an image imitating the user's motion based on the motion data in real time.

[0039] The projector 205 is configured to receive image data representing an image imitating the user's actions in real time and present an image imitating the user's actions based on the received image data in real time. Figure 2As shown in , the projector 205 is configured to be communicatively connected to the electronic control unit (ECU) 200. In one embodiment, the projector 205 is a holographic projector that can present a stereoscopic image that imitates the user's actions in a free space within the autonomous driving vehicle 20. In one embodiment, the projector 205 is also configured to be suitable for receiving additional data representing additional elements to be presented, and generating and presenting additional images that embody the additional elements based on the additional data. The additional elements can be any possible elements that the user wants to present in the form of images when singing karaoke, such as but not limited to: lyrics and subtitles of the song sung by the user, MV pictures related to the song sung by the user, background pictures selected by the user, animations related to karaoke effects (such as applause animations), etc. The additional data can be input and selected by the user when and / or after the karaoke system is enabled, for example, by a device / method that is the same or similar to the device / method used by the user to enable the karaoke system. The data corresponding to the additional elements can be stored in a storage unit of the electronic control unit (ECU) 200.

[0040] Optionally, the autonomous driving vehicle 20 according to the present invention may also be configured to allow its users to interact with users of other vehicles in karaoke, such as singing karaoke together. The other vehicle may be any vehicle, in particular, for example but not limited to, a vehicle within a certain range of the autonomous driving vehicle, in particular an autonomous driving vehicle. This may be achieved by a communication device (not shown) included in the autonomous driving vehicle 20. The communication device may be configured to be suitable for: when the karaoke system is enabled, sending an invitation to another vehicle to invite the user of the other vehicle to sing karaoke together, and in response to a confirmation message from the other vehicle indicating acceptance of the invitation, establishing a communication connection between the autonomous driving vehicle and the other vehicle for transmitting karaoke-related information therebetween. Advantageously, the invitation sent to the other vehicle includes information indicating a song to be invited to sing together. In addition, the karaoke-related information transmitted through the established communication connection may include information indicating a song to be invited to sing together, and each of the autonomous driving vehicle and the other vehicle may send information indicating a song to be invited to sing together to the other vehicle after the communication connection is established. As needed, the communication device may also be configured to be suitable for: when the karaoke system is enabled, receiving an invitation sent by another vehicle to invite the user of the autonomous driving vehicle to sing karaoke together, and in response thereto, sending a confirmation message indicating acceptance of the invitation to the other vehicle. The other vehicle may be an autonomous driving vehicle according to the present invention. By way of example and not limitation, the communication device may be implemented using existing components of the autonomous driving vehicle 20 (e.g., a communication device in an electronic control unit (ECU) 200). Nevertheless, it is possible for the communication device to be implemented in other possible ways. For example, depending on the circumstances, the communication device may be implemented as a whole as a device dedicated to the karaoke function. In addition, the communication device may implement communication using the Internet of Vehicles function.

[0041] Figure 3 A karaoke-related interaction between two autonomous vehicles according to the present invention is schematically illustrated.

[0042] Figure 3 3 shows a first autonomous driving vehicle (also referred to as “first vehicle”) 301 according to the present invention and its driver (also referred to as “first driver”), a second vehicle (also referred to as “second vehicle”) 302 according to the present invention and its driver (also referred to as “second driver”), and a base station 303 providing wireless signals. In addition, Figure 3 Also shown in FIG. 3 are cameras 204, electronic control units (ECUs) 200, and microphones 202 as motion capture devices, respectively, of the first vehicle 301 and the second vehicle 302. In each of the first vehicle 301 and the second vehicle 302, the camera 204 and the microphone 202 are communicatively connected to the electronic control unit (ECU) 200. Assume that Figure 3 In the illustrated scenario, a communication connection has been established between the first vehicle 301 and the second vehicle 302 for transmitting karaoke-related information therebetween, and the first driver and the second driver are singing karaoke together. At this time, the first vehicle 301 and the second vehicle 302 can send audio data representing the voices of their respective drivers and motion data representing the motions of their respective drivers to each other in real time. The communication module (in Figure 3 ) receive the audio data and motion data of the other vehicle driver in real time, play back the voice of the other vehicle driver based on the audio data through their respective karaoke systems, and play the voice of the other vehicle driver through their respective electronic control units and projectors (in Figure 3 (not shown in the figure; refer to the above description) based on the motion data, an image imitating the motion of the driver of the other vehicle is generated and presented. In this way, it can be visually realized that in addition to the first image imitating the motion of the first driver, a second image imitating the motion of the second driver is presented in the first vehicle 301; in addition to the second image imitating the motion of the second driver, a first image imitating the motion of the first driver is presented in the second vehicle 302.

[0043] Figure 4 A flow chart of a method 400 for an autonomous driving vehicle according to the present invention is shown. The method 400 comprises the following steps S401-S403:

[0044] Step S401: when the autonomous driving vehicle is in the autonomous driving mode, enabling a karaoke system of the autonomous driving vehicle to provide a karaoke function for a user of the autonomous driving vehicle;

[0045] Step S402: When the karaoke system is enabled, the motion data representing the user's motion is captured in real time by a motion capture device of the autonomous driving vehicle;

[0046] Step S403: The image presentation device of the autonomous driving vehicle receives motion data representing the user's motion in real time, and generates and presents images imitating the user's motion based on the motion data in real time.

[0047] In one embodiment of the method according to the present invention, the method further comprises: receiving, by the image presentation device, additional data representing additional elements to be presented, and generating and presenting an additional image embodying the additional elements based on the additional data.

[0048] In one embodiment of the method according to the present invention, the method also includes: when the karaoke system is enabled, sending an invitation to another vehicle to invite a user of the other vehicle to sing karaoke together, and establishing a communication connection between the autonomous driving vehicle and the other vehicle in response to a confirmation message from the other vehicle indicating acceptance of the invitation for transmitting karaoke-related information therebetween.

[0049] In one embodiment of the method according to the present invention, the method also includes: when the karaoke system is enabled, receiving an invitation sent by another vehicle to invite a user of the autonomous driving vehicle to sing karaoke together, and in response, sending a confirmation message to the other vehicle indicating acceptance of the invitation.

[0050] The various technical features described above can be combined arbitrarily. Although all possible combinations of these technical features are not described, any combination of these technical features should be considered to be covered by this specification as long as there is no contradiction in such combination.

[0051] Although the present invention has been described in conjunction with the embodiments, it should be understood by those skilled in the art that the above description and the accompanying drawings are only exemplary and non-restrictive, and the present invention is not limited to the disclosed embodiments. Various modifications and variations are possible without departing from the spirit of the present invention.

Claims

1. An autonomous driving vehicle with karaoke function, comprising: a karaoke system configured to be enabled when the autonomous vehicle is in the autonomous driving mode to provide a karaoke function to a user of the autonomous vehicle; a motion capture device configured to capture motion data representing the user's motion in real time when the karaoke system is enabled; The image presentation device is configured to receive motion data representing the user's motion in real time, and to generate and present an image imitating the user's motion based on the motion data in real time.

2. The autonomous driving vehicle of claim 1, wherein the karaoke system is configured to be enabled via a central control system of the autonomous driving vehicle.

3. An autonomous driving vehicle according to claim 1, wherein the image presentation device is also configured to receive additional data representing additional elements to be presented, and to generate and present additional images embodying the additional elements based on the additional data.

4. An autonomous driving vehicle according to claim 3, wherein the image presentation device includes a holographic projector.

5. The autonomous driving vehicle according to any one of claims 1 to 4, further comprising: A communication device configured to: when the karaoke system is enabled, send a first invitation to a first other vehicle to invite a user of the first other vehicle to sing karaoke together, and establish a communication connection between the autonomous driving vehicle and the first other vehicle for transmitting karaoke-related information therebetween in response to a first confirmation message from the first other vehicle indicating acceptance of the first invitation.

6. An autonomous driving vehicle according to claim 5, wherein the communication device is further configured to: when the karaoke system is enabled, receive a second invitation sent by a second other vehicle inviting a user of the autonomous driving vehicle to sing karaoke together, and in response thereto send a second confirmation message to the second other vehicle indicating acceptance of the second invitation.

7. A method for an autonomous vehicle according to any one of the preceding claims, comprising: When the autonomous driving vehicle is in the autonomous driving mode, enabling the karaoke system to provide a karaoke function to a user of the autonomous driving vehicle; When the karaoke system is enabled, capturing motion data representing the user's motion in real time through the motion capture device; The image presentation device receives motion data representing the user's motion in real time, and generates and presents an image imitating the user's motion based on the motion data in real time.

8. The method according to claim 7, further comprising: Additional data representing additional elements to be presented is received by the image presentation device, and an additional image embodying the additional elements is generated and presented based on the additional data.

9. The method according to any one of claims 7-8, further comprising: When the karaoke system is enabled, a first invitation is sent to a first other vehicle to invite a user of the first other vehicle to sing karaoke together, and in response to a first confirmation message from the first other vehicle indicating acceptance of the first invitation, a communication connection is established between the autonomous driving vehicle and the first other vehicle for transmitting karaoke-related information therebetween.

10. The method according to claim 9, further comprising: When the karaoke system is enabled, a second invitation sent by a second other vehicle inviting a user of the autonomous driving vehicle to sing karaoke together is received, and in response, a second confirmation message indicating acceptance of the second invitation is sent to the second other vehicle.

11. The method according to claim 9, further comprising: After establishing a communication connection between the autonomous driving vehicle and the first further vehicle, receiving, in real time from the first additional vehicle, motion data representing a motion of a user of the first additional vehicle; An image imitating the movement of the first other vehicle is generated and presented in real time by the image presentation device based on the movement data representing the movement of the user of the first other vehicle.

12. The method of claim 9, wherein the first invitation includes information indicating a song to which the sing-along is invited.

Images