Method, device, equipment and storage medium for playing multimedia data

Abstract

The present application provides a method, apparatus, device and storage medium for playing multimedia data, wherein the method includes, when playing multimedia data in a vehicle, obtaining a list of listeners for the multimedia data; the listener list includes at least one image data for representing a listener who has listened to at least part of the multimedia data; matching the image data of at least one listener with in-vehicle image data to obtain position information of at least one listener in the vehicle; and playing the multimedia data based on the position information of at least one listener in the vehicle.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a method, apparatus, device, and storage medium for playing multimedia data. Background Art

[0002] When multimedia content is played in a car, it is often played through all the car's speakers, resulting in poor audio quality. Furthermore, when the speakers need to be adjusted, manual adjustments are often necessary. This is cumbersome and difficult for users to achieve the same precision as professionals. The balance and focus points adjusted manually are often less accurate, resulting in poor audio quality. Summary of the Invention

[0003] The present application mainly provides a method, apparatus, device and storage medium for playing multimedia data, which can overcome the problem of poor audio playback effect in related technologies.

[0004] The technical solution of the embodiment of the present application is implemented as follows:

[0005] The present invention provides a method for playing multimedia data, including:

[0006] In the case of playing multimedia data in a vehicle, obtaining a listener list of the multimedia data; the listener list includes at least one image data representing a listener who has listened to at least part of the multimedia data;

[0007] Matching the image data of at least one of the listeners with the in-vehicle image data to obtain position information of at least one listener in the vehicle;

[0008] The multimedia data is played based on the position information of at least one listener in the vehicle.

[0009] An embodiment of the present application provides a device for playing multimedia data, the device comprising:

[0010] An acquiring unit is configured to acquire a listener list of the multimedia data when the multimedia data is played in a vehicle; the listener list includes at least one image data representing a listener who has listened to at least a portion of the multimedia data;

[0011] A matching unit is used to match the image data of at least one of the listeners with the image data in the car to obtain the position information of at least one listener in the car

[0012] The playing unit is configured to play the multimedia data based on the position information of at least one listener in the vehicle.

[0013] An embodiment of the present application provides a device for playing multimedia data, comprising: a memory for storing executable instructions; and a processor for executing the executable instructions stored in the memory to implement the method for playing multimedia data provided in the embodiment of the present application.

[0014] An embodiment of the present application provides a storage medium having executable instructions stored thereon. When the executable instructions are executed by a processor, the method for playing multimedia data provided in the embodiment of the present application is implemented.

[0015] The embodiments of the present application have the following beneficial effects:

[0016] In an embodiment of the present application, when multimedia data is being played in a vehicle, a listener list for the multimedia data can be obtained, the listener list including at least one image data representing an audience that has listened to at least a portion of the multimedia data; the at least one image data of the listener can be matched with in-vehicle image data to obtain location information of at least one in-vehicle listener; and finally, the multimedia data can be played based on the location information of the at least one in-vehicle listener. Because the in-vehicle listener represents an audience that has listened to at least a portion of the multimedia data in the vehicle, the in-vehicle listener is a specific person interested in the currently playing multimedia data. Therefore, in an embodiment of the present application, the multimedia data is played based on the location information of the specific person interested in the currently playing multimedia data, thereby achieving automatic adjustment of the audio system for playing the multimedia data. This solves the problem of poor audio playback quality caused by manual adjustment in related technologies, thereby improving the quality of multimedia data playback in the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 A flowchart of a method for playing multimedia data provided in an embodiment of the present application;

[0018] Figure 2 A flowchart of a method for playing multimedia data provided in an embodiment of the present application;

[0019] Figure 3 A flowchart of a method for playing multimedia data provided in an embodiment of the present application;

[0020] Figure 4 A flowchart of a method for playing multimedia data provided in an embodiment of the present application;

[0021] Figure 5 A flowchart of a method for playing multimedia data provided in an embodiment of the present application;

[0022] Figure 6 A flowchart of a method for playing multimedia data provided in an embodiment of the present application;

[0023] Figure 7A schematic diagram of the structure of a device for playing multimedia data provided in an embodiment of the present application;

[0024] Figure 8 A schematic diagram of the structure of a device for playing multimedia data provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The technical solution of the present application is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0026] In order to enable people in this technical field to better understand the embodiments of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of this application, rather than all the embodiments.

[0027] The terms "first," "second," and "third," etc. in the specification, embodiments, claims, and figures of this application are used to distinguish similar objects and are not necessarily used to describe a particular order or precedence. In addition, the terms "including" and "having," and any variations thereof, are intended to cover non-exclusive inclusions, for example, including a series of steps or units. A method, system, product, or apparatus is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to the process, method, product, or apparatus.

[0028] An embodiment of the present application provides a method for playing multimedia data, which can be applied to a device for playing multimedia data in a vehicle.

[0029] Figure 1 This is a flow chart of a method for playing multimedia data according to an embodiment of the present application. Figure 1 As shown, the process may include:

[0030] In S101 , when multimedia data is played in a vehicle, a list of listeners of the multimedia data is obtained.

[0031] In the embodiment of the present application, the device for playing multimedia data can obtain a pre-generated listener list corresponding to the multimedia data when the multimedia data is played in a vehicle.

[0032] Here, the multimedia data can be either audio data or video data. The listener list is used to represent a list of users interested in the multimedia data. The listener list includes at least one image representing a listener who has listened to at least a portion of the multimedia data. That is, each listener in the listener list is a user who has listened to at least a portion of the multimedia data, and the listener list includes the image data of each listener. Here, at least a portion of the multimedia data refers to the period from the climax to the end of the multimedia data. Because the listeners have listened to at least the climax of the multimedia data, the users who have listened to at least a portion of the multimedia data can be considered listeners interested in the multimedia data. In some embodiments, the listeners can also be historical operators who have listened to at least a portion of the multimedia data. Historical operators represent users who have historically operated on the currently playing multimedia data. Operators represent users who have previously operated on the multimedia data. Operations on the multimedia data can include adjusting the volume or the playback quality of the multimedia data, but these operations do not include switching the currently playing multimedia data to another multimedia data. If a user in the vehicle has previously operated on the multimedia data and listened to at least a portion of the multimedia data, it indicates that the user is interested in the multimedia data, and the image data of the historical operator can be added to the listener list for the multimedia data. In this way, the image data of each listener who is interested in the multimedia data can be obtained through the listener list.

[0033] In S102 , the image data of at least one listener is matched with the in-vehicle image data to obtain the position information of at least one listener in the vehicle.

[0034] Here, the in-car listener refers to the listener in the car among at least one listener. Because not every listener in the listener list is in the car, it is necessary to match the image data of at least one listener with the in-car image data to determine which listeners are in the car and the specific locations of the in-car listeners in the car.

[0035] In some embodiments, the device for playing multimedia data can first match the image data of at least one listener with the in-car image data to obtain the image data corresponding to each listener in the car, and then determine the position of the image data of the listener in the car in the in-car image data, and determine the position as the position information of the listener in the car.

[0036] In S103 , multimedia data is played based on the position information of at least one listener in the vehicle.

[0037] In the embodiment of the present application, after determining the position information of the listener in the vehicle, the device for playing multimedia data can control the audio system inside the vehicle to play the multimedia data based on the position information of the listener in the vehicle.

[0038] In some embodiments, the device for playing multimedia data may determine a target speaker within a preset distance from the location information of the listener in the car based on the location information of the listener in the car, and then play the multimedia data based on the target speaker.

[0039] In some embodiments, the device for playing multimedia data may further determine a sound attenuation direction based on the position information of the listener in the vehicle, adjust the sound quality of the audio system based on the sound attenuation direction, and finally play the multimedia data based on the adjusted audio system.

[0040] In an embodiment of the present application, when multimedia data is being played in a vehicle, a listener list for the multimedia data can be obtained, the listener list including at least one image data representing an audience that has listened to at least a portion of the multimedia data; the at least one image data of the listener can be matched with in-vehicle image data to obtain location information of at least one in-vehicle listener; and finally, the multimedia data can be played based on the location information of the at least one in-vehicle listener. Because the in-vehicle listener represents an audience that has listened to at least a portion of the multimedia data in the vehicle, the in-vehicle listener is a specific person interested in the currently playing multimedia data. Therefore, in an embodiment of the present application, the multimedia data is played based on the location information of the specific person interested in the currently playing multimedia data, thereby achieving automatic adjustment of the audio system for playing the multimedia data. This solves the problem of poor audio playback quality caused by manual adjustment in related technologies, thereby improving the quality of multimedia data playback in the vehicle.

[0041] Figure 2 This is a flowchart of a method for playing multimedia data provided by an embodiment of the present application, based on Figure 1 , Figure 1 S103 in can be realized by S201 to S202, which will be combined Figure 2 The steps shown are explained.

[0042] In S101 , when multimedia data is played in a vehicle, a list of listeners of the multimedia data is obtained.

[0043] In S102 , the image data of at least one listener is matched with the in-vehicle image data to obtain the position information of at least one listener in the vehicle.

[0044] In S201 , a target speaker is determined from at least two speakers based on position information of at least one listener in the vehicle.

[0045] Here, the vehicle includes at least two speakers, and the at least two speakers are distributed in different locations. In the embodiment of the present application, the distribution location of each speaker is related to the seat position in the vehicle. For example, if there are two speakers, one speaker can be placed around the driver and passenger seats of the vehicle, and the other speaker can be placed around the rear seat. If there are more than two speakers, the speakers can be distributed around different seats.

[0046] Here, the target sound is a sound whose distance from the position information of the listener in the car is within a preset range.

[0047] In the embodiment of the present application, the distance between each listener in the car and each speaker can be determined, and then the speakers whose distance is within a preset range are determined as target speakers.

[0048] In S202, the target speaker is controlled to play multimedia data.

[0049] In the embodiment of the present application, after the target speaker is determined, the target speaker can be directly controlled to play the multimedia data.

[0050] This embodiment of the present application can determine a target speaker from at least two speakers based on the location information of at least one listener in the vehicle, and control the target speaker to play multimedia data. Because the target speaker is located within a preset distance from the listener's location information, the sound quality of the multimedia data is optimized for each listener in the vehicle. Thus, this embodiment of the present application automatically adjusts the speaker playing multimedia data based on the listener's location information, improving the quality of multimedia data playback in the vehicle.

[0051] Figure 3 This is a flowchart of a method for playing multimedia data provided by an embodiment of the present application, based on Figure 1 , Figure 1 S103 in the above can be realized by S301 to S303, which will be combined with Figure 3 The steps shown are explained.

[0052] In S101 , when multimedia data is played in a vehicle, a list of listeners of the multimedia data is obtained.

[0053] In S102 , the image data of at least one listener is matched with the in-vehicle image data to obtain the position information of at least one listener in the vehicle.

[0054] In S301 , the center point coordinates of the position information of at least one listener in the vehicle are determined.

[0055] In an embodiment of the present application, the device for playing multimedia data may connect the position information of at least one listener in the vehicle to obtain a geometric shape. When there are two listeners in the vehicle, the geometric shape is a line segment; when there are multiple listeners in the vehicle, the geometric shape is a polygon. The geometric center of the geometric shape is then determined, and the coordinates of the geometric center are used as the center point coordinates.

[0056] In S302 , based on the center point coordinates and the in-vehicle space data, the sound attenuation direction of the multimedia data being played is determined.

[0057] Here, the vehicle interior space data is used to represent the size of the vehicle interior space. In the embodiment of the present application, the vehicle interior space data may include vehicle width data and vehicle length data.

[0058] In the embodiment of the present application, S302 can be implemented through S321 to S324:

[0059] In S321 , the lateral attenuation gradient quantity and the longitudinal attenuation gradient quantity of the vehicle are obtained.

[0060] In an embodiment of the present application, the vehicle can pre-set multiple lateral attenuation gradients and multiple longitudinal attenuation gradients; wherein the number of lateral attenuation gradients is related to the vehicle width data, and the number of longitudinal attenuation gradients is related to the vehicle length data.

[0061] In S322 , based on the vehicle width data and the amount of the lateral attenuation gradient, lateral data of the attenuation gradient is determined.

[0062] In an embodiment of the present application, the device for playing multimedia data may determine the quotient of the vehicle width data and the number of lateral attenuation gradients as the lateral data of the attenuation gradient.

[0063] The lateral data of the attenuation gradient is used to characterize the width of each attenuation gradient.

[0064] In the embodiment of the present application, the lateral data of the attenuation gradient can be realized by formula (1):

[0065]

[0066] Where W is the vehicle width data of the vehicle interior space, and N is the number of lateral attenuation gradients. In this way, the lateral data of the attenuation gradient can be determined based on the vehicle width data and the number of lateral attenuation gradients.

[0067] In S323 , longitudinal data of the attenuation gradient is determined based on the vehicle length data and the longitudinal attenuation gradient quantity.

[0068] In an embodiment of the present application, the device for playing multimedia data can determine the quotient of the vehicle length data and the number of longitudinal attenuation gradients as the longitudinal data of the attenuation gradient.

[0069] The longitudinal data of the attenuation gradient are used to characterize the length of each attenuation gradient.

[0070] In the embodiment of the present application, the longitudinal data of the attenuation gradient can be realized by formula (2):

[0071]

[0072] Where L is the vehicle length data of the vehicle interior space, and M is the number of longitudinal attenuation gradients. In this way, the longitudinal data of the attenuation gradient can be determined based on the vehicle length data and the number of longitudinal attenuation gradients.

[0073] In S324 , the sound attenuation direction of the multimedia data being played is determined based on the coordinates of the center point, the horizontal data of the attenuation gradient, and the vertical data of the attenuation gradient.

[0074] Here, the sound attenuation direction of the multimedia data is the direction in which the sound propagation attenuates when the vehicle plays the multimedia data.

[0075] In an embodiment of the present application, the above-mentioned center point coordinates are two-dimensional coordinates, including a horizontal axis coordinate value and a vertical axis coordinate value. The device for playing multimedia data can determine the quotient of the horizontal axis coordinate value and the horizontal data of the attenuation gradient to obtain the horizontal axis coordinate value of the sound attenuation position; determine the quotient of the vertical axis coordinate value and the vertical data of the attenuation gradient to obtain the vertical axis coordinate value of the sound attenuation position; determine the horizontal axis coordinate value of the sound attenuation position and the vertical axis coordinate value of the sound attenuation position as the sound attenuation coordinates; and use the direction in which the coordinates of the vehicle audio point to the sound attenuation coordinates as the direction of sound propagation attenuation.

[0076] In the embodiment of the present application, the horizontal axis coordinate value of the sound attenuation position can be realized by formula (3):

[0077] The horizontal axis coordinate value of the sound attenuation position = a / the horizontal data of the attenuation gradient (Formula (3));

[0078] Where a is the horizontal axis coordinate value in the center point coordinates.

[0079] In the embodiment of the present application, the vertical axis coordinate value of the sound attenuation position can be realized by formula (4):

[0080] The vertical axis coordinate value of the sound attenuation position = b / the vertical data of the attenuation gradient (Formula (4));

[0081] Wherein, b is the vertical axis coordinate value in the center point coordinates.

[0082] In S303 , multimedia data is played based on the sound attenuation direction.

[0083] In an embodiment of the present application, after determining the sound attenuation direction, the device for playing multimedia data can control all the audio systems of the vehicle to play the multimedia data based on the sound attenuation direction.

[0084] In some embodiments, a target speaker in the vehicle may be controlled to play multimedia data based on the sound attenuation direction, wherein the target speaker is a speaker within a preset range of the location information of the listener in the vehicle.

[0085] The embodiment of the present application can determine the center point coordinates of at least one listener's position information within the vehicle; determine the lateral attenuation gradient data based on the vehicle width data and the number of lateral attenuation gradients; determine the longitudinal attenuation gradient data based on the vehicle length data and the number of longitudinal attenuation gradients; determine the sound attenuation direction for playing multimedia data based on the center point coordinates, the lateral attenuation gradient data, and the longitudinal attenuation gradient data; and finally, play the multimedia data based on the sound attenuation direction. In this way, the embodiment of the present application can determine the sound attenuation direction for playing multimedia data based on the position information of a specific person within the vehicle who is interested in the multimedia data. This can improve the accuracy of adjusting the sound effect, thereby improving the effect of multimedia data playback in the vehicle.

[0086] Figure 4 This is a flowchart of a method for playing multimedia data provided by an embodiment of the present application, based on Figure 1 , Figure 1 S102 in the above can be realized by S401 to S402, which will be combined with Figure 4 The steps shown are explained.

[0087] In S101 , when multimedia data is played in a vehicle, a list of listeners of the multimedia data is obtained.

[0088] In S401 , the portrait data of each listener is matched with the in-car image data to obtain image data corresponding to at least one listener in the car.

[0089] In an embodiment of the present application, an image acquisition device is deployed in the vehicle, which can capture in-vehicle image data inside the vehicle, and then send the captured in-vehicle image data to a device for playing multimedia data. The device for playing multimedia data can then match the portrait data of each listener with the received in-vehicle image data to obtain image data corresponding to at least one listener in the vehicle.

[0090] Here, the audience list of the multimedia data includes image data corresponding to at least one listener. The device playing the multimedia data may compare the in-vehicle image data with the image data of each listener, identify the listener appearing in the in-vehicle image data as the in-vehicle listener, and thereby obtain the image data corresponding to the at least one in-vehicle listener.

[0091] In S402 , for each in-vehicle listener, position information of the in-vehicle listener is determined based on the image data of the in-vehicle listener and the in-vehicle image data.

[0092] In the embodiment of the present application, the device for playing multimedia data can determine the seat information of the audience in the car as the position information of the audience in the car based on the image data of the audience in the car and the in-car image data.

[0093] In some embodiments, the device for playing multimedia data may establish a two-dimensional coordinate system on the in-car image data, and then determine the coordinate data of the in-car listeners in the in-car image data as the position information of the in-car listeners.

[0094] In S103 , multimedia data is played based on the position information of at least one listener in the vehicle.

[0095] This embodiment of the present application can determine the portrait data corresponding to at least one listener in the vehicle based on the in-vehicle image data and the image data of each listener; and determine the location information of each listener in the vehicle based on the portrait data and the in-vehicle image data. Thus, this embodiment of the present application determines the location information of the listener in the vehicle based on the listener's portrait data. If the listener in the vehicle changes position, the location information of the listener in the vehicle can also be re-determined based on the portrait data, thereby improving the accuracy of determining the location information of the listener in the vehicle.

[0096] Figure 5 This is a flow chart of a method for playing multimedia data according to an embodiment of the present application. Figure 1 Before S103 in the above method for playing multimedia data, the above method further includes S501, correspondingly, Figure 1 S103 in the above can be realized by S502. Figure 4 The steps shown are explained.

[0097] In S101 , when multimedia data is played in a vehicle, a listener list of the multimedia data is obtained.

[0098] In S102 , the image data of at least one listener is matched with the in-vehicle image data to obtain the position information of at least one listener in the vehicle.

[0099] In S501 , position information for representing an operator operating multimedia data is determined.

[0100] Here, the term "operator" refers to the user currently operating multimedia data. This operation can include adjusting the volume or playback quality of multimedia data, but does not include switching the currently playing multimedia data to another one. When a user in the vehicle operates multimedia data, it indicates that the user is interested in the multimedia data, so obtaining the user's location information is necessary.

[0101] Here, the position information may be the seat information of the operator in the vehicle, such as the main driver's seat, the co-driver's seat, and the back seat, etc. In some embodiments, the position information may also be the coordinate information of the operator in the vehicle.

[0102] In an embodiment of the present application, the device for playing multimedia data can obtain in-vehicle video data when receiving the user's operation on the multimedia data, and then determine the location information of the operator who is operating the multimedia data based on the in-vehicle video data.

[0103] In some embodiments, when receiving a user's operation on the multimedia data, the device for playing multimedia data may first determine the operation type corresponding to the operation instruction; and then determine the location information of the operator based on the operation type.

[0104] In some embodiments, the above S501 can be implemented by the following steps:

[0105] In S511 , in response to an operation instruction on multimedia data, an operation type corresponding to the operation instruction is determined.

[0106] In the embodiment of the present application, the device for playing multimedia data can determine the operation type corresponding to the operation instruction in response to the operation instruction for the multimedia data when the multimedia data is played in the vehicle.

[0107] Here, the operation instruction is used to represent an instruction for controlling the currently playing multimedia data. In the embodiment of the present application, the operation instruction can be an instruction for adjusting the volume, or an instruction for adjusting the effect of playing multimedia data, or any other instruction for controlling multimedia data. It should be noted that the operation instruction in the embodiment of the present application does not include an instruction for switching multimedia data, such as a control instruction for switching the currently playing multimedia data to another multimedia data. Because, if the operation instruction for the multimedia data is a switching instruction, it means that the operator is not interested in the multimedia data and is not a specific person related to the currently playing multimedia data, so there is no need to determine the location information of the operator.

[0108] Here, the operation type is used to characterize the control method for operating the currently playing multimedia data. In the embodiment of the present application, the operator can control the currently playing multimedia data through different operation types. Exemplarily, the operation type may include at least one of the following: voice operation, square control operation, touch operation, and gesture operation. In the embodiment of the present application, different operation types correspond to different methods for determining the operator's location information.

[0109] In S512 , based on the operation type, the location information of the operator is determined.

[0110] In the embodiment of the present application, after determining the operation type corresponding to the operation instruction, the device for playing multimedia data can determine the location information of the operator based on the operation type.

[0111] In the embodiment of the present application, S512 may be implemented by at least one of the following steps:

[0112] Step 1: When the operation type is voice operation, determine the regional location where the operation instruction is issued; and determine the location information of the operator based on the regional location.

[0113] Here, the voice operation may be a control method in which an operator controls the currently playing multimedia data by voice.

[0114] For example, the operator says "increase the volume" to the device that plays multimedia data. At this time, the device that plays multimedia data can determine that the operation type corresponding to the operation instruction for controlling the multimedia data is a voice operation, and then determine the regional location where the operation instruction is issued, and determine the operator's location information based on the regional location.

[0115] In some embodiments, the device for playing multimedia data includes a microphone array, and the location of the area where the operation instruction is issued is determined by at least two microphones in the microphone array, and then the location information of the operator is determined based on the area location.

[0116] In some embodiments, the interior of the vehicle is pre-divided into multiple sound zones. For example, the interior of the vehicle can be divided into two sound zones, with the driver's seat and front passenger seat combined as one sound zone, and the rear seats combined as one sound zone. Alternatively, the interior of the vehicle can be divided into five sound zones, with the driver's seat as one sound zone, the front passenger seat as one sound zone, and the rear seats as three sound zones. When an operator issues a voice command, the microphone array in the device playing multimedia data can determine the direction of the voice command, then determine the regional location of the corresponding sound zone based on the direction of the voice command, and finally determine the operator's location information based on the regional location.

[0117] Step 2: When the operation type is a key operation, obtain the position information of the control key that generates the operation instruction; and determine the position information of the operator based on the position information of the control key.

[0118] Here, the key operation may be a control method in which an operator controls the multimedia data currently being played by controlling a key.

[0119] In an embodiment of the present application, the vehicle is provided with control buttons in various locations, such as a square control button on the steering wheel, and control buttons on the passenger and rear seats. Therefore, when the operation type is a key operation, the operation instruction carries the corresponding control button location information. For example, when an operator controls multimedia data using a square control button in the driver's seat, the operation instruction can carry the square control button location information. Therefore, when the operation type is a key operation, the device for playing multimedia data can obtain the location information of the square control button that generated the operation instruction from the operation instruction, and then determine the operator's location information based on the control button location information.

[0120] Step 3: When the operation type is a touch operation, obtain in-vehicle video data; and determine the operator's position information based on the in-vehicle video data.

[0121] Here, the touch operation may be a control method in which an operator controls the multimedia data currently being played by touching the control screen.

[0122] In an embodiment of the present application, when the operation type is a touch operation, the device for playing multimedia data can obtain in-vehicle video data, and then determine the position information of the operator who is touching the control screen in the vehicle from the in-vehicle video data.

[0123] In some embodiments, after the device for playing multimedia data determines the location information of the operator, it can obtain and store a portrait image of the operator. In this way, if the operator changes location, the device for playing multimedia data can re-determine the location information of the operator based on the portrait image of the operator.

[0124] In S502 , multimedia data is played based on the position information of at least one listener in the vehicle and the position information of the operator.

[0125] In an embodiment of the present application, after determining the position information of the listeners in the vehicle and the position information of the operator, the device for playing multimedia data can play the multimedia data based on the position information of the listeners in the vehicle and the position information of the operator.

[0126] In some embodiments, the device for playing multimedia data can determine a target sound whose distance from the position information of the listener in the car and the position information of the operator is within a preset distance range based on the position information of the listener in the car and the position information of the operator, and then play the multimedia data based on the target sound.

[0127] In some embodiments, the device for playing multimedia data can also determine a sound attenuation direction based on the location information of the listener in the vehicle and the location information of the operator. Based on the sound attenuation direction, the device can then adjust the playback quality of the audio system, and finally play the multimedia data based on the adjusted audio system. The audio system referred to herein can be all audio systems in the vehicle or the target audio system. The method for determining the sound attenuation direction can be found in the description of the above embodiment.

[0128] In some embodiments, when the vehicle plays at least part of the multimedia data, the device playing the multimedia data can add the image data of the operator to the audience list. In this way, the audience list can be updated in a timely manner, and all users who are interested in the currently played multimedia data can be added to the audience list.

[0129] In the case of multimedia data being played in a vehicle, the embodiment of the present application can determine the operation type corresponding to the operation instruction in response to the operation instruction for the multimedia data; in the case where the operation type is a voice operation, determine the regional location of the operation instruction; determine the location information of the operator based on the regional location; in the case where the operation type is a key operation, obtain the location information of the control key that generates the operation instruction; determine the location information of the operator based on the location information of the control key; in the case where the operation type is a touch operation, obtain in-vehicle video data; and determine the location information of the operator based on the in-vehicle video data. In this way, the embodiment of the present application can determine the location information of the operator in different ways based on the operation type of different operation instructions, thereby improving the speed of determining the location information of the operator. Moreover, the operator is the user currently operating the multimedia data being played, and is a specific person who is interested in the multimedia data being played. Therefore, the embodiment of the present application plays the multimedia data based on the location information of the specific person who is interested in the multimedia data being played, which can improve the effect of playing multimedia data in the vehicle. Figure 6 This is a flow chart of a method for playing multimedia data according to an embodiment of the present application. Figure 6 As shown, the process may include:

[0130] In S601 , a song operator is identified based on the user's operation on the song.

[0131] Here, the song operator is the first listener and the operator of the currently playing song. If the first song is operated by A, then the operators of subsequent songs will be A if there is no other interrupting operation.

[0132] In the embodiment of the present application, the user's location is determined based on the user's operation to identify the current song operator, and the song operator's location in the vehicle is obtained and identified. The specific judgment logic is as follows: Voice operation can determine the operator's location and collect operator characteristic information based on the sound area; Square control operation can determine the operator's location and collect operator characteristic information based on the square control position; Screen operation can identify the operator's location and collect operator characteristic information through the camera. The purpose of collecting operator characteristic information is to continue to identify the operator even if the operator's position in the vehicle changes.

[0133] In S602, the song operators who have listened to at least part of the song are saved in a song listener list.

[0134] In the embodiment of the present application, the operator who has completely listened to the climax of the song can be saved in the listener list of the song.

[0135] In S603, the song is played based on the position of the song operator and the characteristic information of the song listener.

[0136] In this embodiment of the present application, when a song is playing, the user in the car and their location are identified based on the current song operator and the listener's profile information stored in the listener list. Based on the identified location information, the sound field parameters of the audio system are adjusted to control the direction of the sound, thereby achieving a better musical experience for the listener.

[0137] Among them, the parameters of the sound field are adjusted according to the identified position information, and the sound direction of the sound is controlled, including: Step 1: The position of each listener is a point, and multiple listeners form a polygon, and the center point of the polygon is obtained (a, b). This center point is the sound direction of the sound; Step 2: The in-car audio system itself supports setting the sound attenuation direction. It supports N gradients in the horizontal direction of the vehicle body and N gradients in the longitudinal direction of the vehicle body. The specific position of the sound attenuation is set in the form of (x, y). The calculated position of the center point of the listener (a, b) is the corresponding x, y value of a / (width / N), b / (length / N). Among them, width is the width of the cabin, and length is the length of the cabin.

[0138] In some embodiments, the speakers located near the song operator and the listener can be controlled to play the song based on the position determination of the characteristic information of the song operator and the listener; the speakers located near the song operator and the listener can also be controlled to play the song according to the sound attenuation direction determined by the above embodiment.

[0139] The embodiment of the present application can identify the song operator based on the user's operation on the song; save the song operator who has listened to at least part of the song to the song's listener list; and finally play the song based on the position of the song operator and the listener's characteristic information. In this way, the song playback effect can be improved.

[0140] The present invention provides a device for playing multimedia data. Figure 7 A schematic diagram of the structure of a device 700 for playing multimedia data provided in an embodiment of the present application is shown in FIG. Figure 7 As shown, the apparatus includes: an acquisition unit 701, a matching unit 702, and a playback unit 703, wherein:

[0141] An acquiring unit 701 is configured to acquire a list of listeners of the multimedia data; the list of listeners comprising at least one image data representing listeners who have listened to at least part of the multimedia data;

[0142] a matching unit 702, configured to match the image data of at least one listener with the in-vehicle image data to obtain location information of at least one listener in the vehicle;

[0143] The playing unit 703 is configured to play the multimedia data based on the position information of at least one of the listeners in the vehicle and the position information of the operator.

[0144] In some embodiments, the acquisition unit 701 is further configured to determine, in response to an operation instruction on the multimedia data, an operation type corresponding to the operation instruction; and determine location information of the operator based on the operation type.

[0145] In some embodiments, the acquisition unit 701 is also used to determine the regional location of the operation instruction when the operation type is a voice operation; determine the location information of the operator based on the regional location; obtain the location information of the control key that generates the operation instruction when the operation type is a key operation; determine the location information of the operator based on the location information of the control key; obtain in-vehicle video data when the operation type is a touch operation; and determine the location information of the operator based on the in-vehicle video data.

[0146] In some embodiments, the vehicle includes at least two speakers; the playback unit 703 is further configured to determine a target speaker among the at least two speakers based on location information of at least one listener in the vehicle; and control the target speaker to play the multimedia data.

[0147] In some embodiments, the playback unit 703 is further used to determine the center point coordinates of the position information of at least one listener in the vehicle; based on the center point coordinates and the in-vehicle space data, determine the sound attenuation direction of playing the multimedia data; and based on the sound attenuation direction, play the multimedia data.

[0148] In some embodiments, the in-vehicle space data includes vehicle width data and vehicle length data; the playback unit 703 is also used to obtain the lateral attenuation gradient number and the longitudinal attenuation gradient number of the vehicle; based on the vehicle width data and the lateral attenuation gradient number, determine the lateral data of the attenuation gradient; based on the vehicle length data and the longitudinal attenuation gradient number, determine the longitudinal data of the attenuation gradient; based on the center point coordinates, the lateral data of the attenuation gradient and the longitudinal data of the attenuation gradient, determine the sound attenuation direction of playing the multimedia data.

[0149] In some embodiments, the matching unit 702 is further used to match the image data of each of the listeners with the in-car image data to obtain image data corresponding to at least one of the listeners in the car; for each of the listeners in the car, the location information of the listener in the car is determined based on the portrait data of the listener in the car and the in-car image data.

[0150] In some embodiments, the device further includes a determination unit, which is used to determine location information of an operator used to characterize the operation of the multimedia data; the playback unit is also used to play the multimedia data based on the location information of at least one listener in the vehicle and the location information of the operator.

[0151] In some embodiments, the determining unit is further configured to determine, in response to an operation instruction on the multimedia data, an operation type corresponding to the operation instruction; and determine location information of the operator based on the operation type.

[0152] In some embodiments, the determination unit is also used for at least one of the following: when the operation type is a voice operation, determining the area location where the operation instruction is issued; determining the location information of the operator based on the area location; when the operation type is a key operation, obtaining the location information of the control key that generates the operation instruction; determining the location information of the operator based on the location information of the control key; when the operation type is a touch operation, obtaining in-vehicle video data; and determining the location information of the operator based on the in-vehicle video data.

[0153] The description of the above device embodiment is similar to the description of the above method embodiment and has similar beneficial effects as the method embodiment. In some embodiments, the functions or modules included in the device provided in the embodiments of the present application can be used to perform the methods described in the above method embodiments. For technical details not disclosed in the device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

[0154] It should be noted that, in the embodiment of the present application, if the above-mentioned method for playing multimedia data is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific hardware, software or firmware, or any combination of hardware, software and firmware.

[0155] An embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, some or all of the steps in the above method are implemented.

[0156] The present invention provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements some or all of the steps in the above method. The computer-readable storage medium may be transient or non-transient.

[0157] An embodiment of the present application provides a computer program, including computer-readable code. When the computer-readable code is run in a computer device, a processor in the computer device executes some or all of the steps for implementing the above method.

[0158] An embodiment of the present application provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and when the computer program is read and executed by a computer, implements some or all of the steps in the above method. The computer program product can be implemented specifically by hardware, software, or a combination thereof. In some embodiments, the computer program product is embodied as a computer storage medium. In other embodiments, the computer program product is embodied as a software product, such as a software development kit (SDK), etc.

[0159] It should be noted that the descriptions of the various embodiments above tend to emphasize the differences between the various embodiments, and their similarities or similarities can be referenced to each other. The descriptions of the above device, storage medium, computer program, and computer program product embodiments are similar to the descriptions of the above method embodiments and have similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the device, storage medium, computer program, and computer program product of this application, please refer to the description of the method embodiments of this application for understanding.

[0160] The present invention provides a device for playing multimedia data. Figure 8 A schematic diagram of the structure of a device 800 for playing multimedia data provided in an embodiment of the present application is shown in FIG. Figure 8 As shown, the device includes: a processor 801, a communication interface 802 and a memory 803, wherein:

[0161] The processor 801 generally controls the overall operation of the computer device 800. The overall operation may be to implement the method for playing multimedia data provided in the embodiment of the present application, for example, Figures 1 to 6 The method shown.

[0162] The communication interface 802 enables the computer device to communicate with other terminals or servers through a network.

[0163] The memory 803 is configured to store instructions and applications executable by the processor 801. It can also cache data to be processed or processed by the processor 801 and various modules in the computer device 800 (for example, image data, audio data, voice communication data, and video communication data). This can be implemented using flash memory (FLASH) or random access memory (RAM). Data can be transmitted between the processor 801, the communication interface 802, and the memory 803 via a bus 804.

[0164] The present invention provides a computer program product or computer program, which includes computer instructions stored in a readable storage medium. A processor of a computer device reads the computer instructions from the readable storage medium and executes the computer instructions, causing the computer device to perform the method for playing multimedia data described in the present invention.

[0165] The embodiment of the present application provides a readable storage medium storing executable instructions, wherein the executable instructions are stored. When the executable instructions are executed by a processor, the processor will execute the method based on playing multimedia data provided by the embodiment of the present application, for example, Figures 1 to 6 The method shown.

[0166] It should be noted that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0167] The processor may be at least one of an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a central processing unit (CPU), a controller, a microcontroller, and a microprocessor. It is understood that the electronic device that implements the functions of the processor may also be other electronic devices, which are not specifically limited in the embodiments of the present application.

[0168] The above-mentioned computer storage medium / memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory (Flash Memory), a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); it can also be various terminals including one or any combination of the above-mentioned memories, such as mobile phones, computers, tablet devices, personal digital assistants, etc.

[0169] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned steps / processes does not mean the order of execution, and the execution order of each step / process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0170] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0171] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0172] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed across multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0173] In addition, all functional units in the embodiments of the present application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the above-mentioned integrated units can be implemented in the form of hardware or in the form of hardware plus software functional units.

[0174] Those skilled in the art will understand that all or part of the steps of implementing the above-mentioned method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, and other media that can store program codes.

[0175] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the relevant technology, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks, or optical disks.

[0176] The above is only an implementation method of the present application, but the scope of protection of the present application is not limited thereto. Any technician familiar with this technical field can easily think of changes or replacements within the technical scope disclosed in this application, which should be covered by the scope of protection of the present application.

Claims

1. A method for playing multimedia data, characterized in that: include: In the case where multimedia data is played in a vehicle, obtaining a list of listeners of the multimedia data; The audience list includes at least one image data for representing an audience who has listened to at least a portion of the multimedia data; Matching the image data of at least one of the listeners with the in-vehicle image data to obtain position information of at least one listener in the vehicle; Playing the multimedia data based on the position information of at least one listener in the vehicle; The step of playing the multimedia data based on the position information of at least one listener in the vehicle includes: Determine the center point coordinates of the position information of at least one listener in the vehicle; Obtaining a lateral attenuation gradient quantity and a longitudinal attenuation gradient quantity of the vehicle; Determining lateral data of the attenuation gradient based on the vehicle width data of the vehicle and the amount of the lateral attenuation gradient; Determining longitudinal data of the attenuation gradient based on the vehicle length data of the vehicle and the longitudinal attenuation gradient quantity; determining a sound attenuation direction for playing the multimedia data based on the center point coordinates, the horizontal data of the attenuation gradient, and the vertical data of the attenuation gradient; The multimedia data is played based on the sound attenuation direction.

2. The method according to claim 1, characterized in that The vehicle includes at least two speakers; and playing the multimedia data based on the position information of at least one listener in the vehicle includes: determining a target speaker from among at least two of the speakers based on position information of at least one of the listeners in the vehicle; Control the target speaker to play the multimedia data.

3. The method according to claim 1 or 2, characterized in that The matching of the image data of at least one listener with the in-vehicle image data to obtain the position information of at least one listener in the vehicle includes: Matching the image data of each listener with the in-car image data to obtain image data corresponding to at least one listener in the car; For each of the in-vehicle listeners, position information of the in-vehicle listener is determined based on the image data of the in-vehicle listener and the in-vehicle image data.

4. The method according to claim 1 or 2, characterized in that The method further comprises: determining location information for characterizing an operator operating the multimedia data; The playing of the multimedia data based on the position information of at least one listener in the vehicle includes: The multimedia data is played based on the position information of at least one of the listeners in the vehicle and the position information of the operator.

5. The method according to claim 4, characterized in that The determining of the location information used to characterize the operator operating the multimedia data includes: In response to an operation instruction on the multimedia data, determining an operation type corresponding to the operation instruction; Based on the operation type, the location information of the operator is determined.

6. The method according to claim 5, characterized in that The determining of the location information of the operator based on the operation type includes at least one of the following: In the case where the operation type is a voice operation, determining the area where the operation instruction is issued; and determining the location information of the operator based on the area location; In the case where the operation type is a key operation, obtaining position information of the control key that generates the operation instruction; determining the position information of the operator based on the position information of the control button; When the operation type is a touch operation, obtaining in-vehicle video data; The position information of the operator is determined based on the in-vehicle video data.

7. A device for playing multimedia data, characterized in that: include: an acquiring unit, configured to acquire a listener list of the multimedia data when the multimedia data is played in the vehicle; The audience list includes at least one image data for representing an audience who has listened to at least a portion of the multimedia data; a matching unit, configured to match the image data of at least one of the listeners with the in-vehicle image data to obtain position information of at least one listener in the vehicle; A playback unit, configured to determine the center coordinates of the position information of at least one listener in the vehicle; and obtain the number of lateral attenuation gradients and the number of longitudinal attenuation gradients of the vehicle; Determining lateral data of the attenuation gradient based on the vehicle width data of the vehicle and the amount of the lateral attenuation gradient; Determining longitudinal data of the attenuation gradient based on the vehicle length data of the vehicle and the longitudinal attenuation gradient quantity; Based on the coordinates of the center point, the horizontal data of the attenuation gradient, and the vertical data of the attenuation gradient, a sound attenuation direction for playing the multimedia data is determined; and based on the sound attenuation direction, the multimedia data is played.

8. A device for playing multimedia data, characterized in that: include: a memory for storing executable instructions; A processor, configured to implement the method according to any one of claims 1 to 6 when executing the executable instructions stored in the memory.

9. A storage medium, characterized in that: The storage medium stores executable instructions, which, when executed by a processor, implement the method steps described in any one of claims 1 to 6.

Images