Multimedia content marking system, method, device, storage medium and program product

Abstract

The invention discloses a multimedia content marking system, method and device, a storage medium and a program product, and relates to the technical field of vehicle control. The system comprises a vehicle-mounted terminal and a mobile terminal which is connected with the vehicle-mounted terminal, the mobile terminal is used for running a first application program; the multimedia content in the first application program is sent to the vehicle-mounted terminal through the connection relation; the vehicle-mounted terminal is used for playing multimedia content; in response to a received trigger operation for a first physical control in the vehicle, key information is sent to the mobile terminal through the connection relation, and the key information is used for recording the trigger operation for the first physical control; the mobile terminal is also used for receiving the key information; under the condition that the key information meets the marking requirement, the multimedia content in the first application program is marked, the efficiency of marking the multimedia content in the vehicle by a user can be improved, and the vehicle driving safety is guaranteed.

Description

Technical Field

[0001] The present application relates to the field of vehicle control technology, and in particular to a multimedia content marking system, method, device, storage medium and program product. Background Art

[0002] In modern automotive technology, playing music on the in-car system has become an important function to enhance the driving experience. While driving, users can select and play songs through the music application on the smart mobile terminal, and then transmit the audio signal to the in-car system through Bluetooth technology, so that they can enjoy the music on the in-car speakers.

[0003] In the related art, the music collection method mainly relies on the operation of the smart mobile terminal. When users hear their favorite songs in the car system, they need to find and click the collection button on the music application interface on the smart mobile terminal to save these songs.

[0004] However, the above method requires the user to distract himself from operating the mobile terminal while driving, which not only affects the concentration of driving, but also may miss the best time to collect favorite songs due to inconvenient operation, and the human-computer interaction efficiency is low. Summary of the invention

[0005] The embodiments of the present application provide a multimedia content tagging system, method, device, storage medium and program product, which can improve the efficiency of multimedia content tagging. The technical solution is as follows.

[0006] In one aspect, a multimedia content marking system is provided, the system comprising a vehicle-mounted terminal, and a mobile terminal connected to the vehicle-mounted terminal;

[0007] The mobile terminal is used to run a first application; and send multimedia content in the first application to the vehicle-mounted terminal through the connection relationship;

[0008] The vehicle-mounted terminal is used to play the multimedia content; in response to receiving a trigger operation for a first physical control in the vehicle, sending key information to the mobile terminal through the connection relationship, wherein the key information is used to record the trigger operation for the first physical control;

[0009] The mobile terminal is further configured to receive the key information; and to mark the multimedia content in the first application program when the key information meets a marking requirement.

[0010] In some embodiments, the system further comprises a server;

[0011] The mobile terminal is further configured to send a marking request to the server if the key information meets the marking requirement, the marking request being used to request marking the multimedia content, the marking request including a content identifier, an account identifier, and a marking instruction, the content identifier being used to indicate the multimedia content, and the account identifier being used to indicate a master control account corresponding to the mobile terminal logging into the first application;

[0012] The server is configured to receive the marking request; record a marking relationship between the content identifier and the account identifier based on the marking request, wherein the marking relationship is used to indicate that the multimedia content is marked by the master control account; and feed back a marking result to the mobile terminal;

[0013] The mobile terminal is further configured to receive the marking result; and display that the multimedia content is marked based on the marking result.

[0014] In some embodiments, the marking requirements include at least one of the following:

[0015] The key information includes trigger operations received for at least one first physical key in a preset time interval and in a preset order;

[0016] The duration of the trigger operation in the key information reaches a preset duration threshold;

[0017] The operation frequency of the triggering operation in the key information reaches a preset frequency threshold.

[0018] In some embodiments, the mobile terminal is further used to record in the memory the i-th key information received at the first moment; when the i+1-th key information is received at the second moment, the i-th key information is read from the memory if the time interval between the first moment and the second moment does not exceed the preset time interval; if the triggering operations in the i-th key information and the i+1-th key information conform to the preset order, the i+1-th key information is recorded, until multiple key information recorded in the memory conform to the marking requirements, the multimedia content is marked, and i is a positive integer.

[0019] In some embodiments, the mobile terminal is further configured to mark the multimedia content currently played by the first application in response to the plurality of key information meeting the marking requirement; or

[0020] In the process of recording the plurality of key information, when the multimedia content played by the first application is switched from the first multimedia content to the second multimedia content, in response to the plurality of key information meeting the marking requirement, marking the first multimedia content played by the first application at a third moment, where the third moment is a triggering moment corresponding to the first key information among the plurality of key information; or

[0021] In a case where the multimedia content played by the first application is switched from the first multimedia content to the second multimedia content before recording the multiple key information, in response to the multiple key information meeting the marking requirement, marking the first multimedia content played by the first application within a preset time range before the third moment.

[0022] In some embodiments, the vehicle includes a plurality of first physical controls, each of which corresponds to a button identifier;

[0023] The vehicle-mounted terminal is further used to collect fingerprint data corresponding to the trigger operation through the fingerprint collection device corresponding to the first physical control based on the trigger operation; and to send the key information and the fingerprint data to the mobile terminal in association through the connection relationship, wherein the key information includes the key identifier corresponding to the first physical control;

[0024] The mobile terminal is further used to obtain the master fingerprint data corresponding to the master account; and record the key information when the fingerprint data corresponding to the key information matches the master fingerprint data.

[0025] In some embodiments, a vehicle seat in the vehicle corresponds to a vibration sensor;

[0026] The vehicle-mounted terminal is also used to collect the rhythmic data of the vehicle occupant on the vehicle seat through the vibration sensor; in response to the rhythmic beat corresponding to the rhythmic beat of the rhythmic data being consistent with the playback beat of the multimedia content, the trigger operation for the first physical control is automatically executed, and the key information that meets the marking requirements is sent to the mobile terminal.

[0027] In some embodiments, the mobile terminal is further used to send a paging signal, where the paging signal is used to search for a device within a preset range that can establish the connection relationship;

[0028] The vehicle-mounted terminal is further configured to establish a link connection with the mobile terminal in response to the paging signal;

[0029] The mobile terminal is further configured to send a connection request to the vehicle-mounted terminal based on the link connection, wherein the connection request is used to request to establish the connection relationship;

[0030] The vehicle-mounted terminal is further configured to automatically respond to the connection request and establish the connection relationship with the mobile terminal.

[0031] On the other hand, a multimedia content marking method is provided, the method being executed by a vehicle-mounted terminal, the method comprising:

[0032] Based on the connection relationship with the mobile terminal, receiving multimedia content in a first application sent by the mobile terminal;

[0033] Playing the multimedia content;

[0034] In response to receiving a trigger operation for a first physical control in the vehicle, sending key information to the mobile terminal through the connection relationship, wherein the key information is used to record the trigger operation for the first physical control;

[0035] The key information is used to instruct the mobile terminal to mark the multimedia content played by the first application program if the marking requirement is met.

[0036] In another aspect, a multimedia content marking method is provided, the method being executed by a mobile terminal, the method comprising:

[0037] Sending multimedia content in the first application to the vehicle-mounted terminal through a connection relationship with the vehicle-mounted terminal;

[0038] receiving key information sent by the vehicle-mounted terminal through the connection relationship based on the multimedia content;

[0039] If the key information meets the marking requirement, marking the multimedia content in the first application;

[0040] The button information is sent by the vehicle-mounted terminal to the mobile terminal in response to receiving a trigger operation for the first physical control during the process of playing the multimedia content, and the button information is used to record the trigger operation for the first physical control.

[0041] In another aspect, a multimedia content marking device is provided, the device comprising:

[0042] A receiving module, configured to receive multimedia content in a first application sent by the mobile terminal based on a connection relationship with the mobile terminal;

[0043] A playing module, used for playing the multimedia content;

[0044] a sending module, configured to, in response to receiving a trigger operation on a first physical control in the vehicle, send key information to the mobile terminal through the connection relationship, wherein the key information is used to record the trigger operation on the first physical control;

[0045] The key information is used to instruct the mobile terminal to mark the multimedia content played by the first application program if the marking requirement is met.

[0046] In another aspect, a multimedia content marking device is provided, the device comprising:

[0047] A sending module, used for sending multimedia content in the first application to the vehicle-mounted terminal through a connection relationship with the vehicle-mounted terminal;

[0048] A receiving module, used for receiving key information sent by the vehicle terminal through the connection relationship based on the multimedia content;

[0049] a marking module, configured to mark the multimedia content in the first application program if the key information meets a marking requirement;

[0050] The button information is sent by the vehicle-mounted terminal to the mobile terminal in response to receiving a trigger operation for the first physical control during the process of playing the multimedia content, and the button information is used to record the trigger operation for the first physical control.

[0051] On the other hand, a computer device is provided, comprising a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set, or an instruction set, and the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the multimedia content marking method as described in any of the above-mentioned embodiments of the present application.

[0052] On the other hand, a computer-readable storage medium is provided, wherein at least one instruction, at least one program, a code set or an instruction set is stored in the storage medium, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement the multimedia content marking method as described in any of the above-mentioned embodiments of the present application.

[0053] On the other hand, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes any of the multimedia content marking methods described in the above embodiments.

[0054] The beneficial effects brought by the technical solution provided by the embodiment of the present application include at least:

[0055] The vehicle terminal receives trigger operations for physical controls in the vehicle and sends key information to the mobile terminal. The mobile terminal identifies the user's marking operation on the multimedia content through the vehicle terminal based on the key information. When the key information meets the marking requirements, the mobile terminal marks the multimedia content in the application. Therefore, when the vehicle terminal plays the multimedia content in the application sent by the mobile terminal, the marking operation of the multimedia content can be achieved based on the operation on the vehicle terminal. There is no need to distract the driver while operating the mobile terminal during driving, which can improve the efficiency of marking multimedia content, improve the efficiency of human-computer interaction, and ensure driving safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0057] Figure 1 is a schematic diagram of a computer system provided by an exemplary embodiment of the present application;

[0058] Figure 2 is an interactive flow chart of a multimedia content tagging system provided by an exemplary embodiment of the present application;

[0059] Figure 3 is a schematic diagram of multimedia content marking provided by an exemplary embodiment of the present application;

[0060] Figure 4 is a flowchart of a multimedia content marking method provided by an exemplary embodiment of the present application;

[0061] Figure 5 is a flowchart of a multimedia content marking method provided by an exemplary embodiment of the present application;

[0062] Figure 6 is a structural block diagram of a multimedia content marking device provided by an exemplary embodiment of the present application;

[0063] Figure 7 is a structural block diagram of a multimedia content marking device provided by an exemplary embodiment of the present application;

[0064] Figure 8 It is a structural block diagram of a terminal provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0065] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0066] It should be understood that although the terms first, second, etc. may be used in the present disclosure to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present disclosure, the first parameter may also be referred to as the second parameter, and similarly, the second parameter may also be referred to as the first parameter. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0067] In modern automotive technology, playing music on the in-vehicle system has become an important function to enhance the driving experience. While driving, users can select and play songs through the music application on the smart mobile terminal, and then transmit the audio signal to the in-vehicle system through Bluetooth technology to enjoy the music on the in-vehicle speakers. In the related art, the music collection method mainly relies on the operation of the smart mobile terminal. When users hear their favorite songs in the in-vehicle system, they need to find and click the favorite button on the music application interface on the smart mobile terminal to save these songs. However, the above method requires the user to distract himself from operating the mobile terminal while driving, which not only affects the concentration of driving, but also may miss the best time to collect favorite songs due to inconvenient operation, and the human-computer interaction efficiency is low.

[0068] The multimedia content marking system provided in the embodiment of the present application receives trigger operations for physical controls in the vehicle through the vehicle terminal, and sends key information to the mobile terminal. The mobile terminal identifies the user's marking operation on the multimedia content through the vehicle terminal based on the key information, and marks the multimedia content in the application by the mobile terminal when the key information meets the marking requirements. Therefore, when the vehicle terminal plays the multimedia content in the application sent by the mobile terminal, the marking operation of the multimedia content can be implemented based on the operation on the vehicle terminal, and there is no need to distract the driver from operating the mobile terminal during driving. The efficiency of marking multimedia content can be improved, the efficiency of human-computer interaction can be improved, and driving safety can be ensured.

[0069] First, the computer system of this application is introduced. Please refer to Figure 1 , which shows a schematic diagram of a computer system provided by an exemplary embodiment of the present application, wherein the computer system includes: a vehicle-mounted terminal 10 and a mobile terminal 20.

[0070] There is a connection relationship between the vehicle-mounted terminal 10 and the mobile terminal 20 .

[0071] The vehicle-mounted terminal 10 is a terminal device configured in the vehicle. The vehicle-mounted terminal 10 is used to provide users with preset functions such as terminal display and playback in the vehicle. The mobile terminal 20 can be used to control the vehicle-mounted terminal 10 through a connection relationship. The mobile terminal 20 can be located inside or outside the vehicle, and this embodiment of the present application does not limit this.

[0072] A first application is installed in the mobile terminal 20. The first application may be any application including multimedia content, such as music playing software, video playing platform, novel reading software, social application, game application, etc., which is not limited in the embodiment of the present application.

[0073] Multimedia content includes but is not limited to audio content, image content, text content, video content, and any other media form of content.

[0074] When the first application is not installed in the vehicle terminal 10 , the mobile terminal 20 can control the vehicle terminal 10 to play the multimedia content in the first application through the connection relationship.

[0075] Illustratively, the mobile terminal 20 runs a first application and sends multimedia content in the first application to the vehicle terminal through a connection relationship; the vehicle terminal 10 receives and plays the multimedia content, and in response to receiving a trigger operation for a first physical control in the vehicle, sends key information to the mobile terminal through a connection relationship, and the key information is used to record the trigger operation for the first physical control; the mobile terminal 20 receives the key information, and marks the multimedia content in the first application if the key information meets the marking requirements.

[0076] The first physical control may be any physical control in the vehicle, for example, a volume control button or a play control button for a vehicle-mounted terminal, and this embodiment of the present application does not limit this.

[0077] Optionally, the first physical control may be located anywhere in the vehicle, such as on a vehicle steering wheel, a door handle, or a vehicle seat, and this is not limited in the embodiments of the present application.

[0078] Indicatively, Figure 1 As shown, there is a first physical control corresponding to the steering wheel of the vehicle, and the driver can mark the multimedia content in the first application by performing a trigger operation that meets the marking requirements on the first physical control on the steering wheel.

[0079] In some embodiments, the first physical control may be preset by the multimedia content marking system, or may be pre-configured by the user, and the user pre-configuration is taken as an example for description.

[0080] The vehicle-mounted terminal 10 is used to receive multimedia content in a first application sent by the mobile terminal based on the connection relationship between the vehicle-mounted terminal 10 and the mobile terminal 20; play the multimedia content; in response to receiving a trigger operation for a first physical control in the vehicle, send key information to the mobile terminal 20 through the connection relationship, and the key information is used to record the trigger operation for the first physical control; wherein the key information is used to instruct the mobile terminal 20 to mark the multimedia content in the first application if the marking requirements are met.

[0081] The mobile terminal 20 is used to send multimedia content in a first application to the vehicle terminal 10 through a connection relationship between the vehicle terminal 10 and the vehicle terminal 10; receive key information sent by the vehicle terminal 10 based on the multimedia content through the connection relationship; and mark the multimedia content in the first application when the key information meets the marking requirements; wherein the key information is sent by the vehicle terminal to the mobile terminal 20 in response to receiving a trigger operation for the first physical control during the process of playing the multimedia content, and the key information is used to record the trigger operation for the first physical control.

[0082] The above-mentioned terminal is optional. The terminal can be a desktop computer, a laptop computer, a mobile phone, a tablet computer, an e-book reader, a Moving Picture Experts Group Audio Layer III (MP3) player, a Moving Picture Experts Group Audio Layer IV (MP4) player, a smart TV, a smart car, and other forms of terminal devices, which are not limited to the embodiments of the present application.

[0083] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant regions. For example, the operation data and account information involved in this application are all obtained with full authorization.

[0084] To further explain, before collecting relevant data of users (for example, account information, historical operation data, and real-time operation data involved in this application) and during the process of collecting relevant data of users, this application can display a prompt interface, pop-up window, or output voice prompt information. The prompt interface, pop-up window, or voice prompt information is used to prompt the user that its relevant data is currently being collected, so that this application only starts to execute the relevant steps of obtaining relevant data of users after obtaining the confirmation operation issued by the user to the prompt interface or pop-up window, otherwise (that is, when the confirmation operation issued by the user to the prompt interface or pop-up window is not obtained), the relevant steps of obtaining relevant data of users are terminated, that is, the relevant data of users are not obtained. In other words, all user data collected by this application are collected with the consent and authorization of the user, and the collection, use, and processing of relevant user data need to comply with the relevant laws, regulations, and standards of the relevant regions.

[0085] For illustration, please refer to Figure 2 , Figure 2 is an interactive flow chart of a multimedia content marking system provided by an exemplary embodiment of the present application. Figure 2 As shown, the system includes a vehicle-mounted terminal and a mobile terminal connected to the vehicle-mounted terminal. The interaction process of the system includes the following steps:

[0086] Step 211: The mobile terminal runs a first application; and sends multimedia content in the first application to the vehicle-mounted terminal through a connection relationship.

[0087] The first application is an application installed in the mobile terminal.

[0088] Optionally, the first application may be any application including multimedia content, such as music playing software, video playing platform, novel reading software, social application, game application, etc., which is not limited in this embodiment of the present application.

[0089] Multimedia content includes but is not limited to audio content, image content, text content, video content, and any other media form of content.

[0090] The mobile terminal can send the multimedia content in the first application to the vehicle-mounted terminal through the connection relationship, and control the vehicle-mounted terminal to play the multimedia content.

[0091] Optionally, the above connection relationship may include a wired connection relationship or a wireless connection relationship. The embodiment of the present application is described by taking a wireless connection relationship as an example.

[0092] The mobile terminal and the vehicle-mounted terminal can establish a connection relationship through wireless networks such as wireless fidelity networks and Bluetooth.

[0093] In some embodiments, before step 211, the mobile terminal and the vehicle-mounted terminal need to establish the above-mentioned connection relationship. Taking Bluetooth connection as an example, the connection relationship establishment process of the multimedia content marking system provided in the embodiment of the present application is explained.

[0094] The mobile terminal sends a paging signal, which is used to search for devices within a preset range that can establish a connection relationship; the vehicle-mounted terminal responds to the paging signal and establishes a link connection with the mobile terminal; the mobile terminal sends a connection request to the vehicle-mounted terminal based on the link connection, and the connection request is used to request to establish a connection relationship; the vehicle-mounted terminal automatically responds to the connection request and establishes a connection relationship with the mobile terminal.

[0095] Illustratively, the mobile terminal sends a paging signal to display at least one candidate device with a link established in response to the paging signal, and the at least one candidate device includes a vehicle-mounted terminal. The mobile terminal sends a connection request to the vehicle-mounted terminal in response to receiving a connection operation for the vehicle-mounted terminal. After the vehicle-mounted terminal automatically responds to the connection request to establish a connection relationship, the mobile terminal displays that the connection relationship between the mobile terminal and the vehicle-mounted terminal is successfully established.

[0096] It is worth noting that the above connection relationship and construction process are only illustrative examples and are not limited to the embodiments of the present application.

[0097] Step 221, the vehicle-mounted terminal plays multimedia content; in response to receiving a trigger operation for a first physical control in the vehicle, sending key information to the mobile terminal through a connection relationship.

[0098] The button information is used to record the trigger operation on the first physical control.

[0099] The first physical control is used to trigger the execution of a vehicle control function preset for the vehicle. Optionally, the first physical control can be any physical control in the vehicle, for example, a volume control button, a play control button, a speed control button, etc. for the vehicle terminal. The embodiment of the present application is not limited to this.

[0100] Among them, the volume control button is used to adjust the playback volume when the vehicle terminal plays multimedia content, the play control button is used to play, pause or switch the multimedia content played by the vehicle terminal, and the speed control button is used to adjust the playback speed of the multimedia content.

[0101] Optionally, the first physical control may be located anywhere in the vehicle, such as on a vehicle steering wheel, a door handle, or a vehicle seat, and this is not limited in the embodiments of the present application.

[0102] In some embodiments, the first physical control may be preset by the multimedia content marking system, or may be pre-configured by the user, and the user pre-configuration is taken as an example for description.

[0103] Illustratively, the mobile terminal can display a button configuration interface based on the connection relationship, the button configuration interface includes at least one control identifier, the control identifier is used to indicate a physical control in the vehicle, and in response to receiving a trigger operation for the first control identifier, a first physical control is determined from multiple physical controls in the vehicle, wherein the first control identifier is used to indicate the first physical control.

[0104] Optionally, the button configuration interface may also include a configuration prompt, which is used to prompt the user to determine the first physical control by triggering a physical control in the vehicle. During the process of displaying the button configuration interface on the mobile terminal, a trigger operation for the first physical control is received by the vehicle-mounted terminal, and a first control identifier corresponding to the first physical control is sent by the vehicle-mounted terminal to the mobile terminal. The mobile terminal determines the first physical control by receiving the first control identifier.

[0105] It is worth noting that the above-mentioned button configuration is only an illustrative example and is not limited to this in the embodiments of the present application.

[0106] Optionally, the vehicle-mounted terminal may send key information to the mobile terminal immediately upon receiving a trigger operation for the first physical control, or may send key information to the mobile terminal if the received trigger operation meets the marking requirements. This embodiment of the present application is not limited to this.

[0107] Illustratively, taking the example of the vehicle-mounted terminal sending key information to the mobile terminal immediately upon receiving a trigger operation for the first physical control, the vehicle-mounted terminal sends key information to the mobile terminal in response to receiving the trigger operation for the first physical control, and the mobile terminal records the key information and determines whether the key information meets the marking requirements.

[0108] By sending key information to the mobile terminal immediately when the vehicle terminal receives a trigger operation for the first physical control, the mobile terminal can determine whether the key meets the marking requirements, thereby reducing the data processing volume of the vehicle terminal, improving the response speed of the vehicle terminal, and improving data processing efficiency.

[0109] In some embodiments, the driver's tendency to mark multimedia content can also be inferred by the driver following the rhythm of the multimedia content, and the multimedia content in the first application can be automatically marked.

[0110] Schematically, the vehicle seats in the vehicle are equipped with vibration sensors, and the vehicle-mounted terminal collects the rhythmic data of the vehicle passengers on the vehicle seats through the vibration sensors; in response to the rhythmic beat corresponding to the rhythmic beat of the rhythmic data being consistent with the playback beat of the multimedia content, the trigger operation for the first physical control is automatically executed, and key information that meets the marking requirements is sent to the mobile terminal.

[0111] The rhythmic data is used to indicate the body shaking rhythm of the driver during the multimedia content playback process.

[0112] Optionally, the vehicle may also be equipped with an infrared sensor, and the vehicle-mounted terminal may also collect the driver's head movement data through the infrared sensor during the playing of multimedia content; in response to the head movement data indicating that the driver's head swing frequency reaches a preset frequency threshold and the head swing amplitude reaches a preset amplitude threshold, the trigger operation for the first physical control is automatically executed, and key information that meets the marking requirements is sent to the mobile terminal.

[0113] By collecting the biological activity data of drivers through sensors and other equipment, it is possible to intelligently infer the drivers' tendency to mark multimedia content, thereby realizing an automatic marking solution for multimedia content, improving the automation of marking multimedia content, eliminating the need for drivers to perform additional operations, and improving the efficiency of human-computer interaction.

[0114] It is worth noting that the above-mentioned method of collecting biological activity data through sensors and other devices to automatically mark multimedia content is only an illustrative example, and the embodiments of the present application are not limited to this.

[0115] The first physical control may be located within a preset range of a driver's seat of the vehicle, or may be located within a preset range of another seat in the vehicle.

[0116] When the first physical control is within a preset range of the vehicle's driver's seat, the driver can mark the multimedia content in the first application by performing a trigger operation that meets the marking requirements on the first physical control, thereby avoiding the driver from marking multimedia content by operating the mobile terminal during driving and ensuring driving safety.

[0117] When the first physical control is within a preset range of other seats in the vehicle, the passenger can mark the multimedia content in the first application by specifying a trigger operation that meets the marking requirements for the first physical control. This can prevent the passenger from marking multimedia content by operating the mobile terminal during the ride, avoid problems such as motion sickness, and improve the efficiency of human-computer interaction.

[0118] There may be multiple first physical controls in the vehicle. For example, each seat may have a first physical control within a preset range. A user in any seat in the vehicle may mark multimedia content in the first application through the first physical control.

[0119] When there are multiple first physical controls in the vehicle, if multiple users trigger the first physical controls at the same time within a preset time period, it is easy to cause errors in the mobile terminal when recording key information. Therefore, the vehicle-mounted terminal needs to associate and send a key identifier when sending key information. The key identifier is used to uniquely identify the physical control in the vehicle. The mobile terminal records the key identifier and the key information by associating it, and when the key information corresponding to the same key identifier meets the marking requirements, the mobile terminal marks the multimedia content in the first application.

[0120] If within a preset time period, there are at least two button identifiers whose corresponding button information meets the marking requirements, the marking operation is performed according to the permission priority of the button identifier to avoid repeated marking or incorrect marking. For example, assuming that the multimedia content has not been collected, the button information meets the marking requirements and the multimedia content will be collected, and if the multimedia content has been collected, the button information meets the marking requirements and the multimedia content can be uncollected. When user 1 and user 2 collect multimedia content through the first physical button at the same time, the multimedia content may be collected according to the button information corresponding to button identifier 1 and then uncollected according to the button information corresponding to button identifier 2, resulting in a marking error.

[0121] Optionally, permission priorities may be set for multiple first physical controls, and the permission priorities may also be determined through biometrics.

[0122] Taking setting permission priority as an example, when the key information corresponding to at least two key identifiers received within a preset time period meets the marking requirements, the multimedia content is marked according to the key information corresponding to the key identifier with a higher permission priority. For example, the highest permission priority is set for the driver's seat to avoid conflicts between the driver and passengers' operations and cause the driver to be distracted.

[0123] Taking the determination of permission priority through biometrics as an example, there is a fingerprint collection device corresponding to the first physical control. When the mobile terminal establishes a connection relationship with the vehicle-mounted terminal, at least one of the mobile terminal or the vehicle-mounted terminal will prompt the user to authorize the first physical control and the mobile terminal to collect the user's fingerprint to participate in marking multimedia content. If the user authorizes, the first physical control can automatically collect and identify the user's fingerprint data through the fingerprint collection device when receiving a trigger operation, and send key information to the mobile terminal when and only when the fingerprint data collected by the first physical control matches the fingerprint data of the master control account collected and recorded in the mobile terminal.

[0124] Schematically, the vehicle includes multiple first physical controls, and the multiple first physical controls respectively correspond to button identifiers; based on the trigger operation, the vehicle-mounted terminal collects fingerprint data corresponding to the trigger operation through the fingerprint collection device corresponding to the first physical control; the button information and fingerprint data are associated and sent to the mobile terminal through a connection relationship, and the button information includes the button identifier corresponding to the first physical control; the mobile terminal obtains the master control fingerprint data corresponding to the master control account; when the fingerprint data corresponding to the button information matches the master control fingerprint data, the button information is recorded.

[0125] By using physical controls to identify fingerprint information that matches the master account and send key information to participate in multimedia content marking, it can ensure that users who mark multimedia content through physical controls have marking permissions for the multimedia content in the first application, avoid other users interfering with the master account's marking operation of multimedia content in the first application, and improve human-computer interaction efficiency.

[0126] Optionally, the multimedia content marking system provided in the embodiment of the present application can also be applied to fleet group control scenarios. For example, the multimedia content marking system includes vehicle-mounted terminals corresponding to multiple vehicles, and the mobile terminal can control multiple vehicle-mounted terminals to simultaneously play the multimedia content in the first application.

[0127] In the fleet group control scenario, each vehicle corresponds to a first physical control. When establishing a connection relationship with multiple vehicle-mounted terminals, the mobile terminal can configure the vehicle priorities corresponding to the multiple vehicle-mounted terminals, and the vehicle-mounted terminal with the highest vehicle priority will participate in marking multimedia content, etc.; or, in the process of playing multimedia content, in response to the number of vehicle-mounted terminals that send key information that meets the marking requirements reaching a preset number threshold, the mobile terminal marks the multimedia content.

[0128] It is worth noting that the multimedia content marking method in the above-mentioned fleet group control scenario is only an illustrative example and is not limited to this in the embodiments of the present application.

[0129] Step 212: The mobile terminal receives the key information; if the key information meets the marking requirement, the multimedia content in the first application is marked.

[0130] Ways to mark multimedia content include, but are not limited to, liking, collecting, browsing, and any other way of changing the marking status of multimedia content by interacting with the multimedia content.

[0131] In some embodiments, the multimedia content marking system further includes a server, which is a background server corresponding to the first application and is used to record the marking status of the multimedia content in the first application.

[0132] When the user logs in to the first application through the master account, the marking status of the master account for the multimedia content in the first application can be obtained from the server.

[0133] Illustratively, when the key information meets the marking requirements, the mobile terminal sends a marking request to the server. The marking request is used to request to mark the multimedia content. The marking request includes a content identifier, an account identifier, and a marking instruction. The content identifier is used to indicate the multimedia content, and the account identifier is used to indicate the master account corresponding to the mobile terminal logging into the first application. The server receives the marking request; based on the marking request, records the marking relationship between the content identifier and the account identifier, and the marking relationship is used to indicate that the multimedia content is marked by the master account; and feeds back the marking result to the mobile terminal, and the marking result is used to indicate the marking relationship to the mobile terminal. The mobile terminal receives the marking result; based on the marking result, it displays that the multimedia content is marked.

[0134] By updating the tagging relationship between multimedia content and user accounts through the server, the tagging relationship generated by the master account on multiple terminal devices can be accurately synchronized, avoiding confusion in tagging relationships due to multi-terminal logins and improving the tagging accuracy of multimedia content.

[0135] It is worth noting that the above-mentioned servers can be independent physical servers, or they can be server clusters or distributed systems composed of multiple physical servers. They can also be cloud servers that provide basic cloud computing services such as cloud services, cloud security, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), as well as big data and artificial intelligence platforms.

[0136] Among them, cloud technology refers to a hosting technology that unifies hardware, software, network and other resources within a wide area network or local area network to achieve data computing, storage, processing and sharing.

[0137] In some embodiments, the above server can also be implemented as a node in a blockchain system.

[0138] Optionally, the marking requirements include at least one of the following:

[0139] The key information includes trigger operations received for at least one first physical key in a preset time interval and in a preset order;

[0140] The duration of the trigger operation in the key information reaches the preset duration threshold;

[0141] The operation frequency of the trigger operation in the key information reaches the preset frequency threshold.

[0142] When the triggering operation does not meet the marking requirements, the first physical control is used to trigger the execution of a preset vehicle control function. When the triggering operation meets the marking requirements, the first physical control is used to trigger marking of multimedia content in the first application.

[0143] For example, since the number of physical controls that can be set in a vehicle is limited, the physical controls in the vehicle are usually used to execute preset vehicle control functions and may not include multimedia content marking functions. Therefore, when the triggering operation meets the marking requirements, the function corresponding to the physical control is converted into a multimedia content marking function. This can avoid marking multimedia content by operating a mobile terminal during driving, and there is no need to specifically add additional marking function controls during the vehicle production process.

[0144] Illustratively, taking the example of a marking requirement including receiving a trigger operation for at least one first physical button in a preset order within a preset time interval, the volume button in the vehicle can be pressed in an "up, down, up, down" order. If the operation interval between four pressing operations based on this order does not exceed 500 milliseconds, it is determined that the operation meets the marking requirement and the multimedia content is marked.

[0145] In some embodiments, different marking methods for multimedia content may be implemented for different physical controls or different preset sequences.

[0146] Illustratively, by pressing the volume button in the vehicle in the order of "up, down, down", the currently playing song content is marked, and by pressing the volume button in the vehicle in the order of "down, down, up, up", the currently playing song content is unmarked, and so on.

[0147] The above-mentioned marking requirement may be preset by the first application or pre-configured by the user, and this embodiment of the present application does not limit this.

[0148] It is worth noting that the above-mentioned marking requirements are merely illustrative examples and are not limited to the embodiments of the present application.

[0149] When the marking requirement includes receiving a trigger operation for at least one first physical key in a preset order within a preset time interval, the mobile terminal needs to receive and record at least one key information, and determine whether the marking requirement is met based on the at least one key information to determine whether to mark the multimedia content.

[0150] Illustratively, the mobile terminal records in the memory the i-th key information received at the first moment; when the i+1-th key information is received at the second moment, the i-th key information is read from the memory if the time interval between the first moment and the second moment does not exceed the preset time interval; if the triggering operations in the i-th key information and the i+1-th key information conform to the preset order, the i+1-th key information is recorded, until multiple key information recorded in the memory conform to the marking requirements, the first multimedia content is marked, and i is a positive integer.

[0151] In some embodiments, when multiple key information is required to participate in marking multimedia content, the multimedia content played by the vehicle terminal may change during the process of receiving multiple key information, and it is necessary to determine the multimedia content to be marked.

[0152] Optionally, in response to multiple key information meeting the marking requirements, the multimedia content currently played by the first application is marked; or, in the process of recording multiple key information, when the multimedia content played by the vehicle-mounted terminal switches from the first multimedia content to the second multimedia content, in response to the multiple key information meeting the marking requirements, the first multimedia content played by the first application at a third moment is marked, and the third moment is the trigger moment corresponding to the first key information in the multiple key information; or, when the multimedia content played by the first application switches from the first multimedia content to the second multimedia content before recording multiple key information, in response to the multiple key information meeting the marking requirements, the first multimedia content played by the first application within a preset time range before the third moment is marked.

[0153] Illustratively, mark the multimedia content being played when multiple key information received by the mobile terminal meets the marking requirements. Alternatively, record the starting time of the trigger operation corresponding to multiple key information. For example, when the user presses the volume key in the order of "up, down, and down", mark the multimedia content played when the user presses the volume key for the first time. Alternatively, mark the multimedia content played within 5 milliseconds before the first moment when the first case information is received. For example, when the key information that meets the marking requirements is received when the multimedia content is just switched from the first multimedia content to the second multimedia content, mark the first multimedia content that has just been played.

[0154] In some embodiments, when recording multiple key information, the multimedia content played by the vehicle terminal is switched from the first multimedia content to the second multimedia content, and the first multimedia content and the second multimedia content can also be marked at the same time.

[0155] The multimedia content to be marked may be preset by the first application or configured by the user, which is not limited in the embodiment of the present application.

[0156] It is worth noting that the above-mentioned methods for determining the multimedia content to be marked are merely illustrative examples and are not limited in this regard in the embodiments of the present application.

[0157] For illustration, please refer to Figure 3 , Figure 3 is a schematic diagram of multimedia content marking provided by an exemplary embodiment of the present application, such as Figure 3 As shown, there is a first physical control on the vehicle steering wheel, and the first physical control includes a first volume key 301 and a second volume key 302, wherein the first volume key 301 is used to increase the playback volume of the multimedia content played in the vehicle terminal, and the second volume key 302 is used to reduce the playback volume of the multimedia content played in the vehicle terminal. When the mobile terminal can play the multimedia content in the first application through the connection relationship, the program interface 310 of the first application is displayed, and the master account can perform multimedia content playback control on the vehicle terminal through the program interface 310. Taking the first multimedia content in the first application played by the vehicle terminal as an example, when the first multimedia content is not marked by the master account, the program interface 310 includes a mark identifier 311 displayed in a first form. When a trigger operation that meets the marking requirements for the first physical control is received, for example, the first volume button 301 is pressed twice and the second volume button 302 is pressed twice in the order of "up, down, and down" (the interval between each press does not exceed 500 milliseconds), and key information that meets the marking requirements is sent to the mobile terminal through the vehicle terminal, instructing the mobile terminal to mark the first multimedia content. The program interface 310 includes a mark identifier 312 displayed in a second form. The mark identifier 312 displayed in the second form is used to indicate that the first multimedia content is marked by the master account.

[0158] To summarize, the system provided in the embodiment of the present application receives trigger operations on physical controls in the vehicle through the vehicle terminal, sends key information to the mobile terminal, and the mobile terminal identifies the user's marking operation on the multimedia content through the vehicle terminal based on the key information. When the key information meets the marking requirements, the mobile terminal marks the multimedia content in the application. Therefore, when the vehicle terminal plays the multimedia content in the application sent by the mobile terminal, the marking operation of the multimedia content can be implemented based on the operation on the vehicle terminal. There is no need to distract the driver while operating the mobile terminal during driving, which can improve the efficiency of marking multimedia content, improve the efficiency of human-computer interaction, and ensure driving safety.

[0159] For illustration, please refer to Figure 4, which shows a flowchart of a multimedia content marking method provided by an exemplary embodiment of the present application. The method can be executed by a terminal, or by a server, or by both a terminal and a server. The present application embodiment takes the method executed by a vehicle-mounted terminal as an example for explanation. Figure 4 As shown, the method comprises the following steps:

[0160] Step 410: Based on the connection relationship with the mobile terminal, receive multimedia content in a first application sent by the mobile terminal.

[0161] The first application is an application installed in the mobile terminal.

[0162] Optionally, the first application may be any application including multimedia content, such as music playing software, video playing platform, novel reading software, social application, game application, etc., which is not limited in this embodiment of the present application.

[0163] Multimedia content includes but is not limited to audio content, image content, text content, video content, and any other media form of content.

[0164] Step 420: Play multimedia content.

[0165] Optionally, the way in which the vehicle-mounted terminal plays multimedia content can be configured by the mobile terminal or by the vehicle-mounted terminal, including but not limited to the playback volume, playback speed, playback screen size, etc., which is not limited in the embodiments of the present application.

[0166] Step 430, in response to receiving a trigger operation for a first physical control in the vehicle, sending key information to the mobile terminal through a connection relationship, the key information being used to instruct the mobile terminal to mark the multimedia content in the first application if the marking requirements are met.

[0167] The button information is used to record the trigger operation on the first physical control.

[0168] The first physical control may be any physical control in the vehicle, for example, a volume control button or a play control button for a vehicle-mounted terminal, and this embodiment of the present application does not limit this.

[0169] Optionally, the first physical control may be located anywhere in the vehicle, such as on a vehicle steering wheel, a door handle, or a vehicle seat, and this is not limited in the embodiments of the present application.

[0170] In some embodiments, the first physical control may be preset by the multimedia content marking system, or may be pre-configured by the user, and the user pre-configuration is taken as an example for description.

[0171] Optionally, the marking requirements include at least one of the following:

[0172] The key information includes trigger operations received for at least one first physical key in a preset time interval and in a preset order;

[0173] The duration of the trigger operation in the key information reaches the preset duration threshold;

[0174] The operation frequency of the trigger operation in the key information reaches the preset frequency threshold.

[0175] Ways to mark multimedia content include, but are not limited to, liking, collecting, browsing, and any other way of changing the marking status of multimedia content by interacting with the multimedia content.

[0176] To sum up, the method provided in the embodiment of the present application receives the trigger operation for the physical controls in the vehicle through the vehicle terminal, sends the key information to the mobile terminal, and the mobile terminal identifies the user's marking operation for the multimedia content through the vehicle terminal according to the key information, and marks the multimedia content in the application by the mobile terminal when the key information meets the marking requirements. Therefore, when the vehicle terminal plays the multimedia content in the application sent by the mobile terminal, the marking operation of the multimedia content can be implemented based on the operation of the vehicle terminal, and there is no need to distract the operation of the mobile terminal during driving. The efficiency of marking multimedia content can be improved, the efficiency of human-computer interaction can be improved, and driving safety can be ensured.

[0177] For illustration, please refer to Figure 5 , which shows a flowchart of a multimedia content marking method provided by an exemplary embodiment of the present application. The method can be executed by a terminal, or by a server, or by both a terminal and a server. The present application embodiment takes the method executed by a mobile terminal as an example for explanation. Figure 5 As shown, the method comprises the following steps:

[0178] Step 510: sending multimedia content in the first application to the vehicle-mounted terminal through the connection relationship with the vehicle-mounted terminal.

[0179] The first application is an application installed in the mobile terminal.

[0180] Optionally, the first application may be any application including multimedia content, such as music playing software, video playing platform, novel reading software, social application, game application, etc., which is not limited in this embodiment of the present application.

[0181] Multimedia content includes but is not limited to audio content, image content, text content, video content, and any other media form of content.

[0182] Step 520: receiving key information sent by the vehicle-mounted terminal based on the multimedia content through the connection relationship.

[0183] The key information is sent by the vehicle-mounted terminal to the mobile terminal in response to receiving a trigger operation for the first physical control during the process of playing multimedia content. The key information is used to record the trigger operation for the first physical control.

[0184] Step 530: Mark the multimedia content in the first application program when the key information meets the marking requirement.

[0185] Optionally, the marking requirements include at least one of the following:

[0186] The key information includes trigger operations received for at least one first physical key in a preset time interval and in a preset order;

[0187] The duration of the trigger operation in the key information reaches the preset duration threshold;

[0188] The operation frequency of the trigger operation in the key information reaches the preset frequency threshold.

[0189] Ways to mark multimedia content include, but are not limited to, liking, collecting, browsing, and any other way of changing the marking status of multimedia content by interacting with the multimedia content.

[0190] To sum up, the method provided in the embodiment of the present application receives the trigger operation for the physical controls in the vehicle through the vehicle terminal, sends the key information to the mobile terminal, and the mobile terminal identifies the user's marking operation for the multimedia content through the vehicle terminal according to the key information, and marks the multimedia content in the application by the mobile terminal when the key information meets the marking requirements. Therefore, when the vehicle terminal plays the multimedia content in the application sent by the mobile terminal, the marking operation of the multimedia content can be implemented based on the operation of the vehicle terminal, and there is no need to distract the operation of the mobile terminal during driving. The efficiency of marking multimedia content can be improved, the efficiency of human-computer interaction can be improved, and driving safety can be ensured.

[0191] Figure 6 is a structural block diagram of a multimedia content marking device provided by an exemplary embodiment of the present application. Figure 6 As shown, the device includes the following parts:

[0192] The receiving module 610 is configured to receive multimedia content in a first application sent by the mobile terminal based on the connection relationship with the mobile terminal;

[0193] A playing module 620, used for playing the multimedia content;

[0194] A sending module 630, configured to, in response to receiving a trigger operation on a first physical control in the vehicle, send key information to the mobile terminal through the connection relationship, wherein the key information is used to record the trigger operation on the first physical control;

[0195] The key information is used to instruct the mobile terminal to mark the multimedia content played by the first application program if the marking requirement is met.

[0196] To summarize, the device provided in the embodiment of the present application receives trigger operations on physical controls in the vehicle through the vehicle terminal, and sends key information to the mobile terminal. The mobile terminal identifies the user's marking operation on the multimedia content through the vehicle terminal based on the key information, and marks the multimedia content in the application by the mobile terminal when the key information meets the marking requirements. Therefore, when the vehicle terminal plays the multimedia content in the application sent by the mobile terminal, the marking operation on the multimedia content can be implemented based on the operation on the vehicle terminal. There is no need to distract the driver while operating the mobile terminal during driving, which can improve the efficiency of marking multimedia content, improve the efficiency of human-computer interaction, and ensure driving safety.

[0197] Figure 7 is a structural block diagram of a multimedia content marking device provided by an exemplary embodiment of the present application. Figure 7 As shown, the device includes the following parts:

[0198] The receiving module 710 is used to receive multimedia content in a first application sent by the mobile terminal based on the connection relationship with the mobile terminal;

[0199] A playing module 720, used for playing the multimedia content;

[0200] A sending module 730, configured to, in response to receiving a trigger operation on a first physical control in the vehicle, send key information to the mobile terminal through the connection relationship, wherein the key information is used to record the trigger operation on the first physical control;

[0201] The key information is used to instruct the mobile terminal to mark the multimedia content played by the first application program if the marking requirement is met.

[0202] To summarize, the device provided in the embodiment of the present application receives trigger operations on physical controls in the vehicle through the vehicle terminal, and sends key information to the mobile terminal. The mobile terminal identifies the user's marking operation on the multimedia content through the vehicle terminal based on the key information, and marks the multimedia content in the application by the mobile terminal when the key information meets the marking requirements. Therefore, when the vehicle terminal plays the multimedia content in the application sent by the mobile terminal, the marking operation on the multimedia content can be implemented based on the operation on the vehicle terminal. There is no need to distract the driver while operating the mobile terminal during driving, which can improve the efficiency of marking multimedia content, improve the efficiency of human-computer interaction, and ensure driving safety.

[0203] It should be noted that the multimedia content marking device provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0204] Figure 8 The structure block diagram of a terminal 800 provided by an exemplary embodiment of the present application is shown. The terminal 800 may be: a smart phone, a tablet computer, an MP3 player, an MP4 player, a notebook computer or a desktop computer. The terminal 800 may also be called a user equipment, a portable terminal, a laptop terminal, a desktop terminal or other names.

[0205] Typically, the terminal 800 includes a processor 801 and a memory 802 .

[0206] The processor 801 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 801 may be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 801 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a central processing unit (CPU); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 801 may be integrated with a graphics processing unit (GPU), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 801 may also include an artificial intelligence (AI) processor, which is used to process computing operations related to machine learning.

[0207] The memory 802 may include one or more computer-readable storage media, which may be non-transitory. The memory 802 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 802 is used to store at least one instruction, which is used to be executed by the processor 801 to implement the multimedia content marking method provided in the method embodiment of the present application.

[0208] In some embodiments, the terminal 800 further includes other components 803, which can be understood by those skilled in the art. Figure 8 The structure shown in the figure does not constitute a limitation on the terminal 800, and the terminal 800 may include more or less components than those shown in the figure, or combine some components, or adopt a different component arrangement.

[0209] The embodiment of the present application also provides a computer device, which can be implemented as follows: Figure 1 The computer device includes a processor and a memory, wherein at least one instruction, at least one program, code set or instruction set is stored in the memory, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by the processor to implement the multimedia content marking method provided by the above-mentioned method embodiments.

[0210] An embodiment of the present application also provides a computer-readable storage medium, on which is stored at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by a processor to implement the multimedia content marking method provided by the above-mentioned method embodiments.

[0211] The embodiments of the present application also provide a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the multimedia content marking method provided by the above-mentioned method embodiments.

[0212] Optionally, the computer readable storage medium may include: Read Only Memory (ROM), Random Access Memory (RAM), Solid State Drives (SSD) or optical disks, etc. Among them, the random access memory may include resistance random access memory (ReRAM) and dynamic random access memory (DRAM). The serial numbers of the above embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments.

[0213] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0214] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A multimedia content marking system, characterized in that: The system includes a vehicle-mounted terminal and a mobile terminal connected to the vehicle-mounted terminal; The mobile terminal is used to run a first application; and send multimedia content in the first application to the vehicle-mounted terminal through the connection relationship; The vehicle-mounted terminal is used to play the multimedia content; In response to receiving a trigger operation on a first physical control in the vehicle, sending key information to the mobile terminal through the connection relationship, wherein the key information is used to record the trigger operation on the first physical control; The mobile terminal is further configured to receive the key information; and to mark the multimedia content in the first application program when the key information meets a marking requirement.

2. The system according to claim 1, characterized in that The system also includes a server; The mobile terminal is further configured to send a marking request to the server if the key information meets the marking requirement, the marking request being used to request marking the multimedia content, the marking request including a content identifier, an account identifier, and a marking instruction, the content identifier being used to indicate the multimedia content, and the account identifier being used to indicate a master control account corresponding to the mobile terminal logging into the first application; The server is used to receive the marking request; Recording a tagging relationship between the content identifier and the account identifier based on the tagging request, wherein the tagging relationship is used to indicate that the multimedia content is tagged by the master control account; Feedback the marking result to the mobile terminal; The mobile terminal is further configured to receive the marking result; and display that the multimedia content is marked based on the marking result.

3. The system according to claim 1, characterized in that The marking requirements include at least one of the following: The key information includes trigger operations received for at least one first physical key in a preset time interval and in a preset order; The duration of the trigger operation in the key information reaches a preset duration threshold; The operation frequency of the triggering operation in the key information reaches a preset frequency threshold.

4. The system according to claim 3, characterized in that The mobile terminal is also used to record the i-th key information received at the first moment in the memory; when the i+1-th key information is received at the second moment, when the time interval between the first moment and the second moment does not exceed the preset time interval, read the i-th key information from the memory; when the triggering operations in the i-th key information and the i+1-th key information meet the preset order, record the i+1-th key information, until multiple key information recorded in the memory meet the marking requirements, mark the multimedia content, and i is a positive integer.

5. The system according to claim 4, characterized in that The mobile terminal is further configured to mark the multimedia content currently being played by the first application in response to the plurality of key information meeting the marking requirement; or In the process of recording the plurality of key information, when the multimedia content played by the first application is switched from the first multimedia content to the second multimedia content, in response to the plurality of key information meeting the marking requirement, marking the first multimedia content played by the first application at a third moment, where the third moment is a triggering moment corresponding to the first key information among the plurality of key information; or In a case where the multimedia content played by the first application is switched from the first multimedia content to the second multimedia content before recording the multiple key information, in response to the multiple key information meeting the marking requirement, marking the first multimedia content played by the first application within a preset time range before the third moment.

6. The system according to claim 4, characterized in that The vehicle includes a plurality of first physical controls, each of which corresponds to a key mark; The vehicle-mounted terminal is further used to collect fingerprint data corresponding to the trigger operation through the fingerprint collection device corresponding to the first physical control based on the trigger operation; and to send the key information and the fingerprint data to the mobile terminal in association through the connection relationship, wherein the key information includes the key identifier corresponding to the first physical control; The mobile terminal is further used to obtain the master fingerprint data corresponding to the master account; and record the key information when the fingerprint data corresponding to the key information matches the master fingerprint data.

7. The system according to any one of claims 1 to 6, characterized in that: The vehicle seats in the vehicle correspond to vibration sensors; The vehicle-mounted terminal is also used to collect the rhythmic data of the vehicle occupant on the vehicle seat through the vibration sensor; in response to the rhythmic beat corresponding to the rhythmic beat of the rhythmic data being consistent with the playback beat of the multimedia content, the trigger operation for the first physical control is automatically executed, and the key information that meets the marking requirements is sent to the mobile terminal.

8. The system according to any one of claims 1 to 6, characterized in that: The mobile terminal is further used to send a paging signal, wherein the paging signal is used to search for a device within a preset range that can establish the connection relationship; The vehicle-mounted terminal is further configured to establish a link connection with the mobile terminal in response to the paging signal; The mobile terminal is further configured to send a connection request to the vehicle-mounted terminal based on the link connection, wherein the connection request is used to request to establish the connection relationship; The vehicle-mounted terminal is further configured to automatically respond to the connection request and establish the connection relationship with the mobile terminal.

9. A multimedia content marking method based on a vehicle-mounted terminal, characterized in that: The method is executed by a vehicle-mounted terminal, and the method includes: Based on the connection relationship with the mobile terminal, receiving multimedia content in a first application sent by the mobile terminal; Playing the multimedia content; In response to receiving a trigger operation for a first physical control in the vehicle, sending key information to the mobile terminal through the connection relationship, wherein the key information is used to record the trigger operation for the first physical control; The key information is used to instruct the mobile terminal to mark the multimedia content played by the first application program if the marking requirement is met.

10. A multimedia content marking method based on a vehicle-mounted terminal, characterized in that: The method is executed by a mobile terminal, and the method includes: Sending multimedia content in the first application to the vehicle-mounted terminal through a connection relationship with the vehicle-mounted terminal; receiving key information sent by the vehicle-mounted terminal through the connection relationship based on the multimedia content; If the key information meets the marking requirement, marking the multimedia content in the first application; The button information is sent by the vehicle-mounted terminal to the mobile terminal in response to receiving a trigger operation for the first physical control during the process of playing the multimedia content, and the button information is used to record the trigger operation for the first physical control.

11. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one computer program, and the at least one computer program is loaded and executed by the processor to implement the multimedia content marking method according to claim 9 or 10.

12. A computer-readable storage medium, characterized in that: The storage medium stores at least one computer program, and the at least one computer program is loaded and executed by the processor to implement the multimedia content marking method according to claim 9 or 10.

13. A computer program product, characterized in that The method comprises a computer program, which implements the multimedia content marking method according to claim 9 or 10 when the computer program is executed by a processor.

Images