Multimedia resource searching method and device and electronic equipment

By obtaining biometric information from the cockpit data of users in the vehicle, analyzing user age information, and obtaining multimedia resource search results suitable for this age level based on the target search scenario label information, the problem of returning content in the prior art that children are not suitable for children is solved, and the protection of children's physical and mental health and more friendly media services are achieved.

CN119557464APending Publication Date: 2025-03-04BEIJING CO WHEELS TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202311127340.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-09-01
Publication Date
2025-03-04

AI Technical Summary

Technical Problem

The prior art may return resources that contain content that is not suitable for children when users search for multimedia resources, affecting the physical and mental health of children.

Method used

By obtaining biometric information from the cockpit data of the user in the car, analyzing the user's age information, and obtaining multimedia resource search results suitable for this age level based on the target search scenario tag information.

Benefits of technology

Ensure that the searched multimedia resources are suitable for the age of users in the car, avoid children from contacting unsuitable content, thereby protecting children's physical and mental health and providing more friendly media services.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119557464A_ABST
    Figure CN119557464A_ABST
Patent Text Reader

Abstract

The invention relates to a multimedia resource searching method and device and electronic equipment, and relates to the technical field of information, and the method comprises the following steps: firstly, determining a search term of a vehicle for searching multimedia resources; acquiring respective corresponding biological characteristic information of the in-vehicle users from cabin data of the in-vehicle users sent by the vehicle; analyzing user age information corresponding to the biological characteristic information; determining target search scene label information corresponding to the in-vehicle user of the user age information; obtaining a multimedia resource search result which corresponds to the search term and has a level corresponding to the target search scene label information; and sending the multimedia resource search result to the vehicle. Compared with the prior art, the method has the advantages that multimedia resources suitable for children can be searched when the children exist in the vehicle cabin, so that the physical and psychological health of the children is protected to a certain extent, and more friendly media services can be provided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of information technology, and in particular to a method, device and electronic device for searching multimedia resources. Background Art

[0002] With the continuous development of automobile technology, more and more functions can be used in vehicles, and users can experience the multimedia services provided in the car, such as watching videos using video APPs. In order to meet the different needs of users, different multimedia APPs are integrated into the car computer.

[0003] At present, when a user searches for multimedia resources, all multimedia resources related to the search keyword will be provided to the user. However, some of these searched multimedia resources may be inappropriate for children, which may affect the physical and mental health of children. Summary of the invention

[0004] In view of this, the present application provides a method, device and electronic device for searching multimedia resources, the main purpose of which is to improve the technical problem that the multimedia resources searched in the current prior art may contain resources that are not suitable for children and may affect the physical and mental health of children.

[0005] In a first aspect, the present application provides a method for searching multimedia resources, comprising:

[0006] Determining search terms for vehicles to search multimedia resources;

[0007] Acquire biometric information corresponding to each of the in-vehicle users from the in-vehicle user's cabin data sent by the vehicle;

[0008] analyzing user age information corresponding to the biometric information;

[0009] Determine the target search scene label information corresponding to the in-vehicle user with the user age information;

[0010] Obtaining multimedia resource search results corresponding to the search term and at a level corresponding to the target search scenario label information, wherein different search scenario label information respectively corresponds to multimedia resources at different levels, and the multimedia resources at different levels have respective corresponding audience groups;

[0011] The multimedia resource search result is sent to the vehicle.

[0012] In a second aspect, the present application provides a method for searching multimedia resources, comprising:

[0013] Sending cockpit data of the in-car user to the server, the cockpit data is used for the user age information to determine the target search scene label information corresponding to the in-car user with the user age information;

[0014] Receive multimedia resource search results corresponding to the search terms and at a level corresponding to the target search scenario label information sent by the server, wherein different search scenario label information corresponds to multimedia resources of different levels, and the multimedia resources of different levels have their own corresponding audience groups.

[0015] In a third aspect, the present application provides a multimedia resource search device, comprising:

[0016] A determination module configured to determine a search term for a vehicle to search for multimedia resources;

[0017] An acquisition module is configured to acquire biometric information corresponding to each user in the vehicle from the cabin data of the user in the vehicle sent by the vehicle;

[0018] an analysis module configured to analyze user age information corresponding to the biometric information;

[0019] The determination module is further configured to determine target search scene label information corresponding to the in-vehicle user of the user age information;

[0020] The acquisition module is further configured to acquire multimedia resource search results corresponding to the search term and at a level corresponding to the target search scenario label information, wherein different search scenario label information respectively corresponds to multimedia resources at different levels, and the multimedia resources at different levels have their own corresponding audience groups;

[0021] The sending module is configured to send the multimedia resource search result to the vehicle.

[0022] In a fourth aspect, the present application provides a multimedia resource search device, comprising:

[0023] A sending module is configured to send cockpit data of the in-car user to the server, wherein the cockpit data is used to analyze the user age information corresponding to the in-car user to determine the target search scene label information corresponding to the in-car user with the user age information;

[0024] The receiving module is configured to receive multimedia resource search results corresponding to the search terms and at a level corresponding to the target search scene label information sent by the server, wherein different search scene label information corresponds to multimedia resources of different levels, and the multimedia resources of different levels have their own corresponding audience groups.

[0025] In a fifth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the method described in the first aspect or the method described in the second aspect is implemented.

[0026] In a sixth aspect, the present application provides an electronic device, comprising a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein the processor implements the method of the first aspect or the method of the second aspect when executing the computer program.

[0027] In a seventh aspect, the present application provides a multimedia resource search system, comprising: at least one vehicle and a server; wherein the server executes the method of the first aspect described above; and the vehicle executes the method of the second aspect described above.

[0028] By means of the above technical scheme, the present application provides a method, device and electronic device for searching multimedia resources, firstly determining the search words for searching multimedia resources by the vehicle; obtaining the biometric information corresponding to each user in the vehicle from the cockpit data of the users in the vehicle sent by the vehicle; analyzing the user age information corresponding to the biometric information; determining the target search scene label information corresponding to the user in the vehicle of the user age information; obtaining the multimedia resource search results corresponding to the search words and corresponding to the target search scene label information, wherein different search scene label information respectively corresponds to different levels of multimedia resources, and different levels of multimedia resources have their own corresponding audience groups; and sending the multimedia resource search results to the vehicle. Compared with the current existing technology, the present application can determine the age information of the users in the vehicle cockpit according to the data in the vehicle cockpit, determine whether there are younger users in the vehicle cockpit, and then determine the corresponding search scene label information, and return the multimedia resource search results of the corresponding level. This embodiment can make the searched resources suitable for users of that age. For example, when there are children in the vehicle cockpit, multimedia resources suitable for children can be searched, thereby protecting the physical and mental health of children to a certain extent, and providing more friendly media services.

[0029] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0031] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0032] Figure 1 A schematic diagram showing a flow chart of a method for searching multimedia resources provided in an embodiment of the present application;

[0033] Figure 2 A schematic diagram showing a flow chart of a method for searching multimedia resources provided in an embodiment of the present application;

[0034] Figure 3 A schematic diagram of an example structure provided by an embodiment of the present application is shown;

[0035] Figure 4 A schematic diagram of the structure of a multimedia resource search device provided in an embodiment of the present application is shown;

[0036] Figure 5 A schematic diagram of the structure of a multimedia resource search device provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0037] In order to more clearly understand the above-mentioned purposes, features and advantages of the present application, the scheme of the present application will be further described below. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0038] This embodiment provides a method for searching multimedia resources, which can be applied to the server side for execution, such as Figure 1 As shown, the method includes:

[0039] Step 101: Determine a search term for a vehicle to search for multimedia resources.

[0040] In an embodiment of the present application, multimedia resources can be of different types, such as video, music, audiobooks, etc. The multimedia resources are stored in a resource database on the server side. The resources in the resource database can be provided by different suppliers and can bring together resources for different multimedia applications.

[0041] For example, the resource database on the server side may include video content contained in all third-party applications such as A video APP, B video APP, C video APP, etc. Correspondingly, the resource database on the server side may include music content contained in all third-party applications such as A music APP, B music APP, C music APP, etc. Other categories of content contained in the resource database will not be given examples one by one here.

[0042] Step 102: Obtain biometric information corresponding to each user in the vehicle from the cabin data of the users in the vehicle sent by the vehicle.

[0043] In an embodiment of the present application, the cabin data of the user in the vehicle may be image data and sound data in the vehicle cabin obtained through in-cabin monitoring (In-cabin monitoring), driver monitoring (Drive Monitoring System, DMS), occupancy monitoring system, OMS) and voiceprint recognition (Voiceprint Recognition), etc.

[0044] Optionally, the user's biometric information may include the user's location information, the user's motion information, the user's voice information, the user's body features and facial features information, etc.

[0045] Step 103: Analyze the user age information corresponding to the biometric information.

[0046] In the embodiment of the present application, the user's age information is the age of the user in the car.

[0047] Step 104: Determine the target search scenario label information corresponding to the in-vehicle user with the user age information.

[0048] Optionally, the search scenarios corresponding to users in the car may include child search scenarios, adult search scenarios, adult search scenarios with children present, and all-adult scenarios. The child search scenario may be a search scenario where children search for media resources for themselves; the adult search scenario may be a search scenario where adults search for media resources for children in the car; the adult search with children present may be a search scenario where there are children in the car but the adults search for media resources for themselves; the all-adult scenario may be a search scenario where there are only adults and no children in the car.

[0049] Illustratively, the child search scenario may be that the child operates in the vehicle or searches through voice commands; the adult search scenario may be that the adult in the vehicle operates or gives voice commands on behalf of the child, for example, the father in the main driver's seat plays a movie for his son in the back seat through the voice command "Play movie in the back seat".

[0050] In the embodiment of the present application, the label information of the search scene can be divided into three categories, namely, children's resources, general level, and not suitable for children. The first category of children's resources is suitable for all age groups. For example, the video can be a children's cartoon, such as Peppa Pig, etc.; the music can be children's music, such as Leap Frog, etc.; the audio book resources can be children's stories, such as Snow White, etc. The second category of general level is media resources that children can watch or listen to without pressure. For example, video resources can be family and fairy tale themes, such as "Despicable Me", etc.; music resources can be audio programs such as news information, etc.; the third category is not suitable for children, that is, resources that contain violence, pornography, etc. that are not suitable for children.

[0051] In this embodiment, the corresponding search scene can be determined according to the age information of the users in the car, and then the corresponding search scene label information can be determined. The specific analysis and determination can be carried out according to different situations. The following only illustrates several examples, and does not limit the specific implementation of this embodiment.

[0052] For example, in the case where a user initiates a search for multimedia resources through voice commands, the user's voice information is recognized to determine that multimedia resources need to be searched, and the content result of "playing movies for users in the back seats" can be obtained through semantic recognition. The corresponding ages of these users can be identified through the cabin data of the users in the car. If it is determined that the user who initiated the voice command in the front row is an adult, and the user sitting in the back row is a child, it can be determined that the current scene is an adult-agent search, and then the label information of the adult-agent search scene can be determined, such as the label of children's resources.

[0053] For another example, in the case where a user initiates a search for multimedia resources through voice commands, the user's voice information is identified to determine that multimedia resources need to be searched, and the content result of "playing a movie" can be obtained through semantic recognition. The corresponding ages of these users can be identified through the cockpit data of the users in the car. If it is determined that the user who initiated the voice command in the front row is an adult, and the user sitting in the back row is a child, it can be determined that the current search scene is for adults with children present, and then the label information of the adult search scene with children present can be determined, such as the general level label. If it is determined that the initiator of the voice command is from the back row user, and the user sitting in the back row is a child, it can be determined that the current search scene is for children, and then the label information of the children's search scene can be determined, such as the label of children's resources.

[0054] For another example, when a user initiates a search for multimedia resources through an operation, a search request for multimedia resources will be received, and the search request will be parsed to determine that the user in the front row needs to project the searched multimedia resources onto the screen in the back row. Based on the ages of the identified users in the car, if it is determined that the user in the front row who initiated the operation is an adult, and the user in the back row is a child, it can be determined that the current search scene is for adults with children present, and then the label information of the search scene for adults with children present can be determined, such as a general-level label.

[0055] For another example, in the case where a user initiates a search for multimedia resources through an operation, a search request for multimedia resources will be received, and the search request will be parsed to determine that it is a request from a user in the back seat to watch a movie. Based on the ages of the identified users in the car, if it is determined that the user in the back seat who initiated this operation is a child, it can be determined that the current search scene is for children, and further the label information of the search scene for children, such as the label of children's resources, can be determined.

[0056] For another example, whether the user initiates a search for multimedia resources through an operation or through a voice command, if the cockpit data is identified and it is determined that the ages of the users in the car are all adults, then this search scenario is a completely adult scenario, and the corresponding completely adult scenario label information can be determined, such as any one or more of the above three types of labels.

[0057] Step 105: Obtain multimedia resource search results corresponding to the search term and at a level corresponding to the target search scenario tag information.

[0058] Among them, different search scenario label information corresponds to different levels of multimedia resources, and different levels of multimedia resources have their own corresponding audience groups.

[0059] In an embodiment of the present application, the search results of multimedia resources at the level corresponding to the tag information can specifically be: if it is in a children's search scenario or an adult's search scenario, and the children in the vehicle directly retrieve media resources, then the multimedia resource search will give priority to obtaining the first category of children's resources, that is, children's cartoons, children's music, children's stories, etc. suitable for all age groups, and will not obtain the third category of resources, that is, resources that are not suitable for children, such as violence, pornography, etc.

[0060] Optionally, if the search scenario is an adult one with children present, the multimedia resource search acquires resources based on resource matching and popularity, and does not acquire third-category resources, that is, does not acquire resources that are not suitable for children, such as those containing violence, pornography, etc.; if the scenario is completely adult, there is no restriction on resource categories, and the multimedia resource search acquires resources based on resource matching and popularity.

[0061] Step 106: Send the multimedia resource search results to the vehicle.

[0062] Compared with the current existing technology, this embodiment can determine whether there are children in the vehicle cabin based on the data in the vehicle cabin. When there are children in the vehicle cabin, multimedia resources related to the search terms can be obtained by category according to different search scenarios, so that the searched resources do not contain resources that are not suitable for children, better protect the physical and mental health of children, and provide more friendly media services.

[0063] Furthermore, based on the above Figure 1 In the content of the embodiment, optionally, different search scene label information includes at least one or more of the following: child search scene label information, adult search scene label information, adult search scene label information with children present, and adult search scene label information without children present; accordingly, if the target search scene label information is any one of the child search scene label information, adult search scene label information, and adult search scene label information with children present, then step 105 may specifically include: obtaining a first multimedia resource search result corresponding to the search term, wherein the first multimedia resource search result does not include multimedia resources that are prohibited for children. If the target search scene label information is any one of the child search scene label information and adult search scene label information, then step 105 may specifically include: obtaining a second multimedia resource search result corresponding to the search term, wherein the second multimedia resource search result includes children's multimedia resources, such as preferentially recalling children's multimedia resources.

[0064] For example, it is assumed that the multimedia resources in the resource database are divided into three categories: the first category is children's resources, which are suitable for all age groups. For videos, they are mainly children's films, such as Peppa Pig; music is mainly children's music, such as Leap Frog; audio book resources are mainly children's stories; the second category is ordinary resources, which are stress-free for children and can be played even when children are present. For video resources, they are mainly family and fairy tale themes, such as Despicable Me; music, such as; audio programs, such as news information; the third category of resources is not suitable for children, such as resources that contain violence and are not suitable for children. In this embodiment, the first multimedia resource search result can be the search result corresponding to the search term obtained from the first and second categories of resources, and the second multimedia resource search result can be the search result corresponding to the search term obtained from the first category of resources. In other words, for children's search scenarios and adult search scenarios, the first category of resources is recalled first.

[0065] Optionally, the cockpit data includes voice information of the users in the car and / or user image information. Accordingly, step 102 may further specifically include: recognizing voice information to obtain voiceprint feature information corresponding to each user in the car; and / or, recognizing user image information to obtain facial feature information corresponding to each user in the car; and / or, recognizing user image information to obtain body feature information corresponding to each user in the car; step 102 may further specifically include: analyzing user age information corresponding to the voiceprint feature information, and / or facial feature information, and / or body feature information.

[0066] In an embodiment of the present application, the user's biometric information may include but is not limited to the user's facial features, voiceprint features, motion features, etc. The age of the user in the vehicle cabin is judged based on the user's biometric information, and auxiliary judgment can also be made based on the location information in the cabin described by the user.

[0067] For example, if the user is in the back seat of the vehicle, and the image information in the cockpit shows that the user is using a child safety seat, it can be determined that there is a child in the vehicle cabin; if the user is in the main driving position, and the image information in the cockpit shows that there is only one person in the vehicle cabin, it can be determined to be a fully adult scene.

[0068] Optionally, step 105 specifically further includes: based on the search term, obtaining multimedia resource search results of a level corresponding to the target search scene label information from a resource database.

[0069] The resource database includes multimedia resources corresponding to different multimedia APPs, and the multimedia resource search results include multimedia resource search results corresponding to at least one multimedia APP.

[0070] In an embodiment of the present application, the multimedia agent system may include a resource database, and may also display recalled resources and assume interactive functions; for example, when a cockpit member requests "play Peppa Pig", the agent receives the search results recalled from the cloud and displays the resources for the cockpit member to choose from. After the cockpit member makes a selection, the agent calls the corresponding media APP to play the resource based on the application to which the resource belongs.

[0071] Exemplarily, if the multimedia resource search results include multiple media apps, the resources of all multimedia apps may be obtained, or the resources of multimedia apps may be selectively obtained based on the number of times the vehicle uses the apps.

[0072] Optionally, step 104 may specifically include: sending multimedia resource search results corresponding to at least one multimedia APP and a corresponding multimedia APP identifier to the vehicle.

[0073] For example, if the multimedia resource search results include multiple media apps, the resources of all multimedia apps can be obtained, and the multimedia app identifiers corresponding to the search information can be sent to the vehicle. Alternatively, based on the number of times the vehicle uses the multimedia app, multimedia app identifiers with more frequent uses can be sent to the vehicle, while multimedia app identifiers with less frequent uses or even those that have never been used will not be sent to the vehicle.

[0074] Optionally, step 101 may specifically include: receiving a search request for multimedia resources sent by a vehicle; or receiving a voice message sent by a vehicle, and identifying through the voice message that the vehicle needs to search for multimedia resources and search terms.

[0075] The search request carries the search term.

[0076] In an embodiment of the present application, if the user in the cabin searches directly on the vehicle screen, the server can directly receive the multimedia resource request sent by the vehicle. If the user in the cabin uses voice commands, the vehicle cannot recognize that the user in the cabin needs to search for multimedia resources. The vehicle will send voice information to the server. If it is detected that the user has issued an instruction to search for multimedia resources, the multimedia resource search will be performed directly.

[0077] Compared with the current existing technology, this embodiment can obtain the user's biometric information based on the data in the vehicle cabin to determine the age of the user in the vehicle cabin, and then determine whether there are children in the vehicle cabin. When there are children in the vehicle cabin, multimedia resources related to the search terms can be obtained by category in the resource database according to different search scenarios of multimedia resources, so that the searched resources do not contain resources that are not suitable for children, better protect the physical and mental health of children, and provide more friendly media services. The resource database integrates resources of multimedia APPs, and the resources of all multimedia APPs can be retrieved in the resource database, which improves the efficiency of media retrieval and enhances the user experience.

[0078] To illustrate the processing process at the vehicle end, further, this embodiment also provides a method for searching multimedia resources, which is applied to vehicles, such as Figure 2 As shown, the method includes:

[0079] Step 201: Send the cabin data of the user in the car to the server.

[0080] Among them, the cockpit data is used to analyze the user age information corresponding to the user in the car to determine the target search scene label information corresponding to the user in the car with the user age information.

[0081] In an embodiment of the present application, the cockpit data of the in-vehicle user may be image data and sound data in the vehicle cockpit obtained through in-cabin monitoring, driver monitoring (Drive Monitoring System, DMS), occupancy monitoring system (OMS) and voiceprint recognition (Voiceprint Recognition), etc. The in-vehicle occupants and their actions may be identified through visual technology (offline capability), the recognition accuracy may be improved by registering members, the gender, age and other information of the person to whom the voice belongs may be determined through voiceprint information; the recognition accuracy may be improved through the voiceprint of registered members; the voice commands may be uploaded to the cloud for semantic understanding through a multimodal recognition system; and offline natural language understanding (NLU) capability may be provided.

[0082] Step 202: Receive multimedia resource search results corresponding to the search term and at a level corresponding to the target search scenario tag information sent by the server.

[0083] Among them, different search scenario label information corresponds to different levels of multimedia resources, and different levels of multimedia resources have their own corresponding audience groups.

[0084] Compared with the current existing technology, this embodiment can obtain the user's biometric information based on the data in the vehicle cabin to determine the age of the user in the vehicle cabin, and then determine whether there are children in the vehicle cabin. When there are children in the vehicle cabin, multimedia resources related to the search terms can be obtained by category in the resource database according to different search scenarios of multimedia resources, so that the searched resources do not contain resources that are not suitable for children, better protect the physical and mental health of children, and provide more friendly media services. The resource database integrates resources of multimedia APPs, and the resources of all multimedia APPs can be retrieved in the resource database, which improves the efficiency of media retrieval and enhances the user experience.

[0085] Furthermore, based on the above Figure 2 The content of the embodiment, optionally, step 201 may specifically include: sending a search request for multimedia resources to the server; or, sending voice information and cockpit data to the server.

[0086] The search request carries cockpit data and search terms, and the voice information is used to identify that the vehicle needs to search for multimedia resources and search terms.

[0087] In an embodiment of the present application, if the user in the cabin searches directly on the vehicle screen, the server can directly receive the multimedia resource request sent by the vehicle. If the user in the cabin uses voice commands, the vehicle cannot recognize that the user in the cabin needs to search for multimedia resources. The vehicle will send voice information to the server. If the server detects that the user has issued an instruction to search for multimedia resources, it will directly perform the multimedia resource search.

[0088] Optionally, step 202 may specifically include: receiving multimedia resource search results corresponding to at least one multimedia APP, and a corresponding multimedia APP identifier.

[0089] Optionally, after step 202, the method of this embodiment also includes: outputting multimedia resource search results corresponding to at least one multimedia APP; determining a target multimedia resource selected by the user to play in the multimedia resource search results; determining a target multimedia APP identifier of the target multimedia APP to which the target multimedia resource belongs based on the multimedia APP identifier corresponding to the target multimedia resource; and calling the target multimedia APP corresponding to the target multimedia APP identifier to play the target multimedia resource.

[0090] For example, if the multimedia APP received from the server does not exist in the vehicle system, it can be downloaded locally in the vehicle based on the multimedia APP identifier sent by the server.

[0091] Compared with the current existing technology, this embodiment can obtain the user's biometric information based on the data in the vehicle cabin to determine the age of the user in the vehicle cabin, and then determine whether there are children in the vehicle cabin. When there are children in the vehicle cabin, multimedia resources related to the search terms can be obtained by category in the resource database according to different search scenarios of multimedia resources, so that the searched resources do not contain resources that are not suitable for children, better protect the physical and mental health of children, and provide more friendly media services. The resource database integrates resources of multimedia APPs, and the resources of all multimedia APPs can be retrieved in the resource database, which improves the efficiency of media retrieval and enhances the user experience.

[0092] In order to fully illustrate the specific implementation process of the method of this embodiment, this embodiment provides the following examples, but is not limited thereto: Figure 3 The figure shows a schematic diagram of the structure of an example.

[0093] Users retrieve media resources through touch or voice; retrieval information and member information are uploaded to the cloud; the cloud retrieval system recalls resources according to different scenarios; the recalled resources interact with users through the multimedia agent system.

[0094] For example, a father is driving a car and his son is sitting in the back seat; the father gives his son a voice command to "play a movie for the back seat", intending to play media resources for the children in the back seat; the cockpit monitoring system uploads the cockpit visual information and voice commands to the cloud, and the cloud-based multi-modal system recognizes that there are children in the back seat and the voice intention is to search for movies; the search system uses the search strategy of adult search scenarios based on the data provided by the multi-modal recognition system to prioritize children's movie resources; the resource data is sent to the multimedia agent system for graphical user interface (GUI) display, and the multimedia agent system responds to user interaction operations, such as touch page turning, touch play cancellation, click play and voice interaction commands (page turning, cancel, selection, etc.); when the user selects a resource to play, the agent system calls the corresponding media APP to start playing the resource.

[0095] Compared with the current existing technology, this embodiment can obtain the user's biometric information based on the data in the vehicle cabin to determine the age of the user in the vehicle cabin, and then determine whether there are children in the vehicle cabin. When there are children in the vehicle cabin, multimedia resources related to the search terms can be obtained by category in the resource database according to different search scenarios of multimedia resources, so that the searched resources do not contain resources that are not suitable for children, better protect the physical and mental health of children, and provide more friendly media services. The resource database integrates resources of multimedia APPs, and the resources of all multimedia APPs can be retrieved in the resource database, which improves the efficiency of media retrieval and enhances the user experience.

[0096] Further, as Figure 1 The specific implementation of the method shown in the embodiment provides a multimedia resource search device, which can be applied to the server side for execution, such as Figure 4 As shown, the device includes: a determination module 31, an acquisition module 32, an analysis module 33, and a sending module 34.

[0097] A determination module 31 is configured to determine a search term for a vehicle to search for multimedia resources;

[0098] The acquisition module 32 is configured to acquire biometric information corresponding to each user in the vehicle from the cabin data of the user in the vehicle sent by the vehicle;

[0099] An analysis module 33, configured to analyze user age information corresponding to the biometric information;

[0100] The determination module 31 is further configured to determine the target search scene label information corresponding to the in-vehicle user of the user age information;

[0101] The acquisition module 32 is further configured to acquire multimedia resource search results corresponding to the search term and at a level corresponding to the target search scenario label information, wherein different search scenario label information corresponds to multimedia resources of different levels, and the multimedia resources of different levels have their own corresponding audience groups;

[0102] The sending module 34 is configured to send the multimedia resource search result to the vehicle.

[0103] In a specific application scenario, different search scene label information includes at least one or more of: children's search scene label information, adult search scene label information, adult search scene label information with children present, and adult search scene label information without children present; accordingly, the acquisition module 32 is specifically configured to obtain a first multimedia resource search result corresponding to the search term, wherein the first multimedia resource search result does not include multimedia resources that are banned for children; the acquisition module 32 is also specifically configured to obtain a second multimedia resource search result corresponding to the search term, wherein the second multimedia resource search result includes children's multimedia resources.

[0104] In a specific application scenario, the cockpit data includes voice information of the users in the vehicle and / or user image information; accordingly, the acquisition module 32 is further configured to identify the voice information to obtain voiceprint feature information corresponding to each user in the vehicle; and / or, to identify the user image information to obtain facial feature information corresponding to each user in the vehicle; and / or, to identify the user image information to obtain human body feature information corresponding to each user in the vehicle; the analysis module 32 is further configured to analyze the user age information corresponding to the voiceprint feature information, and / or facial feature information, and / or human body feature information.

[0105] In a specific application scenario, the acquisition module 32 is further configured to obtain the multimedia resource search results of the level corresponding to the target search scene label information from the resource database based on the search term, the resource database contains multimedia resources corresponding to different multimedia APPs, and the multimedia resource search results contain multimedia resource search results corresponding to at least one multimedia APP; accordingly, the sending module 34 is specifically configured to send the multimedia resource search results corresponding to the at least one multimedia APP and the corresponding multimedia APP identifier to the vehicle.

[0106] In a specific application scenario, the determination module 31 is specifically configured to receive a search request for multimedia resources sent by the vehicle, wherein the search request carries the search term; or, to receive voice information sent by the vehicle, and to identify through the voice information that the vehicle needs to search for multimedia resources and the search term.

[0107] It should be noted that for other corresponding descriptions of the functional units involved in the multimedia resource search device provided in this embodiment, reference can be made to Figure 1 The corresponding description in will not be repeated here.

[0108] Further, as Figure 2 The specific implementation of the method shown in the embodiment provides a multimedia resource search device, which is applied to a vehicle to perform, such as Figure 5 As shown, the device includes: a sending module 41 and a receiving module 42.

[0109] The sending module 41 is configured to send the cockpit data of the in-car user to the server, wherein the cockpit data is used to analyze the user age information corresponding to the in-car user to determine the target search scene label information corresponding to the in-car user with the user age information;

[0110] The receiving module 42 is configured to receive multimedia resource search results corresponding to the search terms and at a level corresponding to the target search scenario tag information sent by the server, wherein multimedia resources at different levels have their own corresponding audience groups.

[0111] In a specific application scenario, the sending module 41 is specifically configured to send a search request for multimedia resources to the server, wherein the search request carries the cockpit data and the search term; or, to send voice information and the cockpit data to the server, wherein the voice information is used to identify that the vehicle needs to search for multimedia resources and the search term.

[0112] In a specific application scenario, the receiving module 42 is specifically configured to receive multimedia resource search results corresponding to at least one multimedia APP and a corresponding multimedia APP identifier.

[0113] In a specific application scenario, the receiving module 42 is also configured to output the multimedia resource search results corresponding to the at least one multimedia APP; determine the target multimedia resource selected by the user to play in the multimedia resource search results; determine the target multimedia APP identifier of the target multimedia APP to which the target multimedia resource belongs based on the multimedia APP identifier corresponding to the target multimedia resource; call the target multimedia APP corresponding to the target multimedia APP identifier to play the target multimedia resource.

[0114] It should be noted that for other corresponding descriptions of the functional units involved in the multimedia resource search device provided in this embodiment, reference can be made to Figure 2 The corresponding description in will not be repeated here.

[0115] Based on the above Figure 1 The method shown in the embodiment also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned Figure 1 The method shown.

[0116] Based on this understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, USB flash drive, mobile hard disk, etc.), including a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various implementation scenarios of the present application.

[0117] Based on the above Figure 1 The method shown, and Figure 4 In order to achieve the above-mentioned purpose, the embodiment of the present application further provides an electronic device, which can be configured on the server side, and the device includes a storage medium and a processor; the storage medium is used to store a computer program; the processor is used to execute the computer program to achieve the above-mentioned Figure 1 The method shown.

[0118] Based on the above Figure 2 The method shown, and Figure 5 In order to achieve the above-mentioned purpose, the embodiment of the present application also provides an electronic device, which can be configured on the vehicle side, and the device includes a storage medium and a processor; the storage medium is used to store a computer program; the processor is used to execute the computer program to achieve the above-mentioned Figure 2 The method shown.

[0119] Optionally, the above-mentioned physical device may also include a user interface, a network interface, a camera, a radio frequency (RF) circuit, a sensor, an audio circuit, a WI-FI module, etc. The user interface may include a display, an input unit such as a keyboard, etc., and the optional user interface may also include a USB interface, a card reader interface, etc. The network interface may optionally include a standard wired interface, a wireless interface (such as a WI-FI interface), etc.

[0120] Those skilled in the art will appreciate that the above-mentioned physical device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or a combination of certain components, or different arrangements of components.

[0121] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the above-mentioned physical device, and supports the operation of the information processing program and other software and / or programs. The network communication module is used to realize the communication between the components inside the storage medium, and the communication with other hardware and software in the information processing physical device.

[0122] Based on the contents of the above embodiments, the embodiment of the present application further provides a multimedia resource search system, including: a server and at least one vehicle and a server. Specifically, the server may execute the following Figure 1 The method shown; the vehicle can execute as follows Figure 2 The method described.

[0123] Through the description of the above implementation methods, the technical personnel in this field can clearly understand that the present application can be implemented by means of software plus the necessary general hardware platform, or by hardware. By applying the scheme of this embodiment, compared with the current existing technology, this embodiment can obtain the user's biometric information based on the data in the vehicle cabin to determine the age of the user in the vehicle cabin, and then determine whether there are children in the vehicle cabin. When there are children in the vehicle cabin, multimedia resources related to the search terms can be obtained by category in the resource database according to different search scenarios of multimedia resources, so that the searched resources do not contain resources that are not suitable for children, better protect the physical and mental health of children, and provide more friendly media services. The resource database integrates the resources of multimedia APPs, and the resources of all multimedia APPs can be retrieved in the resource database, which improves the efficiency of media retrieval and improves the user experience.

[0124] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0125] The above is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features applied for herein.

Claims

1. A method for searching multimedia resources, characterized in that: include: Determining search terms for vehicles to search multimedia resources; Acquire biometric information corresponding to each of the in-vehicle users from the in-vehicle user's cabin data sent by the vehicle; analyzing user age information corresponding to the biometric information; Determine the target search scene label information corresponding to the in-vehicle user with the user age information; Obtaining multimedia resource search results corresponding to the search term and at a level corresponding to the target search scenario label information, wherein different search scenario label information respectively corresponds to multimedia resources at different levels, and the multimedia resources at different levels have their own corresponding audience groups; The multimedia resource search result is sent to the vehicle.

2. The method according to claim 1, characterized in that: The different search scene label information at least includes: one or more of: children's search scene label information, adult search scene label information, adult search scene label information with children present, and adult search scene label information without children present; If the target search scene label information is any one of the child search scene label information, the adult agent search scene label information, and the adult search scene label information with the child present, then obtaining the multimedia resource search result corresponding to the search term and at a level corresponding to the target search scene label information includes: Obtaining a first multimedia resource search result corresponding to the search term, wherein the first multimedia resource search result does not include multimedia resources that are prohibited for children; If the target search scene label information is any one of the child search scene label information and the adult search scene label information, then obtaining the multimedia resource search results corresponding to the search term and at a level corresponding to the target search scene label information includes: A second multimedia resource search result corresponding to the search term is obtained, wherein the second multimedia resource search result includes children's multimedia resources.

3. The method according to claim 2, characterized in that The cockpit data includes voice information of the user in the vehicle and / or user image information; The step of obtaining biometric information corresponding to each user in the vehicle from the cabin data of the user in the vehicle sent by the vehicle includes: Recognize the voice information to obtain voiceprint feature information corresponding to each user in the car; and / or, Identify the user image information to obtain facial feature information corresponding to each user in the vehicle; and / or, Identify the user image information to obtain human body feature information corresponding to each user in the vehicle; The analyzing the user age information corresponding to the biometric information includes: Analyze the user age information corresponding to the voiceprint feature information, and / or the facial feature information, and / or the body feature information.

4. The method according to claim 1, characterized in that The step of obtaining multimedia resource search results corresponding to the search term and at a level corresponding to the target search scene label information includes: Based on the search term, obtaining multimedia resource search results of a level corresponding to the target search scene label information from a resource database, wherein the resource database includes multimedia resources corresponding to different multimedia APPs, and the multimedia resource search results include multimedia resource search results corresponding to at least one multimedia APP; The sending the multimedia resource search result to the vehicle includes: The multimedia resource search result corresponding to the at least one multimedia APP and the corresponding multimedia APP identifier are sent to the vehicle.

5. The method according to claim 1, characterized in that The step of determining a search term for a vehicle to search for multimedia resources includes: receiving a search request for multimedia resources sent by the vehicle, wherein the search request carries the search term; or, The voice information sent by the vehicle is received, and the vehicle needs to search for multimedia resources and the search term through the voice information.

6. A method for searching multimedia resources, characterized in that: include: Sending cockpit data of the in-car user to the server, wherein the cockpit data is used to analyze the user age information corresponding to the in-car user to determine the target search scene label information corresponding to the in-car user with the user age information; Receive multimedia resource search results corresponding to the search terms and at a level corresponding to the target search scenario label information sent by the server, wherein different search scenario label information corresponds to multimedia resources of different levels, and the multimedia resources of different levels have their own corresponding audience groups.

7. The method according to claim 6, characterized in that The sending of the cockpit data of the user in the vehicle to the server includes: Sending a multimedia resource search request to the server, wherein the search request carries the cockpit data and the search term; or, The voice information and the cockpit data are sent to the server, wherein the voice information is used to identify that the vehicle needs to search for multimedia resources and the search term.

8. The method according to claim 6, characterized in that The receiving, from the server, a multimedia resource search result corresponding to the search term and at a level corresponding to the target search scene label information, includes: Receive multimedia resource search results corresponding to at least one multimedia APP and a corresponding multimedia APP identifier.

9. The method according to claim 8, characterized in that After receiving the multimedia resource search results corresponding to at least one multimedia APP and the corresponding multimedia APP identifier, the method further includes: Outputting multimedia resource search results corresponding to the at least one multimedia APP; Determine a target multimedia resource selected by a user for playback in the multimedia resource search results; Determine a target multimedia APP identifier of a target multimedia APP to which the target multimedia resource belongs; The target multimedia APP corresponding to the target multimedia APP identifier is called to play the target multimedia resource.

10. A multimedia resource search device, characterized in that: include: A determination module configured to determine a search term for a vehicle to search for multimedia resources; An acquisition module is configured to acquire biometric information corresponding to each user in the vehicle from the cabin data of the user in the vehicle sent by the vehicle; an analysis module configured to analyze user age information corresponding to the biometric information; The determination module is further configured to determine target search scene label information corresponding to the in-vehicle user of the user age information; The acquisition module is further configured to acquire multimedia resource search results corresponding to the search term and at a level corresponding to the target search scenario label information, wherein different search scenario label information respectively corresponds to multimedia resources at different levels, and the multimedia resources at different levels have their own corresponding audience groups; The sending module is configured to send the multimedia resource search result to the vehicle.

11. A multimedia resource search device, characterized in that: include: A sending module is configured to send cockpit data of the in-car user to the server, wherein the cockpit data is used to analyze the user age information corresponding to the in-car user to determine the target search scene label information corresponding to the in-car user with the user age information; The receiving module is configured to receive multimedia resource search results corresponding to the search terms and at a level corresponding to the target search scene label information sent by the server, wherein different search scene label information corresponds to multimedia resources of different levels, and the multimedia resources of different levels have their own corresponding audience groups.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

13. An electronic device comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 9 is implemented.