Multimedia content recommendation method and device, equipment and storage medium

Abstract

The invention discloses a multimedia content recommendation method and device, equipment and a storage medium, and belongs to the field of multimedia content recommendation. The method comprises the steps that behavior information of a to-be-recommended object in an indoor space and environment information corresponding to the indoor space are acquired, and the behavior information is used for reflecting behaviors of the to-be-recommended object in the indoor space; determining recommended multimedia content corresponding to the to-be-recommended object according to the behavior information of the to-be-recommended object and the environment information corresponding to the indoor space; and sending the recommended multimedia content to a multimedia device, wherein the multimedia device is used for playing the recommended multimedia content. Multimedia content recommendation is performed on the to-be-recommended object in the indoor space by referring to multi-dimensional factors, so that the accuracy of multimedia content recommendation in an indoor space scene can be improved.

Description

Technical Field

[0001] The present application relates to the field of multimedia content recommendation, and in particular to a method, device, equipment and storage medium for recommending multimedia content. Background Art

[0002] By using a client that supports multimedia content, users can play multimedia content on demand, such as playing songs to meet their emotional needs.

[0003] In the related art, the server corresponding to the client usually analyzes the user's preferences and actively recommends multimedia content that the user may be interested in, so as to improve the user's experience in the process of playing multimedia content. For example, the server obtains the historical multimedia content played by the user in the past, determines similar multimedia content similar to the historical multimedia content, and recommends the similar multimedia content to the user.

[0004] In the above-mentioned method, multimedia content is recommended to the user, but only the multimedia content played by the user in the past is referred to, so there is a problem of low accuracy in recommending multimedia content. Summary of the invention

[0005] The present application provides a method, device, equipment and storage medium for recommending multimedia content, which can improve the accuracy of recommending multimedia content. The technical solution is as follows:

[0006] According to one aspect of the present application, a method for recommending multimedia content is provided, the method comprising:

[0007] Acquire behavior information of a to-be-recommended object in an indoor space and environment information corresponding to the indoor space, wherein the behavior information is used to reflect the behavior of the to-be-recommended object in the indoor space;

[0008] Determining recommended multimedia content corresponding to the object to be recommended according to the behavior information of the object to be recommended and the environmental information corresponding to the indoor space;

[0009] The recommended multimedia content is sent to a multimedia device, and the multimedia device is used to play the recommended multimedia content.

[0010] According to another aspect of the present application, a multimedia content recommendation device is provided, the device comprising:

[0011] An acquisition module, used to acquire behavior information of an object to be recommended in an indoor space and environment information corresponding to the indoor space, wherein the behavior information is used to reflect the behavior of the object to be recommended in the indoor space;

[0012] A determination module, configured to determine the recommended multimedia content corresponding to the object to be recommended according to the behavior information of the object to be recommended and the environment information corresponding to the indoor space;

[0013] The sending module is used to send the recommended multimedia content to a multimedia device, and the multimedia device is used to play the recommended multimedia content.

[0014] In an optional design, the determining module is used to:

[0015] Determining a first multimedia content set in a multimedia content library according to the behavior information;

[0016] The recommended multimedia content is determined in the first multimedia content set according to the environmental information.

[0017] In an optional design, the multimedia content in the multimedia content library corresponds to a preset behavior tag; the determination module is used to:

[0018] Determining multimedia content having a first behavior tag in the multimedia content library according to the behavior type corresponding to the behavior information, and obtaining the first multimedia content set;

[0019] The first behavior tag includes a behavior tag that has a corresponding relationship with the behavior type.

[0020] In an optional design, the multimedia content in the multimedia content library corresponds to a preset temperature tag, and the environmental information includes temperature information; and the determination module is used to:

[0021] In a case where the temperature indicated by the temperature information exceeds a temperature threshold, determining the multimedia content with a first temperature tag in the first multimedia content set as the recommended multimedia content;

[0022] In a case where the temperature indicated by the temperature information does not exceed the temperature threshold, determining the multimedia content with the second temperature tag in the first multimedia content set as the recommended multimedia content;

[0023] The first temperature label and the second temperature label are different labels among the temperature labels.

[0024] In an optional design, the multimedia content in the multimedia content library corresponds to a preset humidity tag, and the environmental information includes humidity information; the determination module is used to:

[0025] In a case where the humidity indicated by the humidity information exceeds a humidity threshold, determining the multimedia content with the first humidity tag in the first multimedia content set as the recommended multimedia content;

[0026] In a case where the humidity indicated by the humidity information does not exceed the humidity threshold, determining the multimedia content with the second humidity tag in the first multimedia content set as the recommended multimedia content;

[0027] The first humidity tag and the second humidity tag are different tags among the humidity tags.

[0028] In an optional design, the multimedia content in the multimedia content library corresponds to a preset temperature and humidity tag, and the environmental information includes temperature information and humidity information; the determination module is used to:

[0029] When the temperature indicated by the temperature information exceeds a temperature threshold and the humidity indicated by the humidity information exceeds a humidity threshold, determining the multimedia content with the first temperature and humidity tag in the first multimedia content set as the recommended multimedia content;

[0030] When the temperature indicated by the temperature information exceeds the temperature threshold or the humidity indicated by the humidity information exceeds the humidity threshold, determining the multimedia content with the second temperature and humidity label in the first multimedia content set as the recommended multimedia content;

[0031] When the temperature indicated by the temperature information does not exceed the temperature threshold and the humidity indicated by the humidity information does not exceed the humidity threshold, determining the multimedia content with the third temperature and humidity tag in the first multimedia content set as the recommended multimedia content;

[0032] Among them, the first temperature and humidity tag, the second temperature and humidity tag, and the third temperature and humidity tag are different tags among the temperature and humidity tags.

[0033] In an optional design, the determining module is used to:

[0034] Determining a second multimedia content set in a multimedia content library according to the environmental information;

[0035] The recommended multimedia content is determined in the second multimedia content set according to the behavior information.

[0036] In an optional design, the device further includes:

[0037] The acquisition module is used to acquire a captured image corresponding to the indoor space, where the captured image is collected by a camera in the indoor space;

[0038] The recognition module is used to obtain the behavior information of the object to be recommended by recognizing the captured image.

[0039] In an optional design, the environmental information includes noise detection information corresponding to the indoor space, and the noise detection information is collected by a microphone in the indoor space; the sending module is used to:

[0040] When the volume of the ambient noise indicated by the noise detection information is greater than a volume threshold, sending at least one of a noise reduction audio and a noise reduction song to the multimedia device;

[0041] The noise reduction audio includes audio for offsetting the ambient noise, and the noise reduction songs include songs whose similarity to the white noise is greater than a similarity threshold.

[0042] According to another aspect of the present application, a computer device is provided, comprising a processor and a memory, wherein the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the multimedia content recommendation method as described above.

[0043] According to another aspect of the present application, a computer-readable storage medium is provided, wherein at least one program is stored in the computer-readable storage medium, and the at least one program is loaded and executed by a processor to implement the multimedia content recommendation method as described above.

[0044] According to another aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program including computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the multimedia content recommendation method provided in various optional implementations of the above aspects.

[0045] The beneficial effects of the technical solution provided by this application include at least:

[0046] By determining the multimedia content recommended to the object to be recommended in the indoor space based on the behavior information of the object to be recommended in the indoor space and the corresponding environmental information of the indoor space, it is possible to simultaneously refer to the behavior of the object to be recommended and the environment in which the object to be recommended is located to recommend multimedia content to the object to be recommended. By referring to multi-dimensional factors to recommend multimedia content to the object to be recommended in the indoor space, the accuracy of multimedia content recommendation in the indoor space scene can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0048] Figure 1 is a structural block diagram of a computer system provided by an exemplary embodiment of the present application;

[0049] Figure 2 is a schematic diagram of a process of recommending multimedia content provided by an exemplary embodiment of the present application;

[0050] Figure 3 is a flowchart of a method for recommending multimedia content provided by an exemplary embodiment of the present application;

[0051] Figure 4 is a flowchart of a method for recommending multimedia content provided by an exemplary embodiment of the present application;

[0052] Figure 5 is a schematic diagram of a process of determining a first multimedia content set provided by an exemplary embodiment of the present application;

[0053] Figure 6 is a schematic diagram of a process of determining recommended multimedia content provided by an exemplary embodiment of the present application;

[0054] Figure 7 is a schematic diagram of a process of determining a recommended song provided by an exemplary embodiment of the present application;

[0055] Figure 8 is a structural schematic diagram of a multimedia content recommendation device provided by an exemplary embodiment of the present application;

[0056] Fig. 9 is a structural schematic diagram of a multimedia content recommendation device provided by an exemplary embodiment of the present application;

[0057] Fig.10 It is a structural diagram of a computer device provided by an exemplary embodiment of the present application.

[0058] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application. DETAILED DESCRIPTION

[0059] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0060] Figure 1 The computer system 100 includes a terminal 110 and a server 120 .

[0061] The terminal 110 is installed and runs an application 111 that supports the recommendation of multimedia content, and the multimedia content includes at least one of audio, video, picture and text. The application 111 includes any one of a listening application, a song application, a singing application, a live application, a short video application, a video on demand application, a social application, an office application, a game application, a takeaway application, an online shopping application, a financial application, a life service application, a navigation application, a medical application, a learning application and a mini program. In some embodiments, the application 111 is a client. When the terminal 110 runs the application 111, the user interface of the application 111 is displayed on the screen of the terminal 110. The terminal 110 is a terminal used by the user 112, and the user account of the user 112 can be logged in to the application 111. The terminal 110 can generally refer to one of a plurality of terminals. Optionally, the device type of the terminal 110 includes at least one of a smart phone, a tablet computer, a smart watch, an e-book reader, an MP3 player, an MP4 player, and a laptop computer.

[0062] The terminal 110 is connected to the server 120 via a wireless network or a wired network.

[0063] The server 120 includes at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. The server 120 is used to provide background services for the application 111 that supports the recommendation of multimedia content. Optionally, the server 120 undertakes the main computing work and the terminal 110 undertakes the secondary computing work; or, the server 120 undertakes the secondary computing work and the terminal 110 undertakes the main computing work; or, the server 120 and the terminal 110 adopt a distributed computing architecture for collaborative computing.

[0064] In an illustrative example, the server 120 includes a processor 121, a user account database 122, a content recommendation module 123, and a user-oriented input / output interface (I / O interface) 124. The processor 121 is used to load instructions stored in the server 120 and process data in the user account database 122 and the content recommendation module 123; the user account database 122 is used to store data of user accounts used by the terminal 110 and other terminals, such as the user account's avatar, the user account's nickname, the group to which the user account belongs, etc.; the content recommendation module 123 is used to determine multimedia content recommended to the user; and the user-oriented I / O interface 124 is used to establish communication and exchange data with the terminal 110 through a wireless network or a wired network.

[0065] In combination with the above introduction to the implementation environment involved in the present application, the method provided in the embodiment of the present application will be described below.

[0066] Figure 2 FIG. 1 is a schematic diagram of a process of recommending multimedia content provided by an exemplary embodiment of the present application. Figure 2 As shown, the server obtains the behavior information 203 of the object to be recommended 202 in the indoor space 201, and the environmental information 204 corresponding to the indoor space 201. The object to be recommended 202 includes at least one of a person and a pet located in the indoor space 201, such as a baby in the indoor space 201. The behavior information 203 is used to reflect the behavior of the object to be recommended 202 in the indoor space 201, such as the behavior type of the behavior of the object to be recommended 202. The environmental information 204 is used to reflect the environment of the indoor space 201, such as at least one of the temperature of the indoor space 201 and the humidity of the indoor space 201. In some embodiments, a camera 205 is provided in the indoor space 201, and the server obtains the image captured by the camera 205 of the indoor space 201, and obtains the behavior information 203 of the object to be recommended 202 by identifying the captured image. In some embodiments, an environmental sensor 206, such as a temperature and humidity sensor, is provided in the indoor space 201, and the server obtains the environmental information 204 corresponding to the indoor space 201 through the environmental sensor 206.

[0067] After obtaining the behavior information 203 of the object to be recommended 202 and the environment information 204 corresponding to the indoor space 201, the server determines the first multimedia content set in the multimedia content library according to the behavior information 203, and determines the recommended multimedia content 207 in the first multimedia content set according to the environment information 204. In some embodiments, the server screens the multimedia content in the multimedia content library according to the pre-set tags corresponding to the multimedia content in the multimedia content library according to the behavior type corresponding to the behavior information 203, thereby obtaining the first multimedia content set. Then, according to the environment information 204, the multimedia content in the first multimedia content set is screened again according to the tags corresponding to the multimedia content in the first multimedia content set, thereby obtaining the recommended multimedia content 207. In some embodiments, the recommended multimedia content 207 is a recommended song. It should be noted that, for the process of first determining the second multimedia content set in the multimedia content library based on the environmental information 204, and then determining the recommended multimedia content 207 in the second multimedia content set based on the behavior information 203, as well as the process of determining the recommended multimedia content 207 in the multimedia content library based on the behavior information 203 and the environmental information 204 at the same time, reference can be made to the above introduction to the process of first determining the first multimedia content set and then determining the recommended multimedia content 207, and the embodiments of the present application will not be described in detail here.

[0068] After obtaining the recommended multimedia content 207, the server sends the recommended multimedia content 207 to the multimedia device 207, and the multimedia device 207 has a client corresponding to the server installed therein. After receiving the recommended multimedia content 207 through the client, the multimedia device 207 plays the recommended multimedia content 207 through the client. In some embodiments, the multimedia device 207 may be located in the indoor space 201 or outside the indoor space 201. The multimedia device 207 may be a terminal, for example, including at least one of a mobile phone, a tablet computer, a smart watch, an e-book reader, an MP3 player, an MP4 player, a laptop computer, and a smart speaker.

[0069] By determining the multimedia content recommended to the object to be recommended in the indoor space based on the behavior information of the object to be recommended in the indoor space and the corresponding environmental information of the indoor space, it is possible to simultaneously refer to the behavior of the object to be recommended and the environment in which the object to be recommended is located to recommend multimedia content to the object to be recommended. By referring to multi-dimensional factors to recommend multimedia content to the object to be recommended in the indoor space, the accuracy of multimedia content recommendation in the indoor space scene can be improved.

[0070] Figure 3 FIG. 1 is a flowchart of a method for recommending multimedia content provided by an exemplary embodiment of the present application. The method can be used in a computer device, such as a server deployed in a server. Figure 3 As shown, the method includes:

[0071] Step 302: Obtain behavior information of the object to be recommended in the indoor space and environment information corresponding to the indoor space.

[0072] The indoor space includes at least one of a closed space and a semi-enclosed space. In some embodiments, the indoor space includes a family room, for example, at least one of a living room, a dining room, a bedroom, and a study. The objects to be recommended include objects located in the indoor space, and the objects to be recommended include at least one of a person and a pet, for example, a baby in the indoor space. The objects to be recommended are objects waiting for multimedia content recommendation, and the multimedia content in the embodiments of the present application includes at least one of audio, video, picture, and text, for example, the multimedia content is a song.

[0073] The behavior information of the object to be recommended is used to reflect the behavior of the object to be recommended in the indoor space. For example, the behavior information is used to indicate the behavior type of the object to be recommended in the indoor space. Exemplarily, the behavior of the object to be recommended in the indoor space includes at least one of standing, sitting, lying flat, lying on the side, lying prone, walking, brisk walking, running, dancing, aerobics, yoga, reading, working, sleeping, playing with mobile phones, playing games, being in a daze, crawling, and crying. In some embodiments, a camera is provided in the indoor space, and the camera is used to collect the captured images corresponding to the indoor space, and the behavior information of the object to be recommended is obtained by identifying the captured images.

[0074] The environmental information corresponding to the indoor space is used to reflect the environment of the indoor space. In some embodiments, the environmental information corresponding to the indoor space includes at least one of temperature information, humidity information, air pressure information, air quality information, altitude information, and illumination information. The temperature information is used to indicate the temperature of the indoor space, the humidity information is used to indicate the humidity of the indoor space, the air pressure information is used to indicate the air pressure of the indoor space, the air quality information is used to indicate the air quality of the indoor space, the altitude information is used to indicate the altitude corresponding to the indoor space, and the illumination information is used to indicate the illumination intensity in the indoor space. In some embodiments, a temperature sensor is provided in the indoor space, and the temperature information is collected by the temperature sensor. A humidity sensor is provided in the indoor space, and the humidity information is collected by the humidity sensor. A pressure sensor is provided in the indoor space, and the pressure information is collected by the pressure sensor. An air quality sensor is provided in the indoor space, and the air quality information is collected by the air quality sensor. An air quality sensor is provided in the indoor space, and the air quality information is collected by the air quality sensor. A pressure sensor and / or a positioning sensor are provided in the indoor space, and the altitude information is collected by the pressure sensor or the positioning sensor. A light sensor is provided in the indoor space, and the light information is collected by the light sensor. In some embodiments, the temperature sensor and the humidity sensor are integrated into the temperature and humidity sensor, or the temperature sensor and the humidity sensor are separately provided sensors.

[0075] The above-mentioned sensors for collecting behavioral information and environmental information, such as cameras, temperature sensors, humidity sensors, etc., can be collectively referred to as information collection sensors. Optionally, a direct communication connection is established between the information collection sensor and the server, or a communication connection is established between the information collection sensor and the client corresponding to the server, and the information collection sensor establishes a communication connection with the server through the client. In some embodiments, when the device where the client is located is located in an indoor space, the information collection sensor may be a sensor integrated in the device where the client is located, such as a camera, a positioning module, an air pressure sensor, etc. in the device where the client is located. The information collection sensor may also be a sensor independently set in the indoor space.

[0076] The client is used to provide multimedia content, and the multimedia content provided by the client includes at least one of the multimedia content sent by the server to the client and the multimedia content stored in the client. The multimedia content in the embodiment of the present application includes at least one of audio, video, picture and text, such as songs. In some embodiments, the client in the embodiment of the present application includes any one of a listening client, a song client, a singing client, a live client, a short video client, a video on demand client, a social client, an office client, a game client, a takeaway client, an online shopping client, a financial client, a life service client, a navigation client, a medical client, a learning client and a mini program. The client establishes a communication connection with the server, and the server is used to provide multimedia content to the client.

[0077] Step 304: Determine the recommended multimedia content corresponding to the object to be recommended according to the behavior information of the object to be recommended and the environment information corresponding to the indoor space.

[0078] The recommended multimedia content corresponding to the object to be recommended is multimedia content recommended to the object to be recommended. The recommended multimedia content includes at least one of audio, video, picture and text recommended to the object to be recommended, such as a recommended song recommended to the object to be recommended.

[0079] In some embodiments, a multimedia content library is provided in the server, and the multimedia content library includes a plurality of multimedia contents. Each multimedia content in the multimedia content library corresponds to a pre-set label, and different labels have a corresponding relationship with different behavior information and different environmental information. Optionally, the label corresponding to each multimedia content in the multimedia content library, and the corresponding relationship between different labels and different behavior information and different environmental information are set by the operation and maintenance personnel. Based on the behavior information and environmental information, the server can determine in the multimedia content library the candidate multimedia content whose label has a corresponding relationship with the acquired behavior information and environmental information, thereby determining the recommended multimedia content based on the candidate multimedia content screened by the label. For example, the server screens the multimedia content in the multimedia content library according to the label based on the behavior information and environmental information, and obtains n candidate multimedia content, and then randomly determines the recommended multimedia content from the n candidate multimedia content, where n is a positive integer.

[0080] Optionally, in the process of determining the recommended multimedia content corresponding to the object to be recommended, the server first determines a first multimedia content set based on the behavior information of the object to be recommended, the first multimedia content set includes one or more multimedia content, and then screens out candidate multimedia content from the first multimedia content set based on the environmental information, thereby determining the recommended multimedia content based on the candidate multimedia content. Alternatively, the server first determines a second multimedia content set based on the environmental information corresponding to the indoor space, the second multimedia content set includes one or more multimedia content, and then screens out candidate multimedia content from the second multimedia content set based on the behavior information, thereby determining the recommended multimedia content based on the candidate multimedia content. Alternatively, the server determines candidate multimedia content based on both the behavior information of the object to be recommended and the environmental information corresponding to the indoor space, thereby determining the recommended multimedia content based on the candidate multimedia content.

[0081] Step 306: Send the recommended multimedia content to the multimedia device.

[0082] The multimedia device is used to play the recommended multimedia content. The multimedia device includes a device that supports playing multimedia content, and a client corresponding to the server is installed in the multimedia device. The multimedia device receives the recommended multimedia content sent by the server through the client. Optionally, the multimedia device is located in an indoor space, or the multimedia device is located outside the indoor space, which is not limited in the embodiments of the present application. In some embodiments, the multimedia device is a terminal, and the terminal includes at least one of a mobile phone, a tablet computer, a smart watch, an e-book reader, an MP3 player, an MP4 player, a laptop computer, and a smart speaker.

[0083] The recommended multimedia content includes at least one of audio, video, picture and text recommended to the recommended object. When the recommended multimedia content is audio, playing the recommended multimedia content can be understood as playing the sound of the audio. When the recommended multimedia content is video, playing the recommended multimedia content can be understood as displaying the video screen and playing the sound of the video. When the recommended multimedia content is a picture, playing the recommended multimedia content can be understood as displaying the picture screen. When the recommended multimedia content is text, playing the recommended multimedia content can be understood as displaying the text screen.

[0084] In some embodiments, when the multimedia device receives the recommended multimedia content, the client in the multimedia device automatically plays the recommended multimedia content. In some embodiments, when the multimedia device receives the recommended multimedia content, the client in the multimedia device displays the recommended multimedia content in the user interface, and when receiving a play operation for the recommended multimedia content, the client in the multimedia device plays the recommended multimedia content.

[0085] It should be noted that the method provided in the embodiment of the present application is introduced by taking the collaborative implementation of the server and the client as an example. It is understandable that the method provided in the embodiment of the present application can also be implemented independently by the client.

[0086] In summary, the method provided in this embodiment determines the multimedia content recommended to the object to be recommended in the indoor space according to the behavior information of the object to be recommended in the indoor space and the environmental information corresponding to the indoor space, and can simultaneously refer to the behavior of the object to be recommended and the environment in which the object to be recommended is located to recommend multimedia content to the object to be recommended. By referring to multi-dimensional factors to recommend multimedia content to the object to be recommended in the indoor space, the accuracy of multimedia content recommendation in the indoor space scene can be improved.

[0087] Figure 4 FIG. 1 is a flowchart of a method for recommending multimedia content provided by an exemplary embodiment of the present application. The method can be used in a computer device, such as a server deployed in a server. Figure 4 As shown, the method includes:

[0088] Step 402: Obtain behavior information of the object to be recommended in the indoor space and environment information corresponding to the indoor space.

[0089] The indoor space includes at least one of a closed space and a semi-enclosed space. In some embodiments, the indoor space includes a family room, for example, at least one of a living room, a dining room, a bedroom, and a study. The objects to be recommended include objects located in the indoor space, and the objects to be recommended include at least one of a person and a pet, for example, a baby in the indoor space. The objects to be recommended are objects waiting for multimedia content recommendation, and the multimedia content in the embodiments of the present application includes at least one of audio, video, picture, and text, for example, the multimedia content is a song.

[0090] The behavior information of the object to be recommended is used to reflect the behavior of the object to be recommended in the indoor space. For example, the behavior information is used to indicate the behavior type of the object to be recommended in the indoor space. Exemplarily, the behavior of the object to be recommended in the indoor space includes at least one of standing, sitting, lying flat, lying on the side, lying prone, walking, walking fast, running, dancing, doing aerobics, yoga, reading, working, sleeping, playing with mobile phones, playing games, being in a daze, crawling, and crying.

[0091] In some embodiments, a camera is provided in the indoor space, and the server obtains captured images corresponding to the indoor space, and the captured images are collected by the camera in the indoor space. By identifying the captured images, the server can obtain the behavior information of the object to be recommended. Optionally, the server identifies the captured images through an artificial intelligence (AI) model to obtain the behavior information of the object to be recommended. The AI ​​model can be a behavior recognition model built based on convolutional neural networks (CNN). The behavior recognition model is obtained by training sample images corresponding to different sample objects under different behaviors, and behavior labels corresponding to the sample images. The behavior labels are used to indicate the behavior of the sample objects in the sample images.

[0092] In some embodiments, the server will identify the captured image to determine the behavior information of the object to be recommended only when the server determines that there is an object to be recommended in the captured image. Optionally, the server identifies the captured image through an AI model to determine whether there is an object to be recommended in the captured image. The AI ​​model can be an object recognition model built based on CNN. The object recognition model is trained with training images corresponding to the object to be recommended. The training images are images including the object to be recommended. The training images can be uploaded by the client corresponding to the server. Optionally, through the object recognition model, the server can determine the target area in the captured image where the object to be recommended exists, thereby cutting out the target area in the captured image, and then inputting the image corresponding to the target area into the behavior recognition model, thereby determining the behavior information of the object to be recommended based on the image corresponding to the target area through the behavior recognition model.

[0093] Optionally, a direct communication connection is established between the camera and the server, or a communication connection is established between the camera and a client corresponding to the server, and the camera establishes a communication connection with the server through the client. In some embodiments, when the device where the client is located is located in an indoor space, the camera can be a camera integrated in the device where the client is located, or the camera can be a camera independently set in the indoor space.

[0094] The environmental information corresponding to the indoor space is used to reflect the environment of the indoor space. In some embodiments, the environmental information corresponding to the indoor space includes at least one of temperature information, humidity information, air pressure information, air quality information, altitude information, and lighting information. The temperature information is used to indicate the temperature of the indoor space, the humidity information is used to indicate the humidity of the indoor space, the air pressure information is used to indicate the air pressure of the indoor space, the air quality information is used to indicate the air quality of the indoor space, the altitude information is used to indicate the altitude corresponding to the indoor space, and the lighting information is used to indicate the light intensity in the indoor space.

[0095] It should be noted that the embodiments of the present application are mainly introduced by taking the environmental information including temperature information, the environmental information including humidity information, and the environmental information including temperature information and humidity information as examples. It is understandable that when the environmental information includes the above information other than temperature information and humidity information, the method provided in the embodiments of the present application is also applicable.

[0096] In some embodiments, when the environmental information includes temperature information, a temperature sensor is provided in the indoor space, and the temperature information is collected by the temperature sensor. When the environmental information includes humidity information, a humidity sensor is provided in the indoor space, and the humidity information is collected by the humidity sensor. When the environmental information includes temperature information and humidity information, a temperature sensor and a humidity sensor are provided in the indoor space, and the temperature information is collected by the temperature sensor, and the humidity information is collected by the humidity sensor. In some embodiments, the temperature sensor and humidity sensor are integrated in the temperature and humidity sensor, or the temperature sensor and humidity sensor are separately provided sensors.

[0097] Optionally, a direct communication connection is established between the temperature sensor and the humidity sensor and the server, or a communication connection is established between the temperature sensor and the humidity sensor and the client corresponding to the server, and the temperature sensor and the humidity sensor establish a communication connection with the server through the client. In some embodiments, when the device where the client is located is located in an indoor space, the temperature sensor and the humidity sensor may be sensors integrated in the device where the client is located, or the temperature sensor and the humidity sensor may be sensors independently set in the indoor space.

[0098] Step 404: Determine a first multimedia content set in the multimedia content library according to the behavior information.

[0099] A multimedia content library is provided in the server, and the multimedia content library includes multiple multimedia contents, and the first multimedia content set includes one or more multimedia contents. In some embodiments, the multimedia contents in the multimedia content library correspond to pre-set behavior tags. Optionally, the behavior tag corresponding to each multimedia content in the multimedia content library is set by the operation and maintenance personnel. In the process of determining the first multimedia content set, the server determines the multimedia content with the first behavior tag in the multimedia content library according to the behavior type corresponding to the behavior information, thereby obtaining the first multimedia content set. The first behavior tag includes a behavior tag that has a corresponding relationship with the behavior type corresponding to the acquired behavior information. Optionally, the correspondence between different behavior tags in the multimedia content library and different behavior information / behavior types is set by the operation and maintenance personnel.

[0100] For example, Figure 5FIG. 1 is a schematic diagram of a process of determining a first multimedia content set provided by an exemplary embodiment of the present application. Figure 5 As shown, taking the multimedia content as songs as an example, the song library 501 includes song 1, song 2, song 3, song 4, song 5 and song 6. Song 1 has behavior label 1, song 2 has behavior label 2, song 3 has behavior label 3, song 4 has behavior label 1, song 5 has behavior label 2, and song 6 has behavior label 4. Among them, behavior label 1 corresponds to crawling, behavior label 2 corresponds to standing, behavior label 3 corresponds to lying flat, and behavior label 4 corresponds to lying prone. The behavior information 502 obtained by the server indicates that the behavior of the object to be recommended is crawling. Since crawling corresponds to behavior label 1, the server will determine the first song set 503 based on the songs with behavior label 1, that is, song 1 and song 4.

[0101] Step 406: Determine recommended multimedia content in the first multimedia content set according to the environmental information.

[0102] The recommended multimedia content is multimedia content recommended to the object to be recommended. The recommended multimedia content includes at least one of audio, video, picture and text recommended to the object to be recommended, such as a recommended song recommended to the object to be recommended.

[0103] For the case where the environmental information includes temperature information: In some embodiments, the multimedia content in the multimedia content library corresponds to a pre-set temperature tag. Optionally, the temperature tag corresponding to each multimedia content in the multimedia content library is set by the operation and maintenance personnel. In the process of determining the recommended multimedia content, when the temperature indicated by the temperature information exceeds the temperature threshold, the server will determine the multimedia content with the first temperature tag in the first multimedia content set as the recommended multimedia content; when the temperature indicated by the temperature information does not exceed the temperature threshold, the server will determine the multimedia content with the second temperature tag in the first multimedia content set as the recommended multimedia content. The first temperature tag and the second temperature tag are different tags in the temperature tag. Optionally, the correspondence between different temperature tags and different temperature information in the multimedia content library is set by the operation and maintenance personnel, for example, the correspondence between the temperature information exceeding the temperature threshold and the first temperature tag, and the correspondence between the temperature information not exceeding the temperature threshold and the second temperature tag is set by the operation and maintenance personnel. In some embodiments, the temperature threshold is set based on the suitable survival temperature of the object to be recommended, which can be set by the operation and maintenance personnel or by the server corresponding to the client. The temperature indicated by the temperature information exceeding the temperature threshold means being higher than the temperature threshold or lower than the temperature threshold.

[0104] Optionally, the temperature threshold includes a first temperature threshold and a second temperature threshold, the first temperature threshold is higher than the second temperature threshold, for example, the first temperature threshold is 24°C, the second temperature threshold is 18°C, and the temperature exceeding the temperature threshold includes at least one of being higher than the first temperature threshold and lower than the second temperature threshold. In some embodiments, the first temperature tag includes at least one of a first sub-temperature tag and a second sub-temperature tag, the first sub-temperature tag corresponds to a situation higher than the first temperature threshold, and the second sub-temperature tag corresponds to a situation lower than the second temperature threshold. When the temperature indicated by the temperature information is higher than the first temperature threshold, the server will determine the multimedia content with the first sub-temperature tag in the first multimedia content set as the recommended multimedia content; when the temperature indicated by the temperature information is lower than the second temperature threshold, the server will determine the multimedia content with the second sub-temperature tag in the first multimedia content set as the recommended multimedia content.

[0105] For the case where the environmental information includes humidity information: In some embodiments, the multimedia content in the multimedia content library corresponds to a pre-set humidity tag. Optionally, the humidity tag corresponding to each multimedia content in the multimedia content library is set by the operation and maintenance personnel. In the process of determining the recommended multimedia content, when the humidity indicated by the humidity information exceeds the humidity threshold, the server will determine the multimedia content with the first humidity tag in the first multimedia content set as the recommended multimedia content; when the humidity indicated by the humidity information does not exceed the humidity threshold, the server will determine the multimedia content with the second humidity tag in the first multimedia content set as the recommended multimedia content. The first humidity tag and the second humidity tag are different tags in the humidity tag. Optionally, the correspondence between different humidity tags and different humidity information in the multimedia content library is set by the operation and maintenance personnel, for example, the correspondence between the humidity information exceeding the humidity threshold and the first humidity tag, and the correspondence between the humidity information not exceeding the humidity threshold and the second humidity tag is set by the operation and maintenance personnel. In some embodiments, the humidity threshold is set based on the suitable living humidity of the object to be recommended, which can be set by the operation and maintenance personnel or by the server corresponding to the client. The humidity indicated by the humidity information exceeding the humidity threshold means being higher than the humidity threshold or lower than the humidity threshold.

[0106] Optionally, the humidity threshold includes a first humidity threshold and a second humidity threshold, the first humidity threshold is higher than the second humidity threshold, for example, the first humidity threshold is 60%, the second humidity threshold is 40%, and the humidity exceeding the humidity threshold includes at least one of being higher than the first humidity threshold and lower than the second humidity threshold. In some embodiments, the first humidity tag includes at least one of a first sub-humidity tag and a second sub-humidity tag, the first sub-humidity tag corresponds to a situation higher than the first humidity threshold, and the second sub-humidity tag corresponds to a situation lower than the second humidity threshold. In the case where the humidity indicated by the humidity information is higher than the first humidity threshold, the server will determine the multimedia content with the first sub-humidity tag in the first multimedia content set as the recommended multimedia content; in the case where the humidity indicated by the humidity information is lower than the second humidity threshold, the server will determine the multimedia content with the second sub-humidity tag in the first multimedia content set as the recommended multimedia content.

[0107] For the case where the environmental information includes temperature information and humidity information: In some embodiments, the multimedia content in the multimedia content library corresponds to a pre-set temperature and humidity tag. Optionally, the temperature and humidity tags corresponding to each multimedia content in the multimedia content library are set by the operation and maintenance personnel. In the process of determining the recommended multimedia content, when the temperature indicated by the temperature information exceeds the temperature threshold and the humidity indicated by the humidity information exceeds the humidity threshold, the server will determine the multimedia content with the first temperature and humidity tag in the first multimedia content set as the recommended multimedia content; when the temperature indicated by the temperature information exceeds the temperature threshold or the humidity indicated by the humidity information exceeds the humidity threshold, the server will determine the multimedia content with the second temperature and humidity tag in the first multimedia content set as the recommended multimedia content; when the temperature indicated by the temperature information does not exceed the temperature threshold and the humidity indicated by the humidity information does not exceed the humidity threshold, the server will determine the multimedia content with the third temperature and humidity tag in the first multimedia content set as the recommended multimedia content. The first temperature and humidity tag, the second temperature and humidity tag, and the third temperature and humidity tag are different tags in the temperature and humidity tags. Optionally, the correspondence between different temperature and humidity tags in the multimedia content library and different temperature information and different humidity information is set by the operation and maintenance personnel, for example, the correspondence between the temperature information exceeding the temperature threshold and the humidity information exceeding the humidity threshold and the first temperature and humidity tag, and the correspondence between the temperature information exceeding the temperature threshold or the humidity information exceeding the humidity threshold and the second temperature and humidity tag, and the correspondence between the temperature information not exceeding the temperature threshold and the humidity information not exceeding the humidity threshold and the third temperature and humidity tag is set by the operation and maintenance personnel. In some embodiments, the temperature threshold is set based on the suitable survival temperature of the object to be recommended, and the humidity threshold is set based on the suitable survival humidity of the object to be recommended. The temperature threshold and the humidity threshold can be set by the operation and maintenance personnel, or can be set by the server corresponding to the client. The temperature indicated by the temperature information exceeding the temperature threshold means being higher than the temperature threshold or lower than the temperature threshold, and the humidity indicated by the humidity information exceeding the humidity threshold means being higher than the humidity threshold or lower than the humidity threshold.

[0108] Optionally, the temperature threshold includes a first temperature threshold and a second temperature threshold, the first temperature threshold is higher than the second temperature threshold, and the temperature exceeding the temperature threshold includes at least one of being higher than the first temperature threshold and lower than the second temperature threshold. The humidity threshold includes a first humidity threshold and a second humidity threshold, the first humidity threshold is higher than the second humidity threshold, and the humidity exceeding the humidity threshold includes at least one of being higher than the first humidity threshold and lower than the second humidity threshold. In some embodiments, the first temperature and humidity tag includes at least one of a first sub-temperature and humidity tag, a second sub-temperature and humidity tag, a third sub-temperature and humidity tag, and a fourth sub-temperature and humidity tag, the first sub-temperature and humidity tag corresponds to a situation higher than the first temperature threshold and higher than the first humidity threshold, the second sub-temperature and humidity tag corresponds to a situation higher than the first temperature threshold and lower than the second humidity threshold, the third sub-temperature and humidity tag corresponds to a situation lower than the second temperature threshold and higher than the first humidity threshold, and the fourth sub-temperature and humidity tag corresponds to a situation lower than the second temperature threshold and lower than the second humidity threshold. The second temperature and humidity tag includes at least one of a fifth sub-temperature and humidity tag, a sixth sub-temperature and humidity tag, a seventh sub-temperature and humidity tag, and an eighth sub-temperature and humidity tag. The fifth sub-temperature and humidity tag corresponds to a situation higher than the first temperature threshold, the sixth sub-temperature and humidity tag corresponds to a situation lower than the second temperature threshold, the seventh sub-temperature and humidity tag corresponds to a situation higher than the first humidity threshold, and the eighth sub-temperature and humidity tag corresponds to a situation lower than the second humidity threshold.

[0109] For example, Figure 6 FIG. 1 is a schematic diagram of a process for determining recommended multimedia content provided by an exemplary embodiment of the present application. Figure 6 As shown, taking the multimedia content as songs as an example, the first song set 601 determined by the server according to the behavior information includes song 1, song 2, song 3, song 4, song 6 and song 6, song 1 has temperature and humidity label 1, song 2 has temperature and humidity label 2, song 3 has temperature and humidity label 1, song 4 has temperature and humidity label 2, song 5 has temperature and humidity label 3, and song 6 has temperature and humidity label 4. Among them, temperature and humidity label 1 corresponds to the situation where the temperature is greater than the first temperature threshold and the humidity is greater than the first humidity threshold, temperature and humidity label 2 corresponds to the situation where the temperature is greater than the first temperature threshold and the humidity is less than the second humidity threshold, temperature and humidity label 3 corresponds to the situation where the temperature is less than the second temperature threshold and the humidity is greater than the first humidity threshold, and temperature and humidity label 4 corresponds to the situation where the temperature is less than the second temperature threshold and the humidity is less than the second humidity threshold. The environmental information 602 obtained by the server indicates that the temperature is 28°C and the humidity is 70%, which is greater than the first temperature threshold of 24°C and the humidity is greater than the first humidity threshold of 70%. Therefore, in this case, the server will determine the recommended song 603 based on the songs with temperature and humidity label 1, that is, song 1 and song 3.

[0110] Optionally, the server first determines the candidate multimedia content that meets the conditions in the first multimedia content set in the above manner according to the environmental information, and then determines the recommended multimedia content from the candidate multimedia content. For example, the server screens the multimedia content in the first multimedia content set according to the label according to the environmental information to obtain n candidate multimedia content, and then randomly determines the recommended multimedia content from the n candidate multimedia content, where n is a positive integer.

[0111] In some embodiments, the server determines recommended multimedia content from the candidate multimedia content based on the recommendation priority corresponding to the candidate multimedia content. For example, the server sorts the candidate multimedia content according to the recommendation priority, and determines the candidate multimedia content ranked first as the recommended multimedia content. Optionally, the recommendation priority is determined based on a first expression corresponding to the multimedia content at a first moment and a second expression corresponding to the multimedia content at a second moment. Among them, the first moment is a moment before playing the multimedia content, and the second moment is a moment during the playing of the multimedia content. The first expression is determined by identifying the expression of the object to be recommended in the captured image collected at the first moment, and the second expression is determined by identifying the expression of the object to be recommended in the captured image collected at the second moment. Optionally, the server recognizes the expression of the object to be recommended in the captured image through an AI model. The AI ​​model can be an expression recognition model built based on CNN, and the expression recognition model is trained through expression images corresponding to different sample expressions. When the first expression is a negative expression and the second expression is a positive expression, the server will increase the recommendation priority of the multimedia content; when the first expression is a positive expression and the second expression is a negative expression, the server will lower the recommendation priority of the multimedia content; when the first expression and the second expression are both positive expressions or both negative expressions, the server will keep the recommendation priority of the multimedia content unchanged. Among them, positive expressions include expressions reflecting positive emotions, such as at least one of smiles, laughter, surprise, satisfaction, excitement, happiness, etc. Negative expressions include expressions reflecting negative emotions, such as at least one of anger, sadness, anxiety, fear, disgust, disappointment, frustration, etc.

[0112] In some embodiments, in addition to the methods of determining recommended multimedia content described in step 404 and step 406 above, the server may also determine recommended multimedia content in other ways. For example, the server first determines the second multimedia content set in the multimedia content library based on the environmental information, and then determines the recommended multimedia content in the second multimedia content set based on the behavior information. Alternatively, the server directly determines the recommended multimedia content in the multimedia content library based on both the behavior information and the environmental information. The process of determining the recommended multimedia content by the server in the above two methods can be referred to the relevant content in the foregoing text, and the embodiments of the present application will not be described in detail here.

[0113] In some embodiments, the recommended multimedia content is a recommended song. When the camera captures an image of the indoor space, the server will identify items in the captured image other than the object to be recommended through an AI model. The AI ​​model can be an item recognition model based on CNN. The item recognition model is trained by item images corresponding to different sample items, and the item image is an image including the sample item. After obtaining the items in the captured image, the server will determine the target item that is closest to the object to be recommended among the determined items, for example, based on the distance between the image area of ​​different items in the captured image and the image area of ​​the object to be recommended. After that, the server will obtain the historical songs played by the user account in the past m days, and the user account is the account logged in to the client. The name of the target item is calculated with the song title and lyrics of each historical song respectively, and the score of each historical song is determined according to the similarity corresponding to the song title of the historical song and the similarity corresponding to the lyrics, and then the historical song with the highest score is determined as the recommended song.

[0114] In some embodiments, the object to be recommended is a baby, and the recommended multimedia content is a recommended song. When the server obtains the captured image of the camera, it will identify the gaze object of the object to be recommended in the captured image, and the gaze object is the object that the object to be recommended is gazing at in the captured image. Optionally, the server recognizes the captured image through an AI model to obtain the gaze object, and the AI ​​model can be a gaze recognition model built based on CNN, and the gaze recognition model is obtained by training different sample gaze images, and different sample gaze images include images of babies gazing at sample objects under different lines of sight. After obtaining the gaze object, the server identifies the type of the gaze object, for example, the type of the gaze object includes mother, father, grandfather, grandmother, toy, baby carriage, crib, etc. Optionally, the server identifies the type of the gaze object through an AI model, and the AI ​​model can be a type recognition model built based on CNN, and the type recognition model is obtained by training images corresponding to different sample objects, and the image corresponding to the sample object is an image including the sample object. After determining the type of the gaze object, the server determines the recommended song according to the type of the gaze object, and the recommended song is related to the type of the gaze object. Optionally, the name of the recommended song is related to the type of the gaze object. In this case, the server calculates the first semantic similarity between the type of the gazed object and the song titles in the song library, thereby determining the song with the highest first semantic similarity as the recommended song. Alternatively, the lyrics of the recommended song are related to the type of the gazed object. In this case, the server calculates the second semantic similarity between the type of the gazed object and the lyrics of the songs in the song library, thereby determining the song with the highest second semantic similarity as the recommended song.

[0115] Step 408: Send the recommended multimedia content to the multimedia device.

[0116] The multimedia device is used to play the recommended multimedia content. The multimedia device includes a device that supports playing multimedia content, and a client corresponding to the server is installed in the multimedia device. The multimedia device receives the recommended multimedia content sent by the server through the client. Optionally, the multimedia device is located in an indoor space, or the multimedia device is located outside the indoor space, which is not limited in the embodiments of the present application. In some embodiments, the multimedia device is a terminal, and the terminal includes at least one of a mobile phone, a tablet computer, a smart watch, an e-book reader, an MP3 player, an MP4 player, a laptop computer, and a smart speaker.

[0117] In some embodiments, when the multimedia device receives the recommended multimedia content, the client in the multimedia device automatically plays the recommended multimedia content. In some embodiments, when the multimedia device receives the recommended multimedia content, the client in the multimedia device displays the recommended multimedia content in the user interface, and when receiving a play operation for the recommended multimedia content, the client in the multimedia device plays the recommended multimedia content.

[0118] In some embodiments, the environmental information includes noise detection information corresponding to the indoor space, the noise detection information is collected by a microphone in the indoor space, and the noise detection information is used to reflect the environmental noise in the indoor space. When the volume of the environmental noise indicated by the noise detection information is greater than the volume threshold, for example, the decibel value of the environmental noise is greater than the decibel value threshold, the server will send at least one of noise reduction audio and noise reduction songs to the multimedia device to play the noise reduction audio or noise reduction songs through the multimedia device. Among them, the noise reduction audio includes audio used to offset the environmental noise, the sound wave corresponding to the noise reduction audio is opposite to the sound wave corresponding to the environmental noise, and the noise reduction audio is obtained by reverse processing the sound wave corresponding to the environmental noise. The noise reduction songs include songs whose similarity with white noise is greater than the similarity threshold. White noise refers to noise whose power spectral density is constant in the entire frequency domain, for example, including at least one of rain, wind, and running water. The noise reduction songs are songs pre-stored in the server.

[0119] In some embodiments, when the environmental information obtained by the server meets the environmental sound playback condition, the server will send an audio file of the environmental sound to the multimedia device to play the environmental sound through the multimedia playback device, and the environmental sound includes the sound generated by the natural environment. Optionally, the environmental sound playback condition includes that the temperature indicated by the temperature information is greater than the first temperature threshold. When the environmental sound playback condition is met, the server will send an audio file with a first environmental sound tag to the multimedia device. Optionally, the environmental sound playback condition includes that the humidity indicated by the humidity information is greater than the first humidity threshold. When the environmental sound playback condition is met, the server will send an audio file with a second environmental sound tag to the multimedia device. Among them, the first environmental sound tag and the second environmental sound tag are set by the operation and maintenance personnel. The audio file with the first environmental sound tag can be an audio file corresponding to the environmental sound generated by a wind chime, and the audio file with the second environmental sound tag can be an audio file corresponding to the environmental sound generated by the wind or an audio file corresponding to the environmental sound generated by waves.

[0120] In some embodiments, the object to be recommended is an infant. When the behavior information determined by the server indicates that the behavior of the object to be recommended is a moving behavior, the server will determine the moving path corresponding to the moving behavior in the target shot image used to identify the moving behavior. The moving behavior includes a behavior that causes the position of the object to be recommended to move, such as crawling. The moving path is used to reflect the path of the object to be recommended moving in the target shot image under the moving behavior. Optionally, after acquiring the target shot image, the server will acquire a plurality of continuous reference shot images through a camera, and the acquisition time of the reference shot image is after the target shot image. The server analyzes the position change of the object to be recommended in the plurality of reference shot images, and the position change of the object to be recommended in the reference shot image compared with the target shot image, so as to determine the moving path corresponding to the moving behavior in the target shot image. The server will then determine whether there is an obstacle on the moving path in the target shot image. Optionally, the server identifies whether there is an obstacle on the moving path through an AI model, and the AI ​​model can be an obstacle recognition model constructed based on CNN, and the obstacle recognition model is obtained by training obstacle images corresponding to different sample obstacles. When the server determines that there are obstacles on the moving path in the target image, the server will control the client to play the target song. The target song includes songs that are identified as changes in the behavior of the recommended object after playing. The target song is a song pre-stored in the server. For example, before playing a song, the server identifies the behavior of the recommended object as crawling through the camera image. During the playback of the song, the server identifies the behavior of the recommended object as dazed through the camera image. In this case, the server will identify the song as the target song.

[0121] In some embodiments, when the server detects the presence of a target pattern in the image captured by the camera, it triggers the server to execute the steps of obtaining behavior information and environmental information, and determining the recommended multimedia content, and the target pattern is the pattern uploaded by the client. Optionally, when the server obtains the captured image, it calculates the similarity between the captured image and the target pattern, and when the similarity is greater than a similarity threshold, the server determines to trigger multimedia content recommendation, thereby executing the steps of obtaining behavior information and environmental information, and determining the recommended multimedia content.

[0122] It should be noted that the method provided in the embodiment of the present application is introduced by taking the collaborative implementation of the server and the client as an example. It is understandable that the method provided in the embodiment of the present application can also be implemented independently by the client.

[0123] In summary, the method provided in this embodiment determines the multimedia content recommended to the object to be recommended in the indoor space according to the behavior information of the object to be recommended in the indoor space and the environmental information corresponding to the indoor space, and can simultaneously refer to the behavior of the object to be recommended and the environment in which the object to be recommended is located to recommend multimedia content to the object to be recommended. By referring to multi-dimensional factors to recommend multimedia content to the object to be recommended in the indoor space, the accuracy of multimedia content recommendation in the indoor space scene can be improved.

[0124] The method provided in this embodiment also provides a convenient and accurate way to recommend multimedia content based on behavior information and environmental information by filtering the first multimedia content set according to behavior information and then filtering the recommended multimedia content according to environmental information. By filtering the multimedia content corresponding to the behavior information according to the preset behavior tag, it is possible to accurately and quickly determine the recommended multimedia content according to the behavior information. By filtering the multimedia content corresponding to the temperature information according to the preset temperature tag, it is possible to accurately and quickly determine the recommended multimedia content according to the temperature information. By filtering the multimedia content corresponding to the humidity information according to the preset humidity tag, it is possible to accurately and quickly determine the recommended multimedia content according to the humidity information. By filtering the multimedia content corresponding to the temperature information and the humidity information according to the preset temperature and humidity tags, it is possible to accurately and quickly determine the recommended multimedia content according to the temperature information and the humidity information. By identifying the captured image collected by the camera to determine the behavior information of the object to be recommended, it is possible to accurately recommend multimedia content according to the real-time behavior of the object to be recommended. By sending noise reduction audio and / or noise reduction songs to the multimedia device, it is possible to offset the negative impact of environmental noise on the recommended object by playing noise reduction audio or noise reduction songs.

[0125] In an illustrative example, taking the method provided in the embodiment of the present application as an example for recommending songs for babies, Figure 7 FIG. 1 is a schematic diagram of a process for determining a recommended song provided by an exemplary embodiment of the present application. Figure 7 As shown, in step S1, the camera set in the indoor space will continuously capture images of the indoor space and transmit the images to the server in real time for infant behavior analysis. In step S2, the server will analyze the captured images transmitted by the camera, capture and analyze the infant's behavior information, such as sleeping, crying, crawling, dazed, etc. In step S3, the temperature and humidity sensor set in the indoor space will detect the temperature and humidity of the indoor space in real time, and transmit the detection results to the server. In step S4, the server determines whether the current temperature and humidity of the indoor space are comfortable (whether they exceed the threshold) by analyzing the temperature and humidity detected by the temperature and humidity sensor. In step S5, the server recommends corresponding songs according to the labels of the songs in the song library based on the infant's behavior information and whether the temperature and humidity of the current indoor space are suitable. For example, if the baby is crawling, the server will recommend some lively and cheerful songs; if the baby is crying or the temperature and humidity are too high, the server will recommend some soothing pure music. In addition, when the behavior information indicates that the baby is sleeping, the server will control the APP (client) to gradually reduce the sound of the song being played, or pause the song. In step S6, when the APP receives the recommended songs and song playing instructions sent by the server, the APP will play the songs provided by the server. The APP can be installed in a mobile phone or a smart speaker. The APP can also adjust the volume of the songs played or pause or start playing songs according to the instructions of the server. The server can also send behavior information and environmental information to the APP, so that the baby's behavior information and indoor temperature and humidity detection results can be displayed through the APP user interface. For example, when the behavior information indicates that the baby is sleeping and the temperature and humidity are both above the threshold, the APP will display: The baby is sleeping, the current temperature and humidity are too high, and it is recommended to turn on the air conditioner for dehumidification.

[0126] It should be noted that before collecting relevant data of users and during the process of collecting relevant data of users, this application can display a prompt interface, pop-up window or output voice prompt information, and the prompt interface, pop-up window or voice prompt information is used to prompt the user that its relevant data is currently being collected, so that this application only starts to execute the relevant steps of obtaining relevant data of users after obtaining the confirmation operation issued by the user to the prompt interface or pop-up window, otherwise (that is, when the confirmation operation issued by the user to the prompt interface or pop-up window is not obtained), the relevant steps of obtaining relevant data of users are terminated, that is, the relevant data of users are not obtained. In other words, all user data collected by this application are collected with the consent and authorization of the user, and the collection, use and processing of relevant user data need to comply with the relevant laws, regulations and standards of relevant countries and regions.

[0127] It should be noted that the sequence of the method steps provided in the embodiments of the present application can be appropriately adjusted, and the steps can be increased or decreased accordingly according to the circumstances. Any technician familiar with the technical field can easily think of the changed methods within the technical scope disclosed in the present application, and they should be included in the protection scope of the present application, so they will not be repeated here.

[0128] Figure 8 FIG. 1 is a schematic diagram of a structure of a multimedia content recommendation device provided by an exemplary embodiment of the present application. Figure 8 As shown, the device comprises:

[0129] The acquisition module 801 is used to acquire behavior information of the object to be recommended in the indoor space and environment information corresponding to the indoor space, wherein the behavior information is used to reflect the behavior of the object to be recommended in the indoor space;

[0130] A determination module 802 is used to determine the recommended multimedia content corresponding to the object to be recommended according to the behavior information of the object to be recommended and the environment information corresponding to the indoor space;

[0131] The sending module 803 is used to send the recommended multimedia content to a multimedia device, and the multimedia device is used to play the recommended multimedia content.

[0132] In an optional design, the determining module 802 is used to:

[0133] Determining a first multimedia content set in a multimedia content library according to the behavior information;

[0134] The recommended multimedia content is determined in the first multimedia content set according to the environmental information.

[0135] In an optional design, the multimedia content in the multimedia content library corresponds to a preset behavior tag; the determination module 802 is used to:

[0136] Determining multimedia content having a first behavior tag in the multimedia content library according to the behavior type corresponding to the behavior information, and obtaining the first multimedia content set;

[0137] The first behavior tag includes a behavior tag that has a corresponding relationship with the behavior type.

[0138] In an optional design, the multimedia content in the multimedia content library corresponds to a preset temperature tag, and the environmental information includes temperature information; the determination module 802 is used to:

[0139] In a case where the temperature indicated by the temperature information exceeds a temperature threshold, determining the multimedia content with a first temperature tag in the first multimedia content set as the recommended multimedia content;

[0140] In a case where the temperature indicated by the temperature information does not exceed the temperature threshold, determining the multimedia content with the second temperature tag in the first multimedia content set as the recommended multimedia content;

[0141] The first temperature label and the second temperature label are different labels among the temperature labels.

[0142] In an optional design, the multimedia content in the multimedia content library corresponds to a preset humidity tag, and the environmental information includes humidity information; the determination module 802 is used to:

[0143] In a case where the humidity indicated by the humidity information exceeds a humidity threshold, determining the multimedia content with the first humidity tag in the first multimedia content set as the recommended multimedia content;

[0144] In a case where the humidity indicated by the humidity information does not exceed the humidity threshold, determining the multimedia content with the second humidity tag in the first multimedia content set as the recommended multimedia content;

[0145] The first humidity tag and the second humidity tag are different tags among the humidity tags.

[0146] In an optional design, the multimedia content in the multimedia content library corresponds to a preset temperature and humidity tag, and the environmental information includes temperature information and humidity information; the determination module 802 is used to:

[0147] When the temperature indicated by the temperature information exceeds a temperature threshold and the humidity indicated by the humidity information exceeds a humidity threshold, determining the multimedia content with the first temperature and humidity tag in the first multimedia content set as the recommended multimedia content;

[0148] When the temperature indicated by the temperature information exceeds the temperature threshold or the humidity indicated by the humidity information exceeds the humidity threshold, determining the multimedia content with the second temperature and humidity label in the first multimedia content set as the recommended multimedia content;

[0149] When the temperature indicated by the temperature information does not exceed the temperature threshold and the humidity indicated by the humidity information does not exceed the humidity threshold, determining the multimedia content with the third temperature and humidity tag in the first multimedia content set as the recommended multimedia content;

[0150] Among them, the first temperature and humidity tag, the second temperature and humidity tag, and the third temperature and humidity tag are different tags among the temperature and humidity tags.

[0151] In an optional design, the determining module 802 is used to:

[0152] Determining a second multimedia content set in a multimedia content library according to the environmental information;

[0153] The recommended multimedia content is determined in the second multimedia content set according to the behavior information.

[0154] In an alternative design, such as Fig. 9 As shown, the device also includes:

[0155] The acquisition module 801 is used to acquire a captured image corresponding to the indoor space, where the captured image is collected by a camera in the indoor space;

[0156] The recognition module 804 is used to obtain the behavior information of the object to be recommended by recognizing the captured image.

[0157] In an optional design, the environmental information includes noise detection information corresponding to the indoor space, and the noise detection information is collected by a microphone in the indoor space; the sending module 803 is used to:

[0158] When the volume of the ambient noise indicated by the noise detection information is greater than a volume threshold, sending at least one of a noise reduction audio and a noise reduction song to the multimedia device;

[0159] The noise reduction audio includes audio for offsetting the ambient noise, and the noise reduction songs include songs whose similarity to the white noise is greater than a similarity threshold.

[0160] It should be noted that the multimedia content recommendation device provided in the above embodiment is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the multimedia content recommendation device provided in the above embodiment and the multimedia content recommendation method embodiment belong to the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0161] An embodiment of the present application also provides a computer device, which includes: a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, at least one program, a code set or an instruction set is loaded and executed by the processor to implement the multimedia content recommendation method provided by the above-mentioned method embodiments.

[0162] For example, Fig.10 It is a structural diagram of a computer device provided by an exemplary embodiment of the present application.

[0163] The computer device 1000 includes a central processing unit (CPU) 1001, a system memory 1004 including a random access memory (RAM) 1002 and a read-only memory (ROM) 1003, and a system bus 1005 connecting the system memory 1004 and the central processing unit 1001. The computer device 1000 also includes a basic input / output system (I / O system) 1006 for facilitating information transmission between various components in the computer device, and a large-capacity storage device 1007 for storing an operating system 1013, application programs 1014, and other program modules 1015.

[0164] The basic input / output system 1006 includes a display 1008 for displaying information and an input device 1009 such as a mouse and a keyboard for user inputting information. The display 1008 and the input device 1009 are connected to the central processing unit 1001 through an input / output controller 1010 connected to the system bus 1005. The basic input / output system 1006 may also include an input / output controller 1010 for receiving and processing inputs from a plurality of other devices such as a keyboard, a mouse, or an electronic stylus. Similarly, the input / output controller 1010 also provides output to a display screen, a printer, or other types of output devices.

[0165] The mass storage device 1007 is connected to the central processing unit 1001 via a mass storage controller (not shown) connected to the system bus 1005. The mass storage device 1007 and its associated computer readable storage medium provide non-volatile storage for the computer device 1000. That is, the mass storage device 1007 may include a computer readable storage medium (not shown) such as a hard disk or a compact disc read-only memory (CD-ROM) drive.

[0166] Without loss of generality, the computer-readable storage medium may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable storage instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, Erasable Programmable Read Only Memory (EPROM), Electronically Erasable Programmable Read-Only Memory (EEPROM), flash memory or other solid-state storage devices, CD-ROM, Digital Versatile Disc (DVD) or other optical storage, cassettes, tapes, disk storage or other magnetic storage devices. Of course, those skilled in the art will know that the computer storage medium is not limited to the above. The above-mentioned system memory 1004 and mass storage device 1007 can be collectively referred to as memory.

[0167] The memory stores one or more programs, and the one or more programs are configured to be executed by one or more central processing units 1001. The one or more programs contain instructions for implementing the above-mentioned method embodiments. The central processing unit 1001 executes the one or more programs to implement the methods provided by the above-mentioned various method embodiments.

[0168] According to various embodiments of the present application, the computer device 1000 can also be connected to a remote computer device on a network through a network such as the Internet. That is, the computer device 1000 can be connected to the network 1012 through the network interface unit 1011 connected to the system bus 1005, or the network interface unit 1011 can be used to connect to other types of networks or remote computer device systems (not shown).

[0169] The memory also includes one or more programs, which are stored in the memory and include steps executed by a computer device in the method provided in the embodiment of the present application.

[0170] A computer-readable storage medium is also provided in an embodiment of the present application. The computer-readable storage medium stores at least one instruction, at least one program, code set or instruction set. When the at least one instruction, at least one program, code set or instruction set is loaded and executed by a processor of a computer device, the multimedia content recommendation method provided by the above-mentioned method embodiments is implemented.

[0171] The present application also provides a computer program product or a computer program, which includes a computer instruction stored in a computer-readable storage medium. A processor of a computer device reads the computer instruction from the computer-readable storage medium, and the processor executes the computer instruction, so that the computer device executes the multimedia content recommendation method provided by the above-mentioned method embodiments.

[0172] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned readable storage medium may be a read-only memory, a disk or an optical disk, etc.

[0173] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent switching, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for recommending multimedia content, characterized in that: The method comprises: Acquire behavior information of a to-be-recommended object in an indoor space and environment information corresponding to the indoor space, wherein the behavior information is used to reflect the behavior of the to-be-recommended object in the indoor space; Determining recommended multimedia content corresponding to the object to be recommended according to the behavior information of the object to be recommended and the environmental information corresponding to the indoor space; The recommended multimedia content is sent to a multimedia device, and the multimedia device is used to play the recommended multimedia content.

2. The method according to claim 1, characterized in that The determining, according to the behavior information of the object to be recommended and the environment information corresponding to the indoor space, the recommended multimedia content corresponding to the object to be recommended includes: Determining a first multimedia content set in a multimedia content library according to the behavior information; The recommended multimedia content is determined in the first multimedia content set according to the environmental information.

3. The method according to claim 2, characterized in that The multimedia content in the multimedia content library corresponds to a preset behavior tag; and determining the first multimedia content set in the multimedia content library according to the behavior information includes: Determining multimedia content having a first behavior tag in the multimedia content library according to the behavior type corresponding to the behavior information, and obtaining the first multimedia content set; The first behavior tag includes a behavior tag that has a corresponding relationship with the behavior type.

4. The method according to claim 2, characterized in that: The multimedia content in the multimedia content library corresponds to a preset temperature tag, and the environmental information includes temperature information; and determining the recommended multimedia content in the first multimedia content set according to the environmental information includes: In a case where the temperature indicated by the temperature information exceeds a temperature threshold, determining the multimedia content with a first temperature tag in the first multimedia content set as the recommended multimedia content; In a case where the temperature indicated by the temperature information does not exceed the temperature threshold, determining the multimedia content with the second temperature tag in the first multimedia content set as the recommended multimedia content; The first temperature label and the second temperature label are different labels among the temperature labels.

5. The method according to claim 2, characterized in that: The multimedia content in the multimedia content library corresponds to a preset humidity tag, and the environmental information includes humidity information; and determining the recommended multimedia content in the first multimedia content set according to the environmental information includes: In a case where the humidity indicated by the humidity information exceeds a humidity threshold, determining the multimedia content with the first humidity tag in the first multimedia content set as the recommended multimedia content; In a case where the humidity indicated by the humidity information does not exceed the humidity threshold, determining the multimedia content with the second humidity tag in the first multimedia content set as the recommended multimedia content; The first humidity tag and the second humidity tag are different tags among the humidity tags.

6. The method according to claim 2, characterized in that The multimedia content in the multimedia content library corresponds to a preset temperature and humidity tag, and the environmental information includes temperature information and humidity information; and determining the recommended multimedia content in the first multimedia content set according to the environmental information includes: When the temperature indicated by the temperature information exceeds a temperature threshold and the humidity indicated by the humidity information exceeds a humidity threshold, determining the multimedia content with the first temperature and humidity label in the first multimedia content set as the recommended multimedia content; When the temperature indicated by the temperature information exceeds the temperature threshold or the humidity indicated by the humidity information exceeds the humidity threshold, determining the multimedia content with the second temperature and humidity label in the first multimedia content set as the recommended multimedia content; When the temperature indicated by the temperature information does not exceed the temperature threshold and the humidity indicated by the humidity information does not exceed the humidity threshold, determining the multimedia content with the third temperature and humidity tag in the first multimedia content set as the recommended multimedia content; Among them, the first temperature and humidity tag, the second temperature and humidity tag, and the third temperature and humidity tag are different tags among the temperature and humidity tags.

7. The method according to any one of claims 1 to 6, characterized in that: The determining, according to the behavior information of the object to be recommended and the environment information corresponding to the indoor space, the recommended multimedia content corresponding to the object to be recommended includes: Determining a second multimedia content set in a multimedia content library according to the environmental information; The recommended multimedia content is determined in the second multimedia content set according to the behavior information.

8. The method according to any one of claims 1 to 6, characterized in that: The step of obtaining behavior information of the object to be recommended in the indoor space includes: Acquire a captured image corresponding to the indoor space, where the captured image is collected by a camera in the indoor space; The behavior information of the object to be recommended is obtained by identifying the captured image.

9. The method according to any one of claims 1 to 6, characterized in that: The environmental information includes noise detection information corresponding to the indoor space, and the noise detection information is collected by a microphone in the indoor space; the method further includes: When the volume of the ambient noise indicated by the noise detection information is greater than a volume threshold, sending at least one of a noise reduction audio and a noise reduction song to the multimedia device; The noise reduction audio includes audio for offsetting the ambient noise, and the noise reduction songs include songs whose similarity to the white noise is greater than a similarity threshold.

10. A multimedia content recommendation device, characterized in that: The device comprises: An acquisition module, used to acquire behavior information of an object to be recommended in an indoor space and environment information corresponding to the indoor space, wherein the behavior information is used to reflect the behavior of the object to be recommended in the indoor space; A determination module, configured to determine the recommended multimedia content corresponding to the object to be recommended according to the behavior information of the object to be recommended and the environment information corresponding to the indoor space; The sending module is used to send the recommended multimedia content to a multimedia device, and the multimedia device is used to play the recommended multimedia content.

11. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the multimedia content recommendation method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The readable storage medium stores at least one program, and the at least one program is loaded and executed by a processor to implement the multimedia content recommendation method according to any one of claims 1 to 9.

13. A computer program product, characterized in that The computer program product includes computer instructions, which are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the multimedia content recommendation method as described in any one of claims 1 to 9.

Images