Recommendations for shooting effects, devices, storage media and electronic devices
By identifying the image frames of videos taken by users and recommending shooting effects based on category tags, the problem of inconvenient selection of shooting effects in the prior art is solved, and the ease of use and fun of the video is improved.
Patent Information
- Application Number
- CN202310161334.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-02-23
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2043-02-23
AI Technical Summary
In the prior art, users need to choose the shooting effect by themselves when shooting videos, which is not convenient enough and lacks an automated recommendation mechanism, resulting in insufficient ease of use and fun in the video shooting effect.
By obtaining the target video taken by the user, extracting image frames for image recognition, and recommending corresponding shooting effects based on the identified category tags, including filters, special effects and music, to improve the viewing and fun of the video.
It improves the ease of use of video shooting effects, enhances the viewing and fun of videos, and stimulates users' desire to shoot.
Smart Images

Figure CN116112779B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure generally relates to the field of computer technology, and more specifically to a method, device, computer program product, non-transitory computer-readable storage medium, and electronic device for recommending shooting effects. Background Art
[0002] This section is intended to introduce some aspects of the art, which may be related to various aspects of the present disclosure described below and / or claimed. It is believed that this section helps to provide background information to facilitate a better understanding of various aspects of the present disclosure. Therefore, it should be understood that these statements should be understood from this perspective, rather than as an admission of the prior art.
[0003] When shooting videos, users can add shooting effects such as filters, stickers or music to increase the richness and fun of the video.
[0004] In existing technical solutions, users usually need to select and apply the shooting effects themselves, which is not convenient to use.
[0005] Therefore, it is necessary to propose a recommended solution for shooting effects to alleviate or solve at least one of the above technical problems. Summary of the invention
[0006] The purpose of the present disclosure is to provide a method, device, computer program product, non-transitory computer-readable storage medium and electronic device for recommending shooting effects, so as to improve the usability of video shooting effects.
[0007] According to a first aspect of the present disclosure, a method for recommending shooting effects is provided, comprising: obtaining a target video, wherein the target video is shot by a user; extracting at least one image frame from the target video; performing image recognition on the at least one image frame to obtain a corresponding category label; and determining a corresponding shooting effect based on the category label and recommending it to the user.
[0008] According to a second aspect of the present disclosure, a device for recommending shooting effects is provided, including: an acquisition module, used to acquire a target video, wherein the target video is shot by a user; an extraction module, used to extract at least one image frame from the target video; a recognition module, used to perform image recognition on the at least one image frame to obtain a corresponding category label; and a recommendation module, used to determine a corresponding shooting effect based on the category label and recommend it to the user.
[0009] According to a third aspect of the present disclosure, a computer program product is provided, comprising program code instructions. When the program product is executed by a computer, the program code instructions enable the computer to execute the method according to the first aspect of the present disclosure.
[0010] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method according to the first aspect of the present disclosure.
[0011] According to a fifth aspect of the present disclosure, an electronic device is provided, comprising: a processor, a memory that electronically communicates with the processor; and instructions, the instructions being stored in the memory and executable by the processor to enable the electronic device to perform the method according to the first aspect of the present disclosure.
[0012] The embodiment of the present disclosure obtains a category label by identifying the image frame of the target video, and recommends the corresponding shooting effect based on the category label, which is conducive to improving the usability of the video shooting effect, improving the viewing and fun of the video, and stimulating the user's desire to shoot.
[0013] It should be understood that the content described in this section is not intended to identify key or essential features of the claimed invention, nor is it intended to be used alone to determine the scope of the claimed invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In all drawings, the same reference numerals refer to similar but not necessarily identical elements.
[0015] Figure 1 A system architecture diagram showing an embodiment of a method for recommending shooting effects according to the present disclosure;
[0016] Figure 2 A flowchart showing an embodiment of a method for recommending shooting effects according to the present disclosure is shown;
[0017] Figure 3A-3C A flowchart showing another embodiment of a method for recommending a photographing effect according to the present disclosure;
[0018] Figure 3D A flowchart of a specific example of a method for recommending a photographic effect according to the present disclosure;
[0019] Figure 4 An exemplary block diagram of a device for recommending photographic effects according to an embodiment of the present disclosure is shown;
[0020] Figure 5A schematic diagram of an example electronic device 500 is shown that may be used to implement embodiments of the present disclosure.
[0021] Specific implementation method
[0022] The present disclosure will be described more fully below with reference to the accompanying drawings. However, the present disclosure may be embodied in a variety of alternative forms and should not be construed as being limited to the embodiments described herein. Therefore, although the present disclosure is susceptible to various modifications and alternative forms, its specific embodiments are shown by way of example in the accompanying drawings and will be described in detail herein. However, it should be understood that this approach is not intended to limit the present disclosure to the specific form disclosed, but rather, the present disclosure covers all modifications, equivalents, and alternatives that fall within the spirit and scope of the present disclosure as defined by the claims.
[0023] It should be understood that although various elements can be described herein with terms such as first, second, etc., these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, a first element can be referred to as a second element, and similarly, a second element can be referred to as a first element without departing from the teaching of the present disclosure.
[0024] Some examples are described herein in conjunction with block diagrams and / or flow charts, wherein each box represents a circuit element, module, or portion of code that includes one or more executable instructions for implementing a specified logical function. It should also be noted that in other implementations, the functions described in the box may not occur in the order described. For example, depending on the functions involved, two boxes shown in succession may actually be executed substantially simultaneously, or the boxes may sometimes be executed in reverse order.
[0025] The phrases "according to an embodiment..." or "in an embodiment..." mentioned herein mean that a specific feature, structure, or characteristic described in conjunction with the embodiment may be included in at least one implementation of the present disclosure. The phrases "according to an embodiment..." or "in an embodiment..." that appear in different places herein do not necessarily refer to the same embodiment, nor are they necessarily separate or alternative embodiments that are mutually exclusive with other embodiments.
[0026] Figure 1 An exemplary system architecture 100 is shown to which an embodiment of the method, apparatus, terminal device, and storage medium for recommending photographing effects of the present disclosure can be applied.
[0027] like Figure 1As shown, the system architecture 100 may include terminal devices 101, 102, 103, a network 104 and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.
[0028] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Various communication client applications can be installed on terminal devices 101, 102, 103, such as voice interaction applications, video conferencing applications, short video social applications, web browser applications, shopping applications, search applications, instant messaging tools, email clients, social platform software, etc.
[0029] Terminal devices 101, 102, 103 can be hardware or software. When terminal devices 101, 102, 103 are hardware, they can be various electronic devices with microphones and speakers, including but not limited to smart phones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Compression Standard Audio Layer 3), MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Compression Standard Audio Layer 4) players, portable computers and desktop computers, etc. When terminal devices 101, 102, 103 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules, or as a single software or software module. No specific limitation is made here.
[0030] The server 105 may be a server that provides various services. For example, the server 105 may be a background server that processes the recommendation requests for shooting effects sent by the terminal devices 101 , 102 , and 103 .
[0031] In some cases, the recommendation of shooting effects provided by the present disclosure may be performed by the terminal devices 101 , 102 , and 103 . Accordingly, the device for recommending shooting effects may also be provided in the terminal devices 101 , 102 , and 103 . In this case, the system architecture 100 may not include the server 105 .
[0032] In some cases, the recommendation of the shooting effects provided by the present disclosure may be executed by the server 105 , and accordingly, the device for recommending the shooting effects may also be set in the server 105 . In this case, the system architecture 100 may not include the terminal devices 101 , 102 , and 103 .
[0033] In some cases, the recommendation of shooting effects provided by the present disclosure may be jointly performed by the terminal devices 101, 102, 103 and the server 105. Accordingly, the shooting effect recommendation apparatus may also be respectively arranged in the terminal devices 101, 102, 103 and the server 105.
[0034] It should be noted that the server 105 can be hardware or software. When the server 105 is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server 105 is software, it can be implemented as multiple software or software modules (for example, for providing distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.
[0035] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to the implementation requirements.
[0036] Figure 2 FIG. 1 is a flow chart showing an embodiment of a method for recommending a photographing effect according to the present disclosure. The method in this embodiment can be performed by Figure 1 implemented by the terminal device in Figure 1 Implementation by the server in , or by Figure 1 It is implemented jointly by the terminal devices and servers in the system.
[0037] like Figure 2 As shown, the method 200 includes the following steps:
[0038] Step 210, obtaining a target video, where the target video is shot by a user.
[0039] The method in this embodiment can be applied to video live broadcast scenarios, and can also be applied to non-live broadcast scenarios, such as video submission scenarios.
[0040] In this embodiment, when the user is shooting a video, a shooting effect can be recommended based on the video that the user has shot, and applied to the user's subsequent shooting. The video that the user has shot is the target video.
[0041] Step 220: extract at least one image frame from the target video.
[0042] In this embodiment, the number of image frames may be one or more. Exemplarily, key frames in the target video may be obtained as the extracted image frames.
[0043] Step 230: Perform image recognition on at least one image frame to obtain a corresponding category label.
[0044] In this embodiment, an image recognition algorithm can be used to perform image recognition processing on the extracted image frames. Exemplarily, an image recognition algorithm based on opencv (a cross-platform computer vision library) can be used to perform image recognition processing on the extracted image frames.
[0045] In this embodiment, the recognition result of the image frame is the category label of the information contained in the image frame. For example, the category label is "person", "landscape", "animal", "plant" and the like.
[0046] In the case of extracting multiple image frames, the final category label can be determined according to the category label of each image frame. Exemplarily, the union of the category labels of multiple image frames can be taken as the final category label. Alternatively, one or more category labels with the highest confidence can be selected from the category labels of multiple image frames as the final category label.
[0047] Step 240: Determine the corresponding shooting effect according to the category label and recommend it to the user.
[0048] In this embodiment, the shooting effect corresponding to the category label may be determined according to a set algorithm.
[0049] In this embodiment, the shooting effect may include at least one of a filter, a special effect, and a sound. The filter, for example, is to achieve a specific visual effect by changing parameters such as the brightness and contrast of the image. The special effect, for example, is to achieve an interesting effect of the image by adding a texture to the image, changing the shape of a face, etc. The music, for example, is background music or a specific sound effect that can be added to the video.
[0050] In an optional embodiment, at least one candidate shooting effect may be first obtained, and then the recommendation score of each candidate shooting effect may be determined according to the category label, and finally, according to the recommendation score of each candidate shooting effect, the target shooting effect may be determined from the candidate shooting effects and recommended to the user. Exemplarily, one or more shooting effects with the highest recommendation score may be selected as the target shooting effect. Exemplarily, the category label corresponding to each candidate shooting effect may be pre-set. For a specific candidate shooting effect, if the candidate shooting effect corresponds to an identified category label, the confidence of the category label may be used as the recommendation score of the candidate shooting effect; if the candidate shooting effect corresponds to multiple identified category labels, the sum of the confidences of the multiple category labels may be used as the recommendation score of the candidate shooting effect.
[0051] The candidate shooting effects mentioned above can be managed and maintained by the operator. For example, the operator can set the currently popular or latest shooting filters as candidate shooting effects. The candidate shooting effects can also be shooting effects that the user has used before, or shooting effects automatically generated by the system. Optionally, the candidate shooting effects managed and maintained by the operator can be inserted into the candidate shooting effects corresponding to the category label in a certain proportion. Optionally, if the candidate shooting effects managed and maintained by the operator match the category label, they are preferentially determined as the target shooting effects and recommended to the user, regardless of the value of their recommendation scores.
[0052] In an optional embodiment, when the recommendation score of the target shooting effect is greater than the first score threshold (for example, indicating "very recommended") and the number is one, the target shooting effect can be directly applied in the current shooting. When the recommendation score of the target shooting effect is greater than the first score threshold (for example, indicating "very recommended") and the number is multiple, or when the recommendation score of the target shooting effect is greater than the second score threshold and less than the first score threshold (for example, indicating "relatively recommended"), an interactive interface can be provided to the user, and the target shooting effect can be applied in response to the user's operation (for example, selection operation or confirmation operation) on the recommendation interactive interface.
[0053] In this embodiment, by identifying the image frames of the target video to obtain a category label, and giving the category label to recommend a corresponding shooting effect, it is helpful to improve the usability of the video shooting effect, improve the viewing and fun of the video, and help stimulate the user's desire to shoot.
[0054] Figure 3A FIG. 2 is a flow chart showing another embodiment of a method for recommending a shooting effect according to the present disclosure. Figure 3A As shown, the method 310 includes the following steps:
[0055] Step 311, obtaining the target video and the audio data corresponding to the target video.
[0056] The audio data corresponding to the target video is used to determine the sound environment during shooting. Exemplarily, the audio data can be obtained by extracting audio from the target video, or the audio data can be obtained by acquiring sound data collected by a microphone.
[0057] Step 312: extract at least one image frame from the target video.
[0058] For step 312 , please refer to the description of step 220 above.
[0059] Step 313: perform image recognition on at least one image frame to obtain a corresponding category label.
[0060] For step 313 , please refer to the description of step 230 above.
[0061] Step 314: modify the category label according to the audio data corresponding to the target video data.
[0062] Modify the category label, such as adding, modifying or deleting the current category label.
[0063] In an optional embodiment, the ambient volume can be determined based on the audio data, and when the ambient volume is greater than a first set threshold, a "noisy" label is added to the current category label. When the ambient volume is less than a second set threshold, a "quiet" label is added to the current category label.
[0064] In an optional embodiment, the category label determined according to the audio content of the audio data can be combined with the category label determined by the audio content and the category label determined by the target video to determine the final category label. Exemplarily, the audio content can be identified by the type of sound to determine whether it is a human voice, wind sound, music or animal sound. For the human voice, speech recognition can be performed to determine the keywords in the audio content, such as "scenery", "efficiency" or "shopping".
[0065] In an optional embodiment, when the category label determined by the audio data and the category label determined by the target video are fused, if the two are consistent (for example, both are labeled "funny"), the recommendation score of the category label can be improved. Exemplarily, the recommendation score based on the audio data and the recommendation score based on the target video can be added to obtain the recommendation score of the category label.
[0066] In an optional embodiment, when the category labels determined by the audio data and the category labels determined by the target video are merged, the priority of the two can be set to specify whether the category labels determined by the audio data or the category labels determined by the target video are given priority.
[0067] Step 315: determine the corresponding shooting effect according to the corrected category label and recommend it to the user.
[0068] Exemplarily, when the current tag includes a "noisy" tag, no sound effect may be recommended to the user. When the current tag includes a "quiet" tag, a sound effect, such as specific music, may be recommended to the user.
[0069] Figure 3B FIG. 2 is a flow chart showing another embodiment of a method for recommending a shooting effect according to the present disclosure. Figure 3B As shown, the method 320 includes the following steps:
[0070] Step 321, obtaining the target video and the camera information corresponding to the target video.
[0071] The camera information corresponding to the target video is used to indicate the activation status of the front / rear camera of the terminal device, and further indicates whether the target video is shot by the front camera of the terminal device or the rear camera of the terminal device.
[0072] Step 322: extract at least one image frame from the target video.
[0073] For step 322 , please refer to the description of step 220 above.
[0074] Step 323: perform image recognition on at least one image frame to obtain a corresponding category label.
[0075] For step 323 , please refer to the description of step 230 above.
[0076] Step 324, modifying the category label according to the camera information corresponding to the target video data.
[0077] Modify the category label, for example, add, modify or delete the current category label. For example, when the current category label is "person" and the camera information corresponding to the target video indicates that the front camera is turned on, the "person" label can be further modified to a "selfie" label to indicate that the current shooting scene is a user selfie.
[0078] Step 325: Determine the corresponding shooting effect based on the corrected category label and recommend it to the user.
[0079] For example, when the current tag includes the tag "selfie", shooting effects such as "face blocking", "face deformation" or "beautification" can be provided to the user.
[0080] Figure 3C FIG. 2 is a flow chart showing another embodiment of a method for recommending a shooting effect according to the present disclosure. Figure 3C As shown, the method 330 includes the following steps:
[0081] Step 331, obtaining description information of the target video and the historical videos shot by the user.
[0082] The historical video shot by the user can be a video stored locally or uploaded to the server. The description information of the historical video, for example, is the title, introduction or category label of the historical video.
[0083] Step 332: extract at least one image frame from the target video.
[0084] For step 332 , please refer to the description of step 220 above.
[0085] Step 333: perform image recognition on at least one image frame to obtain a corresponding category label.
[0086] For step 333 , please refer to the description of step 230 above.
[0087] Step 334, modifying the category label according to the description information of the historical video shot by the user.
[0088] The category tag is modified, for example, the current category tag is added, modified or deleted. For example, when the description information of the historical video shot by the user contains the keyword "funny", the "funny" tag can be added to the current category tag.
[0089] Step 335: determine the corresponding shooting effect based on the corrected category label and recommend it to the user.
[0090] For example, when the current tag includes the tag "funny", shooting effects such as funny stickers, funny sound effects or cheerful music may be provided to the user.
[0091] In an optional embodiment, the category label can be modified based on the audio data corresponding to the target video, the camera information corresponding to the target video, and the description information of the historical video taken by the user to improve the accuracy of the category label and thereby improve the accuracy of the shooting effect recommendation.
[0092] Figure 3D A flowchart of a specific example of a method for recommending shooting effects according to the present disclosure. Figure 3D As shown, the terminal device first obtains the target video, audio data and camera information (here referred to as feature information), that is, executes step 341, and then sends the above feature information to the server, that is, executes step 342. The server first extracts at least one image frame from the target video, and then performs image recognition on at least one image frame to obtain a category label, and then corrects the category label according to the audio data, camera information and the description information of the historical video (stored by itself), and finally determines the shooting effect according to the corrected category label, that is, executes steps 343-346. After determining the shooting effect, the server sends the shooting effect to the terminal device, that is, executes step 347. The terminal device finally applies the above shooting effect in shooting, that is, executes step 348.
[0093] Figure 4 FIG. 1 shows an exemplary block diagram of a device for recommending shooting effects according to an embodiment of the present disclosure. Figure 4As shown, the device 400 for recommending shooting effects includes: an acquisition module 410, used to obtain a target video, where the target video is shot by a user; an extraction module 420, used to extract at least one image frame from the target video; a recognition module 430, used to perform image recognition on the at least one image frame to obtain a corresponding category label; and a recommendation module 440, used to determine the corresponding shooting effect based on the category label and recommend it to the user.
[0094] It should be understood that Figure 4 The various modules of the apparatus 400 shown in FIG. Figure 2 The steps in the method 200 described above correspond to each other. Therefore, the operations, features and advantages described above for the method 200 are also applicable to the apparatus 400 and the modules included therein. For the sake of brevity, some operations, features and advantages are not described in detail here.
[0095] In an optional embodiment, the acquisition module 410 is further used to: acquire audio data corresponding to the target video. The recommendation module 440 is further used to: modify the category label according to the audio data corresponding to the target video data; determine the corresponding shooting effect according to the modified category label and recommend it to the user.
[0096] In an optional embodiment, the acquisition module 410 is further used to: acquire the camera information corresponding to the target video. The recommendation module 440 is further used to: modify the category label according to the camera information corresponding to the target video data; determine the corresponding shooting effect according to the modified category label and recommend it to the user.
[0097] In an optional embodiment, the acquisition module 410 is further used to: acquire description information of historical videos shot by the user. The recommendation module 440 is further used to: modify the category label according to the description information of the historical videos; determine the corresponding shooting effect according to the modified category label and recommend it to the user.
[0098] In an optional embodiment, the recommendation module 440 is further used to: obtain at least one candidate shooting effect; determine the recommendation score of each of the candidate shooting effects according to the category label; and determine the target shooting effect from the candidate shooting effects according to the recommendation score of each of the candidate shooting effects and recommend it to the user.
[0099] In an optional embodiment, the recommendation module 440 is also used to: when the recommendation score of the above-mentioned target shooting effect is greater than the first score threshold and the number is one, directly apply the above-mentioned target shooting effect in the current shooting; when the recommendation score of the above-mentioned target shooting effect is greater than the first score threshold and the number is multiple, or when the recommendation score of the above-mentioned target shooting effect is greater than the second score threshold and less than the first score threshold, provide an interactive interface to the user, and apply the above-mentioned target shooting effect in response to the user's operation in the above-mentioned recommendation interactive interface.
[0100] In an optional embodiment, the above-mentioned shooting effect includes at least one of a filter, a special effect and a sound.
[0101] In an optional embodiment, the candidate shooting effects include candidate shooting effects managed and maintained by operators. The recommendation module 440 is further configured to: when the candidate shooting effects managed and maintained by operators match the category labels, determine the candidate shooting effects managed and maintained by operators as target shooting effects and recommend them to users.
[0102] In an optional embodiment, the recommendation module 440 is also used to: determine a corresponding category label based on the above audio data; match the category label determined based on the above audio data with the category label determined based on the above target video; and adjust the recommendation score of the corresponding category label based on the matching result.
[0103] Figure 5 Schematic block diagram of an example electronic device 500 that can be used to implement embodiments of the present disclosure is shown. Figure 5 , a structural block diagram of an electronic device 500 that can serve as a server or client of the present disclosure will now be described, which is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein. Figure 5As shown, the electronic device 500 includes a computing unit 501, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 502 or a computer program loaded from a storage unit 508 into a random access memory (RAM) 503. In the RAM 503, various programs and data required for the operation of the device 500 can also be stored. The computing unit 501, the ROM 502, and the RAM 503 are connected to each other through a bus 504. An input / output (I / O) interface 505 is also connected to the bus 504. Multiple components in the device 500 are connected to the I / O interface 505, including: an input unit 706, such as a keyboard, a mouse, etc.; an output unit 507, such as various types of displays, speakers, etc.; a storage unit 508, such as a disk, an optical disk, etc.; and a communication unit 509, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 509 allows the device 500 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0104] The computing unit 501 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 501 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 501 performs the various methods and processes described above, such as the recommended method for shooting effects. For example, in some embodiments, the recommended method for shooting effects may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 508. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 500 via the ROM 502 and / or the communication unit 509. When the computer program is loaded into the RAM 503 and executed by the computing unit 501, one or more steps of the recommended method for shooting effects described above may be performed. Alternatively, in other embodiments, the computing unit 501 may be configured to perform the recommended method for shooting effects in any other appropriate manner (e.g., by means of firmware).
[0105] The various illustrative logics, logic blocks, modules, circuits, and algorithmic processes described in conjunction with the aspects disclosed herein may be implemented as electronic hardware, computer software, or a combination of both. The interchangeability of hardware and software has been generally described in terms of functionality and illustrated in the various illustrative components, blocks, modules, circuits, and processes described above. Whether such functionality is implemented in hardware or software depends on the specific application and design constraints on the overall system.
[0106] The hardware and data processing apparatus for implementing the various illustrative logics, logic blocks, modules and circuits described in conjunction with the aspects disclosed herein can be implemented or executed with a general purpose single-chip or multi-chip processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic, discrete hardware components, or any combination thereof designed to perform the functions described herein. A general purpose processor can be a microprocessor or any conventional processor, controller, microcontroller or state machine. The processor can also be implemented as a combination of computing devices, such as a combination of a DSP and a microprocessor, a plurality of microprocessors, one or more microprocessors combined with a DSP core, or any other such configuration. In some aspects, specific processes and methods can be performed by circuits specific to a given function.
[0107] In one or more aspects, the functions described may be implemented in hardware, digital electronic circuitry, computer software, firmware (including the structures disclosed in this specification and their equivalents), or any combination thereof. Aspects of the subject matter described in this specification may also be implemented as one or more computer programs, i.e., one or more modules of computer program instructions, encoded on computer storage media for execution by a data processing apparatus or to control the operation of the data processing apparatus.
[0108] If implemented in software, the function can be stored or transferred to a computer-readable medium as one or more instructions or codes. The process of the method or algorithm disclosed herein can be implemented in a software module executable by a processor, and the software module can reside on a computer-readable medium. Computer-readable media include computer storage media and communication media, and the communication media include any medium capable of transmitting a computer program from one place to another. The storage medium can be any available medium accessible by a computer. As an example and not limitation, this computer-readable medium may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, disk storage or other magnetic storage device, or any other medium that can be used to store the required program code in the form of an instruction or data structure and can be accessed by a computer. In addition, any connection can be appropriately referred to as a computer-readable medium. The disk (Disk) and disk (disc) used herein include high-density optical disks (CDs), laser disks, optical disks, digital versatile disks (DVDs), floppy disks and blue-ray disks, wherein the disk (Disk) usually copies data magnetically, and the disk (disc) copies data optically with lasers. The above combination should also be included in the scope of computer-readable media. Additionally, the operations of a method or algorithm may be implemented as one or any combination or set of codes and instructions on a machine-readable medium and a computer-readable medium, which may be incorporated into a computer program product.
[0109] Each embodiment in the present disclosure is described in a related manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, equipment embodiment, computer-readable storage medium embodiment, and computer program product embodiment, since they are basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
Claims
1. A method for recommending a shooting effect, comprising: Acquire a target video, where the target video is shot by a user; Extracting at least one image frame from the target video; Performing image recognition on the at least one image frame to obtain a corresponding category label; According to the category label, determine the corresponding shooting effect and recommend it to the user; Before determining the corresponding shooting effect according to the category label and recommending it to the user, the method further includes: Acquiring audio data corresponding to the target video; and The determining, based on the category label, a corresponding shooting effect and recommending it to the user includes: Modifying the category label according to the audio data corresponding to the target video data; According to the corrected category label, the corresponding shooting effect is determined and recommended to the user.
2. The method according to claim 1, wherein: Before determining the corresponding shooting effect according to the category label and recommending it to the user, the method further includes: Obtaining camera information corresponding to the target video; and The determining, based on the category label, a corresponding shooting effect and recommending it to the user includes: Modifying the category label according to the camera information corresponding to the target video data and the audio data corresponding to the target video data; According to the corrected category label, the corresponding shooting effect is determined and recommended to the user.
3. The method according to claim 1, wherein: Before determining the corresponding shooting effect according to the category label and recommending it to the user, the method further includes: Obtaining description information of historical videos shot by the user; and The determining, based on the category label, a corresponding shooting effect and recommending it to the user includes: Modifying the category label according to the description information of the historical video and the audio data corresponding to the target video data; According to the corrected category label, the corresponding shooting effect is determined and recommended to the user.
4. The method according to claim 1, wherein: The determining, based on the category label, a corresponding shooting effect and recommending it to the user includes: Obtain at least one candidate shooting effect; Determining a recommendation score for each of the candidate shooting effects according to the category label; According to the recommendation score of each of the candidate shooting effects, a target shooting effect is determined from the candidate shooting effects and recommended to the user.
5. The method according to claim 4, wherein: The determining a target shooting effect from the candidate shooting effects and recommending it to the user includes: When the recommendation score of the target shooting effect is greater than a first score threshold and the number is one, directly applying the target shooting effect in the current shooting; When the recommended score of the target shooting effect is greater than the first score threshold and the number is multiple, or when the recommended score of the target shooting effect is greater than the second score threshold and less than the first score threshold, an interactive interface is provided to the user, and the target shooting effect is applied in response to the user's operation on the recommendation interactive interface.
6. The method according to claim 1, wherein: The shooting effect includes at least one of a filter, a special effect and a sound.
7. The method according to claim 4, wherein: The candidate shooting effects include candidate shooting effects managed and maintained by an operator; and The determining the corresponding shooting effect according to the category label and recommending it to the user also includes: In a case where the candidate photographing effects managed and maintained by the operator match the category label, the candidate photographing effects managed and maintained by the operator are determined as target photographing effects and recommended to the user.
8. The method according to claim 1, wherein: The modifying of the category label according to the audio data corresponding to the target video data includes: Determining a corresponding category label according to the audio content of the audio data; A final category label is determined according to the category label determined by the audio content and the category label determined by the target video.
9. A device for recommending shooting effects, comprising: An acquisition module is used to acquire a target video, where the target video is shot by a user, and acquire audio data corresponding to the target video; An extraction module, used for extracting at least one image frame from the target video; A recognition module, used to perform image recognition on the at least one image frame to obtain a corresponding category label; The recommendation module is used to modify the category label according to the audio data corresponding to the target video data, and determine the corresponding shooting effect according to the modified category label and recommend it to the user.
10. A computer program product comprising program code instructions, which, when the program product is executed by a computer, cause the computer to perform the method of at least one of claims 1 to 8.
11. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to at least one of claims 1-8.
12. An electronic device comprising: processor, a memory in electronic communication with the processor; as well as Instructions, which are stored in the memory and can be executed by the processor to cause the electronic device to perform the method according to at least one of claims 1-8.
Citation Information
Patent Citations
Picture processing method and terminal
CN104580888A
Video template recommendation method and device
CN110177219A
Audio file recommendation method and device, electronic equipment and readable storage medium
CN112214636A
Live broadcast video recommendation method and device
CN113315988A
Shooting method and terminal
CN113727012A
