Video interaction method and device

Abstract

The embodiment of the invention provides a video interaction method, and the method comprises the steps: displaying a playing interface which comprises a video image, and the video image comprises at least one target object; in response to one selected target object, extracting the target object from the video picture, and generating a target image based on the target object; and displaying the target image on the playing interface. According to the technical scheme provided by the embodiment of the invention, the target image can be quickly captured and processed when the audience selects one target object in the video picture, and then the target image is displayed on the playing interface, so that visual instant feedback is provided for the audience, and the interaction effect is strongly related to the video content; and the interaction experience of audiences in the video playing process is effectively improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of live broadcast technology, and in particular, to a video interaction method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art

[0002] With the rapid development of the Internet and digital technology, watching videos and interacting with them is being accepted and loved by more and more people. However, current video technology mainly provides a passive viewing experience, and the interactive design is complex (such as sending bullet screens and posting comments), making it difficult for viewers to participate in real time, and the interactive effect is not strongly related to the video content, resulting in a poor overall interactive experience.

[0003] It should be noted that the above content is not necessarily prior art, nor is it intended to limit the scope of patent protection of this application. Summary of the invention

[0004] The embodiments of the present application provide a video interaction method, apparatus, computer device, computer-readable storage medium, and computer program product to solve or alleviate one or more of the technical problems raised above.

[0005] One aspect of an embodiment of the present application provides a video interaction method, the method comprising: Displaying a playback interface, wherein the playback interface includes a video screen, and the video screen includes at least one target object; In response to selecting one of the target objects, extracting the target object from the video picture, and generating a target image based on the target object; The target image is displayed on the playback interface.

[0006] Optionally, extracting the target object from the video screen and generating a target image based on the target object includes: Inputting the video image into a pre-trained image segmentation model to obtain the target object through the image segmentation model; A first image processing is performed on the target object to obtain the target image.

[0007] Optionally, displaying the target image on the playback interface includes: Compressing the target image to a first preset size to obtain a target thumbnail; The target thumbnail is displayed on the playback interface.

[0008] Optionally, the video interaction method further includes: In response to selecting the target thumbnail, enlarging the target thumbnail to a second preset size to obtain a target preview image; The target preview image is displayed on the playback interface.

[0009] Optionally, the playback interface further includes an interactive control, and the interactive control includes an on state and an off state; and the video interaction method further includes: In response to selecting the interactive control, the interactive control is switched from a closed state to an open state, and an interactive prompt is popped up, wherein the interactive prompt is used to guide the selection of the target object.

[0010] Optionally, the playback interface further includes a function area, and the function area includes a first function area; and the video interaction method further includes: In response to a first drag operation on the target image, displaying an image style setting panel, the image style setting panel being configured with a plurality of image style controls, the first drag operation being used to move the target image to the first function area; In response to selecting one of the image style controls, obtaining a corresponding image style; The target image is subjected to second image processing based on the corresponding image style to obtain an output image adapted to the corresponding image style.

[0011] Optionally, the playback interface further includes a comment area, and the video interaction method further includes: Generating a target bullet screen and / or a target comment according to the output image; Displaying the target bullet screen on the video screen; and / or displaying the target comment in the comment area.

[0012] Optionally, the functional area further includes a second functional area; and the video interaction method further includes: In response to a second drag operation on the target image, acquiring target content from a preset media database, the target content including media content matching the target image, the second drag operation being used to move the target image to the second functional area; The target content is displayed on the playback interface.

[0013] Optionally, the function area is associated with a preset dynamic special effect; and the video interaction method further includes: In response to a drag operation on the target image, a dynamic special effect of the function area is displayed, where the dynamic special effect is used to guide the execution of the first drag operation or the second drag operation.

[0014] Optionally, the video interaction method further includes: Based on the target image, acquiring target content from a preset media database, the target content including media content matching the target image; The target content is displayed on the playback interface.

[0015] Optionally, the video interaction method further includes: Based on the target image, obtaining description information of the target image; The description information of the target image is displayed on the playback interface.

[0016] Another aspect of the embodiments of the present application provides a video interaction device, the device comprising: A display module, used to display a playback interface, wherein the playback interface includes a video screen, and the video screen includes at least one target object; A generating module, configured to extract the target object from the video picture in response to selecting one of the target objects, and generate a target image based on the target object; A display module is used to display the target image on the playback interface.

[0017] Another aspect of an embodiment of the present application provides a computer device, including: at least one processor; and a memory communicatively coupled to the at least one processor; Wherein: the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method as described above.

[0018] Another aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method described above is implemented.

[0019] Another aspect of an embodiment of the present application provides a computer program product, including a computer program, which implements the above-mentioned method when executed by a processor.

[0020] The above technical solution adopted in the embodiment of the present application may have the following advantages: A playback interface including a video screen is displayed, wherein the video screen includes at least one target object. The viewer selects one of the target objects and presses continuously, and the target object can be extracted from the video screen to generate a target image, and the target image is displayed on the playback interface. It can be seen that the embodiment of the present application can quickly capture and process the target image when the viewer selects one of the target objects in the video screen, and then display it on the playback interface, thereby providing the viewer with intuitive and instant feedback, and the interactive effect is strongly related to the video content, effectively improving the audience's interactive experience during video playback. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] The accompanying drawings exemplarily illustrate the embodiments and constitute a part of the specification, and together with the text description of the specification, are used to explain the exemplary implementation of the embodiments. The embodiments shown are for illustrative purposes only and do not limit the scope of the claims. In all drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0022] Figure 1 The following schematically shows an operating environment diagram of the video interaction method according to the first embodiment of the present application; Figure 2 A flowchart of a video interaction method according to Embodiment 1 of the present application is schematically shown; Figure 3 Schematically shows Figure 2 Flow chart of sub-steps of step S202; Figure 4 Schematically shows Figure 2 Flow chart of sub-steps of step S204; Figure 5 The newly added flow chart of the video interaction method according to the first embodiment of the present application is schematically shown; Figure 6 Another newly added flow chart of the video interaction method according to the first embodiment of the present application is schematically shown; Figure 7 Another newly added flow chart of the video interaction method according to the first embodiment of the present application is schematically shown; Figure 8 A block diagram schematically shows a video interaction device according to Embodiment 2 of the present application; and Fig. 9 The hardware architecture diagram of the computer device according to the third embodiment of the present application is schematically shown. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0024] It should be noted that the descriptions involving "first", "second", etc. in the embodiments of the present application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in the field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0025] In the description of the present application, it should be understood that the numerical labels before the steps do not indicate the order in which the steps are executed, but are only used to facilitate the description of the present application and to distinguish each step, and therefore should not be understood as a limitation on the present application.

[0026] First, the following terms are explained: Cutout: Extract a specific object from a picture.

[0027] Distortion correction: Fix the distortion in images or videos caused by lens, angle or other factors.

[0028] Color correction: Adjust the colors in an image or video to make it more realistic, natural, or to meet specific visual requirements.

[0029] Emoticons: A type of material that expresses emotions through pictures or animated images.

[0030] Secondly, in order to facilitate those skilled in the art to understand the technical solutions provided in the embodiments of the present application, the relevant technologies are described below: With the rapid development of the Internet and digital technology, watching videos and interacting with them are being accepted and loved by more and more people. However, the applicant understands that the relevant video technology mainly provides a passive viewing experience, and the interactive design is complex (such as chatting, sending gifts and other functions require frequent switching operations), which makes it difficult for viewers to participate in real time. At the same time, the interactive effect is weakly related to the video content, and the audience may miss the opportunity to deeply understand the video content, thereby reducing the value of the video content and the overall interactive experience is poor.

[0031] To this end, the embodiment of the present application provides a video interaction technical solution. In this technical solution: (1) A video interaction method based on real-time matting is provided. When watching a video, the audience can achieve the matting of video content, emoticon package generation and video search through simple operations, thereby improving the overall interactive experience. (2) The audience can directly participate in content creation, and enhance the interactivity of the video through functions such as matting and emoticon package generation, thereby improving the viewing experience and sense of participation. (3) When the audience long presses, the image is quickly captured and processed, providing instant feedback, improving the interactive effect, and enhancing real-time performance. (4) The complex interactive process is simplified into an intuitive drag-and-drop operation, making it easier for the audience to use the interactive function, reducing the audience's learning cost, and increasing the frequency of interaction and usage experience. (5) The intelligent search algorithm quickly finds related videos based on the audience's matting results, enhancing the discoverability of the content and improving the audience's satisfaction. See below for details.

[0032] Finally, for ease of understanding, an exemplary operating environment is provided below.

[0033] like Figure 1 As shown, the operating environment diagram includes: service platform 2, anchor terminals (4A, 4B, ..., 4M), and audience terminals (6A, 6B, ..., 6N). In the live broadcast scenario, the anchor terminal (4A, 4B, ..., 4M) logs in to the service platform 2, and the service platform 2 pushes the live broadcast data to the audience terminal (6A, 6B, ..., 6N) in real time.

[0034] Service platform 2 can provide live broadcast service, which can be a single server, a server cluster or a cloud computing service center.

[0035] The anchor terminal (4A, 4B, ..., 4M) is used to generate live broadcast data in real time and perform streaming operations on the live broadcast data. The live broadcast data may include audio data or video data. The anchor terminal may be an electronic device such as a smart phone or a tablet computer. Of course, the anchor terminal may be a virtual computing instance in the service platform 2.

[0036] The audience terminal (6A, 6B, ..., 6N) may be configured to receive the live broadcast data of the anchor terminal in real time. The audience terminal (6A, 6B, ..., 6N) may be any type of computing device, such as a smart phone, a tablet device, a laptop computer, a smart TV, a vehicle-mounted terminal, etc. The audience terminal (6A, 6B, ..., 6N) may have a built-in browser or a special program, and receive the live broadcast data through the browser or the special program to output content to the user. The content may include video, audio, comments, text data and / or the like.

[0037] The audience terminal (6A, 6B, ..., 6N) may include a player. The player outputs (e.g., displays, presents) content to the user. The content may include video, audio, comments, text data and / or the like. The audience terminal (6A, 6B, ..., 6N) may include an interface, which may include an input element (touch screen). For example, the input element may be configured to receive user instructions, and the user instructions may enable the audience terminal (6A, 6B, ..., 6N) to perform various operations, such as sending a bullet screen, entering a comment, giving a gift, etc.

[0038] The anchor terminals (4A, 4B, ..., 4M), the audience terminals (6A, 6B, ..., 6N) and the service platform 2 may be connected via a network. The network may include various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls and / or proxy devices, etc. The network may include physical links, such as coaxial cable links, twisted pair cable links, optical fiber links, combinations thereof and / or the like. The network may include wireless links, such as cellular links, satellite links, Wi-Fi links and / or the like.

[0039] It should be noted that the number of the host terminals and the audience terminals in the figure is only for illustration and is not used to limit the scope of patent protection of this application. According to actual conditions, there can be any number of host terminals and audience terminals.

[0040] The following uses the viewer terminal (such as 6A) as the execution subject to introduce the technical solution of the present application through multiple embodiments. It should be noted that these embodiments can be implemented in a variety of different forms and should not be interpreted as being limited to the embodiments described here.

[0041] Embodiment 1 Figure 2 The flowchart of the video interaction method according to the first embodiment of the present application is schematically shown.

[0042] like Figure 2 As shown, the video interaction method may include steps S200 to S204, wherein: Step S200, displaying a playback interface, wherein the playback interface includes a video screen, and the video screen includes at least one target object.

[0043] Step S202 , in response to selecting one of the target objects, extracting the target object from the video frame, and generating a target image based on the target object.

[0044] Step S204: displaying the target image on the playback interface.

[0045] The video interaction method provided in this embodiment displays a playback interface including a video screen, wherein the video screen includes at least one target object. The viewer selects one of the target objects and presses it continuously, and the target object can be extracted from the video screen to generate a target image, and the target image is displayed on the playback interface. It can be seen that the embodiment of the present application can quickly capture the target object and process it to obtain the target image when the viewer selects one of the target objects in the video screen, and then display it on the playback interface, thereby providing the viewer with intuitive and instant feedback, and the interactive effect is strongly related to the video content, effectively improving the audience's interactive experience during video playback.

[0046] The following combination Figure 2 , each step in steps S200~S204 and other optional steps are explained in detail.

[0047] Step S200 , displaying a playback interface, the playback interface including a video screen, and the video screen including at least one target object.

[0048] The playback interface can be a web page or an application program interface, which is automatically loaded when the viewer plays the video. The playback interface can include a video screen. The video screen can include one or more target objects. The target object can be any element in the video screen, such as: a vehicle, a person, a vase, etc. The target object can be used as a cutout target to be identified and extracted.

[0049] Step S202 In response to selecting one of the target objects, the target object is extracted from the video picture, and a target image is generated based on the target object.

[0050] For example, the viewer can select any target object in the video screen by continuous pressing (long pressing), clicking, voice command, gesture operation, eye tracking, etc., and the target object can be extracted from the video screen and a target image can be generated. The target image can be the target object itself, or it can be an image obtained by resizing the target object or adding a background. There are many ways to extract the target object from the video screen, such as deep learning models, computer vision technology (such as image segmentation, edge monitoring, background removal, etc.). An exemplary solution is provided below.

[0051] In an optional embodiment, if Figure 3 As shown, step S202 may include: Step S300: input the video image into a pre-trained image segmentation model to obtain the target object through the image segmentation model.

[0052] Step S302: Perform a first image processing on the target object to obtain the target image.

[0053] Exemplarily, when the audience selects the target object, the real-time video screen is obtained and the video screen is input into a pre-trained image segmentation model (such as a convolutional neural network, CNN) to perform real-time image segmentation through the image segmentation model to ensure the efficiency and accuracy of image segmentation and processing, thereby obtaining an accurate target object (cutout result). The first image processing is performed on the target object to generate a target image to ensure its performance effect in the live broadcast. Among them, the first image processing includes distortion correction, color correction, denoising, etc. of the target object.

[0054] In this embodiment, through real-time image segmentation and processing, combined with efficient deep learning models and image enhancement technology, the target object can be accurately extracted and optimized, high-quality target images can be obtained, and its display effect in live broadcast can be optimized to meet the audience's interactive needs.

[0055] Step S204 , displaying the target image on the playback interface.

[0056] For example, the target image can be displayed floating on the upper layer of the video screen, or it can be displayed in other positions of the playback interface. Animation effects (such as fade-in, bounce, flash, etc.) can also be configured for the target image to ensure that the display of the target image (cutout result) is intuitive and eye-catching, thereby enhancing the interactive experience.

[0057] In an optional embodiment, the video interaction method may further include: obtaining description information of the target image based on the target image; and displaying the description information of the target image on the playback interface.

[0058] For example, the target image can be analyzed by computer vision technology to generate description information of the target object. The description information may include the content, emotion, color, etc. of the target image. The description information is displayed on the playback interface, for example, in a preset area around the target image, and of course, the description information can also be displayed in other areas of the playback interface.

[0059] In this embodiment, by displaying the description information of the target image, the video interactive experience can be further enhanced and the video content can be enriched.

[0060] Furthermore, the interactive experience can be further optimized by adjusting the target image. Some exemplary solutions are provided below.

[0061] In an optional embodiment, if Figure 4 As shown, step S204 may include: Step S400: compress the target image to a first preset size to obtain a target thumbnail.

[0062] Step S402: display the target thumbnail on the playback interface.

[0063] Exemplarily, an appropriate size (first preset size) may be preselected, which is smaller than the size of the target image. The target image may be compressed to the first preset size using an image compression algorithm, and may be converted into a target thumbnail. The target thumbnail is smaller in size than the target image, occupies less space on the playback interface, reduces the occlusion of the video screen, and further optimizes the live broadcast experience. The target thumbnail is displayed on the playback interface, and some animation effects may be added to the target thumbnail, such as fade in and fade out, to enhance the visual appeal.

[0064] In this embodiment, the target image is converted into a target thumbnail, which can ensure its efficient display on the playback interface and improve the visual effect and interactive experience.

[0065] Furthermore, the target thumbnail can be configured to be interactive, and the viewer can move the target thumbnail or adjust its size by clicking on it, thereby optimizing the interactive experience. An exemplary solution is provided below.

[0066] In an optional embodiment, if Figure 5 As shown, the video interaction method may further include: Step S500, in response to selecting the target thumbnail, enlarging the target thumbnail to a second preset size to obtain a target preview image.

[0067] Step S502: displaying the target preview image on the playback interface.

[0068] For example, a click event or a touch event can be configured for the target thumbnail to make it responsive. The viewer can click on the target thumbnail to enlarge the target thumbnail to a second preset size, obtain a target preview image and display it on the playback interface. The size of the target preview image is larger than the target thumbnail. Therefore, the viewer can view a larger image and more clearly view the details of the target object, thereby enhancing the interactive experience.

[0069] In this embodiment, by configuring an event for a target thumbnail, the audience can easily zoom in to view the details of the target object, thereby increasing the interactive experience.

[0070] The above embodiments exemplarily introduce the video interaction method, that is, the audience can cut out the video content in real time during the video playback and obtain instant feedback, and can further interact with the feedback results, effectively enhancing the audience interaction experience. The video interaction method will be further introduced in combination with more embodiments below.

[0071] In an optional embodiment, the playback interface may further include an interactive control, and the interactive control may include an on state and a off state. The interactive control may be configured in a high-visibility area of ​​the playback interface, such as within the video screen, at the bottom of the video screen, etc. Furthermore, the interactive control may also add a text description, such as "real-time matting", to briefly describe the function of the control. The interactive control may also use high-contrast colors and icons for easy identification by the audience. The video interaction method may also include: in response to selecting the interactive control, converting the interactive control from a closed state to an on state, and popping up an interactive prompt, wherein the interactive prompt is used to guide the selection of the target object.

[0072] For example, when the audience selects the interactive control, the interactive control can be switched from the off state to the on state to activate the real-time keying function. The playback interface can also pop up an interactive prompt to explain the purpose and operation method of the real-time keying function (such as "long press the video screen to key out the image"), thereby effectively guiding the audience to quickly select the target object.

[0073] In this embodiment, the real-time matting function can be flexibly turned on and off by configuring the interactive controls, and the audience can be effectively guided to perform operations through interactive prompts, thereby enhancing the audience's interactive ability.

[0074] In an optional embodiment, the playback interface may further include a function area, and the function area may include a first function area. Figure 6 As shown, the video interaction method may further include: Step S600: In response to a first drag operation on the target image, an image style setting panel is displayed, wherein the image style setting panel is configured with a plurality of image style controls. The first drag operation is used to move the target image to the first function area.

[0075] Step S602, in response to selecting one of the image style controls, obtaining the corresponding image style.

[0076] Step S604: performing a second image processing on the target image based on the corresponding image style to obtain an output image adapted to the corresponding image style.

[0077] Exemplarily, the audience can select the target image or target thumbnail and long press it, and then drag it to the first functional area. The first functional area can be for further image processing of the target image, for example: converting the target image into an emoticon package, applying artistic effects (such as cartoonization), adding filters, etc. Taking the conversion of the target image into an emoticon package as an example, when the target image is dragged to the first functional area, the playback interface can display the image style setting panel. The image style setting panel may include multiple image style controls, corresponding to multiple image styles, such as cute, funny, sad, etc. The audience selects one of the image style controls to obtain the corresponding image style. Based on the corresponding image style, the target image is subjected to a second image processing, and an output image (such as an emoticon package) corresponding to the image style video can be obtained. Among them, the second image processing may include adding text, emoticons, applying filters, adding animation effects, and converting formats. One or more.

[0078] In this embodiment, the matting result is dragged to the designated function area, and one-click (automatic) conversion of emoticons in various styles is supported, which can enhance the convenience of content discovery and sharing and promote social interaction.

[0079] In an optional embodiment, the playback interface may further include a comment area. The video interaction method may further include: generating a target bullet screen and / or a target comment according to the output image; displaying the target bullet screen on the video screen; and / or displaying the target comment in the comment area.

[0080] In this embodiment, the output image can be converted into barrage and / or comments and displayed accordingly on the video screen and / or comment area to improve the convenience of interaction and further optimize the video interaction effect.

[0081] In an optional embodiment, the functional area may further include a second functional area. Figure 7 As shown, the video interaction method may further include: Step S700: In response to a second drag operation on the target image, target content is acquired from a preset media database, the target content including media content matching the target image. The second drag operation is used to move the target image to the second function area.

[0082] Step S702: display the target content on the playback interface.

[0083] Exemplarily, the audience can select a target image or a target thumbnail and drag it to the second functional area, and the second functional area can be used to search for media content related to the target image. Media content may include web pages, videos, music, pictures, live broadcasts, etc. Taking the search for videos related to the target image as an example, when the target image is dragged to the second functional area, a preset intelligent search algorithm can be enabled to quickly find and return target content (related videos) that matches the target image in a preset video database. Among them, the intelligent search algorithm can be combined with image feature extraction technology to ensure the accuracy and timeliness of the search. In some embodiments, the search results (target content) can also be optimized according to the audience's operating habits and preferences to further improve audience satisfaction.

[0084] The target content can be displayed on the video screen or other areas of the playback interface. The audience can select the target content, and a new video window will pop up on the playback interface or directly jump to a new page to watch.

[0085] In this embodiment, the matting result is dragged to the designated functional area, and the intelligent search algorithm is automatically used to quickly find and form visual feedback, which improves the convenience of content discovery and sharing. The audience can quickly find the content of interest and promote video interaction.

[0086] In an optional embodiment, the video interaction method may further include: based on the target image, acquiring target content from a preset media database, the target content including media content matching the target image; and displaying the target content on the playback interface.

[0087] In this embodiment, after obtaining the target image, matching media content can be directly searched from a preset media database based on the target image, and the target content can be obtained and displayed on the playback interface (the video screen or other areas of the playback interface) without responding to drag operations, thereby further simplifying the video interaction process and improving the interactive experience.

[0088] In an optional embodiment, the function area may be associated with a preset dynamic special effect (such as flashing, color change, border thickening, etc.). The video interaction method may also include: in response to a drag operation on the target image, displaying the dynamic special effect of the function area, the dynamic special effect is used to guide the execution of the first drag operation or the second drag operation.

[0089] For example, when the viewer drags the target image, the function area can be dynamically highlighted to guide the viewer to drag the target image to the function area. The function area can also present visual feedback (such as flashing, color change) when the viewer drags the target image, prompting the viewer that the function area can be placed with the target image.

[0090] In this embodiment, real-time visual feedback is provided for the functional area so that the audience can identify the target area of ​​the drag, thereby ensuring the smoothness of the audience experience.

[0091] In order to make the present application easier to understand, an exemplary application is provided below.

[0092] S1: Display the playback interface, which includes a video screen, interactive controls, and a function area, wherein the video screen includes at least one target object, and the function area includes a first function area (one-click conversion of emoticons) and a second function area (related video search).

[0093] S2: The viewer clicks the interactive control to turn on the real-time cutout function.

[0094] S3: The viewer long presses any target object in the video screen, and the system calls the image processing module, uses the pre-trained deep learning model to extract the target object from the video screen, and generates a target image.

[0095] S4: Convert the target image into a target thumbnail and display it on the playback interface.

[0096] S5: The viewer clicks on the target thumbnail to view a larger preview of the target.

[0097] S6: The viewer selects the target thumbnail and long presses it, then drags it to the function area. During the dragging process, the system dynamically highlights the draggable function area and provides visual feedback (such as flashing or color change) to prompt the viewer that the target can be placed, thereby enhancing the viewer's operation guidance.

[0098] S7: If dragged to the first function area, an image style setting panel pops up, providing a variety of image style controls for the audience to choose from, and converting the target image into an emoticon package based on the image style selected by the audience.

[0099] S8: If dragged to the second function area, the target image is searched for related videos (target content) in the video database of the station based on the target image, combined with image feature extraction technology and intelligent search algorithm, and returned and displayed on the playback interface. The audience can click to watch the related video.

[0100] In this exemplary application: (1) A video interaction method based on real-time matting is provided. When watching a video, the audience can use simple operations to cut out the video content, generate emoticons, and search for videos, thereby improving the overall interactive experience. (2) The audience can directly participate in content creation, and enhance the interactivity of the video through functions such as cutting out and generating emoticons, thereby improving the viewing experience and sense of participation. (3) When the audience long presses, the image is quickly captured and processed, providing instant feedback, improving the interactive effect, and enhancing real-time performance. (4) The complex interactive process is simplified into an intuitive drag-and-drop operation, making it easier for the audience to use the interactive function, reducing the audience's learning cost, and increasing the frequency of interaction and usage experience. (5) The intelligent search algorithm quickly finds relevant videos based on the audience's matting results, enhancing the discoverability of the content and improving audience satisfaction.

[0101] Embodiment 2 Figure 8 The block diagram of the video interaction device according to the second embodiment of the present application is schematically shown. The device can be divided into one or more program modules, one or more program modules are stored in a storage medium, and are executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Figure 8 As shown, the device 1000 may include: a display module 1100, a generation module 1200 and a presentation module 1300, wherein: The display module 1100 is used to display a playback interface, wherein the playback interface includes a video screen, and the video screen includes at least one target object; A generating module 1200 is configured to extract the target object from the video picture in response to selecting one of the target objects, and generate a target image based on the target object; The display module 1300 is used to display the target image on the playback interface.

[0102] As an optional embodiment, extracting the target object from the video screen and generating a target image based on the target object includes: Inputting the video image into a pre-trained image segmentation model to obtain the target object through the image segmentation model; A first image processing is performed on the target object to obtain the target image.

[0103] As an optional embodiment, displaying the target image on the playback interface includes: Compressing the target image to a first preset size to obtain a target thumbnail; The target thumbnail is displayed on the playback interface.

[0104] As an optional embodiment, the device 1000 is further used for: In response to selecting the target thumbnail, enlarging the target thumbnail to a second preset size to obtain a target preview image; The target preview image is displayed on the playback interface.

[0105] As an optional embodiment, the playback interface further includes an interactive control, and the interactive control includes an on state and an off state; the device 1000 is further used for: In response to selecting the interactive control, the interactive control is switched from a closed state to an open state, and an interactive prompt is popped up, wherein the interactive prompt is used to guide the selection of the target object.

[0106] As an optional embodiment, the playback interface further includes a function area, and the function area includes a first function area; the device 1000 is further used for: In response to a first drag operation on the target image, displaying an image style setting panel, the image style setting panel being configured with a plurality of image style controls, the first drag operation being used to move the target image to the first function area; In response to selecting one of the image style controls, obtaining a corresponding image style; The target image is subjected to second image processing based on the corresponding image style to obtain an output image adapted to the corresponding image style.

[0107] As an optional embodiment, the playback interface further includes a comment area, and the device 1000 is further used for: Generating a target bullet screen and / or a target comment according to the output image; Displaying the target bullet screen on the video screen; and / or displaying the target comment in the comment area.

[0108] As an optional embodiment, the functional area further includes a second functional area; and the device 1000 is further used for: In response to a second drag operation on the target image, acquiring target content from a preset media database, the target content including media content matching the target image, the second drag operation being used to move the target image to the second functional area; The target content is displayed on the playback interface.

[0109] As an optional embodiment, the function area is associated with a preset dynamic special effect; the device 1000 is also used for: In response to a drag operation on the target image, a dynamic special effect of the function area is displayed, where the dynamic special effect is used to guide the execution of the first drag operation or the second drag operation.

[0110] As an optional embodiment, the apparatus 1000 is further used for: Based on the target image, acquiring target content from a preset media database, the target content including media content matching the target image; The target content is displayed on the playback interface.

[0111] As an optional embodiment, the apparatus 1000 is further used for: Based on the target image, obtaining description information of the target image; The description information of the target image is displayed on the playback interface.

[0112] Embodiment 3 Fig. 9 The schematic diagram of the hardware architecture of a computer device 10000 suitable for implementing the video interaction method according to the third embodiment of the present application is shown schematically. In some embodiments, the computer device 10000 may be a terminal device such as a smart phone, a wearable device, a tablet computer, a personal computer, a vehicle terminal, a game console, a virtual device, a workbench, a digital assistant, a set-top box, a robot, etc. In other embodiments, the computer device 10000 may be a rack server, a blade server, a tower server, or a cabinet server (including an independent server, or a server cluster composed of multiple servers), etc. Fig. 9 As shown, the computer device 10000 includes but is not limited to: a memory 10010, a processor 10020, and a network interface 10030 that can communicate with each other through a system bus. Among them: The memory 10010 includes at least one type of computer-readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (such as SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic disk, optical disk, etc. In some embodiments, the memory 10010 can be an internal storage module of the computer device 10000, such as a hard disk or memory of the computer device 10000. In other embodiments, the memory 10010 can also be an external storage device of the computer device 10000, such as a plug-in hard disk equipped on the computer device 10000, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. Of course, the memory 10010 can also include both the internal storage module of the computer device 10000 and its external storage device. In this embodiment, the memory 10010 is generally used to store the operating system and various application software installed in the computer device 10000, such as the program code of the video interaction method, etc. In addition, the memory 10010 can also be used to temporarily store various data that have been output or will be output.

[0113] In some embodiments, the processor 10020 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other chips. The processor 10020 is generally used to control the overall operation of the computer device 10000, such as performing control and processing related to data interaction or communication with the computer device 10000. In this embodiment, the processor 10020 is used to run the program code stored in the memory 10010 or process data.

[0114] The network interface 10030 may include a wireless network interface or a wired network interface, and the network interface 10030 is generally used to establish a communication link between the computer device 10000 and other computer devices. For example, the network interface 10030 is used to connect the computer device 10000 to an external terminal through a network, and to establish a data transmission channel and a communication link between the computer device 10000 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile communication (GSM), Wideband Code Division Multiple Access (WCDMA), 4G network, 5G network, Bluetooth, Wi-Fi, etc.

[0115] It should be pointed out that Fig. 9 Only a computer device having components 10010 - 10030 is shown, but it should be understood that implementation of all of the components shown is not a requirement, and more or fewer components may alternatively be implemented.

[0116] In this embodiment, the video interaction method stored in the memory 10010 can also be divided into one or more program modules and executed by one or more processors (such as processor 10020) to complete the embodiment of the present application.

[0117] Embodiment 4 An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the steps of the video interaction method in the embodiment.

[0118] In this embodiment, the computer-readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as a hard disk or memory of the computer device. In other embodiments, the computer-readable storage medium may also be an external storage device of a computer device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the computer device. Of course, the computer-readable storage medium may also include both the internal storage unit of the computer device and its external storage device. In this embodiment, the computer-readable storage medium is generally used to store an operating system and various application software installed on the computer device, such as the program code of the video interaction method in the embodiment, etc. In addition, the computer-readable storage medium may also be used to temporarily store various types of data that have been output or are to be output.

[0119] Embodiment 5 An embodiment of the present application also provides a computer program product, including a computer program, which implements the method in the above embodiment when executed by a processor.

[0120] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present application can be implemented by general-purpose computer devices, they can be concentrated on a single computer device, or distributed on a network composed of multiple computer devices, optionally, they can be implemented by executable program codes of computer devices, so that they can be stored in a storage device and executed by the computer device, and in some cases, the steps shown or described can be executed in a different order from that herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0121] It should be noted that the above are only preferred embodiments of the present application, and the patent protection scope of the present application is not limited thereto. Any equivalent structure or equivalent process transformation made using the contents of the specification and drawings of the present application, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A video interaction method, characterized in that: The method comprises: Displaying a playback interface, wherein the playback interface includes a video screen, and the video screen includes at least one target object; In response to selecting one of the target objects, extracting the target object from the video picture, and generating a target image based on the target object; The target image is displayed on the playback interface.

2. The method according to claim 1, characterized in that Extracting the target object from the video screen and generating a target image based on the target object includes: Inputting the video image into a pre-trained image segmentation model to obtain the target object through the image segmentation model; A first image processing is performed on the target object to obtain the target image.

3. The method according to claim 1, characterized in that Displaying the target image on the playback interface includes: Compressing the target image to a first preset size to obtain a target thumbnail; The target thumbnail is displayed on the playback interface.

4. The method according to claim 3, characterized in that The method further comprises: In response to selecting the target thumbnail, enlarging the target thumbnail to a second preset size to obtain a target preview image; The target preview image is displayed on the playback interface.

5. The method according to claim 1, characterized in that The playback interface also includes an interactive control, and the interactive control includes an on state and a off state; the method also includes: In response to selecting the interactive control, the interactive control is switched from a closed state to an open state, and an interactive prompt is popped up, wherein the interactive prompt is used to guide the selection of the target object.

6. The method according to any one of claims 1 to 5, characterized in that: The playback interface further includes a function area, and the function area includes a first function area; the method further includes: In response to a first drag operation on the target image, displaying an image style setting panel, the image style setting panel being configured with a plurality of image style controls, the first drag operation being used to move the target image to the first function area; In response to selecting one of the image style controls, obtaining a corresponding image style; The target image is subjected to second image processing based on the corresponding image style to obtain an output image adapted to the corresponding image style.

7. The method according to claim 6, characterized in that The playback interface also includes a comment area, and the method further includes: Generating a target bullet screen and / or a target comment according to the output image; Displaying the target bullet screen on the video screen; and / or displaying the target comment in the comment area.

8. The method according to claim 6, characterized in that The functional area also includes a second functional area; and the method further includes: In response to a second drag operation on the target image, acquiring target content from a preset media database, the target content including media content matching the target image, the second drag operation being used to move the target image to the second functional area; The target content is displayed on the playback interface.

9. The method according to claim 8, characterized in that The function area is associated with a preset dynamic special effect; the method further includes: In response to a drag operation on the target image, a dynamic special effect of the function area is displayed, where the dynamic special effect is used to guide the execution of the first drag operation or the second drag operation.

10. The method according to claim 1, characterized in that The method further comprises: Based on the target image, acquiring target content from a preset media database, the target content including media content matching the target image; The target content is displayed on the playback interface.

11. The method according to claim 1, characterized in that: The method further comprises: Based on the target image, obtaining description information of the target image; The description information of the target image is displayed on the playback interface.

12. A video interactive device, characterized in that: The device comprises: A display module, used to display a playback interface, wherein the playback interface includes a video screen, and the video screen includes at least one target object; A generating module, configured to extract the target object from the video picture in response to selecting one of the target objects, and generate a target image based on the target object; A display module is used to display the target image on the playback interface.

13. A computer device, characterized in that: include: at least one processor; and a memory communicatively connected to the at least one processor; wherein: The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 11.

14. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method according to any one of claims 1 to 11 is implemented.

15. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to claims 1 to 11 are implemented.

Images