Video interaction method, device, computer and readable storage medium

Abstract

The embodiments of the present application disclose a video interaction method, device, computer, and readable storage medium, which relate to computer vision technology in the field of artificial intelligence. The method includes: displaying N video windows on a video interaction page; N is a positive integer; when a graphic prompt box is displayed on the video interaction page, obtaining a video interaction image from the video screens displayed respectively in the N video windows; the content of the video interaction image is the content of the area covered by the graphic prompt box in the N video screens; if the video interaction image matches the virtual image indicated by the graphic prompt box, then displaying the virtual resource associated with the virtual image. Using this application, it is possible to enrich the triggering methods of virtual resources and improve the flexibility of virtual resource triggering.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a video interaction method, device, computer, and readable storage medium. Background Art

[0002] With the development of the Internet, the ways of promoting products and users obtaining virtual resources are becoming more and more diverse, allowing users to obtain the virtual resources they may need in different scenarios, making the distribution of virtual resources more convenient. In the field of social communication, users often need to send communication messages during the chat process. When the server detects that the communication message hits a pre-set keyword, etc., it is considered that the user has triggered the virtual resource. The server sends the virtual resource to the user device where the user is located, so that the user often needs to actively send a message including keywords related to the virtual resource in order to obtain the virtual resource. In this case, the communication message sent by the user to obtain the virtual resource is likely to be irrelevant to the conversation content, resulting in a messy communication content, thereby affecting normal communication. Moreover, the above methods of triggering virtual resources are relatively simple, making the triggering of virtual resources less flexible. Summary of the Invention

[0003] The embodiments of the present application provide a video interaction method, device, computer, and readable storage medium, which can enrich the triggering methods of virtual resources and improve the flexibility of virtual resource triggering.

[0004] On the one hand, an embodiment of the present application provides a video interaction method, the method comprising:

[0005] Display N video windows on the video interaction page; N is a positive integer;

[0006] When a graphic prompt box is displayed in a video interaction page, a video interaction image is obtained from the video screens displayed in the N video windows respectively; the content of the video interaction image is the content of the area covered by the graphic prompt box in the N video screens;

[0007] If the video interaction image matches the virtual image indicated by the graphic prompt box, the virtual resources associated with the virtual image are displayed.

[0008] In one aspect, an embodiment of the present application provides a video interaction device, the device comprising:

[0009] The window display module is used to display N video windows in the video interaction page; N is a positive integer;

[0010] An image acquisition module is used to acquire a video interaction image from the video screens displayed in the N video windows when the graphic prompt box is displayed in the video interaction page; the content of the video interaction image is the content of the area covered by the graphic prompt box in the N video screens;

[0011] The resource display module is used to display the virtual resources associated with the virtual image if the video interaction image matches the virtual image indicated by the graphic prompt box.

[0012] The resource display module includes:

[0013] a virtual image display unit, configured to display a virtual image if the video interaction image matches the virtual image indicated by the graphic prompt box;

[0014] The resource display unit is used to switch the virtual image to display the virtual resources associated with the virtual image.

[0015] The virtual image display unit is specifically used for:

[0016] If the video interaction image matches the virtual image indicated by the graphic prompt box, a mask layer is added to the video interaction page, and the virtual image is displayed in the mask layer.

[0017] The resource display unit includes:

[0018] An icon display subunit, configured to switch and display the virtual image into at least two virtual resource icons;

[0019] The resource triggering subunit is configured to respond to a triggering operation on a target virtual resource icon among the at least two virtual resource icons and display a target virtual resource corresponding to the target virtual resource icon.

[0020] The device further comprises:

[0021] A component display module, configured to respond to a trigger operation on a virtual resource and display a resource trigger component of the virtual resource;

[0022] The component trigger module is used to respond to the trigger operation of the resource trigger component and display a prompt message indicating that the virtual resource has been successfully obtained.

[0023] The image acquisition module includes:

[0024] A window adjustment unit is configured to adjust the display of the N video windows when a graphic prompt box is displayed on a video interaction page and there is a non-overlapping video window among the N video windows; a non-overlapping video window refers to a video window with no overlapping area with the graphic prompt box; and after the adjustment, there is no non-overlapping video window among the N video windows;

[0025] The image acquisition unit is used to acquire the video interaction image from the video pictures respectively displayed in the N video windows after the adjustment display.

[0026] The window adjustment unit includes:

[0027] The window scaling subunit is used to, when a graphic prompt box is displayed on a video interaction page and there are non-overlapping video windows among N video windows, and the N video windows are displayed in a single dimension, extend the non-overlapping video windows among the N video windows along the display dimension, and shrink the intersecting video windows among the N video windows along the display dimension; intersecting video windows refer to video windows other than the non-overlapping video windows among the N video windows; and single-dimensional display refers to single-row display or single-column display;

[0028] The single-dimensional display subunit is used to display the adjusted N video windows in a single dimension.

[0029] The window adjustment unit includes:

[0030] The area acquisition subunit is used to obtain the prompt display area in the video interaction page when a graphic prompt box is displayed in the video interaction page and there is a non-overlapping video window among N video windows, and the N video windows are multi-dimensionally displayed; multi-dimensional display means displaying in at least two rows and at least two columns; the prompt display area refers to a continuous rectangular area that does not include non-overlapping video windows;

[0031] The size adjustment subunit is used to insert non-overlapping video windows into the prompt display area, adjust the sizes of N video windows according to the insertion positions of the non-overlapping video windows in the prompt display area, and display the N video windows after size adjustment; the regular display area refers to the area where the non-overlapping video windows are located.

[0032] The device further comprises:

[0033] The duration trigger module is used to obtain the video startup duration corresponding to the video interaction page. If the video startup duration is greater than or equal to the resource trigger time threshold, a graphic prompt box is displayed on the video interaction page.

[0034] The device further comprises:

[0035] The voice conversion module is used to obtain the voice data of the target object, convert the voice data into text, and obtain the text data corresponding to the voice data;

[0036] The text segmentation module is used to perform word segmentation processing on the text data to obtain M word segmentation phrases; M is a positive integer;

[0037] The key trigger module is used to obtain the graphic prompt box corresponding to the resource keyword if there is a resource keyword in the M word segmentation phrases, and display the graphic prompt box in the video interaction page.

[0038] The key trigger module includes:

[0039] A frequency counting unit is used to obtain the historical statistical frequency of the resource keyword in the interactive video corresponding to the video interactive page if the resource keyword exists in the M segmented word phrases;

[0040] The prompt display unit is used to obtain a graphic prompt box corresponding to the resource keyword if the historical statistical number is greater than or equal to the resource triggering number threshold, and display the graphic prompt box in the video interaction page.

[0041] The image acquisition module includes:

[0042] a window information acquisition unit configured to, when a graphic prompt box is displayed on a video interaction page, acquire window position information and window size information of each video window, intercept the video interaction page displaying the graphic prompt box, determine the intercepted video interaction page as a prompt image, and send the window position information, window size information, and prompt image to a video processing device, so that the video processing device pre-adjusts the prompt image based on the window position information and window size information to obtain adjustment position information and adjustment size information;

[0043] An adjustment information receiving unit, configured to receive the adjustment position information and the adjustment size information sent by the video processing device, and display the adjusted N video windows on the video interaction page according to the adjustment position information and the adjustment size information;

[0044] The image acquisition unit is further configured to acquire a video interaction image from the video frames respectively displayed in the adjusted N video windows.

[0045] The image acquisition module includes:

[0046] An image generation unit is configured to obtain, when a graphic prompt box is displayed in a video interaction page, image pixels covered by the graphic prompt box from the video images displayed in the N video windows, and compose a video interaction image from the image pixels covered by the graphic prompt box;

[0047] The device also includes:

[0048] The color value comparison module is used to obtain the pixel color difference value between the image pixels that make up the video interactive image. If the pixel color difference value belongs to the graphic fill color value range, it is determined that the video interactive image matches the virtual image indicated by the graphic prompt box; the graphic fill color value range is the color value range indicated by the graphic prompt box.

[0049] The device further comprises:

[0050] an identification acquisition module, for acquiring window identifications corresponding to the N video windows if there is a non-overlapping video window among the N video windows; a non-overlapping video window refers to a video window with no overlapping area with the graphic prompt box;

[0051] A page generation module is used to generate a simulation window page according to the window position information, the window size information and the window identifier; the simulation window page includes N simulation windows, and the video windows with the same window identifier correspond to the simulation windows;

[0052] an information determination module for pre-adjusting the N simulated windows included in the simulated window page to obtain adjustment position information and adjustment size information; the adjustment position information and adjustment size information are used to indicate the position information and size information of the N simulated windows after adjustment in the simulated window page, and are used to indicate the position information and size information corresponding to the N window identifiers;

[0053] An adjustment display module, configured to adjust and display the video windows respectively associated with the N window identifiers according to the adjustment position information and the adjustment size information;

[0054] The image acquisition module is specifically used to:

[0055] Video interaction images are obtained from the video images respectively displayed in the adjusted N video windows.

[0056] The device further comprises:

[0057] A mask generation module is used to obtain a virtual image corresponding to the graphic prompt box and generate a video window mask layer in the prompt image based on the virtual image;

[0058] A mask division module is used to divide the video window mask layer into N window sub-mask layers associated with N video windows according to the window position information and the window size information;

[0059] A ratio determination module is used to obtain the image color value information of the virtual image and obtain the pixel ratio of the image pixels in the i-th window sub-mask layer that match the image color value information; i is a positive integer less than or equal to N;

[0060] a cross determination module, configured to determine that the i-th video window corresponding to the i-th window sub-mask layer is a cross video window if the pixel ratio is greater than or equal to the image display threshold;

[0061] The non-overlapping determination module is used to determine that the i-th video window corresponding to the i-th window sub-mask layer is a non-overlapping video window if the pixel ratio is less than the image display threshold.

[0062] The information determination module includes:

[0063] A first window acquisition unit is configured to acquire a simulation prompt area in a simulation window page and acquire a first simulation window included in the simulation prompt area; the simulation prompt area is a continuous rectangular area that does not include simulation windows corresponding to non-overlapping video windows; the N simulation windows also include a second simulation window corresponding to the non-overlapping video window, and a third simulation window other than the first simulation window and the second simulation window;

[0064] A first adjusting unit, configured to adjust the sizes of the second simulation window and the first simulation window, and display the adjusted first simulation window and second simulation window in the simulation prompt area;

[0065] a second adjusting unit, configured to stretch the third simulation window and display the adjusted third simulation window in an area other than the simulation prompt area of the simulation window page;

[0066] The information determining unit is used to determine the adjustment position information and the adjustment size information according to the adjusted N simulation windows.

[0067] The N simulation windows include the fourth simulation window and the fifth simulation window corresponding to the non-overlapping video window; the fourth simulation window is the simulation window other than the fifth simulation window among the N simulation windows;

[0068] The information determination module includes:

[0069] a third adjustment unit, configured to, if the N simulation windows are displayed in a single dimension, shrink the fourth simulation window and stretch the fifth simulation window, and display the adjusted fourth and fifth simulation windows on the simulation window page; an overlapping area exists between the adjusted fourth simulation window and the graphic prompt box;

[0070] The information determining unit is further configured to determine adjustment position information and adjustment size information according to the adjusted N simulation windows.

[0071] On the one hand, an embodiment of the present application provides a computer device, including a processor, a memory, and an input and output interface;

[0072] The processor is connected to the memory and the input and output interface respectively, wherein the input and output interface is used to receive and output data, the memory is used to store computer programs, and the processor is used to call the computer program so that the computer device including the processor executes the video interaction method in one aspect of an embodiment of the present application.

[0073] On the one hand, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program. The computer program is suitable for being loaded and executed by a processor so that a computer device having the processor executes the video interaction method in one aspect of the embodiment of the present application.

[0074] In one aspect, an embodiment of the present application provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the method provided in various optional embodiments of the embodiment of the present application.

[0075] Implementing the embodiments of this application will have the following beneficial effects:

[0076] In an embodiment of the present application, N video windows are displayed in a video interaction page; N is a positive integer; when a graphic prompt box is displayed in the video interaction page, a video interaction image is obtained from the video screens displayed in each of the N video windows; the content of the video interaction image is the content of the area covered by the graphic prompt box in the N video screens; if the video interaction image matches the virtual image indicated by the graphic prompt box, the virtual resource associated with the virtual image is displayed. Through the above process, the virtual resource can be triggered during the video interaction process, and the virtual resource can be triggered by the video screen displayed in each video window, and the video screen displayed in the video window is the screen of the device participating in the video interaction process, so that each terminal device can participate in the triggering process of the virtual resource, thereby improving the interactivity between each terminal device and enriching the video interaction function. In addition, since each terminal device participates in the triggering process of the virtual resource, the participation of each terminal device in the virtual resource is improved, thereby improving the promotion effect of the virtual resource, and further enriching the triggering method of the virtual resource and improving the flexibility of the virtual resource triggering. BRIEF DESCRIPTION OF THE DRAWINGS

[0077] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0078] Figure 1 This is a network interaction architecture diagram of a video interaction provided by an embodiment of the present application;

[0079] Figure 2 This is a schematic diagram of a video interaction scenario provided by an embodiment of the present application;

[0080] Figure 3 This is a flow chart of a video interaction method provided by an embodiment of the present application;

[0081] Figure 4 This is a schematic diagram of a video interactive image processing process provided by an embodiment of the present application;

[0082] Figure 5 The embodiment of the present application provides a schematic diagram of a resource display scenario;

[0083] Figure 6 This is a schematic diagram of a simulated window creation scenario provided by an embodiment of the present application;

[0084] Figure 7a This is a schematic diagram of a window adjustment scenario in a single-column display provided by an embodiment of the present application;

[0085] Figure 7b This is a schematic diagram of a window adjustment scenario under a single-line display provided by an embodiment of the present application;

[0086] Figure 8 This is a schematic diagram of an edge window adjustment scenario provided by an embodiment of the present application;

[0087] Figure 9 This is a schematic diagram of an intermediate window adjustment scenario provided by an embodiment of the present application;

[0088] Figure 10 This is an interactive flow chart of a video interaction scenario provided by an embodiment of the present application;

[0089] Figure 11 This is a schematic diagram of a video interaction device provided in an embodiment of the present application;

[0090] Figure 12 It is a structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0091] The following will be combined with the accompanying drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of this application.

[0092] Among them, the embodiments of the present application can use artificial intelligence technology to identify and process videos, etc., specifically, it can realize the recognition and adjustment of video images, etc., and can also realize the user's voice recognition, etc. Among them, the present application can specifically involve computer vision technology and voice technology in the field of artificial intelligence, etc., to improve the efficiency of the implementation of the solution in this application.

[0093] Artificial Intelligence (AI) refers to the theories, methods, techniques, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, to perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that seeks to understand the essence of intelligence and produce new intelligent machines that can respond in a manner similar to human intelligence. AI also encompasses the study of the design principles and implementation methods of various intelligent machines, enabling them to possess the capabilities of perception, reasoning, and decision-making.

[0094] Artificial intelligence (AI) technology is a comprehensive discipline encompassing a wide range of fields, encompassing both hardware and software technologies. Foundational AI technologies generally include sensors, specialized AI chips, cloud computing, distributed storage, big data processing, operating / interaction systems, and mechatronics. AI software technologies primarily encompass computer vision, speech processing, natural language processing, as well as machine learning / deep learning, autonomous driving, and smart transportation.

[0095] Computer vision (CV) is the science of making machines "see." Specifically, it refers to the use of cameras and computers to replace the human eye in identifying, tracking, and measuring objects. Further image processing is performed to transform the computer-generated images into images more suitable for human observation or transmission to instrumentation. As a scientific discipline, computer vision studies related theories and technologies, aiming to build artificial intelligence systems capable of extracting information from images or multidimensional data. Computer vision technologies typically include image processing, image recognition, image semantic understanding, image retrieval, optical character recognition (OCR), video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, autonomous driving, and smart transportation. It also includes common biometric recognition technologies such as facial recognition and fingerprint recognition.

[0096] Key technologies in speech technology include automatic speech recognition, speech synthesis, and voiceprint recognition. Enabling computers to hear, see, speak, and feel is the future direction of human-computer interaction, with speech becoming one of the most promising methods of human-computer interaction.

[0097] With the research and progress of artificial intelligence technology, artificial intelligence technology has been studied and applied in many fields, such as common smart homes, smart wearable devices, virtual assistants, smart speakers, smart marketing, unmanned driving, automatic driving, drones, robots, smart medical care, smart customer service, Internet of Vehicles, automatic driving, smart transportation, etc. It is believed that with the development of technology, artificial intelligence technology will be applied in more fields and play an increasingly important role.

[0098] The solutions provided in the embodiments of this application involve artificial intelligence computer vision and speech technologies, and are specifically described through the following embodiments:

[0099] In the examples of this application, see Figure 1 , Figure 1 This is a network interaction architecture diagram for video interaction provided by an embodiment of the present application. The embodiment of the present application can be implemented by a video processing device and a terminal device. The video processing device 101 can exchange data with other terminal devices, and each terminal device can also exchange data with each other. The terminal devices can exchange data directly, through the video processing device 101, or through cloud technology, etc., without limitation.

[0100] like Figure 1As shown, it is assumed that there are at least two terminal devices, such as terminal device 102a, terminal device 102b and terminal device 102c, and video interaction can be performed between each terminal device. When each terminal device performs video interaction, any terminal device can display N video windows, and each video window is used to display the video picture collected by the corresponding terminal device. N is a positive integer. For example, if video interaction is performed between terminal device 102a, terminal device 102b and terminal device 102c, then N is 3, and any terminal device can display 3 video windows, which are used to display the video pictures corresponding to terminal device 102a, terminal device 102b and terminal device 102c respectively. Taking terminal device 102a as an example, when the acquisition process for a virtual resource is triggered, terminal device 102a can display a graphic prompt box corresponding to the virtual resource and, based on the graphic prompt box, obtain the second video images fed back by other terminal devices. The second video images of each terminal device are displayed in N video windows. If each second video image can form a virtual graphic corresponding to the graphic prompt box, it is considered that the virtual resource corresponding to the virtual graphic has been triggered, and terminal device 102a can display the virtual resource. Similarly, other terminal devices, such as terminal devices 102b and terminal device 102c, can also display virtual resources based on the above process. Through the above process, virtual resources can be triggered when different users are interacting with each other through video. At the same time, different users can participate in filling the graphic prompt box of the virtual resource to trigger the virtual resource. This can improve the interactivity between users in the video interaction, enrich the functionality of the video interaction, and deepen the user's impression of the virtual object corresponding to the virtual resource, thereby improving the promotion effect of the virtual object. Furthermore, the triggering methods of virtual resources in interactive scenarios can be enriched to improve the flexibility of virtual resource triggering.

[0101] It is understandable that the video processing device mentioned in the embodiment of the present application may be a computer device, and the computer device in the embodiment of the present application includes but is not limited to a terminal device or a server. In other words, the computer device may be a server or a terminal device, or it may be a system composed of a server and a terminal device. Among them, the terminal device mentioned above may be an electronic device, including but not limited to mobile phones, tablet computers, desktop computers, laptop computers, PDAs, vehicle-mounted devices, augmented reality / virtual reality (AR / VR) devices, helmet displays, smart TVs, wearable devices, smart speakers, digital cameras, cameras and other mobile Internet devices (mobile internet device, MID) with network access capabilities, or terminal devices in scenarios such as trains, ships, and flights. As Figure 1As shown in , the terminal device may be a laptop (as shown by the terminal device 102b), a mobile phone (as shown by the terminal device 102c), or a vehicle-mounted device (as shown by the terminal device 102a), etc. Figure 1 Only some of the devices are listed as examples. Optionally, the terminal device 102a refers to a device located in the vehicle 103. The terminal device 102a can be used to display video interaction pages, etc., and to interact with other terminal devices through video. Among them, the server mentioned above can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, vehicle-road collaboration, content delivery network (CDN), and big data and artificial intelligence platforms.

[0102] For details, see Figure 2 , Figure 2 This is a schematic diagram of a video interaction scenario provided by an embodiment of the present application. Figure 2 As shown, the terminal device can display N video windows in the video interaction page 201, where N is a positive integer. The N video windows are composed of the terminal device and other terminal devices that perform video interaction with the terminal device. That is to say, assuming that N terminal devices are performing video interaction, each terminal device will correspond to a video window, and each terminal device can display the video window of the terminal device participating in the video interaction process. For example, assuming that N is 3, that is, terminal device 1, terminal device 2, and terminal device 3 perform video interaction, then terminal device 1 can display 3 video windows, including the video window of terminal device 1, the video window of terminal device 2, and the video window of terminal device 3; terminal device 2 can display 3 video windows, including the video window of terminal device 1, the video window of terminal device 2, and the video window of terminal device 3; terminal device 3 can display 3 video windows, including the video window of terminal device 1, the video window of terminal device 2, and the video window of terminal device 3. As shown Figure 2 As shown, taking a terminal device as an example, the terminal device displays N video windows in the video interaction page 201, including video window 2a, video window 2b, video window 2c, video window 2d, video window 2e, video window 2f, video window 2g, video window 2h and video window 2i. The terminal device can display the video images of other terminal devices based on the various video windows in the video interaction page 201.

[0103] Furthermore, when the graphic prompt box 202 is displayed in the video interaction page 201, the terminal device can obtain the video interaction image 204 from the video pictures displayed in the N video windows. In particular, since when the graphic prompt box 202 is displayed in the video interaction page 201, each terminal device may not be able to provide real-time feedback on the graphic prompt box 202, optionally, when the graphic prompt box 202 is displayed in the video interaction page 201, the terminal device can obtain the video interaction image 204 from the video pictures displayed in the N video windows after the prompt box response time has passed. In particular, since the N video windows are used to display the picture content collected by each terminal device and to realize video interaction between each terminal device, the video pictures displayed in the N video windows are in a changing state. In this application, it generally refers to the video pictures (such as Figure 2 ), optionally, the video screen can be recorded as the first video screen, that is, when the graphic prompt box 202 is displayed in the video interaction page 201, the video interaction image 204 is obtained from the first video screens displayed in the N video windows. If the video interaction image 204 matches the virtual image 205 indicated by the graphic prompt box 202, the virtual resource 2061 associated with the virtual image 205 can be displayed in the resource display area 206. The resource display area 206 can be displayed independently on the video interaction page 201, or it can be displayed within the video interaction page 201, and this is not limited here.

[0104] Through the above process, the triggering of virtual resources in the video interaction process is realized, the triggering method of virtual resources is enriched, and the video interaction function is enriched. Moreover, each terminal device can participate in the specific triggering process of virtual resources, which improves the interactivity between each terminal device, improves the promotion effect of virtual resources, and can improve the flexibility of virtual resource triggering.

[0105] Optionally, the data involved in the embodiments of the present application can be stored in a computer device, or the data can be stored based on cloud storage technology or blockchain technology, which is not limited here.

[0106] Further, see Figure 3 , Figure 3 This is a flow chart of a video interaction method provided by an embodiment of the present application. Figure 3 As shown, the video interaction process includes the following steps:

[0107] Step S301: display N video windows on the video interaction page.

[0108] In the embodiment of the present application, each terminal device can perform video interaction, for example, each terminal device can perform video communication, or can perform associated live broadcast, etc., that is, the video interaction can be video communication, or associated live broadcast, etc., which is not limited here. Optionally, during the video interaction process, the video images in the N video windows displayed in each terminal device are constantly changing, realizing video interaction between each terminal device, such as Figure 2 As shown in the video windows (such as video window 2a, video window 2b, ... video window 2i, etc.) displayed in the video interaction page 201.

[0109] Furthermore, if the terminal device receives a display request for a graphic prompt box, the terminal device may display the graphic prompt box in the video interaction page, wherein the terminal device may display the graphic prompt box directly in the video interaction page, or may display the graphic prompt box in an area independently displayed on the video interaction page, etc., and there is no limitation here, wherein the graphic prompt box is visually covered on N video windows, such as Figure 2 As shown in the graphic prompt box 202 in . Optionally, the terminal device can obtain the page display size information of N video windows in the video interaction page, and obtain a graphic prompt box based on the page display size information. The size of the graphic prompt box is less than or equal to the page display size information, and the adjusted graphic prompt box is displayed in the video interaction page. Optionally, the terminal device can trigger a display request for the graphic prompt box based on the video startup duration, or can trigger a display request for the graphic prompt box based on the voice of the object, etc., which is not limited here. Specifically, the terminal device can obtain the video startup duration corresponding to the video interaction page. If the video startup duration is greater than or equal to the resource trigger time threshold, the graphic prompt box is displayed in the video interaction page. Optionally, when starting the video interaction process, the terminal device can initiate a duration profile acquisition request to the video processing device, receive a trigger duration profile sent by the video processing device based on the duration profile acquisition request, parse the trigger duration profile, obtain the resource trigger time threshold, start the video timer, and when the video timer indicates that the video startup duration corresponding to the video interaction page is greater than or equal to the resource trigger time threshold, it is considered that a display request for the graphic prompt box is triggered, the graphic prompt box is displayed in the video interaction page, and step S302 is executed.

[0110] Furthermore, the terminal device can obtain the voice data of the target object, perform text conversion on the voice data, and obtain text data corresponding to the voice data; perform word segmentation processing on the text data to obtain M word segmentation phrases; M is a positive integer. If there are resource keywords in the M word segmentation phrases, a graphic prompt box corresponding to the resource keyword is obtained, and the graphic prompt box is displayed in the video interaction page. Optionally, the terminal device can trigger a display request for the graphic prompt box when the number of occurrences of the resource keyword is greater than or equal to the resource triggering number threshold. Specifically, if there are resource keywords in the M word segmentation phrases, the historical statistical number of resource keywords is obtained in the interactive video corresponding to the video interaction page; if the historical statistical number is greater than or equal to the resource triggering number threshold, the graphic prompt box corresponding to the resource keyword is obtained, and the graphic prompt box is displayed in the video interaction page. Optionally, the terminal device can send a keyword configuration file acquisition request to the video processing device, receive the keyword configuration file sent by the video processing device based on the keyword configuration file acquisition request, parse the keyword configuration file to obtain a keyword list, and if there are resource keywords belonging to the keyword list in the M word segmentation phrases, obtain a graphic prompt box corresponding to the resource keyword, display the graphic prompt box in the video interaction page, and execute step S302.

[0111] Step S302: When a graphic prompt box is displayed in the video interaction page, a video interaction image is obtained from the video pictures displayed in the N video windows.

[0112] In the embodiment of the present application, the content of the video interaction image is the content of the area covered by the graphic prompt box in the N video screens. Optionally, when the graphic prompt box is displayed in the video interaction page, the terminal device can directly obtain the video interaction image from the video screens displayed respectively in the N video windows; or, when the graphic prompt box is displayed in the video interaction page, the terminal device can display the fill prompt information in the video interaction page, and after the prompt box response time has passed, obtain the video interaction image from the video screens displayed respectively in the N video windows. For example, see Figure 4 , Figure 4 This is a schematic diagram of a video interactive image processing process provided by an embodiment of the present application. Figure 4As shown, when a graphic prompt box is displayed in the video interaction page 401, the terminal device can display a filling prompt information 4011 in the video interaction page 401. The filling prompt information 4011 is used to indicate how each terminal device fills the graphic prompt box. For example, the filling prompt information 4011 can be "Please use your body to connect the virtual image indicated by the graphic prompt box" or "Please color to fill the virtual image indicated by the graphic prompt box", etc., which is not limited here. The terminal device can fill the graphic prompt box based on the filling prompt information 4011, that is, update the video screen displayed in the video window corresponding to the terminal device. For example, if the filling prompt information 4011 is "Please use your body to connect the virtual image indicated by the graphic prompt box", the terminal device can select the video screens displayed in N video windows (such as Figure 2 Alternatively, the filling prompt information 4011 is "please fill in the virtual image indicated by the graphic prompt box", and the terminal device can display the video screens (such as Figure 4 The terminal device can obtain the video interaction image 402 from the video screen shown in the video window 4a, video window 4b, video window 4c, video window 4d, video window 4e, video window 4f, video window 4g, video window 4h and video window 4i, and compare the video interaction image 402 with the virtual image 403 indicated by the graphic prompt box. The virtual image 403 indicated by the graphic prompt box can be any reproducible image, such as a gesture image, a posture image, an expression image, a text image, a pattern image or a voice symbol image, etc., without limitation. For example, Figure 4 The virtual image 403 shown in FIG. 4 is a text image “X”.

[0113] Specifically, when a graphic prompt box is displayed in the video interaction page, the terminal device can directly obtain the video interaction image from the video images displayed in the N video windows, such as Figure 2 Alternatively, when a graphic prompt box is displayed on the video interaction page and there is a non-overlapping video window among the N video windows, the terminal device may adjust the display of the N video windows, wherein the non-overlapping video window refers to a video window with no overlapping area with the graphic prompt box; after the adjustment, there is no non-overlapping video window among the N video windows; and the video interaction image is obtained from the video images displayed in the N video windows after the adjustment.

[0114] Furthermore, when a graphic prompt box is displayed on a video interaction page and there are non-overlapping video windows among the N video windows, the N video windows are adjusted and displayed. Specifically, when a graphic prompt box is displayed on a video interaction page and there are non-overlapping video windows among the N video windows, and the N video windows are displayed in a single dimension, the non-overlapping video windows among the N video windows are extended along the display dimension, and the intersecting video windows among the N video windows are contracted along the display dimension; intersecting video windows refer to video windows other than the non-overlapping video windows among the N video windows; and single-dimensional display refers to single-row display or single-column display. The adjusted N video windows are displayed in a single dimension.

[0115] Alternatively, when a graphic prompt box is displayed on a video interaction page, and there is a non-overlapping video window among N video windows, and the N video windows are displayed in multi-dimensional form, a prompt display area on the video interaction page is obtained; multi-dimensional display refers to displaying in at least two rows and at least two columns, that is, multi-row and multi-column display; the prompt display area refers to a continuous rectangular area that does not include the non-overlapping video window. The non-overlapping video window is inserted into the prompt display area, and the N video windows are resized according to the insertion position of the non-overlapping video window in the prompt display area, and the resized N video windows are displayed.

[0116] Optionally, when a graphic prompt box is displayed on a video interaction page, the terminal device can obtain the window position information and window size information of each video window, intercept the video interaction page displaying the graphic prompt box, determine the intercepted video interaction page as a prompt image, and send the window position information, window size information, and prompt image to a video processing device, so that the video processing device pre-adjusts the prompt image based on the window position information and window size information to obtain adjustment position information and adjustment size information. The terminal device receives the adjustment position information and adjustment size information sent by the video processing device, and displays the adjusted N video windows on the video interaction page according to the adjustment position information and adjustment size information; and obtains a video interaction image from the video screens displayed in the adjusted N video windows.

[0117] Optionally, when a graphic prompt box is displayed on the video interaction page, image pixels covered by the graphic prompt box are obtained from the video images displayed in each of the N video windows, and the image pixels covered by the graphic prompt box are combined to form a video interaction image. Specifically, the terminal device may crop the video images displayed in each of the N video windows based on the graphic prompt box to obtain the image pixels covered by the graphic prompt box.

[0118] Furthermore, the terminal device can obtain the pixel color difference value between the image pixels constituting the video interactive image. If the pixel color difference value falls within the graphic fill color value range, it is determined that the video interactive image matches the virtual image indicated by the graphic prompt box; the graphic fill color value range is the color value range indicated by the graphic prompt box. Optionally, the terminal device can directly calculate the pixel color difference value between the image pixels constituting the video interactive image; or, the terminal device can obtain the pixel information of the image pixels constituting the video interactive image, obtain the color space mean of the pixel information, and process the color space mean using a color difference formula to obtain the pixel color difference value, wherein the color space mean can be the LAB color space mean. The LAB color space (CIELAB color space), also known as L*a*b*, is a color space defined by the Commission International Eclairage (CIE), which represents color using three values, wherein "L*" is used to represent perceived brightness, and "a*" and "b*" represent the four unique colors of human vision, including red, green, blue, and yellow, which are used to represent a perceptually unified space. Optionally, the terminal device can also obtain the pixel difference value between the image pixels and adjacent pixels that constitute the video interaction image. If the pixel color difference value belongs to the graphic fill color value range and the pixel difference value is greater than or equal to the fill color difference threshold, it is determined that the video interaction image matches the virtual image indicated by the graphic prompt box.

[0119] Optionally, if the terminal device does not display the fill prompt information, the way different video windows are used to fill the graphic prompt box may not be exactly the same, that is, the pixel color difference value corresponding to the video interaction image may not fall within the graphic fill color value range. At this time, the terminal device can perform image recognition on the video screen displayed in each video window to obtain the fill sub-image in each video window, and splice the fill sub-image in each video window according to the display position of each video window in the video interaction page to obtain the video interaction image.

[0120] Optionally, if the virtual image is a voice symbol image, the terminal device can also obtain the audio data corresponding to each of the N video windows, perform semantic analysis on the audio data corresponding to each of the N video windows, and obtain the voice text data of each video window. If each voice text data matches the voice information indicated by the voice symbol image, it is determined that the video interaction image matches the virtual image indicated by the graphic prompt box; or, if the number of voice text data that matches the voice information indicated by the voice symbol image in the N voice text data is greater than or equal to the voice matching threshold, it is determined that the video interaction image matches the virtual image indicated by the graphic prompt box. The voice matching threshold is obtained based on N. For example, an 80% matching rate can be considered to indicate that the video interaction image matches the virtual image indicated by the graphic prompt box. The voice matching threshold is N*0.8, etc., which is not limited here.

[0121] Optionally, if the virtual image is a gesture image, posture image, expression image, text image or pattern image, etc., a video interaction image can be obtained from the video screens displayed in N video windows respectively, and the video interaction image can be compared with the virtual image. Optionally, the video interaction image can be compared with the virtual image. Alternatively, the video interaction image includes N interactive sub-images, and each interactive sub-image is compared with the virtual image respectively. If each interactive sub-image matches the virtual image, it is determined that the video interaction image matches the virtual image indicated by the graphic prompt box; or, if the number of interactive sub-images that match the virtual image in the N interactive sub-images is greater than or equal to the image matching threshold, it is determined that the video interaction image matches the virtual image indicated by the graphic prompt box. The image matching threshold is obtained based on N. For example, an 80% matching rate can be considered that the video interaction image matches the virtual image indicated by the graphic prompt box. The image matching threshold is N*0.8, etc., and is not limited here. Further optionally, if the virtual image is an expression image, the terminal device may also obtain the video frames displayed in N video windows, identify the facial data in each video frame, and compose the facial data in each video frame into a video interaction image. If the facial data in each video frame matches the virtual image, then the video interaction image is determined to match the virtual image indicated by the graphic prompt box; alternatively, if the number of facial images in the facial data in each video frame that match the virtual image is greater than or equal to an image matching threshold, then the video interaction image is determined to match the virtual image indicated by the graphic prompt box, etc.

[0122] The above are just some optional matching methods for virtual images. The virtual images in this application can also be other types of images, etc., which are not limited here.

[0123] Optionally, the terminal device can obtain k video interaction images generated during the prompt box filling time period from the video pictures displayed by N video windows respectively during the prompt box filling time period, where k is a positive integer. If the k video interaction images all match the virtual image indicated by the graphic prompt box, it means that the time when the graphic prompt box is in the filling state reaches the prompt box filling time period, and step S303 is executed.

[0124] Step S303: If the video interaction image matches the virtual image indicated by the graphic prompt box, the virtual resources associated with the virtual image are displayed.

[0125] In an embodiment of the present application, if the video interaction image matches the virtual image indicated by the graphic prompt box, the virtual image is displayed; and the virtual image is switched to display as a virtual resource associated with the virtual image. Optionally, if the video interaction image matches the virtual image indicated by the graphic prompt box, the terminal device can add a mask layer to the video interaction page and display the virtual image in the mask layer. Optionally, when switching the virtual image to display as a virtual resource associated with the virtual image, the terminal device can switch the virtual image to display as at least two virtual resource icons; in response to a trigger operation on a target virtual resource icon among the at least two virtual resource icons, the target virtual resource corresponding to the target virtual resource icon is displayed.

[0126] For example, see Figure 5 , Figure 5 This is a schematic diagram of a resource display scenario provided by an embodiment of the present application. Figure 5 As shown, the terminal device displays N video windows in the video interaction page 501, including video window 5a, video window 5b, video window 5c, video window 5d, video window 5e, video window 5f, video window 5g, video window 5h and video window 5i. When a graphic prompt box is displayed in the video interaction page 501, a video interaction image is obtained from the video pictures displayed in the N video windows respectively. Assuming that the video interaction image matches the virtual image indicated by the graphic prompt box, a mask layer 5021 is added to the video interaction page 501, and a virtual image 5022 is displayed in the mask layer 5021, as shown in FIG. Figure 5 The page indicated by the middle area 502 is switched to display the virtual image 5022 as at least two virtual resource icons 5031 (as indicated by the page in the area 503). In response to a triggering operation on a target virtual resource icon 5032 among the at least two virtual resource icons 5031, the target virtual resource 5041 corresponding to the target virtual resource icon 5032 is displayed. Specifically, the target virtual resource 5041 can be displayed in the resource display area 504. The at least two virtual resource icons 5031 can correspond to the same virtual resource or different virtual resources.

[0127] Furthermore, the terminal device can respond to the trigger operation for the virtual resource and display the resource trigger component of the virtual resource, such as Figure 5 The "Receive" component in the resource trigger component responds to the trigger operation of the resource trigger component and displays a prompt message indicating that the virtual resource has been successfully obtained.

[0128] Optionally, when a graphic prompt box is displayed in a video interaction page, there may often be a video window among the N video windows that has no overlapping area with the graphic prompt box. At this time, the N video windows can be adjusted so that each video window has an overlapping area with the graphic prompt box, that is, there is no non-overlapping video window among the N video windows, so that each terminal device participating in the video interaction can participate in the triggering process of virtual resources in the video interaction process, thereby improving the participation and interactivity of users corresponding to each terminal device.

[0129] Specifically, if there are non-overlapping video windows among the N video windows, the window identifiers corresponding to the N video windows are obtained; non-overlapping video windows refer to video windows that do not have overlapping areas with the graphic prompt box; a simulation window page is generated based on the window position information, window size information, and window identifier; the simulation window page includes N simulation windows, and video windows with the same window identifier correspond to the simulation window. The N simulation windows included in the simulation window page are pre-adjusted to obtain adjustment position information and adjustment size information; the adjustment position information and adjustment size information are used to indicate the position information and size information of the adjusted N simulation windows in the simulation window page, and are also used to indicate the position information and size information corresponding to the N window identifiers; based on the adjustment position information and adjustment size information, the video windows associated with the N window identifiers are adjusted and displayed. When obtaining video interaction images from the video screens displayed in the N video windows, the video interaction images are obtained from the video screens displayed in the adjusted N video windows.

[0130] Furthermore, the terminal device can obtain a virtual image corresponding to the graphic prompt box, and generate a video window mask layer in the prompt image based on the virtual image. According to the window position information and the window size information, the video window mask layer is divided into N window sub-mask layers associated with N video windows. The image color value information of the virtual image is obtained, and the image pixel points that match the image color value information in the i-th window sub-mask layer are obtained, and the pixel ratio occupied in the i-th window sub-mask layer, i is a positive integer less than or equal to N. If the pixel ratio is greater than or equal to the image display threshold, the i-th video window corresponding to the i-th window sub-mask layer is determined to be a cross video window; if the pixel ratio is less than the image display threshold, the i-th video window corresponding to the i-th window sub-mask layer is determined to be a non-overlapping video window.

[0131] When pre-adjusting the N simulated windows included in the simulated window page to obtain adjustment position information and adjustment size information, the terminal device can obtain a simulated prompt area in the simulated window page and obtain a first simulated window included in the simulated prompt area. The simulated prompt area refers to a continuous rectangular area that does not include simulated windows corresponding to non-overlapping video windows. The N simulated windows also include a second simulated window corresponding to the non-overlapping video window and a third simulated window other than the first and second simulated windows. The second simulated window and the first simulated window are resized, and the adjusted first and second simulated windows are displayed in the simulated prompt area. In other words, the second simulated window is inserted into the simulated prompt area, and the second simulated window and the first simulated window are resized so that the adjusted first and second simulated windows can be displayed in the simulated prompt area. Furthermore, since the insertion of the second simulated window into the simulated prompt area leaves the area originally occupied by the second simulated window empty, the third simulated window can be stretched and displayed in an area of the simulated window page other than the simulated prompt area. The adjustment position information and adjustment size information are determined based on the adjusted N simulated windows.

[0132] The N simulation windows include a fourth simulation window and a fifth simulation window corresponding to a non-overlapping video window; the fourth simulation window is the simulation window other than the fifth simulation window among the N simulation windows. When pre-adjusting the N simulation windows included in the simulation window page to obtain adjustment position information and adjustment size information, if the N simulation windows are displayed in a single dimension, the fourth simulation window is shrunk and the fifth simulation window is stretched, and the adjusted fourth and fifth simulation windows are displayed on the simulation window page; there is an overlapping area between the adjusted fourth simulation window and the graphic prompt box. The adjustment position information and adjustment size information are determined based on the adjusted N simulation windows.

[0133] Optionally, the process of adjusting the N video windows can also be implemented by a video processing device. Figure 6 , Figure 6 This is a schematic diagram of a simulation window creation scenario provided by an embodiment of the present application. Figure 6As shown, the video processing device receives a prompt image 601, window position information and window size information sent by a terminal device, wherein the window position information is used to indicate the positions of N video windows, such as the coordinate positions of the N video windows in the video interaction page, and the window size information is used to indicate the sizes of the N video windows, such as the length and width corresponding to the N video windows. The video processing device can add a video window mask layer 602 to the prompt image 601 to generate a mask image 603. The video processing device can determine the side length dividing line 6041 of the N video windows based on the window position information and the window size information, and divide the video window mask layer 602 based on the side length dividing line 6041 to obtain N window sub-mask layers associated with the N video windows, such as Figure 6 As shown in the middle area 604. Among them, the window sub-mask layer is associated with the video window covered by the window sub-mask layer, and the associated window sub-mask layer and video window can be considered to have the same window identifier. Taking the i-th window sub-mask layer and the i-th video window as an example, the image pixel points in the i-th window sub-mask layer that match the image color value information can be obtained, and the pixel ratio occupied in the i-th window sub-mask layer. If the pixel ratio corresponding to the i-th window sub-mask layer is greater than or equal to the image display threshold, the i-th video window corresponding to the i-th window sub-mask layer is determined to be a cross video window; if the pixel ratio is less than the image display threshold, the i-th video window corresponding to the i-th window sub-mask layer is determined to be a non-overlapping video window. Similarly, the detection results of N window sub-mask layers are obtained. If there are non-overlapping video windows in the N window sub-mask layers, a simulated window page 605 is generated. The simulated window page 605 includes N simulated windows, and the N simulated windows correspond one-to-one with the N video windows. The simulated windows with the same window identifier have the same position and size as the video windows. The video processing device can pre-adjust the N simulated windows included in the simulated window page 605 to obtain adjustment position information and adjustment size information, and send the adjustment position information and adjustment size information to the terminal device. The terminal device can display the adjusted N video windows on the video interaction page based on the adjustment position information and adjustment size information.

[0134] Furthermore, the process of determining the adjustment position information and the adjustment size information by the video processing device can refer to the process of determining the adjustment position information and the adjustment size information by the terminal device. For example, see Figures 7a to 9 , Figures 7a to 9 These are several optional window adjustment methods provided by the embodiments of this application. For example, Figure 7a This is a schematic diagram of a window adjustment scenario under a single column display provided by an embodiment of the present application. Figure 7aAs shown, assuming that video window ① is a non-overlapping video window, then the N simulation windows 701 include simulation window ① and simulation window ②, simulation window ① is the fifth simulation window corresponding to the non-overlapping video window, and simulation window ② is the fourth simulation window other than the fifth simulation window. The video processing device can shrink the fourth simulation window (i.e., simulation window ②) and stretch the fifth simulation window (i.e., simulation window ①) to obtain the adjusted N simulation windows 702, and determine the adjustment position information and adjustment size information based on the adjusted N simulation windows 702. Specifically, the video processing device can keep the horizontal coordinates of each simulation window unchanged and increase the vertical coordinate ratio occupied by the fifth simulation window so that there are no non-overlapping simulation windows in the adjusted simulation windows, and the definition of non-overlapping simulation windows is the same as that of non-overlapping video windows. Optionally, the video processing device can increase the fixed ratio of the height of the fifth simulation window each time (such as 10%), and after multiple adjustments, until there are no non-overlapping simulation windows in the adjusted simulation windows.

[0135] For example, Figure 7b This is a schematic diagram of a window adjustment scenario under a single-line display provided by an embodiment of the present application. Figure 7b As shown, assuming that video window ① is a non-overlapping video window, the N simulation windows 703 include simulation window ① and simulation window ②, simulation window ① is the fifth simulation window corresponding to the non-overlapping video window, and simulation window ② is the fourth simulation window other than the fifth simulation window. The video processing device can shrink the fourth simulation window (i.e., simulation window ②) and stretch the fifth simulation window (i.e., simulation window ①) to obtain the adjusted N simulation windows 704, and determine the adjustment position information and adjustment size information based on the adjusted N simulation windows 704. Specifically, the video processing device can keep the vertical coordinates of each simulation window unchanged and increase the horizontal coordinate ratio occupied by the fifth simulation window so that there are no non-overlapping simulation windows in the adjusted simulation windows, and the definition of non-overlapping simulation windows is the same as that of non-overlapping video windows. Optionally, the video processing device can increase the fixed ratio of the width of the fifth simulation window each time (such as 10%), and after multiple adjustments, until there are no non-overlapping simulation windows in the adjusted simulation windows.

[0136] For example, see Figure 8 , Figure 8 This is a schematic diagram of an edge window adjustment scenario provided by an embodiment of the present application. Figure 8As shown, assuming that N simulation windows 801 include simulation window ①, simulation window ②, simulation window ③ and simulation window ④, assuming that simulation window ① is a simulation window corresponding to a non-overlapping video window (i.e., the second simulation window), the terminal device can obtain a simulation prompt area in the simulation window page, which can be simulation prompt area 8011 or simulation prompt area 8012. In the first mode (1), taking simulation prompt area 8011 as an example, the first simulation window included in the simulation prompt area 8011 is simulation window ② and simulation window ④, simulation window ① is inserted into the simulation prompt area 8011, and simulation window ①, simulation window ② and simulation window ④ are resized based on the simulation prompt area 8011, such as dividing the area height of the simulation prompt area 8011 equally to obtain at least two simulation sub-areas, and inserting simulation window ①, simulation window ② and simulation window ④ into the at least two simulation sub-areas respectively; further, simulation window ③ (i.e., the third simulation window) is stretched to obtain the adjusted N simulation windows 802. In the second method, taking the simulation prompt area 8012 as an example, the first simulation windows included in the simulation prompt area 8012 are simulation window ③ and simulation window ④, simulation window ① is inserted into the simulation prompt area 8012, and the sizes of simulation window ①, simulation window ③ and simulation window ④ are adjusted based on the simulation prompt area 8012, such as dividing the area width of the simulation prompt area 8012 equally to obtain at least two simulation sub-areas, and inserting simulation window ①, simulation window ③ and simulation window ④ into the at least two simulation sub-areas respectively; further, simulation window ② (i.e., the third simulation window) is stretched to obtain the adjusted N simulation windows 803.

[0137] For example, see Figure 9 , Figure 9 This is a schematic diagram of an intermediate window adjustment scenario provided by an embodiment of the present application. Figure 9 As shown, assuming that N simulation windows 901 include simulation window ①, simulation window ②, simulation window ③, simulation window ④, simulation window ⑤, simulation window ⑥, simulation window ⑦, simulation window ⑧, and simulation window 9, and assuming that simulation window ⑤ is a simulation window corresponding to a non-overlapping video window (i.e., the second simulation window), the terminal device can obtain a simulation prompt area in the simulation window page, which can be simulation prompt area 9011, simulation prompt area 9012, simulation prompt area 9013, or simulation prompt area 9014. Taking simulation prompt area 9012 as an example, simulation window ⑤ is inserted into simulation prompt area 9012, simulation window ⑤ and simulation window ③, simulation window ⑥, and simulation window 99 included in simulation prompt area 9012 are resized, and simulation window ② and simulation window ⑧ are stretched to obtain the adjusted N simulation windows 902.

[0138] Among them, the present application can be applied to the field of video interaction, and the virtual resources can be product resources or game resources, etc., which are not limited here. For example, a virtual image is used to indicate a target product, and the virtual resources corresponding to the virtual image can include but are not limited to preferential information of the target product (such as coupons, etc.) and product trial rights, etc.; for example, the virtual image is used to indicate a target game, and the virtual resources corresponding to the virtual image can include but are not limited to game props in the target game, game prop preferential information and game task completion cards, etc. For example, N users are interacting through video and discussing the target game. When a display request for a graphic prompt box corresponding to the target game is triggered, the terminal device displays a graphic prompt box in the video interaction page, and the terminal devices where each user is located fill in the graphic prompt box based on N video windows. At this time, the terminal device obtains a video interaction image from the video screens displayed in N video windows respectively. If the video interaction image matches the virtual image indicated by the graphic prompt box, the virtual resources associated with the virtual image are displayed, that is, the virtual resources associated with the target game. The graphic prompt box can be a prompt box generated based on the icon of the target game, or a prompt box generated based on the game name of the target game, etc., and there is no limitation here.

[0139] In an embodiment of the present application, N video windows are displayed in a video interaction page; N is a positive integer; when a graphic prompt box is displayed in the video interaction page, a video interaction image is obtained from the video screens displayed in each of the N video windows; the content of the video interaction image is the content of the area covered by the graphic prompt box in the N video screens; if the video interaction image matches the virtual image indicated by the graphic prompt box, the virtual resource associated with the virtual image is displayed. Through the above process, the virtual resource can be triggered during the video interaction process, and the virtual resource can be triggered by the video screen displayed in each video window, and the video screen displayed in the video window is the screen of the device participating in the video interaction process, so that each terminal device can participate in the triggering process of the virtual resource, thereby improving the interactivity between each terminal device and enriching the video interaction function. In addition, since each terminal device participates in the triggering process of the virtual resource, the participation of each terminal device in the virtual resource is improved, thereby improving the promotion effect of the virtual resource, and further enriching the triggering method of the virtual resource and improving the flexibility of the virtual resource triggering.

[0140] Further, see Figure 10 , Figure 10 This is an interactive flow chart of a video interaction scenario provided by an embodiment of the present application. Figure 10 As shown, the process includes the following steps:

[0141] Step S1: The user (ie, target object) inputs voice data.

[0142] Step S2: convert the voice data into text.

[0143] In an embodiment of the present application, the terminal device can convert the voice data into text to obtain text data corresponding to the voice data.

[0144] Step S3: Search the keyword database for text data.

[0145] In an embodiment of the present application, the terminal device can perform word segmentation processing on the text data to obtain M word segmentation phrases, and search the M word segmentation phrases included in the text data in the keyword library.

[0146] Step S4: Return the search results.

[0147] Step S5: When the resource keyword exists, the resource keyword is sent to the video processing device.

[0148] In an embodiment of the present application, when the search result is used to indicate that a resource keyword exists in the M segmented word phrases, the resource keyword is sent to the video processing device.

[0149] Step S6: The video processing device obtains a graphic prompt box corresponding to the resource keyword from the prompt box library.

[0150] Step S7: Return to the graphic prompt box.

[0151] Step S8: Send the graphic prompt box and virtual resources to the terminal device.

[0152] Step S9: Obtain the graphic prompt frame and obtain the coverage of the graphic prompt frame.

[0153] In an embodiment of the present application, the terminal device can obtain a graphic prompt box and obtain the coverage of N video windows by the graphic prompt box.

[0154] Step S10: Adjust N video windows.

[0155] In an embodiment of the present application, the terminal device can adjust the N video windows based on the coverage of the N video windows by the graphic prompt box, and determine the adjustment position information and the adjustment size information.

[0156] Step S11: Re-render N video windows.

[0157] In an embodiment of the present application, the terminal device can re-render N video windows in the video interaction page based on the adjusted position information and the adjusted size information.

[0158] Step S12: Detect the compliance rate in the graphic prompt box.

[0159] In an embodiment of the present application, the terminal device can detect the compliance rate in the graphic prompt box, that is, detect the matching degree between the video interaction image obtained from the video screens displayed respectively in the adjusted N video windows and the virtual image. If the video interaction image matches the virtual image, step S13 is executed.

[0160] Step S13: After the standard is met, the virtual resources are displayed.

[0161] In an embodiment of the present application, the terminal device can display virtual resources associated with the virtual image when the video interaction image matches the virtual image.

[0162] Step S14, click the "Receive" component.

[0163] Step S15: Send a resource acquisition request to the video processing device, and send the user information and virtual resource information to the video processing device.

[0164] Step S16: store relevant information.

[0165] In an embodiment of the present application, the video processing device can store user information and virtual resource information, such as storing it in the video processing device, or storing it in a cloud storage space, or storing it in a blockchain network, etc.

[0166] Step S17: Notify the terminal device that the receipt is successful.

[0167] In an embodiment of the present application, the video processing device sends a resource collection success message to the terminal device.

[0168] Step S18: Display a prompt message indicating successful acquisition.

[0169] In an embodiment of the present application, the terminal device may display a prompt message indicating successful acquisition of the virtual resource.

[0170] Optionally, the number of graphic prompt boxes can be one or at least two. If there are at least two graphic prompt boxes, the terminal device can provide a prompt box filling time period for each graphic prompt box, obtain the filling result of each graphic prompt box, and if the video interaction image corresponding to each graphic prompt box matches the virtual image indicated by the graphic prompt box, then the virtual resources associated with the at least two graphic prompt boxes are displayed. In this way, virtual resources associated with graphic prompt boxes that cannot be filled in one go can also be triggered. Alternatively, the virtual resources associated with at least two graphic prompt boxes are different. In this case, the terminal device can display the virtual resources associated with each graphic prompt box, so that the terminal device can obtain multiple different types of virtual resources at the same time. For example, there is a graphic prompt box corresponding to product A and a graphic prompt box corresponding to product B. In this case, the terminal device can simultaneously obtain the virtual resources corresponding to product A and product B, etc. Optionally, the terminal device can display one or at least two virtual resource icons. The number of virtual resource icons can be random or pre-set. The terminal device may statically display one or at least two virtual resource icons, or may dynamically display one or at least two virtual resource icons, etc., which is not limited here.

[0171] Further, see Figure 11 , Figure 11 Schematic diagram of a video interaction device provided in an embodiment of the present application. The video interaction device can be a computer program (including program code, etc.) running on a computer device. For example, the video interaction device can be an application software; the device can be used to execute the corresponding steps of the method provided in an embodiment of the present application. Figure 11 As shown, the video interaction device 1100 can be used to Figure 3 The computer device in the corresponding embodiment may specifically include: a window display module 11 , an image acquisition module 12 and a resource display module 13 .

[0172] The window display module 11 is used to display N video windows in the video interaction page; N is a positive integer;

[0173] The image acquisition module 12 is used to acquire a video interaction image from the video screens displayed in the N video windows when the graphic prompt box is displayed in the video interaction page; the content of the video interaction image is the content of the area covered by the graphic prompt box in the N video screens;

[0174] The resource display module 13 is configured to display the virtual resources associated with the virtual image if the video interaction image matches the virtual image indicated by the graphic prompt box.

[0175] The resource display module 13 includes:

[0176] The virtual image display unit 131 is configured to display the virtual image if the video interaction image matches the virtual image indicated by the graphic prompt box;

[0177] The resource display unit 132 is configured to switch the virtual image to display virtual resources associated with the virtual image.

[0178] The virtual image display unit 131 is specifically configured to:

[0179] If the video interaction image matches the virtual image indicated by the graphic prompt box, a mask layer is added to the video interaction page, and the virtual image is displayed in the mask layer.

[0180] The resource display unit 132 includes:

[0181] The icon display subunit 1321 is configured to switch and display the virtual image into at least two virtual resource icons;

[0182] The resource triggering subunit 1322 is configured to respond to a triggering operation on a target virtual resource icon among the at least two virtual resource icons and display a target virtual resource corresponding to the target virtual resource icon.

[0183] The device 1100 further includes:

[0184] The component display module 14 is used to respond to the trigger operation on the virtual resource and display the resource trigger component of the virtual resource;

[0185] The component triggering module 15 is configured to respond to a triggering operation on a resource triggering component and display a prompt message indicating successful acquisition of the virtual resource.

[0186] The image acquisition module 12 includes:

[0187] The window adjustment unit 121 is configured to adjust the N video windows for display when a graphic prompt box is displayed on the video interaction page and there is a non-overlapping video window among the N video windows; the non-overlapping video window refers to a video window with no overlapping area with the graphic prompt box; and after the adjustment, there is no non-overlapping video window among the N video windows;

[0188] The image acquisition unit 122 is configured to acquire a video interaction image from the video frames displayed in the N video windows after the adjustment.

[0189] The window adjustment unit 121 includes:

[0190] The window scaling subunit 1211 is configured to, when a graphic prompt box is displayed on a video interaction page and there are non-overlapping video windows among N video windows, and the N video windows are displayed in a single dimension, extend the non-overlapping video windows among the N video windows along the display dimension, and shrink the intersecting video windows among the N video windows along the display dimension. Intersecting video windows refer to video windows other than the non-overlapping video windows among the N video windows. Single-dimensional display refers to single-row display or single-column display.

[0191] The single-dimensional display subunit 1212 is configured to perform single-dimensional display on the adjusted N video windows.

[0192] The window adjustment unit 121 includes:

[0193] The region acquisition subunit 1213 is configured to, when a graphic prompt box is displayed on the video interaction page and there is a non-overlapping video window among the N video windows, and the N video windows are displayed in a multi-dimensional manner, acquire a prompt display region on the video interaction page; multi-dimensional display means displaying in at least two rows and at least two columns; the prompt display region means a continuous rectangular region that does not include the non-overlapping video windows;

[0194] The size adjustment subunit 1214 is used to insert non-overlapping video windows into the prompt display area, adjust the sizes of N video windows according to the insertion positions of the non-overlapping video windows in the prompt display area, and display the N video windows after the size adjustment; the regular display area refers to the area where the non-overlapping video windows are located.

[0195] The device 1100 further includes:

[0196] The duration trigger module 16 is used to obtain the video startup duration corresponding to the video interaction page, and if the video startup duration is greater than or equal to the resource trigger time threshold, a graphic prompt box is displayed in the video interaction page.

[0197] The device 1100 further includes:

[0198] The voice conversion module 17 is used to obtain the voice data of the target object, convert the voice data into text, and obtain text data corresponding to the voice data;

[0199] The text segmentation module 18 is used to perform segmentation processing on the text data to obtain M segmentation phrases; M is a positive integer;

[0200] The key trigger module 19 is used to obtain a graphic prompt box corresponding to the resource keyword if there is a resource keyword in the M segmented word phrases, and display the graphic prompt box in the video interaction page.

[0201] The key trigger module 19 includes:

[0202] The frequency counting unit 191 is used to obtain the historical statistical frequency of the resource keyword in the interactive video corresponding to the video interactive page if the resource keyword exists in the M segmented word phrases;

[0203] The prompt display unit 192 is used to obtain a graphic prompt box corresponding to the resource keyword if the historical statistical number is greater than or equal to the resource triggering number threshold, and display the graphic prompt box in the video interaction page.

[0204] The image acquisition module 12 includes:

[0205] The window information acquisition unit 123 is configured to, when a graphic prompt box is displayed on a video interaction page, acquire window position information and window size information of each video window, intercept the video interaction page displaying the graphic prompt box, determine the intercepted video interaction page as a prompt image, and send the window position information, window size information, and prompt image to a video processing device so that the video processing device pre-adjusts the prompt image based on the window position information and window size information to obtain adjusted position information and adjusted size information.

[0206] An adjustment information receiving unit 124 is configured to receive the adjustment position information and the adjustment size information sent by the video processing device, and display the adjusted N video windows on the video interaction page according to the adjustment position information and the adjustment size information;

[0207] The image acquisition unit 122 is further configured to acquire a video interaction image from the video frames displayed in the adjusted N video windows.

[0208] The image acquisition module 12 includes:

[0209] The image generation unit 125 is configured to obtain image pixels covered by the graphic prompt box from the video images displayed in the N video windows when the graphic prompt box is displayed in the video interaction page, and to compose a video interaction image from the image pixels covered by the graphic prompt box;

[0210] The apparatus 1100 further includes:

[0211] The color value comparison module 20 is used to obtain the pixel color difference value between the image pixels that constitute the video interaction image. If the pixel color difference value belongs to the graphic fill color value range, it is determined that the video interaction image matches the virtual image indicated by the graphic prompt box; the graphic fill color value range is the color value range indicated by the graphic prompt box.

[0212] The device 1100 further includes:

[0213] The identifier acquisition module 21 is used to obtain the window identifiers corresponding to the N video windows if there is a non-overlapping video window among the N video windows; the non-overlapping video window refers to a video window with no overlapping area with the graphic prompt box;

[0214] The page generation module 22 is used to generate a simulation window page according to the window position information, the window size information and the window identifier; the simulation window page includes N simulation windows, and the video windows with the same window identifier correspond to the simulation windows;

[0215] An information determination module 23 is configured to pre-adjust the N simulated windows included in the simulated window page to obtain adjustment position information and adjustment size information; the adjustment position information and adjustment size information are used to indicate the position information and size information of the N simulated windows after adjustment in the simulated window page, and are used to indicate the position information and size information corresponding to the N window identifiers.

[0216] The display adjustment module 24 is used to adjust and display the video windows respectively associated with the N window identifiers according to the adjustment position information and the adjustment size information;

[0217] The image acquisition module 12 is specifically used for:

[0218] Video interaction images are obtained from the video images respectively displayed in the adjusted N video windows.

[0219] The device 1100 further includes:

[0220] The mask generation module 25 is used to obtain a virtual image corresponding to the graphic prompt box, and generate a video window mask layer in the prompt image based on the virtual image;

[0221] The mask division module 26 is used to divide the video window mask layer into N window sub-mask layers associated with the N video windows according to the window position information and the window size information;

[0222] The ratio determination module 27 is configured to obtain the image color value information of the virtual image and obtain the pixel ratio of the image pixels in the i-th window sub-mask layer that match the image color value information, where i is a positive integer less than or equal to N.

[0223] The intersection determination module 28 is configured to determine that the i-th video window corresponding to the i-th window sub-mask layer is an intersection video window if the pixel ratio is greater than or equal to the image display threshold;

[0224] The non-overlapping determination module 29 is configured to determine that the i-th video window corresponding to the i-th window sub-mask layer is a non-overlapping video window if the pixel ratio is less than the image display threshold.

[0225] The information determination module 23 includes:

[0226] The first window acquisition unit 231 is configured to acquire a simulation prompt area in the simulation window page and acquire a first simulation window included in the simulation prompt area; the simulation prompt area is a continuous rectangular area that does not include simulation windows corresponding to non-overlapping video windows; the N simulation windows also include a second simulation window corresponding to the non-overlapping video window, and a third simulation window other than the first and second simulation windows;

[0227] A first adjusting unit 232 is configured to adjust the sizes of the second simulation window and the first simulation window, and display the adjusted first simulation window and second simulation window in the simulation prompt area;

[0228] The second adjusting unit 233 is configured to stretch the third simulation window and display the adjusted third simulation window in an area other than the simulation prompt area of the simulation window page;

[0229] The information determining unit 234 is configured to determine the adjustment position information and the adjustment size information according to the adjusted N simulation windows.

[0230] The N simulation windows include the fourth simulation window and the fifth simulation window corresponding to the non-overlapping video window; the fourth simulation window is the simulation window other than the fifth simulation window among the N simulation windows;

[0231] The information determination module 23 includes:

[0232] The third adjustment unit 235 is configured to shrink the fourth simulation window and stretch the fifth simulation window if the N simulation windows are displayed in a single dimension, and display the adjusted fourth and fifth simulation windows on the simulation window page; an overlapping area exists between the adjusted fourth simulation window and the graphic prompt box;

[0233] The information determining unit 234 is further configured to determine adjustment position information and adjustment size information according to the adjusted N simulation windows.

[0234] The embodiment of the present application provides a video interaction device, which can display N video windows in a video interaction page; N is a positive integer; when a graphic prompt box is displayed in the video interaction page, a video interaction image is obtained from the video screens displayed in each of the N video windows; the content of the video interaction image is the content of the area covered by the graphic prompt box in the N video screens; if the video interaction image matches the virtual image indicated by the graphic prompt box, the virtual resource associated with the virtual image is displayed. Through the above process, the triggering of virtual resources can be achieved during the video interaction process, and the virtual resources can be triggered by the video screen displayed in each video window, and the video screen displayed in the video window is the screen of the device participating in the video interaction process, so that each terminal device can participate in the triggering process of the virtual resource, thereby improving the interactivity between each terminal device and enriching the video interaction function. In addition, since each terminal device participates in the triggering process of the virtual resource, the participation of each terminal device in the virtual resource is improved, thereby improving the promotion effect of the virtual resource, and further enriching the triggering method of the virtual resource and improving the flexibility of the virtual resource triggering.

[0235] See also Figure 12 , Figure 12 This is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. Figure 12 As shown, the computer device in the embodiment of the present application may include: one or more processors 1201, a memory 1202, and an input / output interface 1203. The processor 1201, the memory 1202, and the input / output interface 1203 are connected via a bus 1204. The memory 1202 is used to store computer programs, which include program instructions. The input / output interface 1203 is used to receive and output data, such as for data exchange between a terminal device and a video processing device. The processor 1201 is used to execute the program instructions stored in the memory 1202.

[0236] The processor 1201 may perform the following operations:

[0237] Display N video windows on the video interaction page; N is a positive integer;

[0238] When a graphic prompt box is displayed in a video interaction page, a video interaction image is obtained from the video screens displayed in the N video windows respectively; the content of the video interaction image is the content of the area covered by the graphic prompt box in the N video screens;

[0239] If the video interaction image matches the virtual image indicated by the graphic prompt box, the virtual resources associated with the virtual image are displayed.

[0240] In some feasible implementations, the processor 1201 may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor, or the processor may be any conventional processor, etc.

[0241] The memory 1202 may include a read-only memory and a random access memory, and provides instructions and data to the processor 1201 and the input / output interface 1203. A portion of the memory 1202 may also include a non-volatile random access memory. For example, the memory 1202 may also store device type information.

[0242] In a specific implementation, the computer device can execute the following operations through its built-in functional modules: Figure 3 For details on the implementation methods provided in each step, please refer to the Figure 3 The implementation methods provided in each step are not repeated here.

[0243] The embodiment of the present application provides a computer device, including: a processor, an input and output interface, and a memory, wherein the processor obtains a computer program in the memory and executes the computer program. Figure 3 The video interaction operation is performed by following the steps of the method shown in . The embodiment of the present application realizes the triggering of virtual resources during the video interaction process, and the virtual resources can be triggered by the video screen displayed in each video window, and the video screen displayed in the video window is the screen of the device participating in the video interaction process, so that each terminal device can participate in the triggering process of the virtual resource, thereby improving the interactivity between each terminal device and enriching the video interaction function. In addition, since each terminal device participates in the triggering process of the virtual resource, the participation of each terminal device in the virtual resource is improved, thereby improving the promotion effect of the virtual resource, and further enriching the triggering method of the virtual resource and improving the flexibility of the virtual resource triggering.

[0244] The present invention also provides a computer-readable storage medium storing a computer program suitable for being loaded and executed by the processor. Figure 3 For details on the video interaction methods provided in each step, please refer to the Figure 3The implementation methods provided in each step will not be repeated here. In addition, the description of the beneficial effects of adopting the same method will not be repeated. For technical details not disclosed in the computer-readable storage medium embodiment involved in this application, please refer to the description of the method embodiment of this application. As an example, the computer program can be deployed to be executed on one computer device, or on multiple computer devices located in one location, or on multiple computer devices distributed in multiple locations and interconnected by a communication network.

[0245] The computer-readable storage medium may be the video interaction device provided in any of the aforementioned embodiments or the internal storage unit of the computer device, such as the hard disk or memory of the computer device. The computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the computer device. Furthermore, the computer-readable storage medium may also include both the internal storage unit of the computer device and an external storage device. The computer-readable storage medium is used to store the computer program and other programs and data required by the computer device. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

[0246] The present application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs Figure 3 The method provided in the various optional methods realizes the triggering of virtual resources during the video interaction process, and can trigger the virtual resources through the video images displayed in each video window. The video images displayed in the video window are the images of the devices participating in the video interaction process, so that each terminal device can participate in the triggering process of the virtual resource, thereby improving the interactivity between each terminal device and enriching the video interaction function. In addition, since each terminal device participates in the triggering process of the virtual resource, the participation of each terminal device in the virtual resource is improved, thereby improving the promotion effect of the virtual resource, and further enriching the triggering method of the virtual resource and improving the flexibility of the virtual resource triggering.

[0247] The terms "first", "second", etc. in the description, claims, and drawings of the embodiments of the present application are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or device comprising a series of steps or units is not limited to the listed steps or modules, but may optionally include steps or modules not listed, or may optionally include other step units inherent to these processes, methods, apparatuses, products, or devices.

[0248] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in this description according to their functions. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0249] The methods and related devices provided by the embodiments of the present application are described with reference to the method flow charts and / or structural diagrams provided by the embodiments of the present application. Specifically, each process and / or block in the method flow charts and / or structural diagrams, as well as the combination of processes and / or blocks in the flow charts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable video interactive device to generate a machine, so that the instructions executed by the processor of the computer or other programmable video interactive device generate instructions for implementing the process. Figure 1 Schematic diagram of one or more processes and / or structures Figure 1 These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable video interactive device to work in a specific way, so that the instructions stored in the computer-readable memory produce a product including an instruction device, which implements the function specified in the process. Figure 1 Schematic diagram of one or more processes and / or structures Figure 1 These computer program instructions can also be loaded onto a computer or other programmable video interactive device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 The flow or flows and / or structures illustrate the steps of the functions specified in one block or multiple blocks.

[0250] The steps in the method of the embodiment of the present application can be adjusted in order, combined and deleted according to actual needs.

[0251] The modules in the device of the embodiment of the present application can be merged, divided and deleted according to actual needs.

[0252] The above disclosure is only a preferred embodiment of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

Claims

1. A video interaction method, characterized in that: The method comprises: Display N video windows on the video interaction page; N is an integer greater than 1; When a graphic prompt box is displayed in the video interaction page, a video interaction image is obtained from the video screens displayed respectively in the N video windows; the graphic prompt box is visually covered on the N video windows, and the content of the video interaction image is a combination of the content of the area covered by the graphic prompt box in the N video screens; If the video interaction image matches the virtual image indicated by the graphic prompt box, displaying the virtual resources associated with the virtual image; Among them, when a graphic prompt box is displayed in the video interaction page, a video interaction image is obtained from the video pictures respectively displayed in the N video windows, including: when a graphic prompt box is displayed in the video interaction page, and there is a non-overlapping video window among the N video windows, the N video windows are adjusted and displayed; the non-overlapping video window refers to a video window with no overlapping area with the graphic prompt box; the non-overlapping video window does not exist in the N video windows after adjustment and display; and the video interaction image is obtained from the video pictures respectively displayed in the N video windows after adjustment and display.

2. The method according to claim 1, wherein If the video interaction image matches the virtual image indicated by the graphic prompt box, displaying virtual resources associated with the virtual image includes: If the video interaction image matches the virtual image indicated by the graphic prompt box, displaying the virtual image; The virtual image is switched and displayed as a virtual resource associated with the virtual image.

3. The method according to claim 2, wherein If the video interaction image matches the virtual image indicated by the graphic prompt box, displaying the virtual image includes: If the video interaction image matches the virtual image indicated by the graphic prompt box, a mask layer is added to the video interaction page, and the virtual image is displayed in the mask layer.

4. The method according to claim 2, wherein The switching and displaying of the virtual image as a virtual resource associated with the virtual image includes: Switching and displaying the virtual image into at least two virtual resource icons; In response to a triggering operation on a target virtual resource icon among the at least two virtual resource icons, a target virtual resource corresponding to the target virtual resource icon is displayed.

5. The method according to claim 1, wherein The method further comprises: In response to a trigger operation on the virtual resource, displaying a resource trigger component of the virtual resource; In response to the triggering operation on the resource triggering component, a prompt message indicating successful acquisition of the virtual resource is displayed.

6. The method according to claim 1, wherein When a graphic prompt box is displayed in the video interaction page and there is a non-overlapping video window among the N video windows, performing window adjustment and display on the N video windows includes: When a graphic prompt box is displayed in the video interaction page, and there is a non-overlapping video window among the N video windows, and the N video windows are displayed in a single dimension, the non-overlapping video windows among the N video windows are extended along the display dimension, and the intersecting video windows among the N video windows are contracted along the display dimension; the intersecting video windows refer to video windows among the N video windows other than the non-overlapping video windows; the single-dimensional display refers to a single-row display or a single-column display; The adjusted N video windows are displayed in the single dimension.

7. The method according to claim 1, wherein When a graphic prompt box is displayed in the video interaction page and there is a non-overlapping video window among the N video windows, performing window adjustment and display on the N video windows includes: When a graphic prompt box is displayed in the video interaction page, and there is a non-overlapping video window among the N video windows, and the N video windows are displayed in multi-dimensional form, obtaining a prompt display area in the video interaction page; the multi-dimensional display refers to displaying in at least two rows and at least two columns; the prompt display area refers to a continuous rectangular area that does not include the non-overlapping video windows; The non-overlapping video window is inserted into the prompt display area, the N video windows are resized according to the insertion position of the non-overlapping video window in the prompt display area, and the N video windows after resizing are displayed.

8. The method according to claim 1, wherein The method further comprises: The video startup duration corresponding to the video interaction page is obtained. If the video startup duration is greater than or equal to the resource trigger time threshold, the graphic prompt box is displayed in the video interaction page.

9. The method according to claim 1, wherein The method further comprises: Acquire voice data of a target object, and convert the voice data into text to obtain text data corresponding to the voice data; Perform word segmentation processing on the text data to obtain M word segmentation phrases; M is a positive integer; If a resource keyword exists in the M segmented word phrases, a graphic prompt box corresponding to the resource keyword is obtained and the graphic prompt box is displayed in the video interaction page.

10. The method according to claim 9, wherein If a resource keyword exists in the M segmented word phrases, obtaining a graphic prompt box corresponding to the resource keyword and displaying the graphic prompt box on the video interaction page includes: If a resource keyword exists in the M segmented word phrases, obtaining the historical statistical number of the resource keyword in the interactive video corresponding to the video interactive page; If the historical statistical number is greater than or equal to the resource triggering number threshold, a graphic prompt box corresponding to the resource keyword is obtained and the graphic prompt box is displayed in the video interaction page.

11. The method according to claim 1, wherein When a graphic prompt box is displayed in the video interaction page, obtaining a video interaction image from the video pictures respectively displayed in the N video windows includes: When a graphic prompt box is displayed in the video interaction page, window position information and window size information of each video window are obtained, the video interaction page displaying the graphic prompt box is intercepted, the intercepted video interaction page is determined as a prompt image, and the window position information, the window size information and the prompt image are sent to a video processing device, so that the video processing device pre-adjusts the prompt image window based on the window position information and the window size information to obtain adjustment position information and adjustment size information; receiving the adjusted position information and the adjusted size information sent by the video processing device, and displaying the adjusted N video windows on the video interaction page according to the adjusted position information and the adjusted size information; A video interaction image is obtained from the video frames respectively displayed in the adjusted N video windows.

12. The method according to claim 1, wherein When a graphic prompt box is displayed in the video interaction page, obtaining a video interaction image from the video pictures respectively displayed in the N video windows includes: When a graphic prompt box is displayed in the video interaction page, image pixels covered by the graphic prompt box are obtained from the video images displayed in the N video windows respectively, and the image pixels covered by the graphic prompt box are combined into a video interaction image; The method further comprises: Obtain pixel color difference values between the image pixels constituting the video interaction image. If the pixel color difference values belong to a graphic fill color value range, determine that the video interaction image matches the virtual image indicated by the graphic prompt box; the graphic fill color value range is the color value range indicated by the graphic prompt box.

13. The method according to claim 1, wherein The performing window adjustment and display on the N video windows includes: Obtain window position information, window size information, and window identifiers corresponding to the N video windows respectively; Generate a simulation window page according to the window position information, the window size information and the window identifier; the simulation window page includes N simulation windows, and the video windows with the same window identifier correspond to the simulation windows; performing window pre-adjustment on the N simulated windows included in the simulated window page to obtain adjustment position information and adjustment size information; the adjustment position information and the adjustment size information are used to indicate the position information and size information of the N simulated windows after adjustment in the simulated window page, and are used to indicate the position information and size information corresponding to the N window identifiers, respectively; The video windows respectively associated with the N window identifiers are adjusted and displayed according to the adjustment position information and the adjustment size information.

14. The method according to claim 13, wherein The method further comprises: intercepting a video interaction page displaying the graphic prompt box, and determining the intercepted video interaction page as a prompt image; Acquire a virtual image corresponding to the graphic prompt box, and generate a video window mask layer in the prompt image based on the virtual image; Dividing the video window mask layer into N window sub-mask layers associated with the N video windows according to the window position information and the window size information; Obtaining image color value information of the virtual image, obtaining the pixel ratio of the image pixels in the i-th window sub-mask layer that match the image color value information, where i is a positive integer less than or equal to N; If the pixel ratio is greater than or equal to the image display threshold, determining that the i-th video window corresponding to the i-th window sub-mask layer is a cross video window; If the pixel ratio is less than the image display threshold, it is determined that the i-th video window corresponding to the i-th window sub-mask layer is a non-overlapping video window.

15. The method according to claim 13, wherein The pre-adjusting of the N simulation windows included in the simulation window page to obtain adjustment position information and adjustment size information includes: Obtaining a simulation prompt area in the simulation window page, and obtaining a first simulation window included in the simulation prompt area; the simulation prompt area is a continuous rectangular area that does not include simulation windows corresponding to non-overlapping video windows; the N simulation windows also include a second simulation window corresponding to the non-overlapping video window, and a third simulation window other than the first simulation window and the second simulation window; resizing the second simulation window and the first simulation window, and displaying the resized first simulation window and second simulation window in the simulation prompt area; stretching the third simulation window, and displaying the adjusted third simulation window in an area of the simulation window page except the simulation prompt area; According to the adjusted N simulation windows, adjustment position information and adjustment size information are determined.

16. The method according to claim 13, wherein The N simulation windows include a fourth simulation window and a fifth simulation window corresponding to the non-overlapping video window; the fourth simulation window is a simulation window among the N simulation windows excluding the fifth simulation window; The pre-adjusting of the N simulation windows included in the simulation window page to obtain adjustment position information and adjustment size information includes: If the N simulation windows are displayed in a single dimension, the fourth simulation window is shrunk, the fifth simulation window is stretched, and the adjusted fourth and fifth simulation windows are displayed on the simulation window page; there is an overlapping area between the adjusted fourth simulation window and the graphic prompt box; According to the adjusted N simulation windows, adjustment position information and adjustment size information are determined.

17. A video interaction device, characterized in that: The device comprises: The window display module is used to display N video windows in the video interaction page; N is an integer greater than 1; an image acquisition module, configured to acquire a video interaction image from the video screens displayed in the N video windows respectively when a graphic prompt box is displayed in the video interaction page; the graphic prompt box visually covers the N video windows, and the content of the video interaction image is a combination of the content of the area covered by the graphic prompt box in the N video screens; a resource display module, configured to display virtual resources associated with the virtual image if the video interaction image matches the virtual image indicated by the graphic prompt box; Among them, the image acquisition module is used to acquire video interaction images from the video pictures respectively displayed in the N video windows when a graphic prompt box is displayed in the video interaction page. It is specifically used to: when a graphic prompt box is displayed in the video interaction page and there is a non-overlapping video window among the N video windows, perform window adjustment and display on the N video windows; the non-overlapping video window refers to a video window that has no overlapping area with the graphic prompt box; the non-overlapping video window does not exist in the N video windows after adjustment and display; and acquire video interaction images from the video pictures respectively displayed in the N video windows after adjustment and display.

18. A computer device, characterized in that: Includes processor, memory, input and output interfaces; The processor is connected to the memory and the input / output interface respectively, wherein the input / output interface is used to receive and output data, the memory is used to store a computer program, and the processor is used to call the computer program so that the computer device executes the method according to any one of claims 1 to 16.

19. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a computer program, which is suitable for being loaded and executed by a processor, so that a computer device having the processor executes the method according to any one of claims 1 to 16.

20. A computer program product, characterized in that The computer program product includes computer instructions, which are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the method according to any one of claims 1 to 16.

Images