Multimedia component trigger method, device, electronic device, and storage medium

Abstract

The embodiments of the present disclosure provide a multimedia component trigger method, device, electronic device, and storage medium for determining a target trigger area in response to a gesture operation on a video playback interface. The target trigger area is a contact area of ​​the gesture operation on the video playback interface, and the video playback interface is used to play a currently displayed target video. The target trigger area is detected, and a hidden component or a video component is triggered based on the detection result. Here, the hidden component is used to display a corresponding target page in the video playback interface after being triggered, and the video component is used to perform a first application function on the target video after being triggered.

Description

[Technical Field]

[0001] TECHNICAL FIELD Embodiments of the present disclosure relate to the field of Internet technology, and more particularly to a multimedia component triggering method, device, electronic device, and storage medium.

[0002] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of priority to a patent application filed with the State Intellectual Property Office of China on September 8, 2022, bearing application number 202211098310.2 and entitled "Multimedia component triggering method, device, electronic device and storage medium," the entire contents of which are incorporated herein by reference. [Background technology]

[0003] Currently, internet-based short video applications are gaining recognition from an increasing number of users due to their advantages such as free posting and abundant content. In the prior art, such short video applications typically push videos to terminal devices based on feedstream technology, allowing users to easily watch videos on the terminal device through gesture operations such as sliding up and down. Summary of the Invention [Problem to be solved by the invention]

[0004] SUMMARY OF THE INVENTION Embodiments of the present disclosure provide a multimedia component triggering method, apparatus, electronic device, and storage medium. [Means for solving the problem]

[0005] In a first aspect, an embodiment of the present disclosure provides a multimedia component trigger method, including:

[0006] In response to a gesture operation on the video playback interface, a target trigger area is determined, the target trigger area being a contact area of ​​the gesture operation on the video playback interface for playing a currently displayed target video. The target trigger area is detected, and a hidden component or a video component is triggered based on the detection result. Here, the hidden component is used to display a corresponding target page in the video playback interface after being triggered. The video component is used to perform a first application function on the target video after being triggered.

[0007] In a second aspect, an embodiment of the present disclosure provides a multimedia component trigger device, including:

[0008] The response module is used to determine a target trigger area in response to a gesture operation on the video playback interface, where the target trigger area is a contact area of ​​the gesture operation on the video playback interface for playing the currently displayed target video.

[0009] The trigger module is used to detect a target trigger area and trigger a hidden component or a video component based on the detection result, where the hidden component is used to display a corresponding target page in the video playback interface after being triggered, and the video component is used to perform a first application function on the target video after being triggered.

[0010] In a third aspect, embodiments of the present disclosure provide an electronic device, including:

[0011] The electronic device includes a processor and a memory communicatively coupled to the processor.

[0012] The memory stores computer-executable instructions.

[0013] The processor executes computer-executable instructions stored in memory to implement the multimedia component triggering method described by the first aspect above and various possible designs of the first aspect.

[0014] In a fourth aspect, embodiments of the present disclosure provide a computer-readable storage medium that, when a processor executes computer-executable instructions, realizes the multimedia component triggering method described by the first aspect above and various possible designs of the first aspect.

[0015] In a fifth aspect, embodiments of the present disclosure provide a computer program product that, when executed by a processor, realizes the multimedia component triggering method described by the first aspect above and various possible designs of the first aspect.

[0016] In a sixth aspect, embodiments of the present disclosure provide a multimedia component triggering method that, when executed by a processor, realizes the first aspect described above and various possible designs of the first aspect. [Effects of the Invention]

[0017] The embodiments of the present disclosure provide a multimedia component trigger method, device, electronic device, and storage medium for determining a target trigger area, which is a contact area of ​​the gesture operation on a video playback interface for playing a currently displayed target video, detecting the target trigger area, and triggering a hidden component or a video component based on the detection result, wherein the hidden component is used to display a corresponding target page on the video playback interface after being triggered, and the video component is used to perform a first application function on the target video after being triggered. [Brief explanation of the drawings]

[0018] In order to more clearly describe the technical aspects of the embodiments of the present disclosure or the prior art, the following briefly describes the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are some embodiments of the present disclosure, and those skilled in the art can obtain other drawings based on these drawings without paying creative labor. [Figure 1] FIG. 1 is an application scene diagram of a multimedia component trigger method provided by an embodiment of the present disclosure; [Figure 2] 1 is a flowchart 1 of a multimedia component trigger method provided by an embodiment of the present disclosure; [Figure 3] 1 is a schematic diagram of a video playback interface provided by an embodiment of the present disclosure. [Figure 4] 1 is a schematic diagram of a target trigger area provided by an embodiment of the present disclosure. FIG. [Figure 5] 3 is a flowchart of a specific implementation method of step S101 in the embodiment shown in FIG. 2. [Figure 6] 1 is a schematic diagram of a process for determining a target trigger region provided by an embodiment of the present disclosure. FIG. [Figure 7] 3 is a flowchart of a specific implementation method of step S102 in the embodiment shown in FIG. 2. [Figure 8] 1 is a schematic diagram of a process for determining to trigger a hidden component provided by an embodiment of the present disclosure; [Figure 9] 1 is a schematic diagram of a dynamic target object provided by an embodiment of the present disclosure; [Figure 10] 2 is a flowchart 2 of a method for triggering a multimedia component provided by an embodiment of the present disclosure; [Figure 11] 1 is a schematic diagram of the logical structure of a video playback interface provided by an embodiment of the present disclosure; [Figure 12] 1 is a schematic diagram of a process for triggering a hidden component through a long press gesture operation provided by an embodiment of the present disclosure; [Figure 13] 1 is a schematic diagram of triggering hidden components based on a page container provided by an embodiment of the present disclosure; [Figure 14] FIG. 1 is a block diagram of a multimedia component trigger device provided by an embodiment of the present disclosure; [Figure 15] 1 is a structural schematic diagram of an electronic device provided by an embodiment of the present disclosure; [Figure 16] 1 is a schematic structural diagram of the hardware of an electronic device provided by an embodiment of the present disclosure; FIG. DETAILED DESCRIPTION OF THE INVENTION

[0019] In order to clarify the objectives, technical solutions and advantages of the embodiments of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only some embodiments of the present disclosure, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments in the present disclosure without creative work belong to the scope of protection of the present disclosure.

[0020] Hereinafter, application scenarios of the embodiments of the present disclosure will be described.

[0021] FIG. 1 is a diagram illustrating an application scenario of a multimedia component trigger method provided by an embodiment of the present disclosure. The multimedia component trigger method provided by an embodiment of the present disclosure can be applied to an application scenario of playing short videos, more specifically, to triggering hidden information in short videos. As shown in FIG. 1, the method provided by an embodiment of the present disclosure can be applied to terminal devices such as smartphones and tablets. For example, a short video application is running in the terminal device. During the process of playing a target video (short video) on the terminal device through the video playback interface of the application, some hidden information, i.e., "color eggs," are hidden and set in the video playback interface. When a user performs a gesture operation on the video playback interface to trigger a multimedia component corresponding to the color eggs (in the figure, a long press gesture is shown to trigger the color eggs), a hidden page corresponding to the hidden information, i.e., a "color egg page," is displayed on top of the video playback interface. More specifically, the purpose of triggering hidden information in short videos, for example, for promotional videos, campaign activity pages, etc., is realized.

[0022] In the prior art, short video applications based on feedstream technology could only realize simple interaction operations for currently played videos, such as switching videos and pressing "Like" on a video, and could not add more complex interaction operations, such as triggering a color egg in a short video (see the related introduction of the application scene shown in FIG. 1 for the color egg). This is because the video component for displaying videos in short video applications has a native operation mode preset by the application. For example, a long press gesture operation can realize the function of "Like" on a currently played video, and an up / down slide gesture operation can realize the function of "switching" the currently played video. Color Egg is a page display mode that enhances the fun of interaction and the diversity of content display by hiding trigger controls (not displaying the location of the trigger controls). This is achieved by the user triggering hidden components within a specific area through gesture operations. During this process, if the trigger area of ​​the hidden component overlaps with the trigger area of ​​the video component, the Color Egg trigger logic will conflict with the application's native operation logic, causing problems such as the hidden component being unusable or the video component being unusable. An embodiment of the present disclosure provides a multimedia component trigger method for solving the above problems.

[0023] Referring to FIG. 2, FIG. 2 is a flowchart 1 of a multimedia component trigger method provided by an embodiment of the present disclosure.

[0024] The method of this embodiment can be applied to a terminal device, and the multimedia component trigger method includes: Step S101 includes: determining, in response to a gesture operation on a video playback interface, a target trigger area, which is a contact area of ​​the gesture operation on the playback interface for playing a currently displayed target video.

[0025] For example, the method provided by the present embodiment may be performed by a terminal device such as a smartphone or a tablet. A video playback application, more specifically, a short video application based on feedstream technology, is running in the terminal device, where the application plays the short video through a video playback interface. FIG. 3 is a schematic diagram of a video playback interface provided by an embodiment of the present disclosure. As shown in FIG. 3, the video playback interface is a functional module implemented based on a function class for playing video provided by an operating system in a target application. While playing the target video, the video playback interface can execute corresponding application functions in response to a user's gesture operation on the video playback interface, such as switching videos with a slide gesture or adding a video to favorites with a long press gesture.

[0026] Based on the above description of the video playback interface, for example, when a user performs a gesture operation on a video playback interface displayed in a target application via an interaction unit, such as a touch screen, of a terminal device, the interaction unit can determine a contact area of ​​the gesture operation on the video playback interface, i.e., a target trigger area, by examining the gesture operation. FIG. 4 is a schematic diagram of a target trigger area provided by an embodiment of the present disclosure. As shown in FIG. 4, the interaction unit may be, for example, a touch screen, and the gesture operation may be, for example, a click gesture. When the click gesture is applied to the touch screen of the terminal device, it causes a change in the capacitance of the touch screen. The touch screen detects the change in capacitance and determines the specific contact position of the click gesture, more specifically, for example, the coordinates of the contact position, i.e., the contact coordinates. Furthermore, based on the area to which the contact coordinates belong, a target trigger area is determined in which the contact coordinates are located within the target trigger area. Furthermore, although not described in detail, the outline shape of the target trigger area can be various shapes, such as a non-rectangular, circular, or other irregular shape.

[0027] Furthermore, a possible implementation includes specific implementation steps of step S102, as shown in FIG.

[0028] Step S1011: Detecting contact coordinates corresponding to the gesture operation, the contact coordinates characterizing the coordinates of the contact point of the gesture operation on the video playback interface.

[0029] Step S1012: Based on the contact coordinates, a non-display trigger area, which is located within a first distance from the contact coordinates and in which a non-display component is set, is determined as a target trigger area.

[0030] For example, after detecting contact coordinates corresponding to a gesture operation, one possible implementation is to determine a target trigger area corresponding to the contact coordinates based on a preset mapping relationship between the contact coordinates and the trigger area; this implementation is not further described. Another possible implementation is to search for a hidden trigger area within a preset range centered on the contact coordinates using the contact coordinates. If a hidden trigger area is included in the preset range, the hidden trigger area is determined as the target trigger area. FIG. 6 is a schematic diagram of a process for determining a target trigger area provided by an embodiment of the present disclosure. As shown in FIG. 6, after determining contact coordinates A, a circular area Zoom_1 is detected with a center at contact coordinates A and a radius of a first distance R. If a partial overlap between the preset hidden trigger area Zoom_2 and Zoom_1 is detected, the hidden trigger area is deemed to be within the first distance of the contact coordinates, and the hidden trigger area Zoom_2 is determined as the target trigger area.

[0031] In this embodiment, the target trigger area is determined to be within the hidden trigger area by detecting the hidden trigger area within the preset range of contact coordinates corresponding to the gesture operation. In the application scenario of triggering a color egg (hidden information) in a short video, the color egg is usually invisible, which may cause the user's gesture operation to be inaccurate. The method in this embodiment realizes automatic adjustment when the contact coordinates are located in the peripheral area of ​​the hidden trigger area, thereby increasing the probability that the user will trigger the color egg and improving the user experience.

[0032] Step S102: Detect a target trigger area, and trigger a hidden component or a video component according to the detection result, where the hidden component is used to display a corresponding target page in the video playback interface after being triggered, and the video component is used to perform a first application function on the target video after being triggered.

[0033] Illustratively, after determining the target trigger area, the target trigger area is further detected, and the result is used to determine whether the target trigger area is used to trigger a hidden component or a video component. If the target trigger area is used to trigger a hidden component, the hidden component is triggered and a corresponding program is called, after which a corresponding target page is displayed in the video playback interface, thereby realizing the trigger purpose of the hidden information. If the target trigger area is used to trigger a video component, the video component is triggered and a corresponding program is called, after which a first application function is performed on the target video, thereby realizing a normal application function for the target video, such as "press like," "favorite," "video switch," etc.

[0034] In one possible implementation, the position of the hidden trigger area changes dynamically according to the playback of the target video, as shown in Figure 7, which illustratively includes a specific implementation step of step S102.

[0035] Step S1021: Detect the position of the target trigger area.

[0036] Step S1022: Trigger the hidden component if the target trigger region is within the identifying contour of a target object in the target video, where the target object is obtained by image recognition on the current frame of the target video.

[0037] Step S1023: Trigger a video component when the target trigger region is outside the identification contour of the target object in the target video.

[0038] Illustratively, the target object is an image element determined based on semantic information of the target video, such as a face, a person, or a distinctive object in the video, such as a car or a house. It can be obtained using image recognition technology, which will not be further described here. After detecting the position of the target trigger area, it is determined based on the position of the target trigger area whether the target trigger area falls within the identifying contour of the target object in the target video. Here, the identifying contour is a contour formed by extending the outer contour of the target object outward a preset distance, which is equal to or greater than 0. Illustratively, the area corresponding to the identifying contour is the hidden trigger area.

[0039] Furthermore, if the target trigger area falls within the identification contour of the target object, the target trigger area belongs to the non-display trigger area, and then triggers the non-display component to execute the subsequent corresponding call program; if the target trigger area does not fall within the identification contour of the target object, the target trigger area does not belong to the non-display trigger area, and then triggers the video component to execute the subsequent corresponding call program.

[0040] FIG. 8 is a schematic diagram of a process for determining whether to trigger a hidden component provided by an embodiment of the present disclosure. As shown in FIG. 8, a target video includes two target objects, namely, a "smartphone" and a "promotional display" in the target video. Here, the "smartphone" and the "promotional display" each correspond to an identification contour. After detecting a gesture operation to obtain a target trigger area, if the target trigger area falls within the identification contour corresponding to the "smartphone," the hidden component corresponding to the smartphone is triggered. For example, a target page A is displayed in a video playback interface, and the target page A is used to display parameters of the smartphone. If the target trigger area falls within the identification contour corresponding to the "promotional display," the hidden component corresponding to the promotional display is triggered. For example, a target page B is displayed in a video playback interface for displaying a video of a smartphone promotional activity. In addition, if the target trigger area does not fall within the identification contour corresponding to "smartphone" or within the identification contour corresponding to "promotional display", i.e., if the target trigger area is outside the identification contour of the target object of the target video, trigger the corresponding video component, such as collecting the currently played target video, based on a specific gesture operation.

[0041] In the steps of this embodiment, by detecting the relationship between the target trigger area and the identification contour of the target object, dynamic color egg triggering for different target objects is realized, and different target objects can trigger corresponding types of hidden information, thus increasing the diversity of information and content richness.

[0042] In one possible implementation manner, the position of the target object changes dynamically according to the playback of the target video, and before step S1021, further includes:

[0043] Detect target objects in target videos in real time.

[0044] Illustratively, during playback of the target video, the content played by the target video changes as the playback progresses, i.e., the content displayed in the current frame of the target video changes, and in each video frame, the target object corresponding to the target video may be in the same position or a different position, and the target object may be present or absent.

[0045] FIG. 9 is a schematic diagram of a dynamic target object provided by an embodiment of the present disclosure. As shown in FIG. 9, the target object is the "promotion display" in FIG. 9. As shown in FIG. 9, in the N1th frame of the target video, the "promotion display" is located on the left side of the target video (current video frame). In the N2th frame of the target video, the "promotion display" is located on the right side of the target video (current video frame). In the N3th frame of the target video, the "promotion display" is located outside the target video (current video frame), i.e., no object exists in the target video. When the target trigger region falls within the identification contour of the target object, a hidden component is triggered, and hidden information is triggered based on the following steps. When the target trigger region falls outside the identification contour, a corresponding video component is triggered based on a specific gesture operation, or the process returns to step S1020 and the above steps are re-executed to redetect the target object and the gesture operation.

[0046] In this embodiment, by detecting the relationship between the target trigger area and the identifying contour of the target object in the target video in real time, a dynamic hidden trigger area for the target video is realized, and the hidden trigger area can follow the specific target object in real time, thereby improving the flexibility and fun of multimedia component triggering.

[0047] In this embodiment, a target trigger area is determined in response to a gesture operation on the video playback interface. The target trigger area is a contact area of ​​the gesture operation on the video playback interface for playing the currently displayed target video. The target trigger area is detected, and a hidden component or a video component is triggered based on the detection result. Here, the hidden component is used to display a corresponding target page in the video playback interface after being triggered, and the video component is used to perform a first application function on the target video after being triggered. After detecting the gesture operation on the video playback page, the terminal device first determines the corresponding target trigger area based on the gesture operation, and then determines whether to trigger the hidden component or the video component based on the detection result for the target trigger area, thereby avoiding operation conflicts between the hidden component and the video component and realizing normal triggering of the hidden component, thereby increasing the fun of interaction during video playback and the diversity of content display in the hidden information trigger mode.

[0048] 10, which is a flowchart 2 of a method for triggering a multimedia component provided by an embodiment of the present disclosure. This embodiment further subdivides step S102 based on the embodiment shown in FIG. 2. Here, the video playback interface includes a video container and a page container superimposed on top of the video container. Here, the page container is placed on top of the video container.

[0049] The multimedia component trigger method provided in this embodiment includes:

[0050] Step S201: Set a page container to a display state, and display an instruction ID corresponding to a hidden component in the page container, which is used to indicate a trigger area corresponding to the hidden component.

[0051] 11 is a schematic diagram of the logical structure of a video playback interface provided by an embodiment of the present disclosure. The video playback interface includes a video container and a page container arranged on top of each other. The video container and the page container correspond to a layer, respectively, so that the video container and the page container can also be referred to as a video container layer and a page container layer. In the default state, the page container is set on top of the video container, but the page container is not displayed. Here, the video container is used to display the target video and place the video component, and the page container is used to display the target page and place the hidden component. The page container is not displayed until responding to a gesture operation on the video playback interface. Furthermore, the video container and the page container are software modules implemented by corresponding classes. Here, for example, the video container is implemented based on a canvas, and the page container is implemented based on a lynx container.

[0052] When the target video is played in the video playback interface, an instruction ID is displayed in the page container to indicate the location of the hidden component. More specifically, for example, the hidden trigger area is highlighted to indicate to the user which area to trigger the color egg video, thereby improving interaction efficiency. Note that step S201 is an optional step in this embodiment, and this embodiment can perform the next step without performing step S201.

[0053] Step S202: Determine a target trigger area in response to a gesture operation on the video playback interface, where the target trigger area is a contact area of ​​the gesture operation on the video playback interface for playing the currently displayed target video.

[0054] S203: Detect a target trigger area of ​​the page container.

[0055] S204: If a hidden component exists in the target trigger area of ​​the page container, a first call function corresponding to the hidden component is called, and the corresponding target page is displayed in the page container based on the call result of the first call function.

[0056] For example, when a user performs a gesture operation on the video playback interface, the terminal device detects the gesture operation and determines a corresponding target trigger area. The specific implementation manner of this step has been specifically described in step S101 of the embodiment shown in FIG. 2, so it will not be further described here.

[0057] Then, based on the obtained target trigger area, the terminal device first detects the page container and determines whether a hidden component exists within the target trigger area of ​​the page container. A specific implementation is achieved by calling the corresponding function interface of the page container, and will not be further described. Based on the embodiment shown in FIG. 11 and the introduction of the prior art above, both the page container and the application container can respond to a user's gesture operation. At the same time, the page container is overlaid on the application container. When a gesture operation is detected, both the page container and the application container must respond to the gesture operation, which results in a logical conflict. In this embodiment, in response to a gesture operation on a video playback interface, the terminal device first detects the target trigger area of ​​the page container. If a hidden component exists within the target trigger area of ​​the page container, the terminal device calls a first call function corresponding to the hidden component to implement the corresponding function. That is, the terminal device displays the corresponding target page within the page container and implements the trigger of hidden information. Then, if a hidden component does not exist within the target trigger area of ​​the page container, the terminal device calls a second call function corresponding to the video component within the video container to implement the corresponding function. That is, the terminal device executes a first application function, such as "like" a video. This solves the problem of logical conflicts between the page container and the application container.

[0058] More specifically, for example, the page container is a lynx container, and the video container is a canvas container. In a specific implementation, adding user-interaction-enabled=false to the lower full-screen canvas indicates that it does not need to respond to events. The remaining elements above the canvas respond to events normally without adding user-interaction-enabled=false. When a user detects an operation (e.g., a click) on the screen, the terminal device (or a target application running within it) detects the element that should respond to the event based on the click coordinates. For overlapping elements (here, the lower video and upper full-screen canvas), the default operation is to consume the event regardless of whether the upper element has a call function that binds the click. However, because the canvas has user-interaction-enabled=false set, it cannot be the event target during the detection phase. Therefore, the event target detection mechanism continues to run until the lower video element is found. When the user presses and holds the boot gesture, the page container level rises to the top level, playing the target page fullscreen.

[0059] In one possible embodiment, the gesture operation is illustratively a long press gesture operation.

[0060] A specific embodiment of step S204 is as follows: In response to a long press gesture operation, the boot ID is displayed.

[0061] When it is detected that the long press gesture operation continues for a first time, it triggers a hidden component corresponding to the target trigger area, and a target page corresponding to the hidden component is displayed in the video playback interface.

[0062] For example, in an application scenario that triggers hidden information, the user's gesture operation may encounter a false touch problem due to the hidden nature of the hidden component. For example, if the duration of a "long press gesture" operation is too short, it may be confused with a "click gesture" operation, resulting in a false touch and affecting the interactive experience.

[0063] 12 is a schematic diagram of a process for triggering a hidden component using a long press gesture provided by an embodiment of the present disclosure. As shown in FIG. 12, after a user performs a long press gesture on a video playback interface, the terminal device displays a boot ID on the video playback interface. The boot ID may be an icon that changes over time. As shown in FIG. 12, the boot ID is illustratively a circular progress bar. As the long press gesture continues, the circular progress bar continuously advances. When the long press gesture continues for a first time, the progress bar reaches its end. Then, a hidden component corresponding to the target trigger area is triggered. For example, a target page for playing a color egg video is displayed in the page container.

[0064] In this embodiment, the boot ID is set to trigger the hidden component after the first long press, which avoids errors and improves interaction efficiency and user experience.

[0065] Step S205: If there is no hidden component in the target trigger area of ​​the page container, call a second call function corresponding to the video component in the video container, and execute a first application function based on the call result of the second call function.

[0066] Illustratively, in another case, the video container for the target application is usually full screen, and no matter where in the video playback interface a gesture operation is performed, a trigger on the video component can be realized. Therefore, when there is no hidden component in the target trigger area of ​​the page container, this area is not a hidden trigger area. In this case, the video component of the video container is triggered, and the second call function corresponding to the video component is called, so as to realize control over the target video and execute the first application function.

[0067] 13 is a schematic diagram of triggering a hidden component based on a page container provided by an embodiment of the present disclosure. As shown in FIG. 13, when a page container overlaps a video container and generates a trigger event corresponding to a gesture operation, it first determines whether a hidden component exists in the target trigger area of ​​the page container. If a hidden component exists, the page container consumes the trigger event and displays the target page full screen within the page container (triggering the hidden component). If no hidden component exists, the trigger event passes through the page container and reaches the video container, which consumes the trigger event through the video container and causes the video to execute a first application function, such as "like."

[0068] In this embodiment, by setting the page container and the video container to overlap each other, the hidden component in the target trigger area of ​​the page container is first detected, and then the hidden component or the video component is triggered based on the detection result, thereby avoiding logical conflicts between the hidden component and the video component.

[0069] Corresponding to the multimedia component trigger method provided by the above-mentioned embodiment, Fig. 14 is a block diagram of the configuration of the multimedia component trigger device provided by the embodiment of the present disclosure. For convenience of explanation, only the parts related to the embodiment of the present disclosure are shown.

[0070] Referring to FIG. 14, the multimedia component trigger device 3 includes:

[0071] The response module 31 is used to determine a target trigger area in response to a gesture operation on the video playback interface, where the target trigger area is a contact area of ​​the gesture operation on the video playback interface for playing the currently displayed target video.

[0072] The trigger module 32 is used to detect a target trigger area and trigger a hidden component or a video component based on the detection result. After being triggered, the hidden component is used to display a corresponding target page in the video playback interface. After being triggered, the video component is used to perform a first application function on the target video.

[0073] In one embodiment of the present disclosure, the response module 31 is specifically used to: obtain contact coordinates corresponding to a gesture operation, where the contact coordinates characterize the coordinates of a contact point on the video playback interface where the gesture operation is made; and determine, based on the contact coordinates, a non-display trigger area located within a first distance from the contact coordinates and in which a non-display component is set, as a target trigger area, where the non-display trigger area is an area in which a non-display component is set.

[0074] In one embodiment of the present disclosure, the trigger module 32 is specifically used to: Detect a target object in the target video in real time Trigger a hidden component obtained by image recognition of the current frame of the target video if the target trigger region is within the identifying contour of the target object in the target video, and trigger a video component if the target trigger region is outside the identifying contour of the target object in the target video.

[0075] In one embodiment of the present disclosure, a video playback interface includes a video container and a page container configured to overlap each other, where the video container is used to display a target video and to place a video component, and the page container is used to display the target video and to place a hidden component, and the page container is not displayed until it responds to a gesture operation of the video playback interface.

[0076] In one embodiment of the present disclosure, the trigger module 32 is specifically used to: detect a target trigger area of ​​a page container; if a hidden component exists in the target trigger area of ​​the page container, call a first call function corresponding to the hidden component, and display a corresponding target page in the page container according to the call result of the first call function;

[0077] In one embodiment of the present disclosure, the trigger module 32 is further used to: call a second call function corresponding to a video component in a video container when no hidden component exists in the target trigger area of ​​the page container, and execute a first application function based on the call result of the second call function.

[0078] In one embodiment of the present disclosure, the video container is implemented based on a canvas, and the page container is implemented based on a lynx container.

[0079] In one embodiment of the present disclosure, in response to a gesture operation on the video playback interface, before determining the target trigger area, the trigger module 32 is also used to set the page container to a visible state and display, within the page container, an instruction ID corresponding to the hidden component that indicates the trigger area corresponding to the hidden component.

[0080] In one embodiment of the present disclosure, the gesture operation is a long press gesture operation. Before triggering the hidden component, the trigger module 32 is also used to display a guidance ID in response to the long press gesture operation.

[0081] The trigger module 32 is used to trigger the hidden component, specifically, after detecting that the long press gesture operation continues for a first time, trigger the hidden component corresponding to the target trigger area to display the target page corresponding to the hidden component in the video playback interface.

[0082] Here, the response module 31 is connected to the trigger module 32. The multimedia component trigger device 3 provided in this embodiment can implement the technical solutions of the above method embodiments, which have similar principles and technical effects, and this embodiment will not be described here.

[0083] FIG. 15 is a structural schematic diagram of an electronic device provided by an embodiment of the present disclosure.

[0084] As shown in FIG. 15, the electronic device 4 includes: The system includes a processor 41 and a memory 42 communicatively connected to the processor 41 .

[0085] The memory 42 stores computer-executable instructions, The processor 41 executes computer-executable instructions stored in the memory 42 to implement the multimedia component trigger method in the embodiment shown in FIGS.

[0086] Here, preferably, the processor 41 and the memory 42 are connected via a bus 43 .

[0087] The relevant explanations can be understood in accordance with the relevant explanations and effects corresponding to the steps in the corresponding embodiments with reference to FIGS. 2 to 13, and many of the explanations will be omitted here.

[0088] Referring to FIG. 16, a schematic diagram of the hardware structure of an electronic device 900 provided by an embodiment of the present disclosure is shown. The electronic device 900 may be a terminal device or a server. Here, terminal devices include, but are not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (PDAs), tablets (Portable Android Devices, PADs), portable multimedia players (PMPs), and in-vehicle terminals (e.g., car navigation terminals), as well as fixed terminals such as digital televisions (TVs) and desktop computers. The electronic device shown in FIG. 16 is merely an example and does not impose any limitations on the functions and scope of use of the embodiment of the present disclosure.

[0089] 16, electronic device 900 may include a processing unit (e.g., a central processor, a graphics processor, etc.) 901 that can perform various appropriate operations and processes in accordance with a program stored in read only memory (ROM) 902 or a program loaded from a storage device 908 into random access memory (RAM) 903. RAM 903 also stores various programs and data necessary for the operation of electronic device 900. Processing unit 901, ROM 902, and RAM 903 are connected to one another via a bus 904. An input / output (I / O) interface 905 is also connected to bus 904.

[0090] Generally, the following devices may be connected to the I / O interface 905: input devices 906, including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 907, including, for example, a liquid crystal display (LCD), speaker, vibrator, etc.; storage devices 908, including, for example, a magnetic tape, hard disk, etc.; and communication devices 909. The communication devices 909 may enable the electronic device 900 to communicate wirelessly or via wires with other devices to exchange data. While FIG. 16 illustrates the electronic device 900 with various devices, it should be understood that it need not implement or include all of the illustrated devices. Alternatively, more or fewer devices may be implemented or included.

[0091] In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product. The computer program product includes a computer program carried on a computer-readable medium, the computer program including program code for executing the methods illustrated in the flowcharts. In such an embodiment, the computer program may be downloaded and installed from a network via the communication device 909, installed from the storage device 908, or installed from the ROM 902. When the computer program is executed by the processing device 901, the functions defined by the methods of the embodiments of the present disclosure are performed.

[0092] It should be noted that the computer-readable medium described above in this disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media include, but are not limited to, an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program for instructions to execute or be used in connection with a system, apparatus, or device. In contrast, in this disclosure, a computer-readable signal medium may include a propagating data signal in baseband or as part of a carrier wave that carries computer-readable program code. Such a propagating data signal may take various forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the foregoing. A computer-readable signal medium may be any computer-readable medium, other than a computer-readable storage medium, that can transmit, propagate, or transmit a program used by or in connection with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted over any suitable medium, including, but not limited to, electrical wire, optical cable, radio frequency (RF), etc., or any suitable combination of the foregoing.

[0093] The computer-readable medium may be included in the electronic device, or may exist separately from the electronic device.

[0094] The computer-readable medium carries one or more programs that, when executed by an electronic device, cause the electronic device to perform the method shown in the above embodiment.

[0095] Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and the like, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can run entirely on the user computer, partially on the user computer, as a separate package, partially on the user computer and partially on a remote computer, or entirely on a remote computer or server. When referring to a remote computer, the remote computer can be connected to the user computer via any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or can be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0096] The flowcharts and block diagrams in the figures illustrate possible architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program segment, or portion of code, including one or more executable instructions for implementing a given logical function. It should be noted that in alternative implementations, the functions shown in the blocks may occur in a different order than that shown in the figures. For example, two blocks shown in succession may, in fact, be essentially executed in parallel or may be executed in the reverse order, depending on the functionality involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented in a dedicated hardware-based system that performs a given function or operation, or may be implemented in a combination of dedicated hardware and computer instructions.

[0097] The units described in the embodiments of the present disclosure may be realized by software or hardware, but the names of the units may not necessarily be limiting of the units themselves, for example, the first acquisition unit may be described as "a unit for acquiring at least two Internet Protocol addresses."

[0098] The functions described herein may be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that may be used include, but are not limited to, Field-Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Parts (ASSPs), System on Chip (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0099] In the context of the present disclosure, a machine-readable medium may be a tangible medium that contains or can store a program for use by, or in connection with, an instruction execution system, device, or apparatus. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or apparatus, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include one or more wire-based electrical connections, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0100] In a first aspect, according to one or more embodiments of the present disclosure, there is provided a multimedia component trigger method, including:

[0101] In response to a gesture operation on the video playback interface, a target trigger area is determined, the target trigger area being a contact area of ​​the gesture operation on the video playback interface for playing a currently displayed target video. The target trigger area is detected, and a hidden component or a video component is triggered based on the detection result. Here, the hidden component is used to display a corresponding target page in the video playback interface after being triggered. The video component is used to perform a first application function on the target video after being triggered.

[0102] According to one or more embodiments of the present disclosure, determining a target trigger area in response to a gesture operation on a video playback interface includes: obtaining contact coordinates corresponding to the gesture operation, the contact coordinates characterizing coordinates of a contact point on the video playback interface of the gesture operation; and determining, based on the contact coordinates, a non-display trigger area located within a first distance from the contact coordinates and having a non-display component as the target trigger area, where the non-display trigger area is an area having a non-display component.

[0103] According to one or more embodiments of the present disclosure, detecting the target trigger region and triggering a non-display component or a video component based on the detection result includes: detecting a target object in the target video in real time; triggering a non-display component if the target trigger region is within an identifying contour of the target object in the target video, the target object being obtained by image recognition on the current frame of the target video; and triggering a video component if the target trigger region is outside the identifying contour of the target object in the target video.

[0104] According to one or more embodiments of the present disclosure, a video playback interface includes an overlapping video container and a page container, where the video container is used to display a target video and configure a video component, and the page container is used to display a target page and configure a hidden component that is not displayed before a gesture operation in response to the video playback interface.

[0105] According to one or more embodiments of the present disclosure, detecting a target trigger area and triggering a hidden component or a video component based on a detection result includes: detecting a target trigger area of ​​a page container; if a hidden component exists in the target trigger area of ​​the page container, calling a first call function corresponding to the hidden component, and displaying a corresponding target page in the page container based on a call result of the first call function.

[0106] According to one or more embodiments of the present disclosure, the method further includes calling a second call function corresponding to a video component in the video container when no hidden component is present in the target trigger area of ​​the page container, and executing the first application function based on a call result of the second call function.

[0107] According to one or more embodiments of the present disclosure, the video container is implemented based on a canvas, and the page container is implemented based on a lynx container.

[0108] According to one or more embodiments of the present disclosure, before determining a target trigger area in response to a gesture operation on a video playback interface, the method further includes setting the page container to a visible state and displaying an indication ID within the page container to indicate a trigger area corresponding to the hidden component.

[0109] According to one or more embodiments of the present disclosure, the gesture operation is a long press gesture operation, and further includes displaying a guidance ID in response to the long press gesture operation before triggering the hidden component. Triggering the hidden component includes triggering a hidden component corresponding to the target trigger area to display a target page corresponding to the hidden component in the video playback interface after detecting that the long press gesture operation continues for a first length of time.

[0110] In a second aspect, according to one or more embodiments of the present disclosure, there is provided a multimedia component trigger device, including:

[0111] The response module is used to determine a target trigger area in response to a gesture operation on the video playback interface, where the target trigger area is a contact area of ​​the gesture operation on the video playback interface for playing the currently displayed target video.

[0112] The trigger module is used to detect a target trigger area and trigger a hidden component or a video component based on the detection result, where the hidden component is used to display a corresponding target page in the video playback interface after being triggered, and the video component is used to perform a first application function on the target video after being triggered.

[0113] In one embodiment of the present disclosure, the response module is specifically used to: obtain contact coordinates corresponding to a gesture operation, where the contact coordinates characterize the coordinates of a contact point on the video playback interface where the gesture operation is made; and determine, based on the contact coordinates, a non-display trigger area located within a first distance from the contact coordinates and in which a non-display component is set, as a target trigger area, where the non-display trigger area is an area in which a non-display component is set.

[0114] In one embodiment of the present disclosure, the trigger module is specifically used to: detect a target object in a target video in real time, and trigger a hidden component obtained by image recognition of the current frame of the target video if the target trigger region is within the identifying contour of the target object in the target video, and trigger a video component if the target trigger region is outside the identifying contour of the target object in the target video.

[0115] In one embodiment of the present disclosure, a video playback interface includes a video container and a page container configured to overlap each other, where the video container is used to display a target video and to place a video component, and the page container is used to display the target video and to place a hidden component, and the page container is not displayed until it responds to a gesture operation of the video playback interface.

[0116] In one embodiment of the present disclosure, the trigger module is specifically used for: detecting a target trigger area of ​​a page container; if a hidden component exists in the target trigger area of ​​the page container, calling a first call function corresponding to the hidden component, and displaying a corresponding target page in the page container according to the call result of the first call function;

[0117] In an embodiment of the present disclosure, the trigger module is further used for: calling a second call function corresponding to a video component in a video container when no hidden component exists in a target trigger area of ​​a page container, and executing a first application function according to a call result of the second call function.

[0118] In one embodiment of the present disclosure, the video container is implemented based on a canvas, and the page container is implemented based on a lynx container.

[0119] In one embodiment of the present disclosure, before determining a target trigger area in response to a gesture operation on a video playback interface, the trigger module is further used to set the page container to a visible state and display an indication ID corresponding to the hidden component within the page container, and the indication ID is used to indicate the trigger area corresponding to the hidden component.

[0120] In one embodiment of the present disclosure, the gesture operation is a long press gesture operation, and before triggering a hidden component, the trigger module displays boot identification information in response to the long press gesture operation. When triggering a hidden component, specifically after detecting that the long press gesture operation continues for a first length of time, the trigger module triggers a hidden component corresponding to the target trigger area to display a target page corresponding to the hidden component in the video playback interface.

[0121] In a third aspect, in accordance with one or more embodiments of the present disclosure, there is provided an electronic device, the electronic device including a processor and a memory communicatively coupled to the processor.

[0122] The memory stores computer-executable instructions.

[0123] The processor executes computer-executable instructions stored in memory to implement the multimedia component triggering method described by the first aspect above and various possible designs of the first aspect.

[0124] In a fourth aspect, according to one or more embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer-executable instructions, which, when executed by a processor, realize various possible designed multimedia component triggering methods, such as those of the first and second aspects described above.

[0125] In a fifth aspect, embodiments of the present disclosure provide a computer program product that, when executed by a processor, realizes the multimedia component triggering method described by the first aspect above and various possible designs of the first aspect.

[0126] In a sixth aspect, embodiments of the present disclosure provide a multimedia component triggering method that, when executed by a processor, realizes the first aspect described above and various possible designs of the first aspect.

[0127] The above description merely describes preferred embodiments of the present disclosure and the technical principles used. Those skilled in the art should understand that the scope of the present disclosure is not limited to the technical proposals based on the specific combinations of the above-mentioned technical features, but also encompasses other technical proposals formed by any combination of the above-mentioned technical features or equivalent features without departing from the concept of the above-mentioned disclosure. For example, the above-mentioned features and technical features having similar functions disclosed in the present disclosure (but not limited to these) may be substituted for each other.

[0128] Furthermore, while operations are illustrated using a particular order, this should not be understood as requiring them to be performed in the particular order or sequence illustrated. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes details of several specific implementation schemes, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of individual embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments alone or in any suitable subcombination.

[0129] Although the present subject matter has been described using language specific to structural features and / or methodological logic operations, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or operations described above. On the contrary, the specific features and operations described above are merely example forms of implementing the claims.

Claims

1. A multimedia component trigger method, comprising: determining a target trigger area in response to a gesture operation on a video playback interface, the target trigger area being a contact area of ​​the gesture operation on the video playback interface for playing a currently displayed target video; detecting the target trigger area and triggering a non-display component or a video component based on the detection result; The hidden component is used to display a corresponding target page in the video playback interface after being triggered; the video component is used to perform a first application function on the target video after being triggered; method.

2. The step of determining a target trigger area in response to a gesture operation on the video playback interface includes: obtaining contact coordinates corresponding to the gesture operation, the contact coordinates characterizing coordinates of a contact point on the video playback interface of the gesture operation; determining, based on the contact coordinates, a non-display trigger area that is located within a first distance from the contact coordinates and in which a non-display component is set, as the target trigger area; The method of claim 1 , comprising:

3. The step of detecting the target trigger area and triggering a non-display component or a video component based on the detection result includes: detecting a target object in a target video in real time; triggering the non-display component if the target trigger region is within an identifying contour of a target object in the target video, the target object being obtained by image recognition on a current frame of the target video; triggering the video component when the target trigger region is outside an identifying contour of a target object in the target video; 3. The method of claim 1 or 2, comprising:

4. the video playback interface includes a video container and a page container that are set to overlap; the video container is used to display the target video and configure the video component; the page container is used to display the target page and configure the hidden component; the page container is invisible before responding to a gesture operation on the video playback interface; The method according to claim 1 or 2.

5. The step of detecting the target trigger area and triggering a non-display component or a video component based on the detection result includes: detecting a target trigger region of the page container; When a hidden component exists in a target trigger area of ​​the page container, calling a first call function corresponding to the hidden component, and displaying a corresponding target page in the page container based on a call result of the first call function; The method of claim 4, comprising:

6. The method further comprises: calling a second call function corresponding to a video component in the video container when no hidden component exists in the target trigger area of ​​the page container, and executing the first application function based on a call result of the second call function; The method of claim 5 , comprising:

7. The video container is realized based on a canvas, The page container is implemented based on the lynx container.

7. The method according to claim 5 or 6.

8. before the step of determining a target trigger region in response to a gesture operation on the video playback interface, further setting the page container to a visible state and displaying a display ID corresponding to the hidden component within the page container; Including, The display ID indicates a trigger area corresponding to the non-display component.

8. The method according to any one of claims 4 to 7.

9. the gesture operation is a long press gesture operation, before the step of triggering the hidden component, further displaying a boot ID in response to the long press gesture operation; The step of triggering the hidden component comprises: triggering a hidden component corresponding to the target trigger area and displaying a target page corresponding to the hidden component within the video playback interface when detecting that the long press gesture operation continues for a first time length; 9. The method of claim 1, comprising:

10. A multimedia component trigger device, comprising: a response module used to determine a target trigger area in response to a gesture operation on a video playback interface, the target trigger area being a contact area of ​​the gesture operation on the video playback interface for playing a currently displayed target video; a trigger module used to detect the target trigger area and trigger a non-display component or a video component based on the detection result; The hidden component is used to display a corresponding target page in the video playback interface after being triggered; the video component is used to perform a first application function on the target video after being triggered; Device.

11. An electronic device, a processor and a memory communicatively coupled to the processor; the memory storing computer-executable instructions; The processor executes computer-executable instructions stored in the memory to perform the method of any one of claims 1 to 9. electronic equipment.

12. 1. A computer-readable storage medium, comprising: The computer-readable storage medium has computer-executable instructions stored thereon; 10. The computer-executable instructions, when executed by a processor, perform the method of any one of claims 1 to 9. A computer-readable storage medium.

13. A computer program product comprising a computer program which, when executed by a processor, performs the method of any one of claims 1 to 9.

14. A computer program for carrying out the method according to any one of claims 1 to 9.

Images