Bullet screen control method, device, electronic device and storage medium

Abstract

The embodiments of the present application provide a barrage control method, device, electronic device and storage medium, which relate to the field of video processing technology to solve the problem of a relatively single barrage presentation method. The method includes: when a gesture image captured by a camera meets a trigger condition, determining a barrage control area of ​​a video area according to the gesture image, wherein the barrage control area displays N barrages, where N is greater than or equal to 1; and controlling the movement of the N barrages. In the above-mentioned barrage control method, the barrage control area can be determined by the gesture image captured by the camera, and the barrage in the barrage control area can be controlled, which can improve the diversity of barrage presentation methods. For users, the barrage can be controlled by only specific gesture operations. The whole process is simple to operate and can enhance the user's interactive experience.

Description

Technical Field

[0001] The present application relates to the field of video processing, and in particular to a bullet screen control method, device, electronic device and storage medium. Background Art

[0002] Danmu refers to comments sent by people who watch the video and can be directly displayed on the video. Although the sending time of different Danmu varies, they will appear at a specific time point in the video. Therefore, Danmu can give viewers a sense of "real-time interaction". In the prior art, Danmu is generally displayed on the video in a fixed way, which is relatively simple. Summary of the invention

[0003] The embodiments of the present application provide a bullet screen control method, device, electronic device and storage medium to solve the problem that the bullet screen presentation method in the prior art is relatively single.

[0004] The embodiment of the present application is implemented as follows:

[0005] In a first aspect, an embodiment of the present application provides a bullet screen control method, including:

[0006] When the gesture image captured by the camera meets the trigger condition, a bullet screen control area of ​​the video area is determined according to the gesture image, and the bullet screen control area displays N bullet screens, where N is greater than or equal to 1;

[0007] Control the movement of the N bullet comments.

[0008] In a second aspect, an embodiment of the present application provides a bullet screen control device, including:

[0009] A first determination module is used to determine a bullet screen control area of ​​a video area according to a gesture image when a gesture image captured by a camera meets a trigger condition, wherein the bullet screen control area displays N bullet screens, where N is greater than or equal to 1;

[0010] A control module is used to control the movement of the N bullet comments.

[0011] In a third aspect, an embodiment of the present application further provides an electronic device, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the computer program, when executed by the processor, implements the steps of the barrage control method described in the first aspect.

[0012] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the barrage control method described in the first aspect are implemented.

[0013] In an embodiment of the present application, when the gesture image captured by the camera meets the trigger condition, the bullet screen control area of ​​the video area is determined according to the gesture image, and the bullet screen control area displays N bullet screens; the movement of the N bullet screens is controlled. In the above-mentioned bullet screen control method, the bullet screen control area can be determined by the gesture image captured by the camera, and the bullet screen in the bullet screen control area can be controlled, which can improve the diversity of bullet screen presentation methods. For users, the control of the bullet screen can be achieved through specific gesture operations. The whole process is simple to operate and can enhance the user's interactive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 is a flow chart of the bullet screen control method provided in an embodiment of the present application;

[0015] Figure 2 is a schematic diagram of a bullet screen control display interface provided in an embodiment of the present application;

[0016] Figure 3 is a schematic diagram of a gesture image provided in an embodiment of the present application satisfying a trigger condition;

[0017] Figures 4 to 5 is a schematic diagram of determining the motion trajectory of a gesture image provided by an embodiment of the present application;

[0018] Figure 6 It is a schematic diagram of determining a bullet screen control area provided in an embodiment of the present application;

[0019] Figure 7 is a schematic diagram of determining a barrage in a barrage control area provided by an embodiment of the present application;

[0020] Figure 8 is a structural diagram of a bullet screen control device provided in an embodiment of the present application;

[0021] Fig. 9 is a structural diagram of an electronic device provided in an embodiment of the present application;

[0022] Fig.10 This is another structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0023] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0024] See also Figure 1 , Figure 1: is a flow chart of the bullet screen control method provided by the embodiment of the present application. Figure 1 As shown, this embodiment provides a bullet screen control method, including the following steps:

[0025] Step 101: when a gesture image captured by a camera meets a trigger condition, a bullet screen control area of ​​a video area is determined according to the gesture image, and N bullet screens are displayed in the bullet screen control area;

[0026] Step 102: Control the movement of the N bullet comments.

[0027] For ease of understanding and explanation, the barrage control method of an embodiment of the present application is explained below using a barrage control device as the execution subject.

[0028] Before step 101, the barrage control device can obtain the gesture image captured by the camera and detect whether the gesture image captured by the camera meets the trigger condition. For the user, the user can turn on the camera when watching the video, and when the user needs to interact with the barrage, the user can input the gesture that meets the trigger condition. The camera can also be turned on automatically by the barrage control device when the barrage control device detects that the user is watching the video.

[0029] In the embodiment of the present application, the gesture image can be understood as an image of the user's hand captured by a camera, for example, it can be an image of a finger or an image of the entire palm.

[0030] In step 101, when it is detected that the gesture image meets the trigger condition, the bullet screen control device can determine the bullet screen control area of ​​the video area according to the gesture image. For example, the bullet screen control area can be determined according to the size of the gesture image, or the bullet screen control area can be determined according to the projection of the gesture image on the video area, or the bullet screen control area can be determined according to the movement trajectory of the gesture image, or a one-to-one mapping relationship between the gesture image and the bullet screen control area can be pre-configured, and the bullet screen control area is determined according to the mapping relationship. For example, the bullet screen control area corresponding to the first gesture image is pre-configured as the middle area of ​​the video area, the bullet screen control area corresponding to the second gesture image is pre-configured as the upper left corner area of ​​the video area, and so on.

[0031] In an embodiment of the present application, the gesture image that meets the trigger condition and the gesture image that determines the barrage control area may be gesture images at the same time or gesture images at different times; they may be gesture images of the same posture at different times or gesture images of different postures at different times.

[0032] As an example, when the gesture image meets the trigger condition, the camera can start recording the motion trajectory of the gesture image in the target area, and determine the bullet screen control area according to the motion trajectory of the gesture image.

[0033] Since the bullet screen is not static in the video area, but is presented in the video area in a scrolling manner, the bullet screen can be uniquely identified by an ID to ensure that the IDs of all bullet screens are not repeated. Specifically, the identification method can be identified by a natural number growth method, or by an identification method that is accurate to microseconds according to the bullet screen time. When determining the bullet screen control area, the ID of the bullet screen displayed in the bullet screen control area can be determined, so that the controlled bullet screen can be determined based on the ID later.

[0034] In step 102, the bullet screen control device may control the N bullet screens displayed in the bullet screen control area, specifically, control the movement of the N bullet screens.

[0035] It should be noted that the barrage displayed in the barrage control area may include complete barrages, that is, the entire barrage is located in the barrage control area, and may also include incomplete barrages, that is, part of the barrage is located in the barrage control area, and the other part is located outside the barrage control area. The N barrages displayed in the barrage control area may refer to the N complete barrages displayed in the barrage control area, or to any barrage displayed in the barrage control area. Assuming that the barrage control area displays 3 complete barrages and 2 incomplete barrages, N can be either 3 or 5. When only 1 barrage is displayed in the barrage control area, N can be 1. In other words, N is an integer greater than or equal to 1.

[0036] In this embodiment, when the gesture image captured by the camera meets the trigger condition, the bullet screen control area of ​​the video area is determined according to the gesture image, and the bullet screen control area displays N bullet screens; the movement of the N bullet screens is controlled. In the above-mentioned bullet screen control method, the bullet screen control area can be determined by the gesture image captured by the camera, and the bullet screen in the bullet screen control area can be controlled, which can improve the diversity of bullet screen presentation methods. For users (i.e., video viewers), the control of the bullet screen can be achieved through specific gesture operations. The whole process is simple to operate and can enhance the user's interactive experience.

[0037] In some optional implementations, before determining the bullet screen control area of ​​the video area according to the gesture image, the method further includes:

[0038] Displaying the gesture image in a target area of ​​the current display interface, wherein the size of the target area is smaller than the size of the video area;

[0039] When it is detected that the gesture image moves to a preset position in the target area, it is determined that the gesture image satisfies the trigger condition.

[0040] In this implementation, the target area may be located at the top layer of the video screen to display the gesture image captured by the camera. The user may see the gesture image through the target area and see the motion track of the gesture image in the video simulation area.

[0041] The bullet screen control device can calculate whether the gesture image moves to the preset position through gesture tracking and other technologies. If the gesture image moves to the preset position, the gesture image meets the trigger condition; if the gesture image does not move to the preset position, the gesture image does not meet the trigger condition.

[0042] In this implementation, by displaying the gesture image in the target area, the user can understand the gesture situation in real time and make the gesture image meet the trigger condition as soon as possible, thereby improving the controllability of the barrage control, improving the operability of the user in the entire barrage control process, and enhancing the user's interactive experience.

[0043] In some optional embodiments, the target area includes a gesture trigger area;

[0044] The step of determining that the gesture image satisfies the trigger condition when detecting that the gesture image moves to a preset position in the target area includes:

[0045] When it is detected that the gesture image is located in the gesture triggering area and the gesture image moves to the boundary of the gesture triggering area, it is determined that the gesture image satisfies the triggering condition.

[0046] In this embodiment, the gesture trigger area can be understood as a trigger area, which can be located in the middle of the target area. The user can first place the palm so that the gesture image is located in the gesture trigger area, and control the palm to move to the boundary of the gesture trigger area.

[0047] In this implementation, by setting a gesture trigger area, the user can better control the movement of the palm to a specific position, so that the gesture image meets the trigger condition as soon as possible, thereby improving the controllability of the barrage control, improving the user's operability in the entire barrage control process, and enhancing the user's interactive experience.

[0048] In some optional implementations, the aspect ratio of the target area is equal to the aspect ratio of the video area;

[0049] The step of determining the bullet screen control area of ​​the video area according to the gesture image includes:

[0050] Based on the ratio of the target area to the video area, mapping the gesture image of the target area to the video area in equal proportion to obtain a motion trajectory of the gesture image in the video area;

[0051] The area covered by the movement trajectory of the gesture image in the video area is determined as the bullet screen control area.

[0052] In this implementation, the aspect ratio of the target area is the same as that of the video area, and the target area is a proportionally reduced area of ​​the video area. Therefore, the target area can be called a control area or a video simulation area.

[0053] In this implementation, the barrage control area is determined by proportionally mapping the gesture image of the target area to the video area. The barrage control area determined in this way can better conform to the user's senses, making it easier for the user to make appropriate gestures to control the barrage, thereby improving the user's operability in the entire barrage control process and enhancing the user's interactive experience.

[0054] In the embodiment of the present application, after the bullet screen control area is determined, the subsequent process of controlling the movement of the bullet screen may be related to or unrelated to the gesture image. In other words, the gesture image may play a role in the subsequent process of controlling the movement of the bullet screen, or the subsequent process of controlling the movement of the bullet screen no longer depends on the gesture image. The embodiment of the present application does not limit this.

[0055] The following describes the process of controlling the movement of the bullet screen and the situation related to the gesture image.

[0056] In some optional implementations, controlling the movement of the N bullet screens includes:

[0057] Control the N bullet comments to move along a movement trajectory of the gesture image in the video area.

[0058] In this implementation, controlling the barrage to move along the motion trajectory of the gesture image in the video area can provide users with a visual effect that the barrage can be manipulated (such as grabbing or pushing), which can increase the diversity of barrage presentation methods and enhance the user's interactive experience.

[0059] Optionally, controlling the N bullet comments to move along a movement trajectory of the gesture image in the video area includes:

[0060] Controlling the N bullet screens to tilt according to the tilt angle of the gesture image;

[0061] Control the N bullet comments to move along a movement trajectory of the gesture image in the video area.

[0062] In this implementation, the barrage is controlled to tilt according to the tilt angle of the gesture image, and the barrage is controlled to move along the motion trajectory of the gesture image in the video area, which can further increase the diversity of barrage presentation methods and further enhance the user's interactive experience.

[0063] Optionally, after controlling the N bullet screens to tilt according to the tilt angle of the gesture image, the method further includes:

[0064] In the case that the N barrages exceed the area covered by the gesture image in the video area, the N barrages are controlled to be proportionally reduced until the N barrages do not exceed the area covered by the gesture image in the video area.

[0065] In this implementation, by controlling the barrage to be proportionally reduced to not exceed the area covered by the gesture image in the video area, the diversity of the barrage presentation methods can be further improved, and the user's interactive experience can be further enhanced.

[0066] Optionally, when the area occupied by the N barrages is smaller than the area covered by the gesture image in the video area, the N barrages are controlled to be enlarged proportionally until the N barrages do not exceed the area covered by the gesture image in the video area.

[0067] In this implementation, by controlling the barrage to be proportionally enlarged to not exceed the area covered by the gesture image in the video area, the diversity of the barrage presentation methods can be further improved, and the user's interactive experience can be further enhanced.

[0068] The above optional implementation manner realizes controlling the movement of the bullet screen through the user's gesture movement, that is, the process of controlling the movement of the bullet screen is related to the gesture image.

[0069] The following describes the case where the process of controlling the movement of the bullet screen is not related to the gesture image.

[0070] In some optional implementations, after determining the bullet screen control area of ​​the video area according to the gesture image and before controlling the movement of the N bullet screens, the method further includes:

[0071] Determine the maximum free area where the N bullet comments are located;

[0072] The controlling the movement of the N bullet screens includes:

[0073] Control the N bullet comments to move in a preset manner within the maximum idle area.

[0074] The above-mentioned preset method may include at least one of translation, flipping, rotation, shape change, arrangement change and adding special effects.

[0075] The maximum free area can be understood as the maximum area above, below, left, and right where there are no other bullet screens.

[0076] In this implementation, the entire maximum free area can be used as the area where the N barrages can be moved, or the area occupied by the gesture image in the maximum free area can be removed and the remaining free area can be used as the area where the N barrages can be moved (that is, the area where the N barrages can be moved is the area of ​​the maximum free area excluding the area occupied by the gesture image).

[0077] In this implementation, by determining the maximum free area where the bullet screen is located and controlling the bullet screen to move in a preset manner in the maximum free area, it is possible to ensure that the movement of the bullet screen will not have an adverse effect on the bullet screen outside the bullet screen control area.

[0078] Optionally, the determining the maximum idle area where the N bullet comments are located includes:

[0079] Calculate the number of grids occupied by the N bullet comments in the video area according to a predefined unit grid size;

[0080] Taking the positions of the N bullet comments as the starting point, search for free grids row by row and column by column to determine the largest free rectangular grid at the positions of the N bullet comments.

[0081] In this implementation, the video area may be gridded in advance, the unit grid size may be defined, and the number of grids occupied by the barrage may be calculated according to the number of barrage characters, the size of a single character in the barrage, and the unit grid size. As an example, the number of grids occupied by the barrage may be equal to the number of barrage characters*the size of a single character / the unit grid size and then rounded up.

[0082] The maximum free rectangular grid can be understood as the maximum rectangular area where no other bullets exist above, below, left, or right. As an example, the method for determining the maximum free rectangular grid is as follows: according to the number of grids occupied by the bullets calculated above, search for free grids row by row upwards. If the current row is not occupied by other bullets, continue to search for free grids row by row upwards until a new row is occupied by other bullets; then perform the above steps downwards, left, and right in sequence. To avoid repetition, this will not be described in detail.

[0083] In this embodiment, by determining the maximum free rectangular grid, the barrage is controlled to move in a preset manner in the area corresponding to the maximum free rectangular grid. No matter how the barrage moves, it will not affect the presentation of other barrages, which can further ensure that the movement of the barrage will not have an adverse effect on the barrage outside the barrage control area.

[0084] The above optional implementation manner realizes controlling the movement of the bullet screen without using the user's gesture movement, that is, the process of controlling the movement of the bullet screen is not related to the gesture image.

[0085] In order to better understand the bullet screen control process of the embodiment of the present application, the following Figures 2 to 7, provide specific examples.

[0086] like Figure 2 As shown, when watching a video, the mobile terminal user can input a camera start operation, and the mobile terminal responds to the operation to turn on the camera and displays a video simulation area 31 at the lower right of the current interface. The aspect ratio of the video simulation area 31 is the same as that of the video screen 32. The middle part of the video simulation area 31 is a gesture trigger area 33. The gesture trigger area 33 is a closed-loop area, which includes a control ring a composed of an inner ring 34 and an outer ring 35. The user's palm needs to be placed in the gesture trigger area 33, and the video simulation area 31 can display a gesture image 36. The mobile terminal can track the user's gesture through gesture tracking technology.

[0087] like Figure 3 As shown, when the gesture image 36 moves from the inner ring 34 to the outer ring 35 along a direction perpendicular to the control ring a within a limited time, the user's gesture image meets the trigger condition.

[0088] like Figures 4 to 5 As shown, the camera may start to record the movement trajectory of the gesture image 36 in the video simulation area 31 .

[0089] The mobile terminal sends the motion trajectory of the gesture image captured by the camera in the video simulation area to the background, and the background processes each frame of the image. The processing method is as follows:

[0090] like Figure 6 As shown, the existing gesture recognition technology is used to identify the gesture image 36 and identify the palm position. The palm position can be defined as the position above the key point No. 0 in the figure, that is, the position above the radius of the palm. The video simulation area 31 is gridded to calculate the number of grids occupied by the palm and the coordinate values ​​corresponding to the grids, where x represents the horizontal coordinate and y represents the vertical coordinate. Here, calculating the number of grids occupied by the palm and the coordinate values ​​corresponding to the grids is a specific example of determining the bullet screen control area 38 based on the gesture image 36. The bullet screen control area 38 is the area determined by the coordinate values ​​corresponding to the grids occupied by the palm.

[0091] like Figure 7As shown, the background returns the coordinates of the grid position occupied by the palm to the client, and the client determines whether there is a bullet screen in the grid corresponding to the coordinates. If there is a bullet screen, the bullet screen control operation is performed on the bullet screen in the grid. The specific calculation process for determining the existence of bullet screens in the grid is as follows: pre-define the unit grid size, the size of the bullet screen single word, and the moving speed of the bullet screen. The number of grids occupied by the bullet screen is calculated according to "the number of bullet screen words * the size of the single word divided by the unit grid upward regularization", and the coordinate value (x, y) of the bullet screen in the grid is obtained. The bullet screen "Come on, come on" 37 moves from the right side of the screen according to the moving speed of the bullet screen, multiplied by the time corresponding to one frame of the screen, and the new coordinate value of the bullet screen "Come on, come on" 37 after the movement is obtained. According to the number of grids where the coordinates of the bullet screen overlap with the palm grid, the bullet screen contained in the palm motion trajectory can be calculated. In order to more accurately determine the bullet screen contained in the palm motion trajectory, the proportion of the bullet screen falling into the palm grid can be further calculated. Here, the bullet screen contained in the palm motion trajectory is the bullet screen displayed in the bullet screen control area 38.

[0092] Afterwards, the mobile terminal can control the movement of the barrage contained in the palm motion trajectory in a certain manner. The specific manner of moving the barrage can refer to the relevant descriptions of the above-mentioned multiple optional implementation methods. Since there are many movement methods, they are no longer illustrated one by one.

[0093] In summary, the beneficial effects of the present application include at least: being able to increase the diversity of barrage presentation methods, making the user's operation simple during barrage control, and being able to enhance the user's interactive experience.

[0094] See also Figure 8 , Figure 8 is a structural diagram of a bullet screen control device provided in an embodiment of the present application, such as Figure 8 As shown, the bullet screen control device 800 includes:

[0095] The first determination module 801 is used to determine a bullet screen control area of ​​the video area according to the gesture image when the gesture image captured by the camera meets the trigger condition, and the bullet screen control area displays N bullet screens, where N is greater than or equal to 1;

[0096] The control module 802 is used to control the movement of the N bullet comments.

[0097] In some embodiments, the bullet screen control device 800 further includes:

[0098] A display module, configured to display the gesture image in a target area of ​​a current display interface, wherein the size of the target area is smaller than the size of the video area;

[0099] The second determining module is configured to determine that the gesture image satisfies the trigger condition when it is detected that the gesture image moves to a preset position in the target area.

[0100] In some embodiments, the target area includes a gesture trigger area;

[0101] The second determining module is specifically used for:

[0102] When it is detected that the gesture image is located in the gesture triggering area and the gesture image moves to the boundary of the gesture triggering area, it is determined that the gesture image satisfies the triggering condition.

[0103] In some embodiments, the aspect ratio of the target area is equal to the aspect ratio of the video area;

[0104] The first determining module 801 is specifically used for:

[0105] Based on the ratio of the target area to the video area, mapping the gesture image of the target area to the video area in equal proportion to obtain a motion trajectory of the gesture image in the video area;

[0106] The area covered by the movement trajectory of the gesture image in the video area is determined as the bullet screen control area.

[0107] In some embodiments, the control module 802 includes:

[0108] The first control unit is used to control the N bullet comments to move along the movement trajectory of the gesture image in the video area.

[0109] In some embodiments, the first control unit is specifically configured to:

[0110] Controlling the N bullet screens to tilt according to the tilt angle of the gesture image;

[0111] Control the N bullet comments to move along a movement trajectory of the gesture image in the video area.

[0112] In some embodiments, the first control unit is further configured to:

[0113] In the case that the N barrages exceed the area covered by the gesture image in the video area, the N barrages are controlled to be proportionally reduced until the N barrages do not exceed the area covered by the gesture image in the video area.

[0114] In some embodiments, the bullet screen control device 800 further includes:

[0115] A third determination module is used to determine the maximum free area where the N bullet comments are located;

[0116] The control module 802 includes:

[0117] The second control unit is used to control the N bullet screens to move in a preset manner within the maximum idle area.

[0118] In some embodiments, the preset method includes at least one of translation, flipping, rotation, shape change, arrangement change and adding special effects.

[0119] In some embodiments, the third determination module is specifically used to:

[0120] Calculate the number of grids occupied by the N bullet comments in the video area according to a predefined unit grid size;

[0121] Taking the positions of the N bullet comments as the starting point, search for free grids row by row and column by column to determine the largest free rectangular grid at the positions of the N bullet comments.

[0122] The bullet screen control device 800 can realize Figures 1 to 7 The various processes implemented by the illustrated method embodiment achieve the same beneficial effects, and to avoid repetition, they will not be described again here.

[0123] Fig. 9 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application is shown in FIG. Fig. 9 As shown, the electronic device 900 includes but is not limited to: a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, a processor 910, and a power supply 911. Those skilled in the art can understand that Fig. 9 The electronic device structure shown in the figure does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently. In the embodiments of the present application, the electronic device includes but is not limited to a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, and a pedometer.

[0124] The processor 910 is used to:

[0125] When the gesture image captured by the camera meets the trigger condition, a bullet screen control area of ​​the video area is determined according to the gesture image, and the bullet screen control area displays N bullet screens, where N is greater than or equal to 1;

[0126] Control the movement of the N bullet comments.

[0127] In some embodiments, the display unit 906 is used to:

[0128] Displaying the gesture image in a target area of ​​the current display interface, wherein the size of the target area is smaller than the size of the video area;

[0129] The processor 910 is further configured to:

[0130] When it is detected that the gesture image moves to a preset position in the target area, it is determined that the gesture image satisfies the trigger condition.

[0131] In some embodiments, the target area includes a gesture trigger area;

[0132] The processor 910 is further configured to:

[0133] When it is detected that the gesture image is located in the gesture triggering area and the gesture image moves to the boundary of the gesture triggering area, it is determined that the gesture image satisfies the triggering condition.

[0134] In some embodiments, the aspect ratio of the target area is equal to the aspect ratio of the video area;

[0135] The processor 910 is further configured to:

[0136] Based on the ratio of the target area to the video area, mapping the gesture image of the target area to the video area in equal proportion to obtain a motion trajectory of the gesture image in the video area;

[0137] The area covered by the movement trajectory of the gesture image in the video area is determined as the bullet screen control area.

[0138] In some embodiments, the processor 910 is further configured to:

[0139] Control the N bullet comments to move along a movement trajectory of the gesture image in the video area.

[0140] In some embodiments, the processor 910 is further configured to:

[0141] Controlling the N bullet screens to tilt according to the tilt angle of the gesture image;

[0142] Control the N bullet comments to move along a movement trajectory of the gesture image in the video area.

[0143] In some embodiments, the processor 910 is further configured to:

[0144] In the case that the N barrages exceed the area covered by the gesture image in the video area, the N barrages are controlled to be proportionally reduced until the N barrages do not exceed the area covered by the gesture image in the video area.

[0145] In some embodiments, the processor 910 is further configured to:

[0146] Determine the maximum free area where the N bullet comments are located;

[0147] Control the N bullet comments to move in a preset manner within the maximum idle area.

[0148] In some embodiments, the preset method includes at least one of translation, flipping, rotation, shape change, arrangement change and adding special effects.

[0149] In some embodiments, the processor 910 is further configured to:

[0150] Calculate the number of grids occupied by the N bullet comments in the video area according to a predefined unit grid size;

[0151] Taking the positions of the N bullet comments as the starting point, search for free grids row by row and column by column to determine the largest free rectangular grid at the positions of the N bullet comments.

[0152] The electronic device 900 can realize Figures 1 to 7 The various processes implemented by the illustrated method embodiment achieve the same beneficial effects, and to avoid repetition, they will not be described again here.

[0153] It should be understood that in the embodiment of the present application, the radio frequency unit 901 can be used for receiving and sending signals during information transmission or calls. Specifically, after receiving downlink data from the base station, it is sent to the processor 910 for processing; in addition, uplink data is sent to the base station. Generally, the radio frequency unit 901 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 901 can also communicate with the network and other devices through a wireless communication system.

[0154] The electronic device provides users with wireless broadband Internet access through the network module 902, such as helping users to send and receive emails, browse web pages, and access streaming media.

[0155] The audio output unit 903 can convert the audio data received by the RF unit 901 or the network module 902 or stored in the memory 909 into an audio signal and output it as sound. Moreover, the audio output unit 903 can also provide audio output related to a specific function performed by the electronic device 900 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 903 includes a speaker, a buzzer, a receiver, etc.

[0156] The input unit 904 is used to receive audio or video signals. The input unit 904 may include a graphics processor (GPU) 9041 and a microphone 9042, and the graphics processor 9041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 906. The image frame processed by the graphics processor 9041 can be stored in the memory 909 (or other storage medium) or sent via the radio frequency unit 901 or the network module 902. The microphone 9042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 901 in the case of a telephone call mode.

[0157] The electronic device 900 also includes at least one sensor 905, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 9061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 9061 and / or the backlight when the electronic device 900 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary, which can be used to identify the posture of the electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 905 can also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be repeated here.

[0158] The display unit 906 is used to display information input by the user or information provided to the user. The display unit 906 may include a display panel 9061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0159] The user input unit 907 can be used to receive input digital or character information, and to generate key signal input related to user settings and function control of the electronic device. Specifically, the user input unit 907 includes a touch panel 9071 and other input devices 9072. The touch panel 9071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 9071 or near the touch panel 9071 using any suitable object or accessory such as a finger, stylus, etc.). The touch panel 9071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the contact point coordinates, and then sends it to the processor 910, receives the command sent by the processor 910 and executes it. In addition, the touch panel 9071 can be implemented using various types such as resistive, capacitive, infrared and surface acoustic waves. In addition to the touch panel 9071, the user input unit 907 may also include other input devices 9072. Specifically, other input devices 9072 may include but are not limited to a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be described in detail here.

[0160] Furthermore, the touch panel 9071 may be overlaid on the display panel 9061. When the touch panel 9071 detects a touch operation on or near it, it transmits the information to the processor 910 to determine the type of the touch event. Then, the processor 910 provides a corresponding visual output on the display panel 9061 according to the type of the touch event. Figure 4 In the figure, the touch panel 9071 and the display panel 9061 are used as two independent components to realize the input and output functions of the electronic device. However, in some embodiments, the touch panel 9071 and the display panel 9061 can be integrated to realize the input and output functions of the electronic device, which is not limited here.

[0161] The interface unit 908 is an interface for connecting an external device to the electronic device 900. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 908 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic device 900 or may be used to transmit data between the electronic device 900 and an external device.

[0162] The memory 909 can be used to store software programs and various data. The memory 909 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 909 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0163] The processor 910 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. It executes various functions of the electronic device and processes data by running or executing software programs and / or modules stored in the memory 909, and calling data stored in the memory 909, so as to monitor the electronic device as a whole. The processor 910 may include one or more processing units; preferably, the processor 910 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 910.

[0164] The electronic device 900 may also include a power supply 911 (such as a battery) for supplying power to each component. Preferably, the power supply 911 may be logically connected to the processor 910 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system.

[0165] In addition, the electronic device 900 includes some functional modules not shown, which will not be described in detail here.

[0166] like Fig.10 As shown, the embodiment of the present application also provides an electronic device, including a processor 1010, a memory 1009, and a computer program stored in the memory 1009 and executable on the processor 1010, wherein the computer program is executed by the processor 1010 to implement Figures 1 to 7 The various processes of the method embodiment shown can achieve the same technical effect, and will not be described again here to avoid repetition.

[0167] The present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the above Figure 1The various processes of the embodiment of the bullet screen control method shown in the figure can achieve the same technical effect. To avoid repetition, they are not repeated here. Among them, the computer-readable storage medium is such as a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc.

[0168] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0169] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0170] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A bullet screen control method, characterized in that: include: When the gesture image captured by the camera meets the trigger condition, a bullet screen control area of ​​the video area is determined according to the gesture image, and the bullet screen control area displays N bullet screens, where N is greater than or equal to 1; Control the movement of the N bullet comments; Before determining the bullet screen control area of ​​the video area according to the gesture image, the method further includes: Displaying the gesture image in a target area of ​​the current display interface, wherein the size of the target area is smaller than the size of the video area; When it is detected that the gesture image moves to a preset position in the target area, it is determined that the gesture image satisfies the trigger condition.

2. The method according to claim 1, characterized in that The aspect ratio of the target area is equal to the aspect ratio of the video area; The step of determining the bullet screen control area of ​​the video area according to the gesture image includes: Based on the ratio of the target area to the video area, mapping the gesture image of the target area to the video area in equal proportion to obtain a motion trajectory of the gesture image in the video area; The area covered by the movement trajectory of the gesture image in the video area is determined as the bullet screen control area.

3. The method according to claim 2, characterized in that The controlling the movement of the N bullet screens includes: Control the N bullet comments to move along a movement trajectory of the gesture image in the video area.

4. The method according to claim 3, characterized in that The controlling the N bullet screens to move along the motion track of the gesture image in the video area includes: Controlling the N bullet screens to tilt according to the tilt angle of the gesture image; Control the N bullet comments to move along a movement trajectory of the gesture image in the video area.

5. The method according to claim 4, characterized in that After controlling the N bullet screens to tilt according to the tilt angle of the gesture image, the method further includes: In the case that the N barrages exceed the area covered by the gesture image in the video area, the N barrages are controlled to be proportionally reduced until the N barrages do not exceed the area covered by the gesture image in the video area.

6. The method according to claim 1 or 2, characterized in that: After determining the bullet screen control area of ​​the video area according to the gesture image and before controlling the movement of the N bullet screens, the method further includes: Determine the maximum free area where the N bullet comments are located; The controlling the movement of the N bullet screens includes: Control the N bullet comments to move in a preset manner within the maximum idle area.

7. A bullet screen control device, characterized in that: include: A first determination module is used to determine a bullet screen control area of ​​a video area according to a gesture image when a gesture image captured by a camera meets a trigger condition, wherein the bullet screen control area displays N bullet screens, where N is greater than or equal to 1; A control module, used to control the movement of the N bullet comments; The device also includes: A display module, configured to display the gesture image in a target area of ​​a current display interface, wherein the size of the target area is smaller than the size of the video area; The second determining module is configured to determine that the gesture image satisfies the trigger condition when it is detected that the gesture image moves to a preset position in the target area.

8. An electronic device, characterized in that: It includes a processor, a memory, and a computer program stored in the memory and executable on the processor, and when the computer program is executed by the processor, the steps of the barrage control method as described in any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the barrage control method according to any one of claims 1 to 6 are implemented.

Images