Video display method and device and electronic equipment
By introducing background images and motion trajectories into the video display method, users can quickly locate and view specific moving object postures or video clips in the video, solving the problem of inefficient viewing videos in the prior art.
Patent Information
- Application Number
- CN202411633421.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-14
- Publication Date
- 2025-02-18
AI Technical Summary
The prior art is inefficient when viewing recorded videos, and users need to watch from beginning to end or rely on memory to drag a progress bar to view specific clips in the video.
By receiving the user's thumbnail input to the video, the corresponding background image is displayed, which contains the motion trajectory of the moving object. The user can directly select a specific point in the motion track to display the posture image or video clip of the moving object corresponding to the point.
Users can quickly locate and view the postures or video clips of specific moving objects in the video without watching the video throughout the video, which significantly improves the efficiency of viewing video content.
Smart Images

Figure CN119484926A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the technical field of electronic equipment, and specifically relates to a video display method, device and electronic equipment. Background Art
[0002] With the rapid development of shooting functions of electronic devices, it has become the norm for people to use electronic devices to record videos to record their lives and work.
[0003] Currently, for videos of moving objects recorded in fixed scenes, when the user subsequently views the video, if the user wants to view a certain segment in the video, the user is required to watch the video from the beginning to the end, or the user is required to rely on memory to drag the video progress bar to view the video, which is inefficient. Summary of the invention
[0004] The purpose of the embodiments of the present application is to provide a video display method, device and electronic device to improve the efficiency of users viewing video content.
[0005] In a first aspect, an embodiment of the present application provides a video display method, the method comprising:
[0006] Receiving a first input of a thumbnail of a first video from a user, wherein the first video includes at least one moving object;
[0007] In response to the first input, displaying a background image corresponding to the first video, wherein the background image includes at least one motion track, and the at least one motion track corresponds one-to-one to the at least one moving object;
[0008] receiving a second input of a user on a first motion trajectory point in a first motion trajectory, wherein the first motion trajectory is any one of the at least one motion trajectory;
[0009] In response to the second input, at least one posture image of the first moving object corresponding to the first motion trajectory and / or a video segment in the first video at a timestamp corresponding to the first motion trajectory point are displayed, wherein the at least one posture image is an image of at least one posture of the first moving object at the first motion trajectory point, and each motion trajectory point in the first motion trajectory corresponds to a video segment at a timestamp in the first video.
[0010] In a second aspect, an embodiment of the present application provides a video display device, the device comprising:
[0011] A first receiving module, configured to receive a first input of a thumbnail of a first video from a user, wherein the first video includes at least one moving object;
[0012] A first display module, configured to display a background image corresponding to the first video in response to the first input, wherein the background image includes at least one motion track, and the at least one motion track corresponds one-to-one to the at least one moving object;
[0013] The second receiving module is further used to receive a second input of a user on a first motion trajectory point in the first motion trajectory, where the first motion trajectory is any one of the at least one motion trajectory;
[0014] The second display module is also used to display at least one posture image of the first moving object corresponding to the first motion trajectory in response to the second input, and / or a video clip at a timestamp corresponding to the first motion trajectory point in the first video, wherein the at least one posture image is an image of at least one posture of the first moving object at the first motion trajectory point, and each motion trajectory point in the first motion trajectory corresponds to a video clip at a timestamp in the first video.
[0015] In a third aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.
[0016] In a fourth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.
[0017] In a fifth aspect, an embodiment of the present application provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.
[0018] In an embodiment of the present application, in response to the user's first input of a thumbnail of a first video, a background image corresponding to the first video is displayed, wherein the background image includes the motion trajectory of each moving object in the first video. Then, when the user wants to view a video clip of a certain moving object, a second input can be directly performed at the corresponding motion trajectory point in the motion trajectory of the moving object, and an image of at least one posture of the moving object at the motion trajectory point and / or a video clip at a timestamp corresponding to the motion trajectory point in the first video can be directly displayed. In this way, the user can directly view the posture of the moving object at the motion trajectory point and / or the video clip of the moving object at the motion trajectory point, without the user having to watch the video from beginning to end or relying on memory to drag the video progress bar to view the video, thereby improving the efficiency of the user in viewing video content. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] Figure 1 is a flowchart of a video display method provided by some embodiments of the present application;
[0020] Figure 2 is a schematic diagram of an album interface provided by some embodiments of the present application;
[0021] Figure 3 is a schematic diagram of a background image provided by some embodiments of the present application;
[0022] Figure 4 is a schematic diagram of a preview image provided by some embodiments of the present application;
[0023] Figure 5 is a schematic diagram of a background image provided by some embodiments of the present application;
[0024] Figure 6 is a schematic diagram of displaying a posture image provided by some embodiments of the present application;
[0025] Figure 7 is a schematic diagram of displaying gesture images and video clips provided by some embodiments of the present application;
[0026] Figure 8 is a schematic diagram of a background image provided by some embodiments of the present application;
[0027] Fig. 9 is a schematic diagram of a background image provided by some embodiments of the present application;
[0028] Fig.10 is a schematic diagram of a background image provided by some embodiments of the present application;
[0029] Fig.11 is a flowchart of a video display method provided by some embodiments of the present application;
[0030] Fig.12 is a schematic structural diagram of a video display device shown in some embodiments of the present application;
[0031] Fig.13 is a schematic diagram of the structure of an electronic device shown in some embodiments of the present application;
[0032] Fig.14 It is a schematic diagram of the hardware structure of an electronic device shown in some embodiments of the present application. DETAILED DESCRIPTION
[0033] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.
[0034] The terms "first", "second", etc. in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or N. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0035] The prior art has the problem of low efficiency in viewing video content. In order to solve the above problem, the embodiments of the present application provide a video display method, device and electronic device. By responding to the user's first input of a thumbnail of a first video, a background image corresponding to the first video is displayed, and the background image includes the motion trajectory of each moving object in the first video. Then, when the user wants to view a video clip of a certain moving object, a second input can be directly performed on the corresponding motion trajectory point in the motion trajectory of the moving object, and an image of at least one posture of the moving object at the motion trajectory point and / or a video clip at the timestamp corresponding to the motion trajectory point in the first video can be directly displayed. In this way, the user can directly view the posture of the moving object at the motion trajectory point and / or the video clip of the moving object at the motion trajectory point, without the user having to watch the video from beginning to end or requiring the user to rely on memory to drag the video progress bar to view the video, thereby improving the efficiency of the user in viewing video content.
[0036] The technical solution of the embodiment of the present application can be applied to the scenario where you want to quickly jump to a certain video clip in a video.
[0037] The video display method provided by the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0038] Figure 1It is a flow chart of a video display method provided in an embodiment of the present application. The execution subject of the video display method can be an electronic device, which can be but not limited to a personal computer (PC), a smart phone, a tablet computer or a personal digital assistant (PDA).
[0039] like Figure 1 As shown, the video display method provided in the embodiment of the present application may include steps 110 to 140.
[0040] Step 110: Receive a first input from a user for a thumbnail of a first video.
[0041] Among them, the first video can be a video shot by the user showing the user moving in a shooting scene. The first video can be a real-time video or a video shot in advance by the user, which is not limited in the embodiments of the present application.
[0042] The first video may include at least one moving object, and the moving object may be an object moving in a shooting scene. The shooting scene here may be a fixed scene.
[0043] In one example, a camera is installed in the living room of object A's home, and the camera collects activity videos of object A in the home within one day. The activity videos are the first videos, and object A is the moving object.
[0044] The first input may be an input to a thumbnail of the first video, and the first input is used to display a background image corresponding to the first video, and the first input may be a first operation. Exemplarily, the first input includes, but is not limited to: a user's touch input to a thumbnail of the first video through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which may be determined according to actual use requirements, and the embodiments of the present invention are not limited thereto. The specific gesture in the embodiments of the present application may be any one of a single-click gesture, a sliding gesture, a dragging gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiments of the present application may be a single-click input, a double-click input, or any number of click inputs, etc., and may also be a long press input or a short press input. For example, the first input may be: a user's click input to a thumbnail of the first video.
[0045] Step 120: In response to the first input, display a background image corresponding to the first video.
[0046] The background image may include at least one motion track, and the at least one motion track corresponds to at least one moving object, that is, each moving object has its corresponding motion track displayed in the background image.
[0047] In some embodiments of the present application, in response to the first input, a background image corresponding to the first video may be displayed, and the background image may include motion tracks corresponding to at least one moving object respectively.
[0048] Continuing with the above example, Figure 2 As shown, after the camera captures the activity video of object A in the client in one day, the video can be stored in the album of the electronic device. The activity video is displayed in the album in the form of thumbnails. The user can click on the thumbnail 21 of the activity video to display the video. Figure 3 The background image shown in Figure 3 The background image shown has a motion track 31 of the object A.
[0049] In some embodiments of the present application, the thumbnail of the first video may include a background image area, such as Figure 2 The area 211 in FIG. 2 is the background image area.
[0050] In order to avoid user misoperation, step 110 may specifically include:
[0051] A first input from a user regarding a background image area in a thumbnail of a first video is received.
[0052] In some embodiments of the present application, the user may perform a first input on a background image area in a thumbnail of the first video, thereby displaying the background image of the first video.
[0053] Continue to refer Figure 2 , the user can click area 211 to display Figure 3 Background image shown.
[0054] In an embodiment of the present application, the background image of the first video can be displayed in response to a first input to the background image area in the thumbnail of the first video, thereby avoiding the problem of the background image not being displayed due to the user clicking on other areas, thereby avoiding the problem of user misoperation.
[0055] In some embodiments of the present application, the thumbnail of the first video may also include a video image area, such as Figure 2 The area 212 in the thumbnail 21 is the video image area, that is, the areas other than the background image area in the thumbnail 21 are all video image areas.
[0056] In order to improve the user's interactive experience, the above method may further include:
[0057] receiving a seventh input from the user regarding the video image area;
[0058] In response to the seventh input, the first video is played.
[0059] Among them, the seventh input can be an input to the video image area, and the above-mentioned seventh input is used to play the first video, and the seventh input can be the seventh operation. Exemplarily, the above-mentioned seventh input includes but is not limited to: the user's touch input to the video image area through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiment of the present invention is not limited. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input. For example, the above-mentioned seventh input can be: the user's click input to the video image area.
[0060] In some embodiments of the present application, if the user clicks on the video image area, the first video will be played, so that the user can watch the first video.
[0061] Continue to refer Figure 2 The user can click on area 212 to play the activity video of object A in the client during that day.
[0062] In an embodiment of the present application, when the user wants to play the first video, the first video can be played in response to the user's seventh input to the video image area. In this way, the first video can be played at the moment when the first video is needed according to user needs, thereby meeting the user's personalized needs and improving the user's interactive experience.
[0063] In some embodiments of the present application, before executing step 110, at least one moving object in the first video must first be determined. Specifically, at least one moving object in the first video can be determined by focusing. That is, before step 110, the above method may further include:
[0064] When the preview interface is displayed, receiving a third input from the user on the focus mode control;
[0065] In response to a third input, determining a target tracking focus mode;
[0066] Determine at least one moving object in the preview interface according to the target tracking mode;
[0067] receiving a fourth input from the user to the video recording control;
[0068] In response to the fourth input, the movement process of at least one moving object is recorded to obtain a first video.
[0069] The preview interface may be an interface for displaying a preview image of the shooting scene.
[0070] The focus mode control may be a control for determining the focus mode.
[0071] The third input is an input to the focus mode control, and the third input is used to determine the target focus mode. The third input can be a third operation. Exemplarily, the third input includes but is not limited to: a touch input of the focus mode control by a user through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiment of the present invention is not limited. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a dragging gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input. For example, the third input can be: a sliding input of the focus mode control by the user.
[0072] The target focus mode may be a mode selected for tracking a moving object.
[0073] The video recording control may be a control for recording a shooting scene.
[0074] The fourth input is an input to the video control, and the fourth input is used to record the movement process of at least one moving object to obtain the first video. The fourth input can be a fourth operation. Exemplarily, the fourth input includes but is not limited to: the user's touch input to the video control through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiment of the present invention is not limited. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input. For example, the fourth input can be: a user's click input to the video control.
[0075] In some embodiments of the present application, before recording the first video, that is, when displaying a preview interface of the shooting scene, a third input from the user to the focus mode control can be received first. In response to the third input, a target focus mode can be determined, and then at least one moving object can be determined in the preview interface according to the target focus mode. The user then clicks the recording control to record the movement process of the at least one moving object to obtain the first video.
[0076] Continuing with the above example, Figure 4 As shown, when displaying the preview interface 41 of the shooting scene, the user performs a third input on the focus mode control 42 to determine the target focus mode, and then determines at least one moving object in the preview interface according to the target focus mode. Then the user clicks the video recording control 43 to record the movement process of at least one moving object in the shooting scene to obtain a first video.
[0077] In an embodiment of the present application, when displaying a preview interface of a shooting scene, a target focus mode can be determined in response to a third input of a user to a focus mode control, and then at least one moving object can be determined in the preview interface according to the target focus mode. Then, in response to a fourth input to a recording control, the movement process of at least one moving object in the shooting scene can be recorded to obtain a first video. In this way, at least one moving object can be determined in the preview interface according to different focus modes based on user needs, thereby improving the flexibility of determining at least one moving object.
[0078] In some embodiments of the present application, when using the focus tracking mode to determine at least one moving object, there may be two modes: automatic focus tracking and manual focus tracking. The specific implementation process is as follows:
[0079] 1. Manual focus tracking
[0080] In some embodiments of the present application, when the target focus tracking mode is the manual focus tracking mode, determining at least one moving object in the preview interface according to the target focus tracking mode may specifically include:
[0081] receiving a fifth input from the user regarding at least one object in the preview interface;
[0082] In response to a fifth input, the at least one object is determined to be at least one moving object.
[0083] The at least one object may be at least one object among a plurality of objects displayed in the preview interface.
[0084] The fifth input may be an input to at least one object in the preview interface, and the fifth input is used to determine at least one object as at least one moving object, and the fifth input may be a fifth operation. Exemplarily, the fifth input includes, but is not limited to: a user's touch input to at least one object in the preview interface through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which may be determined according to actual use requirements, and are not limited in the embodiments of the present invention. The specific gesture in the embodiments of the present application may be any one of a single-click gesture, a sliding gesture, a dragging gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiments of the present application may be a single-click input, a double-click input, or any number of click inputs, etc., and may also be a long press input or a short press input. For example, the fifth input may be: a user's click input to at least one object in the preview interface.
[0085] In some embodiments of the present application, the user may click on one or more objects among the multiple objects displayed in the preview interface, and thus the one or more objects clicked by the user may be determined as moving objects.
[0086] Continue to refer Figure 4 The user slides the focus mode control 42 upward, that is, the manual focus mode is selected, and then in the preview interface 41, the user clicks on the object A44, and the object A44 can be determined as a moving object.
[0087] In an embodiment of the present application, when the target focus tracking mode is the manual focus tracking mode, at least one object executed by the user for the fifth input can be determined as at least one moving object. In this way, at least one moving object can be selected according to the needs of the user, thereby avoiding the situation where the automatically determined moving object is not the moving object the user wants to select, thereby meeting the personalized needs of the user and improving the accuracy of the moving object selection.
[0088] 2. Automatic focus tracking
[0089] In some embodiments of the present application, when the target focus tracking mode is the automatic focus tracking mode, determining at least one moving object in the preview interface according to the target focus tracking mode may specifically include:
[0090] At least one object moving in the preview interface is determined as at least one moving object.
[0091] In some embodiments of the present application, when the target focus tracking mode is the automatic focus tracking mode, the moving object in the preview interface can be automatically detected, and then the moving object in the preview interface can be determined as a moving object.
[0092] It should be noted that before the user executes the fourth input on the video recording control, if there is no object moving in the preview interface, the moving object can be directly recorded without determining the moving object in the preview interface. During the recording process, the moving object in the shooting scene can be detected in real time and regarded as the moving object.
[0093] In an embodiment of the present application, when the target focus tracking mode is the automatic focus tracking mode, at least one object moving in the preview interface can be directly determined as at least one moving object. This eliminates the need for the user to select a moving object, thereby simplifying user operations and improving the efficiency of moving object selection.
[0094] In some embodiments of the present application, in order to accurately extract the motion trajectory of the moving object in the first video, before step 110, the above method may further include:
[0095] Acquire a background image in the first video and position information of the first moving object at each moment in the first video;
[0096] According to the conversion relationship between the world coordinate system and the coordinate system of the background image, the position information of the first moving object at each moment is marked in the background image to obtain a plurality of moving trajectory points;
[0097] Based on the plurality of motion trajectory points, a first motion trajectory is generated in the background image.
[0098] The first moving object may be any one of the at least one moving object, and the first moving trajectory is the moving trajectory of the first moving object.
[0099] In some embodiments of the present application, the background image in the first video and the position information of the first moving object at each moment in the first video can be extracted by image detection algorithms, and the position information of the first moving object at each moment can be marked in the background image according to the conversion relationship between the world coordinate system and the coordinate system of the background image. In this way, multiple motion trajectory points of the first moving object can be obtained, and then these multiple motion trajectory points are connected to form the first motion trajectory, that is, in the background image, each trajectory point is used to characterize the change of position of the moving object, that is, different positions correspond to different trajectory points.
[0100] It should be noted that, in the case where the first video is a pre-shot video, the first video can be directly post-processed based on the above method to obtain the motion trajectory of each moving object in the first video.
[0101] In the case where the first video is a video shot in real time, the background image in the first video can be directly extracted during the shooting of the first video. Since the shooting scene is fixed, the background in the first video is basically unchanged, so the background image in the first video can be directly extracted, and then the position information of the moving object is detected in real time. According to its position information, the motion trajectory of each moving object in the first video is obtained in the above manner, that is, in the case where the first video is a video shot in real time, after the shooting of the first video is completed, the first video and the background image of the first video with the motion trajectory are obtained.
[0102] When generating multiple motion trajectory points of a moving object, each motion trajectory point corresponding to the moving object can be associated with the corresponding time in the first video, that is, each motion trajectory point corresponds to a time point in the first video. For example, when the video is recorded to the 20th second, the moving object changes its position. At this time, a new motion trajectory point is added to the background image. The video time point corresponding to the motion trajectory point is the 20th second, that is, each motion trajectory point in the motion trajectory corresponds to a video clip at a timestamp in the first video.
[0103] It should be noted that, continuing with the above example, object A is playing in the living room, and the monitoring video of object A's activities in the living room for a day is captured. If only one background image is generated, there may be more motion trajectory points in the background image. Therefore, the background image of the first video can be re-extracted at regular intervals, and then the motion trajectory of object A can be generated in the background image in the above manner, and each background image only contains the motion trajectory of object A from the time the background image is generated to the time the next background image is generated.
[0104] In the above example, when the background image is extracted at regular intervals, the background image extracted each time is basically unchanged, but there will be slight differences in the background image. For example, continuing with the above example, object A is playing in the living room, there is a sofa near one wall of the living room, a clock is hung on the wall behind the sofa, and there is a TV on the wall opposite the sofa. Then, the positions of the sofa, clock and TV in the background image extracted at regular intervals are fixed, but the time in the clock in each background image is different. For example, the background image is extracted every 4 hours, the time of the first background image extraction is 10 am, and the time of the second background image extraction is 2 pm. Then the time of the clock in the first background image extraction indicates 10 am, and the time of the clock in the second background image extraction indicates 2 pm, but the positions of the sofa, clock and TV in the first and second background images are fixed.
[0105] In an embodiment of the present application, by acquiring a background image in a first video and position information of a first moving object at each moment in the first video, and then marking the position information of the first moving object at each moment in the background image, a plurality of motion trajectory points are obtained. Based on the plurality of motion trajectory points, a first motion trajectory can be generated in the background image, so that the motion trajectory of the moving object in the first video can be accurately extracted.
[0106] Step 130: Receive a second input from the user regarding a first motion trajectory point in the first motion trajectory.
[0107] The first motion trajectory may be any one of the at least one motion trajectory.
[0108] The first trajectory point may be any one of a plurality of motion trajectory points in the first motion trajectory.
[0109] The second input may be an input to the first motion trajectory point in the first motion trajectory, and the second input is used to display the video clip at the timestamp corresponding to the first motion trajectory point in the first video, and the second input may be a second operation. Exemplarily, the second input includes but is not limited to: a touch input of the first motion trajectory point in the first motion trajectory by a user through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiment of the present invention is not limited. The specific gesture in the embodiment of the present application may be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double press gesture, and a double-click gesture; the click input in the embodiment of the present application may be a single-click input, a double-click input, or any number of click inputs, etc., and may also be a long press input or a short press input. For example, the second input may be: a click input of the first motion trajectory point in the first motion trajectory by the user.
[0110] Step 140: In response to the second input, display at least one posture image of the first moving object corresponding to the first motion trajectory, and / or a video clip in the first video at a timestamp corresponding to the first motion trajectory point.
[0111] The at least one posture image may be an image of at least one posture of the first moving object at the first motion trajectory point.
[0112] In some embodiments of the present application, when generating multiple motion trajectory points of a moving object, the posture of the moving object when it moves to the position corresponding to the motion trajectory point can also be captured to generate a posture image of the moving object, and then the posture image when the moving object moves to a certain motion trajectory point is associated with the motion trajectory point, that is, the posture image corresponding to each motion trajectory point is also included in the background image.
[0113] It should be noted that when there are many motion trajectory points in the background image, when the background image is displayed, the posture image corresponding to each motion trajectory point may not be displayed in the background image, but may be hidden, such as Figure 3 As shown, only each motion trajectory point is displayed in the background image, and the posture image corresponding to each motion trajectory point is not displayed.
[0114] When there are relatively few motion trajectory points in the background image, when displaying the background image, the posture image corresponding to each motion trajectory point can also be displayed in the background image. Figure 5 , Figure 5 If there are fewer points in the motion trajectory, Figure 5 The background image shown shows the posture image corresponding to each motion trajectory point, such as Figure 5 The posture image 51 and the posture image 52 in FIG. 5 are the posture images corresponding to the motion trajectory point 501 , the posture image 53 is the posture image corresponding to the motion trajectory point 502 , and the posture image 54 is the posture image corresponding to the motion trajectory point 503 .
[0115] It should be noted that when the moving object moves to a certain moving trajectory point, the moving object changes into multiple postures, so for a certain moving trajectory point, the posture image corresponding to the moving trajectory point may be at least one.
[0116] In some embodiments of the present application, when a user performs a second input on a first motion trajectory point in a first motion trajectory, at least one posture image corresponding to the first motion trajectory point may be displayed around the first motion trajectory point, so that the user can view at least one posture image corresponding to the first motion trajectory point.
[0117] Continuing with the above example, the user clicks Figure 3 If the motion trajectory point 311 in Figure 6 The gesture image 61 and the gesture image 62 corresponding to the motion trajectory point 311 are shown.
[0118] In another embodiment, when the posture image corresponding to each motion trajectory point is displayed in the background image, if the user performs a second input on the first motion trajectory point in the first motion trajectory, the posture image corresponding to the first motion trajectory point can be displayed in a preset display form. The preset display form here can be, for example, but not limited to, flashing display, highlight display, etc., and can also be a combination of the above two methods, which is not limited in the embodiment of the present application.
[0119] Continue to refer Figure 5 When the user clicks on the motion track point 501, Figure 5The gesture image 51 and the gesture image 52 displayed in the figure may be displayed in a highlighted form or in a flashing form, so that the user can intuitively see that the gesture images corresponding to the motion trajectory point 501 are the gesture image 51 and the gesture image 52 .
[0120] In addition, since each motion trajectory point in the first motion trajectory corresponds to a video segment at a timestamp in the first video, after the user performs the second input on the first motion trajectory point in the first motion trajectory, it is also possible to directly jump to the first video and display the video segment in the first video at the timestamp corresponding to the first motion trajectory point.
[0121] Continuing with the above example, the user clicks Figure 3 If the motion track point 311 in the video is selected, the video clip of object A at the motion track point 311 in the first video will be directly jumped to play.
[0122] In another embodiment, after the user performs the second input on the first motion trajectory point in the first motion trajectory, at least one posture image of the first motion object corresponding to the first motion trajectory and a video clip in the first video at a timestamp corresponding to the first motion trajectory point can also be displayed simultaneously.
[0123] Continuing with the above example, the user clicks Figure 3 The motion trajectory point 311 in Figure 7 As shown, the gesture image 61 and the gesture image 62 corresponding to the motion trajectory point 311 and the video clip 70 of the object A at the motion trajectory point 311 in the first video are displayed.
[0124] It should be noted that in Figure 7 In the embodiment, the video clip 70 is played in a small window format. In the embodiment of the present application, the video clip 70 can also be played in a split screen format, and the posture image 61 and the posture image 62 can be displayed, which is not limited in the embodiment of the present application.
[0125] It should be noted that after the user executes the second input on the first motion trajectory point in the first motion trajectory, whether to display at least one posture image of the first motion object corresponding to the first motion trajectory, or to display the video clip at the timestamp corresponding to the first motion trajectory point in the first video, or to display at least one posture image of the first motion object corresponding to the first motion trajectory and the video clip at the timestamp corresponding to the first motion trajectory point in the first video at the same time, can be set according to user needs and is not limited in the embodiments of the present application.
[0126] In some embodiments of the present application, the second input may include a first sub-input and a second sub-input; in a case where a posture image of each motion trajectory point is not displayed in the background image, in order to improve the efficiency of the user viewing the video content, the receiving of the second input of the user for the first motion trajectory point in the first motion trajectory, and displaying the first video segment in the first video in response to the second input may specifically include:
[0127] receiving a first sub-input of a user for a first motion trajectory point in a first motion trajectory;
[0128] In response to the first sub-input, displaying at least one posture image of the first moving object;
[0129] receiving a second sub-input of the user to the first gesture image;
[0130] In response to the second sub-input, a first video segment in the first video is displayed.
[0131] Among them, the first sub-input is an input for the first motion trajectory point in the first motion trajectory, and the above-mentioned first sub-input is used for at least one posture image of the first motion object, and the first sub-input can be a first sub-operation. Exemplarily, the above-mentioned first sub-input includes but is not limited to: the user's touch input of the first motion trajectory point in the first motion trajectory through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible input, which can be determined according to actual use requirements, and the embodiment of the present invention is not limited. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input. For example, the above-mentioned first sub-input can be: the user's click input of the first motion trajectory point in the first motion trajectory.
[0132] The first gesture image may be any gesture image of the at least one gesture image.
[0133] The second sub-input is an input to the first posture image, and the second sub-input is used to display the first video clip in the first video, and the second sub-input can be a second sub-operation. Exemplarily, the second sub-input includes but is not limited to: a touch input of the first posture image by a user through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiment of the present invention is not limited. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input. For example, the first sub-input can be: a click input of the user to the first posture image.
[0134] In some embodiments of the present application, when a user performs a first sub-input on a first motion trajectory point in a first motion trajectory, at least one posture image corresponding to the first motion trajectory point may be displayed around the first motion trajectory point. In this way, the user can determine whether he or she wants to view the video clip by viewing the at least one posture image corresponding to the first motion trajectory point. If not, the user can continue to click other motion trajectory points. If so, the user can perform a second sub-input on the first posture image in the at least one posture image, and can immediately jump to the first video to play the first video clip corresponding to the first motion trajectory point.
[0135] Continuing with the above example, the user clicks Figure 3 If the motion trajectory point 311 in Figure 6 The gesture image 61 and the gesture image 62 corresponding to the motion trajectory point 311 are shown, and then the user clicks the gesture image 61 to jump to the video clip of the object A at the motion trajectory point 311 in the first video.
[0136] In an embodiment of the present application, by responding to the user's first sub-input to the first motion trajectory point in the first motion trajectory, at least one posture image corresponding to the first motion trajectory point can be displayed, so that the user can intuitively view the posture of the first motion object at the first motion trajectory point, so that the user can determine whether he wants to view the video clip of this period through the posture image. If the user is sure that he wants to view the video clip of this period, by responding to the user's second sub-input to the first posture image in at least one posture image, the display can jump to the first video and display the first video clip corresponding to the first motion trajectory point. In this way, the user does not need to watch the video from beginning to end, or the user needs to rely on memory to drag the video progress bar to view the video, thereby improving the efficiency of the user in viewing video content.
[0137] In some embodiments of the present application, when the background image includes multiple motion trajectories, each motion trajectory may be represented in a different style. Specifically, the motion trajectory points in each motion trajectory may be represented in a different style, thereby obtaining different motion trajectories, such as Figure 8 As shown, Figure 8 The background image shown includes two motion tracks, wherein the motion track points in the motion track 81 can be represented by circles, and the motion track points in the motion track 82 can be represented by rectangles.
[0138] The background image may also include a trajectory mark corresponding to at least one motion trajectory. The trajectory mark may be used to represent the motion trajectory. Specifically, the trajectory mark may be marked using the display style of the motion trajectory point of the motion trajectory, such as Figure 8 The trajectory identifier 811 used to characterize the motion trajectory 81 and the trajectory identifier 821 used to characterize the motion trajectory 82 are shown in FIG.
[0139] The above-mentioned trajectory identifier can be used to control the display style of the motion trajectory point of the motion trajectory corresponding to the trajectory identifier. The display style of the motion trajectory point here can be the display and hiding of the motion trajectory point, as well as the display form and display color of the motion trajectory point. The display form here can be, for example, a circle, rectangle, diamond, star, etc.
[0140] In order to improve the flexibility of displaying the motion track points in the motion track corresponding to the first track identifier, the above method may further include:
[0141] receiving a sixth input of the user on the first track identifier;
[0142] In response to the sixth input, the display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier is updated.
[0143] Among them, the sixth input can be an input to the first trajectory identifier, and the sixth input is used to update the display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier, and the sixth input can be the sixth operation. Exemplarily, the sixth input includes but is not limited to: the user's touch input to the first trajectory identifier through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs, which can be determined according to actual use requirements, and the embodiment of the present invention is not limited. The specific gesture in the embodiment of the present application can be any one of a single-click gesture, a sliding gesture, a drag gesture, a pressure recognition gesture, a long press gesture, an area change gesture, a double-press gesture, and a double-click gesture; the click input in the embodiment of the present application can be a single-click input, a double-click input, or any number of click inputs, etc., and can also be a long press input or a short press input. For example, the sixth input can be: the user's click input to the first trajectory identifier.
[0144] In some embodiments of the present application, by responding to the sixth input of the user to the first trajectory identifier, the display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier may be updated.
[0145] Continue to refer Figure 8 If the user wants to update the display form of the motion track points of the motion track 81, the user can click the track mark 811 corresponding to the motion track 81 to display the style candidate list 83. The user clicks "diamond style" 831 to update the circle display style of the motion track points in the motion track 81 to a diamond display style. Fig. 9 shown.
[0146] Continue to refer Figure 8 If the user wants to hide the motion track 81, the user can double-click the track mark 811 corresponding to the motion track 81 to hide the motion track 81. Fig.10 shown.
[0147] In an embodiment of the present application, by responding to the user's sixth input to the first trajectory identifier, the display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier can be updated. In this way, the display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier can be updated according to user needs, thereby improving the flexibility of the display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier.
[0148] In order to better understand the solution of the embodiment of the present application, the solution of the embodiment of the present application is explained by taking the case where the first video is recorded in real time and the background image corresponding to the first video is extracted in real time as an example.
[0149] like Fig.11As shown, the video display method provided in the embodiment of the present application may include steps 901 to 910.
[0150] Step 901, start recording the first video.
[0151] In step 901, the user can start recording the first video by clicking the video recording control.
[0152] Step 902: extract and generate a background image.
[0153] In step 902, a background image may be extracted from the first video using an image detection algorithm.
[0154] Step 903: Determine the target focus tracking mode.
[0155] In step 903, the determination of the target focus mode may refer to the above and will not be repeated here.
[0156] Step 904: Draw trajectory points.
[0157] In step 904, during the first video recording process, the position information of the moving object can be extracted in real time, and the trajectory points of the moving object can be drawn in the background image according to the position information.
[0158] Step 905: Save the video time points corresponding to the trajectory points and the posture images of the moving objects.
[0159] Step 906: End recording of the first video.
[0160] In step 906, the user may click the recording control again to end the recording of the first video.
[0161] Step 907: Display the background image.
[0162] In step 907, the displayed background image has the motion track of the moving object in the first video.
[0163] Step 908: Click the track point.
[0164] In step 908, the user may click a track point in the motion track.
[0165] Step 909: View the gesture image corresponding to the clicked trajectory point.
[0166] Step 910: Jump to the video clip at the video time point corresponding to the clicked track point.
[0167] Above Fig.11The solution shown can record a video and also obtain a background image of the video, which contains the trajectory of the moving object and the posture image of the moving object, so that users can understand the content of the video more quickly. In addition, by associating the posture image with the video time point, it is possible to quickly and accurately jump to the corresponding video time position.
[0168] Above Fig.11 The scheme shown is applied to a surveillance video scenario, that is, a scenario in which the video is pre-recorded. In this case, the user can know whether there is a moving object that the user is interested in, as well as the trajectory and posture of the moving object based on the posture image in the background image without opening the video, thereby greatly improving the efficiency of video viewing.
[0169] The video display method provided in the embodiment of the present application can be executed by a video display device. In the embodiment of the present application, a video display device executing the video display method is taken as an example to illustrate the video display device provided in the embodiment of the present application.
[0170] Fig.12 FIG. 1 is a schematic diagram showing the structure of a video display device according to an exemplary embodiment. Fig.12 As shown, the video display device 1000 may include:
[0171] A first receiving module 1010 is configured to receive a first input of a thumbnail of a first video from a user, wherein the first video includes at least one moving object;
[0172] A first display module 1020, configured to display a background image corresponding to the first video in response to the first input, wherein the background image includes at least one motion track, and the at least one motion track corresponds one-to-one to the at least one moving object;
[0173] The second receiving module 1030 is further configured to receive a second input from a user on a first motion trajectory point in the first motion trajectory, where the first motion trajectory is any one of the at least one motion trajectory;
[0174] The second display module 1040 is also used to display at least one posture image of the first moving object corresponding to the first motion trajectory in response to the second input, and / or a video clip at a timestamp corresponding to the first motion trajectory point in the first video, wherein the at least one posture image is an image of at least one posture of the first moving object at the first motion trajectory point, a video clip at a timestamp corresponding to the first motion trajectory point in the first video, and each motion trajectory point in the first motion trajectory corresponds to a video clip at a timestamp in the first video.
[0175] In an embodiment of the present application, in response to the user's first input of a thumbnail of a first video, a background image corresponding to the first video is displayed, wherein the background image includes the motion trajectory of each moving object in the first video. Then, when the user wants to view a video clip of a certain moving object, a second input can be directly performed at the corresponding motion trajectory point in the motion trajectory of the moving object, and an image of at least one posture of the moving object at the motion trajectory point and / or a video clip at a timestamp corresponding to the motion trajectory point in the first video can be directly displayed. In this way, the user can directly view the posture of the moving object at the motion trajectory point and / or the video clip of the moving object at the motion trajectory point, without the user having to watch the video from beginning to end or relying on memory to drag the video progress bar to view the video, thereby improving the efficiency of the user in viewing video content.
[0176] In some embodiments of the present application, the above-mentioned device may further include:
[0177] A third receiving module, configured to receive a third input of a focus mode control from a user before receiving a first input of a thumbnail of the first video from the user, while displaying the preview interface;
[0178] A first determining module, configured to determine a target focus tracking mode in response to the third input;
[0179] A second determining module, configured to determine the at least one moving object in the preview interface according to the target focus tracking mode;
[0180] A fourth receiving module, used for receiving a fourth input of the user to the video recording control;
[0181] The third determining module is used to record the movement process of the at least one moving object in response to the fourth input to obtain the first video.
[0182] In some embodiments of the present application, when the target focus tracking mode is a manual focus tracking mode, the second determining module is specifically configured to:
[0183] receiving a fifth input from a user on at least one object in the preview interface;
[0184] In response to the fifth input, the at least one object is determined to be the at least one moving object.
[0185] In some embodiments of the present application, when the target focus tracking mode is an automatic focus tracking mode, the second determining module is specifically configured to:
[0186] At least one object moving in the preview interface is determined as the at least one moving object.
[0187] In some embodiments of the present application, the above-mentioned device may further include:
[0188] an acquisition module, configured to acquire, before receiving a first input of a thumbnail of a first video from a user, a background image in the first video and position information of a first moving object at each moment in the first video, wherein the first moving object is any one of the at least one moving object, and the first motion trajectory is a motion trajectory of the first moving object;
[0189] The fourth determination module is further used to mark the position information of the first moving object at each moment in the background image according to the conversion relationship between the world coordinate system and the coordinate system of the background image, so as to obtain a plurality of motion trajectory points;
[0190] A fifth determining module is configured to generate the first motion trajectory in the background image based on the multiple motion trajectory points.
[0191] In some embodiments of the present application, the second input includes a first sub-input and a second sub-input;
[0192] The second receiving module 1030 is specifically used for:
[0193] receiving a first sub-input of a user for a first motion trajectory point in a first motion trajectory;
[0194] The second display module 1040 is specifically used for:
[0195] In response to the first sub-input, displaying at least one posture image of the first moving object;
[0196] The second receiving module 1030 is specifically used for:
[0197] second receiving a second sub-input of the user to the first gesture image;
[0198] The second display module 1040 is specifically used for:
[0199] In response to the second sub-input, a first video segment in the first video is displayed.
[0200] In some embodiments of the present application, the background image also includes a track identifier corresponding to the at least one motion track; the above-mentioned device may also include:
[0201] A fifth receiving module, configured to receive a sixth input of the user on the first track identifier;
[0202] An updating module is used to update the display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier in response to the sixth input.
[0203] In some embodiments of the present application, the thumbnail includes a background image area; the first receiving module 1010 is specifically used to:
[0204] A first input from a user regarding the background image area in the thumbnail of the first video is received.
[0205] In some embodiments of the present application, the thumbnail also includes a video image area; the above-mentioned device may also include:
[0206] A sixth receiving module, configured to receive a seventh input of the user on the video image area;
[0207] A playing module is used to play the first video in response to the seventh input.
[0208] The video display device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmentedreality, AR) / virtual reality (virtualreality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personalcomputer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0209] The video display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0210] The video display device provided in the embodiment of the present application can achieve Figure 1 To avoid repetition, the various processes implemented by the method embodiment are not described here.
[0211] Alternatively, if Fig.13As shown, an embodiment of the present application also provides an electronic device 1100, including a processor 1101 and a memory 1102, wherein the memory 1102 stores programs or instructions that can be executed on the processor 1101, and when the program or instructions are executed by the processor 1101, the various steps of the above-mentioned video display method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.
[0212] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0213] Fig.14 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0214] The electronic device 1200 includes but is not limited to: a radio frequency unit 1201, a network module 1202, an audio output unit 1203, an input unit 1204, a sensor 1205, a display unit 1206, a user input unit 1207, an interface unit 1208, a memory 1209, and a processor 1210 and other components.
[0215] Those skilled in the art will appreciate that the electronic device 1200 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1210 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.14 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0216] The user input unit 1207 is used to receive a first input of a thumbnail of a first video from a user, wherein the first video includes at least one moving object;
[0217] A display unit 1206, configured to display a background image corresponding to the first video in response to the first input, wherein the background image includes at least one motion trajectory, and the at least one motion trajectory corresponds one-to-one to the at least one moving object;
[0218] The user input unit 1207 is further used to receive a second input from a user on a first motion trajectory point in the first motion trajectory, where the first motion trajectory is any one of the at least one motion trajectory;
[0219] The display unit 1206 is also used to display at least one posture image of the first moving object corresponding to the first motion trajectory in response to the second input, and / or a video clip in the first video at a timestamp corresponding to the first motion trajectory point, wherein the at least one posture image is an image of at least one posture of the first moving object at the first motion trajectory point, a video clip in the first video at a timestamp corresponding to the first motion trajectory point, and each motion trajectory point in the first motion trajectory corresponds to a video clip at a timestamp in the first video.
[0220] In this way, in response to the user's first input of the thumbnail of the first video, a background image corresponding to the first video is displayed, wherein the background image includes the motion trajectory of each moving object in the first video. Then, when the user wants to view a video clip of a certain moving object, the second input can be directly performed on the corresponding motion trajectory point in the motion trajectory of the moving object, and an image of at least one posture of the moving object at the motion trajectory point and / or a video clip at the timestamp corresponding to the motion trajectory point in the first video can be directly displayed. In this way, the user can directly view the posture of the moving object at the motion trajectory point and / or the video clip of the moving object at the motion trajectory point, without the user having to watch the video from beginning to end or relying on memory to drag the video progress bar to view the video, thereby improving the efficiency of the user in viewing video content.
[0221] Optionally, the user input unit 1207 is further configured to receive a third input of a focus mode control from the user before receiving a first input of a thumbnail of the first video from the user, while displaying the preview interface;
[0222] Processor 1210 is configured to determine a target focus tracking mode in response to the third input; and determine the at least one moving object in the preview interface according to the target focus tracking mode;
[0223] The user input unit 1207 is further used to receive a fourth input of the user to the video control;
[0224] The processor 1210 is further configured to record the movement process of the at least one moving object in response to the fourth input to obtain the first video.
[0225] In this way, when displaying a preview interface of a shooting scene, the target focus mode can be determined in response to the user's third input to the focus mode control, and then at least one moving object can be determined in the preview interface according to the target focus mode. Then, in response to the fourth input to the video recording control, the movement process of at least one moving object in the shooting scene can be recorded to obtain a first video. In this way, at least one moving object can be determined in the preview interface according to different focus modes based on user needs, thereby improving the flexibility of determining at least one moving object.
[0226] Optionally, when the target focus tracking mode is a manual focus tracking mode, the user input unit 1207 is further configured to receive a fifth input from a user on at least one object in the preview interface;
[0227] The processor 1210 is further configured to, in response to the fifth input, determine the at least one object as the at least one moving object.
[0228] In this way, when the target focus mode is the manual focus mode, at least one object executed by the user for the fifth input can be determined as at least one moving object. In this way, at least one moving object can be selected according to the user's needs, thereby avoiding the situation where the automatically determined moving object is not the moving object the user wants to select, meeting the user's personalized needs and improving the accuracy of moving object selection.
[0229] Optionally, when the target focus tracking mode is an automatic focus tracking mode, the processor 1210 is further configured to determine at least one object moving in the preview interface as the at least one moving object.
[0230] In this way, when the target focus tracking mode is the automatic focus tracking mode, at least one object moving in the preview interface can be directly determined as at least one moving object. This eliminates the need for the user to select a moving object, thereby simplifying user operations and improving the efficiency of moving object selection.
[0231] Optionally, the processor 1210 is further used to obtain a background image in the first video and position information of a first moving object at each moment in the first video before receiving a first input of a thumbnail of the first video from a user, wherein the first moving object is any one of the at least one moving object, and the first motion trajectory is the motion trajectory of the first moving object; according to a conversion relationship between a world coordinate system and a coordinate system of the background image, the position information of the first moving object at each moment is marked in the background image to obtain a plurality of motion trajectory points; and based on the plurality of motion trajectory points, the first motion trajectory is generated in the background image.
[0232] In this way, by obtaining the background image in the first video and the position information of the first moving object at each moment in the first video, and then marking the position information of the first moving object at each moment in the background image, a plurality of motion trajectory points are obtained. Based on the plurality of motion trajectory points, a first motion trajectory can be generated in the background image, so that the motion trajectory of the moving object in the first video can be accurately extracted.
[0233] Optionally, the second input includes a first sub-input and a second sub-input; the user input unit 1207 is further used to receive a first sub-input of a user for a first motion track point in the first motion track;
[0234] The display unit 1206 is further configured to display at least one posture image of the first moving object in response to the first sub-input;
[0235] The user input unit 1207 is further used to receive a second sub-input of the user to the first gesture image;
[0236] The display unit 1206 is further configured to display the first video segment in the first video in response to the second sub-input.
[0237] In this way, by responding to the user's first sub-input to the first motion trajectory point in the first motion trajectory, at least one posture image corresponding to the first motion trajectory point can be displayed, so that the user can intuitively view the posture of the first motion object at the first motion trajectory point, so that the user can determine whether he wants to view the video clip of this period through the posture image. When the user is sure that he wants to view the video clip of this period, by responding to the user's second sub-input to the first posture image in at least one posture image, the display can jump to the first video and display the first video clip corresponding to the first motion trajectory point. In this way, the user does not need to watch the video from beginning to end, or needs to rely on memory to drag the video progress bar to view the video, thereby improving the efficiency of the user in viewing video content.
[0238] Optionally, the background image further includes the track identifiers corresponding to the at least one motion track; the user input unit 1207 is further configured to receive a sixth input of the user on the first track identifier;
[0239] The processor 1210 is further configured to update, in response to the sixth input, a display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier.
[0240] In this way, by responding to the user's sixth input to the first trajectory identifier, the display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier can be updated. In this way, the display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier can be updated according to user needs, thereby improving the flexibility of the display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier.
[0241] Optionally, the thumbnail includes a background image area; the user input unit 1207 is further used to receive a first input from a user on the background image area in the thumbnail of the first video.
[0242] In this way, by responding to the first input to the background image area in the thumbnail of the first video, the background image of the first video can be displayed, thus avoiding the problem of the user clicking on other areas, resulting in the background image not being displayed, thereby avoiding the problem of user misoperation.
[0243] Optionally, the thumbnail also includes a video image area; the user input unit 1207 is further used to receive a seventh input from the user on the video image area;
[0244] Processor 1210 is further configured to play the first video in response to the seventh input.
[0245] In this way, when the user wants to play the first video, the first video can be played in response to the user's seventh input to the video image area. In this way, the first video can be played at the moment when it is needed according to user needs, thereby meeting the user's personalized needs and improving the user's interactive experience.
[0246] It should be understood that in the embodiment of the present application, the input unit 1204 may include a graphics processor (Graphics Processing Unit, GPU) 12041 and a microphone 12042, and the graphics processor 12041 processes the image data of the static picture or video obtained by the image capture device (such as a color camera) in the video capture mode or the image capture mode. The display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1207 includes a touch panel 12071 and at least one of other input devices 12072. The touch panel 12071 is also called a touch screen. The touch panel 12071 may include two parts: a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
[0247] The memory 1209 can be used to store software programs and various data. The memory 1209 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 1209 may include a volatile memory or a non-volatile memory, or the memory 1209 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 1209 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.
[0248] The processor 1210 may include one or more processing units; optionally, the processor 1210 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 1210.
[0249] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned video display method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0250] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
[0251] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned video display method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0252] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0253] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned video display method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0254] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0255] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0256] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. A video display method, characterized in that: The method comprises: Receiving a first input of a thumbnail of a first video from a user, wherein the first video includes at least one moving object; In response to the first input, displaying a background image corresponding to the first video, wherein the background image includes at least one motion track, and the at least one motion track corresponds one-to-one to the at least one moving object; receiving a second input of a user on a first motion trajectory point in a first motion trajectory, wherein the first motion trajectory is any one of the at least one motion trajectory; In response to the second input, at least one posture image of the first moving object corresponding to the first motion trajectory and / or a video segment in the first video at a timestamp corresponding to the first motion trajectory point are displayed, wherein the at least one posture image is an image of at least one posture of the first moving object at the first motion trajectory point, and each motion trajectory point in the first motion trajectory corresponds to a video segment at a timestamp in the first video.
2. The method according to claim 1, characterized in that Before receiving a first input of a thumbnail of the first video from a user, the method further includes: When the preview interface is displayed, receiving a third input from the user on the focus mode control; In response to the third input, determining a target tracking focus mode; Determining the at least one moving object in the preview interface according to the target focus tracking mode; receiving a fourth input from the user to the video recording control; In response to the fourth input, the movement process of the at least one moving object is recorded to obtain the first video.
3. The method according to claim 2, characterized in that When the target focus tracking mode is a manual focus tracking mode, determining the at least one moving object in the preview interface according to the target focus tracking mode includes: receiving a fifth input from a user on at least one object in the preview interface; In response to the fifth input, the at least one object is determined to be the at least one moving object.
4. The method according to claim 2, characterized in that: In a case where the target focus tracking mode is an automatic focus tracking mode, determining the at least one moving object in the preview interface according to the target focus tracking mode includes: At least one object moving in the preview interface is determined as the at least one moving object.
5. The method according to claim 1, characterized in that Before receiving a first input of a thumbnail of the first video from a user, the method further includes: Acquire a background image in the first video and position information of a first moving object at each moment in the first video, wherein the first moving object is any one of the at least one moving object, and the first motion trajectory is a motion trajectory of the first moving object; According to the conversion relationship between the world coordinate system and the coordinate system of the background image, the position information of the first moving object at each moment is marked in the background image to obtain a plurality of moving trajectory points; Based on the multiple motion trajectory points, the first motion trajectory is generated in the background image.
6. The method according to claim 1, characterized in that The second input includes a first sub-input and a second sub-input; The receiving a second input of a user regarding a first motion track point in the first motion track, and displaying a first video segment in the first video in response to the second input, comprises: receiving a first sub-input of a user for a first motion trajectory point in a first motion trajectory; In response to the first sub-input, displaying at least one posture image of the first moving object; receiving a second sub-input of a first gesture image by a user, wherein the first gesture image is any one of the at least one gesture image; In response to the second sub-input, a first video segment in the first video is displayed.
7. The method according to claim 1, characterized in that The background image also includes a track identifier corresponding to each of the at least one motion track; and the method further includes: receiving a sixth input of the user on the first track identifier; In response to the sixth input, a display style of the motion trajectory points in the motion trajectory corresponding to the first trajectory identifier is updated.
8. The method according to claim 1, characterized in that The thumbnail includes a background image area; The receiving a first input of a thumbnail of a first video from a user includes: A first input from a user regarding the background image area in the thumbnail of the first video is received.
9. The method according to claim 8, characterized in that The thumbnail also includes a video image area; the method further includes: receiving a seventh input from a user regarding the video image area; In response to the seventh input, the first video is played.
10. A video display device, characterized in that: The device comprises: A first receiving module, configured to receive a first input of a thumbnail of a first video from a user, wherein the first video includes at least one moving object; A first display module, configured to display a background image corresponding to the first video in response to the first input, wherein the background image includes at least one motion track, and the at least one motion track corresponds one-to-one to the at least one moving object; The second receiving module is further used to receive a second input of a user on a first motion trajectory point in the first motion trajectory, where the first motion trajectory is any one of the at least one motion trajectory; The second display module is also used to display at least one posture image of the first moving object corresponding to the first motion trajectory in response to the second input, and / or a video clip at a timestamp corresponding to the first motion trajectory point in the first video, wherein the at least one posture image is an image of at least one posture of the first moving object at the first motion trajectory point, and each motion trajectory point in the first motion trajectory corresponds to a video clip at a timestamp in the first video.
11. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the video display method according to any one of claims 1 to 9 are implemented.