Display devices, smart terminals, and video compilation generation methods
By configuring a camera and controller in the display device, the system can automatically record and generate video compilation files, solving the operational difficulties faced by home users, especially children, when creating video compilation files, and improving production efficiency and user experience.
Patent Information
- Application Number
- CN202180046688.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-10-23
- Filing Date
- 2021-06-07
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2041-06-07
AI Technical Summary
Home users, especially children, cannot operate photography tools for extended periods when creating video compilation files, leading to difficulties in acquiring video clips, slow editing speed, and a high risk of errors.
A display device and smart terminal are provided, configured with a camera and controller, which automatically record video clips and generate video compilation files, which users can play after confirming the operation.
It simplifies the process of creating video highlight files, improves the user experience, especially for families and those recording videos of pets or babies, ensuring that no wonderful moment is missed.
Smart Images

Figure CN116391358B_ABST
Abstract
Description
[0001] This application claims the following patent applications filed on October 23, 2020: Application No. 202011149949.X, entitled "A Display Device and a Method for Generating a Video Compilation File Watermark"; Application No. 202011148295.9, also filed on October 23, 2020, entitled "A Display Device and a Method for Generating a Video Compilation File"; and Application No. 202011148312.9, also filed on October 23, 2020. Priority is claimed in the following Chinese patent applications: one filed on July 6, 2020, entitled "A control method for a display device and a camera"; another filed on August 21, 2020, entitled "An interactive method, display device, and smart terminal for generating video compilation files"; and the third filed on August 21, 2020, entitled "A display device". The entire contents of these patent applications are incorporated herein by reference. Technical Field
[0002] This application relates to the field of display device technology, and more specifically, to a display device, a smart terminal, and a method for generating video highlights. Background Technology
[0003] Video compilation files are created by editing and splicing together different videos or video clips with similar content or identical elements into a single video file. Some compilation file creation methods require users to use professional photography tools to acquire video clips, view and filter each video, and then manually trim and splice them into a compilation. However, when creating video compilation files for young children at home, users cannot operate photography tools for extended periods, the number of video clips is large, and the video scenes are complex. This can lead to users being unable to acquire video clips, slow editing speeds, and errors in splicing video clips. Summary of the Invention
[0004] Some embodiments of this application provide a display device, including: a camera; a display screen for displaying a user interface; and a controller configured to: receive video clips captured by the camera when a target user is within the monitoring range of the display device; and generate a video compilation file based on a plurality of the acquired video clips, wherein the controller controls the user interface to play the video compilation file after receiving a confirmation operation.
[0005] Some embodiments of this application provide a method for generating a video compilation file, the method comprising: recording video clips when a target user is within the monitoring range; generating a video compilation file based on a plurality of acquired video clips, wherein the video compilation file is played in a user interface after receiving a confirmation operation.
[0006] Some embodiments of this application provide a smart terminal, including: The display is configured to present a terminal user interface with a video recording start entry, the video recording start entry being used to initiate a video recording function that records motion images and generates a video compilation file by video recording within a preset recording duration, the video recording function being configured in the controller of the display device; A processor connected to a controller in the display device, the processor having a specified application configured therein, is configured to: Receive a video recording function activation command generated when the specified application is triggered; In response to the video recording function activation command, a terminal user interface displaying the video recording start entry is presented on the display. The system receives a video recording start command triggered by the video recording start entry, and sends the video recording start command to the controller. The video recording start command is used to instruct the controller to call the camera in the display device to collect motion image materials of the moving target at a preset acquisition frequency within a preset recording duration, and to stitch together a specified number of motion image materials to generate a video compilation file that records the moving target within the preset recording duration. Attached Figure Description
[0007] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device according to one or more embodiments of this application; Figure 2 This is a hardware configuration block diagram of a display device 200 according to one or more embodiments of this application; Figure 3 This is a hardware configuration block diagram of a control device 100 according to one or more embodiments of this application; Figure 4 This is a schematic diagram of the software configuration in a display device 200 according to one or more embodiments of this application; Figure 5 This is a schematic diagram showing the icon control interface of an application in a display device 200 according to one or more embodiments of this application; Figure 6 This is a schematic diagram of a user interface according to one or more embodiments of this application; Figure 7 This is a schematic diagram of the interface demonstrating the functional effects of one or more embodiments of this application; Figure 8 A schematic diagram of the interface for launching a video recording function according to one or more embodiments of this application; Figure 9This is a schematic diagram showing the start-up watermark according to one or more embodiments of this application; Figure 10 This is a schematic diagram of the interactive interface for implementing the sharing to family and friends circle function according to one or more embodiments of this application; Figure 11 This is a schematic diagram of an interface for displaying push notifications according to one or more embodiments of this application; Figure 12 This is a schematic diagram of a video compilation file of a display device according to one or more embodiments of this application; Figure 13 This is a schematic diagram of a terminal user interface according to one or more embodiments of this application; Figure 14 This is a schematic diagram of a video list interface according to one or more embodiments of this application; Figure 15 This is a schematic diagram illustrating the watermark used during the playback of a video compilation file according to one or more embodiments of this application. Figure 16 This is a schematic diagram illustrating the watermark used during the playback of a video compilation file according to one or more embodiments of this application. Figure 17 This is a schematic diagram illustrating the watermark used during the playback of a video compilation file according to one or more embodiments of this application. Figure 18 This is a schematic diagram illustrating the watermark used during the playback of a video compilation file according to one or more embodiments of this application. Figure 19 This is a watermark illustration for playing video compilation files according to one or more embodiments of this application. Detailed Implementation
[0008] To make the objectives, implementation methods and advantages of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the described exemplary embodiments are only some embodiments of this application, and not all embodiments.
[0009] Based on the exemplary embodiments described in this application, all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of the appended claims. Furthermore, although the disclosures in this application are presented by way of one or more exemplary examples, it should be understood that each aspect of these disclosures can constitute a complete implementation on its own. It should be noted that the brief descriptions of terminology in this application are merely for the convenience of understanding the embodiments described below, and are not intended to limit the implementation of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.
[0010] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device according to one or more embodiments of this application, such as... Figure 1 As shown, a user can operate the display device 200 via a mobile terminal 300 and a control device 100. The control device 100 can be a remote control, and communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, wireless or other wired methods to control the display device 200. The user can input user commands through buttons on the remote control, voice input, control panel input, etc., to control the display device 200. In some embodiments, a mobile terminal, tablet computer, computer, laptop computer, and other smart devices can also be used to control the display device 200.
[0011] In some embodiments, the mobile terminal 300 can install software applications with the display device 200 to achieve connection and communication via network communication protocols, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronous display. The display device 200 also communicates with the server 400 via various communication methods. The display device 200 can communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 can provide various content and interactive features to the display device 200. The display device 200 can be a liquid crystal display, an OLED display, or a projection display device. In addition to providing broadcast television reception functions, the display device 200 can also be equipped with a smart network television function that provides computer support.
[0012] Figure 2 An exemplary block diagram of the configuration of the control device 100 according to an exemplary embodiment is shown. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input commands and convert them into commands that the display device 200 can recognize and respond to, acting as an intermediary for interaction between the user and the display device 200. The communication interface 130 is used for external communication and includes at least one of a Wi-Fi chip, a Bluetooth module, NFC, or a replacement module. The user input / output interface 140 includes at least one of a microphone, a touchpad, a sensor, buttons, or a replacement module.
[0013] Figure 3 A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is shown. For example... Figure 3The display device 200 shown includes at least one of the following: a tuner / demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface 280. The controller includes a central processing unit, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to nth interface for input / output. The display 260 can be at least one of a liquid crystal display, an OLED display, a touch display, and a projection display, and can also be a projection device and a projection screen. The tuner / demodulator 210 receives broadcast television signals via wired or wireless reception and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals. The detector 230 is used to collect signals from the external environment or signals interacting with the external environment. The controller 250 and the tuner / demodulator 210 can be located in different separate devices; that is, the tuner / demodulator 210 can also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0014] In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200. The user can input user commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.
[0015] In some embodiments, a "user interface" is the medium through which an application or operating system interacts and exchanges information with a user, enabling the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.
[0016] Figure 4 This is a schematic diagram of the software configuration in a display device 200 according to one or more embodiments of this application, such as... Figure 4As shown, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the Android runtime and system library layer (referred to as the "System Runtime Layer"), and the kernel layer. The kernel layer contains at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, Wi-Fi driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.
[0017] Figure 5 This is a schematic diagram showing the icon control interface of an application in a display device 200 according to one or more embodiments of this application, such as... Figure 5 As shown, the application layer contains at least one application whose corresponding icon control can be displayed on the screen, such as: live TV application icon control, video-on-demand application icon control, media center application icon control, application center icon control, game application icon control, etc. Live TV applications can provide live television from different signal sources. Video-on-demand applications can provide video from different storage sources. Unlike live TV applications, video-on-demand provides video display from certain storage sources. Media center applications can provide applications for playing various multimedia content. The application center can provide storage for various applications.
[0018] <Video Highlights> In some embodiments, the display device employs a camera, for example, to record a pet's daily life via video. In related technologies, recording pet videos typically requires real-time user intervention to access the camera and capture images to obtain a video file. Therefore, to allow users to record their pets' exciting lives even when they are not home during the day, a video recording function can be configured in the display device, enriching the usage scenarios for the camera. Once the video recording function is activated, the display device can access the camera in real-time to capture motion images of the pet. This real-time image capture process requires no user intervention; the display device automatically performs this process as long as it is powered on and connected to the internet. Finally, the display device can also generate a video compilation file based on multiple motion images captured by the camera throughout the day and push it to the user, ensuring that the user does not miss their pet's exciting life while away from home during the day.
[0019] Besides recording your pet's daily life, the video recording function can also capture the activities of other moving objects, such as your baby at home. When the video recording function is activated on the display device, the camera will capture motion footage whenever your pet or baby appears within its field of view. The camera then generates a compilation video file from multiple captured motion footage clips throughout the day, which is sent to the user the next time they turn on the display device. Users can easily track their pet's or baby's daily activities at home using this compilation video, providing a positive user experience.
[0020] Some embodiments of this application provide a display device 200, including a display 275, a camera 232, and a controller 250. The display is configured to present a user interface with a video recording start entry, which is used to initiate the function of recording a specific target within a preset recording duration and generating a video compilation file; wherein the specific target includes a moving target. The camera is configured to acquire image material of the specific target at a preset acquisition frequency. The specific target refers to the target whose image needs to be recorded via video recording within the preset recording duration to generate a video compilation file. The controller is connected to both the camera and the display, and is used to initiate the video recording function configured in the display device, call the camera to acquire image material of the specific target, and finally generate a video compilation file. To facilitate faster and more convenient operation for users when interacting with the display device, an interactive method for generating a video compilation file is provided, which instructs the user on how to initiate the video recording function and how to interactively operate the video compilation file.
[0021] To implement the video recording function, a target application is configured in the display device. Specifically, the target application is configured in the controller and displayed on the system home screen of the display device. The target application provides the entry point for starting the video recording function. To ensure that the user interface displaying the video recording start entry point is shown on the monitor, the controller is further configured as follows: Step 011: In response to the device startup command generated when the user starts the display device, the system home screen is displayed on the monitor, and the target application is displayed on the system home screen. Step 012: In response to the invocation command generated when the target application is triggered, the user interface is displayed on the monitor, and the video recording start entry point is displayed on the user interface. When the user turns on the display device, a device startup command is generated. The controller can invoke the system home screen according to the device startup command and display it on the monitor, where the target application is displayed. When the user triggers the target application via remote control or voice, an invocation command is generated, and the controller invokes the user interface according to the invocation command and displays it on the monitor. At this time, the content displayed on the monitor switches from the system home screen to the user interface, which is the main page of the target application. While the user interface is brought up, a video recording start entry is displayed in the user interface. Users can start the video recording function of the display device by clicking the video recording start entry via remote control or voice, which means starting to collect specific target image materials and generate video compilation files.
[0022] Figure 6 This is a schematic diagram of a user interface according to one or more embodiments of this application. See also: Figure 6 If the target application is "Application A", the user interface displayed after triggering "Application A" will show a video recording startup entry, such as "Video Collection Sub-application" displayed in the upper right corner of the user interface. Triggering "Video Collection Sub-application" will enable the video recording function of the display device. In some embodiments, the video recording startup entry can also be added as a shortcut to the system home screen, allowing users to quickly enable the video recording function of the display device through the video recording startup entry on the system home screen after turning on the display device.
[0023] When a user triggers the video recording start entry on the user interface or system homepage, a video recording start command is generated, which in turn activates the video recording function of the display device, i.e., calls the camera to start capturing images. Specifically, the controller generates a video recording start command when the video recording start entry is triggered, which is further configured as follows: Step 021: In response to the start command generated when the video recording start entry is triggered, a function effect display interface is presented on the display, which displays a confirmation start entry. Step 022: In response to the confirmation command generated when the confirmation start entry is triggered, the display of the function effect display interface is canceled on the display, and the video recording start command is generated. To facilitate users' understanding of the function's effects when using the video recording function for the first time, a function effect display interface can be displayed on the display when the video recording start entry is triggered. The content displayed on the function effect display interface includes a function introduction and a demonstration of the effects that can be achieved.
[0024] Figure 7 This is a schematic diagram of the interface demonstrating the functional effects of one or more embodiments of this application. Figure 7 (a) and Figure 7 The page shown in (b) is an example of a functional demonstration interface, allowing users to gain an understanding of the video recording function based on the content displayed. Users can trigger the video recording start-up entry on the user interface or the system homepage via remote control, generating a start command. The controller can then activate the recording function based on the start command. Figure 7 The function effect demonstration interface is displayed on the monitor. At this time, the content displayed on the monitor switches from the user interface to the function effect demonstration interface. To facilitate users to quickly start the video recording function, a confirmation entry can be displayed on the last screen of the function effect demonstration interface, such as... Figure 7 The "Start" control is shown in (b). When the user triggers the confirmation entry via the remote control, a confirmation command is generated, indicating that the user wants to start the video recording function. At this time, the controller cancels the display of the function effect interface on the monitor according to the confirmation command, and generates a video recording start command to enable the video recording function of the display device.
[0025] In some embodiments, if the user activates the video recording function of the display device for the second or subsequent times (after activating the video recording function for the first time and then closing it), the user may directly display the video recording function activation interface instead of the function effect display interface when triggering the video recording activation entry on the user interface. Figure 8 This is a schematic diagram of the interface of the video recording function launch page according to one or more embodiments of this application. See also Figure 8When the user triggers the video recording start entry in the user interface, a start command is generated. The controller then invokes the video recording function start interface based on the start command and displays it on the monitor. At this time, the video recording function start interface is displayed on the monitor. The video recording function start interface displays a confirmation start entry, such as... Figure 8 The "Start" control is shown in the image. When the user triggers the confirmation entry, a confirmation command is generated. At this time, the controller cancels the display of the video recording function startup interface on the monitor according to the confirmation command and generates a video recording startup command to enable the video recording function of the display device.
[0026] After the video recording function of the display device is enabled, an image material list interface is displayed on the screen. Specifically, the controller invokes and displays the image material list interface on the screen in response to a confirmation command. This interface displays image materials and video compilation files. In some embodiments, if the user initiates the video recording function for the first time, it indicates that the camera has not captured any image materials and therefore has not generated any video compilation files; thus, the image material list interface displays nothing. In other embodiments, if the user initiates the video recording function a second time or on subsequent occasions, it indicates that the camera has previously captured image materials and may have generated video compilation files. In this case, the image material list interface will display historically captured image materials from the camera and historically generated video compilation files from the controller.
[0027] In some embodiments, when executing the interactive method for generating video compilation files, the controller is configured to perform the following steps: S11, receiving a video recording start command generated when the video recording start entry is triggered. The video recording start command instructs the camera to collect image material of a specific target within a preset recording duration and at a preset acquisition frequency. When a user triggers the video recording start entry on the user interface or system homepage, a video recording start command is generated. Based on the video recording start command, the controller can activate the video recording function of the display device, that is, call the camera to start collecting image material of a specific target. The specific target includes moving targets, and the image material includes moving pictures or videos, etc. For example, the specific target could be a pet or a baby. Since the time when the user is separated from the pet or baby is usually during the day, the display device only needs to record the pet or baby's daytime activities, so a preset recording duration can be set. The preset recording duration is the time period during which the controller automatically calls the camera to collect image material of the specific target. In some embodiments, the preset recording duration can be set to 6:00-18:00, that is, the controller calls the camera to collect moving image material within the time period of 6:00-18:00. When a camera captures image footage of a specific target, if the target remains in the same pose and does not move within the camera's field of view, the captured image footage will contain the same content. To avoid excessive storage space usage due to the camera capturing the same footage repeatedly, some embodiments can control the camera to capture image footage at a preset capture frequency.
[0028] <Camera Status Determination> In some embodiments, when the camera is capturing image footage of a specific target at a preset acquisition frequency, the controller executes: S111, receiving a camera invocation command generated by the controller in response to a video recording start command. Upon receiving the video recording start command, the controller can invoke the camera for image acquisition. Therefore, upon receiving the video recording start command, the controller generates a camera invocation command and sends it to the camera. The camera can then start and begin capturing image footage according to the camera invocation command. However, since the camera may be in a state where it is being invoked by other applications, the controller cannot invoke the camera to capture image footage in this situation. Therefore, the controller must first determine whether the camera can be invoked, and only if it can be invoked will it send a camera invocation command to the camera.
[0029] In some embodiments, before sending a camera invocation command to the camera, the controller generates a camera invocation command in response to a video recording start command. The controller performs the following steps: Step 1111: In response to the video recording start command, obtain the current operating status of the camera. Step 1112: If the current operating status of the camera is an uninvoked state, generate a camera invocation command. The camera invocation command is used to invoke the camera to acquire image footage. The controller obtains the current operating status of the camera based on the video recording start command to determine whether the camera can be invoked. If it is determined that the camera is in an uninvoked state, it means that the camera can be invoked to acquire motion image footage of moving targets. At this time, the controller generates a camera invocation command and sends it to the camera to start the camera and invoke the camera to acquire image footage. After the video recording function is started, as long as the camera is not occupied by other applications, the controller continuously invokes the camera to acquire image footage. When the controller detects that the camera is being invoked by other applications, it stops acquiring video clips or pauses acquiring video clips. For example, when the camera is used for video calls, the video highlights application pauses or stops acquiring video clips. If the video highlight function of the display device is turned off, even if the camera is not in use, the controller will not control the camera to record video clips, and the controller will stop the camera from performing monitoring activities.
[0030] S112. In response to the camera call command, image materials are collected from the initial moment of the preset recording duration according to the preset acquisition frequency.
[0031] S113. Image acquisition ends when the preset recording duration ends. After receiving the camera call command from the controller, the camera executes this command daily to acquire image data. Therefore, the start time of image data acquisition is the initial time of the preset recording duration. Each day, starting from the initial time of the preset recording duration, the camera acquires image data at a preset acquisition frequency until the end time of the preset recording duration. For example, the camera starts acquiring motion image data of a moving target at 6:00 AM and ends at 6:00 PM daily. When the preset recording duration ends, the controller generates a camera stop command and sends it to the camera to control the camera to end image data acquisition.
[0032] In some embodiments, when a specific target is within the monitoring range of the display device, the controller receives a video segment captured by the camera, specifically including: when the specific target is within the monitoring range of the display device, the controller controls the camera to perform face detection; based on the face detection, it is determined whether the user is younger than a preset age; if the specific target is younger than the preset age, the controller receives a video segment captured by the camera; otherwise, the controller controls the camera to continue performing face detection.
[0033] In some embodiments, after application service A starts, it first checks whether it is set to start on boot. If the display device is set to start on boot, a delay task with a preset time is started, such as a 5-second delay task. If the display device is not set to start on boot, it checks whether the hardware device has a NAS. If there is no NAS, service A terminates automatically. If there is a NAS, it checks whether there is a video segment to be synthesized. If there is, the video is synthesized. If not, it determines whether the video compilation function switch is on and whether the camera setting is kept up (i.e., whether the camera is in the on state).
[0034] <Motion Image Acquisition> After the camera is invoked, it does not continuously capture images. Instead, it only begins capturing image material after a moving target appears within the camera's shooting range, avoiding the acquisition of useless image material and thus wasting resources. In some embodiments, to facilitate accurate determination that the camera can capture moving image material including a specific target, the controller is further configured to perform the following steps, starting from the initial moment of the preset recording duration, to acquire moving image material of the specific target at a preset acquisition frequency: Step 1121: Acquire a preview image captured by the camera starting from the initial moment of the preset recording duration. Step 1122: Perform image recognition on the preview image to determine whether a moving target exists in the preview image. Step 1123: If a moving target exists in the preview image, invoke the camera to acquire moving image material of the moving target at a preset acquisition frequency. After the camera is invoked, it will capture the preview image in real time from the initial moment of the preset recording duration. Since the preview image indicates that no video recording is being performed, there is no issue of occupying storage space. The controller performs image recognition on the preview image captured by the camera in real time and determines whether the moving target appears within the camera's shooting area based on the image recognition results. The camera will only capture motion image footage of a moving target if that target is within its shooting area. Once the controller detects a moving target in the preview frame, it sends a control command to the camera. Upon receiving the command, the camera will then capture motion image footage of the target at a preset capture frequency.
[0035] In some embodiments, to avoid the camera continuously capturing images of a moving target that has not changed its motion state within a short period of time, the acquisition process can be performed only once when the moving target appears in the camera's shooting area. That is, the camera performs the acquisition of motion image material of the moving target at a preset acquisition frequency. This is further configured to: when a moving target is present in the preview screen, the camera is invoked to perform the process of acquiring motion image material of the moving target once. When the controller determines that a moving target is present in the camera's shooting area through image recognition, it only invokes the camera to acquire a segment of motion image material of the moving target. If the moving target leaves the camera's shooting area and then re-enters the camera's shooting area, the camera is invoked again to acquire a segment of motion image material of the moving target. For example, if the moving target enters the camera's shooting area at 9:00, the camera is invoked to acquire the first segment of motion image material. If the moving target leaves the camera's shooting area at 9:10, and after a period of time, the moving target enters the camera's shooting area again at 10:23, the camera is invoked again to acquire the second segment of motion image material. If the moving target leaves the camera's shooting area at 10:40, the camera is invoked again to acquire the second segment of motion image material. As can be seen, the camera only captures one segment of moving image footage between 9:00 and 9:10, and also only captures one segment of moving image footage between 10:23 and 10:40. The camera's capture process follows the same pattern and will not be described in detail here.
[0036] In some embodiments, the preset acquisition frequency includes a preset acquisition duration and a preset acquisition interval duration. Therefore, the camera's acquisition of motion image material of the moving target according to the preset acquisition frequency is further configured as follows: Step 11231: Starting from the moment a moving target is detected in the preview screen, acquire the first segment of motion image material of the moving target according to the preset acquisition duration. Step 11232: After the preset acquisition interval duration, acquire the second segment of motion image material of the moving target according to the preset acquisition duration. Starting from the moment a moving target is detected in the preview screen, i.e., after receiving the control command sent by the controller, the acquisition of the first segment of motion image material of the moving target begins, and the duration of the first segment of motion image material is the preset acquisition duration. To avoid the camera acquiring motion image material of a moving target that has not changed its motion state within a short period of time, it is necessary to control the camera to wait for a period of time after completing the acquisition of one segment of motion image material before acquiring the next segment. That is, after acquiring the first segment of motion image material, the camera waits for the preset acquisition interval duration before acquiring the second segment of motion image material of the moving target, and the duration of the second segment of motion image material is the preset acquisition duration.
[0037] If the moving target moves out of the camera's field of view again, the controller performs image recognition on the camera's captured image again. If no moving target is detected within the camera's field of view, the controller stops capturing motion images. In other words, during the process of the camera capturing motion image material of a moving target, image recognition is performed in real time on the captured image. Once a movement is detected that is not present in the captured image, a stop control command is immediately sent to the camera to stop capturing. Within the preset recording time, the moving target may appear multiple times within the camera's field of view, and various motion states may occur within the camera's field of view. Therefore, the camera may capture multiple segments of motion image material according to the preset capture frequency.
[0038] S12. When the preset recording time ends, acquire several motion image materials of the moving target captured by the camera within the preset recording time.
[0039] After the display device starts video recording, the camera will continuously capture image footage as long as it is not occupied by other applications. The camera will stop capturing motion images of moving targets at the end of the preset recording time. For example, at 18:00, the controller generates a stop control command and sends it to the camera to stop capturing motion images of moving targets. At this time, within the preset recording time, the camera may capture several motion images, which the controller can then use to create a video compilation file.
[0040] S13. A specified number of motion image clips are stitched together to generate a video compilation file recording the movement of a target within a preset recording duration. To ensure that the compiled video compilation file meets the requirements of a short video, a specified number of video compilation files must be combined when combining multiple motion image clips. Each motion image clip includes the movement of the target, so the video compilation file records the target's activities within the preset recording duration. When viewing the video compilation file, users can see the exciting life of the target, such as a pet or baby, within the preset recording duration. In some embodiments, the controller generates a video compilation file based on multiple acquired video clips, wherein the video compilation file includes the earliest and latest video clips within the preset time period. For example, when generating the video compilation file, the controller checks whether there are valid video clips in the memory; wherein, the valid video clips refer to video clips that have been recorded normally. When there are video clips to be combined in the memory and its space capacity is sufficient, the controller categorizes all valid video clips by day, sorts the video clips of each day in ascending order of time, and selects a preset number of video clips for combination. It is worth noting that in this application, the video clips and image materials are essentially the same.
[0041] In some embodiments, the process of the controller generating a video compilation file based on video segments can be implemented as follows: the controller reads each frame of video stream data from the video segment and writes it to the video track of the target file; the first frame of the next video segment is written after the last frame of the previous video segment, forming continuous frame data of the video compilation. The controller accumulates and calculates the video duration of the generated video compilation file while synthesizing the video stream data. After the video stream data is synthesized, the controller reads each frame of data from the audio file and writes it to the audio track of the target file. If the duration of the read audio track data is longer than the video duration, the reading of audio data stops, and the video synthesis is completed; after video synthesis, the video segments to be synthesized are deleted to release the occupied space.
[0042] <Number of composite files> In some embodiments, to quickly and accurately generate video compilation files that meet the requirements of short videos, the controller, when performing the process of stitching together a specified number of motion image clips to generate a video compilation file recording a moving target within a preset recording duration, is further configured to perform the following steps: S131, obtain the total number of motion image clips captured by the camera within the preset recording duration. S132, if the total number of clips is less than or equal to a specified number, stitch together the motion image clips of the total number of clips in chronological order. S133, if the total number of clips is greater than a specified number, select a specified number of target motion image clips from the motion image clip set. S134, stitch together the specified number of target motion image clips in chronological order to generate a video compilation file recording a moving target within the preset recording duration. Each time the camera captures a segment of motion image clip, it sends it to the controller. Within the preset recording duration, the controller can count the total number of motion image clips captured by the camera.
[0043] In some embodiments, the total duration of the synthesized video compilation file is approximately 30 seconds, which meets the duration requirements for short videos. This means that a maximum of six motion image clips are needed for synthesis. If the total number of clips exceeds six, six suitable motion image clips must be selected from the total number for synthesis. The total number of motion image clips captured by the camera is compared with a specified number. If the total number of clips is less than or equal to the specified number, it indicates that the duration requirement for synthesizing a short video is met. In this case, the motion image clips of the total number of clips can be directly spliced together in chronological order.
[0044] If the total number of motion images exceeds the specified number, it means that if the motion image footage of the total number of footage is combined into a video highlight file, the total duration of the video highlight file will exceed the duration of the short video, and this video highlight file will not meet the requirements. Therefore, to ensure the successful synthesis of the video highlight file, the controller can select a specified number of target motion image footage from the set of motion image footage corresponding to the total number of footage. Then, the specified number of target motion image footage is spliced and synthesized in chronological order to generate a video highlight file that records the moving target within a preset recording duration. For example, if the specified number is set to 6 segments, and the total number of motion image footage is 5 segments, then the 5 segments of motion image footage can be directly spliced and synthesized to obtain the video highlight file; however, if the total number of motion image footage is 10 segments, then suitable target motion image footage needs to be selected from the 10 segments, and then 6 segments of target motion image footage need to be spliced and synthesized to obtain the video highlight file.
[0045] In some embodiments, when the total number of materials exceeds a specified number, and a specified number of target motion image materials are selected from the set of motion image materials corresponding to the total number of materials, the time span between the selected target motion image materials can be larger. For example, if the camera captures motion image materials in the first, middle, and last segments of a preset recording time, then when selecting target motion image materials, it is necessary to ensure that motion materials are selected in the first, middle, and last segments to ensure that the life situation of the moving targets contained in the composite video compilation file is richer.
[0046] Therefore, when the controller executes step 133, i.e., if the total number of materials is greater than a specified number, then select a specified number of target motion image materials from the motion image material set, it is further configured to execute the following steps: Step 1331: Obtain the start acquisition time of each motion image material segment. Step 1332: Divide the start acquisition time corresponding to each motion image material segment into multiple material acquisition time periods according to the time period to which the start acquisition time belongs, and each material acquisition time period includes multiple motion image materials. Step 1333: Select a target number of motion image materials in each material acquisition time period as target motion image materials, and the sum of the target numbers selected in each material acquisition time period is equal to the specified number.
[0047] When a camera captures moving image footage, it uses the start time of capture to mark the time of each segment of moving image footage. Therefore, it can determine the time period to which each segment of moving image footage belongs when it is captured—that is, the beginning, middle, or end of a preset recording duration. For example, if the preset recording duration is 6:00-18:00, then the beginning segment could refer to the morning, the middle segment to the noon, and the end segment to the afternoon. The division of the time period will vary depending on the preset recording duration, and the number of segments can also be determined according to the actual situation. After marking the time period of each segment of moving image footage, it can be divided into multiple footage capture periods based on the start time, for example, the footage capture periods could be the morning, noon, and afternoon. Each footage capture period will include at least one segment of moving image footage.
[0048] To ensure a large time span across the multiple motion image clips in the composite video compilation file, a certain number of motion image clips can be selected within each clip acquisition period. For example, n1 motion image clips can be selected in the morning, n2 in the noon, and n3 in the afternoon. It must be ensured that n1 + n2 + n3 = the specified number. Finally, the selected n1 motion image clips from the morning, n2 from the noon, and n3 from the afternoon are stitched together in chronological order of their start acquisition times to obtain the video compilation file.
[0049] In some embodiments, the above video segment selection rules can be implemented as follows: if the number of video segments is less than or equal to the above preset number, for example, if the number is less than or equal to 5 segments, then all video segments are synthesized; if the number of multiple video segments is greater than the above preset number, for example, if the number is greater than 5 segments, then the first and earliest video segment is selected, the last video segment is the last and latest video segment of the video compilation file, and the remaining 3 video segments are selected evenly from the remaining video segments.
[0050] <Add Watermark> In some embodiments, to improve the viewing experience of video highlight files, background music can be automatically overlaid during the synthesis of the video highlight files, and a start-up watermark can be added to the video highlight files. To further improve the viewing experience of video highlight files, the controller, when performing the process of splicing and synthesizing a specified number of motion image materials to generate a video highlight file recording a moving target within a preset recording duration, is further configured as follows: S141, splicing and synthesizing a specified number of motion image materials to obtain a video file recording a moving target within a preset recording duration. S142, acquiring a preset audio file and a start-up watermark, the start-up watermark being used to identify the product information of the display device. S143, overlaying the audio file, the start-up watermark, and the video file to generate a video highlight file recording a moving target within a preset recording duration. First, a specified number of motion image materials are spliced and synthesized; the motion image materials can be images or videos, resulting in a video file. The controller has multiple preset audio files, and one of the audio files is randomly selected to be synthesized with the video file. Simultaneously, the launch watermark is acquired and added to the video file. To avoid obscuring the video content, the launch watermark can be added to the lower right corner of the screen; the actual placement can be set according to user preference. The launch watermark is used to identify the product information of the display device.
[0051] Figure 9 This is a schematic diagram illustrating a launch watermark according to one or more embodiments of this application. The launch watermark may include a title watermark and a product watermark, see [link / reference]. Figure 9In (a), the title watermark "My Family Diary, April 30, 2020" appears at the beginning of the video playback; the watermark disappears after a few seconds. See also Figure 9 In section (b), a product watermark reading "XX Social TV, Meet Instantly, Gather on One Screen" is added to the lower right corner of the video file. This watermark remains constantly displayed on the video screen. By overlaying the audio file, the watermark, and the video file, a video compilation file recording the movement of a target within a preset recording duration can be generated. To provide users with more operational options, motion image footage captured by the camera can be stored and displayed on the monitor. Users can then perform deletion, editing, and other functions based on the displayed motion image footage.
[0052] In some embodiments, to facilitate user operation on multiple motion image clips, the controller is further configured to: acquire each motion image clip captured by the camera when the camera begins capturing motion image clips of a moving target in response to a video recording start command; generate an image clip list interface in the user interface, displaying each motion image clip in chronological order. The user interface displays a video recording start entry; after the user triggers the video recording start entry, the image clip list interface is displayed on the monitor. The image clip list interface is used to display motion image clips and video highlight files. Each motion image clip captured by the camera is displayed in the image clip list interface. In some embodiments, the image clip list interface displays each motion image clip sequentially according to the start time of its capture. Users can operate on the motion image clips displayed in the image clip list interface to achieve different functions, such as sharing to social media, deleting selected recordings, clearing recordings, and turning off video recording. An operation prompt "Press the menu button to turn off the function or share / delete the video" appears in the upper right corner of the image clip list interface; users can perform the actions indicated by the operation prompt to achieve the above interactive functions.
[0053] In some embodiments, to facilitate user operations on the motion image materials displayed in the image material list interface, the controller is further configured to perform the following steps: Step 151: Receive an interactive function invocation command generated when the user performs an operation according to the operation prompts. Step 152: In response to the interactive function invocation command, present a functional interactive overlay in the image material list interface, the functional interactive overlay including multiple functional controls. Step 153: In response to a target control command generated when the target functional control is triggered, execute the target operation corresponding to the target functional control. The image material list interface does not display the interactive function entry point when displaying content normally. If the user wants to implement a certain interactive function, they need to first invoke the interactive function entry point; that is, the user can invoke the interactive function entry point by triggering the menu button via the remote control according to the operation prompts. When the user performs an operation according to the operation prompts, an interactive function invocation command is generated. The controller invokes the functional interactive overlay as the interactive function entry point and displays it on the display. The functional interactive overlay covers the bottom of the image material list interface in the form of an overlay. When the functional interactive overlay is invoked and displayed, the image material list interface does not disappear.
[0054] In some embodiments, Figure 15 This is a schematic diagram illustrating the watermarking of a video compilation file played according to one or more embodiments of this application, with reference to... Figure 15 The controller, in response to a detected target user, receives video clips captured by the camera; and generates a video compilation file containing a first watermark and a second watermark based on the video clips. The first watermark disappears after a first display time period following the start of playback of the video compilation file on the user interface, while the second watermark updates with the system time at the time the video clips were recorded during playback on the user interface. Figure 16 As shown, Figure 16 This is a schematic diagram illustrating the watermarking during playback of a video compilation file according to one or more embodiments of this application. For example, video compilation 1 includes a first watermark and a second watermark. The first display duration can be configured to 3 seconds. When video compilation 1 is played on the user interface of a display device, the playback screen includes the first watermark and the second watermark within 3 seconds. After 3 seconds, the playback screen of video compilation 1 no longer displays the first watermark, but only the second watermark. The second watermark displays the system time when the video segment was recorded. For example, the second watermark can display the system time when the playback screen of video compilation 1 was recorded, so that the user can know the date and time when the current playback progress of compilation file 1 occurred.
[0055] In some embodiments, the controller receives a video clip captured by a camera in response to a detected target user. Specifically, if the controller determines that the video clip is the first one of the day, it adds a first watermark and a second watermark to the video clip; otherwise, the controller adds a second watermark to the video clip. For example, after the controller of the display device identifies a target user, it starts recording video. If it determines that the currently recorded video clip is the first video clip of the day, the controller adds a first watermark and a second watermark to the currently recorded video clip. The first watermark may, for example, include a cover image and the system date; the second watermark may, for example, include timestamp information, i.e., the system date and the system time, where the system time is the system time of the currently recorded video clip. The second watermark can be dynamically displayed as the user interface refreshes. If the controller determines that the currently recorded video clip is not the first video clip of the day, the controller only adds a second watermark to the currently recorded video clip. The second watermark may, for example, include timestamp information, i.e., the system date and the system time, where the system time is the system time of the currently recorded video clip. The second watermark can be dynamically displayed as the user interface refreshes.
[0056] Figure 17 This is a watermark illustration for playing video compilation files according to one or more embodiments of this application. In some embodiments, the video compilation files generated by the display device of this application further include a third watermark. The controller, in response to a detected target user receiving a video segment captured by a camera, specifically includes adding a first watermark, a second watermark, and a third watermark to the video segment when the controller determines that the video segment is the first one of the day; otherwise, the controller adds a second watermark and a third watermark to the video segment. For example, after the controller of the display device identifies a target user, it starts recording video. When it determines that the currently recorded video segment is the first video segment of the day, the controller adds a first watermark, a second watermark, and a third watermark to the currently recorded video segment. The first watermark may, for example, include a cover image and a system date; the second watermark may, for example, include timestamp information, i.e., the system date and system time, where the system time is the system time of the currently recorded video segment. The second watermark can be dynamically displayed as the user interface refreshes; the third watermark may, for example, include brand logo information, such as... Figure 19 As shown, Figure 19 This is a watermark illustration for playing video compilation files according to one or more embodiments of this application.
[0057] When the controller determines that the currently recorded video clip is not the first video clip of the day, it only adds the second and third watermarks to the currently recorded video clip. The second watermark can be implemented, for example, by including timestamp information, i.e., the system date and system time, where the system time is the system time of the currently recorded video clip. The second watermark can be dynamically displayed as the user interface refreshes. The third watermark can be implemented, for example, by including brand logo information, such as... Figure 18 As shown, Figure 18 This is a watermark illustration for playing video compilation files according to one or more embodiments of this application.
[0058] <Sharing> The interactive overlay includes several functional controls, such as "Share to Friends and Family," "Delete Selected Record," "Clear All Records," and "Turn Off This Function." Users can activate the corresponding control via remote control to perform an interactive function on the motion image footage. The "Share to Friends and Family" control performs the sharing operation; the "Delete Selected Record" control deletes a motion image or video compilation file; the "Clear All Records" control clears all displayed content in the image footage list; and the "Turn Off This Function" control turns off the video recording function of the display device.
[0059] Figure 10 This is a schematic diagram of the interactive interface for implementing the sharing to family and friends circle function according to one or more embodiments of this application. See also Figure 10 In step (a), if a user wants to share a motion graphics file or video highlight file to their WeChat Moments, after selecting the file to be shared, they use the remote control to select the "Share to Friends & Family" control as the target function control. When the user clicks the "Share to Friends & Family" control again using the remote control, the display screen will then redirect to the sharing interface, as shown below. Figure 10 As shown in (b), the sharing interface allows users to share a sports video clip or video highlight file to their WeChat Moments. If a user wants to delete a sports video clip or video highlight file, after selecting the file to be shared, they can use the remote control to select the "Delete Selected Record" control as the target function control. The user then clicks the "Delete Selected Record" control again using the remote control, at which point the display will redirect to the deletion interface, where the sports video clip or video highlight file can be deleted. The user can then trigger the "Delete" control based on the deletion interface to perform the deletion operation, and a "Deleted" message will be displayed on the deletion interface.
[0060] In some embodiments, if a user wants to clear all motion image footage or generated video compilation files captured by the camera, they can select the "Clear All Recordings" control as the target function control using the remote control. The user then clicks the "Clear All Recordings" control again using the remote control, at which point the display screen will switch to the clearing interface. In the clearing interface, all motion image footage or video compilation files displayed in the image footage list will be cleared. The user can then trigger the "Clear" control based on the clearing interface to perform the clearing operation, and a message "All home security recordings have been cleared" will be displayed on the clearing interface.
[0061] In some embodiments, if a user wants to turn off the video recording function of the display device, they can select the "Turn off this function" control as the target function control via the remote control. When the user clicks the "Turn off this function" control again via the remote control, the display interface will jump to the shutdown interface, where the video recording function of the display device can be turned off. The user can execute the shutdown operation by triggering the "Turn off" control based on the shutdown interface, and a "Turn off" message will be displayed on the shutdown interface. After the video recording function of the display device is turned off, previously shared videos can still be viewed by clicking the share link. If the user wants to turn the function back on, they can continue to view the motion image footage from the camera and the generated video compilation files.
[0062] In some embodiments, to facilitate user viewing of each moving image clip in the image clip list interface, a time watermark can be added to each moving image clip when it is displayed in the image clip list interface. Therefore, the controller, when displaying each moving image clip in chronological order in the image clip list interface, is further configured to perform the following steps: Step 161: Obtain the start acquisition time of each moving image clip. Step 162: Generate a time watermark including the start acquisition time, with each time watermark corresponding to a moving image clip. Step 163: Display each moving image clip and its corresponding time watermark in the image clip list interface in chronological order of their start acquisition times, with the time watermark displayed at the bottom or top of the corresponding moving image clip.
[0063] To identify each segment of moving image footage, a time watermark can be used. A time watermark is generated based on the start time of each moving image segment's capture, and each segment has a unique time watermark. Each moving image segment is displayed in the image footage list interface in chronological order of its start time, and similarly, each time watermark is also displayed in chronological order of its start time, ensuring a one-to-one correspondence between the time watermark and the moving image. The time order can be from most recent to furthest from the current time, so that the most recently captured moving image is displayed at the top of the image footage list. The display position of the time watermark can be determined according to the actual usage; for example, it can be displayed at the bottom, top, left, or right of the corresponding moving image.
[0064] In some embodiments, since both the motion image footage captured by the camera and the video compilation files synthesized by the controller are displayed in the image footage list interface, a time watermark can be added to the video compilation files to identify them. Therefore, when adding a time watermark to the video compilation files, the controller is further configured to perform the following steps: Step 171: Obtain the generation time of each video compilation file. Step 172: Create a generation time watermark including the generation time. Step 173: Display each video compilation file and its corresponding generation time watermark in the image footage list interface according to the chronological order of their generation times. The generation time watermark is displayed at the bottom or top of the corresponding video compilation file. Step 174: Delete the motion image footage from the generated video compilation files. To identify each video compilation file, a generation time watermark can be used. The generation time watermark is a watermark generated based on the generation time of each video compilation file, and each video compilation file has an independent corresponding generation time watermark.
[0065] Each video highlight file is displayed in the image material list interface in chronological order of its creation time. Similarly, each creation time watermark is also displayed in the image material list interface in chronological order of its creation time, ensuring a one-to-one correspondence between the creation time watermark and the video highlight file. The chronological order can be from most recent to furthest from the current time, so that the most recently created video highlight files are displayed at the top of the image material list interface, and that video highlight files are displayed before moving images.
[0066] In some embodiments, background music can be added to the video compilation file, and the camera does not record audio data when recording the video clips. After a preset time period, i.e., after 22:00 every day, if the display device is still powered on, or after the display device is powered on the next day, the recorded video clips will be automatically combined into a video compilation file with added background music. When recording the video clips, the camera only needs to record image data and does not record audio data.
[0067] <Push notification> To facilitate timely reminders to users that the controller automatically retrieves and synthesizes video clips from cameras when the user is not at home, the video clips synthesized that day need to be pushed to the user.
[0068] Therefore, when pushing video highlight files to users, the controller is further configured to perform the following steps: generate a push notification based on the video highlight file, including push content and operation prompts; and display the push notification on the system homepage interface displayed on the monitor when the display device is started. Since the video highlight file is generated from motion image footage of moving targets collected within a preset recording duration for the day, the user may not have started the display device within that preset recording duration. Therefore, the video highlight file can be pushed to the user the first time they start the display device after its generation. That is, a push notification is generated based on the video highlight file and displayed on the system homepage interface displayed on the monitor when the user first starts the display device.
[0069] Figure 11 This is a schematic diagram of an interface for displaying push notifications according to one or more embodiments of this application. See also: Figure 11 The push notification includes push content and operation prompts. Push content may include "Your adorable pet's exclusive Vlog has been generated, come and check it out!", and operation prompts may include "Press the menu button to view details." Users can view the pushed video highlight file by triggering the menu button using the remote control. In some embodiments, the video highlight file is pushed only once, and only when the user first turns on the display device after the video highlight file is generated. For example, if the preset recording duration is 6:00-18:00, then at 18:00, the controller controls the camera to stop capturing motion image footage and simultaneously stitches together a specified number of motion image clips to obtain the video highlight file. After 18:00, such as when the user first turns on the display at 19:00, the video highlight file will be displayed on the system homepage as a push notification, prompting the user to view and record the wonderful moments of their pet or baby's day.
[0070] As can be seen, the display device provided in this application embodiment has a display screen configured to present a user interface with a video recording start entry, which is used to activate the video recording function of the display device. The controller receives a video recording start command generated when the video recording start entry is triggered, instructing the camera to collect motion image material of a moving target at a preset acquisition frequency within a preset recording duration. At the end of the preset recording duration, a specified number of motion image materials are stitched together to generate a video compilation file recording the movement of the moving target within the preset recording duration. Therefore, the display device provided in this application embodiment allows the controller to actively call the camera to collect motion image material of the moving target in real time without requiring real-time user operation after the user activates the video recording function. After completing the image acquisition, the controller synthesizes a video compilation file, allowing the user to understand the movement of the moving target within the preset recording duration based on the video compilation file, providing a good user experience.
[0071] <Video Highlights File> In some embodiments, Figure 12 This is a schematic diagram of a video compilation file for a display device according to one or more embodiments of this application. (Reference) Figure 12 The user interface includes multiple video highlight poster controls, and the bottom of each video highlight poster control includes prompt text indicating the generation date. For example, the video highlights can be implemented as multiple video highlights from a single day, meaning that the video highlights are all generated on the same day, but the content of the video highlights is different; in other embodiments, the video highlights can also be implemented as video highlights from different dates, meaning that each video highlight is generated on a different date.
[0072] In some embodiments, the display device controller controls the camera to record video clips and generates a video compilation file based on the acquired video clips. Specifically, the controller records video clips no longer than a first preset time length within a preset time period; after the preset time period, or after the device is powered on for the first time on the day following the preset time period, the controller generates a video compilation file based on the acquired video clips. For example, during a preset time period, such as 00:00-22:00 every day, if the controller detects that the video compilation switch is on and the camera is on (i.e., the camera is raised), the controller automatically detects a child in front of the display device and automatically records a video clip no longer than the first preset time length, such as 6 seconds, each time a child is detected. After the preset time period, i.e., after 22:00 every day, if the display device is still powered on, or after the display device is powered on the next day, the recorded video clips are automatically combined into a video compilation file. The file is stored in a designated directory on the NAS (Network Attached Storage) and pushed to the user via notification. The user can click to view or view and download the target user's compilation stored on the NAS via a mobile device.
[0073] In some embodiments, after the device is powered on for the first time on the day following a preset time period, the display device controller generates a video compilation file based on multiple acquired video clips. Specifically, this includes generating the video compilation file based on multiple acquired video clips after a second preset time length following the first power-on on the day following the preset time period. For example, the target user detection service of the display device can be configured to include power-on startup and scheduled automatic startup. If configured to start the target user detection service on power-on, the task of synthesizing the target user video clips into a video compilation file can be set to start after a preset second time length, such as 5 minutes. By detecting and synthesizing after 5 minutes, it is possible to avoid the system lag and slowdown caused by too many applications starting up after power-on and occupying system resources.
[0074] In some embodiments, if the TV display device is not connected to the NAS, a specific button on the login interface of Application A will be grayed out, indicating that the video highlight switch is off, and the user interface will display a prompt message. In some embodiments, video highlight files generated by the display device can be stored on the NAS, and the display device, mobile terminal, or home private cloud can play the video highlight files by accessing the NAS. The video highlight files generated by the display device are stored on the NAS, and can be viewed and played through Application A, or through the family shared directory in the home private cloud space, or through a mobile application. In some embodiments, the controller controls the push of video highlight files stored in the NAS to the display device, mobile terminal, or home private cloud, and the user can download and play the video highlight files.
[0075] <Solution Software Architecture> In some embodiments, application architecture A includes: a camera detection module, a device settings module, a switch module, a recording and compositing service module, a NAS module, and an application module. The recording and compositing service module includes a face detection module, a video recording module, and a video compositing module. The face detection module detects whether a target user, such as a cute child, is present in the preview frame; the video recording module records video when a cute child is detected; the video compositing module synthesizes video clips and video sources to generate a compilation of cute children, i.e., a video compilation file. The NAS module stores the output of the recording and compositing service module. For example, it saves the recorded video file and the synthesized video compilation file to the relevant directory on the NAS. The application module includes a compilation browsing interface module and a menu module. The compilation browsing interface module displays the video compilation files stored in the NAS module, and the menu module in the compilation browsing interface allows users to share the video compilation files to friends and family, delete them, or perform other operations. The camera detection module detects the camera's occupancy status and outputs the detection results to the recording and compositing service module; the overall device settings module configures the camera and outputs the settings to the recording and compositing service module; the switch module controls the A application's on / off state and outputs the settings to the recording and compositing service module, and can also determine whether to enable the face detection function for target user identification, i.e., target user identification; the switch module also serves as the entry point for the A application, for example, enabling baby detection and capturing baby video clips only after the baby detection switch is turned on; in some embodiments, video compilation files can be played by launching the media center.
[0076] <Smart Terminal Solution> In some of the embodiments described above, the process of activating the video recording function of the display device is implemented by a controller within the display device. However, in other embodiments, the smart terminal connected to the display device can also be used to activate the video recording function. On the smart terminal side, it supports activating the video recording function of the display device, browsing and editing motion picture materials, and viewing and sharing video compilation files.
[0077] To implement the process of a smart terminal activating the video recording function of a display device, some embodiments of this application provide a smart terminal 300, including a display 320 and a processor 310 interconnected. The display 320 is configured to present a terminal user interface with a video recording activation entry. This entry is used to activate the video recording function, which records motion images and generates a video compilation file within a preset recording duration. The video recording function is configured in the controller of the display device. The processor 310 is connected to the controller 250 in the display device. The processor contains a specified application program used to access the terminal user interface and display it on the display 320. The processor receives a video recording activation command generated when the user operates the smart terminal and sends this command to the controller in the display device. The controller then activates the video recording function of the display device, i.e., actively calls the camera to capture motion image material of moving targets and synthesize a video compilation file in real time.
[0078] In some embodiments, when executing the interactive method for generating a video compilation file, the processor is configured to perform the following steps: S21, receiving a video recording function activation command generated when a specified application is triggered. To enable the video recording function of the display device, a specified application needs to be configured within the processor of the smart terminal, and the specified application is displayed on the terminal's home page. The specified application provides an entry point for activating the video recording function. The user manually triggers the specified application, generating a video recording function activation command, and the processor can then invoke the entry point for activating the video recording function according to the video recording function activation command. S22, responding to the video recording function activation command, displaying a terminal user interface with the video recording activation entry point on the display. After receiving the video recording function activation command, the processor displays the terminal user interface on the display 320 of the smart terminal, and displays the video recording activation entry point in the terminal user interface. In some embodiments, Figure 13This is a schematic diagram of a terminal user interface according to one or more embodiments of this application. After a user triggers a specified application, the terminal user interface is displayed on the screen, and a video recording startup entry, such as "A Day in the Life of a Cute Pet," is presented in the terminal user interface. When the user clicks "A Day in the Life of a Cute Pet," a video recording function startup interface is generated. This page displays an "Start" control, and when the user triggers the "Start" control, the video recording function is enabled.
[0079] S23. Receive the video recording start command generated by the trigger video recording start entry, and send the video recording start command to the controller. The video recording start command is used to instruct the controller to call the camera in the display device to collect motion image materials of the moving target within a preset recording time and according to a preset acquisition frequency, and to stitch together a specified number of motion image materials to generate a video compilation file recording the moving target within a preset recording time.
[0080] The user triggers the video recording start entry, i.e., the "Start" control, displayed on the terminal user interface, thereby generating a video recording start command. The processor then sends the video recording start command to the controller in the display device. Upon receiving the command, the controller activates the display device's video recording function, which involves executing the steps of calling the camera on the display device to capture motion image footage of a moving target at a preset acquisition frequency within a preset recording duration, and stitching together a specified number of motion image clips to generate a video compilation file recording the moving target for the preset recording duration. The steps of the controller executing the video recording function can be referred to the display device-based section of the aforementioned embodiment, and will not be repeated here.
[0081] In some embodiments, after the smart terminal activates the video recording function of the display device, a video list interface will be displayed on the smart terminal's screen. When displaying the video list interface, the processor is further configured to perform the following steps: Step 241, in response to a video recording activation command, display the video list interface on the screen. Step 242, retrieve motion image footage and video highlight files stored in the controller, and display the motion image footage and video highlight files in the video list interface. After receiving a video recording activation command generated when the user triggers the video recording activation entry, the processor sends the video recording activation command to the controller to activate the video recording function of the display device, and simultaneously switches the display content of the smart terminal's screen according to the video recording activation command, that is, switches the terminal user interface displayed on the smart terminal's screen to the video list interface. The video list interface is similar to the image footage list interface in the display device, both used to display motion image footage and video highlight files. The motion image footage captured by the camera and the resulting video compilation file are stored in the controller. The controller displays the motion image footage and the compiled video compilation file in the image footage list interface, while simultaneously sending them to the processor on the smart terminal. The processor then displays the motion image footage and the compiled video compilation file in the video list interface. In other words, the content displayed in the video list interface is identical to that displayed in the image footage list interface.
[0082] In some embodiments, if a user activates the video recording function of the display device for the first time, it means that the camera has not captured any motion image material and therefore no video compilation file has been generated. As a result, no content is displayed in the video list interface. Figure 14 This is a schematic diagram of a video list interface according to one or more embodiments of this application. When a user first activates the video recording function, the content displayed in the video list interface is as follows: Figure 14 As shown in (a). At this time, the video list interface displays the message "No pets found yet." In some embodiments, if the user is not starting the video recording function of the display device for the first time, but for the second or subsequent times, it indicates that the camera has previously captured motion image footage and may have generated video compilation files. In this case, the video list interface will display the motion image footage historically captured by the camera and the video compilation files historically generated by the controller, such as... Figure 14 The video list interface is shown in (b). The display order of motion graphics and video highlight files in the video list interface is the same as that in the image material list interface, and will not be repeated here.
[0083] In some embodiments, users can personalize the motion graphics and video highlight files displayed in the video list interface to achieve different functions, such as sharing and downloading. To this end, when a user performs a personalized operation based on the video list interface, the processor is further configured to perform the following steps: Step 251: Display personalized operation controls at the bottom of each motion graphics and video highlight file displayed in the video list interface. Step 252: In response to a personalized operation instruction generated by triggering a target personalized operation control, execute the target personalized operation corresponding to the target personalized operation control. Personalized operation controls are displayed at the bottom of each motion graphics and video highlight file in the video list interface. In some embodiments, the personalized operation controls include a "share" control and a "download" control. The "share" control can perform the operation of sharing a motion graphics or video highlight file to another platform, and the "download" control is used to perform the operation of downloading a motion graphics or video highlight file to the local machine. When a user triggers a personalized operation control, a personalized operation instruction is generated, and the processor can execute the corresponding personalized operation based on the personalized operation instruction, such as sharing to another platform or downloading to the local machine.
[0084] In some embodiments, to facilitate family members to personalize the motion graphics and video highlight files displayed in the video list interface via smart terminals, the smart terminal can authorize other smart terminals to operate the video list interface. When the smart terminal authorizes other smart terminals to personalize the video list interface, the processor is further configured to perform the following steps: Step 261: Receive a device sharing instruction generated when the device sharing control is triggered. The device sharing instruction is used to establish an association with the peer smart terminal. Step 262: Send the device sharing instruction to at least one peer smart terminal to establish an association between the local smart terminal and at least one peer smart terminal. The device sharing instruction is used to instruct the peer smart terminal to perform personalized operations on the video highlight files according to the association. The terminal user interface displays a "Settings" entry. When the user triggers the "Settings" entry, the terminal settings interface is displayed on the smart terminal's screen. The terminal settings interface is configured with a device sharing control. When the user triggers the device sharing control in the terminal settings interface, a device sharing instruction is generated. The processor of the local smart terminal sends the device sharing instruction to the peer smart terminal that needs to personalize the video list interface. Once the remote smart terminal receives the device sharing instruction, it can establish a connection with the local smart terminal, enabling the remote smart terminal to operate the video list interface.
[0085] The operation steps and displayed pages for the remote user and the local user on the remote smart terminal are identical. The only difference is that the remote user cannot enable or disable the video recording function on the remote smart terminal. If the local user has not enabled the video recording function, the video list interface will not display any content. In this case, if the remote user triggers the video recording activation entry on the remote smart terminal's user interface, a prompt will appear, such as "This function needs to be enabled by an administrator to view," where the administrator refers to the local user. In other words, only after the local user enables the video recording function on their local smart terminal can the remote user perform personalized operations on motion graphics and video compilation files on the remote smart terminal.
[0086] As can be seen, some embodiments of this application provide a smart terminal in which the display is configured to present a terminal user interface with a video recording start entry, which is used to activate the video recording function of the display device. A processor is connected to a controller in the display device and is configured to: receive a video recording function activation command generated when a specified application is triggered; present the terminal user interface with the video recording start entry on the display; receive a video recording start command generated when the video recording start entry is triggered and send it to the controller; the video recording start command instructs the controller to call the camera in the display device to collect motion image materials of a moving target at a preset acquisition frequency within a preset recording duration; and stitch together a specified number of motion image materials to generate a video compilation file recording the movement of the moving target within the preset recording duration. Therefore, the smart terminal provided in this application allows users to activate the video recording function of the display device through the smart terminal, enabling the display device to collect motion image materials of a moving target and synthesize a video compilation file without real-time user operation. Users can then obtain information about the movement of the moving target within the preset recording duration from the video compilation file, providing a good user experience.
[0087] Some embodiments of this application also provide an interactive method for generating a video compilation file, applied to a display device. The method includes: S11, receiving a video recording start command generated when the video recording start entry is triggered, the video recording start command instructing the camera to collect motion image materials of a moving target at a preset acquisition frequency within a preset recording duration, the video recording start entry being used to start the function of recording motion images and generating a video compilation file through video recording within the preset recording duration, the moving target referring to a target that needs to have its motion images recorded through video recording within the preset recording duration to generate a video compilation file; S12, at the end of the preset recording duration, acquiring several motion image materials of the moving target collected by the camera within the preset recording duration; S13, stitching together a specified number of motion image materials to generate a video compilation file recording the moving target within the preset recording duration.
[0088] Some embodiments of this application also provide an interactive method for generating video compilation files, applied to a smart terminal. The method includes: S21, receiving a video recording function activation command generated when the specified application is triggered; S22, in response to the video recording function activation command, presenting a terminal user interface with a video recording activation entry on the display, the video recording activation entry being used to activate a video recording function that records motion images and generates a video compilation file within a preset recording duration, the video recording function being configured in the controller of the display device; S23, receiving a video recording activation command generated when the video recording activation entry is triggered, sending the video recording activation command to the controller, the video recording activation command being used to instruct the controller to call the camera in the display device to collect motion image materials of a moving target within a preset recording duration according to a preset acquisition frequency, and to stitch together a specified number of motion image materials to generate a video compilation file recording the moving target within the preset recording duration.
[0089] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the discussion in some embodiments above is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of the embodiments suitable for specific application considerations.
Claims
1. A display device, characterized in that, include: monitor, Camera, The controller is configured as follows: In response to a video recording start command, the camera is controlled to collect motion image material of the moving target at a preset acquisition frequency until the end time of the preset recording duration is reached. Obtain the total number of motion image materials captured by the camera within the preset recording duration; When the total number of motion image materials is greater than a specified number, the start acquisition time of each motion image material segment is obtained; According to the time period to which the start acquisition time belongs, the start acquisition time corresponding to each segment of motion image material is divided into multiple material acquisition time periods; wherein, each material acquisition time period includes multiple motion image materials; Within each of the material acquisition periods, a target number of motion image materials are selected as target motion image materials, and the sum of the target numbers selected in each of the material acquisition periods is equal to the specified number; The target motion image materials are stitched together to generate a video compilation file that records the moving target within a preset recording time. The controller is also configured to: Within each of the material acquisition periods, a target number of motion image materials are selected as target motion image materials. Then, in chronological order, the first target motion image material is selected and a first watermark and a second watermark are added, and the remaining target motion images are added with a second watermark. The first watermark disappears after the first display time begins when the video compilation file is played on the user interface, while the second watermark displays the system time when the video clip was recorded.
2. The display device according to claim 1, characterized in that, The camera is configured as follows: Receive the camera call command generated by the controller in response to the video recording start command; In response to the camera call command, starting from the initial moment of the preset recording duration, motion image material of the moving target is acquired at a preset acquisition frequency; When the preset recording duration ends, the acquisition of motion image material of the moving target is terminated.
3. The display device according to claim 2, characterized in that, The controller is configured to: Starting from the initial moment of the preset recording duration, the preview image captured by the camera is obtained; Image recognition is performed on the preview screen to determine whether the moving target exists in the preview screen; If the moving target is present in the preview screen, the camera is invoked to capture motion image material of the moving target at a preset acquisition frequency.
4. The display device according to claim 3, characterized in that, The controller is configured to: When the moving target is present in the preview screen, the camera is invoked to perform a process of acquiring motion image material of the moving target.
5. The display device according to claim 3, characterized in that, The preset acquisition frequency includes a preset acquisition duration and a preset acquisition interval duration; The controller is configured to: Starting from the moment when the moving target is determined to exist in the preview image, the first segment of motion image material of the moving target is collected according to the preset collection duration; After the preset acquisition interval, the second segment of motion image material of the moving target is acquired according to the preset acquisition duration.
6. The display device according to claim 2, characterized in that, The controller is configured to: In response to the video recording start command, the current operating status of the camera is obtained; If the camera is currently in an unused state, a camera invocation command is generated, which is used to invoke the camera to acquire motion image material.
7. The display device according to claim 1, characterized in that, The controller is configured to: When the camera starts acquiring motion image material of a moving target in response to a video recording start command, each segment of motion image material acquired by the camera is obtained; The user interface generates an image material list interface, displaying each segment of the motion image material in chronological order.
8. The display device according to claim 7, characterized in that, The image material list interface displays operation prompts; The controller is configured to receive an interactive function invocation command generated when a user performs a corresponding operation based on the operation prompts; In response to the interactive function activation command, a functional interactive overlay is presented in the image material list interface, the functional interactive overlay including multiple functional controls; In response to the target control command generated when the target function control is triggered, the target operation corresponding to the target function control is executed.
9. The display device according to claim 7, characterized in that, The controller is configured to: Obtain the start acquisition time of each segment of the motion image material; A time watermark including the start acquisition time is generated, and the time watermark corresponds one-to-one with the motion image material; according to the time sequence of the start acquisition time, each piece of motion image material and its corresponding time watermark are displayed in the image material list interface, and the time watermark is displayed at the bottom or top of the corresponding motion image material.
10. The display device according to claim 1, characterized in that, The controller is configured to: Obtain the total number of motion image materials captured by the camera within a preset recording time; If the total number of materials is less than or equal to the specified number, the motion image materials of the total number of materials are spliced together in chronological order; If the total number of materials is greater than the specified number, then select the specified number of target motion image materials from the motion image material set; The specified number of target motion image materials are stitched together in chronological order to generate a video compilation file that records the moving target within a preset recording duration.
11. The display device according to claim 1, characterized in that, The controller is configured to: The specified number of motion image materials are stitched together to obtain a video file that records the moving target within a preset recording duration. Obtain a preset audio file and a start-up watermark, wherein the start-up watermark is used to identify the product information to which the display device belongs; The audio file, the start-up watermark, and the video file are overlaid to generate a video compilation file that records the moving target within a preset recording duration.
12. The display device according to claim 1, characterized in that, The controller is configured to: Obtain the generation time of each of the aforementioned video compilation files; Create a generation time watermark that includes the generation time; According to the time sequence of the generation time, each video compilation file and its corresponding generation time watermark are displayed in the image material list interface, with the generation time watermark displayed at the bottom or top of the corresponding video compilation file; Delete the motion graphics footage used to generate the video compilation file.
13. The display device according to claim 12, characterized in that, The controller is configured to: Create video record tags, which are used to identify video compilation files generated from video records; Add the video recording marker to the thumbnail of the video compilation file displayed in the image material list interface.
14. The display device according to claim 1, characterized in that, The controller is configured to: A push notification is generated based on the video compilation file, and the push notification includes push content and operation prompts; When the display device is started, the push notification is displayed on the system homepage interface shown on the display.
15. The display device according to claim 1, characterized in that, The controller is configured to: In response to a device startup command generated when a user starts the display device, a system home screen is displayed on the display, and the system home screen displays the target application. In response to a trigger command generated when the target application is activated, a user interface is displayed on the display, which shows a video recording startup entry.
16. The display device according to claim 2, characterized in that, The controller is configured to: In response to the start command generated when the video recording start entry is triggered, a function effect display interface is presented on the display, and a confirmation start entry is displayed on the function effect display interface; In response to the confirmation command generated by triggering the confirmation start entry, the display of the function effect display interface is canceled on the display, and a video recording start command is generated.
17. The display device according to claim 1, characterized in that, The controller is configured to: When a user is within the monitoring range of the display device, the controller controls the camera to perform face detection; Based on the face detection, it is determined whether the user is younger than a preset age. If the user is younger than the preset age, the user is determined to be the target user, and the controller receives video clips captured by the camera. Otherwise, the controller controls the camera to continue face detection.
18. The display device of claim 1, further comprising network-attached memory, The controller is configured to: The video compilation file is stored in a network-attached storage device.
19. The display device of claim 1, wherein the controller is configured to: Background music is added to the video compilation file, and the camera does not record audio data when recording the video clips.
Citation Information
Patent Citations
Interaction method for generating video collection file, display equipment and intelligent terminal
CN111787379A
Display device and method for generating video collection file
CN112351323A
