Doorbell-based recall video generation method and related apparatus

Abstract

The application provides a doorbell-based recall video generation method and related device, the method comprising: if a target recall object exists in a separate album and a target video exists in the separate album, sending the target video to an electronic device; if the target video does not exist, obtaining a candidate video from the separate album, and if the candidate video corresponds to a recall time period completely including a target recall time period, cutting the target video from the candidate video according to the target recall time period and sending the target video to the electronic device; if not completely included, cutting a usable video from the candidate video; obtaining a video corresponding to a to-be-obtained time period from a comprehensive album; generating a target video according to the usable video and the video corresponding to the to-be-obtained time period; and sending the target video to the electronic device; if the separate album does not exist, obtaining the target video from the comprehensive album according to a feature image and a target recall time period; and sending the target video to the electronic device. The data utilization rate and the data processing efficiency of the server can be improved.

Description

Technical Field

[0001] This application belongs to the field of general data processing technology in the Internet industry, and specifically relates to a method and related apparatus for generating memory videos based on a doorbell. Background Technology

[0002] Most current doorbells do not include an alarm sound function but also come with a monitoring function. This means that users can view outdoor surveillance footage through an indoor display device or an electronic device connected to the doorbell, giving current smart doorbells both monitoring and anti-theft capabilities. However, these functions are still relatively basic and cannot provide users with more personalized services based on the acquired data. Summary of the Invention

[0003] This application provides a method and related apparatus for generating memory videos based on doorbells, which, based on existing data, provides users with the function of viewing memory videos, improves the utilization rate of the same data and the data processing efficiency of the server, and enhances the user experience.

[0004] In a first aspect, embodiments of this application provide a method for generating a memory video based on a doorbell, applied to a server of a doorbell system. The doorbell system includes the server, a smart doorbell, and an electronic device, which are communicatively connected. The method includes:

[0005] Obtain a video viewing request from the electronic device, the video viewing request including a target time period and a target object of memory;

[0006] Determine whether the target memory object exists in a separate video album, wherein the memory objects in the memory videos included in the separate video album include the target memory object;

[0007] If the individual video set exists, it is determined whether the target video exists in the individual video set, and the memory period corresponding to the target video matches the target memory period.

[0008] If the target video exists, then the target video is sent to the electronic device;

[0009] If the target video does not exist, alternative videos are obtained from the individual video collection. The memory period corresponding to the alternative video has the highest matching degree with the target memory period, and it is determined whether the memory period corresponding to the alternative video completely includes the target memory period.

[0010] If all are included, the target video is extracted from the candidate videos according to the target recall period and sent to the electronic device;

[0011] If not fully included, a usable video is extracted from the candidate videos, and the memory period corresponding to the usable video is included in the target memory period; the time period that does not include the memory period corresponding to the usable video in the target memory period is determined as the time period to be acquired; the video corresponding to the time period to be acquired is acquired from the comprehensive video collection, which includes all outdoor images from the smart doorbell; the target video is generated based on the usable video and the video corresponding to the time period to be acquired; the target video is sent to the electronic device;

[0012] If the individual video set does not exist, a feature image of the target memory object is obtained; the target video is obtained from the integrated video set based on the feature image and the target memory period; and the target video is sent to the electronic device.

[0013] Secondly, embodiments of this application provide a method for generating a memory video based on a doorbell, applied to an electronic device in a doorbell system. The doorbell system includes a server, a smart doorbell, and the electronic device, which are communicatively connected. The method includes:

[0014] Send a request to the server to view the memory video, the request including the target memory period and the target memory object;

[0015] Acquire and play a target video from the server, wherein the memory segment corresponding to the target video matches the target memory segment; if the target memory object exists in a separate album, and if the separate album contains a video whose memory segment matches the target memory segment, then the target video indicates the video in the separate album whose memory segment matches the target memory segment, and the memory object in the memory videos included in the separate album includes the target memory object; if the separate album does not contain a video matching the target memory segment, and the memory segment corresponding to the candidate video completely includes the target memory segment, then the target video indicates a video extracted from the candidate video, and the candidate video is the video in the separate album with the highest matching degree between the memory segment and the target memory segment; if the separate album does not contain a video matching the target memory segment, and the candidate video... If the corresponding memory period does not completely include the target memory period, then the target video simultaneously indicates a candidate video in the individual video set and a video in the comprehensive video set. The comprehensive video set includes all outdoor images from the smart doorbell, and the candidate video in the individual video set indicated by the target video is a usable video extracted from the candidate video. The memory period corresponding to the usable video is included in the target memory period. The video in the comprehensive video set indicated by the target video is the video corresponding to the time period to be acquired in the comprehensive video set. The time period to be acquired is the time period in the target memory period that does not include the memory period corresponding to the usable video. If the target memory object does not have a separate video set, the target video indicates a video in the comprehensive video set, and the video in the comprehensive video set indicated by the target video matches the target memory period and the feature image corresponding to the target memory.

[0016] Thirdly, embodiments of this application provide a method for generating a memory video based on a doorbell, applied to a smart doorbell in a doorbell system. The doorbell system includes a server, the smart doorbell, and an electronic device, wherein the server, the smart doorbell, and the electronic device are communicatively connected. The method includes:

[0017] When the conditions for outdoor video recording are met, the outdoor video is acquired;

[0018] The outdoor image is sent to the server. The outdoor image includes a target video, which is used to indicate a request to view a memory video. The request to view a memory video includes a target memory period and a target memory object. The memory period corresponding to the target video matches the target memory period. If the target memory object exists in a separate album, and if the separate album contains a video whose memory period matches the target memory period, then the target video indicates the video in the separate album whose memory period matches the target memory period. The memory object in the memory videos included in the separate album includes the target memory object. If the separate album does not contain a video matching the target memory period, and the memory period corresponding to a candidate video completely includes the target memory period, then the target video indicates a video extracted from the candidate video. The candidate video is the video in the separate album with the highest matching degree between the memory period and the target memory period. If the separate album contains a video, then the target video indicates the video extracted from the candidate video. If no video in the album matches the target memory period, and the memory period corresponding to the candidate video does not completely include the target memory period, then the target video simultaneously indicates a candidate video in the individual album and a video in the comprehensive album. The comprehensive album includes all outdoor images from the smart doorbell, and the candidate video in the individual album indicated by the target video is a usable video extracted from the candidate videos. The memory period corresponding to the usable video is included in the target memory period. The video in the comprehensive album indicated by the target video is the video corresponding to the time period to be acquired in the comprehensive album, and the time period to be acquired is the time period in the target memory period that does not include the memory period corresponding to the usable video. If the target memory object does not exist in a separate album, the target video indicates a video in the comprehensive album, and the video in the comprehensive album indicated by the target video matches the target memory period and the feature image corresponding to the target memory.

[0019] Fourthly, embodiments of this application provide a doorbell system, including a server, a smart doorbell, and an electronic device, wherein the server, the smart doorbell, and the electronic device are respectively communicatively connected; the server is used to execute instructions for the steps of the method described in the first aspect above; the electronic device is used to execute instructions for the steps of the method described in the second aspect above; and the smart doorbell is used to execute instructions for the steps of the method described in the third aspect above.

[0020] Fifthly, embodiments of this application provide a doorbell-based memory video generation device, applied to a server of a doorbell system. The doorbell system includes the server, a smart doorbell, and an electronic device, which are communicatively connected. The device includes:

[0021] The first acquisition unit is used to acquire a memory video viewing request from the electronic device, wherein the memory video viewing request includes a target memory period and a target memory object;

[0022] The first determining unit is used to determine whether the target memory object exists in a separate video album, wherein the memory objects in the memory videos included in the separate video album include the target memory object;

[0023] The second determining unit is used to determine whether a target video exists in the separate video set if the separate video set exists, wherein the memory period corresponding to the target video matches the target memory period.

[0024] The first sending unit is configured to send the target video to the electronic device if the target video exists.

[0025] The second acquisition unit is used to acquire alternative videos from the individual video collection if the target video does not exist, wherein the memory period corresponding to the alternative video has the highest matching degree with the target memory period, and to determine whether the memory period corresponding to the alternative video completely includes the target memory period.

[0026] The second sending unit is configured to, if fully included, extract the target video from the candidate videos according to the target recall period and send the target video to the electronic device;

[0027] The third sending unit is configured to: extract a usable video from the candidate videos if the target recall time period is not fully included; determine a time period in the target recall time period that does not include the recall time period corresponding to the usable video; obtain the video corresponding to the time period to be obtained from the comprehensive image set, which includes all outdoor images from the smart doorbell; generate the target video based on the usable video and the video corresponding to the time period to be obtained; and send the target video to the electronic device.

[0028] The fourth sending unit is configured to, if the separate photo set does not exist, acquire a feature image of the target memory object; acquire the target video from the integrated photo set based on the feature image and the target memory period; and send the target video to the electronic device.

[0029] Sixthly, embodiments of this application provide a doorbell-based memory video generation device, applied to an electronic device in a doorbell system. The doorbell system includes a server, a smart doorbell, and the electronic device, which are communicatively connected. The device includes:

[0030] The sending unit is used to send a request to view a memory video to the server, the request including a target memory period and a target memory object;

[0031] An acquisition unit is configured to acquire and play a target video from the server, wherein the memory segment corresponding to the target video matches the target memory segment; if the target memory object exists in a separate album, and if the separate album contains a video whose memory segment matches the target memory segment, then the target video indicates the video in the separate album whose memory segment matches the target memory segment, and the memory object in the memory videos included in the separate album includes the target memory object; if the separate album does not contain a video matching the target memory segment, and the memory segment corresponding to the candidate video completely includes the target memory segment, then the target video indicates a video extracted from the candidate video, and the candidate video is the video in the separate album with the highest matching degree between the memory segment and the target memory segment; if the separate album does not contain a video matching the target memory segment, and the target memory segment... If the memory period corresponding to the candidate video does not completely include the target memory period, then the target video simultaneously indicates the candidate video in the individual video set and the video in the comprehensive video set. The comprehensive video set includes all outdoor images from the smart doorbell, and the candidate video in the individual video set indicated by the target video is a usable video extracted from the candidate video. The memory period corresponding to the usable video is included in the target memory period. The video in the comprehensive video set indicated by the target video is the video corresponding to the time period to be acquired in the comprehensive video set. The time period to be acquired is the time period in the target memory period that does not include the memory period corresponding to the usable video. If the target memory object does not exist in a separate video set, the target video indicates the video in the comprehensive video set, and the video in the comprehensive video set indicated by the target video matches the target memory period and the feature image corresponding to the target memory.

[0032] Seventhly, embodiments of this application provide a doorbell-based memory video generation device, applied to a smart doorbell in a doorbell system. The doorbell system includes a server, the smart doorbell, and an electronic device, which are communicatively connected. The device includes:

[0033] An acquisition unit is used to acquire the outdoor image when the outdoor image recording conditions are met;

[0034] A sending unit is configured to send the outdoor image to the server. The outdoor image includes a target video, which is used to indicate a request to view a memory video. The request to view a memory video includes a target memory period and a target memory object. The memory period corresponding to the target video matches the target memory period. If the target memory object exists in a separate album, and if the separate album contains a video whose memory period matches the target memory period, then the target video indicates the video in the separate album whose memory period matches the target memory period. The memory object in the memory videos included in the separate album includes the target memory object. If the separate album does not contain a video matching the target memory period, and the memory period corresponding to a candidate video completely includes the target memory period, then the target video indicates a video extracted from the candidate video. The candidate video is the video in the separate album with the highest matching degree between the memory period and the target memory period. If no video in the individual video set matches the target memory period, and the memory period corresponding to the candidate video does not completely include the target memory period, then the target video simultaneously indicates both the candidate video in the individual video set and the video in the comprehensive video set. The comprehensive video set includes all outdoor images from the smart doorbell, and the candidate video in the individual video set indicated by the target video is a usable video extracted from the candidate videos. The memory period corresponding to the usable video is included in the target memory period. The video in the comprehensive video set indicated by the target video is the video corresponding to the time period to be acquired in the comprehensive video set, and the time period to be acquired is the time period in the target memory period that does not include the memory period corresponding to the usable video. If the target memory object does not exist in a separate video set, the target video indicates the video in the comprehensive video set, and the video in the comprehensive video set indicated by the target video matches the target memory period and the feature image corresponding to the target memory.

[0035] Eighthly, embodiments of this application provide a server including a processor, a memory, a communication interface, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps in the first aspect of embodiments of this application.

[0036] In a ninth aspect, embodiments of this application provide an electronic device including a processor, a memory, a communication interface, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps in the second aspect of embodiments of this application.

[0037] In a tenth aspect, embodiments of this application provide a smart doorbell, including a processor, a memory, a communication interface, and one or more programs, the one or more programs being stored in the memory and configured to be executed by the processor, the programs including instructions for performing the steps in the third aspect of embodiments of this application.

[0038] In one aspect, embodiments of this application provide a computer storage medium having a computer program / instructions stored thereon, which is executed by a processor to implement the steps of the methods described in the first, second, or third aspects above.

[0039] In a twelfth aspect, embodiments of this application provide a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps described in the first, second, or third aspects of embodiments of this application. The computer program product may be a software installation package.

[0040] As can be seen, in this embodiment, the server determines the memory period and memory object based on the memory video viewing request from the electronic device, and then determines whether the memory object has a separate album. If so, it determines whether there is a target video matching the memory period in the separate album. If so, it sends the target video to the electronic device. If not, it determines the candidate video with the highest matching degree with the target memory period from the separate album. When the memory period corresponding to the candidate video completely includes the target memory period, the target video is extracted from the candidate video and sent to the electronic device. When the candidate video does not completely include the target memory period, a usable video is extracted from the candidate video. The time period to be acquired is determined based on the target memory period and the memory period of the usable video. The video corresponding to the time period to be acquired is obtained from the comprehensive album. The target video is generated based on the usable video and the video corresponding to the time period to be acquired and sent to the electronic device. If there is no separate album, the target video is determined from the comprehensive album based on the feature image of the target memory object and sent. In this way, reprocessing existing memory videos can improve the efficiency of server data processing. Since smart doorbells themselves need to acquire and upload monitoring data, these acquired images can be reused to generate memory videos. This not only eliminates the need for the server to acquire additional video data from the smart doorbell, reducing the data processing burden on the doorbell system, but also increases the utilization rate of the same data and provides users with more diverse services, enhancing the user experience. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 This is a schematic diagram of the composition of a doorbell system provided in an embodiment of this application;

[0043] Figure 2 This is a schematic diagram of the structure of a device provided in an embodiment of this application;

[0044] Figure 3 This is a flowchart illustrating a method for generating a memory video based on a doorbell, as provided in an embodiment of this application.

[0045] Figure 4 This is a schematic diagram of a viewing interface for a memory video provided in an embodiment of this application;

[0046] Figure 5 This is a functional unit block diagram of a doorbell-based memory video generation device provided in an embodiment of this application;

[0047] Figure 6 This is a functional unit block diagram of another doorbell-based memory video generation device provided in this application embodiment;

[0048] Figure 7 This is a functional unit block diagram of another doorbell-based memory video generation device provided in this application embodiment;

[0049] Figure 8 This is a functional unit block diagram of another doorbell-based memory video generation device provided in this application embodiment;

[0050] Figure 9 This is a functional unit block diagram of another doorbell-based memory video generation device provided in this application embodiment;

[0051] Figure 10 This is a functional unit block diagram of another doorbell-based memory video generation device provided in the embodiments of this application. Detailed Implementation

[0052] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.

[0053] The terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0054] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0055] Existing smart doorbells can only be used for extended functions such as monitoring and anti-theft, making them functionally limited and unable to provide users with a better experience.

[0056] To address the aforementioned issues, this application provides a method and related apparatus for generating memory videos based on doorbells. The embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0057] Please see Figure 1 , Figure 1 This is a schematic diagram of a doorbell system provided in an embodiment of this application. The doorbell system 10 includes a server 101, an electronic device 102, and a smart doorbell 103, which are communicatively connected. The smart doorbell 103 is used to acquire outdoor images and upload them to the server 101. After receiving a request to view a recall video from the electronic device 102, the server 101 generates a recall video and sends it to the electronic device 102 for playback. The smart doorbell 103 can also send outdoor images and notification messages to the electronic device 102 based on the viewing request.

[0058] In this solution, the smart doorbell 103 can consist of a main doorbell and a slave doorbell. The main doorbell, also known as the outdoor doorbell, includes image acquisition devices such as a camera, is installed outdoors, and can communicate with the server 101 to upload the acquired outdoor images to the server 101. The slave doorbell, also known as the indoor doorbell, includes sound-emitting devices such as a loudspeaker, is installed indoors, and can communicate with the main doorbell for information exchange. After detecting someone ringing the doorbell, the main doorbell can send a message notification to the slave doorbell, which in turn sends a prompt message. The slave doorbell can also include a display screen, allowing it to display the outdoor images sent by the main doorbell in real time.

[0059] Please see Figure 2 , Figure 2 This is a schematic diagram of the structure of a device provided in an embodiment of this application. The device 110 can be the aforementioned server 101, or the aforementioned electronic device 102, or a master doorbell or slave doorbell in a smart doorbell 103, such as... Figure 2 As shown, device 110 includes a processor 120, a memory 130, a communication interface 140, and one or more programs 131. The one or more programs 131 are stored in the memory 130 and configured to be executed by the processor 120. The one or more programs 131 include instructions for performing any step in any of the methods described in the following embodiments. Specifically, the processor 120 is used to perform any step performed by a server, electronic device, or smart doorbell as described in the following methods embodiments, and when performing data transmission such as sending, it may selectively invoke the communication interface 140 to complete the corresponding operation.

[0060] Please see Figure 3 , Figure 3 This is a flowchart illustrating a doorbell-based memory video generation method provided in an embodiment of this application. The doorbell-based memory video generation method includes the following steps.

[0061] Step 201: When the outdoor image recording conditions are met, the smart doorbell acquires the outdoor image.

[0062] Step 202: The smart doorbell sends the outdoor image to the server.

[0063] The outdoor video recording conditions include the smart doorbell receiving a visitor notification, which could be a visitor ringing the doorbell or someone appearing within the smart doorbell's recording range. Alternatively, the smart doorbell can also receive outdoor video viewing requests from electronic devices. In this case, the smart doorbell will also capture outdoor video, but the captured video will be uploaded to the electronic device by the smart doorbell, and then uploaded to the server for storage after receiving a storage request from the electronic device. It should be noted that the recording condition can also be continuous recording, where the smart doorbell acts as a monitoring device, capturing outdoor video in real time and uploading it to the server for storage.

[0064] Step 203: The electronic device sends a request to the server to view the memory video.

[0065] The request to view the video recollection includes a target recollection period and a target recollection object. The target recollection period can be a holiday period or a period set by the user. That is, when selecting a recollection period, the user can directly use the period of a holiday as the target recollection period. For example, if National Day falls between October 1st and October 7th, the user only needs to set the target recollection period to the National Day of a certain year or several years, and the entire duration of that National Day will be the target recollection period, without the user needing to input the date. Furthermore, some Chinese holidays are determined by the lunar calendar, so the holiday dates in the Gregorian calendar vary each year, requiring users to check the calendar for the exact time. To avoid increasing the user's workload, the user only needs to provide the holiday name and year, and the server can automatically determine the corresponding period. Specifically, the target recollection object can include one object or multiple objects simultaneously.

[0066] Step 204: Determine whether the target memory object exists in a separate photo album.

[0067] The memory objects in the memory videos included in the separate album include the target memory object. If a user has previously generated a memory video for a target memory object and saved it after viewing it, a separate album for that target memory object can be generated. This separate album contains only memory videos for that target memory object. It should be noted that since the target memory object may appear in a family setting, other people besides the target memory object may also appear in the memory videos in the separate album, but every frame of that memory video includes the target memory object corresponding to that separate album.

[0068] Step 205: If the individual video set exists, the server determines whether the target video exists in the individual video set.

[0069] Specifically, the memory period corresponding to the target video matches the target memory period. This matching means that the target memory period and the memory period corresponding to the target video are exactly the same.

[0070] Step 206: If the target video exists, the server sends the target video to the electronic device.

[0071] If a target video exists, it means that the user previously generated and saved a memory video with the currently set target memory object and the currently set target memory time as the target memory time. If the user wants to view this memory video again, the server can directly send the stored target memory video to the user for playback.

[0072] Step 207: If the target video does not exist, the server obtains alternative videos from the individual video set and determines whether the memory period corresponding to the alternative video completely includes the target memory period.

[0073] Among them, the candidate videos have the highest matching degree with the target recall period. When determining the matching degree, if the recall period of a video in a single album completely encompasses the target recall period, the matching degree is high; if the recall period of a video in a single album intersects with the wooden template recall period, the matching degree is low; if the recall period of a video in a single album does not intersect with the wooden template recall period, the matching degree is zero. When determining candidate videos, if there are recall videos with high matching degrees, the candidate video is the one with the highest percentage of overlap between the recall period and the target recall period. For example, if the target recall period is from January 1st to January 3rd of this year, and there are two highly matching recall videos—from January 1st to January 6th of this year, and from December 31st of last year to January 3rd of this year—the latter video has a higher percentage of overlap and is therefore selected as the candidate video. If no video with a high matching degree is found, a candidate video is determined from the memory videos with a low matching degree. This candidate video is the memory video with the highest overlap with the target memory period among the memory videos with low matching degree. For example, if the target memory period is from January 1st to January 3rd of this year, and there are two memory videos with high matching degree, one from January 1st to January 2nd of this year, and the other from December 31st of last year to January 1st of this year, then the first memory video may have the highest overlap with the target memory period, and thus the first memory video can be determined as the candidate video. Of course, if only memory videos with a matching degree of zero are included, then the feature image of the target memory object is obtained; the target video is obtained from the comprehensive photo album based on the feature image and the target memory period; and the target video is sent to the electronic device.

[0074] Step 208: If the target video is fully included, the server extracts the target video from the candidate videos according to the target recall period and sends the target video to the electronic device.

[0075] If all of them are included, the server only needs to cut out the video corresponding to the target memory period from the candidate videos.

[0076] Step 209: If not fully included, the server extracts available videos from the candidate videos, determines the time period in the target memory period that does not include the memory period corresponding to the available videos as the time period to be acquired, obtains the video corresponding to the time period to be acquired from the comprehensive video collection, generates the target video based on the available videos and the video corresponding to the time period to be acquired, and sends the target video to the electronic device.

[0077] The available video footage corresponds to a specific memory period, which is included in the target memory period. The comprehensive video collection includes all outdoor images from the smart doorbell. These outdoor images can be stored according to outdoor image storage rules, which may include saving only images within a preset time period, such as the past three months. Alternatively, the rules may specify saving only video images containing objects; if the acquired image does not contain an object, that portion is edited out during storage. In other words, videos overlapping with the target memory period are first edited from the candidate videos, and then videos corresponding to the remaining memory periods are edited from the comprehensive video collection.

[0078] Step 210: If the individual photo set does not exist, the server obtains the feature image of the target memory object, and obtains the target video from the integrated photo set according to the feature image and the target memory period, and sends the target video to the electronic device.

[0079] When acquiring feature images, the server can send them to the target memory object by taking a photo or selecting one from its album. Based on the acquired image, the server generates character feature information and uses this information to retrieve videos containing that target memory object within the specified memory period. For example... Figure 4 As shown, Figure 4 This is a schematic diagram of a video viewing interface provided in an embodiment of this application. Users can select the desired memory object and time period in this interface. When determining the target memory object, if the target memory object exists in a separate album, the user can directly select the target memory object by choosing the name of that album. Alternatively, users can click on the album and obtain their characteristic image by selecting pictures or taking photos on-site.

[0080] As can be seen, in this example, the server determines the memory period and the memory object based on the memory video viewing request from the electronic device. Then, it determines whether the memory object has a separate album. If so, it determines whether there is a target video matching the memory period in the separate album. If so, the target video is sent to the electronic device. If not, it determines the candidate video with the highest matching degree to the target memory period from the separate album. When the memory period corresponding to the candidate video completely includes the target memory period, the target video is extracted from the candidate video and sent to the electronic device. When the candidate video does not completely include the target memory period, a usable video is extracted from the candidate video. The time period to be acquired is determined based on the target memory period and the memory period of the usable video. The video corresponding to the time period to be acquired is obtained from the comprehensive album. The target video is generated based on the usable video and the video corresponding to the time period to be acquired and sent to the electronic device. If there is no separate album, the target video is determined from the comprehensive album based on the feature image of the target memory object and sent. In this way, reprocessing existing memory videos can improve the efficiency of server data processing. Since smart doorbells themselves need to acquire and upload monitoring data, these acquired images can be reused to generate memory videos. This not only eliminates the need for the server to acquire additional video data from the smart doorbell, reducing the data processing burden on the doorbell system, but also increases the utilization rate of the same data and provides users with more diverse services, enhancing the user experience.

[0081] In one possible instance, before obtaining the request to view the memory video from the electronic device, the method further includes: obtaining outdoor images from the smart doorbell; determining whether the time of obtaining the outdoor images is a preset time, the preset time including the time of a holiday and the time of a user-set time period; if it is the preset time, determining the user's residential environment based on the outdoor images; determining the target storage path of the outdoor images in the integrated image collection based on the residential environment, wherein outdoor images stored in the same storage path correspond to users with the same residential environment; and storing the outdoor images in the integrated image collection according to the target storage path.

[0082] After acquiring outdoor images uploaded by the smart doorbell, due to storage space limitations, not all outdoor images need to be stored. Only outdoor images acquired during holidays or during specific time periods set by the user can be stored. Furthermore, when storing outdoor images, it's possible to determine if the user has moved based on the residential environment shown in the images. Different residential environments correspond to different storage paths; that is, outdoor images of the same user at the same location are stored in the same storage path.

[0083] As can be seen, in this example, determining whether to store outdoor images based on their acquisition time reduces storage burden and ensures sufficient material for generating the memory video. During storage, outdoor images corresponding to different living environments are stored in different storage paths, which facilitates the categorization and retrieval of materials for editing during subsequent memory video generation, improving material acquisition efficiency.

[0084] In one possible instance, storing the outdoor image in the integrated photo album according to the target storage path includes: determining the duration of the outdoor image, which indicates the time from when an object in the outdoor image appears to when it enters the door; when the duration of the outdoor image is greater than a first preset duration, acquiring behavioral changes of the object in the outdoor image; editing the outdoor image according to the behavioral changes to obtain a stored video, the duration of the stored video being less than a second preset duration, and the second preset duration being greater than the first preset duration; when the duration of the outdoor image is less than or equal to the first preset duration, determining the outdoor image as the stored video; and storing the stored video in the integrated photo album according to the target storage path.

[0085] When storing outdoor images, the duration of each image must be considered. If the duration is too long, editing is required when creating the memory video, reducing the efficiency of memory video generation. Therefore, the outdoor image can be edited during storage, so that the material can be used directly when generating the memory video. Since the smart doorbell will acquire outdoor images once the recording conditions are met, and since visitors may stand outside the door for a long time before opening it, if the duration exceeds a first preset duration, the outdoor image needs to be edited; otherwise, it can be stored directly.

[0086] In practice, when editing outdoor footage, the editing can be based on changes in the behavior of the users included in the footage. For example, if a user maintains the same posture while waiting, the footage during that waiting period can be edited, retaining only a small portion. However, if the user makes some movements while waiting for the door to open, such as changing from standing to squatting, the editing needs to include footage of the user standing, footage of the user changing from standing to squatting, and footage of the user squatting. The second preset time length can be determined based on changes in the user's behavior. For example, if the user's behavior changes infrequently, the second preset time length can be very short; if the user's behavior changes frequently, the second preset time length can be very long to fully represent the user's waiting process.

[0087] As can be seen, in this example, editing outdoor footage before storing it can reduce the demand for storage resources and increase the speed of generating the memory video.

[0088] In one possible instance, obtaining the target video from the composite image set based on the feature image and the target memory period includes: determining a plurality of candidate storage videos from the composite image set based on the feature image and the target memory period; determining whether the storage paths of the plurality of candidate storage videos are completely identical; if so, generating the target video based on the plurality of candidate storage videos; if not, determining the number of candidate storage videos included in each storage path corresponding to the plurality of candidate storage videos; determining the target storage video corresponding to each storage path from the plurality of candidate storage videos based on the number of candidate storage videos; and generating the target video based on the target storage video.

[0089] In the process of retrieving target videos from a comprehensive video album to generate a memory video, if the target memory period includes videos from multiple storage paths, it means that the user moved houses during this memory period. Therefore, it is necessary to ensure that the target videos used to generate the memory video include videos from each of the user's homes, meaning that the final target video includes videos from each storage path. Before determining the target storage video corresponding to each storage path from the multiple candidate storage videos based on the number of candidate storage videos, the method further includes: determining the total number of multiple candidate storage videos; if the total number is not greater than a preset number, then all candidate storage videos are determined as target videos; if the total number is greater than the preset number, then the target storage video corresponding to each storage path is determined based on the number of candidate storage videos included in each storage path and the total number. That is, the more candidate storage videos included in a storage path, the more target storage videos corresponding to that storage path. In particular, when determining the target storage video corresponding to each storage path, it can be first determined that the target storage video includes the first and last videos included in each storage path. This includes videos taken within the target time period immediately after the user moves, as well as the last video taken within the target time period before the user moves away. For example, if the target time period is National Day within the last ten years, and the user moves from A to B, then the target stored videos would include the first video taken by the user during National Day at A and the last video taken by the user during National Day at B before moving.

[0090] As can be seen, in this example, when generating the memory video, it is determined that the memory video includes images of the user in different living environments, so that the generated memory video is more complete while ensuring that the time is not too long, and can more easily evoke the user's memories.

[0091] In one possible instance, the memory video viewing request further includes a target memory duration. Before sending the target video to the electronic device, the method further includes: determining whether the duration of the target video is the same as the target memory duration; if they are not the same, determining the difference between the duration of the target video and the target memory duration; if the difference indicates that the duration of the target video is greater than the target memory duration, editing the target video to obtain a playback video, the duration of which is the same as the target memory duration; if the difference indicates that the duration of the target video is less than the target memory duration, determining a reference stored video from the integrated image set based on the feature image and the target memory period, wherein the target video does not include the reference stored video; determining a duration to be supplemented based on the difference; generating a supplementary video based on the duration to be supplemented and the reference stored video; generating a playback video based on the supplementary video and the target video; sending the target video to the electronic device includes: sending the playback video to the electronic device.

[0092] When viewing a memory video, users can also select its length. Therefore, after generating the target video, the server needs to supplement or further edit it based on its original length and the user-selected length. After generating the supplementary video, it needs to be merged and edited based on the existing target video; this merging and editing can be done chronologically. When determining the reference storage video, if the target video is generated from videos in a comprehensive album, the number of videos corresponding to each storage path in the target video can be determined, prioritizing the selection of videos from the storage path with the fewest occurrences in the target video as the reference storage video.

[0093] As can be seen, in this example, the memory video can also be generated according to the duration of the memory video determined by the user, which can flexibly meet the user's needs and improve the user experience.

[0094] In one possible instance, the reference stored videos include multiple videos, and the step of generating a supplementary video based on the duration to be supplemented and the reference stored videos includes: obtaining the number of other objects included in each of the multiple reference stored videos, wherein the other objects are objects in the reference stored videos other than the target memory object; sorting the multiple reference stored videos according to the number of other objects; and sequentially merging and editing the reference stored videos according to the sorting until the supplementary video is obtained, wherein the duration of the supplementary video matches the duration to be supplemented.

[0095] When generating supplementary videos, the video with the most objects appearing in it can be selected first for supplementary video generation until the duration of the generated supplementary video matches the duration to be supplemented.

[0096] As can be seen in this example, the more other objects appear in the video, the easier it is to evoke the user's memories. This allows the user to recall other people while watching the video about the target memory object, making the generated memory video more interesting and improving the user experience.

[0097] In one possible instance, after sending the target video to the electronic device, the method further includes: obtaining an exit request from the electronic device, the exit request indicating exit from the viewing interface of the target video; sending a prompt message to the electronic device, the prompt message indicating whether the electronic device should save the target video; obtaining a response message from the electronic device; if the response message indicates that the target video should be saved, saving the target video to a separate album corresponding to the target memory object; if the response message indicates that the target video should not be saved, deleting the target video.

[0098] If the target memory object corresponding to the target video does not exist in a separate album, and the response information indicates that the target video should be saved, then a separate album is created for the target memory object, and the target video is saved in the created separate album. Specifically, when the response information indicates that the target video should be saved, it is determined whether the target memory period corresponding to the current target video completely overlaps with the target memory period in the separate album, or whether the current target memory period completely includes the memory period of a certain memory video in the separate album. If so, the overlapping memory video in the separate album is deleted. Since if there are overlapping memory videos in the separate album, the current target video is generated based on that memory video, and there is no need to save the previous video. If there is a memory video in the separate album whose memory period completely includes the target memory period, the target video is not saved, or the user is prompted that a related video already exists and whether they want to continue saving. If the user insists on saving, the target video is then saved.

[0099] As can be seen, in this example, determining whether to save the generated memory video based on user needs can reduce the demand for storage resources.

[0100] For examples consistent with the above embodiments, please refer to... Figure 5 , Figure 5This is a functional unit block diagram of a doorbell-based memory video generation device provided in an embodiment of this application. The doorbell-based memory video generation device 30 is applied to a server of a doorbell system. The doorbell system includes the server, a smart doorbell, and an electronic device. The server, the smart doorbell, and the electronic device are communicatively connected. The device includes:

[0101] The first acquisition unit is used to acquire a memory video viewing request from the electronic device, wherein the memory video viewing request includes a target memory period and a target memory object;

[0102] The first determining unit is used to determine whether the target memory object exists in a separate video album, wherein the memory objects in the memory videos included in the separate video album include the target memory object;

[0103] The second determining unit is used to determine whether a target video exists in the separate video set if the separate video set exists, wherein the memory period corresponding to the target video matches the target memory period.

[0104] The first sending unit is configured to send the target video to the electronic device if the target video exists.

[0105] The second acquisition unit is used to acquire alternative videos from the individual video collection if the target video does not exist, wherein the memory period corresponding to the alternative video has the highest matching degree with the target memory period, and to determine whether the memory period corresponding to the alternative video completely includes the target memory period.

[0106] The second sending unit is configured to, if fully included, extract the target video from the candidate videos according to the target recall period and send the target video to the electronic device;

[0107] The third sending unit is configured to: extract a usable video from the candidate videos if the target recall time period is not fully included; determine a time period in the target recall time period that does not include the recall time period corresponding to the usable video; obtain the video corresponding to the time period to be obtained from the comprehensive image set, which includes all outdoor images from the smart doorbell; generate the target video based on the usable video and the video corresponding to the time period to be obtained; and send the target video to the electronic device.

[0108] The fourth sending unit is configured to, if the separate photo set does not exist, acquire a feature image of the target memory object; acquire the target video from the integrated photo set based on the feature image and the target memory period; and send the target video to the electronic device.

[0109] In one possible instance, before obtaining the memory video viewing request from the electronic device, the doorbell-based memory video generation device 30 is further configured to: acquire outdoor images from the smart doorbell; determine whether the time of acquiring the outdoor images is a preset time, the preset time including the time of a holiday and the time of a user-set time period; if it is the preset time, determine the user's residential environment based on the outdoor images; determine the target storage path of the outdoor images in the integrated image set based on the residential environment, wherein outdoor images stored in the same storage path correspond to users with the same residential environment; and store the outdoor images in the integrated image set according to the target storage path.

[0110] In one possible instance, in storing the outdoor image in the integrated photo album according to the target storage path, the doorbell-based memory video generation device 30 is further configured to: determine the duration of the outdoor image, the duration of the outdoor image indicating the time from the appearance of an object in the outdoor image to its entry into the door; when the duration of the outdoor image is greater than a first preset duration, acquire behavioral changes of the object in the outdoor image; edit the outdoor image according to the behavioral changes to obtain a stored video, the duration of the stored video being less than a second preset duration, the second preset duration being greater than the first preset duration; when the duration of the outdoor image is less than or equal to the first preset duration, determine the outdoor image as the stored video; and store the stored video in the integrated photo album according to the target storage path.

[0111] In one possible instance, regarding the acquisition of the target video from the composite photo set based on the feature image and the target memory period, the fourth sending unit 308 is specifically configured to: determine a plurality of candidate stored videos from the composite photo set based on the feature image and the target memory period; determine whether the storage paths of the plurality of candidate stored videos are completely identical; if so, generate the target video based on the plurality of candidate stored videos; if not, determine the number of candidate stored videos included in each storage path corresponding to the plurality of candidate stored videos; determine the target stored video corresponding to each storage path from the plurality of candidate stored videos based on the number of candidate stored videos; and generate the target video based on the target stored video.

[0112] In one possible instance, before the memory video viewing request further includes a target memory duration, the doorbell-based memory video generation device 30 is further configured to: determine whether the duration of the target video is the same as the target memory duration; if not, determine the difference between the duration of the target video and the target memory duration; if the difference indicates that the duration of the target video is greater than the target memory duration, edit the target video to obtain a playback video, the duration of which is the same as the target memory duration; if the difference indicates that the duration of the target video is less than the target memory duration, determine a reference stored video from the integrated image set based on the feature image and the target memory period, wherein the target video does not include the reference stored video; determine the duration to be supplemented based on the difference; generate a supplementary video based on the duration to be supplemented and the reference stored video; generate a playback video based on the supplementary video and the target video; and, in terms of sending the target video to the electronic device, the doorbell-based memory video generation device 30 is further configured to: send the playback video to the electronic device.

[0113] In one possible instance, the reference stored videos include multiple videos. In generating a supplementary video based on the duration to be supplemented and the reference stored videos, the doorbell-based memory video generation device 30 is further configured to: obtain the number of other objects included in each of the multiple reference stored videos, wherein the other objects are objects in the reference stored videos excluding the target memory object; sort the multiple reference stored videos according to the number of other objects; and sequentially merge and edit the reference stored videos according to the sorting until the supplementary video is obtained, wherein the duration of the supplementary video matches the duration to be supplemented.

[0114] In one possible instance, after sending the target video to the electronic device, the doorbell-based memory video generation device 30 is further configured to: obtain an exit request from the electronic device, the exit request indicating exit from the viewing interface of the target video; send a prompt message to the electronic device indicating whether to save the target video; obtain a response message from the electronic device; if the response message indicates to save the target video, save the target video to a separate album corresponding to the target memory object; if the response message indicates not to save the target video, delete the target video.

[0115] It is understood that since the method embodiments and the device embodiments are different presentations of the same technical concept, the content of the method embodiment section in this application should be adapted to the device embodiment section in a synchronous manner, and will not be repeated here.

[0116] In the case of using integrated units, please refer to Figure 6 , Figure 6 This is a functional unit block diagram of another doorbell-based memory video generation device provided in this application embodiment. Figure 6 The doorbell-based memory video generation device 400 includes a processing module 412 and a communication module 411. The processing module 412 controls and manages the operations of the doorbell-based memory video generation device 30, for example, executing the steps of the first acquisition unit 301, the first determination unit 302, the second determination unit 303, the first transmission unit 304, the second acquisition unit 305, the second transmission unit 306, the third transmission unit 307, and the fourth transmission unit 308, and / or performing other processes of the technology described herein. The communication module 411 is used for interaction between the doorbell-based memory video generation device and other devices. Figure 4 As shown, the doorbell-based memory video generation device 400 may further include a storage module 413, which is used to store the program code and data of the doorbell-based memory video generation device.

[0117] The processing module 412 can be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an ASIC, an FPGA, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc. The communication module 411 can be a transceiver, RF circuitry, or a communication interface, etc. The storage module 413 can be a memory.

[0118] All relevant content in the various scenarios involved in the above method embodiments can be referenced from the functional descriptions of the corresponding functional modules, and will not be repeated here. The above-mentioned doorbell-based memory video generation device 400 can perform the above-mentioned... Figure 3 The method shown is a doorbell-based memory video generation method applied to a server.

[0119] For examples consistent with the above embodiments, please refer to... Figure 7 , Figure 7This is a functional unit block diagram of another doorbell-based memory video generation device provided in this application embodiment. The doorbell-based memory video generation device 50 is applied to an electronic device in a doorbell system. The doorbell system includes a server, a smart doorbell, and the electronic device. The server, the smart doorbell, and the electronic device are communicatively connected. The doorbell-based memory video generation device 50 includes: a sending unit 501, used to send a memory video viewing request to the server, the memory video viewing request including a target memory period and a target memory object; and an acquisition unit 502, used to acquire and play a target video from the server, the memory period corresponding to the target video matching the target memory period; if the target memory object exists in a separate video set, and if the separate video set contains a video whose memory period matches the target memory period, then the target video indicates the video in the separate video set whose memory period matches the target memory period, and the memory object in the memory videos included in the separate video set includes the target memory object; if the separate video set does not contain a video matching the target memory period, and the memory period corresponding to the alternative video completely includes the target memory period, then the target video indicates the root memory period. The video extracted from the candidate video is the video with the highest matching degree between the memory period and the target memory period in the individual video set. If there is no video matching the target memory period in the individual video set, and the memory period corresponding to the candidate video does not completely include the target memory period, then the target video simultaneously indicates the candidate video in the individual video set and the video in the comprehensive video set. The comprehensive video set includes all outdoor images from the smart doorbell, and the candidate video in the individual video set indicated by the target video is a usable video extracted from the candidate video. The memory period corresponding to the usable video is included in the target memory period. The video in the comprehensive video set indicated by the target video is the video corresponding to the time period to be acquired in the comprehensive video set. The time period to be acquired is the time period in the target memory period that does not include the memory period corresponding to the usable video. In the case that the target object does not have a separate video set, the target video indicates the video in the comprehensive video set, and the video in the comprehensive video set indicated by the target video matches the target memory period and the feature image corresponding to the target memory.

[0120] In the case of using integrated units, please refer to Figure 8 , Figure 8 This is a functional unit block diagram of another doorbell-based memory video generation device provided in this application embodiment. Figure 8The doorbell-based memory video generation device 600 includes a processing module 612 and a communication module 611. The processing module 612 controls and manages the operation of the doorbell-based memory video generation device 50, for example, executing the steps of the sending unit 501 and the acquiring unit 502, and / or performing other processes of the technology described herein. The communication module 611 is used for interaction between the doorbell-based memory video generation device and other devices. Figure 6 As shown, the doorbell-based memory video generation device 600 may further include a storage module 613, which is used to store the program code and data of the doorbell-based memory video generation device.

[0121] The processing module 612 can be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an ASIC, an FPGA, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc. The communication module 611 can be a transceiver, RF circuitry, or a communication interface, etc. The storage module 413 can be a memory.

[0122] All relevant content in each scenario involved in the above method embodiments can be referenced from the functional descriptions of the corresponding functional modules, and will not be repeated here. The above-mentioned doorbell-based memory video generation device 600 can perform the above... Figure 3 The method shown is a doorbell-based memory video generation method applied to electronic devices.

[0123] For examples consistent with the above embodiments, please refer to... Figure 9 , Figure 9This is a functional unit block diagram of another doorbell-based memory video generation device provided in this application embodiment. The doorbell-based memory video generation device 70 is applied to a smart doorbell in a doorbell system. The doorbell system includes a server, the smart doorbell, and an electronic device. The server, the smart doorbell, and the electronic device are communicatively connected. The doorbell-based memory video generation device 70 includes: an acquisition unit 701, used to acquire the outdoor image when outdoor image recording conditions are met; and a sending unit 702, used to send the outdoor image to the server. The outdoor image includes a target video, which is used to indicate a memory video viewing request. The memory video viewing request includes a target memory period and a target memory object. The memory period corresponding to the target video matches the target memory period. If the target memory object exists in a separate album, and if the separate album contains a video whose memory period matches the target memory period, then the target video indicates the video in the separate album whose memory period matches the target memory period. The memory object in the memory videos included in the separate album includes the target memory object. If the separate album does not contain a video matching the target memory period, and the memory period corresponding to the alternative video completely includes the target memory object... If the target memory period is specified, the target video indicates a video extracted from the candidate videos, where the candidate videos are the videos in the individual video set with the highest matching degree between the memory period and the target memory period. If there is no video in the individual video set that matches the target memory period, and the memory period corresponding to the candidate videos does not completely include the target memory period, then the target video simultaneously indicates both the candidate videos in the individual video set and the videos in the comprehensive video set. The comprehensive video set includes all outdoor images from the smart doorbell, and the candidate videos in the individual video set indicated by the target video are usable videos extracted from the candidate videos. The memory period corresponding to the usable videos is included in the target memory period. The videos in the comprehensive video set indicated by the target video are the videos corresponding to the time period to be acquired in the comprehensive video set, where the time period to be acquired is the time period in the target memory period that does not include the memory period corresponding to the usable videos. If the target object does not have a separate video set, the target video indicates the videos in the comprehensive video set, and the videos in the comprehensive video set indicated by the target video match the target memory period and the feature image corresponding to the target memory.

[0124] In the case of using integrated units, please refer to Figure 10 , Figure 10 This is a functional unit block diagram of another doorbell-based memory video generation device provided in this application embodiment. Figure 10The doorbell-based memory video generation device 800 includes a processing module 812 and a communication module 811. The processing module 812 controls and manages the operation of the doorbell-based memory video generation device 70, for example, executing the steps of the acquisition unit 701 and the transmission unit 702, and / or performing other processes of the technology described herein. The communication module 811 is used for interaction between the doorbell-based memory video generation device and other devices. Figure 8 As shown, the doorbell-based memory video generation device 800 may further include a storage module 813, which is used to store the program code and data of the doorbell-based memory video generation device.

[0125] The processing module 812 can be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an ASIC, an FPGA, or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc. The communication module 811 can be a transceiver, RF circuitry, or a communication interface, etc. The storage module 813 can be a memory.

[0126] All relevant content in each scenario involved in the above method embodiments can be referenced from the functional descriptions of the corresponding functional modules, and will not be repeated here. The above-mentioned doorbell-based memory video generation device 800 can perform the above... Figure 3 The method shown is a doorbell-based memory video generation method applied to smart doorbells.

[0127] The above mainly describes the solutions of the embodiments of this application from the perspective of the method execution process. It is understood that, in order to achieve the above functions, the electronic device includes the corresponding hardware structure and software modules for executing each function. Those skilled in the art should readily recognize that, in conjunction with the units and algorithm steps of the various examples described in the embodiments provided herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0128] This application embodiment can divide the electronic device into functional units according to the above method example. For example, each function can be divided into a separate functional unit, or two or more functions can be integrated into one processing unit. The integrated unit can be implemented in hardware or as a software functional unit. It should be noted that the unit division in this application embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0129] This application also provides a chip, wherein the chip includes a processor for calling and running a computer program from a memory, causing a device on which the chip is installed to perform some or all of the steps described in the above method embodiments of the electronic device.

[0130] This application also provides a computer storage medium storing a computer program for electronic data interchange, which causes a computer to perform some or all of the steps of any of the methods described in the above method embodiments, wherein the computer includes an electronic device.

[0131] This application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods described in the above method embodiments. The computer program product may be a software installation package, and the computer may include an electronic device.

[0132] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0133] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0134] In the several embodiments provided in this application, it should be understood that the disclosed apparatus can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of the units described above is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical or other forms.

[0135] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0136] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0137] If the integrated units described above are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned memory includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0138] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, which may include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.

[0139] The embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

[0140] While the present invention has been disclosed above, it is not limited thereto. Any person skilled in the art can easily conceive of variations or substitutions without departing from the spirit and scope of the present invention, and various modifications and alterations can be made, including combinations of the different functions and implementation steps described above, as well as software and hardware implementation methods, all of which are within the protection scope of the present invention.

Claims

1. A method for generating memory videos based on doorbells, characterized in that, A server for a doorbell system, the doorbell system including the server, a smart doorbell, and an electronic device, wherein the server, the smart doorbell, and the electronic device are communicatively connected, the method comprising: Obtain a video viewing request from the electronic device, the video viewing request including a target time period and a target object of memory; Determine whether the target memory object exists in a separate video album, wherein the memory objects in the memory videos included in the separate video album include the target memory object; If the individual video set exists, it is determined whether the target video exists in the individual video set, and the memory period corresponding to the target video matches the target memory period. If the target video exists, then the target video is sent to the electronic device; If the target video does not exist, alternative videos are obtained from the individual video collection. The memory period corresponding to the alternative video has the highest matching degree with the target memory period, and it is determined whether the memory period corresponding to the alternative video completely includes the target memory period. If all are included, the target video is extracted from the candidate videos according to the target recall period and sent to the electronic device; If not fully included, a usable video is extracted from the candidate videos, and the memory period corresponding to the usable video is included in the target memory period; the time period that does not include the memory period corresponding to the usable video in the target memory period is determined as the time period to be acquired; the video corresponding to the time period to be acquired is acquired from the comprehensive video collection, which includes all outdoor images from the smart doorbell; the target video is generated based on the usable video and the video corresponding to the time period to be acquired; the target video is sent to the electronic device; If the individual video set does not exist, a feature image of the target memory object is obtained; the target video is obtained from the integrated video set based on the feature image and the target memory period; and the target video is sent to the electronic device.

2. The method according to claim 1, characterized in that, Before obtaining the request to view the memory video from the electronic device, the method further includes: Acquire outdoor images from the smart doorbell; Determine whether the time of acquiring the outdoor image is a preset time, the preset time including the time of the holiday and the time of the user-set time period; If it is the preset time, then the user's living environment is determined based on the outdoor image; The target storage path of the outdoor images in the integrated image set is determined based on the living environment. The outdoor images stored under the same storage path correspond to the same living environment of the users. The outdoor images are stored in the integrated image collection according to the target storage path.

3. The method according to claim 2, characterized in that, The step of storing the outdoor imagery in the integrated image set according to the target storage path includes: The duration of the outdoor image is determined, and the duration of the outdoor image is used to indicate the time from when an object in the outdoor image appears until it enters the door; When the duration of the outdoor video is greater than a first preset duration, the behavioral changes of the objects in the outdoor video are acquired; the outdoor video is edited according to the behavioral changes to obtain a stored video, wherein the duration of the stored video is less than a second preset duration and the second preset duration is greater than the first preset duration. When the duration of the outdoor image is less than or equal to the first preset duration, the outdoor image is determined to be the stored video. The stored video is stored in the comprehensive video album according to the target storage path.

4. The method according to claim 3, characterized in that, The step of obtaining the target video from the integrated photo set based on the feature image and the target memory period includes: Based on the feature images and the target recall period, multiple candidate videos are determined from the comprehensive video collection; Determine whether the storage paths of the multiple candidate videos are completely identical; If so, the target video is generated based on the plurality of alternative stored videos; If not, then determine the number of alternative storage videos included in each storage path corresponding to the plurality of alternative storage videos; The target storage video corresponding to each storage path is determined from the plurality of candidate storage videos based on the number of candidate storage videos; The target video is generated based on the target stored video.

5. The method according to claim 4, characterized in that, The request to view the memory video also includes a target memory duration, and before sending the target video to the electronic device, the method further includes: Determine whether the duration of the target video is the same as the duration of the target memory; If they are not the same, then the difference between the duration of the target video and the duration of the target memory is determined; If the gap indicates that the duration of the target video is greater than the target memory duration, the target video is edited to obtain a playback video, the duration of which is the same as the target memory duration. If the gap indicates that the duration of the target video is less than the target recall duration, a reference stored video is determined from the composite image set based on the feature image and the target recall period, wherein the target video does not include the reference stored video; the duration to be supplemented is determined based on the gap; a supplemented video is generated based on the duration to be supplemented and the reference stored video; and a playback video is generated based on the supplemented video and the target video. Sending the target video to the electronic device includes: The video is sent to the electronic device.

6. The method according to claim 5, characterized in that, The reference stored videos include multiple videos, and the step of generating supplementary videos based on the duration to be supplemented and the reference stored videos includes: Obtain the number of other objects included in each of the multiple reference storage videos, wherein the other objects are objects in the reference storage video other than the target memory object; The plurality of reference stored videos are sorted according to the number of the other objects; The reference stored videos are merged and edited sequentially according to the order until the supplementary video is obtained, and the duration of the supplementary video matches the duration to be supplemented.

7. The method according to any one of claims 1-6, characterized in that, After sending the target video to the electronic device, the method further includes: Obtain an exit request from the electronic device, the exit request being used to indicate exiting the viewing interface of the target video; Send a prompt message to the electronic device, the prompt message being used to prompt the electronic device whether to save the target video; Obtain response information from the electronic device; If the response information indicates that the target video should be saved, the target video will be saved to a separate album corresponding to the target memory object; If the response message indicates that the target video should not be saved, then delete the target video.

8. A method for generating memory videos based on doorbells, characterized in that, An electronic device applied to a doorbell system, the doorbell system including a server, a smart doorbell, and the electronic device, wherein the server, the smart doorbell, and the electronic device are communicatively connected, and the method includes: Send a request to the server to view the memory video, the request including the target memory period and the target memory object; Acquire and play a target video from the server, wherein the memory segment corresponding to the target video matches the target memory segment; if the target memory object exists in a separate album, and if the separate album contains a video whose memory segment matches the target memory segment, then the target video indicates the video in the separate album whose memory segment matches the target memory segment, and the memory object in the memory videos included in the separate album includes the target memory object; if the separate album does not contain a video matching the target memory segment, and the memory segment corresponding to the candidate video completely includes the target memory segment, then the target video indicates a video extracted from the candidate video, and the candidate video is the video in the separate album with the highest matching degree between the memory segment and the target memory segment; if the separate album does not contain a video matching the target memory segment, and the candidate video... If the corresponding memory period does not completely include the target memory period, then the target video simultaneously indicates a candidate video in the individual video set and a video in the comprehensive video set. The comprehensive video set includes all outdoor images from the smart doorbell, and the candidate video in the individual video set indicated by the target video is a usable video extracted from the candidate video. The memory period corresponding to the usable video is included in the target memory period. The video in the comprehensive video set indicated by the target video is the video corresponding to the time period to be acquired in the comprehensive video set. The time period to be acquired is the time period in the target memory period that does not include the memory period corresponding to the usable video. If the target memory object does not have a separate video set, the target video indicates a video in the comprehensive video set, and the video in the comprehensive video set indicated by the target video matches the target memory period and the feature image corresponding to the target memory.

9. A method for generating memory videos based on doorbells, characterized in that, A smart doorbell for use in a doorbell system, the doorbell system including a server, the smart doorbell and an electronic device, the server, the smart doorbell and the electronic device being communicatively connected respectively, the method including: Acquire outdoor images when the conditions for outdoor image recording are met; The outdoor image is sent to the server. The outdoor image includes a target video, which is used to indicate a request to view a memory video. The request to view a memory video includes a target memory period and a target memory object. The memory period corresponding to the target video matches the target memory period. If the target memory object exists in a separate album, and if the separate album contains a video whose memory period matches the target memory period, then the target video indicates the video in the separate album whose memory period matches the target memory period. The memory object in the memory videos included in the separate album includes the target memory object. If the separate album does not contain a video matching the target memory period, and the memory period corresponding to a candidate video completely includes the target memory period, then the target video indicates a video extracted from the candidate video. The candidate video is the video in the separate album with the highest matching degree between the memory period and the target memory period. If the separate album contains a video, then the target video indicates the video extracted from the candidate video. If no video in the album matches the target memory period, and the memory period corresponding to the candidate video does not completely include the target memory period, then the target video simultaneously indicates a candidate video in the individual album and a video in the comprehensive album. The comprehensive album includes all outdoor images from the smart doorbell, and the candidate video in the individual album indicated by the target video is a usable video extracted from the candidate videos. The memory period corresponding to the usable video is included in the target memory period. The video in the comprehensive album indicated by the target video is the video corresponding to the time period to be acquired in the comprehensive album, and the time period to be acquired is the time period in the target memory period that does not include the memory period corresponding to the usable video. If the target memory object does not exist in a separate album, the target video indicates a video in the comprehensive album, and the video in the comprehensive album indicated by the target video matches the target memory period and the feature image corresponding to the target memory.

10. A doorbell system, characterized in that, It includes a server, a smart doorbell, and an electronic device, wherein the server, the smart doorbell, and the electronic device are respectively communicatively connected; The server is configured to execute instructions for the steps of the method as described in any one of claims 1-7; The electronic device is used to execute instructions for the steps in the method as described in claim 8; The smart doorbell is used to execute instructions for the steps in the method as described in claim 9.

Images