Modular and combinable intelligent photo album management methods and systems

Abstract

This application discloses a modular and combinable intelligent photo album management method and system. The method includes client device management, media management, and playback scheme management. This application employs a combination of hardware and software with a modular hardware design, significantly reducing user costs. The software client design allows users to simulate an electronic photo frame client using existing smart devices. Furthermore, this application adopts a centralized management and control scheme, enabling multiple clients to work collaboratively, and centralized file storage facilitates user file management. Secondly, multiple control terminals are possible, and multiple clients can not only display content individually but also collaboratively, resulting in more powerful and flexible functionality. Finally, it is not only suitable for televisions but can also adapt to a wider range of display clients, offering more powerful functionality. Benefiting from dedicated storage devices, it has greater storage capacity and can store richer data resources.

Description

Technical Field

[0001] This application relates to the field of electronic photo album technology, and in particular to a modular and combinable intelligent photo album management method and system. Background Technology

[0002] A digital photo album is a special document that can be viewed on a computer, distinct from CDs / VCDs containing still images. Its content is not limited to photographs but can also include various artistic creations. Digital photo albums possess unparalleled advantages over traditional photo albums: a rich combination of images, text, sound, and video; easy editing capabilities; rapid retrieval; permanent preservation without fading; and convenient, inexpensive copying and distribution.

[0003] Patent application CN200810105635.2, entitled "Method, System, and Electronic Photo Frame for Sending Pictures Between Electronic Photo Frames," discloses a method for sending pictures between electronic photo frames, comprising: receiving a picture sending request from a sending electronic photo frame based on a pre-configured association between the sending and receiving electronic photo frames on the network side; and sending the picture carried in the picture sending request to a designated receiving electronic photo frame. This application also discloses a system for sending pictures between electronic photo frames and an electronic photo frame. The method for sending pictures between electronic photo frames provided in this application enables picture sharing between the sending and receiving electronic photo frames. It proposes a solution for sending pictures between multiple electronic photo frames, but it lacks centralized storage and management, requires high computing power from each client device, and each device must be purchased separately, resulting in excessively high overall costs. Besides sharing pictures, the devices cannot collaborate.

[0004] Application CN201510675914.2, entitled "An Electronic Photo Frame," proposes an electronic photo frame with a display screen and an external power supply. The electronic photo frame has a single physical button for turning the display screen on and off, and a unique pairing code for binding with a mobile client. The display screen is used to show information pushed by the mobile client. This application provides an electronic photo frame with information interaction capabilities and its interaction method, which can establish an emotional interaction bridge between the mobile client and the owner of the electronic photo frame. The information pushed by the mobile client to the electronic photo frame is personalized, increasing user engagement and promoting the product. However, it focuses on a one-to-one combination of a single electronic photo frame and a mobile client, essentially turning the mobile client into the control terminal and storage device of the electronic photo frame.

[0005] Patent application CN115396711A, entitled "A Method, Device, Equipment, and Medium for a Smart TV Desktop Electronic Photo Frame Screensaver," provides a method, device, equipment, and medium for a smart TV desktop electronic photo frame screensaver. The method includes: when the screensaver is activated, first determining the default playback data; if the default data is from an electronic photo frame application, then detecting whether user-uploaded data exists on the smart TV's electronic photo frame application; if so, acquiring the user-uploaded data, which includes images, videos, or audio; if the default screensaver data is provided by a service provider, then acquiring the service provider's screensaver data; playing the acquired screensaver data using the smart TV's built-in player; if the acquired screensaver data is incompatible with the smart TV, automatically converting it to a compatible format before playback. This adds an electronic photo frame screensaver function to the existing screensaver functionality, allowing users to not only enjoy screensaver resources provided by service providers but also upload their own images, videos, or audio to set as screensaver playback content, thereby improving the user experience. However, this application focuses on using the TV's screensaver function to play user data, and the user data needs to be uploaded to the TV's built-in storage. The function is relatively simple and limited by the TV's storage space.

[0006] In summary, most existing digital photo frame products use local storage, memory cards, or cloud storage to store user photos or video files. Besides image and video playback, they also include many other functions, requiring powerful computing capabilities and thus increasing costs. Furthermore, current digital photo frame products are primarily designed for single-item use, making it impossible to combine multiple products. For example, if a user wants to create a photo wall displaying multiple photos in a specific arrangement, they need to purchase multiple individual frames, configure them individually, and then place them in their designated positions. Changing the displayed content requires further individual configuration.

[0007] Application content

[0008] This application provides a modular and combinable intelligent photo album management method and system, which is a low-cost, inexpensive, and feature-rich electronic photo frame product that can overcome the shortcomings of the prior art described in the background.

[0009] The first aspect of this application proposes a modular and combinable intelligent photo album management method, including multiple electronic photo album clients and an electronic photo album server, wherein the multiple electronic photo album clients are communicatively connected to the electronic photo album server, and its working steps include:

[0010] S1. Client device communication connection steps, including:

[0011] First, use the client software to scan the client's unique QR code to complete the binding;

[0012] After successful binding, use the client software to complete the network configuration of the finished client;

[0013] After successful network configuration, the client broadcasts a server query message to the network. The server software responds to the message upon receiving it. If the client does not receive a response message, it remains silent for a period of time and then broadcasts the server query message again.

[0014] After receiving the above response message, the client sends a device registration message to the server. The message content includes, but is not limited to, the device's unique identifier ID, initial key, display resolution, and media support information.

[0015] After receiving the device registration message, the server uses the initial key to establish an encrypted communication link with the client based on the QUIC protocol and sends a heartbeat detection message to the client through this link.

[0016] After receiving the heartbeat detection message, the client sends a response message.

[0017] S2, Media Management Steps, including:

[0018] Open the client software on any simulated client, select the client management function, and the client will request the client list and configuration scheme from the server.

[0019] The server responds to the above request and sends the result data;

[0020] After the client receives the data, it will perform a graphical rendering display according to the configuration scheme.

[0021] S3. Playback scheme execution steps, including:

[0022] If the client is a pre-built client, the server will mix the playback content into streaming media content and push it to the client;

[0023] If the client is a simulated client, the server first pushes the playback scheme to the client. The client software requests and reserves a certain amount of storage space as a cache based on the host system information. This cache is used to store playback content, including but not limited to schemes, plugins, music, photos, and videos. Then, according to the playback scheme, the client requests the playback content and plugin content from the server in sequence. After obtaining the corresponding content, the client processes the content locally and then displays and plays it out.

[0024] Based on the screen resolution reported by the client, the playback content is re-encoded and then pushed.

[0025] Based on the media support information reported by the client, determine whether it is necessary to push audio information;

[0026] Based on the transition effect settings and the content of the preceding and following frames, interpolated frame content is generated and pushed to the client to form a visual transition.

[0027] Mixing photos and their captions, mixing videos and their subtitles, mixing photos or videos with music and artistic lyrics;

[0028] Plugin content can be overlaid with mixed photo or video content;

[0029] For scenarios where all clients of the photo wall are combined into a spliced ​​screen to play the same content, photos are cropped to generate content for each client separately.

[0030] Furthermore, after receiving the data, the client performs graphical rendering and display according to the configuration scheme, and performs the following operations:

[0031] View individual clients, set aliases for clients, remove clients, and set playback schemes for clients;

[0032] Add, delete, or edit the photo wall; add multiple clients to the photo wall; set the placement and orientation of each client within the photo wall.

[0033] Add floor plans and set the location of each client or photo wall;

[0034] Select the same playback scheme for multiple clients or photo walls, set different playback schemes for each client, and set a playback scheme list for a specific device.

[0035] Furthermore, the step of determining whether to push audio information based on the media support information reported by the client specifically involves:

[0036] For situations where audio information needs to be pushed, the server will mix the playback content and the audio content.

[0037] In cases where audio information needs to be removed, the server will discard the audio information directly during the mixing process.

[0038] Furthermore, the photo cropping process specifically involves: setting up a photo wall by arranging and combining the electronic albums from multiple clients in a certain combination, and then optimally overlaying it with the original photos, and cropping the photos based on the overlay result.

[0039] Furthermore, after obtaining the relevant content, the content is processed locally, including but not limited to: implementing transition effect rendering, playing background music and displaying artistic lyrics while playing photos, and displaying the caption of the photo while playing the photo.

[0040] Furthermore, in step S3, the playback scheme includes, but is not limited to: playback time period, playback content list, transition effects, background music, whether to enable plugins, and plugin selection configuration items.

[0041] Furthermore, the client sends the audio content to the server, which parses the command and then executes it or sends the command to the client software for execution. The server determines the client type based on the client type: if it is a finished client, it changes the client's mixing content and playback scheme settings; if it is an analog client, it sends a command to the client to change its playback scheme settings and playback progress settings.

[0042] This application also proposes an electronic photo album client for implementing the above-mentioned modular and combinable intelligent photo album management method, comprising at least: a core processor module, a display screen module, a storage module, and a power supply module. The core processor module is electrically connected to the display screen module, the storage module, and the power supply module. The power supply module includes a DC power supply module, a USB power supply module, and a battery module. The core processor module is also electrically connected to any one or a combination of a speaker module, a wireless network connection module, a PoE network and power supply module, and a microphone module. The core processor module controls the operation of a client device management service interface, a media management service interface, and a playback scheme management service interface on the display screen module.

[0043] This application also proposes an electronic album server for implementing the above-mentioned modular and combinable intelligent album management method, characterized in that it includes a processor module, a power module, a memory module, and a display module, wherein the processor module runs a client device management service software module, a media management service software module, and a playback scheme management service software module when executing the method.

[0044] This application also proposes a system for implementing the above-mentioned modular and combinable intelligent photo album management method, including multiple electronic photo album clients and an electronic photo album server. The multiple electronic photo album clients are communicatively connected to the electronic photo album server to realize client device management services, media management services, and playback scheme management services.

[0045] The above-described technical solutions adopted in the embodiments of this application can achieve the following beneficial effects:

[0046] 1. This application adopts a combination of hardware and software with a modular hardware design, which can significantly reduce user costs. The software client design allows users to simulate an electronic photo frame client using existing smart devices. Furthermore, this application employs a centralized management and control scheme, enabling multiple clients to work collaboratively, and centralized file storage facilitates file management for users.

[0047] 2. This application focuses on an electronic photo frame network system composed of multiple clients. In this system, there can be multiple control terminals, and multiple clients can not only display content individually, but also display content collaboratively, making the functions more powerful and flexible.

[0048] 3. This application is not only applicable to televisions, but can also be adapted to a wider variety of display clients, and its functions are relatively more powerful. Benefiting from dedicated storage devices, it has a larger space and can store more data resources. Attached Figure Description

[0049] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0050] Figure 1 This is a functional structure diagram of the modular and combinable smart photo album system of this application.

[0051] Figure 2 This is a flowchart illustrating the usage mode of the modular and combinable smart photo album system described in this application.

[0052] Figure 3 This is a flowchart of the modular and composable intelligent photo album management method of this application. Detailed Implementation

[0053] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0054] The technical solutions provided by the various embodiments of this application are described in detail below with reference to the accompanying drawings.

[0055] Example 1

[0056] This invention includes a low-cost electronic photo frame client, an electronic photo album server software based on a home storage center, and an electronic photo album client software suitable for smartphones / TVs / tablets and PCs. For example... Figure 1 As shown, smartphones / TVs / tablets and PCs with the electronic photo album client software installed can all be considered as one electronic photo frame client. Alternatively, electronic photo frame clients can be purchased directly. Multiple electronic photo frame clients connected to a home LAN can form a smart photo album system with the electronic photo album server. The electronic photo album server software utilizes the powerful storage space of the carrier device (such as a home NAS) to centrally manage users' photos, videos, audio, and other media content, and uniformly manage the content displayed on each electronic photo frame client, user control command input, and the collaborative work of multiple electronic photo frame clients. Specifically, the implementation includes the following processes or functions:

[0057] I. Initialization and Network Setup

[0058] The electronic photo frame client needs to complete network registration with the electronic photo album server (hereinafter referred to as the server) before it can be used normally. For ease of understanding, the following text uses "simulated client" to refer to the electronic photo frame client composed of smartphone / TV / tablet and PC + electronic photo album client (hereinafter referred to as client) software, and "finished client" to refer to the customized electronic photo frame client hardware product. "Client" is used as a general term for the above two types of clients. In the following steps, the finished client starts from step 1.1, while the simulated client is assumed to have already joined the home LAN, so it starts from step 1.3.

[0059] 1.1 After the finished client is powered on, the user needs to be bound first. The user can use the client software on their mobile phone to scan the client's unique QR code to complete the binding.

[0060] 1.2 After successful binding, use the client software on your mobile phone to complete the network configuration of the finished client. (The network configuration process is similar to that of existing IoT devices and will not be described in detail here.)

[0061] 1.3 After successful network configuration, the client broadcasts a query message to the server within the network. The server software responds upon receiving the message. If the client does not receive a response, it remains silent for a period of time before broadcasting the query message again.

[0062] 1.4 After receiving the above response message, the client sends a device registration message to the server. The message content includes information such as the device's unique identifier ID, initial key, display resolution, and media support.

[0063] 1.5 After receiving the device registration message, the server uses the initial key to establish an encrypted communication link with the client based on the QUIC protocol and sends a heartbeat detection message to the client through this link.

[0064] 1.6 After receiving the heartbeat detection message, the client sends a response message.

[0065] 2. Client Management

[0066] The following functions can achieve various effects such as all clients playing the same content, clients in the same room playing the same content, different clients playing different content, different clients playing different content in the photo wall, and all clients in the photo wall forming a splicing screen to play the same content.

[0067] 2.1 The user opens the client software on any simulated client and selects the client management function. The client requests a list of clients and configuration schemes from the server.

[0068] 2.2 The server responds to the above request and sends the result data.

[0069] 2.3 After the client receives the data, it will perform a graphical rendering display according to the configuration scheme. On this display interface, users can perform the following operations:

[0070] 2.3.1 You can see the individual client, set an alias for the client, remove the client, and set a playback scheme for the client.

[0071] 2.3.2 Users can add, delete, or edit photo walls. Multiple clients can be added to a photo wall. The placement and orientation of each client within the photo wall can be set.

[0072] 2.3.3 You can add floor plans and set the location of each client or photo wall.

[0073] 2.3.4 You can select the same playback scheme for multiple clients or photo walls, or set different playback schemes for each client, or set a playback scheme list for a specific device.

[0074] 3. Execution of the playback plan

[0075] The playback scheme includes: playback time period, playback content list, transition effects, background music, whether to enable plugins, and plugin selection. After setting the playback scheme for the client or photo wall, the server software processes the playback content according to the client type and the configuration items in the playback scheme before pushing it to the target device. The server-side processing includes the following:

[0076] 3.1 If the client is a pre-built client, the server will mix the playback content into streaming media content and push it to the client.

[0077] 3.2 If the client is a simulated client, the server first pushes the playback scheme to the client. The client software requests and reserves a certain amount of storage space as a cache based on the host system information to store content such as playback schemes, plugins, music, photos, and videos. Then, according to the playback scheme, it requests the playback content (which is content adapted to the local screen resolution) and plugin content from the server in sequence. After obtaining the corresponding content, it performs content processing locally (e.g., overlaying weather forecast plugins on photos or videos, implementing transition effects rendering, playing background music and displaying artistic lyrics while playing photos, displaying captions for photos while playing photos, etc.) before displaying and playing the output.

[0078] 3.3. Based on the screen resolution reported by the client, the playback content is re-encoded before being pushed to reduce display distortion.

[0079] 3.4. Based on the media support information reported by the client, determine whether it is necessary to push audio information to save network bandwidth and computing power. Specifically, this includes:

[0080] 3.4.1 For situations where audio information needs to be pushed (such as when the client supports audio and background music has been added to the playback scheme), the server will mix the playback content and the audio content.

[0081] 3.4.2 For cases where audio information needs to be removed (such as when the client does not support audio and the playback scheme includes video), the server will directly discard the audio information during mixing.

[0082] 3.3. Generate interpolated frame content based on the transition effect settings and the content of the preceding and following frames, and push it to the client to form a visual transition.

[0083] 3.4. Mixing photos and their captions, mixing videos and their subtitles, mixing photos or videos with music and artistic lyrics, etc.

[0084] 3.5. Plugin content can be overlaid with mixed photo or video content.

[0085] 3.6. For scenarios where all clients of the photo wall are combined into a spliced ​​screen to play the same content, according to... Figure 2 The method is used to crop the photos and generate content for each client separately.

[0086] 4. User Interaction

[0087] Voice interaction is supported when the client includes a microphone. Users activate voice interaction using a wake word. Users can perform actions such as opening the weather app, switching the currently playing content to a specific client, playing photos from a trip to Japan last year, or playing photos of their son at age 3. The client itself does not have built-in voice AI processing capabilities; it needs to send the audio content picked up by the microphone to the server. The server then parses the command and executes it (for finished clients) or sends the command to the client software for execution (for simulated clients). An example of command parsing and execution is as follows:

[0088] 4.1 Enable Weather: The server determines the weather setting based on the client type. If it is a finished client, the weather plugin rendering content is added during the mixing process; if it is a simulated client, a command is sent to the client to add weather settings in the playback scheme.

[0089] 4.2 Switch the current playback content to a specific client: The server determines the client type based on the client type. If it is a finished client, the server changes the client's mixed streaming content and playback scheme settings; if it is a simulated client, the server sends a command to the client to change its playback scheme settings and playback progress settings.

[0090] 4.3 Playing photos from last year's trip to Japan: The server identifies content in the media library that contains corresponding time and location tags, generates a new playback scheme for the target client, and executes it.

[0091] 4.4 Playing photos of the son when he was 3 years old: The server identifies content in the media library that contains the corresponding time and person tags, generates a new playback scheme for the target client, and executes it.

[0092] 5. Server-side media management

[0093] After the server sets up the media library directory, the software scans the media files (mainly images, audio, and video) in each level of the media library and performs different information processing on different types of media files. Then, a media index database is created to store various types of data related to the media files, mainly including file information (directory, filename, file type, creation time, modification time, hash value, etc.), tag information (time, location, people, landscape, theme, etc.), and notes (lyrics for audio, subtitles for video, captions for images, etc.).

[0094] 5.1 Image Files: Identify information such as the exi f of images, obtain the photo's shooting time, location, shooting device, and file modification time, and store this information in the database. Utilize AI capabilities to identify people, landscapes, color tones, objects, and other information in images and store them in the database. Utilize AI capabilities to identify duplicate or consecutively taken images, set associated tags, and store them in the database.

[0095] 5.2 Audio files: Identify the singer, song title, album, album year, playback duration, encoding format, and other information of the audio file and store it in the database.

[0096] 5.3 Video files: Identify video bitrate, encoding format, resolution and other information and store it in the database. Use AI capabilities to analyze video content and identify people, landscapes, color tones, objects and other information and store it in the database.

[0097] 5.4. Users can browse media files on the server by category using the media management function in the client software. They can filter media files by keywords and keyword combinations. Users can manually add, modify, and delete tags for selected files, add captions to image files, lyrics to audio files, and subtitles to videos. Albums can be created. Users can set a first-priority photo in a group of repeated or continuous shots without deleting other photos. After setting this, the system and client will only use the first-priority photo in future use cases.

[0098] 6. Playback Plan Management

[0099] Playback schemes include configuration items such as playback time period, playback content list, transition effects, background music, whether plugins are enabled, and plugin selection. Users can select media files that meet the requirements using the media management function and add them to the playback scheme. Schemes can be created, modified, and deleted in the playback scheme management interface. Users can set the content of the playback scheme, configure whether plugins such as weather, calendar, and reminders are enabled, and determine the plugin location (plugin location can be fixed or intelligently positioned), as well as configure the aforementioned settings.

[0100] 7. Electronic Photo Frame Client

[0101] The electronic photo frame client consists of a display screen module, a speaker module, a DC power supply module, a USB power supply module, a wireless network connection module, a battery module, a PoE network and power supply module, a microphone module, and a core processor module. The display screen module and the core processor module are mandatory; the speaker module, DC power supply module, USB power supply module, wireless network connection module, microphone module, battery module, and PoE network and power supply module are optional and can be flexibly combined according to network connectivity, power supply conditions, home wiring, and usage scenarios. The display screen module supports various sizes and resolutions. The core processor module must support streaming media decoding.

[0102] 8. Server-side software

[0103] The server-side software primarily includes functions such as client device management services, media management services, and playback scheme management services. The server-side software needs to be deployed on devices with network access and ample storage space, such as home NAS devices or PCs.

[0104] 9. Client software

[0105] The client software primarily includes the following functions: client device management interface, media management interface, playback scheme management interface, service discovery and client registration, and client emulation. The client software is mainly deployed on smart devices such as mobile phones, TVs, tablets, or PCs. Its main function is to emulate the host device as an electronic photo frame client or to become the management and control terminal of a smart photo album system.

[0106] 10. The client keeps the screen black during non-playtime periods, but continues to respond to the server's heartbeat detection messages.

[0107] Example 2

[0108] like Figure 1 , Figure 3As shown, the first aspect of this application proposes a modular and combinable intelligent photo album management method, including multiple electronic photo album clients and an electronic photo album server. The multiple electronic photo album clients communicate with the electronic photo album server, and its working steps include:

[0109] S1. Client device communication connection steps, including:

[0110] First, use the client software to scan the client's unique QR code to complete the binding;

[0111] After successful binding, use the client software to complete the network configuration of the finished client;

[0112] After successful network configuration, the client broadcasts a server query message to the network. The server software responds to the message upon receiving it. If the client does not receive a response message, it remains silent for a period of time and then broadcasts the server query message again.

[0113] After receiving the above response message, the client sends a device registration message to the server. The message content includes, but is not limited to, the device's unique identifier ID, initial key, display resolution, and media support information.

[0114] After receiving the device registration message, the server uses the initial key to establish an encrypted communication link with the client based on the QUIC protocol and sends a heartbeat detection message to the client through this link.

[0115] After receiving the heartbeat detection message, the client sends a response message.

[0116] S2, Media Management Steps, including:

[0117] Open the client software on any simulated client, select the client management function, and the client will request the client list and configuration scheme from the server.

[0118] The server responds to the above request and sends the result data;

[0119] After the client receives the data, it will perform a graphical rendering display according to the configuration scheme.

[0120] S3. Playback scheme execution steps, including:

[0121] If the client is a pre-built client, the server will mix the playback content into streaming media content and push it to the client;

[0122] If the client is a simulated client, the server first pushes the playback scheme to the client. The client software requests and reserves a certain amount of storage space as a cache based on the host system information. This cache is used to store playback content, including but not limited to schemes, plugins, music, photos, and videos. Then, according to the playback scheme, the client requests the playback content and plugin content from the server in sequence. After obtaining the corresponding content, the client processes the content locally and then displays and plays it out.

[0123] Based on the screen resolution reported by the client, the playback content is re-encoded and then pushed.

[0124] Based on the media support information reported by the client, determine whether it is necessary to push audio information;

[0125] Based on the transition effect settings and the content of the preceding and following frames, interpolated frame content is generated and pushed to the client to form a visual transition.

[0126] Mixing photos and their captions, mixing videos and their subtitles, mixing photos or videos with music and artistic lyrics;

[0127] Plugin content can be overlaid with mixed photo or video content;

[0128] For scenarios where all clients of the photo wall are combined into a spliced ​​screen to play the same content, photos are cropped to generate content for each client separately.

[0129] In this embodiment, after receiving the data, the client performs graphical rendering and display according to the configuration scheme, and performs the following operations:

[0130] View individual clients, set aliases for clients, remove clients, and set playback schemes for clients;

[0131] Add, delete, or edit the photo wall; add multiple clients to the photo wall; set the placement and orientation of each client within the photo wall.

[0132] Add floor plans and set the location of each client or photo wall;

[0133] Select the same playback scheme for multiple clients or photo walls, set different playback schemes for each client, and set a playback scheme list for a specific device.

[0134] In this embodiment, based on the media support information reported by the client, it is determined whether audio information needs to be pushed, specifically as follows:

[0135] For situations where audio information needs to be pushed, the server will mix the playback content and the audio content.

[0136] In cases where audio information needs to be removed, the server will discard the audio information directly during the mixing process.

[0137] In this embodiment, photo cropping is performed by: setting up a photo wall with the electronic albums of multiple clients in a certain arrangement and combination, and then overlaying it with the original photos in the best possible way, and cropping the photos based on the overlay result.

[0138] In this embodiment, after obtaining the relevant content, the content is processed locally, including but not limited to: implementing transition effect rendering, playing background music and displaying artistic lyrics while playing photos, and displaying the caption of the photo while playing the photo.

[0139] In this embodiment, the playback scheme in step S3 includes, but is not limited to: playback time period, playback content list, transition effects, background music, whether to enable plugins and plugin selection configuration items.

[0140] In this embodiment, the client sends the audio content to the server, which parses the command and executes it or sends the command to the client software for execution. The server determines the client type based on the client type. If it is a finished client, the server changes the client's mixing content and playback scheme settings. If it is an analog client, the server sends a command to the client to change its playback scheme settings and playback progress settings.

[0141] Example 3

[0142] This application also proposes an electronic photo album client for implementing the above-mentioned modular and combinable intelligent photo album management method, comprising at least: a core processor module, a display screen module, a storage module, and a power supply module. The core processor module is electrically connected to the display screen module, the storage module, and the power supply module. The power supply module includes a DC power supply module, a USB power supply module, and a battery module. The core processor module is also electrically connected to any one or a combination of a speaker module, a wireless network connection module, a PoE network and power supply module, and a microphone pickup module. The core processor module controls the operation of a client device management service interface, a media management service interface, and a playback scheme management service interface on the display screen module.

[0143] This application also proposes an electronic album server for implementing the above-mentioned modular and combinable intelligent album management method, characterized in that it includes a processor module, a power module, a memory module, and a display module, wherein the processor module runs a client device management service software module, a media management service software module, and a playback scheme management service software module when executing the method.

[0144] This application also proposes a system for implementing the above-mentioned modular and combinable intelligent photo album management method, including multiple electronic photo album clients and an electronic photo album server. The multiple electronic photo album clients communicate with the electronic photo album server to realize client device management services, media management services, and playback scheme management services.

[0145] In summary, this application employs a combination of hardware and software with a modular hardware design, significantly reducing user costs. The software client design allows users to simulate an electronic photo frame using existing smart devices. Furthermore, the centralized management and control scheme enables multiple clients to work collaboratively, and centralized file storage facilitates user file management. Secondly, multiple control terminals are possible, allowing multiple clients to display content individually or collaboratively, resulting in more powerful and flexible functionality. Finally, it is not only suitable for televisions but also adaptable to a wider range of display clients, offering more powerful features. Benefiting from dedicated storage devices, it has greater storage capacity and can store richer data resources.

[0146] The above description is merely an embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principle of this application should be included within the scope of the claims of this application.

Claims

1. A modular and combinable intelligent photo album management method, characterized in that, It includes multiple electronic photo album clients and an electronic photo album server. The multiple electronic photo album clients communicate with the electronic photo album server, and its working steps include: S1. Client device communication connection steps, including: First, use the client software to scan the client's unique QR code to complete the binding; After successful binding, use the client software to complete the network configuration of the finished client; After successful network configuration, the client broadcasts a server query message to the network. The server software responds to the message upon receiving it. If the client does not receive a response message, it remains silent for a period of time and then broadcasts the server query message again. After receiving the above response message, the client sends a device registration message to the server. The message content includes the device's unique identification ID, initial key, display resolution, and media support information. After receiving the device registration message, the server uses the initial key to establish an encrypted communication link with the client based on the QUIC protocol and sends a heartbeat detection message to the client through this link. After receiving the heartbeat detection message, the client sends a response message. S2, Media Management Steps, including: Open the client software on any simulated client, select the client management function, and the client will request the client list and configuration scheme from the server. The server responds to the above request and sends the result data; After the client receives the data, it will perform a graphical rendering display according to the configuration scheme. S3. Playback scheme execution steps, including: If the client is a pre-built client, the server will mix the playback content into streaming media content and push it to the client; If the client is a simulated client, the server first pushes the playback scheme to the client. The client software requests and reserves a certain amount of storage space as a cache based on the host system information to store the playback scheme, plugins, music, photos, and video content. Then, according to the playback scheme, it requests the playback content and plugin content from the server in sequence. After obtaining the corresponding content, it processes the content locally and then displays and plays it out. Based on the screen resolution reported by the client, the playback content is re-encoded and then pushed. Based on the media support information reported by the client, determine whether it is necessary to push audio information; Based on the transition effect settings and the content of the preceding and following frames, interpolated frame content is generated and pushed to the client to form a visual transition. Mixing photos and their captions, videos and their subtitles, and audio; the audio mixing includes mixing photos or videos with music and artistic lyrics. Plugin content can be overlaid with mixed photo or video content; For scenarios where all clients of the photo wall are combined into a spliced ​​screen to play the same content, photos are cropped to generate content for each client separately.

2. The modular and combinable intelligent photo album management method according to claim 1, characterized in that, After receiving the data, the client performs graphical rendering and display according to the configuration scheme, and performs the following operations: View individual clients, set aliases for clients, remove clients, and set playback schemes for clients; Add, delete, or edit the photo wall; add multiple clients to the photo wall; set the placement and orientation of each client within the photo wall. Add floor plans and set the location of each client or photo wall; Select the same playback scheme for multiple clients or photo walls, set different playback schemes for each client, and set a playback scheme list for a specific device.

3. The modular and combinable intelligent photo album management method according to claim 1, characterized in that, The step of determining whether to push audio information based on the media support information reported by the client specifically involves: For situations where audio information needs to be pushed, the server will mix the playback content and the audio content. In cases where audio information needs to be removed, the server will discard the audio information directly during the mixing process.

4. The modular and combinable intelligent photo album management method according to claim 1, characterized in that, The photo cropping process involves: setting up a photo wall by arranging and combining the electronic photo albums of multiple clients in a certain way, and then overlaying it with the original photos in the best possible way, and cropping the photos based on the overlay result.

5. The modular and combinable intelligent photo album management method according to claim 1, characterized in that, After obtaining the relevant content, the content processing is performed locally, including: implementing transition effect rendering, playing background music and displaying artistic lyrics while playing the photo, and displaying the caption of the photo while playing the photo.

6. The modular and combinable intelligent photo album management method according to claim 1, characterized in that, In step S3, the playback scheme includes: playback time period, playback content list, transition effects, background music, whether to enable plugins and plugin selection configuration items.

7. The modular and combinable intelligent photo album management method according to claim 1, characterized in that, The client sends the audio content to the server, which then parses the command and executes it or sends the command to the client software for execution. The server determines the client type based on the client type. If it is a finished client, the server changes the client's mixing content and playback scheme settings. If it is a simulated client, then send a command to the client to change its playback scheme settings and playback progress settings.

8. An electronic photo album client for implementing the modular and combinable intelligent photo album management method according to any one of claims 1-7, characterized in that, It includes at least: a core processor module, a display screen module, a storage module, and a power supply module, wherein the core processor module is electrically connected to the display screen module, the storage module, and the power supply module; the power supply module includes a DC power supply module, a USB power supply module, and a battery module; the core processor module is also electrically connected to any one or a combination of a speaker module, a wireless network connection module, a PoE network and power supply module, and a microphone pickup module; wherein the core processor module controls the operation of a client device management service interface, a media management service interface, and a playback scheme management service interface on the display screen module.

9. An electronic photo album server for implementing the modular and combinable intelligent photo album management method according to any one of claims 1-7, characterized in that, It includes a processor module, a power supply module, a memory module, and a display module, wherein the processor module runs a client device management service software module, a media management service software module, and a playback scheme management service software module when executing the method.

10. A system for implementing the modular and combinable intelligent photo album management method according to any one of claims 1-7, characterized in that, It includes multiple electronic photo album clients and an electronic photo album server. The multiple electronic photo album clients communicate with the electronic photo album server to realize client device management services, media management services, and playback scheme management services.

Images