Modular intelligent photo album management method and system capable of being combined for use

Abstract

The invention discloses a modular intelligent photo album management method and system capable of being used in a combined mode. The method comprises client equipment management, media management and playing scheme management. According to the application, software and hardware combination and hardware modular design are adopted, the user cost can be greatly reduced, and the software client design enables the user to use the existing intelligent equipment to simulate the digital photo frame client. And a centralized management control scheme is adopted, so that a plurality of clients can work cooperatively, and centralized storage of the files is also convenient for the user to manage the files. And secondly, a plurality of control terminals and a plurality of clients can independently display the content and can cooperatively display the content, so that the function is more powerful and flexible. And finally, the method is not only suitable for televisions, but also suitable for more types of display clients, is relatively powerful in function, is beneficial to special storage equipment, is larger in space, and is richer in storable data resources.

Description

Technical Field

[0001] The present application relates to the technical field of electronic photo albums, and in particular to a modular and combinable intelligent photo album management method and system. Background Art

[0002] Electronic photo albums are special documents that can be viewed on computers, which are different from CD / VCD still images. Their contents are not limited to photographs, but can also include various artistic creations. Electronic photo albums have advantages that traditional photo albums cannot match: the combination of pictures, text, sound and image, the function of free modification and editing, fast retrieval, permanent preservation characteristics that never fade, and the superior means of cheap copying and distribution.

[0003] The patent with application number CN200810105635.2 and application name "Method, system and electronic photo frame for sending pictures between electronic photo frames" discloses a method for sending pictures between electronic photo frames, including: receiving a picture sending request sent by a sender electronic photo frame based on a pre-configured association relationship between the sender electronic photo frame and the receiver electronic photo frame on the network side; sending the picture carried in the picture sending request to a designated receiver electronic photo frame. The present application also discloses a system for sending pictures between electronic photo frames and an electronic photo frame. The method for sending pictures between electronic photo frames provided in the present application realizes picture sharing between the sender electronic photo frame and the receiver electronic photo frame. It proposes a solution for picture sending between multiple electronic photo frames, but there is no centralized storage and management, and the computing power of each client device is required to be high. Moreover, each device must be purchased specially, and the overall cost is too high. In addition to sharing pictures, the devices cannot work together.

[0004] The application number CN201510675914.2 and the application name "An electronic photo frame" proposes an electronic photo frame, which has a display screen and an external power supply, wherein the electronic photo frame has a unique physical button for operating the display screen to turn on and off, and has a unique pairing code for pairing and binding with a mobile client, and the display screen is used to display information pushed by the mobile client. The electronic photo frame with information interaction function and its interaction method provided in this application can establish a bridge of emotional interaction between the mobile client and the owner of the electronic photo frame in the form of emotional interaction. The information pushed by the mobile client obtained on the electronic photo frame is personalized, which improves the user's stickiness to the electronic photo frame, is conducive to the promotion of electronic photo frame products, and improves the user's stickiness to the electronic photo frame. However, it focuses on a one-to-one combination of a single electronic photo frame and a mobile client, which actually turns the mobile client into a control terminal and storage device of the electronic photo frame.

[0005] The patent application number CN115396711A, application name "A method, device, equipment and medium for screensaver of a desktop electronic photo frame for a smart TV" provides a method, device, equipment and medium for screensaver of a desktop electronic photo frame for a smart TV. The method includes: when the screensaver takes effect, first determine the default playback data. If the default is the data of the electronic photo frame application, then detect whether there is user uploaded data on the electronic photo frame application of the smart TV. If so, obtain the user uploaded data, and the user uploaded data includes pictures, videos or audio; if the default is the screensaver data provided by the service provider, then obtain the screensaver data provided by the service provider; call the player provided by the smart TV to play the obtained screensaver data; if the obtained screensaver data is in a data format incompatible with the smart TV, then automatically convert it to a data format compatible with the smart TV before playing. It adds the electronic photo frame screensaver function to the original screensaver function. In addition to enjoying the screensaver resources provided by the service provider, users can also upload pictures, videos or audio as screensaver playback content, thereby improving the user experience. However, this application focuses on using the screen saver function of the TV to play user data, and the user data needs to be uploaded to the built-in storage of the TV. The function is relatively simple and limited by the storage space of the TV.

[0006] In summary, most existing electronic photo frame products use local storage, memory cards or cloud storage to store user photos or video files, and in addition to the picture and video playback function, they also have many other functions, which requires strong computing power for the product itself, thereby increasing the cost of the product. In addition, current electronic photo frame products are basically single-product usage scenarios, and multiple products cannot be used in combination. For example, if a user wants to arrange a photo wall and needs to display multiple photos in a certain arrangement, he needs to purchase multiple single products and set them up separately, and then place them in the corresponding positions; if he wants to change the display content, he needs to set them up again.

[0007] Application Contents

[0008] The present application provides a modular and combinable intelligent photo album management method and system, which is a low-cost, inexpensive and feature-rich electronic photo frame product that can address the deficiencies of the prior art described in the background technology.

[0009] In a first aspect, the present application proposes a modular and combinable smart album management method, including multiple electronic album clients and an electronic album server, wherein the multiple electronic album clients are in communication connection with the electronic album server, and the working steps include:

[0010] S1. Client device communication connection steps, including:

[0011] First, use the client software to scan the client's unique QR code to complete the binding;

[0012] After successful binding, use the client software to complete the network configuration of the finished client;

[0013] After the network configuration is successful, the client broadcasts the server query message to the network. The server software responds to the message after receiving it. If the client does not receive a response message, it will remain silent for a period of time and then broadcast the server query message again;

[0014] After receiving the above response message, the client sends a device registration message to the server. The message content includes but is not limited to the device's unique identification ID, initial key, display resolution, and media support information;

[0015] After receiving the device registration message, the server uses the initial key to establish an encrypted communication link based on the QUIC protocol with the client and sends a heartbeat detection message to the client through the link;

[0016] After receiving the heartbeat detection message, the client feeds back a response message;

[0017] S2, media management steps, including:

[0018] Open the client software on any simulated client, select the client management function, and the client requests the client list and configuration plan from the server;

[0019] The server responds to the above request and sends the result data;

[0020] After receiving the information, the client will render and display it graphically according to the configuration plan;

[0021] S3, playing scheme execution steps, including:

[0022] If the client is a finished client, the server mixes the playback content into streaming media content and pushes it to the client;

[0023] If the client is a simulated client, the server will first push the playback plan to the client. The client software will apply for and reserve a certain amount of storage space as a cache based on the host system information to store and play content including but not limited to plans, plug-ins, music, photos, and videos. Then, according to the playback plan, the server will be requested to play content and plug-in content in turn. After obtaining the corresponding content, the client software will process the content locally and then display and play it.

[0024] According to the screen resolution reported by the client, the playback content is re-encoded and then pushed;

[0025] Determine whether to push audio information based on the media support information reported by the client;

[0026] Generate interpolated frame content based on transition effect settings and previous and next frame content and push it to the client to form a visual picture transition;

[0027] Mix photos and their captions, videos and their subtitles, or photos or videos + music + artistic lyrics;

[0028] Plug-in content is superimposed with photos or video content is mixed;

[0029] For the scenario where all the clients of the photo wall form a splicing screen to play the same content, photos are cropped and content for each client is generated separately.

[0030] Furthermore, after receiving the information, the client performs graphical rendering and display according to the configuration scheme, and performs the following operations:

[0031] See individual clients, set aliases for clients, remove clients, set playback plans for clients;

[0032] Add, delete or edit the photo wall, add multiple clients to the photo wall, set the placement and horizontal and vertical directions of each client in the photo wall;

[0033] Add floor plans and set the location of each client or photo wall;

[0034] Select the same playback plan for multiple clients or photo walls, set different playback plans for each, and set a playback plan list for a certain device.

[0035] Further, judging whether it is necessary to push audio information according to the media support information reported by the client is specifically as follows:

[0036] In the case where audio information needs to be pushed, the server will mix the playback content and the audio content;

[0037] In the case where audio information needs to be removed, the server will directly discard the audio information during the mixing process.

[0038] Furthermore, the photo cropping is specifically performed by arranging the electronic photo albums of multiple clients into a photo wall according to a certain arrangement and combination, optimally superimposing them with the original photos, and cropping the photos based on the superimposed result.

[0039] Furthermore, after obtaining the corresponding content, the content is processed locally, including but not limited to: implementing transition effect rendering, playing background music and displaying artistic lyrics while playing photos, and displaying the text of the photo while playing the photo.

[0040] Furthermore, in step S3, the playback scheme includes but is not limited to: playback time period, playback content list, transition effect, background music, whether to enable a plug-in, and configuration items for plug-in selection.

[0041] Furthermore, the client sends the audio content to the server, which parses the command and executes it or sends it to the client software for execution. The server determines the type of client based on the type of client. If it is a finished client, the server changes the mixed content and playback scheme settings of the client. If it is a simulated client, the server sends a command to the client to change its playback scheme settings and playback progress settings.

[0042] The present application also proposes an electronic photo album client for implementing the above-mentioned modular and combinable intelligent photo album management method, which at least includes: a core processor module, a display screen module, a storage module, and a power module, wherein the core processor module is electrically connected to the display screen module, the storage module, and the power module; the power module includes a DC power supply module, a USB power supply module, and a battery module; the core processor module is also electrically connected to any one or a combination of a speaker module, a wireless network connection module, a PoE network and power supply module, and a microphone receiving module; wherein the core processor module controls the operation of a client device management service interface, a media management service interface, and a playback plan management service interface on the display screen module.

[0043] The present application also proposes an electronic photo album server for implementing the above-mentioned modular and combinable intelligent photo album management method, which is characterized by comprising a processor module, a power module, a memory module, and a display module, wherein when the processor module executes the method, a client device management service software module, a media management service software module, and a playback plan management service software module are run.

[0044] The present application also proposes a system for implementing the above-mentioned modular and combinable intelligent album management method, including multiple electronic album clients and an electronic album server. The multiple electronic album clients are communicatively connected with the electronic album server to implement client device management services, media management services, and playback plan management services.

[0045] At least one of the above technical solutions adopted in the embodiments of the present application can achieve the following beneficial effects:

[0046] 1. This application adopts a combination of software and hardware and a modular hardware design, which can significantly reduce user costs. The software client design allows users to use existing smart devices to simulate electronic photo frame clients. In addition, this application adopts a centralized management and control solution, which can enable multiple clients to work together, and centralized file storage also facilitates user file management.

[0047] 2. This application focuses on an electronic photo frame network system composed of multiple clients. In this system, there can be multiple control terminals. Multiple clients can not only display content individually, but also display content collaboratively, making the functions more powerful and flexible.

[0048] 3. This application is not only suitable for TV, but can also be adapted to more types of display clients, and has relatively more powerful functions. Benefiting from dedicated storage devices, it has larger space and can store richer data resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0050] Figure 1 This is a functional structure diagram of the modular and combinable smart photo album system of this application.

[0051] Figure 2 This is a flow chart of the usage mode of the modular and combinable smart album system of this application.

[0052] Figure 3 This is a flow chart of the modular and combinable smart album management method of this application. DETAILED DESCRIPTION

[0053] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.

[0054] The technical solutions provided by various embodiments of the present application are described in detail below in conjunction with the accompanying drawings.

[0055] Example 1

[0056] The present invention includes a low-cost electronic photo frame client, an electronic photo album server software based on a home storage center, and an electronic photo album client software suitable for smart phones / TVs / tablets and PCs. Figure 1 As shown, a smartphone / TV / tablet and PC installed with the electronic photo album client software can be regarded as an electronic photo frame client. You can also directly purchase an electronic photo frame client. After multiple electronic photo frame clients are connected to the home LAN, they can form a smart photo album system with the electronic photo album server. The electronic photo album server software uses the powerful storage space of the carrier device (such as the home NAS) to centrally manage the user's photos, videos, audio and other media content and uniformly manage the content displayed on each electronic photo frame client, user control command input, and the collaborative work of multiple electronic photo frame clients. The specific implementation includes the following processes or functions:

[0057] 1. Initialization and networking

[0058] The electronic photo frame client needs to complete the network registration with the electronic photo album server (hereinafter referred to as the server) before it can be used normally. For the convenience of understanding, the following text uses the simulated client to refer to the electronic photo frame client composed of smartphones / TVs / tablets and PC+electronic photo album client (hereinafter referred to as the client) software, the finished client to refer to the customized electronic photo frame client hardware product, and the client is used as a general term for the above two types of clients. In the following steps, the finished client starts from step 1.1, and the simulated client is assumed to have joined the home LAN, so it starts from step 1.3.

[0059] 1.1. After the finished client is turned on, the user needs to complete the user binding first. The user uses the client software on the mobile phone to scan the unique QR code of the client to complete the binding.

[0060] 1.2. After successful binding, use the client software on your mobile phone to complete the network configuration of the finished client. (The network configuration process is similar to that of existing IOT devices and will not be repeated here)

[0061] 1.3. After the network configuration is successful, the client broadcasts the server query message to the network, and the server software responds to the message after receiving it. If the client does not receive a response message, it will remain silent for a period of time and then broadcast the server query message again.

[0062] 1.4. After receiving the above response message, the client sends a device registration message to the server. The message content includes the device's unique identification ID, initial key, display resolution, media support and other information.

[0063] 1.5. After receiving the device registration message, the server uses the initial key to establish an encrypted communication link based on the QUIC protocol with the client and sends a heartbeat detection message to the client through the link.

[0064] 1.6. After receiving the heartbeat detection message, the client returns a response message.

[0065] 2. Client management

[0066] Through the following functions, various effects can be achieved, such as all clients playing the same content, clients in the same room playing the same content, different clients playing different content, different clients in the photo wall playing different content, and all clients of the photo wall forming a splicing screen playing the same content.

[0067] 2.1. The user opens the client software on any simulated client and selects the client management function. The client requests the client list and configuration plan from the server.

[0068] 2.2. The server responds to the above request and sends the result data.

[0069] 2.3. After receiving the information, the client will render the information graphically according to the configuration scheme. In this display interface, users can perform the following operations:

[0070] 2.3.1. You can see individual clients, set aliases for clients, remove clients, and set playback plans for clients.

[0071] 2.3.2. You can add, delete or edit the photo wall. You can add multiple clients to the photo wall. You can set the placement and horizontal and vertical directions of each client in the photo wall.

[0072] 2.3.3. You can add floor plans and set the location of each client or photo wall.

[0073] 2.3.4. You can select the same playback plan for multiple clients or photo walls, or set different playback plans for each client or photo wall. You can also set a playback plan list for a certain device.

[0074] 3. Playback plan execution

[0075] The playback plan includes: playback time period, playback content list, transition effect, background music, whether to enable plug-ins and plug-in selection, etc. After setting the playback plan for the client or photo wall, the server software processes the playback content according to the client type and the configuration items in the playback plan and pushes it to the target device. The server-side processing includes the following:

[0076] 3.1. If the client is a finished client, the server will mix the playback content into streaming media content and push it to the client.

[0077] 3.2. If the client is a simulated client, the server will first push the playback plan to the client. The client software will apply for and reserve a certain amount of storage space as a cache based on the host system information, which is used to store playback plans, plug-ins, music, photos, videos, and other content. Then, according to the playback plan, the server will be requested to play content (the content obtained is adapted to the local screen resolution) and plug-in content in turn. After obtaining the corresponding content, the content will be processed locally (for example, weather forecast plug-ins will be superimposed on photos or videos, transition effect rendering will be implemented, background music will be played while playing photos, and artistic lyrics will be displayed, and the text of the photo will be displayed when playing photos, etc.) before display and playback output.

[0078] 3.3. According to the screen resolution reported by the client, the playback content is re-encoded and pushed to reduce display distortion.

[0079] 3.4. Determine whether to push audio information based on the media support information reported by the client to save network bandwidth and computing power, including:

[0080] 3.4.1. In the case where audio information needs to be pushed (such as the client supports audio and background music is added to the playback plan), the server will mix the playback content and the audio content.

[0081] 3.4.2. In the case where audio information needs to be removed (such as the client does not support audio and the playback solution includes video), the server will directly discard the audio information during the mixing process.

[0082] 3.3. Generate interpolated frame content based on the transition effect settings and the content of the previous and next frames and push it to the client to form a visual picture transition.

[0083] 3.4. Mix photos and their accompanying texts, videos and their subtitles, photos or videos + music + artistic lyrics, etc.

[0084] 3.5. Plug-in content is superimposed on photo or video content.

[0085] 3.6. For the scenario where all the clients of the photo wall form a splicing screen to play the same content, follow Figure 2 The method is used to crop photos and generate content for each client.

[0086] 4. User Interaction

[0087] When the client includes a microphone function, voice interaction is supported. Users activate voice interaction through wake-up words. Users can perform operations such as opening the weather, switching the current playback content to a certain client, playing photos of last year's trip to Japan, playing photos of their son when he was 3 years old, etc. The client itself does not have voice AI processing capabilities, and needs to send the audio content picked up by the microphone to the server, which will parse the command and execute the command (for finished clients) or send the command to the client software for execution (for simulated clients). Examples of command parsing and execution are as follows:

[0088] 4.1. Open weather: The server determines the type of client based on the client. If it is a finished client, the server adds the rendering content of the weather plug-in during the mixed stream. If it is a simulated client, the server sends a command to the client to add weather settings to the playback plan.

[0089] 4.2. Switch the current playback content to a certain client: The server determines the type of client based on the client type. If it is a finished client, the server changes the mixed stream content and playback scheme settings of the client; if it is a simulated client, the server sends a command to the client to change its playback scheme settings and playback progress settings.

[0090] 4.3. Play photos of last year's trip to Japan: The server identifies the content with corresponding time and location tags in the media library and generates a new playback plan for the target client and executes it.

[0091] 4.4. Play photos of the son when he was 3 years old: The server identifies the content in the media library that contains corresponding time and person tags, generates a new playback plan for the target client, and executes it.

[0092] 5. Server-side media management

[0093] After the server sets up the media library directory, the software scans the media files (mainly pictures, audio, and video) in each level of the directory in the media library layer by layer and performs different information processing on different types of media files. Then it creates a media index database to save various data related to media files, mainly including file information (directory, file name, file type, creation time, modification time, hash value, etc.), tag information (time, place, person, landscape, theme, etc.), and note information (audio lyrics, video subtitles, picture captions, etc.)

[0094] 5.1. Image files: Identify information such as the image's exi f, obtain the photo's shooting time, shooting location, shooting equipment, file modification time, etc., and store the acquired information in the database. Use AI capabilities to identify people, landscapes, tones, objects, and other information in the image and store them in the database. Use AI capabilities to identify repeated or continuously shot images, set association tags, and store them in the database.

[0095] 5.2. Audio files: Identify the singer, song title, album, album year, play time, encoding format and other information of the audio and store it in the database.

[0096] 5.3. Video files: Identify the video bit rate, encoding format, resolution and other information and store it in the database; use AI capabilities to analyze the video content and identify people, landscapes, tones, objects and other information and store it in the database.

[0097] 5.4. Through the media management function in the client software, users can browse media files on the server by category, filter media files by keywords and combinations of keywords, select a file and manually add, modify, and delete tags for the file, add text to picture files, lyrics to audio files, and subtitles to videos. You can create albums. You can set the first priority photo in a group of repeated or continuous photos without deleting other photos. After setting, the system and client will only use the first priority photo in future usage scenarios.

[0098] 6. Playback plan management

[0099] The playback plan includes: playback time period, playback content list, transition effect, background music, whether to enable plug-ins and plug-in selection and other configuration items. After the user uses the media management function to filter out the media files that meet the requirements, they can select them and add them to the playback plan. In the playback plan management interface, you can create, modify, and delete plans. You can set the content of the playback plan, set whether to enable plug-ins such as weather, calendar, and reminders, and the method for determining the location of the plug-in (the plug-in location is divided into fixed location and smart positioning), and you can set the above-mentioned configuration items.

[0100] 7. Electronic photo frame client

[0101] The electronic photo frame client consists of a display screen module, a speaker module, a DC power supply module, a USB power supply module, a wireless network connection module, a battery module, a PoE network and power supply module, a microphone receiver module, and a core processor module. The display screen module and the core processor module are mandatory modules; the speaker module, the DC power supply module, the USB power supply module, the wireless network connection module, the microphone receiver module, the battery module, the PoE network and power supply module are optional modules, which can be flexibly combined according to the network connection, power supply, home wiring, usage scenarios, etc. The display screen module can support a variety of sizes and resolutions. The core processor module must support streaming media decoding.

[0102] 8. Server software

[0103] The server software mainly includes the following functions: client device management service, media management service, playback plan management service, etc. The server software needs to be deployed on devices with network access conditions and large storage space, such as home NAS, PC, etc.

[0104] 9. Client software

[0105] The client software mainly includes the following functions: client device management interface, media management interface, playback plan management interface, service discovery and client registration, client simulation, etc. The client software is mainly deployed on smart devices such as mobile phones / TVs / tablets or PCs. The main function is to simulate the host device into an electronic photo frame client or a smart album system management and control terminal.

[0106] 10. The client keeps a black screen during the non-playing period, but continues to respond to the server's heartbeat detection message.

[0107] Example 2

[0108] like Figure 1 , Figure 3As shown, the first aspect of the present application proposes a modular and combinable intelligent photo album management method, including multiple electronic photo album clients and an electronic photo album server, wherein the multiple electronic photo album clients are communicated with the electronic photo album server, and the working steps include:

[0109] S1. Client device communication connection steps, including:

[0110] First, use the client software to scan the client's unique QR code to complete the binding;

[0111] After successful binding, use the client software to complete the network configuration of the finished client;

[0112] After the network configuration is successful, the client broadcasts the server query message to the network. The server software responds to the message after receiving it. If the client does not receive a response message, it will remain silent for a period of time and then broadcast the server query message again;

[0113] After receiving the above response message, the client sends a device registration message to the server. The message content includes but is not limited to the device's unique identification ID, initial key, display resolution, and media support information;

[0114] After receiving the device registration message, the server uses the initial key to establish an encrypted communication link based on the QUIC protocol with the client and sends a heartbeat detection message to the client through the link;

[0115] After receiving the heartbeat detection message, the client feeds back a response message;

[0116] S2, media management steps, including:

[0117] Open the client software on any simulated client, select the client management function, and the client requests the client list and configuration plan from the server;

[0118] The server responds to the above request and sends the result data;

[0119] After receiving the information, the client will render and display it graphically according to the configuration plan;

[0120] S3, playing scheme execution steps, including:

[0121] If the client is a finished client, the server mixes the playback content into streaming media content and pushes it to the client;

[0122] If the client is a simulated client, the server will first push the playback plan to the client. The client software will apply for and reserve a certain amount of storage space as a cache based on the host system information to store and play content including but not limited to plans, plug-ins, music, photos, and videos. Then, according to the playback plan, the server will be requested to play content and plug-in content in turn. After obtaining the corresponding content, the client software will process the content locally and then display and play it.

[0123] According to the screen resolution reported by the client, the playback content is re-encoded and then pushed;

[0124] Determine whether to push audio information based on the media support information reported by the client;

[0125] Generate interpolated frame content based on transition effect settings and previous and next frame content and push it to the client to form a visual picture transition;

[0126] Mix photos and their captions, videos and their subtitles, or photos or videos + music + artistic lyrics;

[0127] Plug-in content is superimposed with photos or video content is mixed;

[0128] For the scenario where all the clients of the photo wall form a splicing screen to play the same content, photos are cropped and content for each client is generated separately.

[0129] In this embodiment, after receiving the information, the client performs graphical rendering and display according to the configuration scheme, and performs the following operations:

[0130] See individual clients, set aliases for clients, remove clients, set playback plans for clients;

[0131] Add, delete or edit the photo wall, add multiple clients to the photo wall, set the placement and horizontal and vertical directions of each client in the photo wall;

[0132] Add floor plans and set the location of each client or photo wall;

[0133] Select the same playback plan for multiple clients or photo walls, set different playback plans for each, and set a playback plan list for a certain device.

[0134] In this embodiment, whether audio information needs to be pushed is determined based on the media support information reported by the client, specifically:

[0135] In the case where audio information needs to be pushed, the server will mix the playback content and the audio content;

[0136] In the case where audio information needs to be removed, the server will directly discard the audio information during the mixing process.

[0137] In this embodiment, photo cropping is performed, specifically, electronic photo albums of multiple clients are arranged into a photo wall according to a certain combination, optimally superimposed with the original photos, and photo cropping is performed based on the superposition result.

[0138] In this embodiment, after the corresponding content is obtained, the content is processed locally, including but not limited to: implementing transition effect rendering, playing background music and displaying artistic lyrics while playing photos, and displaying the text of the photo while playing the photo.

[0139] In this embodiment, in step S3, the playback scheme includes but is not limited to: playback time period, playback content list, transition effect, background music, whether to enable a plug-in, and configuration items for plug-in selection.

[0140] In this embodiment, the client sends the audio content to the server, which parses the command and executes the command or sends the command to the client software for execution; the server determines the type of the client and changes the mixed content and playback scheme settings of the client if it is a finished client; if it is a simulated client, a command is sent to the client to change its playback scheme settings and playback progress settings.

[0141] Example 3

[0142] The present application also proposes an electronic photo album client for implementing the above-mentioned modular and combinable intelligent photo album management method, which at least includes: a core processor module, a display screen module, a storage module, and a power module, wherein the core processor module is electrically connected to the display screen module, the storage module, and the power module; the power module includes a DC power supply module, a USB power supply module, and a battery module; the core processor module is also electrically connected to any one or a combination of a speaker module, a wireless network connection module, a PoE network and power supply module, and a microphone receiving module; wherein the core processor module controls the operation of a client device management service interface, a media management service interface, and a playback plan management service interface on the display screen module.

[0143] The present application also proposes an electronic photo album server for implementing the above-mentioned modular and combinable intelligent photo album management method, which is characterized by comprising a processor module, a power module, a memory module, and a display module, wherein when the processor module executes the method, a client device management service software module, a media management service software module, and a playback plan management service software module are run.

[0144] The present application also proposes a system for implementing the above-mentioned modular and combinable intelligent photo album management method, including multiple electronic photo album clients and electronic photo album servers. The multiple electronic photo album clients are communicatively connected with the electronic photo album server to implement client device management services, media management services, and playback plan management services.

[0145] In summary, this application adopts a combination of software and hardware and a hardware modular design, which can greatly reduce user costs. The software client design allows users to use existing smart devices to simulate electronic photo frame clients. In addition, this application adopts a centralized management and control solution, which can enable multiple clients to work together, and centralized file storage also facilitates user file management. Secondly, there can be multiple control terminals, and multiple clients can not only display content individually, but also display content collaboratively, with more powerful and flexible functions. Finally, it is not only suitable for TVs, but can also adapt to more types of display clients, and the functions are relatively more powerful. Benefiting from dedicated storage devices, it has a larger space and can store richer data resources.

[0146] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A modular and combinable intelligent album management method, characterized in that: It includes multiple electronic photo album clients and an electronic photo album server. The multiple electronic photo album clients are connected to the electronic photo album server in a communication manner. The working steps include: S1. Client device communication connection steps, including: First, use the client software to scan the client's unique QR code to complete the binding; After successful binding, use the client software to complete the network configuration of the finished client; After the network configuration is successful, the client broadcasts the server query message to the network. The server software responds to the message after receiving it. If the client does not receive a response message, it will remain silent for a period of time and then broadcast the server query message again; After receiving the above response message, the client sends a device registration message to the server. The message content includes but is not limited to the device's unique identification ID, initial key, display resolution, and media support information; After receiving the device registration message, the server uses the initial key to establish an encrypted communication link based on the QUIC protocol with the client and sends a heartbeat detection message to the client through the link; After receiving the heartbeat detection message, the client feeds back a response message; S2, media management steps, including: Open the client software on any simulated client, select the client management function, and the client requests the client list and configuration plan from the server; The server responds to the above request and sends the result data; After receiving the information, the client will render and display it graphically according to the configuration plan; S3, playing scheme execution steps, including: If the client is a finished client, the server mixes the playback content into streaming media content and pushes it to the client; If the client is a simulated client, the server will first push the playback plan to the client. The client software will apply for and reserve a certain amount of storage space as a cache based on the host system information to store and play content including but not limited to plans, plug-ins, music, photos, and videos. Then, according to the playback plan, the server will be requested to play content and plug-in content in turn. After obtaining the corresponding content, the client software will process the content locally and then display and play it. According to the screen resolution reported by the client, the playback content is re-encoded and then pushed; Determine whether to push audio information based on the media support information reported by the client; Generate interpolated frame content based on transition effect settings and previous and next frame content and push it to the client to form a visual picture transition; Mix photos and their accompanying texts, videos and their subtitles, and audio; the audio mix includes photo or video + music + artistic lyrics mix Plug-in content is superimposed with photos or video content is mixed; For the scenario where all the clients of the photo wall form a splicing screen to play the same content, photos are cropped and content for each client is generated separately.

2. The modular and combinable smart album management method according to claim 1 is characterized in that: After receiving the information, the client performs graphical rendering and display according to the configuration scheme, and performs the following operations: See individual clients, set aliases for clients, remove clients, set playback plans for clients; Add, delete or edit the photo wall, add multiple clients to the photo wall, set the placement and horizontal and vertical directions of each client in the photo wall; Add floor plans and set the location of each client or photo wall; Select the same playback plan for multiple clients or photo walls, set different playback plans for each, and set a playback plan list for a certain device.

3. The modular and combinable smart album management method according to claim 1 is characterized in that: The determining whether to push audio information according to the media support information reported by the client is as follows: In the case where audio information needs to be pushed, the server will mix the playback content and the audio content; In the case where audio information needs to be removed, the server will directly discard the audio information during the mixing process.

4. The modular and combinable smart album management method according to claim 1, characterized in that: The photo cropping is specifically performed as follows: the electronic photo albums of multiple clients are arranged into a photo wall according to a certain combination, optimally superimposed with the original photos, and the photo cropping is performed based on the superposition result.

5. The modular and combinable smart album management method according to claim 1, characterized in that: After the corresponding content is obtained, the content is processed locally, including but not limited to: implementing transition effect rendering, playing background music and displaying artistic lyrics while playing photos, and displaying the text of the photo when playing photos.

6. The modular and combinable smart album management method according to claim 1, characterized in that: In step S3, the playback scheme includes but is not limited to: playback time period, playback content list, transition effect, background music, whether to enable a plug-in, and configuration items for plug-in selection.

7. The modular and combinable smart album management method according to claim 1, characterized in that: The client sends the audio content to the server, which parses the command and executes it or sends it to the client software for execution. The server determines the client type based on the client type. If it is a finished client, the server changes the mixed stream content and playback scheme settings of the client. If it is a simulated client, a command is sent to the client to change its playback scheme settings and playback progress settings.

8. An electronic photo album client for implementing the modular and combinable intelligent photo album management method according to any one of claims 1 to 7, characterized in that: At least includes: a core processor module, a display screen module, a storage module, and a power module, wherein the core processor module is electrically connected to the display screen module, the storage module, and the power module; the power module includes a DC power supply module, a USB power supply module, and a battery module; the core processor module is also electrically connected to any one or a combination of a speaker module, a wireless network connection module, a PoE network and power supply module, and a microphone receiving module; wherein the core processor module controls the operation of a client device management service interface, a media management service interface, and a playback plan management service interface on the display screen module.

9. An electronic photo album server for implementing the modular and combinable intelligent photo album management method according to any one of claims 1 to 7, characterized in that: The method comprises a processor module, a power module, a memory module and a display module, wherein when the processor module executes the method, a client device management service software module, a media management service software module and a playback scheme management service software module are run.

10. A system for implementing the modular and combinable intelligent album management method according to any one of claims 1 to 7, characterized in that: It includes multiple electronic photo album clients and an electronic photo album server. The multiple electronic photo album clients are connected to the electronic photo album server for communication to realize client device management services, media management services, and playback plan management services.

Images