Digital creative image processing method and system for digital photo frame

Abstract

The invention provides a digital creative image processing method and system for an electronic photo frame, and relates to the technical field of electronic equipment, and the system comprises a core control module, a sensing module, an input and output module, a storage module, and a software module running in the core control module. The core control module is a combined framework of a low-power-consumption MCU (Microprogrammed Control Unit) and a lightweight AI (Artificial Intelligence) chip; a low-power-consumption STM32-series MCU and a Shijiangyuan 220 lightweight AI chip combined framework are adopted, dynamic calculation power distribution is achieved through a data bus, the power supply power is adjusted according to task loads in cooperation with an integrated power management unit, the image processing calculation power is guaranteed, meanwhile, system energy consumption is remarkably reduced, the long-term standby requirement of the digital photo frame is met, and the digital photo frame is suitable for being used for a long time. And through cooperation of the software module and the hardware module, a full-process closed-loop link from multi-source input adaptation, scene preprocessing, customized creative processing to output adaptation and interactive response is constructed, the image processing efficiency and continuity are improved, and the fluency of user experience is guaranteed.

Description

Technical Field

[0001] This invention relates to the field of electronic device technology, and in particular to a digital creative image processing method and system for an electronic photo frame. Background Technology

[0002] With the rapid development of digital multimedia and artificial intelligence technologies, electronic photo frames have evolved from traditional, simple image display devices into home multimedia terminals with intelligent and creative processing capabilities. Consumers' demands for electronic photo frames are no longer limited to simple image playback; they expect them to enable convenient access to multiple image sources, automatic image quality optimization, personalized creative processing effects, and intelligent interactive capabilities that adapt to the home environment.

[0003] In home settings, users accumulate a large number of digital images from various channels such as mobile phones, cameras, and the cloud. There is a widespread demand for the organization, display, and creative presentation of these images, with a desire to create a family image display medium that combines commemorative significance and visual aesthetics through electronic photo frames. Meanwhile, the maturity of low-power embedded chips and lightweight AI processing chips, along with the widespread availability of various types of sensors and high-speed data transmission interfaces, provides solid hardware support for electronic photo frames to integrate efficient image processing, real-time environmental awareness, and multimodal interaction functions. This drives the development of electronic photo frames towards greater intelligence and greater suitability for home use scenarios. This invention is a digital creative image processing method and system for electronic photo frames.

[0004] Existing electronic photo frames mostly use a single processor architecture, which makes it difficult to dynamically allocate computing power according to the complexity of image processing tasks. They also lack a refined power management mechanism, resulting in low matching between power supply adjustment and task load, and failing to meet the requirements of long standby time and efficient image processing capabilities. Summary of the Invention

[0005] This invention relates to a digital creative image processing method and system for an electronic photo frame, in order to solve the technical problems mentioned in the background art above.

[0006] In a first aspect, this invention provides a digital creative image processing method and system for an electronic photo frame, specifically comprising: a core control module, a sensing module, an input / output module, a storage module, and a software module running on the core control module; the core control module is a combination architecture of a low-power MCU and a lightweight AI chip, used to schedule the various modules to collaboratively execute image processing tasks; the sensing module is used to collect environmental and interactive signals to achieve real-time perception of environmental parameters and user operations; the input / output module is used to realize the input of multiple source images and the display of processed images; the storage module is used to store programs, templates, and image data, realizing the classified storage and rapid retrieval of data; the software module includes an input adaptation module, an intelligent preprocessing module, a creative processing engine, an output adaptation module, and an interactive control module, with each software module and hardware module working together to realize creative image processing functions, forming a closed-loop processing chain from input to output.

[0007] Furthermore, the low-power MCU in the core control module is an STM32 series chip, and the lightweight AI chip is a Cambricon Siyuan 220 chip. The two are connected through a data bus to realize dynamic allocation of computing power. The core control module integrates a power management unit, which can dynamically adjust the power supply according to the task load to reduce system energy consumption.

[0008] Furthermore, the sensing module includes an ambient light sensor, a touch sensor, and a voice recognition module; the ambient light sensor is a digital light intensity sensor, the voice recognition module is an offline voice chip from iFlytek that supports customized creative processing command recognition, and the touch sensor is a capacitive touch chip that supports basic operations such as single-point double-click and swipe.

[0009] Furthermore, the input / output module supports three input interfaces: USB 3.0, Bluetooth 5.0, and WiFi 6. The output carrier is a 1080P resolution OLED screen, and it is equipped with a speaker to play sound effects in conjunction with dynamic special effects.

[0010] Furthermore, the creative processing engine includes a facial feature extraction submodule, a scene effects matching submodule, and a multi-image narrative arrangement submodule. The facial feature extraction submodule uses a simplified version of the MTCNN model. The scene effects matching submodule has the ability to recognize scene elements and can automatically identify the number of people, scene type, and festival-related elements in the image. The multi-image narrative arrangement submodule can read the EXIF ​​information of the image and arrange the images in an orderly manner based on information such as shooting time and geographical location.

[0011] Furthermore, the scene effects matching submodule has a built-in festival template library, which supports online updates via WiFi.

[0012] Furthermore, the intelligent preprocessing module integrates a lightweight AI noise reduction submodule, which uses a pruned CNN model.

[0013] Furthermore, the interactive control module supports three interaction methods: touch, voice, and light sensing. Touch interaction supports double-tap to switch creative effects and swipe to switch images, while also supporting long-press to trigger the image collection function. Light sensing interaction can automatically adjust the image brightness according to the ambient light intensity.

[0014] Furthermore, the storage module includes built-in Flash storage and an expandable SD card; the built-in Flash storage is allocated 3GB for storing the creative template library, and the remaining space is used to store the system program.

[0015] This invention discloses a digital creative image processing method and system for electronic photo frames, comprising the following steps: 1) Multi-source input adaptation and format standardization: The input adaptation module can be used to access images of multiple formats and perform automatic resolution recognition, scaling and format conversion. 2) Scenario-based intelligent preprocessing: The intelligent preprocessing module performs lightweight AI noise reduction and sharpening, adaptive light sensitivity adjustment, and old photo restoration. 3) Customized creative processing for families: Through the creative processing engine, it can realize the synthesis of parent-child group photos, the rendering of festive atmosphere, or the processing of multiple images linked together for narrative. 4) Output adaptation and interactive response: After the output adaptation module adjusts the display parameters, the output is output and the interactive control module responds to multimodal interactive commands and executes corresponding operations.

[0016] This invention provides a digital creative image processing method and system for electronic photo frames, which has the following beneficial effects: This invention employs a combination architecture of a low-power STM32 series MCU and the Cambricon M220 lightweight AI chip. Dynamic computing power allocation is achieved through a data bus, and the integrated power management unit adjusts the power supply according to the task load. This significantly reduces system energy consumption while ensuring image processing computing power, adapting to the long standby requirements of electronic photo frames. Furthermore, through the collaboration of software and hardware modules, a closed-loop chain is constructed, encompassing multi-source input adaptation, scene-based preprocessing, customized creative processing, output adaptation, and interactive response. This improves image processing efficiency and continuity, ensuring a smooth user experience.

[0017] Furthermore, in this invention, the sensing module integrates multiple types of sensors, including ambient light, touch, and voice sensors. The voice recognition module supports customized creative commands, the touch supports double-click, swipe, long-press, and other operations, and the light sensor can automatically adapt to the brightness. The multimodal interaction methods enhance the user's ease of operation and enable real-time response to the environment and user needs.

[0018] Furthermore, in this invention, the input / output module supports multi-source image access via USB 3.0, Bluetooth 5.0, and WiFi 6, adapting to the data transmission needs of different devices; the 1080POLED screen ensures display quality, and the speaker enables dynamic effects and sound effects to work together, enhancing the visual and auditory experience.

[0019] Furthermore, in this invention, the creative processing engine integrates a simplified version of MTCNN face extraction, scene element recognition, and multi-image narrative arrangement sub-modules. Combined with a built-in online-updable festival template library, it can accurately achieve customized effects such as parent-child synthesis, festival rendering, and chronological arrangement. The intelligent preprocessing module's pruning CNN noise reduction sub-module balances noise reduction and sharpening, old photo restoration effects, and processing efficiency.

[0020] Furthermore, in this invention, the storage module adopts a combination of built-in Flash and expandable SD card. The Flash is divided into dedicated spaces to store creative template libraries and system programs, realizing data classification and storage. Combined with the hardware architecture, it ensures fast access and supports the efficient operation of the entire processing chain. Attached Figure Description

[0021] To more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings of the embodiments will be briefly described below.

[0022] The accompanying drawings described below are only related to some embodiments of the invention and are not intended to limit the invention.

[0023] In the attached diagram: Figure 1 This is a system structure diagram of the digital creative image processing system of the electronic photo frame according to an embodiment of the present invention.

[0024] Figure 2 This is a system structure diagram of the core control module of the digital creative image processing system of the electronic photo frame according to an embodiment of the present invention.

[0025] Figure 3 This is a system structure diagram of the sensing module of the digital creative image processing system of the electronic photo frame according to an embodiment of the present invention.

[0026] Figure 4 This is a system structure diagram of the input / output module of the digital creative image processing system for an electronic photo frame according to an embodiment of the present invention.

[0027] Figure 5 This is a system structure diagram of the storage module of the digital creative image processing system of the electronic photo frame according to an embodiment of the present invention.

[0028] Figure 6 This is a system structure diagram of the creative processing engine of the digital creative image processing system of the electronic photo frame according to an embodiment of the present invention.

[0029] Figure 7 This is a system structure diagram of the interactive control module of the digital creative image processing system of the electronic photo frame according to an embodiment of the present invention. Detailed Implementation

[0030] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the described embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0031] Please refer to Figures 1 to 7 Example 1: This invention proposes a digital creative image processing method and system for electronic photo frames, comprising: a core control module, a sensing module, an input / output module, a storage module, and a software module running on the core control module. The core control module is a combination architecture of a low-power MCU and a lightweight AI chip, used to schedule the collaborative execution of image processing tasks by various modules. The sensing module is used to collect environmental and interactive signals to achieve real-time perception of environmental parameters and user operations. The input / output module is used to realize the input of multi-source images and the display of processed images. The storage module is used to store programs, templates, and image data, realizing the classified storage and rapid retrieval of data. The software module includes an input adaptation module, an intelligent preprocessing module, a creative processing engine, an output adaptation module, and an interactive control module. Each software module and the hardware module work together to realize creative image processing functions, forming a closed-loop processing chain from input to output.

[0032] In this embodiment of the invention, the low-power MCU in the core control module is an STM32 series chip, and the lightweight AI chip is a Cambricon M220 chip. The two are connected through a data bus to achieve dynamic allocation of computing power. The core control module integrates a power management unit, which can dynamically adjust the power supply according to the task load to reduce system energy consumption. Its function is: the STM32 series MCU and the Cambricon M220 chip achieve dynamic allocation of computing power through a data bus, flexibly allocating resources for image processing tasks of different complexities; the integrated power management unit adjusts the power supply according to the task load, maximizing energy reduction while ensuring computing power support, and adapting to the low power consumption requirements of long-term stable operation of the electronic photo frame.

[0033] In this embodiment of the invention, the sensing module includes an ambient light sensor, a touch sensor, and a voice recognition module. The ambient light sensor is a digital light intensity sensor, the voice recognition module is an offline voice chip from iFlytek that supports the recognition of customized creative processing commands, and the touch sensor is a capacitive touch chip that supports basic operations such as single-point double-click and swipe. Its functions are: the digital ambient light sensor collects light intensity data in real time, providing a basis for adjusting display brightness; the capacitive touch sensor supports basic operations to achieve accurate interaction; and the iFlytek offline voice chip ensures that customized creative commands can be recognized even without a network connection. The collaboration of multiple sensors enables real-time perception of the environment and operations, improving the accuracy and convenience of interaction.

[0034] In this embodiment of the invention, the input / output module supports three input interfaces: USB 3.0, Bluetooth 5.0, and WiFi 6. The output carrier is a 1080P resolution OLED screen, and it is equipped with a speaker to play sound effects in conjunction with dynamic special effects. Its functions are: the three interfaces of USB 3.0, Bluetooth 5.0, and WiFi 6 cover wired and wireless transmission scenarios, and can quickly access multi-source images from different devices; the 1080P OLED screen ensures high-definition display of processed images, and the speaker plays sound effects in conjunction with dynamic special effects to achieve audiovisual synergy and enhance the immersive experience of creative displays.

[0035] In this embodiment of the invention, the creative processing engine includes a facial feature extraction submodule, a scene effect matching submodule, and a multi-image narrative arrangement submodule. The facial feature extraction submodule uses a simplified version of the MTCNN model. The scene effect matching submodule has scene element recognition capabilities and can automatically identify the number of people, scene type, and festival-related elements in the image. The multi-image narrative arrangement submodule can read the EXIF ​​information of the image and achieve orderly arrangement of the images based on information such as shooting time and geographical location. Its functions are: the simplified MTCNN model efficiently extracts facial features, providing a foundation for customized processing such as parent-child group photo synthesis; the scene element recognition submodule accurately identifies the image information, achieving precise matching of effects and scenes; and the multi-image narrative arrangement submodule sorts based on EXIF ​​information, making the multi-image display more logical and story-driven, fully supporting customized creative processing needs.

[0036] In this embodiment of the invention, the scene effects matching submodule has a built-in festival template library. The template library supports online updates via WiFi. Its function is to provide ready-made resources for rendering the festive atmosphere, reducing the user's operating costs; and to ensure that the template library is updated in real time via WiFi, adapting to different festivals and trends, and improving the timeliness and diversity of creative processing.

[0037] In this embodiment of the invention, the intelligent preprocessing module integrates a lightweight AI noise reduction submodule. The lightweight AI noise reduction submodule adopts a pruned CNN model. Its function is to: retain the core capabilities of AI noise reduction while simplifying the computational requirements and adapting to a lightweight hardware architecture; efficiently complete preprocessing such as noise reduction and sharpening, improve the image quality of the original image, lay a high-quality foundation for subsequent creative processing, and balance processing effect and efficiency.

[0038] Example 2, building upon Example 1, adds three interaction methods to the interactive control module: touch, voice, and light sensing. Touch interaction supports double-tap to switch creative effects and swipe to switch images, while also supporting long-press to trigger image collection. Light sensing interaction automatically adjusts image brightness based on ambient light intensity. The functions of touch interaction are: rich operational logic enables creative switching and image management; voice interaction simplifies command input; and light sensing interaction automatically adjusts brightness according to ambient light to adapt to the visual experience. These three methods work together to cover different usage scenarios, improving operational convenience and user comfort.

[0039] Example 3: Based on Examples 1 and 2, the storage module includes built-in Flash storage and an expandable SD card. The built-in Flash storage is allocated 3GB for storing the creative template library, and the remaining space is used to store the system program. Its functions are: the dedicated 3GB space of the built-in Flash ensures that the creative template library and the system program are stored independently and can be quickly accessed; the expandable SD card increases the data storage capacity of images and other data; the categorized storage architecture balances storage security and retrieval efficiency, supporting the efficient operation of the entire processing chain.

[0040] This invention discloses a digital creative image processing method and system for electronic photo frames, comprising the following steps: 1) Multi-source input adaptation and format standardization: The input adaptation module can be used to access images of multiple formats and perform automatic resolution recognition, scaling and format conversion. 2) Scenario-based intelligent preprocessing: The intelligent preprocessing module performs lightweight AI noise reduction and sharpening, adaptive light sensitivity adjustment, and old photo restoration. 3) Customized creative processing for families: Through the creative processing engine, it can realize the synthesis of parent-child group photos, the rendering of festive atmosphere, or the processing of multiple images linked together for narrative. 4) Output adaptation and interactive response: After the output adaptation module adjusts the display parameters, the output is output and the interactive control module responds to multimodal interactive commands and executes corresponding operations.

[0041] The working principle of this embodiment is as follows: A core control module combining a low-power MCU (such as the STM32 series) and a lightweight AI chip (such as Cambricon Siyuan 220) serves as the scheduling core. It dynamically allocates computing power via the data bus and adapts energy consumption using a power management unit, coordinating various hardware and software modules to form a complete processing chain. First, the input / output module receives multi-source images via interfaces such as USB 3.0, Bluetooth 5.0, and WiFi 6. The software input adaptation module performs format standardization processing. Then, the intelligent preprocessing module uses a pruned CNN model to perform noise reduction and other preprocessing. Next, the core control module schedules the creative processing engine to extract data using a simplified MTCNN model. The facial feature and scene effects matching submodule recognizes screen elements and matches them with built-in (WiFi-updatable) holiday templates. The multi-image narrative arrangement submodule sorts based on EXIF ​​information to achieve customized creative processing. At the same time, the ambient light, touch, and voice sensors of the perception module collect signals in real time, and the interactive control module responds to operations such as brightness adjustment and effect switching. The built-in Flash and expandable SD card of the storage module classify and store programs, templates, and data and quickly retrieve them. Finally, after the output adaptation module adjusts the parameters, the processed images are displayed in high definition on a 1080P OLED screen, and the speakers play sound effects in sync, completing a closed-loop workflow from input, processing to output and interactive response.

[0042] The following points should be noted in this article: 1. The accompanying drawings of the embodiments of the present invention only involve the structures involved in the embodiments of the present invention; other structures can refer to general designs.

[0043] 2. Where there is no conflict, the embodiments of the present invention and the features thereof can be combined with each other to obtain new embodiments.

[0044] The above are merely specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in the present invention should be included within the scope of protection of the present invention.

Claims

1. A digital creative image processing system for an electronic photo frame, characterized in that, The system includes a core control module, a sensing module, an input / output module, a storage module, and a software module running on the core control module. The core control module is a combination architecture of a low-power MCU and a lightweight AI chip, used to schedule the various modules to collaboratively execute image processing tasks. The sensing module is used to collect environmental and interactive signals to achieve real-time perception of environmental parameters and user operations. The input / output module is used to realize the input of multi-source images and the display of processed images. The storage module is used to store programs, templates, and image data, realizing the classified storage and fast retrieval of data. The software module includes an input adaptation module, an intelligent preprocessing module, a creative processing engine, an output adaptation module, and an interactive control module. The software modules and hardware modules work together to realize creative image processing functions, forming a closed-loop processing link from input to output.

2. The digital creative image processing system for an electronic photo frame according to claim 1, characterized in that, The low-power MCU in the core control module is an STM32 series chip, and the lightweight AI chip is a Cambricon Siyuan 220 chip. The two are connected through a data bus to realize dynamic allocation of computing power. The core control module integrates a power management unit, which can dynamically adjust the power supply according to the task load to reduce system energy consumption.

3. The digital creative image processing system for an electronic photo frame according to claim 1, characterized in that, The sensing module includes an ambient light sensor, a touch sensor, and a voice recognition module; the ambient light sensor is a digital light intensity sensor, the voice recognition module is an offline voice chip from iFlytek that supports customized creative processing command recognition, and the touch sensor is a capacitive touch chip that supports basic operations such as single-point double-click and swipe.

4. The digital creative image processing system for an electronic photo frame according to claim 1, characterized in that, The input / output module supports three input interfaces: USB 3.0, Bluetooth 5.0, and WiFi 6. The output carrier is a 1080P resolution OLED screen, and it is equipped with a speaker to play sound effects in conjunction with dynamic special effects.

5. The digital creative image processing system for an electronic photo frame according to claim 1, characterized in that, The creative processing engine includes a facial feature extraction submodule, a scene effects matching submodule, and a multi-image narrative arrangement submodule. The facial feature extraction submodule uses a simplified version of the MTCNN model. The scene effects matching submodule has the ability to recognize scene elements and can automatically identify the number of people, scene type, and festival-related elements in the image. The multi-image narrative arrangement submodule can read the EXIF ​​information of the image and arrange the images in an orderly manner based on information such as shooting time and geographical location.

6. The digital creative image processing system for an electronic photo frame according to claim 5, characterized in that, The scene effects matching submodule has a built-in holiday template library, which supports online updates via WiFi.

7. The digital creative image processing system for an electronic photo frame according to claim 6, characterized in that, The intelligent preprocessing module integrates a lightweight AI noise reduction submodule, which uses a pruned CNN model.

8. The digital creative image processing system for an electronic photo frame according to claim 1, characterized in that, The interactive control module supports three interaction methods: touch, voice, and light sensing. Touch interaction supports double-tap to switch creative effects and swipe to switch images, while also supporting long-press to trigger the image collection function. Light sensing interaction can automatically adjust the image brightness according to the ambient light intensity.

9. The digital creative image processing system for an electronic photo frame according to claim 1, characterized in that, The storage module includes built-in Flash storage and an expandable SD card; the built-in Flash storage is divided into 3GB for storing the creative template library, and the remaining space is used to store the system program.

10. A method for digital creative image processing system of an electronic photo frame according to any one of claims 1-9, characterized in that: Includes the following steps: 1) Multi-source input adaptation and format standardization: The input adaptation module can be used to access images of multiple formats and perform automatic resolution recognition, scaling and format conversion. 2) Scenario-based intelligent preprocessing: The intelligent preprocessing module performs lightweight AI noise reduction and sharpening, adaptive light sensitivity adjustment, and old photo restoration. 3) Customized creative processing for families: Through the creative processing engine, it can realize the synthesis of parent-child group photos, the rendering of festive atmosphere, or the processing of multiple images linked together for narrative. 4) Output adaptation and interactive response: After the output adaptation module adjusts the display parameters, the output is output and the interactive control module responds to multimodal interactive commands and executes corresponding operations.

Images