Unlock instant, AI-driven research and patent intelligence for your innovation.

Intelligent image data collecting and processing method for refrigerator

A technology of image data acquisition and processing method, applied in the field of intelligent refrigerator control system, can solve the problems of difficult operation, fixed function and high cost, achieve the effect of low cost, solve intelligent control and increase compatibility

Active Publication Date: 2021-12-24
广州微林软件有限公司
View PDF15 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Traditional refrigerators do not have the function of visually recognizing food. At present, smart refrigerators rarely have this function and the price is relatively expensive. After buying a smart refrigerator, its functions are fixed and the volume is large. If the user wants to upgrade or replace it, the operation is very difficult. and high cost
[0006] It can be seen from the above that one of the reasons why traditional refrigerators cannot be directly upgraded to smart refrigerators is the realization of the intelligent function of visually recognizing food. More specifically, traditional refrigerators lack the component of smart camera equipment, and There is a camera on the smart refrigerator. Therefore, the smart refrigerator can collect food images through the camera and realize intelligent control through the corresponding software program system. However, due to the lack of smart camera equipment in the traditional refrigerator, it is necessary to install a camera on the outside. The equipment also lacks its internal intelligent control means, and cannot carry out intelligent image data collection and processing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent image data collecting and processing method for refrigerator
  • Intelligent image data collecting and processing method for refrigerator
  • Intelligent image data collecting and processing method for refrigerator

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] refer to figure 1 As shown, a control method based on an external camera device, the camera device first enters S000 to play the start-up voice when the camera is turned on, and the start-up voice can be turned off or changed through user settings.

[0053] Then enter S001 to judge whether it is a new factory machine, if it is a new factory, read the settings in the TF card and initialize the camera equipment, and store the initialization data including UID, software version and settings in the flash.

[0054] Enter S002 and try to connect to the network through the AP name and corresponding password in the wifi list file. If you can connect to the network, you will jump into the main program of S200. .

[0055] S100 will determine the hardware version and software settings of the camera device, if it is in AP mode, turn to S110 to turn on the wifi hotspot, if it is in bluetooth mode, turn to S120 to turn on bluetooth, if it is in wifi direct mode, turn on wifi direct ...

Embodiment 2

[0073] combine figure 2 As shown, this example provides a vision-based object recognition method and system, including three parts: object detection, matching weight matrix, and object recognition.

[0074] Preferably, the object detection method includes:

[0075] Through different environmental scenes, different weathers, and different lighting, the target video stream is collected by sensors, infrared rays and other mechanisms, and the target video is processed by frame extraction with the help of multimedia processing tools (such as FFmpeg) to obtain multiple image frame sequences.

[0076] Preprocessing is performed on the acquired multi-image frame sequence, and the preprocessing methods are not limited to filtering, screening, cropping, splicing, Gaussian noise and blurring processing, and the preprocessed target object images constitute the target object data set.

[0077] Use Labelimg, a commonly used labeling tool for target detection, to label the target objects t...

Embodiment 3

[0151] Figure 8 to combine Figure 9 This example shows a method for vision-based action recognition, including:

[0152] Step 1: Collect video through the device to obtain a picture sequence set.

[0153] Step 2: Build a deep learning target detection network, perform object detection and human detection processing on the picture, and obtain a detection frame set.

[0154] Step 3: Convert the detection frame set into a multi-object spatio-temporal map.

[0155] Step 4: Through the space-time map, image, device ID number, and image time stamp, perform trajectory generation and trajectory array comparison.

[0156] Step 5: Update the trajectory array with the information of the space-time diagram and the trajectory array, and confirm the action.

[0157] Step 6: Relay update the trajectory array according to the timestamp to keep the trajectory array dynamic.

[0158] In step 3, the detection frame set is converted into a multi-object spatio-temporal map by sorting, filte...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an intelligent image data collecting and processing method for a refrigerator, which comprises the following steps of: collecting image data: controlling camera equipment to collect and send the image data according to a preset triggering condition; recognizing an object, detecting the image by using an enhanced YOLOv4-tiny model, extracting the detected target object, carrying out category classification, forming a relation hierarchical graph and a matching weight matrix based on image data, and confirming the category of the object and the object through an object recognition network and the matching weight matrix; motion recognition: constructing a space-time diagram which is free of intersection and disappears along with time coverage based on the image data, and tracking an action track based on the space-time diagram; scheduling of the virtual server: scheduling the virtual server to pull and process the image data based on the collection state of the image data, the recognition state of the object and the recognition state of the action; the intelligent refrigerator control system can be applied to external camera shooting equipment, intelligent control over the interior of the external camera shooting equipment is achieved. The intelligent refrigerator control system has the intelligent image data collecting and processing functions.

Description

technical field [0001] The invention relates to an intelligent refrigerator control system. Background technique [0002] A refrigerator is a refrigeration device that maintains a constant low temperature, and it is also a civilian product that keeps food or other items at a constant low temperature. There are compressors, refrigerators or cabinets for freezing in the box, and storage boxes with refrigeration devices. The volume of household refrigerators is usually 20-500 liters. [0003] In 1910, the world's first compression refrigeration household refrigerator came out in the United States. In 1925, the Swedish Lido Company developed a household absorption refrigerator. In 1927, General Electric Company of the United States developed a fully enclosed refrigerator. In 1930, the air-cooled continuous diffusion absorption refrigerator with different heating methods was put on the market. In 1931, a new type of refrigerant Freon 12 was successfully developed. In the sec...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/32G06K9/62G06F8/65G06N3/04G06N3/08H04W12/06H04W24/08H04W48/16
CPCG06F8/65G06N3/04G06N3/08H04W12/068H04W24/08H04W48/16G06F18/23213G06F18/2414G06F18/2415G06F18/253Y02D10/00
Inventor 张元本卢伟昌廖丽曼
Owner 广州微林软件有限公司