Operation method and non-transitory computer readable medium having cargo information

By using wireless communication technology of image capture and feature information in electronic shelf systems, the adjustment difficulties caused by cargo position changes are solved, and the automatic update of electronic shelf labels and displays is realized, which improves operational efficiency and human resources utilization.

CN112052919BActive Publication Date: 2024-11-19NOVATEK MICROELECTRONICS CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202010500741.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-06-03
Filing Date
2020-06-04
Publication Date
2024-11-19
Estimated Expiration
2040-06-04

AI Technical Summary

Technical Problem

In the electronic shelf system, when the cargo position is changed or replaced, it is difficult for on-site staff to adjust the image information on the electronic shelf easily, and the information staff cannot obtain the actual position of the goods during the adjustment process, resulting in difficulty and inefficiency. Especially in the case of multiple electronic shelves.

Method used

By transferring cargo information between electronic devices and servers, using image capture and feature information for wireless communication, automatic adjustment of electronic shelf tags and displays is realized, allowing electronic devices or mobile devices to capture cargo images, extract feature information, and perform with servers Communication to control the display content on the electronic shelf.

Benefits of technology

The update and adjustment process of electronic shelf labels and monitors is simplified, the utilization efficiency of human resources is improved, and the complexity and time of manual operation is reduced, especially for multiple electronic shelf environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112052919B_ABST
    Figure CN112052919B_ABST
Patent Text Reader

Abstract

The present invention relates to an operation method with cargo information and a non-transitory computer-readable medium thereof. The operation method with cargo information is applicable to an electronic device. The operation method comprises: obtaining image information associated with one or more cargo objects on a target electronic shelf among a plurality of electronic shelves in a network; and performing a first communication with a server for controlling the electronic shelf in the network according to any one or both of the image information and feature information associated with the one or more cargo objects, wherein the feature information is extracted from the image information, and the first communication comprises wirelessly transmitting any one or both of the image information and feature information associated with the one or more cargo objects to the server.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an operating method having goods information and a non-transitory computer-readable medium thereof, and more particularly, to an operating method applied to an electronic shelf. Background Art

[0002] In conventional electronic shelf systems, when the physical location of a merchandise item on the electronic shelf changes or when a merchandise item is replaced with a different merchandise item, and the image associated with one or more merchandise objects on the electronic shelf must be adjusted, the on-site staff cannot conveniently make the relevant adjustments because the on-site staff needs to request the information staff to adjust the displayed content of the electronic shelf display through the back-end server.

[0003] However, even if the information staff can operate the server to adjust the display content, he does not know the actual location of the goods and items, and there are many problems in the adjustment process. In addition, when there are many electronic shelves, it is also difficult for the information staff to quickly adjust the displayed information of the corresponding electronic shelves. Summary of the invention

[0004] The present invention provides a plurality of operation methods for transmitting goods information between an electronic shelf and a back-end server.

[0005] According to an embodiment of the present invention, an operation method with cargo information is applicable to an electronic device. The operation method comprises: obtaining image information associated with one or more cargo objects on at least one target electronic shelf among a plurality of electronic shelves in a network; and performing a first communication with a server for controlling the electronic shelf in the network according to any one or both of the image information and feature information associated with the one or more cargo objects, wherein the feature information is extracted from the image information, and the first communication comprises wirelessly transmitting any one or both of the image information and feature information associated with the one or more cargo objects to the server.

[0006] According to another embodiment of the present invention, the operating method is applicable to a server for controlling multiple electronic shelves in a network, and includes: wirelessly receiving any one or both of image information and feature information associated with multiple cargo objects on at least one target electronic shelf among the electronic shelves from an electronic device; obtaining identification information based on the feature information associated with the one or more cargo objects; and performing display setting processing for setting display information to be displayed by the at least one target electronic shelf based on the identification information.

[0007] According to another embodiment of the present invention, an operation method with cargo information can be executed by an electronic device, and includes: starting image capture processing to obtain captured images associated with one or more cargo objects on a target electronic shelf among multiple electronic shelves in a network; and displaying first display setting information for setting display information to be displayed by the target electronic shelf, wherein the first display setting information associated with the one or more cargo objects includes identification information depending on feature information of the captured image.

[0008] According to another embodiment of the present invention, an operation method with cargo information can be executed by an electronic device, and includes: starting image capture processing to obtain captured images associated with one or more cargo objects on a target electronic shelf among multiple electronic shelves in a network; and displaying first display setting information for setting display information to be displayed by the target electronic shelf, wherein the first display setting information associated with the one or more cargo objects includes identification information depending on feature information of the captured image.

[0009] According to another embodiment of the present invention, a non-transitory computer-readable medium stores thereon software instructions, which, when executed by a processor, cause the processor to perform the following steps: obtaining image feature information associated with one or more cargo objects on at least one target electronic shelf among a plurality of electronic shelves in a network; and wirelessly communicating with a server based on any one or both of the image information and feature information associated with the one or more cargo objects for controlling the electronic shelf in the network, wherein the communication includes transmitting any one or both of the image information and feature information associated with the one or more cargo objects to the server.

[0010] According to another embodiment of the present invention, a non-transitory computer-readable medium stores thereon software instructions, which, when executed by a processor, cause the processor to execute the following steps: wirelessly receiving from an electronic device any one or both of image information and feature information associated with multiple cargo objects on at least one target electronic shelf among the electronic shelves; obtaining identification information based on the feature information associated with the one or more cargo objects; and performing display setting processing for setting display information to be displayed by the target electronic shelf based on the identification information.

[0011] In summary, the operation method for transmitting goods information can be performed between at least one target electronic shelf and a server. Feature information associated with goods on at least one target electronic shelf can be generated by the server, or the feature information can be obtained by an electronic device and provided to the server through a network. The server can generate display setting information based on the feature information. In this way, it is easier to control an electronic shelf label (ESL) on at least one of the electronic shelves, and manpower can be greatly saved.

[0012] In order to better understand the above features and advantages of the present invention, embodiments accompanied by drawings are described in detail below. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments of the invention and together with the description serve to explain the principles of the invention.

[0014] Figures 1A to 1D are multiple flow charts of operating methods with cargo information according to multiple embodiments of the present disclosure.

[0015] Figure 2A A schematic diagram showing a pairing operation according to an embodiment of the present disclosure.

[0016] Figure 2B Show according to Figure 2A A schematic diagram of a pairing operation of an embodiment.

[0017] Figure 3 is a schematic diagram of a captured image of goods on a target electronic shelf according to an embodiment of the present disclosure.

[0018] Figure 4A and Figure 4B is a schematic diagram of image processing of a captured image of a cargo object according to an embodiment of the preset disclosure.

[0019] Figure 5 The edge detection result according to the embodiment of the present disclosure is shown.

[0020] FIG. 6A to FIG. 6D are multiple flow charts of operating methods for controlling multiple electronic shelves with goods information in a network according to multiple embodiments of the present disclosure.

[0021] Figure 7 A schematic diagram showing first display setting information according to an embodiment of the present disclosure.

[0022] Figure 8 A schematic diagram showing a correction list used in a correction process according to an embodiment of the present disclosure.

[0023] Fig. 9 An image displayed by an electronic shelf display of a target electronic shelf according to an embodiment of the present disclosure is shown.

[0024] Fig. 10A A flow chart showing an operating method for an electronic shelf system according to an embodiment of the present disclosure is shown.

[0025] Fig. 10B A flow chart showing an operating method for an electronic shelf system according to another embodiment of the present disclosure is shown.

[0026] Fig. 10C Show according to Fig. 10B Another flow chart of an operating method for an electronic shelf system of an embodiment.

[0027] Description of Figure Numbers

[0028] 211, 211-1, 211-2, 211-3, 212, 21N: electronic shelves;

[0029] 220: Electronic devices;

[0030] 230: server;

[0031] 300, 500, 701, CMG: captured images;

[0032] 410: edge point image;

[0033] 420: first relationship diagram;

[0034] 430: second relationship diagram;

[0035] 440: first trimming diagram;

[0036] 450: Second pruning diagram;

[0037] 460: Pruning diagram;

[0038] 710: Image;

[0039] 711: code information;

[0040] 712: price;

[0041] 713: Simple diagram;

[0042] 714: Adjust button;

[0043] 800: Correction list;

[0044] 810, 820, 830, 840, 850: candidate cargo information;

[0045] 900: Display information;

[0046] 911, 912, 913, 914, 915: cargo information;

[0047] BC1, BC2, BC3: barcode images;

[0048] DL1, DL2, DL3, DL4: separator lines;

[0049] DSP1, DSP2, DSP3: display;

[0050] F1, F2, F3, F4, F5: Display area;

[0051] FP1, FP2, FP3, FP4, FP5, FP6, FP7: feature points;

[0052] ID1, ID2, IDN: code tag;

[0053] S1, S2, S3, S4, S5: Select blank space;

[0054] S110, S110B, S110C, S110D, S120, S120B, S120C, S121D, S122D, S123D, S130B, S130C, S131D, S1 32D, S140B, S610, S610B, S610C, S610D, S620, S620B, S620C, S621D, S622D, S630, S630B, S630C, S631D, S640B, S650B, S1010-1, S1010-2, S1020-1, S1020-2, S1030-1, S1030-2, S1040-1, S1040-2, S1050-1, S1050-2, S1060-1, S1060-2, S1070-1, S1070-2, S1080-2, S1090-2, S1100-2: steps;

[0055] SG1, SG1': step group;

[0056] SIM1, SIM2, SIM3, SIM4, SIM5: sub-images. DETAILED DESCRIPTION

[0057] The term "coupling (or connection)" throughout the specification (including claims) of the present application is widely used, and covers direct and indirect connections or coupling members. For example, if the present disclosure describes that the first device is coupled (or connected) to the second device, it should be interpreted as the first device can be directly connected to the second device, or the first device can be indirectly connected to the second device by other devices or by a coupling member. In addition, the terms such as "first" and "second" mentioned throughout the specification (including claims) of the present application are only used to name the name of the element or distinguish different embodiments or scopes, and are not intended to limit the upper or lower limits of the number of elements, and are not intended to limit, and are not intended to limit the order of the elements. In addition, the elements / components / steps with the same figure numbers represent the same or similar parts in the drawings and embodiments. The elements / components / symbols with the same figure numbers in different embodiments can refer to the relevant description.

[0058] In some embodiments, a method of operation is disclosed that can combine image processing techniques with object recognition techniques so that users of electronic devices such as mobile phones (eg, field workers) can more easily update the content and / or location of electronic shelf labels.

[0059] In some embodiments, an application program (APP) may be executed by an electronic device such as a mobile phone to perform the operation method.

[0060] In some embodiments, image information may be obtained by capturing an image of one or more cargo objects on at least one target electronic shelf. Feature information may be extracted by electronic information or a server capable of communicating with an electronic device based on image information. Image information and / or feature information may be sent to a server wirelessly or non-wirelessly via a network. Any communication method or network may be utilized. The server may then identify one or more objects, obtain relevant information associated with the one or more objects, and send the relevant information to at least one electronic shelf to update the displayed content of an electronic shelf label or an electronic shelf display.

[0061] In some embodiments, based on the identification results of one or more goods objects on at least one target electronic shelf, advertising information can also be obtained by the server and sent to at least one target electronic shelf, so that advertisements can be displayed at appropriate locations on at least one target electronic shelf.

[0062] Please refer to Figure 1A, which is a flowchart of an operating method with cargo information according to an embodiment of the present disclosure. The operating method is applicable to an electronic device. The cargo information is associated with one or more cargo objects on at least one target electronic shelf, and the at least one target electronic shelf is among multiple electronic shelves. The electronic shelf can be connected to the network wirelessly or non-wirelessly, and the server can also be connected to the network wirelessly or non-wirelessly. Each of the electronic shelves can have a shelf display for displaying electronic shelf labels. Communication between the electronic device and the server regarding information associated with one or more cargo objects on at least one target electronic shelf can enable the server to set display information to be displayed by the shelf display of at least one target electronic shelf via communication between the server and the at least one target electronic shelf.

[0063] In step S110, the electronic device may obtain image information associated with one or more cargo objects on at least one target electronic shelf among a plurality of electronic shelves. In some embodiments, the electronic device may further obtain feature information associated with one or more cargo objects on at least one target electronic shelf among a plurality of electronic shelves, for example, by performing extraction processing based on the image information. In other words, the electronic device may obtain any type of information related to one or more images of one or more cargo objects on at least one target electronic shelf. The electronic device may be a mobile phone, or any other handheld electronic device well known in the art, or any convenient device that can obtain necessary information (e.g., image information) and communicate with a server. The operating method may be performed as an APP or any type of software executed on an electronic device.

[0064] After either or both of the image information and the feature information are obtained by the electronic device, step S120 may be performed. In this step, the electronic device 220 may communicate with the server using only the image information, only the feature information, or both the image information and the feature information. In other words, the electronic device may communicate with the server using any type of information related to one or more images of one or more cargo objects on at least one target electronic shelf. In this way, the server may communicate with at least one target electronic shelf to set display information to be displayed by at least one target electronic shelf based on the information received from the electronic device. The display information may include at least one of name information, price information, and advertising information.

[0065] More specifically, in step S120, the electronic device may perform a first communication with the server according to any one or both of the image information and the feature information associated with one or more cargo objects for controlling the electronic shelf in the network. The first communication includes wirelessly transmitting any one or both of the image information and the feature information associated with one or more cargo objects to the server.

[0066] In this embodiment, the server may be a remote server, and the electronic device may wirelessly transmit either or both of the image information and the feature information associated with one or more cargo objects to the server. In the first embodiment, the electronic device may perform image processing on the image information of the captured image associated with the one or more cargo objects to obtain the feature information, and transmit the feature information to the server. In the second embodiment, the electronic device may transmit the image information to the server without performing image processing in advance, and perform image processing in the server according to the image information to obtain the feature information.

[0067] In this embodiment, before step S110, the electronic device may first perform a pairing operation on a plurality of electronic shelves. Figure 1B , which is a flow chart of an operating method according to another embodiment of the present disclosure. Figure 1B In the embodiment, step S110B is used to perform a pairing operation between an electronic device and multiple electronic shelves. During the pairing operation, at least one of the electronic shelves may be selected or identified by the electronic device from all multiple electronic shelves registered to the same network. The selected or identified at least one electronic shelf may then serve as at least one target electronic shelf whose displayed content will be adjusted. Various methods may be used to select at least one electronic shelf from the electronic shelves of the network as a target electronic shelf that undergoes display information modification. For example, near field wireless communication (NFC) sensing, code scanning, and physical keying may be used. In an embodiment, pairing may be performed by an electronic device by capturing one or more images of a target electronic shelf. Identification information of a target electronic shelf may be obtained by an electronic device based on at least one captured image of the target electronic shelf. The image may be a code image that can only be displayed during the pairing process, such as a QR code image. Alternatively, the electronic device may further perform image analysis on the captured image to obtain identification information. In other words, the identification information may be a QR code or any other feature information obtained based on the captured image. In addition, the electronic device may communicate with the server according to the identification information of the target electronic shelf, and the server may search for the target electronic shelf among the electronic shelves registered to the network according to the identification information received from the electronic device.

[0068] It should be noted that in some embodiments, the server is configured to receive image information from the electronic device and obtain identification information based on the received information. In some other embodiments, the server is configured to receive identification information from the electronic device. In other words, any information can be utilized and provided to the server by the electronic device to enable the server to search for the target electronic shelf.

[0069] In a similar Figure 1AIn step S120B of step S110, the electronic device may be configured to obtain image information representing characteristic information associated with one or more goods objects on a target electronic shelf among the electronic shelves in the network. The characteristic information may be obtained by performing an image processing operation on the image information associated with the one or more goods objects on at least one target electronic shelf. The details of the image processing operation will be described in detail in Figure 4A , Figure 4B as well as Figure 5 The present invention is described in the embodiments of the present invention and will not be repeated here.

[0070] In step S130B, the electronic device may perform a first communication with the server based on either or both of the image information and the feature information associated with one or more cargo objects. The electronic device may wirelessly transmit either or both of the image information and the feature information to the server. The feature information may be obtained in the electronic device or the server by performing an image processing operation. Therefore, the server may identify the feature information to obtain identification information of the cargo object based on the feature information. The server may generate first display setting information based on the feature information to obtain identification information, and transmit the first display setting information to the electronic device through a second communication. The first display setting information may include identification information about one or more cargoes on at least one target electronic shelf obtained by the server.

[0071] Next, in step S140B, the electronic device may perform a confirmation process in step S140B to confirm whether the first display setting information is correct. The user may send a confirmation instruction through the electronic device to ensure that the first display setting information is correct.

[0072] As will be described in detail below, if the confirmation result is positive, then the process can end, meaning that the server can set the display information based on the confirmed identification information. Alternatively, if the confirmation result is positive, then the process can go to a further adjustment process, which allows the user of the electronic device to further adjust the display information, such as location information. Conversely, if the confirmation result is negative, meaning that the user of the electronic device has not confirmed the identification information associated with one or more goods obtained by the server, then a correction process can be performed to allow the user to correct the identification information.

[0073] Please note that the pairing operation in step S110B is not necessary in some embodiments of the present disclosure. In some embodiments, the pairing operation in step S110B can be skipped.

[0074] Please refer to Figure 1C , which is a flow chart of an operating method according to another embodiment of the present disclosure. Figure 1B In the embodiment, Figure 1CIn step S110C, the electronic device may perform a confirmation process to confirm whether the goods information of the first display setting information associated with one or more goods objects is correct. Steps S120 and S130C may be performed after the confirmation process has a positive result (i.e., the goods information provided by the server is initially correct) or when the confirmation process has a positive result but a correction process has been performed to correct the goods information (i.e., the goods information provided by the server is initially incorrect but has been corrected by the electronic device). Steps S120C and S130C may be manually adjusted by the user of the electronic device to obtain the desired display effect of the electronic shelf label or the electronic shelf display.

[0075] In some cases, the user of the electronic device may feel dissatisfied with the first display setting information, so the user may provide the server with the desired display information to be displayed by the target electronic shelf by using the electronic device. The dissatisfaction may occur due to distortion between the captured image and the image actually displayed on the electronic shelf. In other words, the electronic device may obtain the second display setting information in step S120C based on the first display setting information associated with one or more cargo objects received from the server.

[0076] In detail, the electronic device may provide the user with information about the first display setting information initially provided by the server, such as an image to be displayed according to the first display setting information. The user may check the first display setting information according to the information or the displayed image, and make the required corrections to the displayed image through a graphical user interface (GUI) provided by the electronic device. In this way, the electronic device may obtain the second display setting information according to the operation of the GUI. The second display setting information may be more desired or more satisfactory to the user.

[0077] Next, the electronic device may perform a second communication with the server regarding the second display setting information associated with one or more goods objects in step S130C. Therefore, the server may further obtain the display information for setting the electronic shelf label or electronic shelf display corresponding to the second display setting information that the user needs more.

[0078] In this embodiment, if the first display setting information is deemed satisfactory or desired in step S120C, step S130C may be skipped and the first display setting information may be used by the target electronic shelf for displaying accordingly.

[0079] Please refer to the drawing for correct processing Figure 1D, which is a flow chart of an operation method according to another embodiment of the present disclosure. The cargo information obtained by the server may not be corrected, so a correction process may be performed after a confirmation process for confirming the cargo information has a negative result. In this way, when a user of an electronic device finds that the cargo information provided by the server is incorrect, the user may use the electronic device to provide the server with correct cargo information in order to correct the cargo information.

[0080] In other words, the correction process can be performed in appropriate occasions according to design requirements. For example, before the correction process, the electronic device can obtain a confirmation result based on the input received from the user of the electronic device. If the confirmation process indicates that there is any error in the cargo information, the user can correct the cargo information by going to the input of the electronic device. For example, in some embodiments, when the confirmation process has a negative result, Figure 1B After step S140B Figure 1D The server may set the display information based on the correct cargo information and the process may end. In some other embodiments, when the confirmation process has a negative result, Figure 1C After step S110C is performed Figure 1D After step S110D is completed, the process may then go to step S130C, which allows the user to further adjust the display information to be displayed by the target electronic shelf.

[0081] exist Figure 1D In step S110D, the electronic device may perform correction processing. Figure 1D Details of the correction process according to the embodiment are also depicted. In response to the user's input, the electronic device may wirelessly receive candidate cargo object information from the server in step S121D. The candidate cargo object information may be provided to the user from the server, and the electronic device may obtain selection information indicating which one of the candidate cargo objects is correct according to the input received from the user of the electronic device. This means that the electronic device may obtain selection information according to the user's input.

[0082] In step S123D, the electronic device may communicate with the server according to the selection information. Therefore, the server may further obtain display information corresponding to the correct cargo information.

[0083] In the same or alternative embodiments, for example, if steps S121D to S123D are removed, or the candidate cargo object information fails to provide a correct cargo object for selection in step S122D, the electronic device may (in step S131D) perform an image capture operation on one or more cargo objects to obtain a captured image. The captured image may include identification information of the identified cargo object. In some embodiments, the identification information may be a barcode of the identified cargo object. In this way, the electronic device may obtain identification information of one or more target cargoes based on the captured images of the one or more target cargoes in step S131D. Then, the electronic device may communicate with the server based on the identification information in step S132D. Therefore, the server may further obtain display information corresponding to the correct cargo information.

[0084] Please refer to Figure 2A , which shows a schematic diagram of a pairing operation according to an embodiment of the present disclosure. Figure 2A In the embodiment, all electronic shelves 211 to 21N can be registered in the network between the electronic shelves 211 to 21N, the electronic device 220 and the server 230. The registration table can be generated by the server 230 to record multiple identification information corresponding to the electronic shelves 211 to 21N, respectively, and the registration table can be stored in the server 230. The server 230 can be a backend server. The electronic device 220 can be a mobile phone, or any other handheld electronic device well known in the art.

[0085] During the pairing operation, all electronic shelves 211 to 21N may be wirelessly or non-wirelessly connected to the electronic device 220 and the server 230 in the network. The electronic device 220 may first send a notification to the electronic shelves 211 to 21N. In response to the above notification, the electronic shelves 211 to 21N respectively display a plurality of code tags ID1 to IDN. The code tags ID1 to IDN respectively contain identification information of the electronic shelves 211 to 21N. The electronic device 220 may obtain a captured image of one of the code tags ID1 to IDN to select one of the electronic shelves 211 to 21N as the target electronic shelf. Take the case where the electronic shelf 211 is the target electronic shelf. The electronic device 220 may obtain a captured image CMG of the code tag ID1, and identify the captured image CMG of the code tag ID1 to obtain identification information of the electronic shelf 211. The electronic device 220 further communicates with the server 230 through the network according to the identification information of the electronic shelf 211, and the server 230 searches for a target electronic shelf from the electronic shelves 211 to 21N registered to the network according to the identification information of the electronic shelf 211. In this way, the electronic shelf 211 can be paired with the target electronic shelf.

[0086] In this embodiment, the code tags ID1 to IDN may be quick response (QR) code tags, bar code tags, or any other code tags well known in the art.

[0087] In addition, after the pairing operation is completed, the electronic device 220 may send another notification to inform the electronic shelves 211 to 21N that the pairing operation is completed. The electronic shelves 211 to 21N may stop displaying the code marks 211 to 21N to save power.

[0088] Please refer to Figure 2B , which shows that according to Figure 2A Schematic diagram of pairing operation of an embodiment of the present invention. Figure 2B In the embodiment, a plurality of electronic shelves 211-1 to 211-N and a plurality of displays DSP1 to DSPN are arranged, and the displays DSP1 to DSPN correspond to the electronic shelves 211-1 to 211-N, respectively. During the pairing operation, the displays DSP1 to DSPN may provide barcode images BC1 to BCN, respectively, wherein the barcode images correspond to the electronic shelves 211-1 to 211-N, respectively. In addition, the electronic device 220 may capture images of one or more barcode images BC1 to BCN by using its camera. By analyzing the captured images, one or more barcode images BC1 to BCN may be identified, and at least one of the electronic shelves 211-1 to 211-N may be paired as a target electronic shelf.

[0089] In some embodiments, the pairing operation is not necessary. One or more electronic shelves may be predefined as at least one target electronic shelf and connected to the electronic device and the server via a network.

[0090] After selecting or identifying the electronic shelf 211 as the target shelf, the electronic device 220 may obtain at least one captured image of one or more goods on the electronic shelf 211. Figure 3 , which is a schematic diagram of a captured image of goods on a target electronic shelf according to an embodiment of the present disclosure. The captured image 300 includes five goods objects, which are biscuits A, biscuits B, puffs A, cakes A, and puffs B. The electronic device 220 may perform image processing on the captured image 300 to obtain feature information associated with the goods objects. Alternatively, in another embodiment, the image information of the captured image 300 may be transmitted to the server 230, and the server 230 may perform image processing on the image information associated with the captured image 300 to obtain feature information associated with the goods objects.

[0091] Different algorithms may be used. For example, the captured image 300 may be image processed based on artificial intelligence (AI) processing.

[0092] Details of image processing can be found in Figure 4A and Figure 4B , which is a schematic diagram of image processing of a captured image of a cargo object according to an embodiment of the preset disclosure. Figure 4A In the embodiment, taking the image processing being performed by the electronic device as an example, the electronic device of the present disclosure may transform the captured image 300 into a grayscale image, and perform an edge detection operation on the grayscale image to obtain an edge point image 410. The edge detection operation may be applied by a Canny edge detection algorithm or any other edge detection and / or edge enhancement algorithm well known to those skilled in the art.

[0093] Next, along the horizontal axis (X axis), the electronic device may scan each of the plurality of columns of the edge point image 410 and calculate the number of consecutive black pixels in each of the rows to establish a first relationship graph 420 between the number of black pixels and the position (X position) on the X axis of the edge point image 410. In addition, the electronic device performs a smoothing operation on the number of black pixels in the first relationship graph 420 to obtain a second relationship graph 430.

[0094] exist Figure 4B In the embodiment of the present invention, according to the second relationship graph 430, the electronic device performs a first trimming operation according to the second relationship graph 430. In the first trimming operation, the electronic device calculates a first average value of all numbers of black pixels. By setting the first average value to a first threshold value, the electronic device further trims the number of black pixels according to the first threshold value to generate a first trimming graph 440. Therein, the electronic device compares each of the numbers of black pixels with the first threshold value. If the number of black pixels is greater than the first threshold value, the electronic device keeps the number of black pixels unchanged; and if the number of black pixels is not greater than the first threshold value, the electronic device trims the number of black pixels to zero.

[0095] The electronic device may perform a second trimming operation according to the first trimming map 440. In the second trimming operation, the electronic device ignores the number of black pixels that is zero, and calculates a second average value of the number of black pixels that is not zero. The electronic device may set the second average value to a second threshold value, and trim the number of black pixels in the first trimming map 440 according to the second threshold value to generate a second trimming map 450. The electronic device compares each of the numbers of black pixels in the first trimming map 440 with the second threshold value. If the number of black pixels in the first trimming map 440 is greater than the second threshold value, the electronic device keeps the number of black pixels in the first trimming map 440 unchanged; and if the number of black pixels in the first trimming map 440 is not greater than the second threshold value, the electronic device trims the number of black pixels in the first trimming map 440 to zero.

[0096] After generating the second pruning map 450, the electronic device may group the curves in the second pruning map 450 and find multiple groups of feature points FP1 to FP7 as shown in the pruning map 460. Each of the feature points FP1 to FP7 is the maximum value of the corresponding group.

[0097] The electronic device further generates a plurality of separation lines based on the feature points FP1 to FP7. The separation lines are used to separate the cargo objects in the captured image. This can be seen in Figure 5 , which shows the edge detection result according to an embodiment of the present disclosure. Also take the image processing being performed by the electronic device as an example. In one embodiment, first, the electronic device may calculate the first distance between the feature point FP1 and the closest boundary of the captured image 500, and calculate the second distance between the feature point FP7 and the closest boundary of the captured image 500. Since each of the cargo objects has a minimum width, the electronic device may delete the feature point FP1 when the first distance is less than the first preset reference value, and delete the feature point FP7 when the second distance is less than the first preset reference value. Secondly, the electronic device may calculate a plurality of third distances between any two adjacent feature points from the feature point FP2 to the feature point FP6. If the standard deviation of the third distance is greater than the preset second reference value, the electronic device may select the smaller one of the two adjacent feature points with the minimum distance for deletion. Then, the standard deviation based on the remaining feature points may be calculated again, and the electronic device may determine whether to delete another feature point by comparing the standard deviation with the preset second reference value. If the standard deviation is not greater than the preset second reference value, the electronic device may set the remaining feature points to a plurality of final feature points, and generate separation lines DL1 to DL4 according to the positions of the final feature points. According to the separation lines DL1 to DL4 , a plurality of position information of the cargo object in the captured image 500 may be generated, and a plurality of sub-images SIM1 to SIM5 of the cargo object may be recognized by the electronic device according to the position information.

[0098] The electronic device may further perform a feature transformation operation on each of the cargo objects in the captured images based on the sub-images SIM1 to SIM5. The electronic device may apply a Scale-Invariant Feature Transform (SIFT) algorithm to each of the sub-images SIM1 to SIM5 to obtain feature information. In other embodiments, the electronic device may perform a Speeded-Up Robust Features (SURF) method, a Binary Robust Independent Elementary Features (BRIEF) method, a Features From Accelerated Segment Test (FAST) method, an Oriented FAST and Rotated BRIEF (ORB) method, a feature extraction method based on deep learning (e.g., inception V3, a Deep Residual Network (ResNet)), or any other feature extraction method well known to those skilled in the art to obtain feature information.

[0099] Please note here that in some embodiments, the electronic device may display the captured image 500 with the dividing lines DL1 to DL4. In this way, the user can check whether the positions of the dividing lines DL1 to DL4 are correct, and can manually adjust the position of any one of the dividing lines DL1 to DL4. Of course, if the user finds that a certain dividing line is not drawn in the captured image 500, the user can manually add the dividing line. On the other hand, if the user finds that any one of the dividing lines DL1 to DL4 is not necessary, the user can also manually remove the dividing line.

[0100] It should be noted here that it is also possible to do this in the server Figure 4A , Figure 4B as well as Figure 5 The server may perform image processing on the image information of the captured image 300 to obtain feature information.

[0101] In the following, the Figures 1A to 1D of FIG. 6A to FIG. 6D The operating method applicable to the server is shown. Figures 1A to 1D It is used to illustrate the operation method of the electronic device suitable for communicating with the server. In other words, the adjustment of the displayed information is carried out in cooperation with the server and the electronic device. Figures 1A to 1D The operation method is described in terms of the steps performed by the electronic device, and in Figures 1A to 1D The operation method is described in terms of the steps performed by the server.

[0102] refer to Fig. 6A , which shows a flowchart of an operation method with goods information for controlling multiple electronic shelves in a network according to another embodiment of the present disclosure. The flowchart in FIG. 6 is applicable to a server connected to an electronic device as mentioned in FIG. 2 . In step S610, the server wirelessly receives from the electronic device any one or both of image information and feature information associated with multiple goods objects on at least one target electronic shelf among the electronic shelves, wherein the feature information is extracted from the image information. In other words, the server may receive feature information from the electronic device, which has extracted feature information based on a captured image associated with one or more goods on at least one target electronic shelf. Then, the server may obtain recognition information based on the feature information associated with the goods object (step S620). In detail, the server may analyze the feature information to obtain the recognition information. For example, the server may analyze the feature information by K-means clustering and a vector of locally aggregated descriptors (VLAD) algorithm, and also compare the feature information with a data bank to output each of the goods objects in the captured image. In addition, the server may obtain first display setting information according to the identification information by performing display setting processing in step S630, and the first display setting information may be displayed by at least one target electronic shelf. The first display setting information may include goods information associated with the goods object, such as the name, price, product number, and schematic diagram of each of the goods objects. The first display setting information may also include location information associated with the goods object. The server may also communicate with the target electronic shelf according to the first display setting information in step S630. For more details of steps S610 to S630, please refer to the electronic device applicable to the electronic device. Figure 1A The corresponding steps S110 to S120 are omitted here for brevity.

[0103] Please refer to Figure 6B , which shows a flow chart of an operation method for controlling multiple electronic shelves in a network with goods information according to another embodiment of the present disclosure. In step S610B, a pairing operation may be performed by the server to identify or select at least one electronic shelf among the electronic shelves registered to the network as at least one target electronic shelf. The pairing operation involves cooperation with an electronic device. For more details of step S610B, please refer to the electronic device applicable to the electronic device. Figure 1BThe corresponding step S110B and Figure 2A and Figure 2B details and are omitted here for brevity.

[0104] Next, in step S620B, the server may wirelessly receive from the electronic device any one or both of the image information and the feature information associated with the multiple cargo objects on the at least one target electronic shelf. The generation of the feature information involves cooperation with the electronic device. This means that the electronic device or the server may obtain the feature information associated with the one or more cargo objects of the target electronic shelf based on the captured images of the one or more cargo objects obtained by the electronic device. For more details of step S620B, please refer to the description of the electronic device applicable to the electronic device. Figure 1B The corresponding step S120B and Figures 3 to 5 details and are omitted here for brevity.

[0105] The server may obtain identification information according to the feature information in step S630B. The server may obtain identification information based on a match between the cargo data stored in the database and the feature information.

[0106] In step S640B, the server further performs display setting processing based on the identification information to generate first display setting information. The first display setting information can be transmitted to at least one target electronic shelf, and the at least one target electronic shelf can then display the product information on an electronic shelf label or an electronic shelf display based on the first display setting information.

[0107] Alternatively or additionally, the first display setting information may be transmitted to the electronic device, and the electronic device may perform a confirmation process according to the first display setting information in step S650B.

[0108] The confirmation process in step S650B is used to confirm whether the cargo information of the first display setting information associated with one or more cargo objects is correct. During the confirmation process, the confirmation information can be obtained by the server through the electronic device. The user of the electronic device can confirm whether the cargo information obtained by the server is correct, and then provide an input indicating the confirmation result to the electronic device.

[0109] If we correspond to Figure 1C and Figure 1D of FIG. 6C to FIG. 6DAs described in the embodiment illustrated in , if the confirmation process has a positive result, then at least one target electronic shelf may display the goods information on the electronic shelf label or the electronic shelf display based on the first display setting information. On the contrary, if the confirmation process has a positive result, then a correction process may also be performed based on the input of the user of the electronic device to correct the goods information provided by the server. This means that the server may receive the corrected goods information from the electronic device. In addition, in some embodiments, if the confirmation process has a positive result, additional manual adjustments may also be made. If the confirmation process has a negative result but the correction process ends, additional manual adjustments may also be made. This means that the server may receive a second display setting information from the electronic device, wherein the second display setting information may be more desired or more satisfactory to the user than the first display information. The confirmation process involves cooperation with the electronic device. For more details of step S650B, refer to the electronic device applicable to the electronic device. Figure 1B The corresponding step S140B is omitted here for brevity.

[0110] Please note that the pairing operation performed in step S610B is not necessary for some embodiments of the present disclosure. In some embodiments, step S610B may be skipped.

[0111] Please refer to Figure 6C , which shows a flow chart of an operation method for controlling multiple electronic shelves in a network with goods information according to another embodiment of the present disclosure. Figure 6B In the embodiment, Figure 6C In step S610C, a confirmation process is performed to confirm whether the cargo information of the first display setting information associated with one or more cargo objects is correct.

[0112] If the confirmation process has a positive result, it means that the user confirms that the goods information provided by the server is correct, and additional manual adjustments can be made. Steps S620C and S630C can be manually adjusted by the user of the electronic device to obtain the desired display effect of the electronic shelf label or the electronic shelf display. In step S620C, if the first display setting information is not required or satisfactory to the user of the electronic device, the user can adjust the first display setting information to a second display setting information, which is more required or satisfactory than the first display setting information. In other words, the electronic device can generate the second display setting information based on the user's input. The server can receive the second display setting information from the electronic device in step S620C, wherein the second display setting information is associated with one or more goods objects. In addition, the server can communicate with the target electronic shelf according to the second display setting information in step S630C, and the target electronic shelf can display the image according to the second display setting information to have a more satisfactory or display effect. It should be noted that if the confirmation process has a negative result but the correction process ends, additional manual adjustments can be made. The confirmation process involves cooperation with the electronic device. For more details of step S610C, please refer to the electronic device Figure 1C The corresponding step S110C is omitted here for brevity.

[0113] In this embodiment, if it is confirmed in step S620C that the first display setting information is satisfactory or required, step S630C may be skipped and the first display setting information may be used by the target electronic shelf for displaying accordingly.

[0114] Please refer to Fig.6D , which shows a flowchart of an operation method for controlling multiple electronic shelves with goods information in a network according to another embodiment of the present disclosure.

[0115] In step S610D, a correction process may be performed. If step S610C has a negative result, then step S610D may be performed. In addition, after step S610D ends and it is determined that the user of the electronic device has made a manual adjustment, the process may return to steps S620C and 630C.

[0116] During step S610D, the server may transmit the candidate cargo information to the electronic device in step S621D. The candidate cargo information may be obtained by the server based on the characteristic information transmitted by the electronic device. The electronic device may provide the candidate cargo information to the user for selection, and selection information may be obtained by the electronic device, which then sends the selection information to the server. Next, in step S622D, the server communicates with the electronic device to obtain selection information indicating which one of the candidate cargo objects is correct.

[0117] Alternatively or additionally, for example, if there is no correct item to select in the candidate cargo information, the user may capture the identification of the unidentified cargo object in the target shelf, and the server may communicate with the electronic device to obtain the identification information of one or more cargo objects (step S631D). The identification information may be recorded in a barcode of the unidentified cargo object, and the user may use the electronic device to scan the barcode to obtain the identification information. The correction process involves cooperation with the electronic device. More details of step S610D and step S621D, step S622D, and step S631D may refer to the electronic device applicable to the electronic device. Figure 1D The corresponding steps S110D and S121D, S122D, S123D, S131D and S132D are omitted here for brevity.

[0118] Please refer to Figure 7 , which shows a schematic diagram of the first display setting information according to an embodiment of the present disclosure for illustrating a confirmation process, a correction process, and a manual adjustment process. The first display setting information can be transmitted to an electronic device, and the electronic device can display the first display setting information on a graphical user interface (GUI). Figure 7 , captured image 701 (same as captured image 500) may be displayed on the GUI. Five cargo objects may be coded as number 1 to number 5, where biscuit A is number 1, biscuit B is number 2, puff A is number 3, cake A is number 4, and puff B is number 5. The GUI also displays dividing lines DL1 to DL4 to point out location information associated with the cargo objects.

[0119] The GUI may provide an image 710 having a plurality of display areas F1 to F5, and the display areas F1 to F5 correspond to five goods objects numbered 1 to 5, respectively. Taking the display area F1 as an example, the display area F1 includes the name of the goods object (biscuit A), the price 712, the code information 711, and the diagram 713. The GUI may also provide a selection blank space S1 and an adjustment button 714 on the display area F1 for manual adjustment.

[0120] On the other hand, in this embodiment, the electronic device can also perform a confirmation process through the GUI to confirm whether the cargo information of the first display setting information associated with one or more cargo objects is correct. During the confirmation process, the electronic device obtains the confirmation information according to the input received from the user of the electronic device through the GUI.

[0121] When the cargo information of the first display setting information is incorrect, the electronic device may also perform a correction process through the GUI for correcting the cargo information of the first display setting information associated with one or more cargo objects. If the user wants to correct the cargo information of any of the cargo objects, the user may input by touching one of the selection blanks S1 to S5. In addition, if the cargo information in the display area F1 does not match the cargo object No. 1, the user may select the display area F1 for adjustment. For example, the user may perform a long touch on the display area F1, and the GUI may provide a correction list.

[0122] When the user thinks that the first display setting information is not satisfactory or not required, the electronic device can also perform manual adjustment processing through the GUI to adjust the first display setting information (particularly, position information) associated with one or more cargo objects. If the blank space S1 is selected, the user can use the adjustment button 714 to adjust the position of the separation line DL1 to generate position adjustment information associated with the corresponding cargo object.

[0123] Please refer to Figure 8 , which shows a schematic diagram of a correction list used in a correction process according to an embodiment of the present disclosure for explaining the correction process. The correction list can be displayed to a user of the electronic device by a graphical user interface (GUI) on the electronic device to control the correction process. Figure 8 In the embodiment, during the correction process, the correction list 800 may provide a plurality of candidate cargo information 810 to candidate cargo information 850 associated with a plurality of candidate cargo objects. In this embodiment, the correction list 800 may provide five candidate cargo information 810 to candidate cargo information 850, and in another embodiment, the correction list may provide more or less candidate cargo information and is not particularly limited here.

[0124] In this embodiment, the candidate cargo information may be received from the server through wireless communication. The server may perform artificial intelligence (AI) calculation based on the feature information of the captured image to generate the candidate cargo information.

[0125] In addition, the user can select the correct candidate cargo information (ie, candidate cargo information 810) through input, and the electronic device can generate selection information according to the input from the user. The electronic device can further wirelessly communicate with the server according to the selection information indicating which one of the candidate cargo objects is correct.

[0126] On the other hand, if the user fails to find the correct cargo information among the candidate cargo information 810 to the candidate cargo information 850, the user may select a "scan barcode" option. The electronic device may start a barcode scanning application to scan the unrecognized cargo object, and the cargo information may be corrected. That is, during the correction process, identification information of the incorrect cargo object may be obtained based on the captured image. The identification information may be code information (barcode) of the incorrect cargo object.

[0127] On the other hand, if the corresponding cargo object is empty, the user can select the "Set to Empty" option.

[0128] After the correction process is completed, the server may receive the corrected cargo information from the electronic device, and then set the target electronic shelf based on the corrected cargo information. In some embodiments, manual adjustment may be further performed, during which the electronic device may generate second display information associated with one or more cargo objects, wherein the second display information may include the above-mentioned position adjustment information. The electronic device further performs a second communication with the server, and wirelessly transmits the second display setting information associated with the one or more cargo objects to the server through the second communication.

[0129] Please refer to Fig. 9 , which shows an image displayed by an electronic shelf display of a target electronic shelf according to an embodiment of the present disclosure. Display information 900 may be transmitted to the target electronic shelf by a server. Display information 900 includes goods information 911 to goods information 915, and goods information 911 to goods information 915 may be aligned with corresponding goods objects on the target electronic shelf, respectively. In the present disclosure, all goods information 911 to goods information 915 may be displayed on the same electronic shelf label / display.

[0130] In addition, the electronic device of the present disclosure may include a non-transitory computer-readable medium and a processor. The non-transitory computer-readable medium has software instructions stored thereon and can be executed by the processor. When the software instructions are executed by the processor, the processor may perform steps S110 to S120 in FIG. 1 of the present disclosure.

[0131] The server of the present disclosure may also include a non-transitory computer-readable medium and a processor. The non-transitory computer-readable medium has software instructions stored thereon and can be executed by the processor. When the software instructions are executed by the processor, the processor may execute steps S610 to S620 in FIG. 6 of the present disclosure.

[0132] Please refer to Fig. 10A, which shows a flow chart of an operating method for an electronic shelf system according to an embodiment of the present disclosure. In step S1010-1, the target electronic shelf (or several target electronic shelves) can be paired with the electronic device (that is, a mobile phone) through an APP (application) executed by the electronic device. Next, in step S1020-1, the mobile phone can capture images of one or more cargo objects on the target electronic shelf, and the mobile phone performs an algorithm to extract feature information of the cargo in the image (in step S1030-1). The algorithm may include edge detection or image processing algorithms that are well known to those skilled in the art. In step S1040-1, feature information of the cargo object can be extracted by the mobile phone, and the feature information can be sent from the mobile phone to the server.

[0133] Note here that in some embodiments, step S1030-1 and step S1040-1 may be performed by the server. The mobile phone may transmit the image information of the captured image obtained in step S1020-1 to the server, and the server may perform an algorithm to separate the goods in the image (step S1030-1) and obtain feature information. This means that the server may perform an algorithm based on the image information of the captured image received from the mobile phone without receiving feature information from the mobile phone.

[0134] In step S1050 - 1 , the server is configured to recognize the feature information to obtain identification information, and transmit the goods information (eg, identification information) to the mobile phone and the target electronic shelf.

[0135] In addition, the electronic device may be configured to Figure 7 The embodiment shown in FIG. 1 provides identification information to a user of the electronic device through a display, and in step S1060 - 1 , the user performs a confirmation process to confirm whether the identification information is correct or incorrect.

[0136] In optional step S1070-1, if there is a positive confirmation result (yes), then when the user believes that the position provided by the server is not required or satisfactory, the user can make manual adjustments through the APP to slightly adjust the position of the electronic shelf label of each cargo object, and then the operation method can end.

[0137] In some alternative embodiments, the confirmation process of step S1060-1 may be skipped, and the user may directly adjust the position of the electronic shelf label of each cargo object through the APP after transmitting the identification information to the mobile phone and the target electronic shelf.

[0138] Please refer to Fig. 10B, which shows a flow chart of an operating method for an electronic shelf system according to another embodiment of the present disclosure. In step S1010-2, the target electronic shelf is paired with an electronic device (that is, a mobile phone) through an APP (application). Next, in step S1020-2, the mobile phone captures an image of one or more cargo objects on the target electronic shelf, and the mobile phone performs an algorithm to separate the cargo in the image (in step S1030-2). The algorithm may be an edge detection algorithm well known to those skilled in the art. In step S1040-2, feature information of the cargo object may be extracted, and the feature information may be sent to a server. In step S1050-2, the server is configured to identify the feature information to obtain identification information, and transmit the identification information to the mobile phone and the target electronic shelf. In step S1060-2 (confirmation processing), the user of the mobile phone determines whether the identification information is correct.

[0139] If the identification information is correct, step S1070 - 2 may be executed, and if the identification information is incorrect, step S1080 - 2 may be executed to start a correction process including step S1080 - 2 , step S1090 - 2 , and step S1100 - 2 .

[0140] In step S1070 - 2 , a user may manually adjust the position of the electronic shelf label of each product object through the APP, and then the operation method may end.

[0141] In step S1080-2, the user may select an incorrect cargo object and check whether the correct cargo object is in the candidate information. If the correct cargo object is in the candidate information, the user may correct the incorrect cargo object (step S1090-2). On the contrary, if the correct cargo object is not in the candidate information, the barcode scanning function may be enabled through the APP for correcting the incorrect cargo object (in step S1100). If all incorrect cargo objects are corrected, the flow of the operation method may end.

[0142] The details of step S1010 - 2 to step S1100 - 2 have been described in the aforementioned embodiment and will not be repeated here.

[0143] Please note that in this embodiment, the step group SG1 including steps S1010-2 to S1040-2 can be performed by the mobile phone in this embodiment. Fig. 10C , the step group SG1' including steps S1010-2 to S1020-2 may be performed by the mobile phone, and steps S1030-2 to S1040-2 may be performed by the server. Here, Fig. 10C Show according to Fig. 10BAnother flow chart of an operating method for an electronic shelf system of an embodiment.

[0144] In summary, the present disclosure provides an electronic device to obtain any one or both of image information and feature information associated with one or more cargo objects on a target electronic shelf, and transmit any one or both of the image information and feature information to a server. The present disclosure also provides a server to identify feature information to generate display setting information. The electronic device can provide an interface for confirmation, correction and / or manual adjustment, and can display the correct display setting information on the electronic shelf label of the target electronic shelf. In this way, the content displayed by the electronic shelf label can be automatically set or even further manually adjusted, and the efficiency of the electronic shelf can be improved.

[0145] It will be apparent to those skilled in the art that various modifications and changes may be made to the structure of the disclosed embodiments without departing from the scope or spirit of the present disclosure. In view of the foregoing, it is intended that the present disclosure covers modifications and changes of the present disclosure, provided that the modifications and changes fall within the scope of the appended claims and their equivalents.

Claims

1. An operation method for an electronic device having cargo information, comprising: obtaining image information associated with one or more cargo objects on at least one target electronic shelf among a plurality of electronic shelves in a network, wherein the image information comprises at least one captured image of the one or more cargo objects on the at least one target electronic shelf; performing a first communication with a server for controlling the electronic shelf in the network according to either or both of the image information and the feature information associated with the one or more cargo objects, wherein the first communication comprises wirelessly transmitting either or both of the image information and the feature information associated with the one or more cargo objects to the server; performing image processing on the at least one captured image to obtain the characteristic information associated with the one or more cargo objects; generating a plurality of separation lines according to the characteristic information; as well as A single display is provided to display the plurality of dividing lines and the plurality of electronic shelf labels corresponding to the plurality of goods objects, and a position of each of a plurality of display areas is set according to the plurality of dividing lines, wherein each of the plurality of display areas is used to display the electronic shelf labels corresponding to the plurality of goods objects.

2. The method for operating an electronic device with cargo information according to claim 1, wherein the first communication enables the server to set display information displayed by the at least one target electronic shelf according to the characteristic information associated with the one or more cargo objects.

3. The method of claim 1 , wherein the first communication further comprises wirelessly receiving first display setting information related to the feature information associated with the one or more cargo objects from the server.

4. The method for operating an electronic device with cargo information according to claim 3, wherein the first display setting information associated with the one or more cargo objects comprises at least one location information and cargo information associated with the one or more cargo objects.

5. The method for operating the electronic device with cargo information according to claim 3, further comprising: obtaining second display setting information based on the first display setting information associated with the one or more cargo objects received from the server; as well as A second communication is conducted with the server regarding the second display setting information associated with the one or more cargo objects, wherein the second communication includes wirelessly transmitting the second display setting information associated with the one or more cargo objects to the server. 6 . The method for operating an electronic device with cargo information according to claim 5 , wherein the second display setting information comprises position adjustment information associated with at least one of the one or more cargo objects. 7 . The operation method with cargo information applicable to an electronic device according to claim 6 , wherein the position adjustment information is determined according to an input from a user of the electronic device.

8. The method for operating an electronic device with cargo information according to claim 4, further comprising performing a confirmation process for confirming whether the cargo information of the first display setting information associated with the one or more cargo objects is correct.

9. The method of claim 8, wherein the confirmation process comprises obtaining confirmation information based on an input received from a user of the electronic device.

10. The operation method with cargo information applicable to an electronic device according to claim 8, further comprising performing correction processing when the cargo information of the first display setting information associated with the one or more cargo objects is incorrect, so as to correct the cargo information of the first display setting information associated with the one or more cargo objects.

11. The method for operating an electronic device with cargo information according to claim 10, wherein the cargo information of the first display setting information includes candidate cargo information associated with a plurality of candidate cargo objects, and the correction process comprises: wirelessly receiving the candidate cargo information from the server; obtaining selection information indicating which one of the candidate cargo objects is correct based on input received from a user of the electronic device; and Communicate with the server according to the selection information.

12. The method for operating an electronic device with cargo information according to claim 10, wherein the correction process comprises: obtaining identification information of the one or more cargo objects based on the captured images of the one or more cargo objects; as well as Communicate with the server based on the identification information.

13. The operation method with cargo information applicable to an electronic device according to claim 12, wherein the captured image of the one or more cargo objects includes code information indicating the identification information of the one or more cargo objects.

14. The operation method with cargo information applicable to an electronic device according to claim 1, further comprising pairing the electronic device with at least one target electronic shelf among the electronic shelves registered to the network.

15. The operation method with cargo information applicable to an electronic device according to claim 14, wherein the pairing step comprises: obtaining identification information of the at least one target electronic shelf according to the captured image of the at least one target electronic shelf; as well as The server communicates with the server according to the identification information of the at least one target electronic shelf, so that the server searches for the at least one target electronic shelf in the electronic shelves registered to the network according to the identification information of the at least one target electronic shelf. 16 . The operation method with goods information applicable to an electronic device according to claim 15 , wherein the captured image includes code information indicating identification information of the at least one target electronic shelf.

17. The method for operating an electronic device with cargo information according to claim 1, wherein the step of obtaining the image information associated with the one or more cargo objects comprises: The at least one captured image of the one or more merchandise objects on the at least one target electronic shelf is obtained.

18. The method of claim 1, further comprising transmitting the image information to the server without extracting the feature information.

19. The method for operating an electronic device with cargo information according to claim 1, wherein the step of performing the image processing on the at least one captured image to obtain the characteristic information associated with the one or more cargo objects: performing an edge detection operation on the at least one captured image to obtain at least one position information of the one or more cargo objects; and A feature transformation operation is performed on the at least one captured image according to the at least one position information to obtain the feature information of the one or more cargo objects.

20. An operation method for controlling a plurality of electronic shelves in a network, which is applicable to a server and has goods information, comprising: wirelessly receiving from an electronic device any one or both of image information and feature information associated with one or more cargo objects on at least one target electronic shelf among the electronic shelves, wherein the image information comprises at least one captured image of the one or more cargo objects on the at least one target electronic shelf; performing image processing on the at least one captured image to obtain the characteristic information associated with the one or more cargo objects; generating a plurality of separation lines according to the characteristic information; Obtaining identification information according to the characteristic information; performing a display setting process for setting display information to be displayed by the at least one target electronic shelf according to the identification information; as well as A single display is provided to display the plurality of dividing lines and the plurality of electronic shelf labels corresponding to the plurality of goods objects, and a position of each of a plurality of display areas is set according to the plurality of dividing lines, wherein each of the plurality of display areas is used to display the electronic shelf labels corresponding to the plurality of goods objects.

21. The operation method with cargo information applicable to a server according to claim 20, wherein the display setting process comprises: First display setting information is obtained according to the identification information, and communication is performed with the at least one target electronic shelf according to the first display setting information.

22. The operation method with cargo information applicable to a server according to claim 21, wherein the first display setting information associated with the one or more cargo objects comprises location information and cargo information associated with the one or more cargo objects.

23. The operation method with cargo information applicable to a server according to claim 21, wherein the display setting process comprises wirelessly communicating with the electronic device according to the first display setting information.

24. The operation method with cargo information applicable to a server according to claim 23, wherein the step of wirelessly communicating with the electronic device according to the first display setting information comprises: The first display setting information is transmitted to the electronic device.

25. The operation method with cargo information applicable to a server according to claim 24, wherein the step of wirelessly communicating with the electronic device according to the first display setting information comprises: receiving, from the electronic device, second display setting information associated with at least one of the one or more cargo objects; as well as Communicate with the at least one target electronic shelf according to the second display setting information.

26. The operation method with cargo information applicable to a server according to claim 25, wherein the second display setting information comprises position adjustment information associated with at least one of the one or more cargo objects.

27. The operation method with cargo information applicable to a server according to claim 24, further comprising performing a confirmation process for confirming whether the cargo information of the first display setting information associated with the one or more cargo objects is correct.

28. The operation method with cargo information applicable to a server according to claim 27, wherein the confirmation process comprises obtaining confirmation information from the electronic device.

29. The operation method with cargo information applicable to a server according to claim 27, further comprising performing correction processing when the cargo information of the first display setting information associated with the one or more cargo objects is incorrect, so as to correct the cargo information of the first display setting information associated with the one or more cargo objects.

30. The operation method with cargo information applicable to a server according to claim 29, wherein the cargo information of the first display setting information includes candidate cargo information associated with a plurality of candidate cargo objects, and the correction process comprises: transmitting the candidate cargo information to the electronic device; as well as Communicating with the electronic device to obtain selection information indicating which of the candidate cargo objects is correct.

31. The operation method with cargo information applicable to a server according to claim 29, wherein the correction process comprises: Communicate with the electronic device to obtain identification information of the one or more cargo objects, wherein the identification information is determined based on the captured images of the one or more cargo objects.

32. The operation method with cargo information applicable to a server according to claim 31, wherein the captured image of the one or more cargo objects includes code information indicating the identification information of the one or more cargo objects.

33. The operation method with goods information applicable to a server according to claim 20, further comprising pairing the electronic device with at least one target electronic shelf among the electronic shelves registered to the network.

34. The operation method with cargo information applicable to a server according to claim 33, wherein the pairing step comprises: communicating with the electronic device to obtain identification information of the at least one target electronic shelf; as well as The at least one target electronic shelf is searched for in the electronic shelves registered to the network according to the identification information of the at least one target electronic shelf.

35. The operation method with goods information applicable to a server according to claim 33, wherein the identification information is determined based on a captured image including code information indicating identification information of the at least one target electronic shelf.

36. The method of claim 20, wherein the step of performing the image processing on the at least one captured image to obtain the characteristic information associated with the one or more cargo objects comprises performing artificial intelligence processing.

37. An operation method with cargo information executable by an electronic device, comprising: Initiating an image capture process to obtain at least one captured image associated with one or more cargo objects on at least one target electronic shelf among a plurality of electronic shelves in the network, and to generate image information; performing image processing on the at least one captured image to obtain characteristic information associated with the one or more cargo objects; generating a plurality of separation lines according to the characteristic information; as well as displaying first display setting information for setting display information to be displayed by the at least one target electronic shelf, wherein the first display setting information associated with the one or more cargo objects includes identification information depending on feature information of the at least one captured image; A single display is provided to display the plurality of dividing lines and a plurality of electronic shelf labels corresponding to the plurality of cargo objects, and a position of each of a plurality of display areas is set according to the plurality of dividing lines, wherein each of the plurality of display areas is used to display each of the electronic shelf labels corresponding to each of the cargo objects.

38. The operation method with cargo information executable by an electronic device according to claim 37, wherein the first display setting information is obtained from a server of the network communicating with the electronic device.

39. An operating method with cargo information executable by an electronic device according to claim 38, wherein the communication enables the server to set display information displayed by the at least one target electronic shelf according to the identification information associated with the one or more cargo objects.

40. The operation method with goods information executable by an electronic device according to claim 37 further comprises displaying a message for requesting a user of the electronic device to provide second display setting information for setting display information to be displayed by the at least one target electronic shelf.

41. The method of claim 40, wherein the second display setting information includes position adjustment information associated with at least one of the one or more cargo objects.

42. The method of claim 39, further comprising displaying a message for requesting a user of the electronic device to confirm whether the cargo information of the first display setting information associated with the one or more cargo objects is correct.

43. The operation method with cargo information executable by an electronic device according to claim 42 further comprises displaying a message for requesting the user of the electronic device to correct the cargo information of the first display setting information associated with the one or more cargo objects when the cargo information of the first display setting information associated with the one or more cargo objects is incorrect.

44. A non-transitory computer readable medium having stored thereon software instructions which, when executed by a processor, cause the processor to perform steps comprising: obtaining image information associated with one or more cargo objects on at least one target electronic shelf among a plurality of electronic shelves in a network, wherein the image information comprises at least one captured image of the one or more cargo objects on the at least one target electronic shelf; wirelessly communicating with a server for controlling the electronic shelf in the network based on either or both of the image information and the feature information associated with the one or more cargo objects, wherein the communicating includes transmitting either or both of the image information and the feature information associated with the one or more cargo objects to the server; performing image processing on the at least one captured image to obtain the characteristic information associated with the one or more cargo objects; generating a plurality of separation lines according to the characteristic information; as well as A single display is provided to display the plurality of dividing lines and the plurality of electronic shelf labels corresponding to the plurality of goods objects, and a position of each of a plurality of display areas is set according to the plurality of dividing lines, wherein each of the plurality of display areas is used to display the electronic shelf labels corresponding to the plurality of goods objects.

45. A non-transitory computer-readable medium having software instructions stored thereon according to claim 44, wherein the communication causes the server to set display information displayed by the at least one target electronic shelf based on the characteristic information associated with the one or more cargo objects.

46. ​​The non-transitory computer-readable medium having software instructions stored thereon of claim 44, wherein the communicating further comprises receiving, from the server, first display setting information related to the characteristic information associated with the one or more cargo objects.

47. The non-transitory computer-readable medium having software instructions stored thereon of claim 44, further comprising pairing an electronic device with the at least one target electronic shelf among the electronic shelves registered with the network.

48. The non-transitory computer readable medium having software instructions stored thereon according to claim 44, wherein the step of obtaining the image information associated with the one or more cargo objects comprises: The at least one captured image of the one or more merchandise objects on the at least one target electronic shelf is obtained.

49. The non-transitory computer-readable medium having software instructions stored thereon of claim 44, further comprising transmitting the image information to the server without extracting the feature information.

50. A non-transitory computer readable medium having stored thereon software instructions which, when executed by a processor, cause the processor to perform steps comprising: wirelessly receiving from an electronic device any one or both of image information and feature information associated with a plurality of cargo objects on at least one target electronic shelf among the electronic shelves, wherein the image information comprises at least one captured image of the one or more cargo objects on the at least one target electronic shelf; performing image processing on the at least one captured image to obtain the characteristic information associated with the one or more cargo objects; generating a plurality of separation lines according to the characteristic information; Obtaining identification information according to the characteristic information; performing a display setting process for setting display information to be displayed by the at least one target electronic shelf according to the identification information; as well as A single display is provided to display the plurality of dividing lines and the plurality of electronic shelf labels corresponding to the plurality of goods objects, and a position of each of a plurality of display areas is set according to the plurality of dividing lines, wherein each of the plurality of display areas is used to display the electronic shelf labels corresponding to the plurality of goods objects.

51. The non-transitory computer readable medium having software instructions stored thereon according to claim 50, wherein the display settings process comprises: First display setting information is obtained according to the identification information, and communication is performed with the at least one target electronic shelf according to the first display setting information.

52. The non-transitory computer-readable medium having software instructions stored thereon of claim 50, further comprising pairing the electronic device with the at least one target electronic shelf among the electronic shelves registered with a network.

53. The non-transitory computer-readable medium having software instructions stored thereon according to claim 50, wherein the step of performing the image processing on the at least one captured image to obtain the characteristic information associated with the one or more cargo objects includes performing artificial intelligence processing.