Management method for at least one electronic shelf label and management system for at least one electronic shelf label

Abstract

One embodiment provides a management method for at least one electronic shelf label, the management method comprising the steps of: acquiring related information about a product; acquiring identification information of an electronic shelf label; imaging, by using a first imaging device, an area in which the electronic shelf label is provided; acquiring information about the location of the first imaging device; determining the location of the electronic shelf label on the basis of the information about the location of the first imaging device and an image obtained by imaging, by means of the first imaging device, the area in which the electronic shelf label is provided; and assigning the product to the electronic shelf label by matching, to the related information about the product, at least one of the determined information about the location of the electronic shelf label or the identification information of the electronic shelf label.

Description

Management method for at least one electronic shelf label and management system for at least one electronic shelf label

[0001] The present invention relates to a management method for at least one electronic shelf label and a management system for at least one electronic shelf label, and more particularly, to a management method for at least one electronic shelf label and a management system for at least one electronic shelf label, which utilize location information of an electronic shelf label determined based on related information of an imaging device that photographs an electronic shelf label in a process of assigning a product to an electronic shelf label using an electronic device.

[0002] Electronic labels are increasingly being used in applications such as displaying product information on store shelves. Also known as electronic shelf labels or electronic tags, electronic labels connect to a server via a gateway, receive product information, and display it on an electronic paper display. Their low-power operation, resulting in longer battery life, and the ability to update information over a communications network, which reduces store management labor costs, are driving their widespread adoption.

[0003] When a new product is placed on the shelf, a process is required to assign the electronic label to display the product's information. Typically, a store manager uses a terminal to read the barcode attached to the electronic label, then scans the product barcode and transmits it to a server. The server then assigns the electronic label to the product, registers it in its database, and transmits the product information to the electronic label, thereby updating the display.

[0004] In addition, after the assignment of electronic labels and products is completed, information regarding the location of the electronic labels assigned to specific products must be secured to easily determine which products are located in which locations, thereby enabling efficient product and electronic label management.

[0005] To this end, a method is known for identifying the location of an electronic label communicating with a reference node based on wireless communication between multiple anchor nodes and a reference node, each with a predetermined location. However, this method is cumbersome because it requires separate wireless communication between multiple anchor nodes and the reference node after the product allocation process. Furthermore, errors exceeding the allowable range may occur during signal transmission and reception between the anchor and reference nodes, resulting in inaccurate electronic label location identification.

[0006] Accordingly, there is a need for research on a method that can efficiently perform the position of the electronic label to which the product is matched without a separate setting task and can accurately identify the position of the electronic label by minimizing the impact of errors that may occur during the wireless communication process.

[0007] According to various embodiments of the present disclosure, in the process of assigning a product to an electronic shelf label, a management method for at least one electronic shelf label and a management system for at least one electronic shelf label are provided, which utilize information regarding the location of the electronic shelf label determined based on relevant information of an imaging device that photographs an area where an electronic shelf label is provided.

[0008] However, the technical problems that the various embodiments of the present disclosure seek to solve are not limited to the technical problems described above, and other technical problems may exist.

[0009] One example is,

[0010] A method for managing at least one electronic shelf label is provided, comprising: a step of obtaining product-related information; a step of obtaining identification information of an electronic shelf label; a step of photographing an area where the electronic shelf label is provided using a first imaging device; a step of obtaining information about a location of the first imaging device; a step of determining a location of the electronic shelf label based on information about the location of the first imaging device and an image of an area where the electronic shelf label is provided taken by the first imaging device; and a step of assigning the product to the electronic shelf label by matching at least one of the information about the location of the electronic shelf label determined in the product-related information and the identification information of the electronic shelf label.

[0011] In another aspect, at least one electronic shelf label management method may further include a step of acquiring posture information of the first imaging device at a time when the first imaging device photographs an area where the electronic shelf label is provided, and a step of acquiring information regarding internal parameters of the first imaging device.

[0012] In another aspect, in the step of determining the position of the electronic shelf label, the position of the electronic shelf label can be determined based on information about the position of the first imaging device, information about the posture of the first imaging device, information about the internal parameters of the first imaging device, and the image in which the area in which the electronic shelf label is provided is captured by the first imaging device.

[0013] In another aspect, the electronic shelf label may be provided on a first shelf, and the first imaging device may be provided on a second shelf different from the first shelf.

[0014] In another aspect, in the step of obtaining information about the location of the first imaging device, information about the predetermined location of the first imaging device can be obtained from an imaging device location database.

[0015] In another aspect, the first imaging device may be configured to be movable with respect to the electronic shelf label.

[0016] In another aspect, in the step of obtaining information about the position of the first imaging device, information about the position of the first imaging device at the time when the first imaging device photographs the area where the electronic shelf label is provided can be obtained based on a wireless communication method.

[0017] In another aspect, the wireless communication method may include any one of a WiFi wireless communication method, a Bluetooth low energy (BLE) wireless communication method, and an ultra-wideband (UWB) wireless communication method.

[0018] In another aspect, in the step of obtaining identification information of the electronic shelf label, the identification information of the electronic shelf label can be obtained based on a wireless communication method between the electronic device and the electronic shelf label.

[0019] In another aspect, in the step of obtaining relevant information of the above product, relevant information of the above product can be obtained based on the identification result of the unique code displayed on the above product on the electronic device.

[0020] In another aspect, a management method for at least one electronic shelf label may further include the steps of detecting at least one electronic shelf label from the image in which an area provided with the electronic shelf label is photographed by the first imaging device, detecting a pattern code displayed by each of the at least one electronic shelf label detected in the image, comparing at least one identification information corresponding to each of the pattern codes displayed by each of the at least one electronic shelf label detected in the image with previously acquired identification information of the electronic shelf label, and determining a target electronic shelf label displaying a pattern code corresponding to identification information matching the previously acquired identification information of the electronic shelf label among the at least one electronic shelf label detected in the image.

[0021] In another aspect, in the step of determining the position of the electronic shelf label, the position of the electronic shelf label can be determined based on an image of the target electronic shelf label determined based on information about the position of the first imaging device, information about the posture of the first imaging device, information about the internal parameters of the first imaging device, and the image of the area in which the electronic shelf label is provided by the first imaging device.

[0022] In another aspect, the management method for the at least one electronic shelf label may further include the steps of: photographing an area where the electronic shelf label is provided using a second imaging device different from the first imaging device; obtaining information about a position of the second imaging device; determining a position of the electronic shelf label based on the information about the position of the second imaging device and an image of the area where the electronic shelf label is provided taken by the second imaging device; and determining a final position of the electronic shelf label based on the information about the position of the electronic shelf label determined based on the image photographed by the first imaging device and the information about the position of the electronic shelf label determined based on the image photographed by the second imaging device.

[0023] In another aspect, in the step of assigning the product to the electronic shelf label, the product can be assigned to the electronic shelf label by matching at least one of information regarding the final location of the electronic shelf label determined in the relevant information of the product and identification information of the electronic shelf label.

[0024] One example is,

[0025] The present invention provides a management system for at least one electronic shelf label, comprising: an electronic shelf label displaying product-related information; at least one memory storing an electronic shelf label management application for performing a management method for at least one electronic shelf label; and at least one processor for performing a predetermined operation for executing the application; and an imaging device configured to photograph an area where the electronic shelf label is provided, wherein the application obtains product-related information, obtains identification information of the electronic shelf label, photographs the area where the electronic shelf label is provided using the imaging device, obtains information regarding a location of the imaging device, determines the location of the electronic shelf label based on the information regarding the location of the imaging device and an image of the area where the electronic shelf label is provided taken by the imaging device, and assigns the product to the electronic shelf label by matching at least one of the information regarding the location of the electronic shelf label determined in the product-related information and the identification information of the electronic shelf label.

[0026] In another aspect, the application can obtain posture information of the imaging device at the time when the imaging device photographs an area where the electronic shelf label is provided, and obtain information about internal parameters of the imaging device.

[0027] In another aspect, the application can determine the location of the electronic shelf label based on information about the location of the imaging device, posture information of the imaging device, information about internal parameters of the imaging device, and an image of an area in which the electronic shelf label is provided.

[0028] In the process of assigning a product to an electronic shelf label according to various embodiments of the present disclosure, the product assignment task for the electronic shelf label and the task of identifying the location of the electronic shelf label are simultaneously performed by matching at least one of the information on the location of the electronic shelf label determined based on the related information of an image device that has photographed an area where the electronic shelf label is provided with the related information of the product, thereby efficiently performing management of the electronic shelf label.

[0029] According to various embodiments of the present disclosure, the position of the electronic shelf label can be more precisely determined based on related information of a first imaging device that photographs an area where an electronic shelf label is provided and related information of a second imaging device that photographs an area where an electronic shelf label is provided.

[0030] However, the effects that can be obtained through various embodiments of the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood from the description below.

[0031] FIG. 1 illustrates an exemplary configuration of a management system for at least one electronic shelf label according to one embodiment.

[0032] Figure 2 illustrates the configuration of an electronic shelf label according to one embodiment.

[0033] FIG. 3 is a block diagram illustrating an exemplary configuration of a server according to one embodiment.

[0034] FIG. 4 is a block diagram illustrating an exemplary configuration of an electronic device according to one embodiment.

[0035] FIG. 5 is a flowchart of a management method for at least one electronic shelf label according to one embodiment.

[0036] Figure 6 is for explaining a process of obtaining product-related information according to one embodiment.

[0037] FIG. 7 is a diagram illustrating a method of obtaining identification information of an electronic shelf label according to one embodiment.

[0038] FIG. 8 is a diagram illustrating an image device according to one embodiment taking a picture of an area where an electronic shelf label is provided.

[0039] FIG. 9 is an image illustrating an area in which an electronic shelf label is provided according to one embodiment.

[0040] FIG. 10 is a flowchart illustrating steps according to one embodiment that may be further included in the method of FIG. 5.

[0041] FIG. 11 is a flowchart illustrating steps according to another embodiment that may be further included in the method of FIG. 5.

[0042] FIG. 12 is an image illustrating an area in which an electronic shelf label is provided according to another embodiment.

[0043] FIG. 13 is a flowchart illustrating steps according to another embodiment that may be further included in the method of FIG. 5.

[0044] The present invention is capable of various modifications and embodiments. Therefore, specific embodiments are illustrated in the drawings and described in detail in the detailed description. The effects and features of the present invention, as well as the methods for achieving them, will become clear with reference to the embodiments described in detail below together with the drawings. However, the present invention is not limited to the embodiments disclosed below and can be implemented in various forms. In the following embodiments, terms such as first, second, etc. are not used in a limiting sense but are used for the purpose of distinguishing one component from another. Furthermore, the singular expression includes plural expressions unless the context clearly indicates otherwise. Furthermore, terms such as "include" or "have" indicate the presence of a feature or component described in the specification, and do not preemptively exclude the possibility that one or more other features or components may be added. Furthermore, in the drawings, the sizes of components may be exaggerated or reduced for convenience of explanation. For example, the size and thickness of each component shown in the drawings are arbitrarily shown for convenience of explanation, and thus the present invention is not necessarily limited to what is shown.

[0045] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings. When describing with reference to the drawings, identical or corresponding components are given the same reference numerals and redundant descriptions thereof will be omitted.

[0046] FIG. 1 illustrates an exemplary configuration of a management system (1000) for at least one electronic shelf label according to one embodiment. FIG. 2 illustrates a configuration of an electronic shelf label (100) according to one embodiment. FIG. 3 is a block diagram illustrating an exemplary configuration of a server (200) according to one embodiment. FIG. 4 is a block diagram illustrating an exemplary configuration of an electronic device (300) according to one embodiment. FIG. 5 is a flowchart of a management method (S100) for at least one electronic shelf label according to one embodiment. FIG. 6 is for explaining an example of obtaining product-related information according to one embodiment. FIG. 7 is for explaining an example of obtaining identification information of an electronic shelf label according to one embodiment. FIG. 8 is for explaining an example of an image device (401, 402) photographing an area where electronic shelf labels (101, 102, 103) are provided according to one embodiment. FIG. 9 is a flowchart illustrating an image taken of an area where an electronic shelf label is provided according to one embodiment. FIG. 10 is a flowchart illustrating steps according to one embodiment that may be further included in the method (S100) of FIG. 5. FIG. 11 is a flowchart illustrating steps according to another embodiment that may be further included in the method (S100) of FIG. 5. FIG. 12 is a flowchart illustrating an image taken of an area where an electronic shelf label is provided according to another embodiment. FIG. 13 is a flowchart illustrating steps according to another embodiment that may be further included in the method (S100) of FIG. 5.

[0047] -System (1000)

[0048] A management system (1000) for at least one electronic shelf label according to one embodiment can provide an environment in which management of the electronic shelf label (100) can be efficiently performed by enabling a store field staff member to obtain information about the location of the electronic shelf label (100) when performing a task of assigning a product to the electronic shelf label (100) using an electronic device (300).

[0049] Referring to FIG. 1, a system (1000) may include an electronic shelf label (100) provided on a shelf (30), a server (200), an electronic device (300), and an imaging device (400) configured to photograph an area where the electronic shelf label (100) is provided. The electronic device (300) may be a user terminal in the form of a portable mobile device.

[0050] The electronic shelf label (100) included in the system (1000) can be linked with the server (200), and the related information of the product displayed on the electronic shelf label (100) can be updated by the server (200).

[0051] Data related to updated product information is transmitted from the server (200) to the electronic shelf label (100), and the electronic shelf label (100) can display the updated product information. In this case, for example, the server (200) can update the product information based on user input via an electronic device (300).

[0052] In detail, to update the relevant information of a product assigned to an electronic shelf label (100), the server (200) can exchange necessary data with the electronic shelf label (100) and the electronic device (300). Accordingly, the server (200) can provide the environment necessary to update the relevant information of a product.

[0053] A shelf (30) may be provided with a plurality of electronic shelf labels (100) and a plurality of products. Each of the plurality of products may be assigned to a respective one of the plurality of electronic shelf labels (100). A first product may be assigned to any first electronic shelf label among the plurality of electronic shelf labels (100), and a second product different from the first product may be assigned to any other second electronic shelf label. The first electronic shelf label and the first product may be provided adjacent to each other, and the second electronic shelf label and the second product may be provided adjacent to each other.

[0054] The server (200) can update related information of multiple products assigned to multiple electronic shelf labels (100). The server (200) can update related information of multiple products in batches and transmit the updated related information of multiple products to multiple electronic shelf labels (100).

[0055] For example, the server (200) may update relevant information for any first product among a plurality of products and transmit the updated relevant information for the first product to the first electronic shelf label to which the first product is assigned. Furthermore, the server (200) may update relevant information for any other second product among the plurality of products and transmit the updated relevant information for the second product to the second electronic shelf label to which the second product is assigned.

[0056] The electronic shelf label (100), server (200), electronic device (300), and imaging device (400) may be connected to each other via a network (500). Here, the network (500) according to the embodiment may mean a connection structure that enables information exchange between each node, such as the electronic shelf label (100), server (200), and electronic device (300).

[0057] For example, the network (500) may include, but is not limited to, a 3rd Generation Partnership Project (3GPP) network, a Long Term Evolution (LTE) network, a World Interoperability for Microwave Access (WIMAX) network, the Internet, a Local Area Network (LAN), a Wireless Local Area Network (Wireless LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), a Bluetooth network, a satellite broadcasting network, an analog broadcasting network, a Digital Multimedia Broadcasting (DMB) network, etc.

[0058] The electronic shelf label (100) can be wirelessly connected to the server (200) through a separate gateway (not shown). In this case, data from the server (200) can be transmitted to the electronic shelf label (100) through the gateway.

[0059] However, this is not limited thereto, and the electronic shelf label (100) can be connected to an electronic device (300) via wireless communication. For example, the electronic shelf label (100) can be paired to an electronic device (300) based on a Bluetooth function.

[0060] Hereinafter, the electronic shelf label (100), server (200), electronic device (300), and imaging device (400) included in the system (1000) will be described in detail with reference to the attached drawings.

[0061] -Electronic shelf label (100)

[0062] An electronic shelf label (100) may be an electronic device mounted on a shelf (30) to display information related to products displayed on the shelf (30). For example, the electronic shelf label (100) may display information related to the product, such as the Korean product name, English product name, country of origin, product price, discount information, raw materials, and weight / calories.

[0063] The electronic shelf label (100) may include an electronic paper display (EPD) that maintains a product information display state even when power is not supplied. The electronic paper display is suitable for the electronic shelf label (100) that requires reduced power consumption due to its bistability, which maintains the display state for a long period of time even when power is cut off. Known electronic paper displays include a twist ball type using a hemispherical twist ball charged with electrostatic charge, an electrophoretic display using electrophoresis and microcapsules, and a cholesterol liquid crystal display using cholesterol liquid crystals.

[0064] However, it is not limited thereto, and the electronic shelf label (100) may include any one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, and a 3D display.

[0065] Referring to FIG. 2, an electronic shelf label (100) provided on a shelf (30) may include a display module that displays product-related information provided on one area of ​​the outer surface and an LED (10) provided on another area.

[0066] Here, LED (10) is an abbreviation for 'light emitting device' and may be a light emitting device included in an electronic shelf label (100). A pattern code (PC) based on a signal from a server (200) or an electronic device (300) may be displayed on the display module of the electronic shelf label (100). Here, the pattern code (PC) may be a 2D code. For example, the pattern code (PC) may be a 4x4 2D code, and each of the plurality of pixels included in the pattern code (PC) may be displayed in black or white. Accordingly, the pattern code (PC) may be 65,536 (=2 16 ) can be displayed in different forms. However, it is not limited to this, and the size of the pattern code (PC) can be designed to have various sizes other than 4x4.

[0067] Additionally, the electronic shelf label (100) may include at least one button (1, 2). For example, the electronic shelf label (100) may include a first button (1) and a second button (2). The first button (1) and the second button (2) may be provided on one area of ​​the outer surface of the electronic shelf label (100).

[0068] The LED (10) can be controlled based on a signal from a server (200) or an electronic device (300). In addition, the types of light-emitting colors of the LED (10) can be diverse. For example, the light-emitting colors of the LED (10) can include seven colors: blue, red, green, yellow, sky blue, gray, and white. However, the present invention is not limited thereto, and the light-emitting colors of the LED (10) can further include various types of colors other than the seven colors listed above.

[0069] A pairing signal may be transmitted from the electronic shelf label (100) to the electronic device (300) based on a user input via the first button (1) and / or the second button (2). Accordingly, the electronic shelf label (100) may be paired with the electronic device (300) based on a Bluetooth method. For example, when a user presses the first button (1) and / or the second button (2), a pairing signal is transmitted from the electronic shelf label (100) to the electronic device (300), and the electronic shelf label (100) may be paired with the electronic device (300) based on a Bluetooth function.

[0070] -Server (200)

[0071] The server (200) can perform a series of processes to provide an environment in which the system (1000) can obtain information about the location of the electronic shelf label (100) when a store field employee uses an electronic device (300) to perform a task of assigning a product to the electronic shelf label (100).

[0072] For example, the server (200) can receive data on product-related information acquired by the electronic device (300) and data on identification information of the electronic shelf label (100). In addition, at the same time, the server (200) can determine the location of the electronic shelf label (100) based on the related information of the imaging device (400).

[0073] Here, the related information of the imaging device (400) may be a concept including information about the location of the imaging device (400) and image information of an area in which an electronic shelf label (100) is provided by the imaging device (400).

[0074] The server (200) can assign a product to an electronic shelf label (100) by matching any one of the identification information of the electronic shelf label (100) and the information regarding the location of the electronic shelf label (100) to the product-related information.

[0075] Additionally, the server (200) can provide an environment in which a user can update product-related information using an electronic device (300). The server (200) can store application programs, data, and / or commands for the product-related information update application to operate, and can transmit data based thereon to the electronic device (300).

[0076] Furthermore, the server (200) may provide a customer code to the electronic device (300). The server (200) may provide a customer code that grants the user the authority to update product-related information provided to the electronic device (300) that has registered for membership through a product-related information editing application. For example, a store customer or on-site employee may receive a product-related information update service by using the electronic device (300) that has received the customer code.

[0077] Referring to FIG. 3, the server (200) may include at least one processor (21) for data processing, a memory (22) for storing application programs, data and / or commands, etc., at least one communication module (23) for data exchange with an external device, a label location information database (24) for storing location information of an electronic shelf label (100), a label management information database (25) for storing identification information of an electronic shelf label (100) and related information of a product assigned thereto, and an imaging device database (26) for storing related information of an imaging device (400).

[0078] In addition, the server (200) may be implemented as a predetermined computing device that performs the functions of a product-related information update unit (27) that updates product-related information, a label position determination unit (28) that determines the position of an electronic shelf label (100) based on data transmitted from an imaging device (400), a label detection unit (29) that detects an electronic shelf label (100) in an image captured by the imaging device (400), a label position information averaging unit (40) that performs an averaging operation on information about the position of an electronic shelf label (100) determined based on an image captured by a first imaging device (401) and information about the position of an electronic shelf label (100) determined based on an image captured by a second imaging device (402), and a pattern code identification unit (41) that identifies a pattern code displayed by an electronic shelf label (100) in an image captured by the imaging device (400).

[0079] The processor (21) can control the overall operation of components included in the server (200) to provide an environment in which a product-related information editing application and / or an electronic shelf label management application can operate on the electronic device (300).

[0080] The processor (21) may be a system on chip (SOC) including a central processing unit (CPU) and / or a graphics processing unit (GPU), and may execute an operating system (OS) and / or application program stored in memory (22).

[0081] In addition, the processor (21) can communicate internally with each component included in the server (200) via a system bus, and can include one or more predetermined bus structures including a local bus.

[0082] Additionally, the processor (11) may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, and other electrical units for performing functions.

[0083] The memory (22) can store one or more of an operating system (OS), various application programs, data, and commands to provide an environment necessary for performing a method of editing product-related information and / or a method of managing electronic shelf labels.

[0084] In addition, the memory (22) may include a program area and a data area. Here, the program area according to the embodiment may be linked between the operating system (OS) that boots the server (200) and functional elements, and the data area may store data generated according to the use of the server (200).

[0085] In one embodiment, the memory (22) may be a variety of storage devices such as ROM, RAM, EPROM, flash drive, hard drive, etc., and may also be web storage that performs storage functions on the Internet. In addition, the memory (22) may be a storage medium that is removable from the server (200).

[0086] The communication module (23) may include various types of communication devices that enable the server (200) to transmit and receive data with external devices. The server (200) may transmit data based on an application program, data, and / or commands for the product-related information editing application and / or the electronic shelf label management application to the electronic device (300) through the communication module (23).

[0087] The label location information database (24) can store location information of electronic shelf labels (100). A plurality of electronic shelf labels (100) can be provided on a shelf (30) to correspond to a plurality of products. These plurality of electronic shelf labels (100) can each be placed at specific locations on the shelf (30), and specific location information for the shelves (30) of the plurality of electronic shelf labels (100) can be stored in the location information database (24).

[0088] For example, among a plurality of electronic shelf labels (100), a first electronic shelf label may be provided in the second floor, third column of the first shelf provided in Zone A among the plurality of zones. In this case, the location information of the first electronic shelf label, 'the second floor, third column of the first shelf in Zone A', may be stored in the location information database (24) as the location information of the first electronic shelf label in correspondence with the unique identification number of the first electronic shelf label.

[0089] However, it is not limited thereto, and the location information of the electronic shelf label (100) may be stored in the label location information database (24) in the form of coordinate information within the store. For example, the location information in the form of coordinate information of the electronic shelf label (100) may be determined by the label location determination unit (28), and the location information in the form of coordinate information of the electronic shelf label (100) determined by the label location determination unit (28) may be stored in the label location information database (24).

[0090] The label management information database (25) can store product allocation information in a form in which the identification information of the electronic shelf label (100) and the related information of the product assigned to the electronic shelf label (100) are matched with each other.

[0091] For example, a plurality of electronic shelf labels (100) may be provided in a store, and first product allocation information in which the identification information of one first electronic shelf label among the plurality of electronic shelf labels (100) and the related information of the first product assigned to the first electronic shelf label are matched, and second product allocation information in which the identification information of one second electronic shelf label other than the first electronic shelf label among the plurality of electronic shelf labels (100) and the related information of the second product assigned to the second electronic shelf label are matched, may be stored in a label management information database (25).

[0092] The imaging device database (26) can store information related to the imaging device (400). Here, the information related to the imaging device (400) can include information related to the location of the imaging device (400) and information related to internal parameters of the imaging device (400).

[0093] For example, an imaging device (400) according to one embodiment may be installed on a plurality of shelves (30) provided inside a store. In this case, a plurality of imaging devices (400) may be installed on each of the plurality of shelves (30).

[0094] The positions of each of the plurality of shelves (30) within the store may be predetermined. In addition, the positions of each of the plurality of imaging devices (400) provided on each of the plurality of shelves (30) on the corresponding shelf (30) may be predetermined.

[0095] Information about the location of each of the plurality of imaging devices (400) installed on a shelf (30) located at a predetermined location inside the store can be determined in advance and stored in the imaging location database (26).

[0096] For example, a first imaging device among a plurality of imaging devices (400) may be installed on the 4th floor, 3rd row of the first shelf among a plurality of shelves (30) inside the store. In this case, the location information of the first imaging device, 'the 4th floor, 3rd row of the first shelf', may be stored in the imaging device location database (26) as the location information of the first imaging device in correspondence with the unique identification number of the first imaging device.

[0097] However, this is not limited thereto, and the location information of the imaging device (400) may be stored in the form of coordinate information within the store in the imaging device location database (26). For example, the location information in the form of coordinate information of the imaging device (400) may be determined based on a wireless communication method between the imaging device (400) and a plurality of beacons placed within the store.

[0098] For example, the imaging device (400) may receive wireless signals from a plurality of beacons placed within a store, and the imaging device (400) may transmit data regarding information about the received wireless signals to the server (200). The processor (21) of the server (200) may analyze the data regarding information about the wireless signals from the imaging device (400) to calculate the strength and direction of the wireless signals, etc. The processor (21) of the server (200) may analyze the strength and direction of the wireless signals from the imaging device (400) to determine information regarding the location of the imaging device (400) in the form of coordinate information.

[0099] Furthermore, information regarding internal parameters such as the focal length, the position of the principal point, and the lens distortion of the imaging device (400) can be stored in the imaging device database (26).

[0100] Information regarding the internal parameters of the imaging device (400) may be stored in the imaging device database (26). However, this is not limited thereto, and information regarding the internal parameters of the imaging device (400) may be stored in real time in the imaging device database (26) according to data regarding the internal parameters of the imaging device (400) transmitted from the imaging device (400) to the server (200).

[0101] The product-related information update unit (27) can update product-related information displayed on the electronic shelf label (100). For example, the product-related information update unit (27) can control the electronic shelf label (100) so that product-related information displayed on the electronic shelf label (100) is periodically updated according to the product-related information update rules stored in the memory (22). The product-related information update rules stored in the memory (22) can be predetermined by the user and constantly modified.

[0102] However, it is not limited to this, and the product-related information update unit (27) can also control the electronic shelf label (100) so that the product-related information displayed on the electronic shelf label (100) is updated according to user input for editing the product-related information.

[0103] For example, a product-related information update unit (27) can control an electronic shelf label (100) so that information related to a product updated by user input into an electronic device (300) is displayed on the electronic shelf label (100).

[0104] The label position determination unit (28) can determine the position of the electronic shelf label (100) within the store based on data transmitted from the imaging device (400). For example, the label position determination unit (28) can calculate coordinate information of the electronic shelf label (100) within the store.

[0105] For example, the imaging device (400) can photograph an area where an electronic shelf label (100) is provided. The imaging device (400) can transmit data of an image of the area where the electronic shelf label (100) is provided to the server (200). At the same time, data of the posture information of the imaging device (400) at the time when the imaging device (400) photographs the area where the electronic shelf label (100) is provided can be transmitted from the imaging device (400) to the server (200).

[0106] The label position determination unit (28) can determine the position of the electronic shelf label (100) based on information about the position of the imaging device (400), information about the posture of the imaging device (400), an image of an area where the electronic shelf label (100) is provided by the imaging device (400) and information about internal parameters of the imaging device (400) obtained from the imaging device database (26).

[0107] For example, the label position determination unit (28) can calculate coordinate information of the center point of the electronic shelf label (100) detected in an image taken of an area where the electronic shelf label (100) is provided by the imaging device (400).

[0108] Furthermore, the label position determination unit (28) can perform a predetermined matrix operation using information about the position and posture of the imaging device (400) and information about internal parameters of the imaging device (400) with respect to the coordinates of the center point of the electronic shelf label (100) detected in the image, thereby calculating coordinate information of the electronic shelf label (100) within the store.

[0109] The label detection unit (29) can detect the electronic shelf label (100) from an image taken by the imaging device (400) of the area where the electronic shelf label (100) is provided.

[0110] For example, the imaging device (400) can photograph an area where an electronic shelf label (100) is provided, and data of an image of the area where the electronic shelf label (100) is provided can be transmitted from the imaging device (400) to the server (200).

[0111] The label detection unit (29) can detect the electronic shelf label (100) among various objects included in the image in which the area where the electronic shelf label (100) is provided is photographed based on an image extraction algorithm.

[0112] The label position information averaging unit (40) can average information about the position of the first electronic shelf label (101) determined based on images captured by a plurality of imaging devices (401, 402) configured to capture electronic shelf labels (100).

[0113] For example, the label position information averaging unit (40) can average the first coordinate information of the first electronic shelf label (101) determined based on an image captured by the first imaging device (401) of an area where the first electronic shelf label (101) is provided, and the second coordinate information of the first electronic shelf label (101) determined based on an image captured by the second imaging device (402) of an area where the first electronic shelf label (101) is provided.

[0114] The pattern code identification unit (41) can identify the pattern code displayed by the electronic shelf label (100) detected in the image captured by the imaging device (400) of the area where the electronic shelf label (100) is provided.

[0115] The electronic shelf label (100) can display a unique pattern code, and this pattern code can correspond to unique identification information of the electronic shelf label (100). In this case, identifying the pattern code displayed by the electronic shelf label (100) can mean obtaining unique identification information of the electronic shelf label (100) displaying the pattern code.

[0116] Here, the identification information of the electronic shelf label (100) may be in the form of a string of characters, a string of numbers, and / or a combination thereof. However, the present invention is not limited thereto, and the identification information of the electronic shelf label (100) may also include a combination of various symbols other than letters and numbers.

[0117] For example, the pattern code identification unit (41) can detect the pattern code displayed on the electronic shelf label (100) detected from an image in which an area in which the electronic shelf label (100) is provided is photographed based on an image extraction algorithm.

[0118] The detected pattern code may correspond to the identification information of the electronic shelf label (100). The corresponding pattern code and the identification information of the electronic shelf label (100) may be matched and stored in a pattern code database (not shown). The pattern code identification unit (41) may extract the identification information of the electronic shelf label (100) corresponding to the detected pattern code from the pattern code database.

[0119] In this way, the pattern code identification unit (41) can detect the pattern code displayed by the electronic shelf label (100) based on the data of the image in which the electronic shelf label (100) was photographed, and obtain identification information of the electronic shelf label (100) corresponding to the pattern code.

[0120] In the above description, it has been described that the server (200) according to one embodiment performs the functional operations as described above, but various embodiments are possible, such as, depending on the embodiment, at least a part of the functional operations performed by the server (200) may be performed by an external device (e.g., an electronic device (300)), and at least a part of the functional operations performed by the external device may be further performed by the server (200).

[0121] -Electronic devices (300)

[0122] The electronic device (300) may be a device having a product-related information editing application and / or an electronic shelf label management application installed. The electronic device (300) may include a portable user terminal.

[0123] The electronic device (300) may be used by various users. For example, the user of the electronic device (300) may be a store employee or a customer of the store.

[0124] The electronic device (300) may be implemented as, for example, a computer or portable terminal that can connect to a server (200) via a network (500).

[0125] Here, the computer may include, for example, a laptop, desktop, or VR HMD equipped with a web browser (e.g., HTC VIVE, Oculus Rift, GearVR, DayDream, PSVR, etc.).

[0126] A portable terminal is a wireless communication device that ensures portability and mobility, for example, and may include various devices equipped with communication modules such as smartphones, tablet PCs, wearable devices, and Bluetooth (BLE, Bluetooth Low Energy), NFC, RFID, ultrasonic, infrared, WiFi, and LiFi.

[0127] Referring to FIG. 4, from a functional perspective, the electronic device (300) may include a memory (310), a processor assembly (320), a communication module (330), an interface module (340), an input system (350), a sensor system (360), and a display system (370). These components may be configured to be included within the housing of the electronic device (300).

[0128] In detail, an application (311) may be stored in the memory (310). The application (311) may store one or more of various application programs, data, and commands for providing a product-related information editing service and / or an electronic shelf label management service that manages location information of an electronic shelf label (100), product information assigned to an electronic shelf label (100), and identification information of an electronic shelf label (100).

[0129] In addition, the memory (310) may include a program area and a data area. Here, the program area according to the embodiment may be linked between the operating system (OS) that boots the electronic device (300) and functional elements, and the data area may store data generated according to the use of the electronic device (300).

[0130] Additionally, the memory (310) may include at least one non-transitory computer-readable storage medium and one or more temporary computer-readable storage medium.

[0131] For example, the memory (310) may be a variety of storage devices such as a ROM, EPROM, flash drive, hard drive, etc., and may include web storage that performs the storage function of the memory (310) on the Internet.

[0132] The processor assembly (320) may include at least one processor capable of executing commands of an application (311) stored in the memory (310) to perform various tasks for creating a product-related information editing environment and / or an electronic shelf label management environment.

[0133] In an embodiment, the processor assembly (320) can control the overall operation of components included in the electronic device (300) through an application (311) of the memory (310) to provide a product-related information editing environment and / or an electronic shelf label management environment.

[0134] For example, the processor assembly (320) can control data of identification information of an electronic shelf label (100) received through a communication module (330) and data of product-related information to be transmitted to the server (200) again through the communication module (330).

[0135] Additionally, the processor assembly (320) can control the data of an image captured by the imaging device (361) to be transmitted to the server (200) via the communication module (330).

[0136] The processor assembly (320) may be a system on chip (SOC) suitable for an electronic device (300) including a central processing unit (CPU) and / or a graphics processing unit (GPU), and may execute an operating system (OS) and / or application programs stored in a memory (310) and control each component mounted on the electronic device (300).

[0137] Additionally, the processor assembly (320) may communicate with each component internally via a system bus and may include one or more predetermined bus structures including a local bus.

[0138] Additionally, the processor assembly (320) may be implemented by including at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

[0139] The communication module (330) may include one or more devices for communicating with external devices. The communication module (330) may communicate via a wireless network.

[0140] In detail, the communication module (330) can communicate with a server (200) that stores content sources for implementing a product-related information editing environment and / or an electronic shelf label management environment, and can communicate with various user input components, such as a controller that receives user input.

[0141] In an embodiment, the communication module (330) can transmit and receive various data related to a product-related information editing environment and / or an electronic shelf label management environment to and from other electronic devices and / or external servers.

[0142] These communication modules (330) can wirelessly transmit and receive data with at least one of a base station, an external terminal, and an arbitrary server on a mobile communication network constructed through a communication device capable of performing technical standards or communication methods for mobile communication (e.g., LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), 5G NR (New Radio), WIFI) or short-range communication methods.

[0143] Additionally, the communication module (330) may include a barcode reader capable of reading barcodes attached to products. A product barcode containing relevant information about the product may be attached to a product or a shelf (30) on which the product is displayed. When the electronic device (300) approaches the product barcode, the product barcode may be read by the barcode reader included in the communication module (330). Accordingly, the electronic device (300) may obtain relevant information about the product.

[0144] Additionally, the communication module (330) may include a predetermined wireless communication device for obtaining identification information of the electronic shelf label (100). For example, the communication module (330) may include a Bluetooth low energy (BLE) device, a radio frequency identification (RFID) tag, a near field communication (NFC) tag, etc.

[0145] Furthermore, the communication module (330) may include a wireless signal receiver that receives wireless signals from a plurality of beacons placed within the store. A plurality of beacons may be placed at a plurality of fixed locations within the store. The plurality of beacons may transmit wireless signals to an electronic device (300) used by a user within the store, and the electronic device (300) may receive wireless signals from the plurality of beacons through the wireless signal receiver included in the communication module (330).

[0146] Here, the wireless signals transmitted by the plurality of beacons may include at least one of a Wi-Fi signal, a low-power Bluetooth signal, and an ultra-wideband (UWB) signal.

[0147] The interface module (340) can communicatively connect the electronic device (300) to one or more other devices. In detail, the interface module (340) can include wired and / or wireless communication devices compatible with one or more different communication protocols.

[0148] Through this interface module (340), the electronic device (300) can be connected to multiple input / output devices.

[0149] For example, the interface module (340) can be connected to an audio output device such as a headset port or speaker to output audio.

[0150] As an example, the audio output device is described as being connected via an interface module (340), but an embodiment in which it is installed inside an electronic device (300) may also be included.

[0151] Additionally, for example, the interface module (340) may be connected to an input device such as a keyboard and / or mouse to obtain user input.

[0152] Such an interface module (340) may be configured to include at least one of a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device equipped with an identification module, an audio I / O (Input / Output) port, a video I / O (Input / Output) port, an earphone port, a power amplifier, an RF circuit, a transceiver, and other communication circuits.

[0153] The input system (350) can detect user input (e.g., gestures, voice commands, button operation, or other types of input).

[0154] In detail, the input system (350) may include a predetermined button, a touch sensor, and / or an image sensor that receives user motion input.

[0155] Additionally, the input system (350) can be connected to an external controller through an interface module (340) to receive user input.

[0156] The sensor system (360) may include an image device (361), a position sensor (IMU, 363), and an audio sensor (365). In addition, the sensor system (360) may further include various sensors such as a distance sensor, a proximity sensor, and a contact sensor.

[0157] Here, the imaging device (361) can capture images and / or videos of the physical space around the electronic device (300).

[0158] The imaging device (361) can capture an image by photographing the direction in which it is positioned and located on the front or / and back of the electronic device (300), and can capture a physical space through a camera positioned toward the outside of the electronic device (300).

[0159] Such an image device (361) may include an image sensor device and an image processing module. In detail, the image device (361) may process still images or moving images obtained by an image sensor device (e.g., CMOS or CCD).

[0160] The position sensor (IMU, 363) can detect at least one of the movement and acceleration of the electronic device (300). For example, the IMU (363) may be formed by a combination of various position sensors such as an accelerometer, a gyroscope, and a magnetometer. Such an IMU (363) may be referred to as a motion sensor hereinafter.

[0161] Additionally, the IMU (363) can recognize spatial information about the physical space around the electronic device (300) in conjunction with the GPS of the communication module (330).

[0162] The audio sensor (365) can recognize sounds around the electronic device (300).

[0163] In detail, the audio sensor (365) may include a microphone capable of detecting voice input from a user using the electronic device (300).

[0164] The display system (370) can output various information related to the product-related information editing environment and / or the electronic shelf label management environment as graphic images.

[0165] As an example, the display system (370) can display various user interfaces (as an example, a member registration interface) for a product-related information editing environment and / or an electronic shelf label management environment.

[0166] Such displays may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, and an e-ink display.

[0167] The components may be arranged within the housing of such an electronic device (300), and the user interface may include a touch sensor (373) on a display (371) configured to receive user touch input.

[0168] In detail, the display system (370) may include a display (371) that outputs an image and a touch sensor (373) that detects a user's touch input.

[0169] For example, the display (371) may be implemented as a touch screen by forming a mutual layer structure with the touch sensor (373) or forming an integral structure. Such a touch screen may function as a user input unit that provides an input interface between the electronic device (300) and the user, and at the same time, provide an output interface between the electronic device (300) and the user.

[0170] -Imaging device (400)

[0171] An imaging device (400) may be installed in a store and configured to photograph an area where an electronic shelf label (100) is installed.

[0172] For example, referring to FIG. 8, first to third products (p1, p2, p3) and first to third electronic shelf labels (101, 102, 130) may be provided on a first shelf (31), and a plurality of imaging devices (401, 402) may be provided on a second shelf (32) that is different from the first shelf (31). For example, the second shelf (32) may be arranged to face the first shelf (31).

[0173] In FIG. 8, two imaging devices, a first imaging device (401) and a second imaging device (402), are shown as being provided on the second shelf (32), but this is not limited to the first imaging device (401) and three or more imaging devices may be provided on the second shelf (32).

[0174] The imaging device (400) can be configured to rotate in various directions to capture an area where an electronic shelf label (100) is provided through a field of view (FOV). The imaging device (400) can include an RGB camera.

[0175] The imaging device (400) may include a wireless communication module capable of exchanging signals with an external device. For example, the imaging device (400) may include a Bluetooth low energy (BLE) device, a radio frequency identification (RFID) tag, a near field communication (NFC) tag, etc.

[0176] Additionally, the imaging device (400) may further include a wireless signal receiver that receives wireless signals from a plurality of beacons placed within the store.

[0177] Meanwhile, the imaging device (400) may be configured to transmit data related to the imaging device (400) to the server (200).

[0178] For example, the imaging device (400) can transmit data of a captured image to the server (200). In addition, the imaging device (400) can transmit data of attitude information of the imaging device (400) sensed by its own IMU to the server (200).

[0179] Furthermore, the imaging device (400) may be configured to be movable with respect to the electronic shelf label (100).

[0180] For example, the imaging device (400) may be mounted on a mobile robot configured to move within a store. In this case, the mobile robot may use the imaging device (400) to capture images of an area where electronic shelf labels (100) are provided while moving within the store.

[0181]

[0182] -Management method for electronic shelf labels (S100)

[0183] Hereinafter, a management method (S100) for an electronic shelf label, which allocates product-related information to an electronic shelf label (100) and simultaneously obtains and stores information on the location of the electronic shelf label (100) through an electronic shelf label management application (311) stored in a memory (310) of an electronic device (300) according to various embodiments and executed by a processor assembly (320), will be described in detail with reference to FIGS. 5 to 13.

[0184] In various embodiments, the processor assembly (320) of the electronic device (300) may execute an electronic shelf label management application (311) stored in the memory (310) or cause it to operate in a background state.

[0185] Certain operations required for the execution of the electronic sunscreen management application (311) may be performed by the processor (21) of the server (200). However, this is not limited thereto, and at least some of the operations required for the execution of the electronic sunscreen management application (311) may be performed by the processor assembly (320) of the electronic device (300), and other some may be performed by the processor (21) of the server (200).

[0186] Hereinafter, for convenience of explanation, the processor (21) of the electronic device (300) is described as performing a predetermined operation for executing the electronic shelf label management application (311) to perform the management method (S100) for the electronic shelf label.

[0187] Referring to FIG. 5, a management method (S100) for an electronic shelf label according to one embodiment includes a step of obtaining product-related information (S101), a step of obtaining identification information of an electronic shelf label (101) (S103), a step of photographing an area where an electronic shelf label (101) is provided using a first imaging device (401) (S105), a step of obtaining information on a position of the first imaging device (401) (S107), a step of determining a position of the electronic shelf label (100) based on an image of an area where an electronic shelf label (100) is provided by the first imaging device (401) and the information on the position of the first imaging device (401) (S109), and a step of assigning a product to the electronic shelf label (100) by matching at least one of the information on the position of the electronic shelf label (100) determined in the product-related information and the identification information of the electronic shelf label (100). It may include step (S111).

[0188] In step (S101), product-related information can be obtained by an electronic device (300) used by the user.

[0189] For example, referring to FIG. 6, a plurality of products (p1, p2, p3) may be displayed on a shelf (30) provided within a store. In this case, a first product (p1), a second product (p2), and a third product (p3) may be displayed side by side on the shelf (30), and information related to the first product (p1) may be acquired by an electronic device (300).

[0190] The electronic device (300) transmits data of information related to the acquired first product (p1) to the server (200), and accordingly, the server (200) can acquire information related to the first product (p1).

[0191] The electronic device (300) can obtain related information about the first product (p1) by identifying a unique code displayed on the first product (p1) or the shelf (30) on which the first product (p1) is displayed.

[0192] For example, referring to FIG. 6, a user can scan a product barcode attached to a first product (p1) or a shelf (30) on which the first product (p1) is displayed using an electronic device (300). Accordingly, the product barcode is read by a barcode reader installed in the electronic device (300), and the electronic device (300) can obtain data of information related to the first product (p1), such as the Korean product name, English product name, product origin, product price, discount information, raw materials, and weight / calories included in the product barcode.

[0193] In step (S103), identification information of the electronic shelf label (100) can be obtained by an electronic device (300) used by the user.

[0194] For example, referring to FIG. 7, a plurality of electronic shelf labels (101, 102, 103) may be displayed on a shelf (30) provided within a store. In this case, each of the plurality of electronic shelf labels (101, 102, 103) may be displayed in a position close to each of the plurality of products (p1, p2, p3).

[0195] The first electronic shelf label (101) may be any one of a plurality of electronic shelf labels (101, 102, 130).

[0196] For example, the first electronic shelf label (101) may be displayed close to the first product (p1), the second electronic shelf label (102) may be displayed close to the second product (p2), and the third electronic shelf label (103) may be displayed close to the third product (p3).

[0197] The electronic device (300) transmits data of the identification information of the acquired first electronic shelf label (101) to the server (200), and accordingly, the server (200) can acquire the identification information of the first electronic shelf label (101).

[0198] For example, referring to FIG. 7, a user may place an electronic device (300) close to a first electronic shelf label (101) to tag the electronic device (300) to the first electronic shelf label (101). In this case, wireless communication may be achieved through NFC tags installed on each of the first electronic shelf label (101) and the electronic device (300). Based on this wireless communication method between the first electronic shelf label (101) and the electronic device (300), data of identification information of the first electronic shelf label (101) may be transmitted to the electronic device (300).

[0199] However, it is not limited thereto, and data of identification information of the first electronic shelf label (101) may be transmitted to the electronic device (300) based on a low-power Bluetooth device-based wireless communication method or an RFID tag-based wireless communication method between the electronic device (300) and the first electronic shelf label (101).

[0200] In step (S105), the first imaging device (401) can photograph an area where the first electronic shelf label (101) is provided.

[0201] Referring to FIG. 8, the first to third products (p1, p2, p3) and the first to third electronic shelf labels (101, 102, 130) are provided on a first shelf (31), and the first imaging device (401) may be provided on a second shelf (32) that is different from the first shelf (31). For example, the second shelf (32) may be arranged to face the first shelf (31).

[0202] In this case, the first imaging device (401) may be installed on the upper side of the second shelf (32) and configured to photograph the first shelf (31).

[0203] For example, the first imaging device (401) may be configured to periodically photograph the first shelf (31). Accordingly, the first imaging device (401) may periodically photograph an area where the first electronic shelf label (101) is provided.

[0204] However, it is not limited thereto, and the operation of the first imaging device (401) can be controlled according to the control of the server (200) based on data of information regarding the location of the electronic device (300).

[0205] For example, the electronic device (300) may receive wireless signals from a plurality of beacons placed inside a store while being positioned in proximity to the first electronic shelf label (101). The electronic device (300) may transmit data regarding information about the received wireless signals to the server (200). The processor (21) of the server (200) may analyze the data regarding information about the wireless signals from the electronic device (300) to derive information regarding the location of the electronic device (300).

[0206] The processor (21) of the server (200) can determine a first imaging device (401) that is installed at an appropriate location capable of photographing the first electronic shelf label (101) among a plurality of imaging devices (400) installed in the store based on information about the location of the electronic device (300) close to the first electronic shelf label (101). Here, the appropriate location capable of photographing the first electronic shelf label (101) may mean a location closest to the electronic device (300) close to the first electronic shelf label (101).

[0207] Thereafter, the processor (21) of the server (200) can control the first imaging device (401), which is determined to be installed at an appropriate location among the plurality of imaging devices (400) to be capable of photographing the first electronic shelf label (101), to photograph the area where the first electronic shelf label (101) is installed.

[0208] In this way, when the electronic device (300) tags the first electronic shelf label (101) to obtain identification information, the processor (21) of the server (200) can control the first imaging device (401) to photograph the area where the first electronic shelf label (101) is provided based on information about the location of the electronic device (300) close to the first electronic shelf label (101).

[0209] Also, for example, referring to FIG. 9, a first image (Im1) in which an area where a first electronic shelf label (101) is provided by a first imaging device (401) is photographed may include a first electronic shelf label (101) and a first product (p1).

[0210] The first imaging device (401) can transmit data of the first image (Im1) to the server (200), and accordingly, the server (200) can obtain data of the first image (Im1).

[0211] In step (S107), the processor (21) of the server (200) can obtain information about the location of the first imaging device (401) that photographed the area where the first electronic shelf label (101) is provided.

[0212] For example, the processor (21) of the server (200) can obtain information about the location of the first imaging device (401) from the imaging device database (24).

[0213] However, it is not limited thereto, and the processor (21) of the server (200) can directly receive data on information regarding the location of the first imaging device (401) from the first imaging device (401) that has photographed the area where the first electronic shelf label (101) is provided.

[0214] For example, a plurality of beacons may be placed at regular intervals within a store equipped with multiple electronic shelf labels (101, 102, 103). Each of the multiple beacons can transmit a wireless signal in real time in all directions.

[0215] The first imaging device (401) can receive wireless signals from multiple beacons. For example, referring to FIG. 8, the first imaging device (401) can receive wireless signals from multiple beacons while photographing an area where the first electronic shelf label (101) is provided. The first imaging device (401) can transmit data regarding information about the received wireless signals to the server (200).

[0216] The processor (21) of the server (200) can analyze data of information about a wireless signal from the first imaging device (401) to derive information about the location of the first imaging device (401).

[0217] Since the method of deriving information about the location of the first imaging device (401) that received the wireless signal based on the analysis of the wireless signal is already a known technology, a more detailed description thereof is omitted here.

[0218] In step (S109), the processor (21) of the server (200) can determine the position of the first electronic shelf label (101) based on information about the position of the first imaging device (401) and a first image (Im1) in which an area in which the first electronic shelf label (101) is provided is captured by the first imaging device (401).

[0219] For example, the processor (21) of the server (200) can determine the position of the first electronic shelf label (101) by performing a predetermined operation using information about the position of the first imaging device (401) based on the first image (Im1) in which the area where the first electronic shelf label (101) is provided is photographed.

[0220] To this end, the method (S100), referring to FIG. 10, may further include a step (S1091) of acquiring detailed information of the first imaging device (401) performed before step (S109) and a step (S1093) of acquiring information about internal parameters of the first imaging device (401).

[0221] In step (S1091), the processor (21) of the server (200) can obtain the detailed information of the first imaging device (401) at the time when the area where the first electronic shelf label (101) is provided is photographed.

[0222] For example, according to a control command of the processor (21) of the server (200), the first imaging device (401) can photograph an area where the first electronic shelf label (101) is provided, and in this case, the posture of the first imaging device (401) can be determined according to the control command of the processor (21) of the server (200).

[0223] For example, the processor (21) of the server (200) can determine information about the three-dimensional direction (e.g., roll, pitch, yaw) of the first imaging device (401) necessary to control the first imaging device (401) to photograph an area where the first electronic shelf label (101) is provided.

[0224] In this way, the processor (21) of the server (200) can secure the detailed information of the first imaging device (401) in the process of controlling the operation of the first imaging device (401).

[0225] However, it is not limited thereto, and the first imaging device (401) posture information at the time when the first imaging device (401) photographs the area where the first electronic shelf label (101) is provided can be acquired by the IMU included in the first imaging device (401).

[0226] The first imaging device (401) can transmit data of the posture information of the first imaging device (401) to the server (200), and accordingly, the server (200) can obtain data of the posture information of the first imaging device (401).

[0227] In step (S1093), the processor (21) of the server (200) can obtain information about the internal parameters of the first imaging device (401) at the time when the area where the first electronic shelf label (101) is provided is photographed.

[0228] Information regarding the internal parameters of the first imaging device (401) may be stored in the imaging device database (26) of the server (200). The processor (21) of the server (200) may obtain information regarding the internal parameters of the first imaging device (401) from the imaging device database (26).

[0229] However, it is not limited thereto, and information regarding internal parameters of the first imaging device (401) may be directly transmitted from the first imaging device (401) to the server (200).

[0230] In this case, in step (S109), the label position determination unit (28) of the server (200) can determine the position of the first electronic shelf label (101) based on information about the position of the first imaging device (401), information about the posture of the first imaging device (401), and a first image (Im1) in which an area in which the first electronic shelf label (101) is provided is captured by the first imaging device (401).

[0231] Referring to FIG. 9, the label position determination unit (28) of the server (200) can calculate information regarding the coordinates of the first center point (c1) of the first electronic shelf label (101) on the first image (Im1) that captures the area where the first electronic shelf label (101) is provided.

[0232] For example, a first electronic shelf label (101) can be detected from a first image (Im1) by a label detection unit (29), and a first center point (c1) of the first electronic shelf label (101) can be detected. A label position determination unit (28) can produce information regarding the coordinates of the detected first center point (c1) on the first image (Im1).

[0233] In addition, the label position determination unit (28) can determine the position of the first electronic shelf label (101) by performing a predetermined operation using information about the position of the first imaging device (401), information about the posture of the first imaging device (401), and information about the internal parameters of the first imaging device (401) with respect to the coordinates of the first center point (c1) of the first electronic shelf label (101) on the first image (Im1).

[0234] For example, the label position determination unit (28) can produce information about the coordinates of the location of the first electronic shelf label (101) within the store.

[0235] Since a predetermined operation for calculating the coordinates of an object in the real world based on the external parameters of the first imaging device (401), such as the position information and posture information of the first imaging device (401) that captures the image, the internal parameters of the first imaging device (401), and the coordinate information of the object on the captured image is a technology already known, a more detailed description thereof is omitted here.

[0236] In step (S111), the processor (21) of the server (200) can perform a task of assigning a first product (p1) to a first electronic shelf label (101) based on data from the electronic device (300).

[0237] In this case, the processor (21) of the server (200) can assign the first product (p1) to the first electronic shelf label (101) by matching at least one of the information on the location of the first electronic shelf label (101) and the identification information of the first electronic shelf label (101) to the related information of the first product (p1).

[0238] For example, the processor (21) of the server (200) can match the related information of the first product (p1) received from the electronic device (300) with the identification information of the first electronic shelf label (101) to assign the first product (p1) to the first electronic shelf label (101).

[0239] Alternatively, the processor (21) of the server (200) can match the information related to the first product (p1) received from the electronic device (300) with the information regarding the location of the first electronic shelf label (101) to assign the first product (p1) to the first electronic shelf label (101).

[0240] Furthermore, the processor (21) of the server (200) can match the identification information of the first electronic shelf label (101) and the information regarding the location of the first electronic shelf label (101) with the related information of the first product (p1) received from the electronic device (300) to assign the first product (p1) to the first electronic shelf label (101).

[0241] In this way, data of information matching at least one of the information regarding the location of the first electronic shelf label (101) and the identification information of the first electronic shelf label (101) with the related information of the first product (p1) can be stored in the label management information database (25) of the server (200). Accordingly, the location information of the first electronic shelf label (101) to which the first product (p1) is assigned can be stored and managed.

[0242] Meanwhile, a method (S100) according to one embodiment may further include additional steps for detecting a first electronic shelf label (101) from an image in which a plurality of electronic shelf labels are included in an image taken of an area in which a first electronic shelf label (101) is provided, and determining a position of the first electronic shelf label (101) based on an image of the detected first electronic shelf label (101).

[0243] For example, referring to FIG. 11, a method (S100) according to an embodiment may further include, before step (S109), a step (S201) of detecting at least one electronic shelf label from an image in which an area provided with an electronic shelf label (100) is captured by a first imaging device (401), a step (S203) of detecting a pattern code indicated by each of the at least one electronic shelf label detected in the image, a step (S205) of comparing at least one identification information corresponding to each of the pattern codes indicated by each of the at least one electronic shelf label detected in the image with identification information of a previously acquired electronic shelf label (100), and a step (S207) of determining a target electronic shelf label that indicates a pattern code corresponding to identification information that matches the identification information of the previously acquired electronic shelf label (100) among the at least one electronic shelf label detected in the image.

[0244] In step (S201), the label detection unit (29) of the server (200) can detect at least one electronic shelf label in an image in which an area in which a first electronic shelf label (101) is provided is photographed.

[0245] For example, referring to FIG. 12, a second image (Im2) in which an area where a first electronic shelf label (101) is provided by a first imaging device (401) is photographed may further include not only a first product (p1) and a first electronic shelf label (101), but also a second product (p2) and a second electronic shelf label (102).

[0246] The label detection unit (29) can detect the first electronic shelf label (101) and the second electronic shelf label (102) in the second image (Im2).

[0247] For example, the label detection unit (29) can detect the first electronic shelf label (101) by generating a first bounding box (b1) surrounding the first electronic shelf label (101) in the second image (Im2), and can detect the second electronic shelf label (102) by generating a second bounding box (b2) surrounding the second electronic shelf label (102).

[0248] In this way, the label detection unit (29) can detect the images of the first electronic shelf label (101) and the second electronic shelf label (102) in the second image (Im2).

[0249] In step (S203), the pattern code identification unit (41) of the server (200) can detect the pattern code displayed by each of at least one electronic shelf labels detected in the second image (Im2).

[0250] For example, referring to FIG. 12, the first electronic shelf label (101) detected by the label detection unit (29) can display a first pattern code (PC1). In addition, the second electronic shelf label (102) detected by the label detection unit (29) can display a second pattern code (PC2) different from the first pattern code (PC1).

[0251] The pattern code identification unit (41) can detect the first pattern code (PC1) displayed by the first electronic shelf label (101) and the second pattern code (PC2) displayed by the second electronic shelf label (102) in the second image (Im2).

[0252] In step (S205), the pattern code identification unit (41) of the server (200) can compare the identification information corresponding to each of the detected first pattern code (PC1) and second pattern code (PC2) with the identification information of the first electronic shelf label (101) that has been previously acquired.

[0253] For example, the pattern code identification unit (41) can obtain first identification information corresponding to the first pattern code (PC1) from the pattern code database. In addition, the pattern code identification unit (41) can obtain second identification information corresponding to the second pattern code (PC2) from the pattern code database.

[0254] Thereafter, the pattern code identification unit (41) can compare the first identification information corresponding to the first pattern code (PC1) with the identification information of the first electronic shelf label (101). In addition, the pattern code identification unit (41) can compare the second identification information corresponding to the second pattern code (PC2) with the identification information of the first electronic shelf label (101).

[0255] In step (S207), the pattern code identification unit (41) of the server (200) can determine the identification information that is identical to the identification information of the first electronic shelf label (101) transmitted from the electronic device (300) among the first identification information corresponding to the first pattern code (PC1) and the second identification information corresponding to the second pattern code (PC2).

[0256] For example, the pattern code identification unit (41) can determine that the first identification information corresponding to the first pattern code (PC1) is identical to the identification information of the first electronic shelf label (101) transmitted from the electronic device (300).

[0257] Thereafter, the pattern code identification unit (41) can determine an electronic shelf label displaying a first pattern code (PC1) corresponding to first identification information that matches the identification information of the first electronic shelf label (101) as the same target electronic shelf label as the first electronic shelf label (101).

[0258] In this way, the pattern code identification unit (41) can determine a target electronic shelf label that matches the first electronic shelf label (101) among at least one electronic shelf label included in the second image (Im2) that captures the area where the first electronic shelf label (101) is provided.

[0259] In this case, in step (S109) of method (S100) according to one embodiment, the label position determination unit (28) of the server (200) can determine the position of the first electronic shelf label (101) based on information about the position of the first imaging device (401), posture information of the first imaging device (401), information about internal parameters of the first imaging device (401), and an image of a target electronic shelf label determined based on an image of an area in which the first electronic shelf label (101) is provided by the first imaging device (401).

[0260] Referring to FIG. 12, the label position determination unit (28) can calculate information regarding the coordinates of the first center point (c1) of the first electronic shelf label (101), which is the target electronic shelf label, on the second image (Im2) that captures the area where the first electronic shelf label (101) is provided.

[0261] For example, a first electronic shelf label (101), which is a target electronic shelf label, can be detected from a second image (Im2) by a label detection unit (29), and a first center point (c1) of the first electronic shelf label (101) can be detected. A label position determination unit (28) can produce information regarding the coordinates of the detected first center point (c1) on the second image (Im2).

[0262] In addition, the label position determination unit (28) can determine the position of the first electronic shelf label (101) by performing a predetermined operation using information about the position of the first imaging device (401), information about the posture of the first imaging device (401), and information about the internal parameters of the first imaging device (401) with respect to the coordinates of the first center point (c1) of the first electronic shelf label (101) on the second image (Im2).

[0263] In this way, the label position determination unit (28) can specify the coordinates of the first electronic shelf label (101) within the store based on the image of the first electronic shelf label (101), which is a target electronic shelf label detected from the second image (Im2) containing a plurality of electronic shelf labels.

[0264] Furthermore, the method (S100) according to one embodiment may further include additional steps for obtaining more accurate information about the position of the first electronic shelf label (101) by utilizing a second imaging device (402) different from the first imaging device (401).

[0265] For example, referring to FIG. 13, a method (S100) according to one embodiment includes a step (S1111) of photographing an area where an electronic shelf label (100) is provided using a second imaging device (402) different from a first imaging device (401), a step (S1113) of obtaining information about the position of the second imaging device (402), a step (S1115) of determining the position of the electronic shelf label (100) based on the information about the position of the second imaging device (402) and the image of the area where the electronic shelf label (100) is provided photographed by the second imaging device (402), and a step (S1115) of determining the final position of the electronic shelf label (100) based on the information about the position of the electronic shelf label (100) determined based on the image photographed by the first imaging device (401) and the information about the position of the electronic shelf label (100) determined based on the image photographed by the second imaging device (402). It may further include step (S1117).

[0266] In step (S1111), a second imaging device (402) different from the first imaging device (401) can photograph an area where a first electronic shelf label (101) is provided.

[0267] Referring to FIG. 8, a second imaging device (402) may be configured to be able to photograph the first shelf (31) in parallel with the first imaging device (401) on a second shelf (32) facing the first shelf (31). The manner in which the second imaging device (402) photographs an area where the first electronic shelf label (101) is provided is substantially the same as the manner in which the first imaging device (401) photographs an area where the first electronic shelf label (101) is provided, and therefore, a description thereof is omitted herein.

[0268] In addition, steps (S1113) and (S1115) are substantially the same as steps (S107) and (S109) of the method (S100) of FIG. 5, respectively, and therefore, descriptions of steps (S1113) and (S1115) are omitted here.

[0269] In step (S1117), the label position determination unit (28) of the server (200) can determine the final coordinates of the first electronic shelf label (101) within the store based on information about the position of the first electronic shelf label (101) determined based on an image taken of an area where the first electronic shelf label (101) is provided by the first imaging device (401) and information about the position of the first electronic shelf label (101) determined based on an image taken of an area where the first electronic shelf label (101) is provided by the second imaging device (402).

[0270] For example, the label position information averaging unit (40) of the server (200) can average the first coordinate information of the first electronic shelf label (101) determined based on an image captured by the first imaging device (401) of the area where the first electronic shelf label (101) is provided, and the second coordinate information of the first electronic shelf label (101) determined based on an image captured by the second imaging device (402) of the area where the first electronic shelf label (101) is provided.

[0271] Although two imaging devices, a first imaging device (401) and a second imaging device (402), are illustrated in FIG. 8, three or more imaging devices may be provided on the second shelf (32). In this case, the label position information averaging unit (40) can average multiple pieces of coordinate information of the first electronic shelf label (101) determined based on images captured by each of the multiple imaging devices.

[0272] The label position determination unit (28) of the server (200) can determine the coordinate information generated by averaging by the label position information averaging unit (40) as the final coordinates of the first electronic shelf label (101).

[0273] In this way, the label position determination unit (28) of the server (200) can determine the final coordinates obtained by averaging the first and second coordinates of the first electronic shelf label (101) based on the images captured by the first imaging device (401) and the second imaging device (402) as the final position of the first electronic shelf label (101).

[0274] In this case, in step (S111) of method (S100) according to one embodiment, for example, the processor (21) of the server (200) can assign the first product (p1) to the first electronic shelf label (101) by matching at least one of information on the final position of the first electronic shelf label (101) determined in the related information of the first product (p1) and identification information of the first electronic shelf label (101).

[0275] The embodiments of the present invention described above may be implemented in the form of program commands that can be executed by various computer components and recorded on a computer-readable recording medium. The computer-readable recording medium may include program commands, data files, data structures, etc., either singly or in combination. The program commands recorded on the computer-readable recording medium may be specially designed and configured for the present invention or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specifically configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc. Hardware devices may be changed into one or more software modules to perform processing according to the present invention, and vice versa.

[0276] The specific implementations described in the present invention are merely exemplary embodiments and do not limit the scope of the present invention in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the lines connecting or connecting members between components depicted in the drawings are merely exemplary functional connections and / or physical or circuit connections, and may be replaced or represented as various additional functional connections, physical connections, or circuit connections in an actual device. In addition, unless specifically mentioned as “essential,” “important,” etc., a component may not be absolutely necessary for the application of the present invention.

[0277] Although the detailed description of the present invention has been described with reference to preferred embodiments of the present invention, it will be understood by those skilled in the art or having ordinary knowledge in the art that various modifications and changes can be made to the present invention without departing from the spirit and technical scope of the present invention as set forth in the claims below. Accordingly, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification, but should be defined by the claims.

[0278] The present invention has industrial applicability in that it can improve the efficiency of management of electronic shelf labels by acquiring information about the location of an electronic shelf label based on related information of a shelf camera that photographs the electronic shelf label during the process of assigning product-related information to an electronic shelf label, and assigning to a product not only identification information of the electronic shelf label but also information about the location of the electronic shelf label.

Claims

1. Step of obtaining product-related information; Step of obtaining identification information of an electronic shelf label; A step of photographing an area where the electronic shelf label is provided using a first imaging device; A step of obtaining information regarding the position of the first imaging device; A step of determining the position of the electronic shelf label based on information about the position of the first imaging device and an image of an area where the electronic shelf label is provided captured by the first imaging device; and A management method for at least one electronic shelf label, comprising: a step of assigning the product to the electronic shelf label by matching at least one of information regarding the location of the electronic shelf label determined in the relevant information of the product and identification information of the electronic shelf label; 2. In paragraph 1, A step of acquiring posture information of the first imaging device at the time when the first imaging device photographs the area where the electronic shelf label is provided; and A management method for at least one electronic shelf label, further comprising: a step of obtaining information about internal parameters of the first imaging device; 3. In paragraph 2, In the step of determining the position of the above electronic shelf label, A management method for at least one electronic shelf label, which determines the position of the electronic shelf label based on information about the position of the first imaging device, information about the posture of the first imaging device, information about the internal parameters of the first imaging device, and the image in which the area in which the electronic shelf label is provided is captured by the first imaging device.

4. In paragraph 1, A management method for at least one electronic shelf label, wherein the electronic shelf label is provided on a first shelf, and the first imaging device is provided on a second shelf different from the first shelf.

5. In paragraph 4, In the step of obtaining information about the location of the first imaging device, A management method for at least one electronic shelf label, wherein information regarding the location of the first imaging device is obtained from an imaging device location database.

6. In paragraph 1, A management method for at least one electronic shelf label, wherein the first imaging device is configured to be movable with respect to the electronic shelf label.

7. In paragraph 1, In the step of obtaining information about the location of the first imaging device, A management method for at least one electronic shelf label, wherein the first imaging device acquires information about the position of the first imaging device at the time when the first imaging device photographs an area where the electronic shelf label is provided, based on a wireless communication method.

8. In paragraph 7, A management method for at least one electronic shelf label, wherein the wireless communication method includes any one of a WiFi wireless communication method, a Bluetooth low energy (BLE) wireless communication method, and an ultra-wideband (UWB) wireless communication method.

9. In paragraph 1, In the step of obtaining identification information of the above electronic shelf label, A management method for at least one electronic shelf label, wherein identification information of the electronic shelf label is obtained based on a wireless communication method between an electronic device and the electronic shelf label.

10. In paragraph 1, At the stage of obtaining relevant information about the above product, A management method for at least one electronic shelf label, wherein the relevant information of the product is obtained based on the identification result of the unique code displayed on the product on the electronic device.

11. In paragraph 1, A step of detecting at least one electronic shelf label in the image in which the area where the electronic shelf label is provided is photographed by the first imaging device; A step of detecting a pattern code displayed by each of the at least one electronic shelf labels detected in the image; A step of comparing at least one identification information corresponding to each pattern code displayed by each of the at least one electronic shelf label detected in the image with the identification information of the electronic shelf label previously acquired; and A step of determining a target electronic shelf label that displays a pattern code corresponding to identification information that matches the identification information of the electronic shelf label already acquired among the at least one electronic shelf label detected in the image; further comprising, In the step of determining the position of the above electronic shelf label, A management method for at least one electronic shelf label, wherein the position of the electronic shelf label is determined based on an image of the target electronic shelf label, the image being captured by the first imaging device, information regarding the position of the first imaging device, information regarding the posture of the first imaging device, information regarding the internal parameters of the first imaging device, and information regarding the area in which the electronic shelf label is provided.

12. In paragraph 1, A step of photographing an area where the electronic shelf label is provided using a second imaging device different from the first imaging device; A step of obtaining information regarding the location of the second imaging device; A step of determining the position of the electronic shelf label based on information about the position of the second imaging device and an image of an area where the electronic shelf label is provided captured by the second imaging device; and A step of determining the final position of the electronic shelf label based on information about the position of the electronic shelf label determined based on an image captured by the first imaging device and information about the position of the electronic shelf label determined based on an image captured by the second imaging device; further comprising, In the step of assigning the product to the electronic shelf label, A management method for at least one electronic shelf label, which assigns the product to the electronic shelf label by matching at least one of information regarding the final location of the electronic shelf label determined in the relevant information of the product and identification information of the electronic shelf label.

13. Electronic shelf label displaying product-related information; An electronic device comprising at least one memory storing an electronic shelf label management application for performing a management method for at least one electronic shelf label and at least one processor for performing a predetermined operation for executing the application; and An imaging device configured to photograph an area where the electronic shelf label is provided; The above application, Obtain relevant information about the product, Obtain identification information from electronic shelf labels, Using the above imaging device, take a picture of the area where the electronic shelf label is provided, Obtain information about the location of the imaging device, The location of the electronic shelf label is determined based on information about the location of the imaging device and an image of an area where the electronic shelf label is provided by the imaging device. A management system for at least one electronic shelf label, which assigns the product to the electronic shelf label by matching at least one of information regarding the location of the electronic shelf label determined in the relevant information of the product and identification information of the electronic shelf label.

14. In paragraph 13, The above application, The imaging device acquires the posture information of the imaging device at the time when the imaging device photographs the area where the electronic shelf label is provided, A management system for at least one electronic shelf label, which obtains information about internal parameters of the imaging device.

15. In paragraph 14, The above application, A management system for at least one electronic shelf label, which determines the location of the electronic shelf label based on information about the location of the imaging device, information about the posture of the imaging device, information about the internal parameters of the imaging device, and an image in which an area in which the electronic shelf label is provided is photographed.

Images