Code scanning system for scanning an optical code, installation of a code scanning system and use thereof

The code scanning system divides the field of view into scanning and storage areas, enabling efficient recognition of optical codes with limited computing power, addressing the challenges of complex product imaging and improving scanning efficiency and ergonomics.

WO2025146622A1PCT designated stage expired Publication Date: 2025-07-10SMART INNOVATION
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/IB2025/000010
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-01-05
Filing Date
2025-01-06
Publication Date
2025-07-10

AI Technical Summary

Technical Problem

Existing camera-based product scanning systems struggle to accurately identify optical codes in complex scenarios, such as when multiple products are imaged together, requiring depth information and distinguishing foreground from background, which complicates the scanning process and increases computing power requirements.

Method used

A code scanning system that divides the field of view into a scanning area and a storage area using optical properties and image processing, allowing optical codes to be recognized and converted to data only when moved through the scanning area, reducing the need for complex image processing and enabling efficient scanning of multiple codes.

Benefits of technology

The system simplifies the scanning process by allowing optical codes to be recognized with limited computing power, improving ergonomics and speed, and enabling efficient scanning of products in bulk packaging without scanning background objects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure IB2025000010_10072025_PF_FP_ABST
    Figure IB2025000010_10072025_PF_FP_ABST
Patent Text Reader

Abstract

The invention provides a code scanning system for scanning an optical code at a store cash register, comprising a camera and a communication means. The camera is configured, in use, for capturing an image of the field of view of the camera, and the communication means is configured, in use, for receiving data. The field of view comprises a scanning area, which is a part of the field of view in which an optical code is imaged with sufficient sharpness by the camera. The field of view comprises a storage area that is distinct from the scanning area, wherein the storage area and the scanning area together form the field of view. The code scanning system is configured, in use, for recognizing the optical code and converting it to data based on the image captured by the camera and providing the data on the communication means, when an optical code directed toward the camera is moved through the scanning area and the storage area.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Code scanning system for scanning an optical code, installation of a code scanning system and use thereof

[0002] Technical field

[0003] The present invention relates to a code scanning system for scanning an optical code in a store, factory, or warehouse, the installation of a code scanning system and the use thereof.

[0004] Prior art

[0005] Camera-based product scanning systems for use in retail are known in the art. They are flexible due to the extensive capabilities of image processing software, especially when multiple cameras are combined.

[0006] For example, EP4224435 describes the use of one or more cameras for scanning an optical code at a store cash register. It includes a camera configured, in use, for capturing an image of a field of view of the camera and a communication means configured, in use, for receiving data. The field of view comprises a scanning area, wherein the scanning area is the part of the field of view in which an optical code directed toward the camera is imaged with sufficient sharpness by the camera.

[0007] The system described in EP4224435 faces the issue that it is difficult to deduce from an image whether one or more products are captured when using a 2D image. Therefore, in addition to color values, the system also uses depth information for product identification, which allows the creation of a point cloud and allows knowledge of the product's location and shape to be derived. This helps to distinguish different products from one another. The depth information is, for example, collected using a 3D camera, such as a time-of-flight camera or a stereo camera, or a combination of different cameras.

[0008] When using this system at a store cash register, where multiple products in a shopping basket or shopping cart are imaged, another issue arises: if a product only needs to be identified when an operator or customer presents it to the cash register system for registration, for example by taking it out of the shopping basket or shopping cart and placing it into a bag, it becomes necessary to be able to distinguish foreground from background. Here, too, the system uses depth information and a point cloud to achieve this.

[0009] Description of the invention

[0010] Before the aim of the invention and the invention itself are described, a number of definitions are first given in order to clarify the description of the invention.

[0011] An optical code is known in the art. It is an optoelectronically readable code consisting of bars and / or dots with spaces in between, preferably with the highest possible contrast. An optical code has a unit of form, namely a dimension of the bars and / or dots. Optical codes can be one-dimensional codes, also called barcodes, where the unit of form is the minimum width of a bar, or two-dimensional codes, sometimes referred to as matrix codes, where the unit of form is the minimum width of a dot. UPC, EAN, and ITF-14 are examples of standards for one-dimensional barcodes managed by GS1 . Two-dimensional codes include, among others, stacked barcodes, Data Matrix codes, and QR codes. PDF417 is an example of a stacked barcode. ECC 000, ECC 140, and ECC 200 are examples of Data Matrix codes. QR codes may be Model 1 or Model 2 QR codes, and also iQR, Frame QR, secure QR, or micro QR codes, among others. Other optical codes known in the art include, for example, HCC2D codes.

[0012] A camera is configured to capture an image in use. The field of view of a camera is known in the art. It is an area within the three-dimensional object space, also referred to as the scene space, which is captured by the camera during use. The projection of the field of view through the camera forms the image during use. Portions of the object space that are not captured because an object in the space obstructs the view of those portions are, according to the present invention, not considered part of the field of view.

[0013] The optical axis of a camera is known in the art. It is, approximately, an imaginary line that defines the path along which light propagates through the camera, passing through the center of curvature of the camera's lenses and coinciding with its axis of rotational symmetry.

[0014] The depth of field of a camera is known in the art. It is the depth of the portion of the object space encompassed by the field of view of the camera, measured along the optical axis of the camera, in which the camera can image an object with sufficient sharpness. According to the present invention, the image of an optical code is sufficiently sharp when the image is sharp enough to recognize and read the optical code in a digitized image of an optical code, for example, using software executed on a processor in the camera. The depth of field of a camera depends, for example, on the lens, the size of the photosensitive plate, the aperture size, and the focus distance, which is a synonym for the distance between the object and the camera objective. A larger aperture size results in a smaller depth of field; a shorter focus distance also results in a smaller depth of field. According to the present invention, sufficiently sharp may mean, for example, that the circle of confusion of incoming light on the photosensitive plate is smaller than 0.03 mm.

[0015] It is an aim of the present invention to solve the problems with the known state of the art. In particular, the present invention simplifies existing cash register systems.

[0016] This aim is achieved using a code scanning system for scanning an optical code, preferably in a store, factory, or warehouse, further preferably at a store cash register, according to the present invention, comprising a camera and a communication means. The camera is configured, in use, for capturing an image of the field of view of the camera, and the communication means is configured, in use, for receiving data. The field of view comprises a scanning area, which is a part of the field of view in which an optical code is imaged with sufficient sharpness by the camera. The scanning area is for example the part of the field of view in which an optical code is imaged with sufficient sharpness by the camera. The field of view comprises a storage area that is distinct from the scanning area, wherein the storage area and the scanning area together form the field of view. Preferably, the storage area comprises the part of the field of view in which an optical code is imaged with insufficient sharpness by the camera. The storage area is for example the part of the field of view in which an optical code is imaged with insufficient sharpness by the camera. The code scanning system is configured, in use, for recognizing the optical code and converting it to data based on the image captured by the camera and providing the data on the communication means, when an optical code directed toward the camera is moved through the scanning area and the storage area. The code scanning system is for example able to recognize and convert to data an optical code having a unit of form of 1 mm, regardless of where the optical code moves through the scanning area. The code scanning system can thus for example recognize and convert an optical code with lines having a minimum width of 1 mm in the case of a one-dimensional code, and with points having a minimum width of 1 mm in the case of a two-dimensional code, regardless of where the optical code moves through the scanning area. Preferably, the code scanning system comprises a computer unit, for example a computer or an embedded system. The computer unit optionally executes one or more functions of the system, such as for example controlling the camera and / or the communication means, recognizing the optical code and converting it to data, providing the data on the communication means and analyzing the movement of the code through the scanning area.

[0017] It is an advantage of the present invention that only one 2D camera is needed to carry out the registration of an optical code, even when multiple optical codes are imaged. It is an additional advantage that, even though multiple optical codes are imaged, an optical code is only scanned when a user moves it in the view in the correct way, and not as soon as the optical code comes into view. In this way, when for example an entire shopping basket or shopping cart is imaged at a store cash register, it is possible, with less computing power than in the known art, to only scan a product when it is taken out of a shopping basket or shopping cart, and not as soon as it comes into view. It is an additional advantage of the present invention that different optical codes that are imaged by the camera together as the optical codes move through the scanning area and the storage area, possibly independently of each other, are each recognized and converted to data correctly. The division of the field of view into the scanning area and the storage area is preferably achieved through optical properties of the camera, for example through a use and setup of lenses having for example an effect on the depth of field, and / or through a use of a filter, preferably an optical filter, that makes parts of the field of view invisible or out of focus, and / or through the use of focus lighting. It is also possible for the division of the field of view into the scanning area and the storage area to be carried out based on processing performed on an image of the field of view, such as for example by assigning part of the image, and therefore part of the field of view projected by the camera onto that part of the image, to the storage area or to the scanning area. It is also possible for the division of the field of view into the scanning area and the storage area to be achieved by a combination of the use of optical properties of the camera and processing of an image of the field of view. Preferably, any processing of an image of the field of view is carried out by the computer unit.

[0018] It is an advantage of the present invention that in addition to the optical codes to be scanned, which are moved through the scanning area and the storage area, other optical codes may also be present in the field of view of the camera. This allows, for example, products to be stored within view, whether or not temporarily, while other products can be presented to be scanned in the same view, for example at a store cash register or in a warehouse. This temporary storage can be used, for example, to prepare the products for a cashier or a user to present them to the scanning system, or for a cashier or user to pack or load them into a carrying bag after scanning. This storage may for example be realized in a shopping carrier, for example a shopping cart, shopping basket or a carrying bag, on a table, on a conveyor belt, on a store counter and / or on a checkout counter. It is an additional advantage of the present invention that objects in the storage area can be manipulated, even while they are being imaged, without being scanned, as the registration only takes place when the optical code is moved through the scanning area and through the storage area.

[0019] Optionally, the camera of the code scanning system according to the present invention has an optical axis and a depth of field, and the length of the scanning area measured along the optical axis, referred to as the scanning height, is limited by the depth of field. This configuration therefore uses the optical properties of the camera to divide the field of view in the scanning area and the storage area. For example, the depth of field of the camera is not only used for limiting the scanning height, but also for delineating the entire scanning area. This relies on the fact that the depth of field defines the part of the field of view in which an optical code is imaged with sufficient sharpness by the camera.

[0020] It is an additional advantage of the present invention that simple image processing algorithms, and thus processors with limited computing power can be used to scan an optical code when the optical code moves through the area in the correct way, even when other optical codes are present in the storage area and / or move through said area.

[0021] Optionally, the code scanning system according to the present invention is configured, in use, for designating as storage area a part of the field of view in which an optical code directed toward the camera is imaged with sufficient sharpness by the camera. This is for example achieved by processing an image of the field of view, such as for example assigning part of the image, and thus part of the field of view projected by the camera onto that part of the image, to the storage area or to the scanning area, or for example by designating typical image elements, such as for example background images, as storage area or as scanning area.

[0022] It is an additional advantage of the present invention that the storage area in the field of view can be enlarged, as opposed to only using depth of field to delineate the scanning area.

[0023] The present invention also describes a store cash register for use in a store, for example in a supermarket, a department store, a grocery store, a hardware store, a garden center, a DIY store. The store cash register is for example a self-service cash register or a self-checkout, and is preferably a store cash register staffed by an operator. The store cash register comprises the code scanning system according to the present invention. The store cash register is configured, in use, for reading the data from the communication means.

[0024] Optionally, the storage area of the store cash register according to the present invention is configured, in use, for receiving part of a shopping carrier, for example a shopping carrier, preferably a shopping basket or a carrying bag, further preferably a shopping cart.

[0025] It is an additional advantage of the present invention that a customer arriving at the store cash register can place the shopping carrier used by the customer during shopping close to the code scanning system, which improves the ergonomics of the scanning process and speeds up the scanning process, whether performed by an operator, such as a store employee, or by the customer, such as at a self-checkout. The ergonomics and speed of execution of the scanning process are particularly improved by the combination of the ability to place a carrier within view and a product being scanned upon the correct movement through the view, specifically through the scanning area and the storage area.

[0026] Optionally, the scanning area of the store cash register according to the present invention is configured, in use, to be located adjacent to the shopping carrier, when the storage area has received a part of a shopping carrier.

[0027] It is an additional advantage of the present invention that products that are moved inside in the shopping carrier are not scanned, and that products that are taken out of the shopping carrier and moved toward the scanning area are scanned. This simplifies the scanning process by an operator, for example a store employee, or by the customer, as products are not scanned when they are moved inside the shopping carrier, intentionally or not, while unloading the shopping carrier.

[0028] Optionally, the camera of the store cash register according to the present invention is, in use, directed toward an access opening of the shopping carrier, when the storage area has received a part of a shopping carrier.

[0029] Optionally, the camera of the store cash register according to the present invention is, in use, directed downward toward an upward facing access opening of the shopping carrier, and the scanning area is located over the shopping carrier in use, when the storage area has received a part of a shopping carrier. The smaller the distance between the bottom of the scanning area and the top of the shopping carrier, the better. The top of the shopping carrier is for example, in the case of a shopping cart comprising a basket, wheels and a handle, the top of the basket of the shopping cart. It is therefore possible for the handle to extend upward beyond the top of the shopping cart.

[0030] It is an additional advantage of the invention that the scanning process is simplified, since it can be performed ergonomically and without much mental effort by lifting a product out of the shopping carrier with the optical code facing upward. Moreover, image processing is simplified because there is less need to account for a limb of a user potentially obstructing the camera’s view of an optical code in certain images. This configuration also makes the system easier to install and configure. Since a downward-facing camera can also be placed further away from the shopping carrier without an optical code being obscured from the camera’s view by other objects, it becomes easier to increase the camera's depth of field, as the depth of field increases with a greater focusing distance.

[0031] Optionally, the store cash register according to the present invention comprises focus lighting, for example a projector, such as a logo light projector or a gobo projector, preferably a spotlight, configured, in use, for visually delineating the scanning area.

[0032] It is an additional advantage of the present invention that the scanning process is simplified because the focus lighting gives a user of the store cash register a clear visual indication on how to move an optical code, whether or not displayed on a product, for it to be scanned. This effect is enhanced in combination with the camera being directed downward in use toward an upward facing access opening of the shopping carrier, and the scanning area being located over the shopping carrier. Moreover, the scanning area is additionally illuminated when using a spotlight, allowing the camera’s aperture to be reduced with less rapid contrast degradation. This makes it easier to increase the camera’s depth of field, since depth of field is increased as aperture decreases.

[0033] Optionally, the store cash register according to the present invention is configured, in use, for reducing the occurrence of specular reflection of the focus lighting on an optical code in an image captured by the camera, when an optical code directed toward the camera is moved through the scanning area and the storage area. This may for example be achieved by providing the store cash register with diffuse lighting. This may for example also be achieved by a placement of the camera in relation to the focus lighting such that a mirror placed in a plane similar to an optical code directed toward the camera would reflect the light emitted by the focus lighting past the camera.

[0034] It is an additional advantage of the present invention that the contrast of an optical code in an image is improved as the occurrence of specular reflections is reduced. The use of diffuse lighting in the present invention has the additional advantage that specular reflections can be avoided regardless of how a user directs an optical code toward the camera and regardless of the shape of a support on which an optical code is displayed.

[0035] Optionally, the store cash register according to the present invention comprises illumination lighting, preferably diffuse lighting, configured, in use, for illuminating the scanning area.

[0036] It is an additional advantage of the present invention that the scanning area is additionally illuminated, allowing the aperture of the camera to be made smaller with less rapid degradation of contrast. This makes it easier to increase the camera’s depth of field, since depth of field increases as aperture decreases. Moreover, the use of diffuse lighting in the present invention, particularly when the store cash register is equipped with focus lighting, has the additional advantage that the occurrence of specular reflections can be reduced.

[0037] Optionally, the scanning height of the store cash register according to the present invention is greater in use than the size of a support on which an optical code is displayed, along a direction perpendicular to a plane in which the optical code is displayed on the carrier. A support on which an optical code is displayed is for example a product, a loyalty card, a customer card, a voucher for returned empty bottles, or a discount coupon.

[0038] It is an additional advantage of the present invention that by increasing the scanning height, an optical code displayed on a support, preferably on a product, can be recognized and read to data with a larger number of different movements through the field of view, which simplifies and speeds up a scanning process.

[0039] Optionally, the store cash register according to the present invention has the following characteristics: the store cash register comprises a support structure, a transfer area below the support structure, focus lighting configured, in use, for visually delineating the scanning area, and illumination lighting configured, in use, for illuminating the scanning area. The support structure comprises one or a combination of a frame, mast, scaffolding, and a ceiling, preferably a frame comprising two upright elements, each extending between a supporting end and a free end, and a horizontal element perpendicular to the two upright elements, connecting the two upright elements near their respective free ends. The code scanning system of the store cash register further comprises a computer and the communication means comprises an electronic communication connection. The camera has an optical axis and a depth of field, and the length of the scanning area measured along the optical axis, referred to as the scanning height, is limited by the depth of field. The camera, the focus lighting and the illumination lighting are mounted to the support structure. The camera is connected to the computer, for example using a connection known from the art for connecting a camera to a computer, such as for example a USB connection, and the computer is connected to the store cash register through the electronic communication connection. The transfer area is configured, in use, for receiving side by side a first shopping carrier, preferably a first shopping cart, and a second shopping carrier, preferably a second shopping cart. The scanning height is greater in use than the size of a product on which an optical code is displayed, along a direction perpendicular to a plane in which the optical code is displayed on the product. The storage area is configured, in use, for receiving part of the first shopping carrier and part of the second shopping carrier, the camera is directed downward, in use, toward an upward facing access opening of the respective first shopping carrier and second shopping carrier, and the scanning area is located, in use, over the first shopping carrier and the second shopping carrier, when the transfer area has received a first shopping carrier, preferably a first shopping cart, and a second shopping carrier, preferably a second shopping cart. The computer is configured, in use, for recognizing the optical code and converting it to data based on the image captured by the camera and providing the data on the communication means, preferably on the electronic communication connection, when the transfer area has received the first shopping carrier and the second shopping carrier, and an optical code displayed on a product and directed toward the camera is moved through the scanning area and the storage area.

[0040] The aim of the invention is also achieved by a use of the code scanning system according to the present invention or of the store cash register according to the present invention, comprising moving an optical code directed toward the camera through the scanning area and the storage area, capturing an image of the field of view while the optical code moves through the scanning area, recognizing the optical code in the image, converting the optical code to data based on the image, and providing the data on the communication means.

[0041] It is an advantage of the present invention that in addition to the optical codes to be scanned, which are moved through the scanning area and the storage area, other optical codes may also be present in the field of view of the camera. It is an additional advantage of the present invention that objects in the storage area can be manipulated, even while they are being imaged, without being scanned.

[0042] Moving an optical code directed toward the camera while using the store cash register according to the present invention, which is configured for receiving part of a shopping carrier, comprises moving an optical code away from or toward the shopping carrier in the storage area.

[0043] The use of the store cash register according to the present invention, having a transfer area configured, in use, for receiving side by side a first shopping cart and a second shopping cart and an electronic communication connection, is characterized by moving an optical code directed toward the camera through the scanning area and the storage area, which comprises moving the optical code, displayed on a product, away from a first shopping cart and toward a second shopping cart, and providing the data on the communication means, which comprises providing the data on the electronic communication connection.

[0044] Optionally, the use of the store cash register according to the present invention is characterized by the following characteristics. Capturing an image of the field of view while the optical code moves through the scanning area comprises capturing a first image of the field of view of the camera and subsequently capturing a second image of the field of view of the camera, the first image and the second image each comprising a scan-entry image portion and a scan-exit image portion. Recognizing the optical code in the image comprises recognizing the optical code in the scan-entry image portion of the first image and recognizing the optical code in the scan-exit image portion of the second image. Converting the optical code to data based on the image further comprises converting the optical code to data based on the first image and / or the second image.

[0045] It is an advantage of the present invention that a scanning direction can be determined and that optical codes moving through the scanning area and the storage area not according to the scanning direction, for example against the scanning direction, will not be scanned. This clearly indicates to an operator of the store cash register or a user which scanning movement is needed for scanning a product, allowing the operator to scan products more efficiently and faster. Moreover, the operator or user is not limited to only performing the correct scanning movements, as an incorrect scanning movement will not be registered. This allows the operator or user more freedom of movement during the use of the store cash register.

[0046] Optionally, the use of the store cash register according to the present invention is characterized by the following characteristics. The code scanning system comprises a product database, which comprises first product information about a first optical code including a first product identification, and a bulk packaging indication, and which comprises second product information about a second optical code including the first product identification and an individual packaging indication. Moving an optical code directed toward the camera through the scanning area and the storage area comprises moving the first optical code directed toward the camera through the scanning area and the storage area, and moving the second optical code directed toward the camera through the scanning area and the storage area. Capturing an image of the optical code in the scanning area comprises an image including the first optical code and the second optical code. Recognizing the optical code in the image comprises recognizing the first optical code in the image and recognizing the second optical code in the image. Converting the optical code to data based on the image comprises converting the first optical code to first data and converting the second optical code to second data. The method comprises comparing the first product information, selected from the product database based on the first data, to the second product information, selected from the product database based on the second data. And providing the data on the communication means comprises providing the first data on the communication means. Preferably, providing the first data on the communication means follows after comparing the first product information to the second product information.

[0047] It is an advantage of the present invention that when products are presented to the code scanning system in bulk packaging, on which both an optical code for the bulk packaging and an optical code for an individual packaging is present, for example side by side, the operator of the store cash register or the user does not need to take further action. The operator or user can present the products in bulk packaging in the known way by moving the optical codes directed to the camera through the scanning area and the storage area. The code scanning system will provide the correct code on the communication means.

[0048] The aim of the invention is also achieved by a method for making the code scanning system according to the present invention or the store cash register according to the present invention, comprising positioning a configuration object at a first location in the field of view and configuring the scanning area, comprising setting up the camera such that the configuration object is imaged with sufficient sharpness and such that at a second location in the field of view, further from the camera than the first location, the configuration object would be imaged with insufficient sharpness.

[0049] It is an advantage of the present invention that the scanning area is optically limited up to the first location in the field of view. The area further away from the camera than the first location becomes a storage area and enables storing optical codes or products with optical codes in the field of view. It is an additional advantage of the present invention that the scanning area can be configured on the setup, preferably the store cash register, where the code scanning system is used. The installation location, with its specific distances and light intensity, impacts the usability of a preconfigured camera and its scanning area.

[0050] Optionally, the method for making the code scanning system according to the present invention or the store cash register according to the present invention is characterized by the following characteristics. The method comprises positioning a configuration object at a third location in the field of view, closer to the camera than the first location, at a distance from the first location greater than the size of a support on which an optical code is displayed along a direction perpendicular to a plane in which the optical code is displayed on the carrier. And configuring the scanning area comprises setting up the camera such that the configuration object is imaged with sufficient sharpness and such that at a fourth location in the field of view, closer to the camera than the third location, the configuration object would be imaged with insufficient sharpness.

[0051] It is an additional advantage of the present invention that the scanning area is given a height. This makes it possible to recognize and read to data an optical code displayed on a support, preferably on a product, with a larger number of different movements through the field of view, which simplifies and speeds up a scanning process.

[0052] The method for making the store cash register according to the present invention, having a camera directed downward, in use, toward an upward facing access opening of a shopping carrier, when the storage area has received a part of a shopping carrier, comprises positioning a shopping carrier, wherein the first location is located over the shopping carrier.

[0053] Optionally, the method for making the store cash register according to the present invention comprising a support structure, comprises aligning the spotlight with the camera, and configuring the illumination lighting such that the camera captures an image of an optical code in the scanning area with sufficient contrast in order to recognize the optical code and to convert it to data of the optical code based on the image.

[0054] Brief description of the drawings

[0055] The invention will hereafter be described in further detail by referring to the appended drawings.

[0056] Figure 1 shows a code scanning system according to the present invention.

[0057] Figure 1 a shows a side view of a code scanning system according to the present invention with a division of the field of view based on the depth of field of the camera.

[0058] Figure 1 b shows a side view of a code scanning system according to the present invention with a division of the field of view based on optical characteristics of the system. Figure 1 c shows a side view of a code scanning system according to the present invention with a division of the field of view based on processing performed on an image of the field of view.

[0059] Figure 2 shows different views of a store cash register according to the present invention.

[0060] Figure 2a shows a top view of the store cash register from figure 2.

[0061] Figure 2b shows a front view of the store cash register from figure 2.

[0062] Figure 2c shows an isometric projection of the store cash register from figure 2.

[0063] Figure 3 shows a sequence of four images from a camera of a store cash register according to the present invention.

[0064] Figure 3a shows a sequence of four images during a use of a store cash register according to the present invention.

[0065] Figure 3b shows a sequence of four images during a prematurely terminated use of a store cash register according to the present invention.

[0066] Modes for carrvinq out the invention

[0067] The present invention will hereafter be described with respect to particular embodiments and with reference to certain drawings, but the invention is not limited thereto and is defined only by the claims. The drawings shown here are merely schematic depictions and are non-limiting. In the drawings, the dimensions of certain parts may be exaggerated, meaning that the parts in question are not drawn to scale, and are for illustrative purposes only. The dimensions and the relative dimensions do not necessarily correspond to the actual reductions to practice of the invention.

[0068] Furthermore, terms such as “first”, “second”, “third” and the like are used in the description and in the claims for distinguishing between similar elements, and not necessarily for describing a sequential or chronological order. The terms in question are interchangeable under the appropriate circumstances, and the embodiments of the invention can operate in other sequences than described or illustrated here.

[0069] Moreover, terms such as “top”, “bottom”, “over”, “under” and the like are used in the description and the claims for descriptive purposes and not necessarily for indicating relative positions. The terms so used are interchangeable under the appropriate circumstances, and the embodiments of the invention can operate in other orientations than those described or illustrated herein.

[0070] The term “comprising” and derivative terms, as used in the claims, should not be interpreted as being restricted to the means listed respectively thereafter; the term does not exclude other elements or steps. It should be interpreted as specifying the stated features, integers, steps or components as referred to, without, however, precluding the presence or addition of one or more additional features, integers, steps or components, or groups thereof. Thus, the scope of an expression such as “a device comprising means A and B” is not limited to devices consisting only of components A and B. What is meant, in contrast, is that with respect to the present invention, the only relevant components of the device are A and B.

[0071] Fig. 1 shows a code scanning system 101 according to the present invention.

[0072] Fig. 1 a shows a side view of a code scanning system 101 according to the present invention with a division of the field of view 105 based on the depth of field of the camera 103.

[0073] The code scanning system 101 of Fig. 1 a is configured, in use, for scanning an optical code 102. It comprises a camera 103 and a communication means 104. The camera 103 is configured, in use, for capturing an image 109 of the field of view 105 of the camera 103, and the communication means 104 is configured, in use, for receiving data. The field of view 105 comprises a scanning area 106, which is a part of the field of view 105 in which an optical code 102 is imaged with sufficient sharpness by the camera 103, particularly the part of the field of view 105 in which an optical code 102 is imaged with sufficient sharpness by the camera 103. The field of view 105 comprises a storage area 107 that is distinct from the scanning area 106, wherein the storage area 107 and the scanning area 106 together form the field of view 105. The storage area 107 is the part of the field of view 105 in which an optical code 102 is imaged with insufficient sharpness by the camera 103. The code scanning system 101 is configured, in use, for recognizing the optical code 102 and converting it to data based on the image captured by the camera 103 and providing the data on the communication means 104, when an optical code 102 directed toward the camera 103 is moved through the scanning area 106 and the storage area 107. Providing the data on the communication means 104 is indicated in Fig. 1 a by a first arrow d. A movement of the optical code 102 through the scanning area 106 and the storage area 107 is indicated in Fig. 1 a by a second arrow c.

[0074] The division of the field of view 105 into the scanning area 106 and the storage area 107 is realized through optical properties of the camera 103, through a use and configuration of lenses that affects the depth of field. The camera 103 of the code scanning system 101 has an optical axis o and a depth of field, and the length of the scanning area 106 measured along the optical axis o, referred to as the scanning height h, is limited by the depth of field.

[0075] Figure 1 b shows a side view of a code scanning system 101 according to the present invention with a division of the field of view 105 based on optical characteristics of the system. The code scanning system 101 of Fig. 1 b is configured, in use, for scanning an optical code 102. It comprises a camera 103 and a communication means 104. The camera 103 is configured, in use, for capturing an image of the field of view 105 of the camera 103, and the communication means 104 is configured, in use, for receiving data. The field of view 105 comprises a scanning area 106, which is a part of the field of view 105 in which an optical code 102 is imaged with sufficient sharpness by the camera 103, particularly the part of the field of view 105 in which an optical code 102 is imaged with sufficient sharpness by the camera 103. The field of view 105 comprises a storage area 107 that is distinct from the scanning area 106, wherein the storage area 107 and the scanning area 106 together form the field of view 105. The storage area 107 is the part of the field of view 105 in which an optical code 102 is imaged with insufficient sharpness by the camera 103. The code scanning system 101 is configured, in use, for recognizing the optical code 102 and converting it to data based on the image captured by the camera 103 and providing the data on the communication means 104, when an optical code 102 directed toward the camera 103 is moved through the scanning area 106 and the storage area 107. Providing the data on the communication means 104 is indicated in Fig. 1 b by a first arrow d. A movement of the optical code 102 through the scanning area 106 and the storage area 107 is indicated in Fig. 1 b by a second arrow c.

[0076] The division of the field of view 105 into the scanning area 106 and the storage area 107 is realized through optical properties of the camera 103, through a use and configuration of lenses that affects the depth of field and through a use of an optical filter 108 that makes parts of the field of view 105 out of focus. The camera 103 of the code scanning system 101 has an optical axis o and a depth of field, and the length of the scanning area 106 measured along the optical axis o, referred to as the scanning height h, is limited by the depth of field.

[0077] Figure 1 c shows a side view of a code scanning system 101 according to the present invention with a division of the field of view 105 based on processing performed on an image 109 of the field of view 105.

[0078] The code scanning system 101 is configured, in use, for scanning an optical code 102. It comprises a camera 103 and a communication means 104. The camera 103 is configured, in use, for capturing an image 109 of the field of view 105 of the camera 103, and the communication means 104 is configured, in use, for receiving data. The field of view 105 comprises a scanning area 106, which is a part of the field of view 105 in which an optical code 102 is imaged with sufficient sharpness by the camera 103. The field of view 105 comprises a storage area 107 that is distinct from the scanning area 106, wherein the storage area 107 and the scanning area 106 together form the field of view 105. The code scanning system 101 is configured, in use, for recognizing the optical code 102 and converting it to data based on the image 109 captured by the camera 103 and providing the data on the communication means 104, when an optical code 102 directed toward the camera 103 is moved through the scanning area 106 and the storage area 107. Providing the data on the communication means 104 is indicated in Fig. 1 c by a first arrow d. A movement of the optical code 102 through the scanning area 106 and the storage area 107 is indicated in Fig. 1 c by a second arrow c.

[0079] The division of the field of view 105 into the scanning area 106 and the storage area 107 is carried out based on processing performed on an image 109 of the field of view 105, by assigning part of the image 1 10, and therefore part of the field of view 105 projected by the camera 103 onto that part of the image 1 10, to the storage area 107.

[0080] Fig. 2 shows different views of a store cash register 201 according to the present invention. Fig. 2a shows a top view of the store cash register 201 . Fig. 2b shows a front view of the store cash register 201 . Fig. 2c shows an isometric projection of the store cash register 201 .

[0081] The store cash register 201 of Fig. 2 is a store cash register 201 for use in, for example, a supermarket. The store cash register 201 comprises a code scanning system 101 configured, in use, for scanning an optical code 102. The code scanning system 101 comprises a camera 103, a computer 202, and a communication means comprising an electronic communication connection. The camera 103 is connected to the computer 202 through a USB connection, and the computer 202 is connected to the store cash register 201 through the electronic communication connection.

[0082] The camera 103 is configured, in use, for capturing an image of the field of view 105 of the camera 103, and the communication means is configured, in use, for receiving data. The field of view 105 comprises a scanning area 106, which is a part of the field of view 105 in which an optical code 102 is imaged with sufficient sharpness by the camera 103, particularly the part of the field of view 105 in which an optical code 102 is imaged with sufficient sharpness by the camera 103. The field of view 105 comprises a storage area 107 that is distinct from the scanning area 106, wherein the storage area 107 and the scanning area 106 together form the field of view 105. The storage area 107 is the part of the field of view 105 in which an optical code 102 is imaged with insufficient sharpness by the camera 103.

[0083] The store cash register 201 comprises a support structure 203. The support structure 203 comprises a frame 204 comprising two upright elements 205, each extending between a supporting end 206 and a free end 207, and a horizontal element 208 perpendicular to the upright elements 205, connecting the two upright elements 205 near their respective free ends 207. The camera 103 is mounted to the support structure 203, particularly to the horizontal element 208 of the frame 204. The store cash register 201 comprises focus lighting 209, particularly a spotlight 210, configured, in use, for visually delineating the scanning area 106. The focus lighting 209 is mounted to the support structure 203, particularly to the horizontal element 208 of the frame 204.

[0084] The store cash register 201 comprises a transfer area 21 1 below the support structure 203. The transfer area 21 1 is configured, in use, for receiving side by side a first shopping carrier 212, particularly a first shopping cart 213, and a second shopping carrier 214, particularly a second shopping cart 215. In Fig. 2, the transfer area 21 1 receives the first shopping carrier 212, particularly the first shopping cart 213, and the second shopping carrier 214, particularly the second shopping cart 215, each comprising a basket 216, wheels 217 and a handle 218.

[0085] The camera 103 is directed downward, in use, toward an upward facing access opening 219 of the first shopping carrier 212 and toward an upward facing access opening 220 of the second shopping carrier 214, the focus lighting 209 is directed downward, in use, toward an upward facing access opening 219 of the first shopping carrier 212 and an upward facing access opening 220 of the second shopping carrier 214, the scanning area 106 is, in use, located adjacent, particularly over the first shopping carrier 212 and the second shopping carrier 214, and the storage area 107 is configured, in use, for receiving part of the first shopping carrier 212 and part of the second shopping carrier 214 when the transfer area 21 1 has received the first shopping carrier 212 and the second shopping carrier 214. The top 221 of the first shopping carrier 212, respectively the second shopping carrier 214, is the top 221 of the basket 216 of the first shopping cart 213, respectively the second shopping cart 215. The handle 218 of the first shopping cart 213, respectively the second shopping cart 215, thus extends upward beyond the top 221 of the first shopping cart 213, respectively the second shopping cart 215.

[0086] The division of the field of view 105 into the scanning area 106 and the storage area 107 is realized through optical properties of the camera 103, through a use and configuration of lenses that affects the depth of field. The camera 103 of the code scanning system 101 has an optical axis o and a depth of field, and the length of the scanning area 106 measured along the optical axis o, referred to as the scanning height h, is limited by the depth of field. The scanning height h of the store cash register 201 is greater in use than the size of a support on which an optical code 102 is displayed, along a direction perpendicular to a plane in which the optical code 102 is displayed on the carrier. A support on which an optical code 102 is displayed is for example a product, such as for example a package of kitchen towel rolls, a loyalty card, a customer card, a voucher for returned empty bottles, or a discount coupon. The visual delineation of the scanning area 106 is realized through a circle of light 222 incident on the first shopping carrier 212 and / or its contents, and on the second shopping carrier 214 and / or its contents, when the transfer area 21 1 has received the first shopping carrier 212 and the second shopping carrier 214.

[0087] The store cash register 201 is configured, in use, for reducing the occurrence of specular reflection of the focus lighting 209 on an optical code 102 in an image captured by the camera 103. To this end, the store cash register 201 comprises illumination lighting 223 configured, in use, for illuminating the scanning area 106, particularly diffuse lighting, particularly an LED panel 224 emitting diffuse light in use. The illumination lighting 223 is mounted to the support structure 203, particularly to the horizontal element 208 of the frame 204.

[0088] The computer 202 is configured, in use, for recognizing the optical code 102 and converting it to data based on the image captured by the camera 103 and providing the data on the communication means, particularly on the electronic communication connection, when the transfer area 21 1 has received the first shopping carrier 212 and the second shopping carrier 213, and an optical code 102 displayed on a product and directed toward the camera 103 is moved through the scanning area 106 and the storage area 107. A movement of the optical code 102 through the scanning area 106 and the storage area 107 is indicated in Fig. 2b by a second arrow c.

[0089] The store cash register 201 is configured, in use, for reading data from the communication means, and reads the data when the computer 202 provides the data on the communication means.

[0090] Fig. 3 shows a sequence of four images from a camera of a store cash register according to the present invention. Fig. 3a shows a sequence of four images during a use of a store cash register according to the present invention

[0091] The use of a store cash register according to the present invention comprises moving an optical code 102 directed toward the camera through the scanning area and the storage area, capturing an image 109 of the field of view while the optical code 102 moves through the scanning area, recognizing the optical code 102 in the image 109, converting the optical code 102 to data based on the image 109, and providing the data on the communication means.

[0092] Fig. 3a shows a first image 301 of the field of view of the camera, a second image 302 of the field of view of the camera, a third image 303 of the field of view of the camera and a fourth image 304 of the field of view of the camera. The first image 301 , the second image 302, the third image 303 and the fourth image 304 each comprise a scanentry image portion 305 and a scan-exit image portion 306. The images are captured consecutively. First the first image 301 , then the second image 302, then the third image 303, and then the fourth image 304. The second image 302 and the third image 303 are captured while capturing an image 109 of the field of view of the camera while the optical code 102, particularly a barcode 307, moves through the scanning area.

[0093] The first image 301 comprises an image of the optical code 102 in its scan-entry image portion 305. The optical code 102 is not imaged with sufficient sharpness and cannot be recognized. The second image 302 comprises an image of the optical code 102 in its scan-entry image portion 305. The optical code 102 is imaged with sufficient sharpness and can be recognized. The third image 303 comprises an image of the optical code 102 in its scan-exit image portion 306. The optical code 102 is imaged with sufficient sharpness and can be recognized. The fourth image 304 comprises an image of the optical code 102 in its scan-exit image portion 306. The optical code 102 is not imaged with sufficient sharpness and cannot be recognized. Recognizing the optical code 102 in the image 109 comprises recognizing the optical code 102 in the scan-entry image portion 305 of the second image 302 and recognizing the optical code 102 in the scan-exit image portion 306 of the third image 303. Converting the optical code 102 to data based on the image 109 comprises converting the optical code 102 to data based on the second image 302 and / or the third image 303, particularly based on the second image 302.

[0094] Fig. 3b shows a sequence of four images during a prematurely terminated use of a store cash register according to the present invention.

[0095] Fig. 3b shows a first image 301 of the field of view of the camera, a second image 302 of the field of view of the camera, a third image 303 of the field of view of the camera and a fourth image 304 of the field of view of the camera. The first image 301 , the second image 302, the third image 303 and the fourth image 304 each comprise a scanentry image portion 305 and a scan-exit image portion 306. The images are captured consecutively. First the first image 301 , then the second image 302, then the third image 303, and then the fourth image 304. The second image 302 and the fourth image 304 are captured while capturing an image 109 of the field of view of the camera while the optical code 102, particularly a QR code 308, moves through the scanning area.

[0096] The first image 301 comprises an image of the optical code 102 in its scan-entry image portion 305. The optical code 102 is not imaged with sufficient sharpness and cannot be recognized. The second image 302 comprises an image of the optical code 102 in its scan-entry image portion 305. The optical code 102 is imaged with sufficient sharpness and can be recognized. The third image 303 comprises an image of the optical code 102 in its scan-exit image portion 306. The optical code 102 is not imaged with sufficient sharpness and cannot be recognized. The fourth image 304 comprises an image of the optical code 102 in its scan-entry image portion 305. The optical code 102 is imaged with sufficient sharpness and can be recognized. Recognizing the optical code 102 in the image 109 does not take place, according to the use of a store cash register according to the present invention, because the image of the optical code 102 is in the scan-entry image portion 305 of the second image 302 and in the scan-entry image portion 305 of the fourth image 304. Converting the optical code 102 to data based on the image 109 does not take place according to the use of a store cash register according to the present invention.

[0097] Providing the data on the communication means does not take place according to the use of a store cash register according to the present invention.

Claims

Claims1 . A code scanning system (101 ) for scanning an optical code (102), comprising a camera (103) configured, in use, for capturing an image (109) of the field of view (105) of the camera, a communication means (104) configured, in use, for receiving data, wherein the field of view comprises a scanning area (106), the scanning area is a part of the field of view in which an optical code directed toward the camera is imaged with sufficient sharpness by the camera, characterized in that the field of view comprises a storage area (107) that is distinct from the scanning area, the storage area and the scanning area together form the field of view, the code scanning system is configured, in use, for- recognizing the optical code and converting it to data based on the image captured by the camera,- providing the data on the communication means, when an optical code directed toward the camera is moved through the scanning area and the storage area.

2. The code scanning system according to claim 1 , wherein the camera has an optical axis (o) and a depth of field, and the length of the scanning area measured along the optical axis, referred to as the scanning height (h), is limited by the depth of field.

3. The code scanning system according to any of the claims 1 to 2, wherein the code scanning system is configured, in use, for designating as storage area a part of the field of view in which an optical code directed toward the camera is imaged with sufficient sharpness by the camera.

4. A store cash register (201 ), comprising the code scanning system according to any of the claims 1 to 3, wherein the store cash register is configured, in use, for reading the data from the communication means.

5. The store cash register according to claim 4, wherein the storage area is configured, in use, for receiving part of a shopping carrier (212, 213).

6. The store cash register according to claim 5, wherein the scanning area is located adjacent to the shopping carrier in use, when the storage area has received a part of a shopping carrier.

7. The store cash register according to any of the claims 5 to 6, wherein thecamera, in use, is directed toward an access opening (219, 220) of the shopping carrier, when the storage area has received a part of a shopping carrier.

8. The store cash register according to any of the claims 5 to 7, wherein the camera is, in use, directed downward toward an upward facing access opening of the shopping carrier, the scanning area is located over the shopping carrier in use, when the storage area has received a part of a shopping carrier.

9. The store cash register according to any of the claims 4 to 8, further comprising focus lighting (209) configured, in use, for visually delineating the scanning area.

10. The store cash register according to claim 9, wherein the focus lighting is a spotlight (210).11 . The store cash register according to any of the claims 9 to 10, wherein the store cash register is configured, in use, for avoiding a specular reflection of the focus lighting on an optical code in an image captured by the camera, when an optical code directed toward the camera is moved through the scanning area and the storage area.

12. The store cash register according to any of the claims 4 to 11 , further comprising illumination lighting (223) configured, in use, for illuminating the scanning area.

13. The store cash register according to claim 12, wherein the illumination lighting is diffuse lighting.

14. The store cash register according to any of the claims 4 to 13, wherein the scanning height, in use, is greater than the size of a support on which an optical code is displayed, along a direction perpendicular to a plane in which the optical code is displayed on the carrier.

15. The store cash register according to any of the claims 4 to 14, comprising a support structure (203), a transfer area (211 ) below the support structure, focus lighting configured, in use, for visually delineating the scanning area, illumination lighting configured, in use, for illuminating the scanning area, wherein the code scanning system further comprises a computer (202), the communication means comprises an electronic communication connection, the camera has an optical axis and a depth of field, and the length of the scanning area measured along the optical axis, referred to as the scanning height, is limited by the depth of field, the camera is mounted to the support structure,the focus lighting is mounted to the support structure, the illumination lighting is mounted to the support structure, the camera is connected to the computer, the computer is connected to the store cash register through the electronic communication connection, the transfer area is configured, in use, for receiving side by side a first shopping carrier (212), preferably a first shopping cart (213), and a second shopping carrier (214), preferably a second shopping cart (215), the scanning height, in use, is greater than the size of a product on which an optical code is displayed, along a direction perpendicular to a plane in which the optical code is displayed on the carrier, wherein the storage area is configured, in use, for receiving part of the first shopping cart and part of the second shopping cart, the camera is directed downward, in use, toward an upward facing access opening of the respective first shopping cart and second shopping cart, the scanning area is located, in use, over the first shopping cart and the second shopping cart, when the transfer area has received a first shopping carrier, preferably a first shopping cart, and a second shopping carrier, preferably a second shopping cart, and wherein the computer is configured, in use, for- recognizing the optical code and converting it to data based on the image captured by the camera,- providing the data on the communication means, preferably on the electronic communication connection, when- the transfer area has received the first shopping carrier and the second shopping carrier and an optical code displayed on a product and directed toward the camera is moved through the scanning area and the storage area.

16. A use of the code scanning system according to any the claims 1 to 3 or of the store cash register according to any of the claims 4 to 15, comprising moving an optical code directed toward the camera through the scanning area and the storage area, capturing an image of the field of view while the optical code moves through the scanning area, recognizing the optical code in the image,converting the optical code to data based on the image, providing the data on the communication means.

17. The use of the store cash register according to claim 16, at least when combined with claim 5, wherein moving an optical code directed toward the camera through the scanning area and the storage area comprises moving an optical code away from or toward a shopping carrier in the storage area.

18. The use of the store cash register according to any of the claims 16 to 17, at least when combined with claim 15, wherein moving an optical code directed toward the camera through the scanning area and the storage area comprises moving the optical code, displayed on a product, away from a first shopping cart and toward a second shopping cart, providing the data on the communication means comprises providing the data on the electronic communication connection.

19. The use of the store cash register according to any of the claims 16 to 18, wherein capturing an image of the field of view while the optical code moves through the scanning area, comprises capturing a first image (302) of the field of view of the camera and subsequently capturing a second image (303) of the field of view of the camera, the first image and the second image each comprising a scan-entry image portion (305) and a scan-exit image portion (306), recognizing the optical code in the image comprises recognizing the optical code in the scan-entry image portion of the first image and recognizing the optical code in the scan-exit image portion of the second image, converting the optical code to data based on the image comprises converting the optical code to data based on the first image and / or the second image.

20. The use of the store cash register according to any of the claims 16 to 19, wherein the code scanning system comprises a product database, which comprises first product information about a first optical code including a first product identification and a bulk packaging indication, and which comprises second product information about a second optical code including the first product identification and an individual packaging indication, moving an optical code directed toward the camera through the scanning area and the storage area comprises moving the first optical code directed toward the camera through the scanning area and the storage area, and moving the second optical code directed toward the camera through the scanning areaand the storage area, capturing an image of the optical code in the scanning area comprises an image including the first optical code and the second optical code, recognizing the optical code in the image comprises recognizing the first optical code in the image and recognizing the second optical code in the image, converting the optical code to data based on the image comprises converting the first optical code to first data and converting the second optical code to second data, providing the data on the communication means comprises providing the first data on the communication means, and the method further comprises- comparing the first product information, selected from the product database based on the first data, to the second product information, selected from the product database based on the second data.21 . A method for making the code scanning system according to any of the claims 1 to 3 or the store cash register according to any of the claims 4 tot 15, at least when combined with claim 2, comprising positioning a configuration object at a first location in the field of view, configuring the scanning area, comprising setting up the camera such that the configuration object is imaged with sufficient sharpness and such that at a second location in the field of view, further from the camera than the first location, the configuration object would be imaged with insufficient sharpness.

22. The method for making the code scanning system or the store cash register according to claim 21 , comprising positioning a configuration object at a third location in the field of view, closer to the camera than the first location, at a distance from the first location greater than the size of a support on which an optical code is displayed along a direction perpendicular to a plane in which the optical code is displayed on the carrier, configuring the scanning area, comprising setting up the camera such that the configuration object is imaged with sufficient sharpness and such that at a fourth location in the field of view, closer to the camera than the third location, the configuration object would be imaged with insufficient sharpness.

23. The method for making the store cash register according to any of the claims 22 to 23, at least when combined with claim 8, comprising positioning a shopping carrier, wherein the first location is located over the shopping carrier.

24. The method for making the store cash register according to claim 23, atleast when combined with claim 15, further comprising aligning the spotlight with the camera, configuring the illumination lighting such that the camera captures an image of an optical code in the scanning area with sufficient contrast in order to recognize the optical code and to convert it to data of the optical code based on the image.

Citation Information

Patent Citations

  • Multi-item product recognition for checkouts

    EP4224435A1

  • Zero-footprint camera-based point-of-sale bar code presentation scanning system

    US20050098633A1

  • Shopping cart monitoring using computer vision

    US20210284223A1

  • Bioptic barcode reader

    US20220100977A1

  • Checkout product recognition techniques

    US20230252443A1