Monitoring system and method

Abstract

A system (10) monitors preparation by a picker of an order for a customer, for example a food delivery order. The product(s) (20) of the order are arranged prior to delivery on a horizontal order preparation area (18) alongside an order ticket (22). A camera (16) is attached to a base unit (12), in which there is a control unit (34), memory (36), and a wireless communication system (38). In response to a user input device (30) being activated, an image of the order preparation area (18) is captured by the camera and stored digitally in the memory. Data may be transferred to a separate computer (40) so that a comparison can be made (with the use of machine learning, image recognition, text recognition and the like) between the product(s) as ordered (e.g. as ascertained from the order ticket) and the product(s) (20) recognisable from the image.

Description

[0001] Monitoring system and method

[0002] Field of the Invention

[0003] The present disclosure concerns in particular, but not exclusively, a system and / or a method for monitoring preparation by a person of a food and / or drink order for a customer.

[0004] Background of the Invention

[0005] There currently exist several different food delivery providers, such as for example those providers who provide their services under the brands Just Eat, Deliveroo, Uber Eats and the like. Those delivery providers receive orders from customers that are then processed by a restaurant, typically a fast-food chain or takeaway restaurant. A customer may order several items of food and / or drink from a restaurant. The term “food order” will be understood as encompassing an order for one or more food items only, an order for both food and drinks items, and / or an order for only one or more drinks items but no food (for example in the case of an order for bubble tea). The food order for a given customer is prepared by the restaurant for collection by the delivery provider and is then delivered to the customer.

[0006] A significant proportion of the food orders prepared by certain restaurants will be for customers that have made food orders via such food delivery providers. In order for the food delivery providers and the restaurants to provide a satisfactory service to the end customer there is a need for both speedy and accurate preparation of such food orders. Incorrectly prepared orders or orders that are delayed or delivered late cause problems for the restaurant and / or the food delivery provider. Food orders are typically prepared manually by staff in a restaurant, possibly with one or more people (e.g. chefs) cooking / preparing items of food or drink for many different orders in parallel, with another person picking appropriate items for a given food order. The person picking such items may be directed to pick items for a given order, using the paper order ticket that will serve as the receipt to be sent with the food order when collected by the food delivery provider. Preparation of such food orders will typically represent part only of the food and drink services provided by a givenrestaurant, and a single restaurant may produce food orders for customers via two or more different food delivery providers. There may therefore be challenges for a restaurant in integrating with the technology platforms utilised by a single food delivery provider.

[0007] The present invention seeks to mitigate the above-mentioned problems.

[0008] Alternatively or additionally, the present invention seeks to provide improvements in the speed and / or accuracy of completion of orders which involve the picking of one or more items for subsequent provision to a customer.

[0009] Summary of the Invention

[0010] The present invention provides, according to a first aspect, a system for monitoring preparation by a person of an order for a customer, the order comprising at least one product (for example, one or more food and / or drinks products) to be delivered to the customer, the product(s) of the order being arranged prior to delivery on a horizontal order preparation area alongside an order ticket on which details of all of the product(s) in the order are visible. The system comprises a base unit having a power connection for connection to a power source, which may be power over ethernet or a mains power source. The system comprises a camera, for example attached to the base unit. The base unit may comprise the camera. The camera is arranged to be powered by electrical power via the power connection. The system comprises a control unit in the base unit. The system comprises a memory for storing data, the memory for example being located in the base unit.

[0011] The system comprises a wireless communication system, for example located in the base unit, for transferring data across a network. The network may for example be cellular data network. The network may for example be a Wi-Fi network.

[0012] The system comprises a user input device (for example, a button) connected (whether wirelessly or wired) to the control unit.

[0013] The system is so arranged that, in response to the user input device (e.g. a button) being activated by a user, an image of the order preparation area is captured by the camera and stored digitally in a data file in the memory.

[0014] In embodiments of the system a comparison may then be made, advantageously with the use of image recognition, text recognition and / or integrationwith other IT systems (e.g. of the person, company or other entity taking and / or processing the customer’s order) between the product(s) as ordered (for example as listed on the order ticket) and the product(s) as detected on the order preparation area prior to delivery. As a result of the base unit containing not only the camera, but also many of the other electronic parts required to provide the functionality of the system, embodiments of the invention may provide this functionality in an easy to install system, possibly completely independently of the IT systems of the premises in which the system is installed. For example, in embodiments of the invention, it may be that the base unit effectively serves as a firewall between the IT systems of the premises in which the system is installed and the equipment that form the system (e.g. the camera, the control unit in the base unit, the memory located in the base unit, and / or the wireless communication system in the base unit).

[0015] The system may be arranged such that data is transferrable from the memory in the base unit to a separate computer - for example at a remote location - enabling the comparison (between the product(s) as ordered and the product(s) as detected on the order preparation area prior to delivery) to be carried out by that separate computer. The same separate computer may be linked to multiple systems operating in different premises. The separate computer may be configured to be accessed remotely for example via a web-based app, for example so that the premises at which orders are prepared can access data relating to those orders (for example to view the result of the comparison, images, and / or other details, relating to individual orders -and / or for example to enable the customer to view such details relating to their own order(s), and / or for example to enable the delivery service provider to view such details relating to order collected / delivered by them).

[0016] It may be that in some embodiments, some or all image processing is conducted locally within the base unit, optionally with resulting data or results being transmitted from the memory in the base unit to a computer at a different location enabling that computer to perform (e.g. further) analysis on the data or results so transmitted.

[0017] The system may be configured to capture static images (e.g. digital photographs) and store those in the memory. Additionally, or alternatively, the system may be configured to capture moving images (e.g. digital video content) and / or sound, and store those in the memory.The control unit may be arranged to cache multiple data files of images of different customer orders in the memory. The control unit may be arranged to send via the wireless communication system such data files, for example in batches, to a separate computer for extraction of information from the data files so sent. The control unit may be arranged to delete such files once successfully sent from the base unit to the separate computer, thus enabling limited memory resources to be provided at the base unit than might otherwise be required. Caching images, and sending in batches, may allow for interruptions (or bandwidth limits) in the wireless communication network utilised by the base unit. This may in turn improve reliability.

[0018] The wireless communication system may include a device, for example a first device, for communicating via a locally provided Wi-Fi network. The wireless communication system may include a device, for example a second device for communicating via a cellular data network. The wireless communication system may include two devices for communicating via network, each device using an independent or different network thus allowing the control unit to communicate when only one such network is functioning. The wireless communication system may for example have two devices, for example, one for communicating via Wi-Fi and the other for communicating via a cellular data network, independent of the locally provided Wi-Fi network. In embodiments it may therefore be that the control unit is arranged to cause transfer of data to a separate computer primarily with the use of one network communication device and to cause transfer of data to the separate computer with the use of a second device as a back-up or for the purposes of redundancy.

[0019] It may be that the control unit is arranged so that remote commissioning of the system, for example the initial installation of the system at a premises, may be performed - for example with the use of a wireless communication system. It may be that the commission includes initially using a cellular data network to perform initial set-up of the base unit, for example setting up wireless communication via a Wi-Fi network (e.g. remotely programming Wi-Fi settings, Wi-Fi passwords so that remote communication with the control unit can be switched from a cellular data network, such as a 4G or 5G network, to a Wi-Fi connection).

[0020] The base unit may include a mount on which the camera is mounted. The mount may form part of the base unit. The system is preferably configured so that itis mountable to a vertical surface such as a wall or to a horizontal surface, such as for example a ceiling, and so that in either case, the camera views, or is configurable so that it can so view, the horizontal order preparation area beneath the camera. The system may be additionally configured so that it is mountable on top of a horizontal surface, such as for example the horizontal order preparation area itself, and so that the camera views, or is configurable so that it can so view, the horizontal order preparation area beneath the camera. The focal length of the camera may be adjustable, for example at the point of installation, to suit the particular mounting position. In embodiments of the invention, having one system that is able to be installed at a premises in multiple different positions and orientations may reduce part count and may make the installation process easier. In an embodiment, the base unit has a fixing for attaching it to a wall or ceiling, and there is a mount on which the camera is mounted which is configurable so as to enable the camera to view the horizontal order preparation area beneath the camera whether the base unit is installed on a vertical wall or on a horizontal ceiling (the mount optionally being further configurable so as to enable the camera to view the horizontal order preparation area in the case where the camera is installed on the horizontal order preparation area). The camera, or a part thereof, may be configured to rotate between the two positions. The mount may be in the form of an arm that attaches the camera to the rest of the base unit.

[0021] As mentioned above, the user input device may be in the form of a button. The button may be a push button, for example. The button is preferably wirelessly connected to the control unit, which may allow for ease of installation. The button may therefore be placed near to a person picking an order, and installed in an easy manner.

[0022] As mentioned above, in embodiments, the system may be so arranged that, in response to the user input device being activated by a user, an image of the order preparation area captured by the camera is stored digitally in a data file in the memory. In embodiments, the system is arranged so that the same camera captures in the same image both the order ticket and the products arranged on the order preparation area. The system (whether by means of a separate computer and / or by means of an integrated part of the base unit) is preferably arranged to ascertain the identity( / ies) of the product(s) ordered by the customer by processing the image of theorder ticket so captured using text recognition. This may include extracting the identity( / ies) of the product(s) from the order ticket. Alternatively or additionally, this may include using certain data extracted from the order ticket (for example the order number) and then using that data (for example by interrogating a database of orders held on a computer) to electronically retrieve data (e.g. POS data) representing the identity( / ies) of the product(s) so ordered. The system (again, whether by means of a separate computer and / or by means of an integrated part of the base unit) is also preferably arranged to ascertain the identity( / ies) of the product(s) arranged on the order preparation area by processing the same image using image recognition. Then a direct comparison can be made, whether manually or electronically, as between what the customer has ordered versus what has been picked and prepared for delivery as evidenced by one or more images of the order captured at the point of being fully picked (e.g. immediately before being ready for being packaged up for collection for subsequent delivery). Thus, in embodiments, incorrect orders can be detected - and possibly corrected before delivery to the customer. In such embodiments, such a comparison and / or the image(s) captured of the order, may be used to rebut a complaint (e.g. a request for a refund and / or a replacement delivery, in part of in full) from a customer that an order is incomplete, when in fact the order was correctly prepared. The base unit may be configured to communicate to the picker whether an order has been correctly picked or not. This can be via a visual indication (e.g. green tick = correct / red cross = incorrect or not yet correct) and / or audible feedback (e.g. a high-pitched ringing sound, or other positive sound, to indicate a correctly picked order and a low-pitched beep noise, or other error sound, to indicate an incorrectly picked order).

[0023] In an embodiment of the invention, the image captured is sent by the base unit via an email (one image per email for example) to a separate computer. At the separate computer, the sender email address may be used to identify the premises at which the order is being prepared. In another embodiment an FTP file transfer is effected for sending images to a separate computer.

[0024] The images captured by the camera may have a resolution of at least 4 Megapixels. Each image may have a file size in memory of at least 1 MB. The camera may once installed have a fixed field of vision. The camera may have anoptical zoom lens that is configured to be operated remotely via the wireless communication system of the base unit.

[0025] The base unit may have a weight of over IKg.

[0026] According to a second aspect of the invention there is also provided a method of monitoring preparation by a picker (for example a person) of an order for a customer. The method may include using the system as described or claimed herein. The method comprises a step of the picker arranging one or more products on an order preparation area in response to the product(s) as listed on an order (e.g. an order ticket detailing the order). The method comprises a step of a camera capturing one or more images of the order preparation area, for example as a result of the picker causing the camera to do so (e.g. by pushing a button). The camera may simultaneously capture one or more images of the order preparation area and an order ticket. The camera may be part of, or secured to, a housing which contains one or more wireless communication devices.

[0027] The method comprises a step of ascertaining (e.g. with the assistance of an image recognition module) from the one or more images the identities of the products arranged in the order preparation area. The method may comprise a step of ascertaining the identities of the products as ordered by the customer. The method may comprise a step of ascertaining the identities of the products as listed on an order ticket, for example using character recognition. This may be achieved by using character recognition to extract the identities of the products from the text listing them on the order ticket and / or by using character recognition to identify a unique identifier, such as an order number, from which the identities of the products on the rest of the order ticket may be ascertained by interrogating data stored on a computer (for example a point of sale, or POS, system) that links the unique identifier for the order with data representing the items in the order. The method may comprise a step of ascertaining (e.g. with a computer) any discrepancies between what the customer has ordered and the identities of the products as ascertained from the one or more images captured of the order at the order preparation area. The steps of the method may be repeated for a succession of different orders (e.g. repeating the steps of the picker arranging products of successive orders on the order preparation area, the camera capturing images of the orders so prepared, and ascertaining for example with a computer any discrepancies between what has been ordered and what has beenrecognised as having been picked by the picker for the order from the captured images). The method may include a step of sending (for example) with the use of one or more wireless communication devices, to a separate computer, digital data of the image(s) captured for the orders - possibly one order at a time or in batches. The step of sending such digital data to the separate computer may enable the separate computer to log any order discrepancies. The ascertaining of order discrepancies and / or image recognition processing may be carried out by a separate computer using data transferred wireless to it, including the images (or data therefrom) as captured by the camera. The details of any order discrepancies may be transmitted back to the premises by the separate computer over a suitable network connection (e.g. via the internet).

[0028] It will be appreciated that the step of ascertaining from the images the identities of the products as picked and as ordered may be conducted by the separate computer and may thus be conducted only after the step of sending the digital data to the separate computer.

[0029] The method may comprise a step of a separate computer logging any such order discrepancies alongside the digital data of, or derived from, the associated image(s) so sent to the separate computer. The data so logged may include data added by a human operator. With the use of such data as logged it may then be possible for an operator to readily extract from such data the value (or cost) of incorrect orders, and other statistics.

[0030] The method may use an image recognition module which uses a neural network configured to detect certain products from a closed data-set of possible products. Such a neural network may be trained on a data set of images of such products and their true identities. It will be noted that the same image may be processed to extract details using text recognition from a part of the image deemed to be an order ticket and to extract from a different part of the image, using the image recognition module, the identities of the products in the image. A part of such method may thus be to determine which part of the image is an order ticket and the part(s) of the image that correspond to one or more picked items. Such a process may be made easier by having a designated zone in which the order ticket is placed, and a different zone for the picked items.There may be a first designated zone in which the picker arranges the one or more products on the order preparation area and a second designated zone, in which the picker arranges the order ticket, the first designated zone being different from the second designated zone. It may be that first designated zone can be differentiated from the second designated zone by a graphical representation, for example a dividing line, use of different colours or the like.

[0031] The method may include a step of (e.g. electronically) communicating that the identities of the products arranged in the order preparation area fully match the identities of the products as ordered (e.g. as listed on a paper order ticket) - i.e. indicating a correctly assembled order.

[0032] The method may include a step of (e.g. electronically) communicating that there are discrepancies between the identities of the products arranged in the order preparation area and the identities of the products as ordered (e.g. as listed on a paper order ticket). Details of such discrepancies may for example be communicated directly to the picker (e.g. the person preparing the order). Details of such discrepancies may for example be communicated to the premises in which the picker is based, and then optionally subsequently communicated to the picker. The step of communicating such information to the picker may be effected in time that the order may be corrected before the order is collected for delivery. The step of so communicating discrepancies to the picker may be effected within 30 minutes, possibly within ten minutes, and optionally within five minutes, of the images of the order having been initially captured. In some embodiments the step of so communicating discrepancies to the picker may be effected within less than a minute, possibly in a matter of seconds (e.g. less than 10 seconds). The step of communicating to the picker that there are discrepancies, may include providing details of the nature of the discrepancies and / or any corrections that need to be made to complete the order correctly. The step of communicating to the picker that there are discrepancies may be provided via an App. The step of communicating to the picker that there are discrepancies (and / or the step of communicating to the picker that there are no discrepancies - i.e. a correctly picked order) may be provided via a display screen or a device, for example a portable device such as a tablet, a smart phone or the like. The display screen may form part of the base unit of the system. It may be that the display screen is arranged to show all items on the order and anindicative green indicator to show that all items have been correctly picked and a red indicator in the case where that is not the case - optionally alongside a visual representation of the missing item(s) (and / or incorrectly assembled items - e.g. additional items erroneously picked). The base unit may comprise one or more audio transducers, for example loudspeakers, to provide audio feedback on the correctness or otherwise of the order as picked.

[0033] The step of ascertaining from the one or more images the identities of the products as listed on the order ticket may use text recognition to extract text data from the part of the image representing the order ticket. The text data may be representative of the text on the order ticket corresponding to the product(s) ordered by the customer in that order. The text data may be an identifier that uniquely identifies the order (e.g. an order number). The method may then include using such an identifier to obtain electronically, from a separately stored set of data (for example POS data), data representing the product(s) ordered by the customer in that order. This then may improve accuracy (by integrating with a computer system on which the source data for customer orders is stored) and lessen reliance on extensive use of text recognition.

[0034] The method may be performed such that the sending, to the separate computer, of the digital data is performed in batches for a series of successive orders. This may for example include sending data files in batches to a separate computer for extraction of information from the data files so sent, and then deleting such files once successfully sent from the base unit to the separate computer. The files may be sent via FTP. The files may be sent via email.

[0035] It may be that a single computer resource processes multiple images from multiple orders, with such a single computer resource performing, for each order, the step of ascertaining from the one or more images the identities of the products arranged in the order preparation area and the identities of the products as ordered (e.g. as listed on the order ticket as ascertained from the one or more images). In such a case the method may include throttling the rate at which orders are so processed by the single computer resource (e.g. by sending data in batches, by processing data in batches and / or delaying use of the single computer resource for subsequent orders). This may cause only very slight delays in the processing of data (to the extent that they would not affect customer service standards) but with the benefit of significantlyimproving reliability without necessarily needing to upgrade computer hardware to cope with greater volumes of orders.

[0036] In an embodiment, there is provided a method of using a computer, for example the separate computer mentioned above, to log discrepancies between an order as supplied by a customer and the identity of the item(s) as detected by a digital camera, alongside digital data of, or derived from, associated image(s) of the item(s) as picked by a picker for the order, as taken by the digital camera. The method may include receiving data from the digital camera across a communications network. The method may include sending data from the separate computer to a control unit at the location of the digital camera so that any such discrepancies (and / or an indication that there are no such discrepancies - i.e. the order appears to be correctly picked) can be communicated to a picker tasked with picking one or more item(s) for the order. The method may include the separate computer ascertaining from the one or more images the identities of the product(s) (item(s)) picked for the order. The method may include the separate computer ascertaining from the one or more images the identities of the product(s) (item(s)) as listed on an order ticket for the order.

[0037] According to a third aspect of the invention there is also provided a method of installing a system for monitoring preparation by a picker of an order for a customer. The method may include installing the system as described or claimed herein and / or installing a system for implementing the method of monitoring order preparation as described or claimed herein.

[0038] The system to be installed comprises a base unit in which there is provided a control unit, computer memory accessible by the control unit, and a wireless communication system for transferring data from the computer memory across a network. The system comprises a camera, which may be provided in a form already attached to the base unit. The method may comprise a step of connecting the base unit to a power source. The method may comprise a step of securing the base unit to a ceiling, to a wall, or onto the surface of the order preparation area. The method may comprise a step of providing a user input device (e.g. button) for triggering the camera. The method may comprise a step of arranging the camera so that it views the order preparation area. The method may comprise a step of connecting to the control unit via the wireless communication system to perform set-up of the system. This may be done with the use of a first wireless communication protocol (e.g. cellularnetwork), with the set-up of the system including programming the wireless communication system to enable connection to the control unit via the wireless communication system by means of a second wireless communication protocol (e.g. Wi-Fi) different from the first wireless communication protocol. The set-up of the system may include sending data to and from the control unit via the wireless communication system by means of the second wireless communication protocol.

[0039] The set-up of the system may be performed at least partially by means of sending data between the control unit and a computing device at a location remote from (and for example in a different building from) the control unit. In embodiments, this may facilitate a wireless and remote set-up procedure. The installation on site may be limited to physically connecting the base unit to a power source and mounting it appropriately. A more skilled set-up, involving data-input and the like, may be carried out remotely by a different person with the necessary skill-set.

[0040] The set-up of the system (which may be performed remotely) may include setting up a wireless connection between a user input device (such as a button) and the control unit.

[0041] The present invention also provides a computer program product comprising instructions which, when the program is executed by a computer, cause the computer to function as the control unit of the system according to the first aspect, for example including causing the computer to capture and store an image of the order preparation area in response to the user input device being activated, for example receiving data from a digital camera. The computer program product may for example cause the computer to transfer data (for example images, and / or data extracted from such images) from memory accessible by the computer to a separate computer to enable it to make a comparison between the product(s) in an order ticket and the product(s) of an order arranged prior to delivery as detected / captured by a digital camera.

[0042] The present invention also provides a computer program product comprising instructions which, when the program is executed by a computer, cause the computer to function as the separate computer, for example causing the computer to make a comparison between the product(s) in the order ticket and the product(s) of the order arranged prior to delivery.

[0043] The present invention also provides a computer program product comprising instructions which, when the program is executed by a computer, cause the computerto carry out one or more of the steps of the method of the second and / or third aspects of the invention (i.e. insofar as such steps are able to be carried out or controlled by a computer). For example, when the program is executed by such a computer, the computer may ascertain from one or more captured images the identities of the products arranged in an order preparation area, the identities of the products as listed on an order ticket, and any discrepancies therebetween. The computer program may additionally or alternatively cause a computer to log any such discrepancies alongside other digital data of, or derived from, associated captured image(s). The present invention also provides a computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out one or more of the commissioning and / or installation steps of the method of the invention. Other steps or functions of parts of the invention, whether optional or otherwise, which can be carried out by a computer may be carried out by a computer suitably programmed by a such a computer program product.

[0044] There is also provided a computing device comprising a processor and memory. The computing device may be arranged to perform, using the processor, the function of the control unit as described or claimed herein. The computing device may be arranged to perform, using the processor, the function of the separate computer as described or claimed herein. The computing device may be arranged to carry out, using the processor, one or more of the steps of the method as described or claimed herein. Such a computing device may be arranged to execute instructions provided by the computer program product as described or claimed herein.

[0045] It will of course be appreciated that features described in relation to one aspect of the present invention may be incorporated into other aspects of the present invention. For example, the method of the invention may incorporate any of the features described with reference to the apparatus of the invention and vice versa.

[0046] Description of the Drawings

[0047] Embodiments of the present invention will now be described by way of example only with reference to the accompanying schematic drawings of which:Figure 1 shows a view of a system for monitoring preparation of a food order according to a first embodiment of the invention;

[0048] Figure 2 shows an order ticket and items picked according to that order ticket, as viewed by the system of Figure 1;

[0049] Figure 3 shows how parts of the system of Figure 1 integrate with a separate computer;

[0050] Figure 4 is a view from beneath of a camera unit of the system of Figure 1 as mounted to a wall;

[0051] Figure 5 shows a view of the system of Figure 1 but mounted on the ceiling;

[0052] Figure 6 is a view from beneath of the camera unit of the system of Figure 5

[0053] (mounted to the ceiling);

[0054] Figure 7 is a flowchart showing the steps performed during the picking of a food order using the system of the first embodiment of the invention; and

[0055] Figure 8 is a flowchart showing the steps performed when installing the system of the first embodiment of the invention.

[0056] Detailed Description

[0057] The illustrated embodiments concern a system and method for monitoring preparation of food orders by a person working in a restaurant. A customer creates a food order by selecting items of food and drink for the order via a website or app provided by a food delivery service provider (referred to sometimes as an aggregator). Once the order has been completed by the customer, the food delivery service provider sends details of the order to a restaurant so that the restaurant may prepare the food order for collection by the food delivery service provider. Once the food order has been completed by the restaurant it is then transported by the food delivery service provider from the restaurant to the customer.

[0058] In this case the restaurant is a fast food take away restaurant. When a customer makes a food order via a food delivery service provider, the customer may sometimes complain about the food order that has been delivered by the delivery provider, for example stating that the order is incomplete or otherwise incorrect. Such complaints may be registered first with the delivery provider, which then may assumethat the restaurant that has prepared the order has made an error. However, it may be the case that there was an error with the delivery rather than the order, or the customer may simply be incorrect (whether innocently or fraudulently). Figure 1 shows a system 10 for monitoring preparation of the food order in the restaurant for subsequent delivery to the customer via the food delivery service provider. This system 10 provides a means by which accuracy of food orders may be improved and by which evidence can be produced to demonstrate / evidence which items were prepared and picked for a given order. This in turn can have the advantage also of enabling the restaurant and / or the food delivery service provider to refute an allegation of an incorrect order from a customer and therefore reduce the number of and value of unnecessary refunds.

[0059] The system 10 shown in Figure 1 comprises a base unit 12 mounted on the wall 14, so that a camera 16 attached to the base unit 12 can capture images of a food preparation area 18. In use, a person (the “picker”, not shown) at the food preparation area 18 picks items 20 to complete a given order as itemised on a food order ticket 22 (e.g. a printed receipt). The food preparation area 18 includes a mat 24 having a first designated area 26 on which the order ticket 22 is placed and a second designated area 28 in which the picker places the various items as indicated on the order ticket 22. The first designated area 26 is one colour (non-white) and the second designated area 28 is a different contrasting colour (which may also be non-white). The food preparation area 18 also includes a push button 30 secured in place to one side of the mat 24. Once the picker has completed picking the items 20 required by the order ticket 22, he or she pushes the button 30 so that an image of the mat 24 as viewed by the camera is captured, therefore capturing an image of the order ticket 22 and of the items 20 selected for the order. The picker then places the items 20 and order ticket 22 in appropriate packaging (e.g. a box, bag or the like, not shown) for collection by the food delivery service provider.

[0060] The base unit 12 mounted on the wall 14 is connected to power via a lead 32 to a standard mains supply.

[0061] With reference to Figure 3, within the base unit 12 there is provided a computer 34 with an appropriate programmed processor 35 for controlling the operation of the camera 16 and for processing data for subsequent communication via Wi-Fi or other mobile communication network.When the picker presses the button 30, this causes the computer 34 to capture an image as viewed by the camera 16 and store it in memory 36 (i.e. within the base unit 12). Images are cached within memory 36 and are sent in batches (for example batches of ten successive images) under the control of the computer 34 over a wireless network to a separate computer 40. The base unit 12 includes both a Wi-Fi module for communicating via Wi-Fi and a mobile communications module for transmitting data over a cellular data network, such as a 4G or 5G network. The two comms modules are collectively indicated by box 38 in Figure 3. The data is sent, typically via Wi-Fi, to the separate computer 40. The computer 34 is configured such that if the Wi-Fi network is faulty or not operating effectively, the computer 34 switches to using the mobile communications network (e.g. via 4G).

[0062] The transfer of data, including the images captured, from the base unit 12 to the separate computer 40 is via a suitable file transfer protocol (such as FTP) over the internet 42. The data transfer may include suitable point-to-point encryption, using a VPN, and be appropriately firewalled. The data sent includes an identifier that identifies the restaurant, in this case the Shepton Mallet branch of a (fictional) fast food chain named “Fast Food Fish ‘n’ Fries” and an identifier that identifies the food delivery service provider - in this case that being a (fictional) company named “Takeaway 2 U”.

[0063] At the separate computer 40, images are therefore received of successive orders. The separate computer 40 is arranged to process the images and extract data from them. This is done in batches (for example of ten) by one or more computer processors. The batching of processing is done to avoid processor overload, as it has been recognised that the downside of occasionally having slightly slower results is a better option than a processor crashing (e.g. as a result of being overloaded or too much data stacking up in memory), which would lead to much longer delays or incomplete data. It is also recognised that better, faster, and greater computing resources could be used, but that would increase cost in a manner disproportionate to both the value of the task in hand and the turnaround times that are needed in practice, which may be tens of minutes, rather than seconds or milliseconds.

[0064] Image recognition is used to detect the location of the order ticket 22 and also the identity of each item 20 placed in the second designated area 28 on the mat 24 in the food preparation area 18 of the restaurant. By having a designated area 28 for fooditems 20 and a designated area 26 for the placement of the order ticket 22, image detection may be made more efficient. In this case, three individual items 20 are deemed to be present in the image, namely one drink 44, one portion of fries 46, and one fish burger 48. It may be that different drinks and / or different food items 20 are purposely packaged in different coloured or patterned packaging to assist the image recognition algorithms to discern between different items having a similar 3-D shape. Once the part of the image in which the order ticket 22 is located is detected by the computer, the part of the image featuring the ticket is extracted, transformed digitally so that it has the correct orientation (vertically with top-side uppermost) and so that any distortion created by perspective, and the relative viewing angle of the camera 16 to the plane in which the ticket 22 lies, is corrected for. Having the first designated area 26 of the mat 24 being a non-white colour provides a contrast between the ticket 22 and its background which assists with edge detection, and therefore detecting the location and outline of the order ticket 22. Text recognition (e.g. OCR = Optical Character Recognition) is then used to convert all of the text visible on the ticket 22 into text data, including the name of the delivery service provider, the name of the restaurant, the order number, the customer details, and the items 20 of food / drink as listed on the ticket 22, and pricing figures, etc. It may be that all such text data from the order ticket is stored, but only certain key fields may be required depending on the nature of the particular embodiment such that not all data is accessible (or visible) to a given user of the system.

[0065] In this case the following details are captured from the ticket (as shown in Figure 2):

[0066] Delivery Service Provider =

[0067] • Takeaway 2 U

[0068] Order No .=

[0069] • 3841256

[0070] Items ordered =

[0071] • l x drink

[0072] • l x fries

[0073] • 1 x fish burgerA comparison is then made at the separate computer 40 of the items 20 as determined by image recognition (using the shape recognition algorithms and the like) and the items 20 as listed on the order ticket 22 (as detected using image processing and text recognition) and this can then be used to indicate either a correct order or an incorrect order. If the order is deemed to be incorrect an appropriate message is then issued to the restaurant by the separate computer 40. Live feedback may be provided to the picker after he / she presses the button 30, to indicate (visually and / or audibly) as to whether the order had been deemed correctly picked, or not.

[0074] The database at the separate computer is configured so that it may be accessed remotely. Permissions granting the level of access may vary from one user to another. One or more of the images stored on the database may be accessible by an external user, for example once provided with an Internet link by an operator at the separate computer 40 for example, whilst not providing access to any other data connected with those image(s). This may therefore enable the restaurant or the delivery service provider to resolve a customer complaint concerning the incorrectness of an order by providing the customer with the image of the food order immediately before packing / collection by the delivery service provider, thus reducing the number of refunds, or remade orders, resulting from customers falsely (whether by mistake or fraudulent intent) claiming that an order as delivered is incorrect. The restaurant could also provide the image to the food delivery service provider, for similar purposes.

[0075] In order for the image and text recognition to function effectively the camera 16 ideally needs to have a sufficiently high-quality lens and image capture resolution, preferably with an optical zoom that can be adjusted remotely, via wireless link between the base unit 12 and the separate computer 40. The camera 16 in this embodiment has a resolution of 8 megapixels, producing images with a resolution up to 3480 by 2160 pixels, with a file size of up to about 5MB per image. The file includes meta-data including the time and date the image was captured, which is also extracted at the separate computer 40. Alternatively, time and date information may instead be allocated by approximating the time and date of the order as being the time and date of receipt of the data at the separate computer 40 (or the time and date of sending the data from the restaurant premises, or as a time stamp added by the processor 35 of the base unit 12, or via the date and time information extracted from the order ticket / receipt.).Various data is stored in a database at the separate computer 40 alongside each image as captured. This includes the order number, data (premises ID) that identifies the restaurant (in this case, as “Fast Food Fish ‘n’ Fries” (Shepton Mallet branch)), the data (aggregator ID) that identifies the food delivery service provider (in this case, as “Takeaway 2 U”), the time and date, and information relating to whether the order was complete or otherwise (including for example recording which items were missing, if any, from each order).

[0076] Each record in the database also includes fields which can be completed remotely via a web portal and / or by an operator at the separate computer 40. Such fields include details of the financial value of the order, details of any customer complaint lodged (in the case of a disputed order), and details of the outcome of any customer complaint (“dispute”) as resolved (including the financial value of any refund, and optionally the financial value of any cost associated with remaking the order). The financial value of the order may be taken directly from the text as recognised from the image of the order ticket or may be extracted from POS data (Point Of Sale data), in cases where the restaurant allows access to such POS data. It may be that the name of the picker (the person picking the order) is not captured, for privacy reasons.

[0077] The database at the separate computer 40 can be interrogated to provide information concerning a given order (a search by order number), information concerning orders for a given restaurant or premises (a search by restaurant ID) and information concerning orders provided by multiple restaurants for a single aggregator (i.e. a search by the identity of a single delivery service provider). The database can also be searched by the date and time that the order was made. Such information from the database may include statistics and trends concerning the percentage of orders that are deemed correct / incorrect, the value of refunds and / or the cost of resolving disputes, and the like. Given that the data recorded includes information regarding which items were missing from order (as well as any extra items included in error) and when they were recorded as missing / added in error, the databases can allow the provision of useful statistics to the restaurants - e.g. “ketchup packets where the most commonly omitted items”, and “most errors occur between 19:00 and 22:00 on a Monday”.With reference again to Figure 3, the base unit 12 is shown schematically together with the wirelessly connected button 30 and a schematic illustration of the transfer of data via the Internet 42 between the base unit 12 and the separate computer 40. An important aspect of the system of the present embodiment is that it is in the form of a single design of unit that is easy to install at premises that may be very different from each other. The camera 16 needs both to be of sufficiently high quality that clear high-resolution images can be captured of the food preparation area 18 while not interfering with the food preparation process. There may therefore be a relatively narrow range of distances away from the food preparation area 18 that are suitable for mounting the camera 16. Restaurant premises typically have side walls or ceilings in the close vicinity of food preparation areas and the base unit 12 of the present invention is configured to be mountable on a ceiling or on a vertical wall. Having such flexibility in how the base unit 12 may be mounted enables the installation process to be straightforward requiring minimal preparation of the premises before an installer arrives to install the system.

[0078] With reference now to Figures 4, 5, and 6, as well as the previous figures, the base unit 12 has four fixings 54, one at each corner on its bottom, facilitating the securing of the base unit 12 to a wall or ceiling. (The location of the fixings 54 is shown schematically - it will be appreciated that in reality the fixings themselves may be hidden from view). The camera 16 is connected to the base unit 12 via a mounting arm 50 that is movable, by rotation about a fixed axis, between two configurations, namely a first configuration for when the base unit 12 is fixed to a wall 14 and a second configuration for when the base unit is fixed to a ceiling 52. In Figure 1 it will be seen that the base unit 12 is mounted on a vertical wall 14 via the four fixings, and the mounting arm 50 is in its first configuration so that the camera 16 is orientated so that it points downwards. Figure 4 is a view from beneath the base unit 12 when mounted to a wall 14 (i.e. as shown in Figure 1) and shows the relative position of the mounting arm 50, camera 16, and base unit 12. Figure 5 shows the same base unit 12 when fixed to a ceiling 52, with Figure 6 showing the base unit 12 when viewed from below in this ceiling configuration. It will be seen that the mounting arm 50 is rotated by 90° from its first configuration to its second configuration, so that the camera 16 is orientated so that it points downwards also in the ceiling configuration.The base unit 12 weighs about.1.5 kilos and measures 300mm x 200mm x 150 mm.

[0079] An additional aspect provided by the base unit 12 that facilitates ease of installation is that it contains substantially all of the IT, camera systems and communication systems needed for the system to operate. The button 30 is separately mountable, but connected remotely by a suitable wireless communication protocol. (The button is in the form of a Radio Frequency button).

[0080] Whilst not shown in the Figures, the button 30 has its own battery for power supply and a communications module that is configured to emit a signal when the button is pressed, which signal being detected by the computer 34 of the base unit 12.

[0081] The setup of a base unit 12 at a particular restaurant will now be briefly described. An installer arrives with a single base unit 12, one or more food preparation mats 24 (which may be used, replaced, or cleaned and reused by the premises), fixings for securing the base unit 12 to a wall 14 or ceiling 52, a wireless separately mountable button 30 and a power lead 32. The base unit 12 is then installed on the ceiling 52 or wall 14, whichever is most appropriate, in the region of the food preparation area 18. A mat 24 is placed on a horizontal surface in the food preparation area 18 at the location where food orders are assembled. The wireless button 30 is then fixed in the region of the surface, for example with an adhesive pad integrated with the button housing. The mounting arm 50 on which the camera 16 is mounted (if so required) is moved to the appropriate configuration (before or after fixing the base unit 12 to the wall 14 or ceiling 52), so that the camera 16 points downwards towards the food preparation area 18. Power supply is provided to the base unit 12 via the power lead 32. The installer may, if required, bring a wi-fi router and associated kit to set up an independent wi-fi network on the premises if so required. The installer then alerts the separate computer 40 so that commissioning and setup of the base unit 12 can be carried out remotely.

[0082] Initially a connection between the separate computer 40 and the base unit 12 is created using the mobile communications network (for example, over 4G). The region of view of the camera 16 is adjusted by remote operation of the zoom lens so as to ensure that images to be captured will include all of the area defined by the mat 24. This may be achieved automatically by the separate computer - for example by zooming out fully, detecting the mat 24 using image recognition and then zooming inand angling the viewing axis of the camera as appropriate to ensure that the field of view is appropriately matched to the mat and likely position of items on the mat. Alternatively, a human operator may set the viewing angle and zoom level manually, for example via the separate computer 40. Communication between the button 30 and base unit 12 is set up. Each button is “learnt” into each base station.

[0083] Details of the local Wi-Fi network as installed by the installer (or of the Wi-Fi network already on site, if that is used) are programmed via the established link. The connection via the Wi-Fi network is then tested. The installer then tests the system by pressing the button 30 a number of times and awaiting confirmation that the images have been duly received and processed at the separate computer 40.

[0084] The provision of a single design of a food preparation monitoring system 10 which can be easily set up at a particular premises with very little specialist skills being required by the installer and without requiring any interaction with the IT systems at the premises, enables such a monitoring system to be rolled out with relative ease across multiple premises and for multiple delivery service providers. Accuracy of food orders is expected to increase, possibly simply as a result of the pickers at the premises knowing that their work output is being monitored and therefore being more readily held to account, but possibly also as a result of live feedback on the correctness of orders. The system can enable customers’ requests for refunds for an allegedly incorrect order to be refuted, in cases where the data and images captured prove that the food order was correctly assembled. The data produced by such a system may also be of great assistance in training of staff and managing of staff. With the data provided by such a system it may also be possible to detect trends and create statistics that may also assist in the provision of services by the premises and also by the delivery service providers.

[0085] Figure 7 shows a flowchart 100 which illustrates the steps performed during the picking of an order by a picker for example using the apparatus shown in Figures 1 to 6. The food order is one initiated by a customer to be delivered to them by a delivery service provider. The food order comprises one or more items of food / drink to be provided by a single establishment (such as a restaurant or takeaway).

[0086] As a first step (box 101), the picker collects from a food storage area and / or a drinks dispenser the products as listed on the order ticket and then places them on the designated area of the mat in the food preparation area. The order ticket is also placedon the mat in the designated area for the ticket. Then (box 103) the picker presses the button which causes an image of the mat and the items on the mat to be captured. The image is then sent over the internet to a computer in a separate computer. The separate computer then processes the image (box 105), with the use of image processing, text recognition and image recognition, to identify the items as listed on the order ticket, and the items actually picked. The separate computer then makes a comparison (box 107) to identify any discrepancies between the items listed on the order ticket, and those actually picked. The order is then collected by the delivery service provider and delivered to the customer (box 109). The above steps (as represented by boxes 101, 103, 105, 107 and 109) may be repeated (represented by box 111) for a succession of different orders, possibly at different restaurants and / or possibly utilising different delivery service providers. It may be that multiple images are taken and stored locally (cached) at the camera unit at the restaurant premises, before being sent for processing, so that multiple orders are made, collected and sent out for delivery before the images are sent in a batch to be processed remotely (such an alternative being shown in Figure 7 with the use of boxes 115, 117).

[0087] The processing of the images at the separate computer may as mentioned above be performed in batches with a delay between successive batches, to reduce processor overload.

[0088] Data received and processed at the separate computer may be analysed and / or added to at the separate computer (represented by box 113), for example remotely by restaurant staff accessing the database via a web portal. For example when discrepancies are detected by the system restaurant staff may then input alongside the images stored of any discrepancies (whether raised by an end customer and found to be justified, or otherwise), details of any action taken as a result (financial values etc), with the orders logged. Such data may be processed to provide information (statistics for example) that are then communicated, at least in part, to the restaurant premises (which may enhance staff training for example). Such data may may also be communicated to the delivery service provider to provide evidence of the extent of faulty orders and / or to an end customer (for example as an image of a food order immediately before collection by the delivery service provider to show exactly what left the restaurant premises).As an alternative to remote processing of images, it may be that the image recognition and analysis of the correctness of each order is carried out with computing resources local to the premises at which the food orders are prepared.

[0089] Figure 8 shows a flowchart 200 which illustrates the steps performed when installing the apparatus shown in Figures 1 to 6, the apparatus thus comprising a camera with associated base unit in which there is provided a control unit in the form of a computer including a computer processor, memory, Wi-Fi networking hardware and mobile communications network hardware (e.g. data card for communication over a 4G / 5G network). The base unit is provided with the camera attached to it via an adjustable mount.

[0090] The installation comprises a step (represented by box 201) of securing the base unit to a structure (in this case a ceiling, but it could be a wall) in the vicinity of a food preparation area on which there is arranged a two-colour mat. The method includes, if necessary, a step (represented by box 203), of adjusting the position of the mount so that the camera is pointing towards the area in which the mat is placed. The base unit is then connected (represented by box 205) to a power source. There is a step (represented by box 207) of mounting a wireless connecting button to the food preparation area, the button being configured for triggering the camera. Once the apparatus has been set up and the base unit is provided with power, a remote commissioning process is conducted over the mobile communications network.

[0091] During remote commissioning, the camera is set up and tested, and the Wi-Fi communication settings are set-up. Set-up of the camera includes ensuring that the camera is sufficiently zoomed-in so as to capture the whole area of the order mat, and ensuring that the image is correctly focussed. It is preferred for a local Wi-Fi network already at the restaurant premises to be used, with the connection to such a Wi-Fi network being appropriately firewalled for security purposes and so as to restrict access. If such a local Wi-Fi network is not available it may be necessary to separately install (represented by box 211) such a network on-site during the installation process, thus providing a wi-fi network segregated from the IT systems of the local premises. The system is then tested (represented by box 213). This may include testing that images are correctly and timely sent from the base unit over the network connection and received in a separately maintained web portal. All or part of the commissioning process may be automated.It will be appreciated that the above steps may be carried out in a different order, for example step 205 could be performed after step 207.

[0092] Whilst the present invention has been described and illustrated with reference to particular embodiments, it will be appreciated by those of ordinary skill in the art that the invention lends itself to many different variations not specifically illustrated herein. By way of example only, certain possible variations will now be described.

[0093] The transfer of data from the base unit 12 to the separate computer 40 may be via email. In such a case, the identifier that identifies the restaurant may be the email address of the sender of the email. In cases where a restaurant only uses one food delivery service provider, there may be no need to send a separate identifier to identify the food delivery service provider, as this information can be known implicitly at the separate computer.

[0094] The transfer of data (e.g. image(s)) from the base unit 12 to the separate computer 40 may be delayed until the computer 34 in the base unit establishes that there is an internet connection available. Until this moment, all images captured are stored locally in the memory in the base unit. In some premises the availability of internet connection may be sporadic such that images are required to be stored locally for several minutes, if not hours.

[0095] Extra data may also be stored that relates to the confidence level of text recognition or image recognition.

[0096] Image recognition may use machine learning or algorithms powered by “artificial intelligence” to improve accuracy. This may involve providing an Al system with training data, such training data being based on images of food and drink products sold by a particular premises. With the continual increase in available computer processing power as computer technology continually improves, it may be possible for the computer 34 within the base unit 12 or the computing resource at the separate computer 40 to provide faster, almost instantaneous, feedback to the picker at the food preparation area 18 as to the correctness or otherwise of the order being prepared. Such information could be provided by a mobile communication device on the person of the picker or at the food preparation area 18, such as a smartphone or computer tablet, or bespoke display device.

[0097] The base unit may be configured - with extra fixings or the like - to enable it to be fixed on top of a horizontal surface such as on or adjacent to the foodpreparation area 18, and / or configured so that the camera is configurable to view the food preparation area 18 when the base unit stands on and / or adjacent to the food preparation area 18.

[0098] In some embodiments, the computer of the base unit and / or the separate computer may have access, via a suitable API (Application Programming Interface), to the restaurant’s POS data. With such access, it is possible for the base unit to read the order number from the order ticket (receipt), the order number typically being very large and easy for a computer to read, and then cross-reference this with the POS data. This allows the system to read the order items from the POS data rather than via OCR from the receipt. Such a facility can improve accuracy given that OCR text recognition may be prone to read errors.

[0099] The images captured may comprise moving images. For example video footage may be captured, optionally without any sound.

[0100] Where in the foregoing description, integers or elements are mentioned which have known, obvious or foreseeable equivalents, then such equivalents are herein incorporated as if individually set forth. Reference should be made to the claims for determining the true scope of the present invention, which should be construed so as to encompass any such equivalents. It will also be appreciated by the reader that integers or features of the invention that are described as preferable, advantageous, convenient or the like are optional and do not limit the scope of the independent claims. Moreover, it is to be understood that such optional integers or features, whilst of possible benefit in some embodiments of the invention, may not be desirable, and may therefore be absent, in other embodiments.

Claims

Claims1. A system for monitoring preparation by a person of an order for a customer, the order comprising at least one product to be delivered to the customer, the product(s) of the order being arranged prior to delivery on a horizontal order preparation area alongside an order ticket on which details of all of the product(s) in the order are visible,wherein the system comprisesa base unit having a power connection for connection to a power source, a camera attached to the base unit and arranged to be powered by electrical power via the power connection,a control unit in the base unit,a memory for storing data, the memory being located in the base unit, a wireless communication system in the base unit for transferring data across a network, anda user input device connected to the control unit,and wherein the system is so arranged that, in response to the user input device being activated by a user, an image of the order preparation area is captured by the camera and stored digitally in a data file in the memory,and so that data is transferrable from the memory in the base unit to a separate computer configured to make a comparison between the product(s) in the order ticket and the product(s) of the order arranged prior to delivery.

2. A system according to claim 1, wherein the control unit is arranged to cache multiple such data files of images of different customer orders in the memory, to send via the wireless communication system such data files in batches to a separate computer for extraction of information from the data files so sent, and to delete such files once successfully sent from the base unit to the separate computer.

3. A system according to claim 1 or claim 2, wherein the wireless communication system includes a first device for communicating via a locally provided Wi-Fi network and a second device for communicating via a cellular data network independent of the locally provided Wi-Fi network.

4. A system according to claim 3, wherein the control unit is arranged to cause transfer of data to a separate computer primarily with the use of the first device and to cause transfer of data to the separate computer with the use of the second device as a back-up or for the purposes of redundancy.

5. A system according to claim 3 or claim 4, wherein the control unit is arranged so that commissioning of the system is performed with the use of the second device.

6. A system according to claim 5, wherein the commissioning of the system able to be performed with the use of the second device includes setting up wireless communication via the first device.

7. A system according to any preceding claim, wherein the base unit includes a mount on which the camera is mounted.

8. A system according to any preceding claim, wherein the base unit has a fixing for attaching it to a wall or ceiling, the mount being configurable so as to enable the camera to view the horizontal order preparation area beneath the camera whether the base unit is installed on a vertical wall or on a horizontal ceiling, and optionally being additionally desk-mountable (e.g. mountable on the horizontal order preparation area).

9. A system according to any preceding claim, wherein the user input device is in the form of a push button that is wirelessly connected to the control unit.

10. A system according to any preceding claim, wherein the system is arranged so that the camera captures an image of the order ticket and the products arranged on the order preparation area,the system is arranged to ascertain the identity( / ies) of the product(s) ordered by the customer by processing such an image using text recognition to extract the identity( / ies) of the product(s) from the order ticket, andthe system is arranged to ascertain the identity( / ies) of the product(s) arranged on the order preparation area by processing the same image using image recognition.

11. A method of monitoring preparation by a picker of an order for a customer, wherein the method comprises the following steps:the picker arranging one or more products on an order preparation area in response to the product(s) as listed in an order ticket detailing the order,the picker causing a camera to capture one or more images of the order preparation area and the order ticket, the camera being part of, or secured to, a housing which contains one or more wireless communication devices, ascertaining from the one or more images the identities of the products arranged in the order preparation area, the identities of the products as listed on the order ticket, and any discrepancies therebetween,repeating the above steps for a succession of different orders,with the use of the one or more wireless communication devices sending, to a separate computer, digital data of, or derived from, the image(s) for the orders, andwith the separate computer logging any such discrepancies alongside the digital data of, or derived from, the associated image(s) so sent to the separate computer.

12. A method according to claim 11, wherein there is a first designated zone in which the picker arranges the one or more products on the order preparation area and a second designated zone, in which the picker arranges the order ticket, the first designated zone being different from the second designated zone.

13. A method according to claim 11 or claim 12, wherein any discrepancies between the identities of the products arranged in the order preparation area as so ascertained and the identities of the products as listed on the order ticket as so ascertained are communicated to the picker preparing the order.

14. A method according to any of claims 11 to 13, wherein the step of ascertaining from the one or more images the identities of the products as listed on the order ticket uses text recognition to extract an identifier that uniquely identifies the order and thenuses that identifier to obtain electronically, from a separately stored set of data, data representing the product(s) ordered by the customer in that order.

15. A method according to any of claims 11 to 14, wherein the sending, to the separate computer, of the digital data is performed in batches for a series of successive orders, for example in batches of at least 10 successive orders.

16. A method according to any of claims 11 to 15, wherein a single computer resource processes multiple images from multiple orders, for each order performing the step of ascertaining from the one or more images the identities of the products arranged in the order preparation area and the identities of the products as listed on the order ticket, and the method includes throttling the rate at which orders are so processed by the single computer resource.

17. A method according to any of claims 11 to 16, performed with the use of a system according to any one of claims 1 to 10.

18. A method of installing a system for monitoring preparation by a picker of an order for a customer, the order comprising at least one product to be delivered to the customer, the product(s) of the order being arranged prior to delivery on a horizontal order preparation area alongside an order ticket on which details of all of the product(s) in the order are visible,the system comprising a base unit in which there is provided a control unit, computer memory accessible by the control unit, and a wireless communication system for transferring data from the computer memory across a network, anda camera attached to the base unit,wherein the method comprises the following steps:connecting the base unit to a power source,securing the base unit to a ceiling or wall, or onto the surface of the order preparation areaproviding a user input device for triggering the camera,arranging the camera so that it views the order preparation area, andconnecting to the control unit via the wireless communication system to perform set-up of the system.

19. A method according to claim 18, wherein the step of connecting to the control unit via the wireless communication system to perform set-up is by means of a first wireless communication protocol, and the set-up of the system includes programming the wireless communication system to enable connection to the control unit via the wireless communication system by means of a second wireless communication protocol different from the first wireless communication protocol.

20. A method according to claim 19, wherein the set-up of the system includes sending data to and from the control unit via the wireless communication system by means of the second wireless communication protocol.

21. A method according to any of claims 18 to 20, wherein set-up of the system is performed at least partially by means of sending data between the control unit and a computing device at a location remote from the control unit.

22. A computer program product comprising instructions which, when the program is executed by a computer, cause the computer to function as the control unit of any of claims 1 to 10, as the separate computer of any of claims 1 to 10 and / or to carry out one or more of the steps of the method of any of claims 11 to 21.

23. A computing device comprising a processor and memory, wherein the computing device is arranged to perform, using the processor, the function of the control unit of any of claims 1 to 10, to perform, using the processor, the function of the separate computer of any of claims 1 to 10 and / or to carry out, using the processor, one or more of the steps of the method of any of claims 11 to 21.

Images