Display control device, display control method, and non-transitory computer-readable recording medium
Patent Information
- Application Number
- PCT/JP2023/036637
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-10-06
- Publication Date
- 2025-04-10
AI Technical Summary
When using a product identification system based on wireless communication tags, product identification errors are prone to occur, especially when customers are about to purchase products. This error will have a significant impact on the accuracy and reliability of the system.
A display control device and method are designed to dynamically control the display mode by obtaining identification information and accuracy information in product identification results, including adjusting the display order, position, size and color of the information to reflect the accuracy of product identification.
Improve the accuracy of product identification, and let users understand the reliability of identification results through visual means, so as to correct errors in a timely manner and ensure the accuracy of the payment process.
Smart Images

Figure JP2023036637_10042025_PF_FP_ABST
Abstract
Description
Display control device, display control method, and non-transitory computer-readable recording medium
[0001] The present invention relates to a display control device, a display control method, and a non-transitory computer-readable recording medium.
[0002] The following Patent Document 1 discloses a shopping cart that has a function of reading wireless tags such as RFID (radio frequency identifier) tags attached to products and outputting product codes stored in the wireless tags. The following Patent Document 1 also discloses a process of associating the strength of radio waves received from a beacon installed on a certain product shelf with the product code corresponding to the product shelf, and displaying information related to the product codes corresponding to the product shelf in descending order of received radio wave strength.
[0003] Japanese Patent Application Laid-Open No. 2021-114159
[0004] Systems such as those described in Patent Document 1 that identify products based on information read from wireless communication tags such as RFID tags can often have the problem of incorrectly identifying products. The impact of this problem becomes even greater when a system such as that described in Patent Document 1 is used to identify products that customers are planning to purchase. In systems that identify products that customers are planning to purchase based on information read from wireless communication tags, there is a need for technology that can accurately identify the products that customers are planning to purchase.
[0005] The display control device of the present disclosure comprises: a product identification result acquisition means for acquiring a product identification result of a product passing through an aisle, the product identification result including identification information that identifies the product and accuracy information that indicates the accuracy that the product has passed through the aisle; and a display processing means for displaying a screen showing the product identification result on a display. Furthermore, the display processing means controls the display mode of information corresponding to the product according to the accuracy of the product indicated by the accuracy information.
[0006] The display control method of the present disclosure includes at least one computer acquiring a product identification result for a product passing through an aisle, the product identification result including identification information for identifying the product and probability information indicating the probability that the product has passed through the aisle, and displaying a screen showing the product identification result on a display, wherein displaying the screen on a display includes controlling the display mode of information corresponding to the product according to the probability of the product indicated by the probability information.
[0007] The non-transitory computer-readable recording medium of the present disclosure records a program for causing at least one computer to execute an operation including: acquiring a product identification result for a product passing through an aisle, the product identification result including identification information for identifying the product and accuracy information indicating the accuracy that the product has passed through the aisle; and displaying a screen showing the product identification result on a display, wherein displaying the screen on a display includes controlling the display manner of information corresponding to the product in accordance with the accuracy of the product indicated by the accuracy information.
[0008] According to the present disclosure, a technology is provided that contributes to improving the accuracy in identifying a product that a customer is attempting to purchase using a wireless communication tag.
[0009] FIG. 1 is a diagram illustrating a first example of a functional configuration of a display control device in the present disclosure. FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer that realizes a display control device in the present disclosure. FIG. 3 is a flowchart illustrating a first example of processing executed by a display control device in the present disclosure. FIG. 4 is a diagram illustrating a reading device provided in a predetermined passage. FIG. 5 is a diagram illustrating a second example of a functional configuration of a display control device in the present disclosure. FIG. 6 is a flowchart illustrating a second example of processing executed by a display control device in the present disclosure. FIG. 7 is a diagram illustrating an example of a screen displayed on a display. FIG. 8 is a diagram illustrating another example of a screen displayed on a display. FIG. 9 is a diagram illustrating another example of a screen displayed on a display. FIG. 10 is a diagram illustrating a third example of a functional configuration of a display control device in the present disclosure. FIG. 11 is a flowchart illustrating a third example of processing executed by a display control device in the present disclosure. FIG. 12 is a diagram illustrating an example of a first operation executed on a screen. FIG. 13 is a diagram illustrating an example of a second operation executed on a screen.
[0010] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In this disclosure, the drawings relate to one or more embodiments. In all drawings, similar components are denoted by similar reference numerals, and descriptions thereof will be omitted where appropriate. Unless otherwise specified, each block in each block diagram represents a functional configuration, not a hardware configuration. When elements such as blocks in a diagram are linked by arrows, the direction of the arrows is merely intended to make the flow of information easier to understand. In this case, unless otherwise specified, the direction of the arrows does not limit the direction of communication (one-way communication / two-way communication).
[0011] In the following description, "acquisition" includes at least one of the following: a device going to retrieve data or information stored in another device or storage medium (active acquisition), and a device inputting data or information output from another device (passive acquisition). Examples of active acquisition include making a request or inquiry to another device and receiving a reply, and accessing and reading information from another device or storage medium. Examples of passive acquisition include receiving information that is distributed (or transmitted, push notification, etc.). Furthermore, "acquisition" may also mean selecting and acquiring data or information from received data or information, or selecting and receiving distributed data or information.
[0012] 1 is a diagram illustrating a first example of a functional configuration of a display control device according to the present disclosure. The display control device 10 illustrated in the diagram includes a product identification result acquisition unit 110 and a display processing unit 120.
[0013] The product identification result acquisition unit 110 acquires identification results of products passing through a predetermined passage within the premises of a facility (e.g., a retail store, a shopping mall, etc.) that handles products. The predetermined passage is, for example, a passage leading to a location where payment processing for products purchased by customers is performed (a location where a payment device (not shown) for processing the payment is installed). A reading device (not shown) that reads information from a wireless communication tag attached to each product is provided in the predetermined passage. The product identification results are generated based on the reading results by the reading device. As an example, the product identification result acquisition unit 110 may be configured to generate (acquire) the product identification results based on the reading results by the reading device. As another example, if the reading device has a processing unit that generates product identification results, the product identification result acquisition unit 110 may be configured to acquire the product identification results generated by the processing unit of the reading device. Here, the product identification results include information identifying the products that passed through the passage (e.g., product identification information recorded on a wireless communication tag attached to each product) and accuracy information indicating the accuracy with which the products passed through the predetermined passage.
[0014] The display processing unit 120 displays a screen showing the product identification results acquired by the product identification result acquisition unit 110 on a display. The display processing unit 120 controls the display mode of information corresponding to the product in accordance with the probability (the probability that the product passed through a predetermined passage) indicated by the probability information included in the product identification results. Specific examples of "a screen showing the product identification results" will be described later. The display that displays the screen is not particularly limited, and may be, for example, the display of a payment device (not shown) used by a customer to process payment for the product, or the display of a portable communication device (e.g., a smartphone, tablet terminal, etc.) carried by the customer.
[0015] <Example of Hardware Configuration of Display Control Device> FIG. 2 is a diagram illustrating an example of the hardware configuration of a computer that realizes the display control device according to the present disclosure.
[0016] The computer 1000 illustrated in this figure includes a bus 1010 , a processor 1020 , a memory 1030 , a storage device 1040 , an input / output interface 1050 , and a network interface 1060 .
[0017] The bus 1010 is a data transmission path for transmitting and receiving data among the processor 1020, memory 1030, storage device 1040, input / output interface 1050, and network interface 1060. However, the method of connecting the processor 1020 and the like to each other is not limited to bus connection.
[0018] The processor 1020 is a central processing unit (CPU) or a graphics processing unit (GPU).
[0019] The memory 1030 is a main storage device realized by a random access memory (RAM) or the like.
[0020] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), etc. The storage device 1040 stores at least a program module that realizes the functions of the display control device 10 described above (the product identification result acquisition unit 110 and the display processing unit 120).
[0021] The processor 1020 loads a program module read from the storage device 1040 onto the memory 1030 and executes the program module, thereby realizing a function corresponding to the program module. For example, the processor 1020 reads a program module corresponding to the product identification result acquisition unit 110 onto the memory 1030 and executes the program module, thereby realizing the function of the product identification result acquisition unit 110 described in the present disclosure. Similarly, the processor 1020 reads a program module corresponding to the display processing unit 120 onto the memory 1030 and executes the program module, thereby realizing the function of the display processing unit 120 described in the present disclosure. The operation of the processor 1020 is common to each embodiment included in the present disclosure.
[0022] The above-described program modules may be recorded on a recording medium other than the storage device 1040. The recording medium on which the program modules are recorded may include any non-transitory, tangible medium usable by the computer 1000. The recording medium on which the program modules are recorded may have embedded therein program code that is readable by the computer 1000 (processor 1020).
[0023] The input / output interface 1050 is an interface for connecting the computer 1000 (display control device 10) to various input / output devices.
[0024] The network interface 1060 is an interface for connecting the computer 1000 (display control device 10) to a network. This network includes, for example, a local area network (LAN) and a wide area network (WAN). The network interface 1060 connects the computer 1000 (display control device 10) to various networks via a wireless or wired connection. The computer 1000 (display control device 10) can communicate with various other devices present on various networks via the network interface 1060. For example, the computer 1000 (display control device 10) can communicate with other devices such as a reading device installed in a predetermined passage, a payment device installed in a predetermined location, and a portable communication device carried by a customer via the network interface 1060.
[0025] The computer 1000 (display control device 10) can also be connected to various devices (not shown) via the input / output interface 1050 or the network interface 1060. The "various devices" referred to here are not particularly limited, but include, for example, input devices such as operation buttons, keyboards, touch panels, mice, and microphones, and output devices such as displays, speakers, and printers.
[0026] <Example of Operation of Display Control Device> An example of operation of the display control device according to the present disclosure will now be described with reference to Figures 3. Figure 3 is a flowchart showing a first example of processing executed by the display control device according to the present disclosure.
[0027] First, the product identification result acquisition unit 110 acquires the product identification results for products passing through the aisle (step S102). Then, the display processing unit 120 determines the display format of information corresponding to the product based on the product accuracy information included in the product identification results acquired in step S102 (step S104). Then, the display processing unit 120 generates screen data showing the product identification results based on the results of step S104 (step S106). For example, the display processing unit 120 generates screen data displaying information corresponding to a product identified by identification information included in the product identification results in a display format determined based on the product accuracy information. Here, "information corresponding to the product" includes the product name. Furthermore, "information corresponding to the product" is not particularly limited, and may further include the product price, an image of the product's exterior, and benefits (such as discounts and loyalty program points). Then, the display processing unit 120 outputs the screen data generated in step S106 to a predetermined display and displays a screen showing the product identification results on the display (step S108).
[0028] As described above, the display control device according to the present disclosure displays a screen indicating a product identification result on a display. Here, the display control device according to the present disclosure determines the display mode of information corresponding to the product on the screen based on product accuracy information included in the product identification result. That is, the display control device according to the present disclosure controls (changes) the display state of information corresponding to the product on the screen according to the accuracy with which the product is determined to have passed through a predetermined aisle. In this manner, information (screen) visually indicating the accuracy of the identification result of the product that passed through a predetermined aisle is displayed on the display. A person checking the screen (e.g., a customer planning to purchase a product that passed through the aisle) can easily determine the likelihood that the product has been incorrectly identified based on the display mode of the information corresponding to the product. Here, if the person notices an error in the product identification result from the content displayed on the screen, the person can take appropriate measures to correct the error. Thus, the present disclosure provides a display control device that solves the problem of contributing to improving the accuracy of identifying a product that a customer is attempting to purchase using a wireless communication tag. The present disclosure also provides a display control method executed by the display control device and a non-transitory computer-readable recording medium storing a program implementing the functions of the display control device.
[0029] A detailed example of a display control device according to the present disclosure will be described below.
[0030] <Regarding the Product Identification Result Acquisition Unit 110> As an example, the product identification result acquisition unit 110 is configured to generate product identification results based on the results of reading wireless communication tags attached to products passing through a predetermined passage. Here, the results of reading the wireless communication tags are generated by a reader (e.g., FIG. 4) installed in the predetermined passage.
[0031] FIG. 4 is a diagram illustrating a reading device installed in a predetermined passageway. As shown, the reading device 20 is installed in a predetermined passageway 90. In this example, the reading device 20 is depicted as a gate-type device having two housings, but the structure of the reading device 20 is not limited to this example. The reading device 20 has the function of reading information from a wireless communication tag attached to a product. The reading device 20 emits radio waves to activate the wireless communication tag via an antenna (not shown). The wireless communication tag is not particularly limited, but may be any tag that complies with a wireless communication standard using radio waves in the UHF (Ultra High Frequency) band. The wireless communication tag attached to a product is activated in response to radio waves emitted from the antenna (not shown) of the reading device 20. The activated wireless communication tag encodes information stored in its memory area (e.g., identification information of the corresponding product) and transmits a response radio wave. The reading device 20 receives the response radio wave transmitted from the wireless communication tag via an antenna (not shown). The reader 20 generates a reading result based on the response radio waves from each wireless communication tag. Specifically, the reader 20 generates information that associates the reception strength of the response radio waves from each wireless communication tag with information decoded from the response radio waves.
[0032] Here, the reception strength of the response radio waves when a product passes through the aisle 90 is generally greater than the reception strength of the response radio waves when the product is located outside the aisle 90 (i.e., the product has not passed through the aisle 90). In other words, the reception strength of the response radio waves from the wireless communication tag can be used as information indicating the probability that the product has passed through the aisle 90. As an example, the product identification result acquisition unit 110 uses the reception strength of the response radio waves from the wireless communication tag itself as the accuracy information. As another example, the product identification result acquisition unit 110 may be configured to calculate the probability that the product has passed through the aisle using a predetermined function, table, or machine learning model that uses the reception strength of the response radio waves from the wireless communication tag as a parameter. The product identification result acquisition unit 110 generates a product identification result based on the accuracy information obtained for each product. For example, the product identification result acquisition unit 110 includes, in the identification result, information corresponding to a product (information obtained from the wireless communication tag) associated with accuracy information indicating an accuracy equal to or greater than a predetermined first threshold.
[0033] The function of obtaining accuracy information for each product from the reading result of the wireless communication tag and the function of generating a product identification result from the accuracy information for each product may be included in the reading device 20. In this case, the product identification result acquisition unit 110 acquires the product identification result generated by the reading device 20.
[0034] <Display Processing Unit 120> The display processing unit 120 generates a screen showing the product identification results. Here, the display processing unit 120 determines the display mode of information corresponding to the product based on product accuracy information included in the product identification results.
[0035] As an example, when information about multiple products is included in the product identification result, the display processing unit 120 may determine the display order of the information corresponding to each product according to the accuracy indicated by the accuracy information. For example, the display processing unit 120 sets the display order of the information corresponding to the products in the vertical or horizontal direction of the screen to ascending or descending order of the accuracy of each product indicated by the accuracy information. By controlling the display order of the information on the screen based on the accuracy information of each product, a person viewing the screen can intuitively grasp the likelihood that each product has been erroneously identified based on the display order.
[0036] As another example, the display processing unit 120 may be configured to determine at least one of the display position, display size, and display color of information corresponding to a product based on the accuracy indicated by the accuracy information. For example, when products are classified based on the accuracy indicated by the accuracy information, the display processing unit 120 may determine the display position of the information on the screen according to the classification result. Specifically, the display processing unit 120 arranges information about products belonging to each classification in an area on the screen allocated to that classification. Furthermore, for example, the display processing unit 120 may determine the display size of the information and the display color (shade or hue of the color) of the information according to the accuracy in order to visually represent the degree of accuracy indicated by the accuracy information.
[0037] In addition, the display processing unit 120 may be configured to visually represent the magnitude of the accuracy indicated by the accuracy information by combining two or more controls related to the display order, display position, display size, and display color.
[0038] In this way, by controlling the display mode on the screen, such as the display order, display position, display size, and display color of information corresponding to a product, based on the accuracy information of the product, a person checking the screen can intuitively grasp the likelihood that each product has been incorrectly identified.
[0039] Second Embodiment Fig. 5 is a diagram illustrating a second example of the functional configuration of a display control device according to the present disclosure. The display control device 10 illustrated in this diagram includes a classification unit 112 in addition to the configuration illustrated in Fig. 1.
[0040] The classification unit 112 classifies products read (detected) by a reading device installed in a specific aisle based on the product accuracy indicated by the accuracy information. For example, the classification unit 112 identifies whether the product corresponds to a "confirmed product" or a "candidate product" based on the product accuracy indicated by the accuracy information. Here, a "confirmed product" refers to a product determined to have passed through the aisle (a product confirmed as a product the customer intends to purchase). A "candidate product" refers to a product that has not been confirmed as having passed through the aisle but may have passed through the aisle. For example, the classification unit 112 identifies products whose wireless communication tag reception strength or an arbitrary score obtained from the reception strength is equal to or greater than a predetermined second threshold as "confirmed products." For example, the classification unit 112 classifies products whose wireless communication tag reception strength or an arbitrary score obtained from the reception strength is less than a predetermined second threshold as "candidate products." The second threshold used here is greater than the first threshold used in generating the product identification result described above. In other words, the second threshold value can be said to be a threshold value for further classifying the product identified by the first threshold value in terms of the probability that the product has passed through the aisle.
[0041] Based on the classification results by the classification unit 112, the display processing unit 120 generates a screen containing information corresponding to products identified as "confirmed products" and information corresponding to products identified as "candidate products" in a distinguishable manner, and displays the screen on a specified display.
[0042] <Operation Example> FIG. 6 is a flowchart showing a second example of processing executed by the display control device 10 in the present disclosure.
[0043] First, the product identification result acquisition unit 110 acquires the identification results of products passing through the aisle (step S202). This process is similar to step S102 in the flowchart of FIG.
[0044] The classification unit 112 selects a target product from the products included in the product identification results obtained in the process of step S202 (step S204). Then, the classification unit 112 determines whether the accuracy indicated by the accuracy information linked to the selected product is equal to or greater than a predetermined second threshold (step S206).
[0045] If the certainty indicated by the certainty information of the selected product is equal to or greater than a predetermined threshold value (step S206: YES), the classification unit 112 identifies the product as a "confirmed product" (step S208). For example, the classification unit 112 associates flag information indicating a "confirmed product" with the product and stores it in a storage area such as the memory 1030. On the other hand, if the certainty indicated by the certainty information of the selected product is less than a predetermined threshold value (step S206: NO), the classification unit 112 identifies the product as a "candidate product" (step S210). For example, the classification unit 112 associates flag information indicating a "candidate product" with the product and stores it in a storage area such as the memory 1030.
[0046] If there are any products included in the product identification results that have not yet been selected (step S212: NO), a new target product is selected from the unselected products (step S204). If all products included in the product identification results have been selected (step S212: YES), the display processing unit 120 generates screen data showing the product identification results using the processing results of the classification unit 112 (step S214). Specifically, the display processing unit 120 uses the processing results of the classification unit 112 to generate a screen that includes information about the confirmed product and information about the candidate product in a distinguishable manner. The display processing unit 120 then outputs the screen data generated in the processing of step S212 to a specified display and displays a screen showing the product identification results on the display (step S216).
[0047] FIG. 7 is a diagram showing an example of a screen displayed on the display. In this example, the display processing unit 120 generates a screen including an area A1 for outputting information identified as a confirmed product and an area A2 for outputting information identified as a candidate product. The screen shown in FIG. 7 allows a user to see at a glance whether the information for each product included in the product identification results based on the reading results of the reading device is information for a "confirmed product" or information for a "candidate product." Although not shown, the display processing unit 120 may control the display mode of the information for each product output in area A1 and / or area A2, as described in the first embodiment.
[0048] Here, the accuracy information of a product is based on the reception strength of the response radio waves from the wireless communication tag attached to that product. In this case, there are roughly two cases where a product may be mistakenly identified: (1) When the response radio waves from the wireless communication tag become stronger than usual due to some factor (a case where a product that did not pass through is determined to have passed through) (2) When the response radio waves from the wireless communication tag become weaker than usual due to some factor (a case where a product that passed through the aisle is mistakenly determined not to have passed through)
[0049] In general, case (2) is more likely to occur than case (1). For example, if an object that blocks radio waves (e.g., a product containing a lot of water or metal) is present around the wireless communication tag, the response radio waves from the wireless communication tag may be attenuated, resulting in a decrease in reception strength. From this perspective, it can be said that there is a high possibility that an error will occur in the identification results for the "candidate product." In other words, by displaying a screen that allows the presence of such candidate products to be recognized at a glance, a person viewing the screen can easily determine whether or not the product is likely to have been erroneously identified. If the person then notices an error in the product identification results after viewing the screen, they can take appropriate measures to correct the error.
[0050] <Modification> The display processing unit 120 may be configured to limit information about a product identified as a "candidate product" according to the product's accuracy. For example, the display processing unit 120 may be configured to reduce the amount of information corresponding to the product as the accuracy of the product decreases. As an example, when the accuracy indicated by the accuracy information associated with a product identified as a "candidate product" is below a reference threshold, the display processing unit 120 reduces the types of information output as information corresponding to the product. As a specific example, when outputting the product name and an exterior image of the product as "information corresponding to the product," the display processing unit 120 may control the display so that exterior images of the product are not displayed for candidate products with accuracy below the reference threshold (e.g., FIG. 8). FIG. 8 is a diagram illustrating another example of a screen displayed on the display. In this example, the display mode (display size) of information about the candidate product displayed in area A2 is controlled to a size according to the accuracy. Furthermore, in this example, product photos (exterior images of the product) are not displayed for products (the bottom three products) among the candidate products displayed in area A2 with accuracy below the reference threshold. By reducing the amount of information contained on the screen in this way, it is expected that the visibility of the entire screen will be improved. Furthermore, when product exterior images are not displayed, it is expected that there will be a secondary effect of reducing the amount of processing operations and improving the image display speed.
[0051] As another example, the display processing unit 120 may control the display position of information about a product identified as a candidate product based on the degree of certainty indicated by the degree of certainty information associated with the product, using a predetermined area for displaying information about the product identified as a "confirmed product" as a reference (e.g., FIG. 9 ). FIG. 9 is a diagram illustrating another example of a screen displayed on the display. In the example of FIG. 9 , the display processing unit 120 places information about the product identified as a "confirmed product" within area A3, and places information about the products identified as "candidate products" around area A3. Here, the display processing unit 120 controls the position of the information about the product so that the greater the degree of certainty indicated by the degree of certainty information associated with the product identified as a "candidate product," the closer the information about the product is to area A3. In the example of FIG. 9 , among the products identified as "candidate products," "Product G" and "Product I" are positioned closer to area A3 than "Product H," "Product J," and "Product K." This means that the accuracy indicated by the accuracy information linked to "Product G" and "Product I" is greater than the accuracy indicated by the accuracy information linked to "Product H," "Product J," and "Product K." Such a screen allows the accuracy of each product to be grasped more intuitively.
[0052] In the example of FIG. 9 , the display processing unit 120 generates a screen including an image reproducing a space including at least a predetermined aisle. Specifically, the display processing unit 120 generates a screen showing the product identification results using a schematic image of a predetermined aisle and a reading device installed in the aisle viewed from the side. By using such a screen, a person viewing the screen can more intuitively understand the product identification results. The display processing unit 120 may also be configured to generate a screen (e.g., FIG. 10 ) including an image representing a virtual space (a virtual space that simulates an actual store) including at least a predetermined aisle. FIG. 10 is a diagram showing another example of a screen displayed on the display. The screen illustrated in FIG. 10 also allows a user to more intuitively understand the product identification results.
[0053] Third Embodiment <Functional Configuration Example> Fig. 11 is a diagram illustrating a third example of the functional configuration of the display control device 10 according to the present disclosure. The display control device 10 illustrated in this figure includes a correction unit 130 in addition to the configuration illustrated in Fig. 5 .
[0054] The correction unit 130 corrects the display content of the screen showing the product identification results in response to an input operation on the screen. As an example, the correction unit 130 corrects the identification results of the "confirmed product" and the "candidate product" in response to an input operation on the information displayed on the screen.
[0055] 12 is a flowchart showing a third example of processing executed by the display control device 10 according to the present disclosure. The flowchart in this figure shows the flow of processing for correcting the display content of a screen showing the product identification results.
[0056] First, the correction unit 130 accepts an input operation on the screen displayed on a predetermined display by the display processing unit 120 (step S302). The correction unit 130 accepts at least one of a first operation for correcting at least one product identified as a "candidate product" to a "confirmed product" and a second operation for correcting at least one product identified as a "confirmed product" to a "candidate product."
[0057] For example, if the display has a touch panel function, the correction unit 130 accepts input operations (such as a touch operation or a flick operation) using the touch panel function as the first operation and the second operation described above. Specific examples of operations performed on the screen are shown in FIGS. 13 and 14 . FIG. 13 is a diagram showing an example of a first operation performed on the screen. FIG. 14 is a diagram showing an example of a second operation performed on the screen. FIG. 13 illustrates an example of a flick operation for moving information corresponding to one of the products identified as "candidate products" (product I) into area A3 displaying information corresponding to the products identified as "candidate products." FIG. 14 illustrates an example of a flick operation for moving information corresponding to one of the products identified as "candidate products" (product A) out of area A3 displaying information corresponding to the products identified as "candidate products."
[0058] The correction unit 130 corrects the display content of the screen in accordance with the input operation received in step S302 (step S304). For example, when an input operation such as that illustrated in Fig. 13 is received, the correction unit 130 moves information about "Product I," which is the target of the input operation, to area A3 as information about a product identified as a "confirmed product." Furthermore, when an input operation such as that illustrated in Fig. 14 is received, the correction unit 130 moves information about "Product A," which is the target of the input operation, outside area A3 as information about a product identified as a "candidate product."
[0059] As described above, the example of the display control device 10 according to the present disclosure has a function for correcting an error in the product identification result in response to a correction operation performed by a person checking the screen. This function can avoid problems that arise when the payment process is completed with the product identification result in an incorrect state.
[0060] In addition, a device (e.g., a payment device or a portable communication device carried by a customer) equipped with a display that displays a screen showing the product identification results may be equipped with a functional processing unit (program module) equivalent to the correction unit 130 instead of the display control device 10.
[0061] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.
[0062] In addition, although the flowcharts used in the above description show a sequence of steps (processes), the order of steps executed in each embodiment is not limited to the sequence shown in the flowcharts. In each embodiment, the order of steps shown in the diagrams can be changed as long as it does not cause any problems in terms of the content.
[0063] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes. 1. A display control device comprising: a product identification result acquisition means for acquiring product identification results for products passing through an aisle, the product identification results including identification information that identifies the product and accuracy information that indicates the accuracy that the product has passed through the aisle; and a display processing means for displaying a screen showing the product identification results on a display, the display processing means controlling the display mode of information corresponding to the product according to the accuracy of the product indicated by the accuracy information. 2. The display control device described in 1., wherein, when multiple product identification results have been acquired, the display mode includes a display order of information corresponding to each of the multiple products. 3. The display control device described in 1. or 2., wherein the display mode includes at least one of a display position, a display size, and a display color of the information corresponding to the product. 4. The display control device according to any one of 1. to 3., wherein the product identification result acquisition means identifies whether the product corresponds to a confirmed product, which is a product confirmed to have passed through the aisle, or a candidate product, which is a product that may have passed through the aisle, based on the certainty of the product indicated by the certainty information, and the display processing means causes the display to display the screen including information corresponding to the product identified as the confirmed product and information corresponding to the product identified as the candidate product in a distinguishable state. 5. The display control device according to 4., wherein the display processing means limits information displayed about the product identified as the candidate product in accordance with the certainty related to the product. 6. The display control device according to 5., wherein the display processing means limits display of product images of products identified as the candidate products whose certainty is less than a predetermined threshold, among the products identified as the candidate products. 7. The display processing means controls the display position of information about the product identified as the candidate product relative to an area displaying information about the product identified as the confirmed product, based on the certainty of each product identified as the candidate product. 10. The display control device according to claim 9, wherein:8. The display control device according to any one of 4. to 7., further comprising a correction means for correcting the identification results of the confirmed products and the candidate products in response to an input operation on the information displayed on the screen. 9. The display control device according to 8., wherein the input operation includes at least one of an operation for correcting at least one of the candidate products to the confirmed product and an operation for correcting at least one of the confirmed products to the candidate products. 10. The display control device according to any one of 1. to 9., wherein the screen includes an image that reproduces a space that includes at least the passage. 11. A display control method, wherein at least one computer acquires an identification result of a product passing through a passage, the product identification result including identification information that identifies the product and accuracy information that indicates the accuracy that the product has passed through the passage, and displays a screen showing the identification result of the product on a display, wherein displaying the screen on a display includes controlling the display mode of information corresponding to the product in response to the accuracy of the product indicated by the accuracy information. 12. A non-transitory computer-readable recording medium that records a program for causing at least one computer to execute an operation including: acquiring a product identification result for a product passing through an aisle, the product identification result including identification information that identifies the product and accuracy information that indicates the accuracy that the product has passed through the aisle; and displaying a screen showing the product identification result on a display, wherein displaying the screen on a display includes controlling the display mode of information corresponding to the product in accordance with the accuracy of the product indicated by the accuracy information.
[0064] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 10 that are subordinate to Supplementary Note 1 (display control device) may also be subordinate to Supplementary Note 11 (display control method) and Supplementary Note 12 (non-transitory computer-readable recording medium) in the same subordinate relationship as Supplementary Note 2 to 10. Furthermore, not limited to Supplementary Note 1, Supplementary Note 11, and Supplementary Note 12, some or all of the configurations described as Supplements may be subordinate to various hardware, software, various recording means for recording software, or systems, as long as they do not deviate from the above-described embodiments.
[0065] REFERENCE SIGNS LIST 10 Display control device 1000 Computer 1010 Bus 1020 Processor 1030 Memory 1040 Storage device 1050 Input / output interface 1060 Network interface 110 Product identification result acquisition unit 112 Classification unit 120 Display processing unit 130 Correction unit 20 Reading device 90 Passage
Claims
1. A display control device comprising: a product identification result acquisition means for acquiring product identification results for a product passing through an aisle, the product identification results including identification information for identifying the product and accuracy information indicating the accuracy of the product having passed through the aisle; and a display processing means for displaying a screen indicating the product identification results on a display, wherein the display processing means controls the display mode of information corresponding to the product depending on the accuracy of the product indicated by the accuracy information.
2. The display control device according to claim 1, wherein, when a plurality of product identification results are obtained, the display manner includes a display order of information corresponding to each of the plurality of products.
3. The display control device according to claim 1 or 2, wherein the display mode includes at least one of a display position, a display size, and a display color of the information corresponding to the product.
4. A display control device as described in any one of claims 1 to 3, wherein the product identification result acquisition means identifies whether the product corresponds to a confirmed product, which is a product that is confirmed to have passed through the aisle, or a candidate product, which is a product that may have passed through the aisle, based on the certainty of the product indicated by the certainty information, and the display processing means displays on the display the screen including information corresponding to the product identified as the confirmed product and information corresponding to the product identified as the candidate product in a distinguishable state.
5. The display control device according to claim 4, wherein the display processing means limits information displayed about a product identified as the candidate product in accordance with the degree of certainty regarding the product.
6. The display control device according to claim 5, wherein the display processing means restricts display of product images of products identified as the candidate products whose certainty is less than a predetermined threshold value.
7. A display control device as described in any one of claims 4 to 6, wherein the display processing means controls the display position of information about the products identified as the candidate products relative to an area displaying information about the products identified as the confirmed products, based on the certainty of each product identified as the candidate product.
8. A display control device according to any one of claims 4 to 7, further comprising a correction means for correcting the identified results of the confirmed product and the candidate product in response to an input operation on the information displayed on the screen.
9. The display control device according to claim 8, wherein the input operation includes at least one of an operation of correcting at least one of the candidate products to the determined product and an operation of correcting at least one of the determined products to the candidate product.
10. A display control device according to any one of claims 1 to 9, wherein the screen includes an image reproducing a space including at least the passageway.
11. A display control method, comprising: at least one computer acquiring a product identification result of a product passing through an aisle, the product identification result including identification information for identifying the product and accuracy information indicating the accuracy that the product has passed through the aisle; and displaying a screen indicating the product identification result on a display; wherein displaying the screen on a display includes controlling a display mode of information corresponding to the product in accordance with the accuracy of the product indicated by the accuracy information.
12. A non-transitory computer-readable recording medium recording thereon a program for causing at least one computer to execute an operation including: acquiring a product identification result for a product passing through an aisle, the product identification result including identification information for identifying the product and accuracy information indicating the accuracy that the product has passed through the aisle; and displaying a screen indicating the product identification result on a display, wherein displaying the screen on a display includes controlling the display manner of information corresponding to the product in accordance with the accuracy of the product indicated by the accuracy information.
Citation Information
Patent Citations
Device monitoring system
JP2014126999A
Settlement system and settlement method
JP2021056999A