Information processing terminals and information processing programs

Abstract

We provide technology that allows for the visualization of scan results. [Solution] The information processing terminal comprises a location information processing unit, a scan information processing unit, and a display processing unit. The location information processing unit acquires the user's location information. The scan information processing unit acquires scan information related to scanning by a reader device. The display processing unit displays objects on the camera image to visualize the scan results based on the user's location information and the scan information.

Description

Technical Field

[0001] Embodiments of the present invention relate to an information processing terminal and an information processing program.

Background Art

[0002] Conventionally, in a store or the like, there is a system for performing inventory management of articles using wireless tags attached to the articles. In such a system, an inventory-taking operation is performed by scanning the wireless tags with a portable RFID (Radio Frequency Identification) reader. The inventory-taking operation includes, for example, an operation of checking how many articles are arranged on the shelves where the articles are placed. In the inventory-taking operation using wireless tags, it is difficult to visually confirm up to which position on the shelf the scanning has actually been performed. For example, when the inventory-taking operation is interrupted for some reason, at the time of resuming the operation, it is not known up to which position the scanning has been performed, and there is a possibility of duplicating the scanned area or skipping the un-scanned area.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The problem to be solved by the embodiments of the present invention is to provide a technique capable of visualizing a scanning result.

Means for Solving the Problems

[0005] In one embodiment, the information processing terminal comprises a location information processing unit, a scan information processing unit, and a display processing unit. The location information processing unit acquires the user's location information. The scan information processing unit acquires scan information related to scanning by a reader device. The display processing unit displays objects on the camera image to visualize the scan results based on the user's location information and the scan information. [Brief explanation of the drawing]

[0006] [Figure 1] Figure 1 is a block diagram illustrating a schematic example of the configuration of an information processing system according to an embodiment. [Figure 2] Figure 2 is an external view showing an example of the external configuration of a wireless tag communication device according to an embodiment. [Figure 3] Figure 3 is a schematic block diagram showing a first configuration example of the control system in a wireless tag communication device according to the embodiment. [Figure 4] Figure 4 is a schematic block diagram showing a second example of the configuration of the control system in the wireless tag communication device according to the embodiment. [Figure 5] Figure 5 is a diagram illustrating the data structure of scan information according to the embodiment. [Figure 6] Figure 6 is a schematic diagram showing an example of an object display image displayed in a wireless tag communication device according to an embodiment. [Figure 7] Figure 7 is a flowchart illustrating an example of the operation of a wireless tag communication device according to an embodiment. [Figure 8] Figure 8 is a sequence diagram illustrating another example of the operation of a wireless tag communication device according to an embodiment. [Figure 9] Figure 9 is a sequence diagram illustrating yet another example of the operation of a wireless tag communication device according to an embodiment. [Modes for carrying out the invention]

[0007] The embodiments will be described below with reference to the drawings. Note that the scale of the parts in the drawings used in the description of the embodiments may have been changed as appropriate. Also, for illustrative purposes, some components may be omitted from the drawings used in the description of the embodiments.

[0008] [Embodiment] (Example configuration) Figure 1 is a block diagram illustrating a schematic example of the configuration of the information processing system S. Information processing system S is a system for managing inventory of goods in a store. The store is assumed to be a physical store. Goods include, but are not limited to, tangible items such as clothing and food and beverages. The store may be a store that primarily sells tangible goods, or a store that primarily sells services. For example, a store that primarily sells tangible goods is a supermarket or a home improvement store, etc., but is not limited to these. For example, a store that primarily provides services is a restaurant or a gym, etc., but is not limited to these.

[0009] A transaction involving goods is the exchange of fees between the customer and the store in connection with the sale of goods by the store. From the store's perspective, the transaction includes the meaning of selling goods. From the customer's perspective, the transaction includes the meaning of purchasing goods.

[0010] The information processing system S includes a wireless tag communication device 1 and a server 2. The wireless tag communication device 1 and the server 2 are connected to each other via a network NW so that they can communicate with each other. The network NW includes one or more networks from among various networks such as the Internet, mobile communication networks, and LANs (Local Area Networks). The LAN may be a wireless LAN or a wired LAN. The information processing system S may also refer to a system that includes at least one electronic device.

[0011] The wireless tag communication device 1 includes a reader device (base device) 10 and an information processing terminal 13 as a user interface. The information processing system S may include multiple wireless tag communication devices 1.

[0012] The wireless tag communication device 1 is a device that communicates with RFID tags (wireless tags). The wireless tag communication device 1 is a wireless tag reader that reads tag information recorded on RFID tags by communicating with them. RFID tags are attached to items such as goods or parts. RFID tags record tag information, which includes information that identifies the attached item, in their internal memory. The tag information includes tag identification information. The configuration of the wireless tag communication device 1 will be described later.

[0013] Server 2 is an electronic device that manages inventory information. For example, Server 2 manages inventory information for products in store X. The inventory information includes scan information related to scanning by the wireless tag communication device 1. Scanning includes the irradiation of radio waves and the reading of RFID tags. The scan information is information indicating the scan results by the wireless tag communication device 1. The scan results include information regarding the reading of RFID tags by the wireless tag communication device 1. The information regarding the reading of RFID tags includes tag information recorded on the RFID tags. The information regarding the reading of RFID tags may also include information indicating the number of RFID tags read. The scan results include information regarding radio waves from the wireless tag communication device 1. The information regarding radio waves includes information indicating the intensity of the radio waves and the duration of the radio wave irradiation. The scan results are, for example, labels. The labels are numerical values ​​indicating the scan results. The labels may, for example, be numerical values ​​indicating the number of RFID tags read by the wireless tag communication device 1. The labels may also be numerical values ​​indicating the intensity of the radio waves from the wireless tag communication device 1. The labels may also be numerical values ​​indicating the duration of the radio wave irradiation from the wireless tag communication device 1. The label is a numerical value based on at least one of the number of readings, radio wave intensity, and radio wave exposure time. The label may also be a numerical value based on a combination of the number of readings, radio wave intensity, and radio wave exposure time. Furthermore, the scan results may include information indicating the scan area.

[0014] The scan information includes position information. The position information is, for example, information on the coordinates of the wireless tag communication device 1. The coordinates include, for example, X coordinates, Y coordinates, and Z coordinates. The scan information may include time information indicating the time when the RFID tag was read by the wireless tag communication device 1. The time when the RFID tag was read may be the time when the wireless tag communication device 1 irradiated radio waves. The time when the radio waves were irradiated indicates, for example, the time when the scan was performed. The time when the scan was performed is also referred to as the scan time. The server 2 manages the scan information of a plurality of wireless tag communication devices 1 in store X.

[0015] The server 2 stores the user information of the customers in store X. The user information includes the point information of the customers. The point information is an aggregate of point records generated for each user. The point record includes, for example, a user ID and data of service points. The user ID is, for example, information that can uniquely identify a customer as a point service member. The user ID may be information indicated by a membership code. The user ID is an example of user identification information. The service point is, for example, a privilege given to a user based on the settlement of a transaction. The service point can be acquired, subtracted, or lost according to the actions or activities of the user. The service point indicates the number of service points owned by the user. The service point is also simply referred to as a point.

[0016] The server 2 may be a cloud server. The server 2 may manage the inventory information of a plurality of stores. The server 2 is an example of an information processing device.

[0017] The configuration of the wireless tag communication device 1 will be described. FIG. 2 is a diagram showing an example of the external configuration of the wireless tag communication device 1 according to the embodiment. The wireless tag communication device 1 shown in FIG. 2 is a handy-type device that is operated in a state held by an operator. The wireless tag communication device 1 shown in FIG. 2 is operated, for example, as a search device for searching for an RFID tag or an article with an RFID tag attached.

[0018] The wireless tag communication device 1 reads tag information and the like recorded in the RFID tag by communicating with the RFID tag.

[0019] The RFID tag is a wireless communication device that operates by radio waves (output signals) from the wireless tag communication device 1. The RFID tag has a processor, a memory, a communication circuit, an antenna, and the like. The RFID tag outputs a response signal including tag information recorded in its own memory in response to a read command from the wireless tag communication device 1. For example, the RFID tag is attached to an article such as a product or a part. The RFID tag attached to the article has tag information including information for identifying the article recorded in the internal memory.

[0020] The wireless tag communication device 1 according to the embodiment is operated by an operator. The wireless tag communication device 1 is a device that communicates with the RFID tag while moving. For example, the wireless tag communication device 1 is a handy-type device that is operated while being held and moved by an operator. Also, the wireless tag communication device 1 may be mounted on a moving body operated by an operator. The operator is an example of a user of the wireless tag communication device 1.

[0021] The wireless tag communication device 1 according to the embodiment reads the RFID tag attached to the article while changing its position and orientation by the operation of the operator.

[0022] The wireless tag communication device 1 reads the tag information recorded in the RFID tag by receiving a response signal from the RFID tag existing in the reading area (scanning area). Further, the wireless tag communication device 1 also acquires information such as an RSSI (Received Signal Strength Indicatior) value and a phase value from the response (received) signal from the RFID tag. The wireless tag communication device 1 may store the tag information, the RSSI value, and the phase value obtained from the received signal in the memory as a reading result together with information such as the position and orientation of its own device.

[0023] In the configuration example shown in Figure 2, the wireless tag communication device 1 consists of a reader device 10 and an information processing terminal 13. Alternatively, the reader device 10 may be provided as the wireless tag communication device 1. In this case, the wireless tag communication device 1 as the reader device 10 is operated with the information processing terminal 13, which is an external device, set as the user interface.

[0024] The reader device 10 comprises a housing on which an RFID tag interface having an antenna and a communication control circuit is installed. In the reader device 10, the antenna is positioned so that its directivity is strongest in the direction of arrow a shown in Figure 2. Here, the direction of arrow a is assumed to be the front (forward) direction of the wireless tag communication device 1. Also, the front direction of the wireless tag communication device 1 is assumed to be the direction of the antenna.

[0025] The reader device 10 has a gripping section 11 and a holding section 12, in addition to the control system configuration described later. The gripping section 11 is the part that the operator grips. The holding section 12 is made up of a jig that holds the information processing terminal 13. The holding section 12 holds the information processing terminal 13 so that the display screen of the display unit 14 of the information processing terminal 13 faces the operator who is gripping the gripping section 11. The wireless tag communication device 1 is operated by the operator gripping the gripping section 11 while the information processing terminal 13 is set in the holding section 12.

[0026] The information processing terminal 13 has a display unit 14 and an input unit 15. The display unit 14 and the input unit 15 are, for example, display devices with touch panels. When the information processing terminal 13 is set in the holding unit 12 of the reader device 10, the screen displayed on the display unit 14 can be viewed by the operator. The display unit 14 is an example of a display unit. Also, when the information processing terminal 13 is set in the holding unit 12 of the reader device 10, operation instructions from the operator are input to the input unit 15.

[0027] The wireless tag communication device 1 continuously reads RFID tags while being operated by an operator. For example, the operator changes the position of the wireless tag communication device 1 (the position of the device itself) by moving while holding the gripping part 11. While estimating its own position, the wireless tag communication device 1 repeatedly reads RFID tags within a reading area determined by the direction of the antenna and the magnitude of the radio waves emitted from the antenna.

[0028] The wireless tag communication device 1 estimates its own position (self-position) using self-estimation technology. For example, the wireless tag communication device 1 estimates its own position based on images captured by a camera using a self-position estimation method used in AR (augmented reality) technology. However, the method and configuration used by the wireless tag communication device 1 to estimate its own position are not limited to any specific one, as long as the self-position can be estimated even indoors.

[0029] The configuration of the control system in the wireless tag communication device 1 according to this embodiment will be described. Figure 3 is a schematic block diagram showing a first configuration example of the control system in the wireless tag communication device 1 according to the embodiment. In the configuration example shown in Figure 3, the reader device 10, which functions as a wireless tag communication device 1, is connected to an information processing terminal 13, which functions as an external device. The reader device 10, which functions as a wireless tag communication device 1, includes a processor 21, memory 22, wireless tag communication unit 23, and interface (I / F) 26.

[0030] The processor 21 controls each component. The processor 21 includes, for example, an arithmetic circuit such as a CPU (Central Processing Unit). The processor 21 controls each component and performs various data processing by executing a program. The processor 21 may also have internal memory. The processor 21 performs various processes by executing a program stored in memory 22, etc. For example, the arithmetic circuit may be a CPU, GPU (Graphics Processing Unit), ASIC (Application Specific Integrated Circuit), or FPGA (Field-Programmable Gate Array), but is not limited to these. The processor 21 is an example of a processing circuit including an arithmetic circuit.

[0031] Memory 22 includes various types of memory. For example, memory 22 includes ROM (Read Only Memory), RAM (Random Access Memory), NVM (Non-Volatile Memory), etc. ROM is a non-volatile memory that cannot be rewritten. ROM stores programs executed by the processor 21. RAM is a volatile memory that temporarily stores data. RAM operates as working memory or buffer memory. NVM is a rewritable non-volatile memory. NVM stores information such as control information, configuration information, and processing results. The NVM in memory 22 stores various programs for the processor 21 to execute the processes described later.

[0032] The wireless tag communication unit 23 is a communicator that constitutes an RFID interface for communicating with RFID tags. The wireless tag communication unit 23 is a communicator that has a communication control circuit and an antenna. However, the wireless tag communication unit 23 may also be configured with a connection interface that connects to an external antenna.

[0033] In the wireless tag communication unit 23, the communication control circuit includes a control circuit for communicating with the RFID tag via the antenna. The communication control circuit causes the antenna to emit a transmission signal (radio wave) supplied from the processor 21 at a set output value. The antenna outputs the transmission signal supplied from the communication control circuit as a radio wave that the RFID tag can receive. The wireless tag communication unit 23 sets the range (reading area) in which the RFID tag can respond based on the direction of the antenna and the output value of the radio wave output from the antenna.

[0034] Furthermore, in the wireless tag communication unit 23, the communication control circuit not only outputs a transmission signal to the antenna, but also supplies the signal received by the antenna to the processor 21 as received data. The communication control circuit receives a response signal from the RFID tag, processes the response signal (received signal) received by the antenna, and supplies it to the processor 21. For example, the communication control circuit supplies the processor 21 with tag information contained in the received signal from the RFID tag, as well as the RSSI value and phase value indicating the strength of the received signal.

[0035] Interface 26 only needs to be compatible with the interface 33 provided by the information processing terminal 13. For example, interface 26 may be connected by physical contact to an interface provided by the information processing terminal 13, such as a USB (Universal Serial Bus) interface or a LAN interface. Alternatively, interface 26 may be connected wirelessly, such as by a Bluetooth® interface or a Wi-Fi® interface.

[0036] The reader device 10, which functions as the wireless tag communication device 1, has a power supply that provides power for operation. In the case of a handheld wireless tag communication device 1, for example, a rechargeable battery (secondary battery) is provided as the power source. The battery supplies power to each part of the wireless tag communication device 1 to operate it.

[0037] In the configuration example shown in Figure 3, the information processing terminal 13 is set in the holding unit 12 of the reader device 10, which is the wireless tag communication device 1. The information processing terminal 13 can be any device equipped with a display 14 and an input device 15, etc., that communicates with the reader device 10, which is the wireless tag communication device 1. The information processing terminal 13 is, for example, a portable information processing terminal such as a smartphone or a tablet PC (Personal Computer).

[0038] As shown in Figure 3, the information processing terminal 13 includes a processor 31, memory 32, interface (I / F) 33, sensor 34, camera 35, display 14, and input 15, etc. The processor 31 controls each part and performs data processing, etc. The processor 31 is, for example, a CPU. The processor 31 performs various operations by executing programs stored in the memory 32. The processor 31 is an example of a processing circuit that includes an arithmetic circuit.

[0039] Memory 32 stores scan information. Scan information is information indicating the scan results by the wireless tag communication device 1. Scan information may include location information, label, and time information.

[0040] Memory 32 stores object data. Object data is data for displaying objects. An object is, for example, an object for visualizing the scan results by the wireless tag communication device 1. An object is, for example, a virtual object. The scan results by the wireless tag communication device 1 are an example of the scan results by the reader device 10. An object indicates, for example, the area scanned by the wireless tag communication device 1. The scanned area is also called the scan area. The scan area corresponds to the reading area of ​​the wireless tag communication device 1. The scan area is set, for example, by the distance between the position (self-position) of the wireless tag communication device 1 and the RFID tag (shelf), the direction of the antenna, and the output value of the radio waves. An object may have any shape. An object may be, for example, a shape that surrounds the scan area. An object may be a shape that surrounds the products placed on the shelf included in the scan area. Object data may include data that indicates multiple objects associated with scan information. For example, object data may include data that indicates multiple objects associated with the label value. Object data may include data that indicates different objects depending on the label value. For example, object data may include data that represents different objects associated with a label value. These different objects may include objects with different display modes. Display modes may include size, shape, color, density, brightness, luminance, pattern, or flashing display. Note that object data may also simply be referred to as "objects."

[0041] Interface 33 is an interface (second communication interface) for communicating with interface 26. Interface 33 can be any interface that corresponds to interface 26. For example, interface 33 can be a LAN, USB, Bluetooth, or Wi-Fi interface.

[0042] The sensor (sensor group) 34 includes sensors that detect the movement of the information processing terminal 13. For example, sensor 34 is an IMU (Inertial Measurement Unit). Sensor 34 may also include an acceleration sensor, a gyroscope, or a geomagnetic (compass) sensor. Sensor 34 may be configured to include multiple types of sensors. Sensor 34 may also include a position detection sensor for detecting position. In this case, sensor 34 is an example of a position detection sensor. Note that some or all of the sensors as sensor 34 as described above may be provided in the reader device 10.

[0043] Camera 35 takes an image. When the information processing terminal 13 is set on the reader device 10, the camera 35 changes its shooting direction according to the orientation of the reader device 10. For example, the shooting direction of camera 35 may be set to match the orientation of the antenna of the wireless tag communication unit 23 provided on the reader device 10.

[0044] The images captured by camera 35 are used to estimate the position (position of the device itself) of the information processing terminal 13 (the wireless tag communication device 1 consisting of a reader device 10 on which the information processing terminal 13 is set). Camera 35 is an example of a position detection sensor. For example, the processor 31 of the information processing terminal 13 estimates its own position (position of the device itself) based on the images captured by camera 35 using a self-position estimation method used in AR (augmented reality) technology.

[0045] The communication interface 36 includes various interfaces that enable the information processing terminal 13 to communicate with other electronic devices via a network NW, according to a predetermined communication protocol. For example, the information processing terminal 13 communicates with the server 2 via the communication interface 36. The communication interface 36 may be an interface for wired communication or an interface for wireless communication.

[0046] The display unit 14 and input unit 15 of the information processing terminal 13 are connected to the processor 21 via an internal interface. The display unit 14 is a device that displays information. For example, the display unit 14 displays a display screen instructed by the processor 21. The input unit 15 is a device for the operator to input operation instructions, etc. The input unit 15 supplies information indicating the content of the instructions given by the operator to the processor 21.

[0047] The hardware configuration of the wireless tag communication device 1 is not limited to the configuration described above. The wireless tag communication device 1 allows for the omission and modification of the above-described components, as well as the addition of new components, as appropriate.

[0048] The various components implemented in the aforementioned processor 31 will now be described.

[0049] The processor 31 implements a location information processing unit 310, a scan information processing unit 311, a display processing unit 312, and a communication processing unit 313. Each part implemented in the processor 31 can also be described as a function. Each part implemented in the processor 31 can also be described as being implemented in the control unit, which includes the processor 21 and the memory 32.

[0050] The location information processing unit 310 performs location estimation processing to estimate the location of the wireless tag communication device 1. The location information processing unit 310 estimates the location of the wireless tag communication device 1 using self-estimation techniques. The location of the wireless tag communication device 1 may be interpreted as the location of the information processing terminal 13. The location of the wireless tag communication device 1 is an example of the user's location. The location information processing unit 310 estimates the location of the wireless tag communication device 1 using a self-position estimation method used in AR technology, for example, based on a camera image captured by the camera 35. The location information processing unit 310 may also estimate the location of the wireless tag communication device 1 using a self-position estimation method based on sensor data acquired by the sensor 34. The sensor data includes, for example, acceleration data and angular velocity data. The location information processing unit 310 may also estimate the location of the wireless tag communication device 1 based on the camera image and sensor data. Based on the location estimation processing, the location information processing unit 310 acquires location information of the wireless tag communication device 1 indicating its location. The location information is coordinate information, for example, indicated by X coordinates, Y coordinates, and Z coordinates. The location information of the wireless tag communication device 1 is an example of user location information.

[0051] The scan information processing unit 311 acquires scan information related to the scan performed by the reader device 10. The scan information processing unit 311 acquires scan information from the reader device 10 via the interface 33. The scan information processing unit 311 stores the scan information in the memory 32.

[0052] The display processing unit 312 displays objects on the camera image based on the user's location information and scan information. The display processing unit 312 displays an image on the display 14 in which objects are superimposed or combined on the camera image using AR technology. The display processing unit 312 may, for example, perform spatial recognition based on the camera image using AR technology. The display processing unit 312 may superimpose or combine objects on the camera image according to the recognized space. The display processing unit 312 displays objects in the scanned area of ​​the camera image based on the scan information. The display processing unit 312 may, for example, display objects so as to surround the scanned area. The display processing unit 312 may, for example, display objects so as to fill in the scanned area.

[0053] The display processing unit 312 may display different objects on the display unit 14 according to the scan information. The display processing unit 312 may display different objects on the display unit 14 according to the label value. For example, the display processing unit 312 may display different objects according to the number of tags read by the reader device 10. The display processing unit 312 may change the size of the objects according to the number of reads. For example, the display processing unit 312 may display larger objects when the number of reads is large. The display processing unit 312 may change the color density of the objects according to the number of reads. The display processing unit 312 may display objects with a higher density when the number of reads is large. The display processing unit 312 may decrease the size of the objects as the number of reads decreases. The display processing unit 312 may decrease the density of the objects as the number of reads decreases. The display processing unit 312 may change the size of the objects based on the number of reads exceeding a predetermined value. The display processing unit 312 may change the density of the objects based on the number of reads exceeding a predetermined value. The display processing unit 312 may change the shape of the object according to the number of reads.

[0054] The display processing unit 312 may display different objects depending on the duration of radio wave irradiation by the reader device 10. The display processing unit 312 may change the size of the objects depending on the duration of radio wave irradiation. For example, the display processing unit 312 may display larger objects when the radio wave irradiation time is long. The display processing unit 312 may change the color density of the objects depending on the duration of radio wave irradiation. The display processing unit 312 may display objects with a higher density of color when the radio wave irradiation time is long. The display processing unit 312 may decrease the size of the objects as the radio wave irradiation time decreases. The display processing unit 312 may decrease the density of the objects as the radio wave irradiation time decreases. The display processing unit 312 may change the size of the objects based on the duration of radio wave irradiation exceeding a predetermined value. The display processing unit 312 may change the density of the objects based on the duration of radio wave irradiation exceeding a predetermined value. The display processing unit 312 may change the shape of the objects depending on the duration of radio wave irradiation.

[0055] The display processing unit 312 may similarly display different objects depending on the intensity of the radio waves from the reader device 10.

[0056] The display processing unit 312 may change the display mode of objects based on time information. For example, the display processing unit 312 may display different objects depending on the elapsed time since the scan time. The display processing unit 312 may hide objects when a predetermined amount of time has elapsed since the scan time. Hiding objects includes removing their display. For example, the display processing unit 312 may display smaller objects the longer the elapsed time since the scan time. The display processing unit 312 may display objects with lower color density the longer the elapsed time since the scan time.

[0057] The display processing unit 312 may display objects based on scan history information on the camera image. Scan history information indicates the history of past scan information. For example, the scan history information indicates the history of scan information for a predetermined time period from the current time. The scan history information for a predetermined time period from the current time is scan information from a predetermined time prior to the current time to the current time. For example, the scan history information for a predetermined time period from the current time is scan information from a time 5 hours prior to the current time to the current time. In this case, the scan history information includes scan information of scans performed from 5 hours prior to the current time. The scan history information may also include scan information from other wireless tag communication devices 1. The scan history information may also include scan information from multiple wireless tag communication devices 1. Based on the scan history information, the display processing unit 312 may superimpose or combine objects indicating scan results scanned by other wireless tag communication devices 1 onto the camera image and display the resulting image on the display unit 14. The display processing unit 312 may superimpose or combine objects indicating scan results scanned by multiple wireless tag communication devices 1 onto the camera image and display the resulting image on the display unit 14.

[0058] The communication processing unit 313 outputs data to the server 2 via the communication interface 36. For example, the communication processing unit 313 outputs scan information to the server 2. The communication processing unit 313 retrieves data from the server 2 via the communication interface 36. For example, the communication processing unit 313 retrieves scan history information about past scans from the server 2. The communication processing unit 313 may also output a scan history request command to the server 2 to request scan history information. The communication processing unit 313 may retrieve scan history information as a response to the scan history request command.

[0059] Figure 4 is a schematic block diagram showing a second configuration example of the control system in the wireless tag communication device 1 according to the embodiment. The wireless tag communication device 1 may have the configuration shown in Figure 4 instead of the wireless tag communication device 1 shown in Figure 3. In the configuration example shown in Figure 4, the wireless tag communication device 1 includes a processor 41, memory 42, wireless tag communication unit 43, sensor 44, communication interface (I / F) 45, camera 46, display 14, and input 15.

[0060] The processor 41 controls each component. The processor 41 includes, for example, an arithmetic circuit such as a CPU. The processor 41 performs control of each component and various data processing by executing programs. The processor 41 may also be equipped with internal memory. The processor 41 performs various processes by executing programs stored in memory 42 or the like.

[0061] Processor 41 performs the same functions as processor 31. Processor 41 can perform the same functions as the position information processing unit 310, scan information processing unit 311, display processing unit 312, and communication processing unit 313. Processor 41 is an example of a processing circuit including an arithmetic circuit.

[0062] Memory 42 includes various types of memory. For example, memory 42 includes ROM, RAM, NVM, and other types of memory. ROM is a non-volatile memory that cannot be rewritten. ROM stores programs executed by the processor 21. RAM is a volatile memory that temporarily stores data. RAM operates as working memory or buffer memory.

[0063] The NVM of memory 42 is a rewritable, non-volatile memory. Memory 42 stores control information, configuration information, and processing results in the NVM. Memory 42 also stores various programs in the NVM for the processor 41 to execute the processes described later. For example, memory 42 stores an operation support program in the NVM that outputs information to assist the operator in operating the chassis. Memory 42 also stores evaluation criteria values ​​in the NVM for the operation support program to evaluate the operation of the chassis.

[0064] Memory 42 stores scan information, similar to memory 32. Memory 42 also stores object data, similar to memory 32.

[0065] The wireless tag communication unit 43 is a communicator that constitutes an RFID interface for communicating with RFID tags. The wireless tag communication unit 43 is, for example, a communicator having a communication control circuit and an antenna. However, the wireless tag communication unit 43 may also be configured by a connection interface that connects to an external antenna.

[0066] In the wireless tag communication unit 43, the communication control circuit includes a control circuit for communicating with the RFID tag via the antenna. The communication control circuit causes the antenna to emit a transmission signal (radio wave) supplied from the processor 41 at a set output value. The antenna outputs the transmission signal supplied from the communication control circuit as a radio wave that the RFID tag can receive. The wireless tag communication unit 43 sets the range (reading area) in which the RFID tag can respond based on the orientation of the antenna and the output value of the radio wave output from the antenna.

[0067] Furthermore, in the wireless tag communication unit 43, the communication control circuit not only outputs a transmission signal to the antenna, but also supplies the signal received by the antenna to the processor 41 as received data. The communication control circuit receives a response signal from the RFID tag, processes the response signal (received signal) received by the antenna, and supplies it to the processor 41. For example, the communication control circuit supplies the processor 41 with tag information contained in the received signal from the RFID tag, as well as the RSSI value and phase value indicating the strength of the received signal.

[0068] Sensor (sensor group) 44 includes sensors similar to those in sensor (sensor group) 34.

[0069] The communication interface 45 includes various interfaces that enable the wireless tag communication device 1 to communicate with other electronic devices via a network NW according to a predetermined communication protocol. For example, the information processing terminal 13 communicates with the server 2 via the communication interface 45. The communication interface 45 may be an interface for wired communication or an interface for wireless communication.

[0070] Camera 46 takes images. The camera 46 changes its shooting direction according to the orientation of the wireless tag communication device 1. For example, the shooting direction of camera 46 may be set to match the orientation of the antenna of the wireless tag communication unit 43. The images taken by camera 46 are used to estimate the position of the wireless tag communication device 1 (the position of the device itself). Camera 46 is an example of a position detection sensor. For example, the wireless tag communication device 1 estimates its own position (the position of the device itself) based on the images taken by camera 46 using a self-position estimation method used in AR (augmented reality) technology.

[0071] The wireless tag communication device 1 has a power supply to provide power for operation. In the case of a handheld type wireless tag communication device 1, for example, a rechargeable battery (secondary battery) is provided as the power source. The battery supplies power to each part of the wireless tag communication device 1 to operate it. Furthermore, the wireless tag communication device 1 may be configured such that the camera is replaced with a device for determining the location of the device itself.

[0072] The hardware configuration of the wireless tag communication device 1 is not limited to the configuration described above. The wireless tag communication device 1 allows for the omission and modification of the above-described components, as well as the addition of new components, as appropriate.

[0073] Let's explain the scan information. Figure 5 is a diagram illustrating the data structure of scan information according to the embodiment.

[0074] Figure 5 shows an example of the data structure of scan information stored in memory 32, for example. The scan information indicates the scan result by the wireless tag communication device 1. The scan information includes location information and a label. The location information indicates the location of the wireless tag communication device 1. The location information includes X coordinate, Y coordinate, and Z coordinate information. The label indicates a numerical value indicating the scan result by the wireless tag communication device 1. The label indicates at least one of the following: a numerical value indicating the number of RFID tags read by the wireless tag communication device 1, a numerical value indicating the strength of the radio waves from the wireless tag communication device 1, and a numerical value indicating the duration of radio wave irradiation from the wireless tag communication device 1. The label may also indicate a numerical value based on a combination of the number of RFID tags read, the strength of the radio waves, and the duration of radio wave irradiation. For example, a higher numerical value indicates a higher number of RFID tags read. A higher numerical value indicates a higher strength of the radio waves. A higher numerical value indicates a longer duration of radio wave irradiation. A higher numerical value may indicate a higher read rate in which RFID tags are read.

[0075] Scan information includes an address. The address indicates a memory location. The address indicates the position in memory where the data is stored.

[0076] For example, the address "0×1000" stores location information "X coordinate: 210", "Y coordinate: 100", "Z coordinate: 20", and label "50". The wireless tag communication device 1 performs a scan at location information "(X,Y,Z)=(210,100,20)" and indicates that the scan result was label "50".

[0077] (Example display) An example of an object display image shown on the display unit 14 of the wireless tag communication device 1 will be described. Figure 6 is a schematic diagram showing an example of an object display image displayed on the wireless tag communication device 1 according to the embodiment.

[0078] Figure 6 shows the object display image Ima. The object display image Ima is the image displayed on the display unit 14 when a scan is performed by the user of the wireless tag communication device 1. The user points the wireless tag communication device 1 towards the shelf where the products are displayed and performs the scan. In the following description, the user will be using the wireless tag communication device 1 shown in Figure 3. The shelf where the products are displayed is also called the product shelf.

[0079] The object display image Ima includes a camera image display area Ara and an object display area Arb. The camera image display area Ara is the area for displaying the camera image captured by the camera 35. The camera 35 can capture an image of the shelf that is included in the shooting range in the direction towards which the wireless tag communication device 1 is pointed.

[0080] The object display area Arb is the area where objects are displayed. For example, the processor 31 displays objects in the object display area Arb based on scan information. The object display area Arb corresponds to the scan area of ​​the wireless tag communication device 1. In this example, the processor 31 displays objects by filling in the product located in the object display area Arb based on scan information. For example, the processor 31 may superimpose or combine objects on the camera image for display.

[0081] Object Oba is an example of an object displayed based on the location information and label shown in the scan information. For example, suppose object Oba is an object based on the location information "(X,Y,Z)=(210,100,20)" and label "50". Based on the object data, processor 31 displays an object with a display format corresponding to label "50" as object Oba at the position in the camera image corresponding to the scan area from the location information "(X,Y,Z)=(210,100,20)". Processor 31 may display multiple objects to fill the scan area. Object display area Arb may display objects that show the scan results of the wireless tag communication device 1 scanning from multiple locations. Object display area Arb may include multiple objects with different display formats depending on the label value. For example, consider the case where object Oba corresponds to label "50" and object Obb corresponds to label "30". Processor 31 may display object Oba in a darker color than object Obb. Processor 31 may display the size of object Oba as smaller than the size of object Obb.

[0082] In the example shown in Figure 6, multiple objects are displayed in the object display area Arb, but the display format of objects is not limited to this. For example, the processor 31 may display a single object that surrounds the scan area corresponding to the location information, based on the location information and label indicated in the scan information. The processor 31 may partially change the display format of a single object based on the label. For example, the processor 31 may display the portion of the scan area corresponding to the portion with a high label value in a darker color. The processor 31 may display the portion of the scan area corresponding to the portion with a low label value in a darker color.

[0083] In this example, the wireless tag communication device 1 can visualize the scan results by displaying objects in the scan area. For example, the wireless tag communication device 1 can visualize the locations where many RFID tags were read by displaying different objects depending on the number of tags read. Furthermore, the wireless tag communication device 1 can visualize the locations where many RFID tags were likely read by displaying different objects depending on the radio wave irradiation time from the reader device 10. Therefore, the user of the wireless tag communication device 1 can visually see how far the scan has progressed on the product shelf. This allows the wireless tag communication device 1 to visualize the user's scan results.

[0084] (Example of processing) This section describes the processing in the information processing system S. The processing procedure described below is merely an example, and each process may be modified as much as possible. Furthermore, depending on the embodiment, the processing procedure described below may be omitted, replaced, or added as appropriate.

[0085] In the following explanation focusing on the information processing terminal 13, you may substitute "processor 31" for "information processing terminal 13." Similarly, in the explanation focusing on server 2, you may substitute "server 2" for "server 2's processor."

[0086] Figure 7 is a flowchart illustrating an example of the operation of the wireless tag communication device 1 according to this embodiment. The wireless tag communication device 1 is assumed to be the wireless tag communication device shown in Figure 3.

[0087] In the following, we assume that a user of the wireless tag communication device 1 scans shelves displaying products with the reader device 10 in store X. The user, for example, points the reader device 10 towards the shelves displaying products and emits radio waves from the reader device 10. The user is, for example, a store employee performing inventory at store X.

[0088] The processor 31 of the information processing terminal 13 activates the sensor 34 and the camera 35 (ACT1). In ACT1, for example, the processor 31 activates the sensor 34 and the camera 35 based on user input. User input is, for example, inputting a scan start command to indicate that a scan should begin.

[0089] The processor 31 estimates the position of the wireless tag communication device 1 (ACT2). ACT2 may also be processed by the position information processing unit 310 implemented by the processor 31. In ACT2, for example, the processor 31 acquires a camera image from the camera 35. The processor 31 acquires sensor data from the sensor 34. Based on the camera image and sensor data, the processor 31 estimates the position of the wireless tag communication device 1 using a self-position estimation method used in AR technology.

[0090] The processor 31 acquires the self-position of the wireless tag communication device 1 (ACT3). ACT3 may also be processed by the position information processing unit 310 implemented by the processor 31. In ACT3, for example, the processor 31 acquires position information indicating the position of the wireless tag communication device 1 estimated by a self-position estimation method. The processor 31 acquires, for example, X, Y, and Z coordinate information indicating the position of the wireless tag communication device 1. The processor 31 stores the position information in the memory 32.

[0091] The processor 31 scans the RFID tags of the products displayed on the shelf (ACT4). In ACT4, for example, the processor 31 outputs a response request (read command) as an output signal with a predetermined output value via the wireless tag communication unit 23. The wireless tag communication unit 23 receives a received (response) signal as a response wave output by the RFID tags in the scan area. When the wireless tag communication unit 23 receives a signal from the RFID tag, it extracts the tag information indicated by the received signal and supplies the extracted tag information to the processor 31.

[0092] The processor 31 acquires the scan results (ACT5). ACT5 may also be processed by the scan information processing unit 311 implemented by the processor 31. In ACT5, for example, the processor 31 acquires the number of tags read as a scan result based on the tag information. The processor 31 may also acquire the radio wave irradiation time by the wireless tag communication unit 23 as a scan result. The processor 31 may also acquire the radio wave intensity by the wireless tag communication unit 23 as a scan result. The processor 31 stores the scan results as scan information in the memory 32. The processor 31 may also store labels based on the scan results in the memory 32.

[0093] The processor 31 displays the object on the display unit 14 based on the scan information (ACT6). ACT6 may also be a process performed by the display processing unit 312 implemented by the processor 31. In ACT6, for example, the processor 31 determines the scan area based on the position information. The processor 31 generates an image for displaying the object in the scan area based on the label. For example, the processor 31 displays an image on the display unit 14 in which the object is superimposed or combined with the camera image acquired from the camera 35 at a position corresponding to the scan area.

[0094] The processor 31 may display objects associated with the label value at positions corresponding to the scan area based on the object data. The processor 31 may display different objects on the display 14 depending on the label. For example, the processor 31 may display different objects depending on the number of tags read by the reader device 10. The display processing unit 312 may display different objects depending on the radio wave irradiation time by the reader device 10.

[0095] The processor 31 may change the display mode of the object based on the time information included in the scan information. For example, the processor 31 may display different objects depending on the elapsed time since the scan time. The processor 31 may change the display mode of the object when a predetermined time has elapsed since the scan time. Changing the display mode includes hiding the object.

[0096] The processor 31 determines whether the exit button for ending the scan has been selected (ACT7). In ACT7, for example, the processor 31 determines whether the exit button has been selected by the user. The selection of the exit button corresponds to the input of a scan termination command. The user inputs the scan termination command via the input device 15. For example, the user may select the exit button displayed on the display device 14.

[0097] If the Exit button is selected (ACT7:YES), the process ends. If the Exit button is not selected (ACT7:NO), the process returns from ACT7 to ACT2.

[0098] In this example, the wireless tag communication device 1 can acquire the user's location information, acquire scan information related to the scan performed by the reader device 10, and display objects on the camera image based on the user's location information and scan information. For example, the wireless tag communication device 1 can determine the scan area by the reader device 10 by estimating the location of the wireless tag communication device 1. The wireless tag communication device 1 can visualize the scan results by displaying objects in the area corresponding to the scan area of ​​the camera image to visualize the scan results. Therefore, the user of the wireless tag communication device 1 can visually see how far the scan has progressed on the product shelf. In this way, the wireless tag communication device 1 can visualize the scan results performed by the user.

[0099] Furthermore, the wireless tag communication device 1 can display different objects depending on the scan results. For example, by displaying different objects depending on the number of tags read, the wireless tag communication device 1 can visualize the locations where many RFID tags were read. Also, by displaying different objects depending on the radio wave irradiation time by the reader device 10, the wireless tag communication device 1 can visualize the locations where many RFID tags were likely read. As a result, users of the wireless tag communication device 1 can visually see where many tags were read on the product shelves. They can recognize which locations on the product shelves should be scanned. In this way, the wireless tag communication device 1 can visualize the scan results performed by the user. For example, by visualizing the scan results, users can recognize that areas where readings were sufficient are areas where inventory work has been completed, and areas where readings were insufficient are areas where inventory work is still needed. This allows the wireless tag communication device 1 to streamline inventory work.

[0100] Figure 8 is a sequence diagram illustrating another example of the operation of the wireless tag communication device 1 according to the embodiment. In the example shown in Figure 8, the display unit 14 of the wireless tag communication device 1 displays an object indicating the scan results for previously performed scans. Previously performed scans include scans previously performed by the wireless tag communication device 1. Previously performed scans include scans previously performed by wireless tag communication devices other than the wireless tag communication device 1. Previously performed scans include scans previously performed by multiple wireless tag communication devices. The scan results for previously performed scans are stored in the server 2 as scan history information.

[0101] In the following, similar to the example in Figure 7, we assume that a user of the wireless tag communication device 1 scans a shelf where products are displayed in store X using the reader device 10. The user, for example, points the reader device 10 towards the shelf where the products are displayed and emits radio waves from the reader device 10.

[0102] The processor 31 of the information processing terminal 13 activates the sensor 34 and camera 35, similar to ACT1 (ACT11). In ACT11, for example, the processor 31 activates the sensor 34 and camera 35 based on user input.

[0103] The processor 31 estimates the position of the wireless tag communication device 1, similar to ACT2 (ACT12). ACT12 may also be processed by the position information processing unit 310 implemented by the processor 31.

[0104] The processor 31 acquires the position of the wireless tag communication device 1, similar to ACT3 (ACT13). ACT13 may also be processed by the position information processing unit 310 implemented by the processor 31. The processor 31 stores the position information in the memory 32.

[0105] The processor 31 requests scan history information from the server 2. This process may also be carried out by the communication processing unit 313 implemented by the processor 31. For example, the processor 31 outputs a scan history information request command to the server 2. The scan history information request command may also be a command that requests scan history information for a predetermined time period from the current time. For example, the scan history information request command may be a command that requests scan history information for 5 hours from the current time.

[0106] Server 2 receives a scan history information request command from the information processing terminal 13. Based on the scan history information request command, Server 2 outputs scan history information to the information processing terminal 13 (ACT21). In ACT21, for example, Server 2 outputs scan history information to the information processing terminal 13 that shows the scan results for scans that have been performed in the past and are stored in memory.

[0107] The processor 31 of the information processing terminal 13 acquires scan history information from the server 2 (ACT 14). ACT 14 may also be processed by the communication processing unit 313 implemented by the processor 31. The processor 31 may also store the scan history information in the memory 32.

[0108] The processor 31 displays objects on the display 14 based on the scan history information (ACT 15). ACT 15 may also be a process performed by the display processing unit 312 implemented by the processor 31. In ACT 15, for example, the processor 31 determines the scan area based on the position information of the scan history information. The processor 31 generates an image for displaying objects indicating the scan history in the scan area based on the labels of the scan history information. For example, the processor 31 displays an image on the display 14 in which objects indicating the scan history are superimposed or combined at positions corresponding to the scan area of ​​the camera image acquired from the camera 35. The processor 31 may also display objects associated with label values ​​at positions corresponding to the scan area based on object data. The processor 31 may display different objects on the display 14 depending on the label. For example, the processor 31 may display different objects depending on the number of tags read indicated by the scan history information. The display processing unit 312 may display different objects depending on the radio wave irradiation time indicated by the scan history information.

[0109] The processor 31 may change the display mode of the object based on the time information included in the scan history information. For example, the processor 31 may display different objects depending on the elapsed time since the scan time. The processor 31 may change the display mode of the object when a predetermined amount of time has elapsed since the scan time.

[0110] Processor 31, like ACT4, scans the RFID tags of the products displayed on the shelves (ACT16).

[0111] The processor 31 acquires the scan results (ACT17), similar to ACT5. ACT17 may also be processed by the scan information processing unit 311 implemented by the processor 31. In ACT17, for example, the processor 31 acquires the number of tags read as a scan result based on the tag information. The processor 31 may also acquire the radio wave irradiation time by the wireless tag communication unit 23 as a scan result. The processor 31 may also acquire the radio wave intensity by the wireless tag communication unit 23 as a scan result. The processor 31 stores the scan results as scan information in the memory 32. The processor 31 may also store labels based on the scan results in the memory 32.

[0112] The processor 31 outputs scan information indicating the scan result to the server 2 (ACT18). ACT18 may also be processed by the communication processing unit 313 implemented by the processor 31. In ACT18, for example, the processor 31 may output scan information to the server 2 each time it acquires a scan result.

[0113] Server 2 acquires scan information from information processing terminal 13. Server 2 saves the scan information to memory (ACT22).

[0114] The processor 31, similar to ACT6, displays the object on the display unit 14 based on the scan information (ACT19). ACT19 may also be processed by the display processing unit 312 implemented by the processor 31. In ACT19, for example, the processor 31 displays an image on the display unit 14 in which the object is superimposed or combined at a position corresponding to the scan area of ​​the camera image acquired from the camera 35.

[0115] The processor 31 may display objects associated with the label value at positions corresponding to the scan area based on the object data. The processor 31 may display different objects on the display 14 depending on the label. For example, the processor 31 may display different objects depending on the number of tags read by the reader device 10. The display processing unit 312 may display different objects depending on the radio wave irradiation time by the reader device 10.

[0116] The processor 31 may change the display mode of the object based on the time information included in the scan information. For example, the processor 31 may display different objects depending on the elapsed time since the scan time. The processor 31 may change the display mode of the object when a predetermined amount of time has elapsed since the scan time.

[0117] The processor 31, like ACT7, determines whether the exit button to end the scan has been selected (ACT20).

[0118] If the Exit button is selected (ACT20:YES), the process ends. If the Exit button is not selected (ACT20:NO), the process returns from ACT20 to ACT12.

[0119] In this example, the wireless tag communication device 1 can acquire scan history information about past scans and display objects based on the scan history information on the camera image. For example, the wireless tag communication device 1 can display objects on the camera image that visualize the scan results of scans previously performed by the wireless tag communication device 1. Therefore, the user of the wireless tag communication device 1 can visually see how far the product shelves have been scanned in the past. In addition, the wireless tag communication device 1 can display objects on the camera image that visualize the scan results of scans performed by other wireless tag communication devices. Therefore, the user of the wireless tag communication device 1 can visually see how far the product shelves have been scanned by other users. As a result, the user of the wireless tag communication device 1 can recognize the parts of the product shelves that have already been scanned and easily recognize which parts of the product shelves should be scanned. Therefore, the information processing system S can share scan results from multiple wireless tag communication devices and prevent duplication of inventory work. As a result, the wireless tag communication device 1 can streamline inventory work.

[0120] Figure 9 is a sequence diagram illustrating yet another example of the operation of the wireless tag communication device 1 according to the embodiment. In the example shown in Figure 9, it is assumed that a customer of store X scans a shelf displaying merchandise using the reader device 10. In this example, the user of the wireless tag communication device 1 is a customer of store X. The customer receives rewards such as points based on the results of scanning the shelf displaying merchandise with the reader device 10. For example, the rewards are service points, but are not limited to these. The rewards may also be coupons, discount vouchers, etc.

[0121] The information processing terminal 13 is described as being lent to the customer by store X, but is not limited to this. For example, the information processing terminal 13 may be a smartphone or tablet device owned by the customer. In this case, the customer's smartphone or tablet device shall be linked to the reader device 10. The information processing terminal 13 shall include a card reader for reading membership cards.

[0122] In the following example, similar to the example in Figure 7, the user (customer) of the wireless tag communication device 1 points the reader device 10 towards the shelf where the products are displayed and emits radio waves from the reader device 10.

[0123] The processor 31 of the information processing terminal 13 obtains the customer's user ID (ACT 101). In ACT 101, for example, the processor 31 displays a member code request message on the display unit 14, requesting the customer to scan their member code. For example, the member code request message may include a message such as "Please scan your member card." The member code request message may be at least one of text data, image data, audio data, or video data. The customer has the processor 31 read their member card via a card reader (not shown). The processor 31 may also have the processor 31 read the customer's member code via a camera or the like. The member code may be a member code recorded on the member card, or it may be an image that can be displayed on the user terminal or the like. The processor 31 obtains the member code based on the code symbol on which the member code is recorded. The processor 31 may store the member code as the user ID in memory 32. The processor 31 outputs the user ID to the server 2.

[0124] Server 2 obtains the user ID from the information processing terminal 13 (ACT201).

[0125] The processor 31 of the information processing terminal 13 activates the sensor 34 and camera 35, similar to ACT1 (ACT102). In ACT102, for example, the processor 31 activates the sensor 34 and camera 35 based on user input.

[0126] The processor 31 estimates the position of the wireless tag communication device 1, similar to ACT2 (ACT103). ACT103 may also be processed by the position information processing unit 310 implemented by the processor 31.

[0127] The processor 31 acquires the position of the wireless tag communication device 1, similar to ACT3 (ACT104). ACT104 may also be processed by the position information processing unit 310 implemented by the processor 31. The processor 31 stores the position information in the memory 32.

[0128] Processor 31, like ACT4, scans the RFID tags of the products displayed on the shelves (ACT105).

[0129] The processor 31 acquires the scan results (ACT106), similar to ACT5. ACT106 may also be processed by the scan information processing unit 311 implemented by the processor 31. In ACT106, for example, the processor 31 acquires the number of tags read as a scan result based on the tag information. The processor 31 may also acquire the radio wave irradiation time by the wireless tag communication unit 23 as a scan result. The processor 31 may also acquire the radio wave intensity by the wireless tag communication unit 23 as a scan result. The processor 31 stores the scan results as scan information in the memory 32. The processor 31 may also store labels based on the scan results in the memory 32.

[0130] The processor 31, similar to ACT6, displays the object on the display unit 14 based on the scan information (ACT107). ACT107 may also be processed by the display processing unit 312 implemented by the processor 31. In ACT107, for example, the processor 31 displays an image on the display unit 14 in which the object is superimposed or combined at a position corresponding to the scan area of ​​the camera image acquired from the camera 35.

[0131] The processor 31 may display objects associated with the label value at positions corresponding to the scan area based on the object data. The processor 31 may display different objects on the display 14 depending on the label. For example, the processor 31 may display different objects depending on the number of tags read by the reader device 10. The display processing unit 312 may display different objects depending on the radio wave irradiation time by the reader device 10.

[0132] The processor 31 may change the display mode of the object based on the time information included in the scan information. For example, the processor 31 may display different objects depending on the elapsed time since the scan time. The processor 31 may change the display mode of the object when a predetermined amount of time has elapsed since the scan time.

[0133] Processor 31, like ACT7, determines whether the exit button to end the scan has been selected (ACT108).

[0134] If the Exit button is selected (ACT108:YES), the process ends. If the Exit button is not selected (ACT108:NO), the process returns from ACT108 to ACT103.

[0135] The processor 31 outputs scan information indicating the scan result to the server 2 (ACT109). ACT109 may also be processed by the communication processing unit 313 implemented by the processor 31. The processor 31 may also output scan information to the server 2 each time it acquires a scan result.

[0136] Server 2 acquires scan information from information processing terminal 13 (ACT202). In ACT202, for example, Server 2 associates the scan information with the user ID and stores it in memory.

[0137] Server 2 performs point processing based on the scan information (ACT203). In ACT203, for example, Server 2 calculates points based on the scan information. Server 2 may calculate different points depending on the label value. For example, Server 2 may calculate different points depending on the number of tags read. Server 2 may calculate different points depending on the radio wave exposure time. Specifically, Server 2 may add more points the more tags are read. Server 2 may add more points the longer the radio wave exposure time.

[0138] Server 2 may also calculate points depending on whether or not a specified product has been scanned. For example, Server 2 may add points if the location where the specified product is displayed is included in the scanning area.

[0139] In this example, the wireless tag communication device 1 can display objects in the camera image based on the scan results performed by the customer. Therefore, the wireless tag communication device 1 can visualize the scan results performed by the customer. Because customers can easily see the scan results, they can perform inventory work in a game-like manner. In addition, the information processing system S can provide customers with rewards according to the scan results. Therefore, the information processing system S can motivate customers to perform inventory work. In this way, the information processing system S can address the problem of insufficient personnel to perform inventory work.

[0140] (Other embodiments) In the embodiments described above, the program executed by the processor is pre-stored in the device's memory. However, the program executed by the processor may be downloaded to the device from a network or installed on the device from a storage medium. The storage medium can be any medium that can store programs and is readable by the device, such as a CD-ROM. Furthermore, functions obtained through pre-installation or download may be realized in cooperation with the device's internal OS (operating system), etc.

[0141] The information processing terminal 13 may be implemented as a single electronic device, or as multiple electronic devices with distributed functions.

[0142] The embodiments described above may be applied to methods of execution by the system. The embodiments described above may be applied to programs that can cause the system's computer to perform each function. The embodiments described above may be applied to recording media that store programs.

[0143] Each of the one or more arithmetic circuits that make up a processing circuit executes one or more of the processes. If the processing circuit consists of a single arithmetic circuit, the single arithmetic circuit executes all of the processes. If the processing circuit consists of multiple arithmetic circuits, each of the multiple arithmetic circuits executes some of the processes. Some of the processes may be one of the processes or two or more of the processes. If the processing circuit consists of multiple arithmetic circuits, the multiple arithmetic circuits may be contained in one device or distributed across multiple devices.

[0144] The program may be transferred while stored in the electronic device according to the embodiment, or it may be transferred without being stored in the electronic device. In the latter case, the program may be transferred via a network, or it may be transferred while recorded on a recording medium. The recording medium is a non-temporary tangible medium. The recording medium is a computer-readable medium. The recording medium may be any medium that is capable of storing a program and is readable by a computer, such as a CD-ROM or memory card, and its form is not limited.

[0145] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents.

[0146] The above-described embodiment may also be expressed as follows: (1) A location information processing unit that acquires the user's location information, A scan information processing unit that acquires scan information related to scanning by a reader device, A display processing unit that displays an object on the camera image to visualize the scan results based on the user's location information and the scan information, An information processing terminal equipped with the following features. (2) The display processing unit displays different objects according to the scan result. (1) The information processing terminal described above. (3) The display processing unit displays objects in different display formats according to the number of tags read by the reader device. (1) The information processing terminal described above. (4) The display processing unit displays objects in different display formats depending on the duration of radio wave irradiation by the reader device. (1) The information processing terminal described above. (5) The system further includes a communication processing unit that acquires scan history information regarding past scans, The display processing unit displays the object based on the scan history information on the camera image. (1) The information processing terminal described above. (6) To the computer, A function to obtain the user's location information, A function to acquire scan information related to scanning by a reader device, Based on the user's location information and the scan information, a function is provided to display an object on the camera image to visualize the scan results. An information processing program capable of executing [the specified action]. [Explanation of Symbols]

[0147] 1...Wireless tag communication device, 2...Server, 10...Reader device (base device), 11...Gripping unit, 12...Holding unit, 13...Information processing terminal, 14...Display unit, 15...Input unit, 21...Processor, 22...Memory, 23...Wireless tag communication unit, 26...Interface (I / F), 31...Processor, 32...Memory, 33...Interface (I / F), 34...Sensor (sensor group), 35...Camera, 36...Communication interface, 41...Processor, 42...Memory, 43...Wireless tag communication unit, 44...Sensor (sensor group), 45...Communication interface (I / F), 46...Camera, 310...Location information processing unit, 311...Scan information processing unit, 312...Display processing unit, 313...Communication processing unit, a...Arrow, Ara...Camera image display area, Arb...Object display area, Ima...Object display image, NW...Network, Oba~Obb...Object, S...Information processing system, X...Store.

Claims

1. A location information processing unit that acquires the user's location information, A scan information processing unit that acquires scan information related to scanning by a reader device, A display processing unit that displays an object on the camera image to visualize the scan results based on the user's location information and the scan information, An information processing terminal equipped with the following features.

2. The display processing unit displays different objects according to the scan results. The information processing terminal according to claim 1.

3. The display processing unit displays objects in different display formats according to the number of tags read by the reader device. The information processing terminal according to claim 1.

4. The display processing unit displays objects in different display formats depending on the duration of radio wave irradiation by the reader device. The information processing terminal according to claim 1.

5. It further includes a communication processing unit that acquires scan history information regarding past scans. The display processing unit displays the object based on the scan history information on the camera image. The information processing terminal according to claim 1.

6. On the computer, A function to obtain the user's location information, A function to acquire scan information related to scanning by a reader device, Based on the user's location information and the scan information, a function is provided to display an object on the camera image to visualize the scan results. An information processing program capable of executing [the specified action].

Images