Wireless tag communication device

Abstract

Disclosed is a wireless tag communication device capable of displaying guidance that is easily and intuitively understood by an operator, the wireless tag communication device having an antenna, a communication control circuit, a camera, a sensor, and a processor. The antenna has directivity. The communication control circuit communicates with a wireless tag via the antenna. The camera captures an image in which the direction in which the directivity of the antenna is greatest and the direction in which the camera captures the image coincide. The sensor detects the brightness in a first image captured by the camera. The processor calculates the detected position of the wireless tag that is a search target in the first image, and displays a second image in which the area other than the explicit area with the detected position of the wireless tag as the base point with respect to the first image is masked with a masking density corresponding to the brightness detected by the sensor on a display.

Description

[0001] This application claims priority to Japanese application No. JP2022-044293, filed on March 18, 2022, and incorporates the contents of the aforementioned application in their entirety. Technical Field

[0002] Embodiments of the present invention relate to a wireless tag communication device. Background Technology

[0003] Currently, there are wireless tag communication devices designed to read RFID tags (hereinafter also referred to as wireless tags) located in unspecified locations. These devices communicate with a designated RFID tag by changing the orientation of the antenna through operator input. Based on the communication status with the designated RFID tag, the wireless tag communication device infers the direction in which the RFID tag is located. Existing wireless tag communication devices inform the operator of the RFID tag's location by displaying a guide screen containing the inferred direction on a monitor.

[0004] The operator moves in the direction shown on the display while searching for RFID tags or items with RFID tags attached. However, the operator needs to be familiar with the direction of RFID tags displayed on the guide screen of the existing wireless tag communication device to actually find the RFID tags. It is expected that the wireless tag communication device will allow the operator to intuitively and easily identify the location of the RFID tags, making it easier for the operator to find the RFID tags. Summary of the Invention

[0005] In view of the above problems, the technical problem to be solved by the present invention is to provide a wireless tag communication device that can display guidance that is easy for the operator to understand intuitively.

[0006] To address the aforementioned problems, a wireless tag communication device according to an embodiment of the present invention includes: an antenna, a communication control circuit, a camera, a sensor, and a processor. The antenna is directional. The communication control circuit communicates with the wireless tag via the antenna. The camera captures an image in the direction where the antenna's directionality is maximized and the shooting direction is the same. The sensor detects the brightness in the first image captured by the camera. The processor calculates the detection position of the wireless tag, which is the search target, in the first image, and displays the first image and a second image on a display screen, in which the area outside the explicit region, with the wireless tag's detection position as the base point, is masked with a masking density corresponding to the brightness detected by the sensor.

[0007] According to the aforementioned wireless tag communication device, a wireless tag communication device can be provided that can display intuitive and easy-to-understand guidance for the operator.

[0008] In the aforementioned wireless tag communication device, the processor calculates the distance between the location of the wireless tag being searched and the location of the wireless tag communication device, and changes the size of the indicated area based on the calculated distance.

[0009] According to the aforementioned wireless tag communication device, the indicated area can be varied based on the distance to the wireless tag.

[0010] In the aforementioned wireless tag communication device, the processor measures the average brightness of the entire first image and sets a masking density corresponding to the average brightness of the entire first image.

[0011] According to the aforementioned wireless tag communication device, a second image can be generated in which the masked area is masked with an easily observable masking density corresponding to the overall brightness of the first image.

[0012] In the aforementioned wireless tag communication device, the processor measures the average brightness of the area outside the explicitly indicated area in the first image and sets a masking density corresponding to the average brightness of the area outside the explicitly indicated area in the first image.

[0013] According to the aforementioned wireless tag communication device, a second image can be generated with a masking density that makes it easy to observe areas outside the explicit area.

[0014] In the aforementioned wireless tag communication device, the first image has a display area that displays a message indicating that a wireless tag has been detected as the search target. The processor measures the average brightness of the display area in the first image and sets a masking density corresponding to the average brightness of the display area.

[0015] According to the aforementioned wireless tag communication device, a second image can be generated with a masking density that makes the information displayed in the guided display area easy to observe.

[0016] Another aspect of the present invention provides a wireless tag communication device, comprising: an antenna having directional properties; a communication control circuit for communicating with a wireless tag via the antenna; a camera for capturing a first image in the direction where the directional properties of the antenna are maximized and the camera direction is aligned; and a processor for setting the color of a second image superimposed on the first image based on color information in the first image captured by the camera, and superimposing the first image and the second image with the color set according to the color information in the first image and displaying them on a display.

[0017] According to the aforementioned wireless tag communication device, a wireless tag communication device can be provided that can display guidance that is easy for the operator to understand intuitively.

[0018] In the aforementioned wireless tag communication device, the processor calculates the detection location of the wireless tag in the first image that is the search target, and displays a second image representing the detection location of the wireless tag on the display with a color set based on the color information of the first image.

[0019] The wireless tag communication device described above can easily display the detection location of the wireless tag.

[0020] In the aforementioned wireless tag communication device, the processor divides the first image into multiple regions and sets the color of the second image based on the color information in each of the divided regions.

[0021] According to the aforementioned wireless tag communication device, a color can be set for each of multiple areas.

[0022] In the aforementioned wireless tag communication device, the second image is a marker image representing the detection location of the wireless tag, and the processor calculates the brightness of the display area of ​​the marker image in the first image and sets the color of the marker image according to the brightness of the display area of ​​the marker image.

[0023] According to the wireless tag communication device described above, a marker image indicating the detection location of the wireless tag can be displayed in an easily observable color.

[0024] In the aforementioned wireless tag communication device, the second image further includes a message guiding the detection of a wireless tag as a search target, the first image has a display area for displaying the message, and the processor calculates the brightness of the display area for the guidance in the first image and sets the color of the message according to the brightness of the display area for the guidance.

[0025] According to the aforementioned wireless tag communication device, messages guiding the detection of wireless tags as search targets can be displayed in easily observable colors. Attached Figure Description

[0026] Figure 1 This is a block diagram that schematically illustrates an example of the configuration of a control system for a wireless tag communication device according to an embodiment;

[0027] Figure 2 This is an exterior view showing an example of the configuration of the wireless tag communication device according to the embodiment;

[0028] Figure 3 This is a diagram illustrating a first display example of a guide screen displayed by the wireless tag communication device according to the embodiment;

[0029] Figure 4This is a diagram illustrating a first display example of a guide screen displayed by the wireless tag communication device according to the embodiment;

[0030] Figure 5 This is a diagram illustrating a first display example of a guide screen displayed by the wireless tag communication device according to the embodiment;

[0031] Figure 6 This is a diagram illustrating a second display example of a guide screen displayed by the wireless tag communication device according to the embodiment;

[0032] Figure 7 This is a diagram illustrating a second display example of a guide screen displayed by the wireless tag communication device according to the embodiment;

[0033] Figure 8 This is a diagram illustrating a second display example of a guide screen displayed by the wireless tag communication device according to the embodiment;

[0034] Figure 9 This is a diagram illustrating a third display example of a guide screen displayed by the wireless tag communication device according to the embodiment;

[0035] Figure 10 This is a diagram illustrating a third display example of a guide screen displayed by the wireless tag communication device according to the embodiment;

[0036] Figure 11 This is a diagram illustrating a third display example of a guide screen displayed by the wireless tag communication device according to the embodiment;

[0037] Figure 12 This is a flowchart illustrating a first operational example of the wireless tag communication device involved in the embodiment;

[0038] Figure 13 This is a diagram illustrating a fourth display example of a guide screen displayed by the wireless tag communication device involved in the embodiment;

[0039] Figure 14 This is a diagram illustrating a fourth display example of a guide screen displayed by the wireless tag communication device according to the embodiment; and

[0040] Figure 15 This is a flowchart illustrating a second operational example of the wireless tag communication device involved in the embodiments.

[0041] Explanation of reference numerals in the attached figures

[0042] 10 Wireless tag communication device; 21 Processor; 22 Memory

[0043] 23 Sensor 24 Communication control circuit 25 Antenna

[0044] 28 Information terminals; 29 Cameras; 31 Sensors; 114 Displays

[0045] 115 Input Device Detailed Implementation

[0046] Hereinafter, embodiments will be described with reference to the accompanying drawings.

[0047] First, the configuration of the wireless tag communication device (wireless tag reading device) 10 involved in the embodiment will be described.

[0048] Figure 1 This is a block diagram that schematically illustrates an example configuration of the wireless tag communication device 10 involved in the embodiment.

[0049] The wireless tag communication device 10 described in this embodiment is a device for communicating with RFID tags (wireless tags). The wireless tag communication device 10 is a wireless tag reading device that reads tag information, etc., recorded on RFID tags by communicating with them. Based on the reading results of the RFID tags, the wireless tag communication device 10 infers location-related information, such as the direction in which the RFID tags are located. The wireless tag communication device 10 displays an image on a display 114 showing the inferred location of the RFID tags.

[0050] An RFID tag is a wireless communication device that operates via radio waves (output signals) from a wireless tag communication device 10. An RFID tag includes a processor, memory, communication circuitry, and antenna. Upon receiving a read command from the wireless tag communication device 10, the RFID tag outputs a response signal containing tag information recorded in its own memory. For example, an RFID tag may be attached to a product or component. An RFID tag attached to a product records tag information containing information specifying that product in its internal memory.

[0051] The wireless tag communication device 10 involved in the operator operation embodiment. The wireless tag communication device 10 is a device that changes the orientation of the antenna 25 used for communicating with RFID tags through operator operation. For example, the wireless tag communication device 10 is a portable device that the operator holds and operates. Alternatively, the wireless tag communication device 10 may also be a device mounted on a mobile body where the operator operates the orientation of the antenna.

[0052] The wireless tag communication device 10 described in this embodiment is a device that reads RFID tags attached to an item by changing the position and orientation through operator operation. The wireless tag communication device 10 reads the tag information recorded by the RFID tag by receiving a response signal from the RFID tag present within its reading range. The wireless tag communication device 10 also acquires information such as RSSI values ​​and phase values ​​detected from the response signals from the RFID tag. The wireless tag communication device 10 stores the RSSI values ​​and phase values, along with the tag information, as the RFID tag reading result.

[0053] For example, the wireless tag communication device 10 is used as a search device for searching for items with RFID tags in a predetermined area such as a warehouse or shop. As a search device, the wireless tag communication device 10 continuously reads the RFID tags being searched while changing its position and orientation through operator operation.

[0054] The wireless tag communication device 10 infers the direction in which the RFID tag exists (tag direction) based on wireless communication with the RFID tag being searched. Additionally, the wireless tag communication device 10 infers its own position (device position) based on images captured by the camera 29 and information detected by the sensor 23. Furthermore, the wireless tag communication device 10 infers the location of the RFID tag (detection position) based on the result of the tag direction inferred in a time sequence and the result of the device's position inference. The wireless tag communication device 10 displays the inferred RFID tag position as an image that can be visually recognized by the operator on the display 114.

[0055] exist Figure 1 In the example configuration shown, the wireless tag communication device 10 includes a processor 21, a memory 22, a sensor 23, a communication control circuit 24, an antenna 25, a communication interface (I / F) 26, an interface 27, an information terminal 28, a camera 29, a sensor 31, and a power supply 33.

[0056] Processor 21 controls various components. Processor 21 includes arithmetic circuitry such as a CPU. Processor 21 executes programs to control various components and perform various data processing tasks. Additionally, processor 21 may have internal memory. Processor 21 performs various processes by executing programs stored in memory 22, etc.

[0057] Memory 22 includes various types of memory. For example, memory 22 includes ROM, RAM, NVM, etc. ROM is a non-volatile memory that cannot be rewritten. ROM stores programs executed by processor 21, etc. RAM is a volatile memory that temporarily stores data. RAM operates as working memory or buffer memory. NVM is a non-volatile memory that can be rewritten. NVM stores information such as control information, setting information, and processing results, etc.

[0058] Additionally, the NVM of memory 22 stores various programs for processor 21 to execute the various processes described later. For example, memory 22 stores a program for performing a process to infer the location (tag location) of an RFID tag that is being searched. Furthermore, memory 22 is associated with the tag location inference process, storing programs for performing a process to infer the tag orientation and programs for performing a process to infer the location of the device.

[0059] The memory 22 stores programs for performing display processing to display a guide screen corresponding to the label position on the display 114. Additionally, the memory 22, associated with the guide screen display processing, stores programs for performing image processing to generate a second image representing the label position. The memory 22, associated with the second image generation process, stores programs for processing images captured by the camera 29 at a concentration corresponding to sensor values ​​measured by the sensor 31. The memory 22 stores programs for displaying a second image, such as a marker image or guide image representing the label position, in a color corresponding to the color information of the image captured by the camera 29. Furthermore, the memory 22 may also pre-store marker images representing label positions and second images of multiple patterns that can be displayed as operation guides.

[0060] Sensor 23 is a sensor that detects the operation of the wireless tag communication device 10. For example, sensor 23 is an accelerometer, a gyroscope, or a geomagnetic (azimuth) sensor. Sensor 23 may also be a configuration that includes multiple types of sensors. Furthermore, sensor 23 may be a configuration that is present in the information terminal 28, or it may be a configuration that includes the sensors present in the information terminal 28.

[0061] The communication control circuit 24 and the antenna 25 constitute an RFID interface for communicating with RFID tags.

[0062] The communication control circuit 24 includes control circuitry for communicating with the RFID tag via the antenna 25. The communication control circuit 24 causes a transmission signal (radio wave) provided by the processor 21 to be transmitted from the antenna 25 at a set output value. The antenna 25 outputs the transmission signal provided by the communication control circuit 24 as a radio wave receivable by the RFID tag.

[0063] The communication control circuit 24 not only outputs a transmit signal to the antenna 25, but also provides the signal received by the antenna 25 as received data to the processor 21. The communication control circuit 24 causes the antenna 25 to receive a response signal from the RFID tag, processes the response signal (received signal) received by the antenna 25, and provides it to the processor 21. For example, the communication control circuit 24 provides the processor 21 with the tag information contained in the received signal from the RFID tag, the RSSI value representing the strength of the received signal, and the phase value.

[0064] Communication I / F26 is an interface used for communication with external devices. Communication I / F26 is a communication interface used for communication with host devices 11, such as servers. Communication I / F26 can be an interface for both wired and wireless communication.

[0065] Interface 27 is an interface used for connecting to information terminal 28. Interface 27 can be any interface that corresponds to an interface included in information terminal 28. For example, interface 27 can also be an interface that physically contacts and connects to an interface included in information terminal 28 such as a USB (Universal Serial Bus) interface or a LAN interface. Alternatively, interface 27 can also be an interface for wireless communication connection such as a Bluetooth (registered trademark) interface or a Wi-Fi (registered trademark) interface.

[0066] Information terminal 28 is a device including display 114 and input device 115, etc. Information terminal 28 is a user interface that outputs prompts to the operator or inputs information instructed by the operator. Information terminal 28 can also be a portable information processing device such as a smartphone or tablet PC.

[0067] exist Figure 1 In the configuration example shown, the information terminal 28 includes a processor 111, a memory 112, an interface (I / F) 113, a display 114, and an input device 115.

[0068] Processor 111 performs control and data processing for various components. Processor 111 is, for example, a CPU. Processor 111 performs various actions by executing programs stored in memory 112. In addition, processor 111 can also execute part or all of the processing performed by processor 21, which will be described later.

[0069] Interface 113 is an interface (second communication interface) used for communication with processor 21. Interface 113 can be any interface corresponding to interface 27. For example, interface 113 can be a LAN, USB, Bluetooth, or Wi-Fi interface, etc.

[0070] Display 114 is a device for displaying information. For example, display 114 displays the detection results of RFID tags (e.g., the location of RFID tags). Input device 115 is a device for an operator to input operation instructions, etc. Display 114 and input device 115 are configured by, for example, a display device with a touch panel.

[0071] Sensor 31 is a sensor that detects the brightness or illuminance in the image (first image) captured by camera 29.

[0072] Camera 29 captures images. Camera 29 captures images based on the communication range (reading range) of the antenna 25 with respect to the RFID tag. Camera 29 captures images with the direction of maximum orientation of the antenna 25 as the imaging direction. Camera 29 is configured in the wireless tag communication device 10 such that the optical axis of the imaging direction is aligned with the axis of the direction of maximum orientation of the antenna 25. For example, when the direction of maximum orientation of the antenna 25 is taken as the orientation of the antenna 25, camera 29 is configured such that the imaging direction is aligned with the orientation of the antenna.

[0073] Sensor 31 is a sensor that detects the brightness or illuminance in the image (first image) captured by camera 29. For example, sensor 31 is a brightness sensor that detects the brightness in the image captured by camera 29. Alternatively, sensor 31 can also be an illuminance sensor that detects the illuminance within the range captured by camera 29. Furthermore, sensor 31 can also be a component of information terminal 28.

[0074] Power source 33 provides power to enable the wireless tag communication device 10 to operate. Power source 33 supplies power to various parts of the wireless tag communication device 10 for operation. In the portable wireless tag communication device 10, power source 33 is, for example, a rechargeable battery.

[0075] Next, a detailed description will be given of the configuration examples of the communication control circuit 24 and antenna 25 in the wireless tag communication device 10 according to the embodiments.

[0076] The communication control circuit 24 includes a modulation circuit, a transmitting-side amplifier circuit, a coupler, a receiving-side amplifier circuit, a demodulation circuit, an output setting circuit, and a level detection circuit. The antenna 25 is connected to the coupler in the communication control circuit 24. The antenna 25 transmits and receives radio waves used for communication with the RFID tag. The communication control circuit 24 processes signals transmitted to the RFID tag via the antenna 25 and signals received from the RFID tag.

[0077] The modulation circuit modulates the waveform signal (carrier) with the input transmit data. The amplifier circuit on the transmitting side amplifies the output signal of the modulation circuit. The coupler provides the output signal of the amplifier circuit on the transmitting side to the antenna 25. Through these configurations, the communication control circuit 24 outputs the carrier modulated with the transmit data from the antenna 25.

[0078] The RFID tag receives radio waves as a transmission signal sent from antenna 25. For example, the RFID tag identifies a read command contained in the transmission signal sent from antenna 25. When the RFID tag identifies the read command, it outputs the data (tag information) stored in its memory via radio waves, for example, backscatter modulation.

[0079] Antenna 25 receives radio waves as the received signal output by the RFID tag. Communication control circuit 24 acquires the received signal from antenna 25 via a coupler and provides it to the amplification circuit on the receiving side. The amplification circuit on the receiving side amplifies the received signal from antenna 25. Demodulation circuit demodulates the data (tag information) contained in the received signal amplified by the amplification circuit on the receiving side.

[0080] Antenna 25 is directional. Antenna 25 is, for example, a planar antenna. However, antenna 25 is not limited to the specified configuration. Antenna 25 is configured to face the direction in which its directionality is maximized (e.g., Figure 2 The wireless tag communication device 10 is configured to transmit electromagnetic waves in the direction shown (a) centered on the communication (reading) area. The direction in which the antenna 25 has the greatest directivity is the front.

[0081] Additionally, the communication control circuit 24 sets the strength (output value) of the output signal via the output setting circuit. The amplifier circuit on the transmitting side amplifies the signal supplied from the modulation circuit in such a way that the output value set by the output setting circuit is achieved. The antenna 25 transmits the output signal (radio wave) supplied from the amplifier circuit on the transmitting side via a coupler at the output value set by the output setting circuit.

[0082] The communication control circuit 24 detects the strength of the signal input to the amplifier circuit on the receiving side via a level detection circuit. The amplifier circuit on the receiving side receives the received signal from the antenna 25 via a coupler. The communication control circuit 24 detects information, using the level detection circuit, to specify the RSSI value representing the strength of the received signal (response signal from the RFID tag) received by the antenna 25.

[0083] Next, the configuration of the appearance of the wireless tag communication device 10 according to the embodiment will be described.

[0084] Figure 2 This is a diagram illustrating an example of the configuration of the wireless tag communication device 10 according to the embodiment.

[0085] Figure 2 The wireless tag communication device 10 shown is a portable device that is operated while being held by an operator. Figure 2 The wireless tag communication device 10 shown is used, for example, as a search device for RFID tags or items with RFID tags attached.

[0086] exist Figure 2 In the illustrated configuration example, the wireless tag communication device 10 is used when an information terminal 28 is installed on the reading device (base device) 120. The reading device 120 includes... Figure 1 Other devices besides the information terminal 28 shown. The reading device 120 includes a housing on which an antenna 25 is provided. For example, in the reading device 120, the antenna 25 is configured to... Figure 2 The direction of arrow a is the strongest. Here, the direction of arrow a is taken as the front (front) direction of the wireless tag communication device 10. Furthermore, the front direction of the wireless tag communication device 10 is set to the orientation of the antenna 25.

[0087] Reading device 120 in Figure 1 Based on the configuration of the control system shown, it includes a gripping part 121 and a holding part 122. The gripping part 121 is the part held by the operator. The holding part 122 is configured by a clamp that holds the information terminal 28. The holding part 122 holds the information terminal 28 so that the display screen of the display 114 faces the operator holding the gripping part 121. The wireless tag communication device 10 is operated by the operator holding the gripping part 121 with the information terminal 28 installed in the holding part 122.

[0088] The wireless tag communication device 10 is operated by an operator who continuously reads RFID tags. For example, the operator holding the grip unit 121 changes the position (location of the device) of the wireless tag communication device 10, which is equipped with antenna 25, and the orientation of the antenna. The wireless tag communication device 10 repeatedly reads RFID tags while simultaneously deducing the direction in which the RFID tag exists (tag orientation) and the location of the device.

[0089] The wireless tag communication device 10 infers the direction in which the RFID tag is located (tag orientation) from the reading results of the RFID tag. For example, the wireless tag communication device 10 infers the tag orientation of the RFID tag based on the direction (antenna orientation) where the RSSI value is the largest in the reading results of a specified RFID tag. Alternatively, the wireless tag communication device 10 may also infer the tag orientation of the RFID tag based on the center value of the range in which the specified RFID tag is read (antenna orientation).

[0090] The wireless tag communication device 10 uses self-prediction technology to estimate its own location. In this embodiment, the wireless tag communication device 10 uses spatial recognition technology to estimate its own location using images captured by the camera 29 and information detected by the sensor 23. For example, the wireless tag communication device 10 estimates its own location (the location of the device) using a self-location estimation method used in AR (Augmented Reality) technology. However, the method and configuration used by the wireless tag communication device 10 to estimate its own location are not particularly limited, as long as it can estimate its own location indoors or elsewhere.

[0091] The wireless tag communication device 10 stores the reading results of the RFID tags that have been read and set as search targets in the memory 22. When the wireless tag communication device 10 receives a response signal from the specified RFID tag, it stores information such as tag information, tag orientation, the device's position, RSSI value, and phase value as reading results.

[0092] The wireless tag communication device 10 infers the tag orientation and its own position simultaneously with the RFID tag being searched. Based on the inferred tag orientation and the device's position, the wireless tag communication device 10 infers the location where the RFID tag being searched exists. For example, the wireless tag communication device 10 calculates the RFID tag's position (tag detection position) based on changes in its own position and the inferred tag orientation at each position. As a specific example, the wireless tag communication device 10 uses triangulation techniques to infer the RFID tag's position based on the tag orientation inferred from a first position and the tag orientation inferred from a second position.

[0093] The wireless tag communication device 10 displays an image on the display 114 representing the estimated location of the RFID tag. The wireless tag communication device 10 calculates the location (tag detection location) of the RFID tag being searched in the image (first image) captured by the camera 29. The wireless tag communication device 10 displays the image (first image) captured by the camera 29 and a second image representing the detection location of the tag in the first image on the display 114.

[0094] The second image is either a masked image that covers the area outside the explicitly indicated area using the tag's detection position as a reference point, or a marker image representing the detection position. For example, the wireless tag communication device 10 generates a masked image representing the tag's detection position as a second image based on the brightness or illuminance measured by the sensor 31. Additionally, the wireless tag communication device 10 generates a second image representing the tag's detection position, such as a marker image or a guide image, using colors corresponding to the color information of the image captured by the camera 29. Furthermore, the wireless tag communication device 10 can also select a second image representing the tag's detection position from multiple patterned marker images based on the color information of the image captured by the camera 29.

[0095] The following describes examples of the guide screen display (first, second, and third display examples) when the second image is a masked image covering an area outside the explicitly indicated area.

[0096] The masking image, serving as the second image, is generated by masking areas outside the display area (masked areas) with a masking density corresponding to the brightness (or illuminance) in the first image. The masking process, which masks the masked areas, is image processing that renders the masked areas semi-transparent by setting a masking density (transparency) corresponding to the brightness of the first image. Alternatively, the masking process can also be image processing that blurs the masked areas by setting a masking density corresponding to the brightness of the first image. Furthermore, the masking process can also be image processing that gradually masks the masked areas with a brightness gradient centered on the label's detection position.

[0097] The masking density is set based on the brightness or illuminance of the first image as a sensor value detected by sensor 31. For example, the masking density can be set based on the average or maximum brightness of the entire first image as set by sensor 31. Alternatively, the masking density can be set based on the average or maximum brightness of the masked area in the first image. Furthermore, the masking density can also be set based on the average or maximum brightness of a predetermined area (guided display area) in the first image.

[0098] Next, a first display example of the wireless tag communication device 10 shown on the guide screen of the display 114 will be described.

[0099] Figure 3 , Figure 4 and Figure 5 This is a diagram showing a first display example of a guide screen displayed on a display 114 by a wireless tag communication device 10.

[0100] Figure 3 This is a first display example of a guide screen displayed on display 114 when the RFID tag T of the searched object is detected (read). Figure 3In the first explicit example shown, the reading range of the RFID tag T in the image captured by camera 29 (first image) is used as the explicit area. Figure 3 In the first display example shown, the area outside the reading range is used as the masking area, and the masked image (second image) that has been masked is superimposed on the first image. Figure 3 The masked image shown as the second image has a masking density (transparency) set based on the brightness measured by sensor 31.

[0101] In addition, Figures 3 to 5 In the first display example shown, the guide screen displays a character message MEA indicating that the RFID tag T, which is the search target, has been detected (read). In this first display example, the character message MEA informs the user that the RFID tag T, which is the search target (of a product), has been found within the range of the first image. In this first display example, the character message MEA is displayed in a predetermined area (the guide display area) defined by the upper region of the first image.

[0102] Figure 4 This is the first example of a guide screen displayed when the direction (tag orientation) of the RFID tag T of the searched object is locked. Figure 4 In the first example shown, in the image captured by camera 29, a clearly defined area containing the inferred tag orientation is set, and an image (second image) is displayed that treats the area outside this area as a masked area. That is, when the wireless tag communication device 10 locks the tag orientation, the display 114 narrows the clearly defined area and displays (updates) a guide screen that enlarges the masked area. Thus, the operator can easily and intuitively identify the area where the tag orientation is locked.

[0103] Figure 5 This is the first example of a guide screen displayed when the shooting direction of camera 29 changes. Figure 5 This is when the shooting direction of camera 29 changes, from... Figure 4 The diagram shows an example of a guide screen transition. In the guide screen, the processor 21 displays the image captured by the camera 29 at a predetermined frame rate as the first image. Therefore, when the shooting direction of the camera 29 changes in the left-right direction through the operator's operation, the first image (the image captured by the camera 29) displayed on the guide screen changes.

[0104] When a first image with a changed camera orientation is displayed (updated) in the guide screen, the position of the label on the guide screen also changes. Therefore, the processor 21 updates the occlusion area displayed as the second image in response to the change in the camera orientation of the camera 29 displayed on the monitor 114.

[0105] For example, if the camera 29's shooting direction changes in the left-right direction, the label's direction relative to the antenna also changes in the left-right direction. The processor 21 changes the visible and obscured areas in the guide screen based on the relative position of the label, which changes according to the camera 29's shooting direction. According to this first display example, by changing the obscured area according to the camera 29's shooting direction, the visible area containing the label's direction can be displayed easily and intuitively.

[0106] Next, a second display example of the wireless tag communication device 10 involved in the embodiment displayed on the guide screen of the display 114 will be described.

[0107] Figure 6 , Figure 7 and Figure 8 This is a second display example of a guide screen displayed on a display 114 by the wireless tag communication device 10.

[0108] The second display example is a guide screen showing the change in the visible area in an image captured by camera 29, with the location of RFID tag T as the reference point. The second display example shows a second image in such a way that the visible area becomes larger the closer it is to RFID tag T. In the second display example, the second image is generated through image processing (masking processing) of the masked area as described above.

[0109] In addition, Figures 6 to 8 In the guide screen of the second display example shown, a character message MEA is displayed indicating that the RFID tag T, which is the search target, has been detected (read). The character message MEA in the second display example is the same as that in the first display example, informing the user that the RFID tag T (of the product) has been found within the range of the first image. In addition, the character message MEA in the second display example is also displayed in a predetermined area (the guide display area) set above the first image.

[0110] Figure 6 This is a second example of a guide screen displayed on display 114 when the distance to the location of the RFID tag T, which is the target of the search, is a first distance. Figure 7 This is a second display example of a guide screen displayed on display 114 when the distance to the location of the RFID tag T, which is the target of the search, is a second distance that is closer than the first distance. Figure 8 This is a second example of a guide screen displayed on display 114 when the distance to the location of the RFID tag T, which is the target of the search, is a third distance that is closer than the second distance.

[0111] exist Figure 6In the guide screen shown, the explicit area in the image captured by camera 29, with the location (presumed location) of the RFID tag as the base point, is set with a first size corresponding to the first distance.

[0112] exist Figure 7 In the shown guide screen, the explicit area in the image captured by camera 29, with the location of the RFID tag as the reference point, is set to a second size corresponding to a second distance. In the second display example, the second size corresponding to the second distance is larger than the first size corresponding to the first distance.

[0113] in addition, Figure 7 The first image displayed on the guide screen is the same as... Figure 6 The image shown in the guide screen is magnified compared to the first image displayed. This is because the distance between the camera 29 and the RFID tag is greater than that shown in the image. Figure 6 The guide screen shown is compared to the display. Figure 7 The guide screen shown is recent. Therefore, in Figure 7 In the shown guide screen, the image (first image) surrounding the RFID tag T in the explicit area with the RFID tag as the base point is compared with... Figure 6 Compared to the guide screen shown, it is displayed in an enlarged state.

[0114] exist Figure 8 In the shown guide screen, the explicit area in the image captured by camera 29, with the position of RFID tag T as the base point, is set as the third size corresponding to the third distance. In the second display example, the third size corresponding to the third distance is larger than the second size corresponding to the second distance. Additionally, in the example shown... Figure 8 The image (first image) displayed in the explicit area shown in the guide screen is displayed as... Figure 7 The image shown in the guide screen is a clear image compared to the magnified image.

[0115] Figures 6 to 8 In the second illustrated display example, as the operator holding the wireless tag communication device approaches the target RFID tag T, the clearly visible area around the RFID tag T is magnified. Thus, the operator moves closer to the target RFID tag T until the area around the target RFID tag T can be reliably identified. As a result, even an operator unfamiliar with the operation of the device can easily locate the target RFID tag T.

[0116] Next, a third display example of the wireless tag communication device 10 shown on the guide screen of the display 114 will be described.

[0117] Figure 9 , Figure 10 and Figure 11This is a third display example of a guide screen displayed on a display 114 by the wireless tag communication device 10.

[0118] The third display example is another example of a guide screen showing changes in the indicated area in an image captured by camera 29, with the location of the RFID tag T as the reference point. The third display example shows a second image in a manner where the indicated area becomes smaller the closer it is to the RFID tag T. In the third display example, the second image is generated through image processing (masking processing) of the masked area as described above.

[0119] In addition, Figures 9 to 11 The guidance screen in the third display example also shows the text of the RFID tag T that has been detected (read) as the search target. The guidance shown in the third display example is displayed in a predetermined area (the guidance display area) set above the area in the first image.

[0120] In addition, Figures 9 to 11 The third display example also shows a guide screen displaying a character message MEA indicating that the RFID tag T, the target of the search, has been detected (read). The MEA in the third display example is the same as in the first display example, informing the user that the RFID tag T (of the product) has been found within the range of the first image. Furthermore, the MEA in the third display example is also displayed in a predetermined area (the guide display area) set above the first image.

[0121] Figure 9 This is a third example of a guide screen displayed on display 114 when the distance to the location of the RFID tag T, which is the target of the search, is a first distance. Figure 10 This is a third example of a guide screen displayed on display 114 when the distance to the location of the RFID tag T, which is the target of the search, is a second distance that is closer than the first distance. Figure 11 This is a third display example of a guide screen displayed on display 114 when the distance to the location of the RFID tag T, which is the target of the search, is a third distance that is closer than the second distance.

[0122] exist Figure 9 In the guidance screen shown, in the image captured by camera 29, the explicit area with the position (presumed position) of RFID tag T as the base point is set as the first size corresponding to the first distance.

[0123] exist Figure 10In the shown guide screen, the explicit area in the image captured by camera 29, with the position of RFID tag T as the base point, is set to a second size corresponding to the second distance. In the third display example, the second size corresponding to the second distance is smaller than the first size corresponding to the first distance.

[0124] Figure 10 The first image displayed on the guide screen is the same as... Figure 9 The guided screen shown is a magnified version of the first image compared to the displayed image. This is because the distance between the camera 29 and the RFID tag T is different from the displayed image. Figure 9 The guide screen shown is compared to the display. Figure 10 The guide screen shown is recent. Therefore, in Figure 10 In the shown guide screen, within the clearly defined area of ​​the second size, which is smaller than the first size, the image surrounding the RFID tag T (the first image) is compared to... Figure 9 Compared to the guide screen shown, it is displayed in an enlarged state.

[0125] exist Figure 11 In the shown guide screen, the explicit area in the image captured by camera 29, with the position of RFID tag T as the base point, is set as the third size corresponding to the third distance. In the third display example, the third size corresponding to the third distance is smaller than the second size corresponding to the second distance. Additionally, in... Figure 11 In the guide screen shown, the setting is compared to Figure 10 The guide screen shown displays a small area of ​​explicit information, which is similar to... Figure 10 The guide screen shown is compared to the enlarged image.

[0126] Figures 9 to 11 In the third illustrated display example, as the operator holding the wireless tag communication device approaches the target RFID tag T, the visible area around the RFID tag T is reduced in size. Thus, the operator approaches the target RFID tag T until it is easily and visually confirmed at the positioning point. As a result, the operator can move while visually locking the position of the RFID tag T in the guided image, making it easy to find the target RFID tag T even for those unfamiliar with the device's operation.

[0127] In addition, although Figure 6 , Figure 7 and Figure 8 In the guide screen of the second display example shown, the highlighted area is set as a circular area, but the shape of the highlighted area is not limited to a specific shape. For example, in Figure 6 , Figure 7 and Figure 8 The explicit area in the guide screen of the second display example shown can also be set to a shape such as a rectangle or a polygon.

[0128] In addition, although Figure 9 , Figure 10 and Figure 11 In the shown guide screen, the explicit area is set as a rectangular area, but the shape of the explicit area is not limited to a specific shape. For example, it can also be... Figure 9 , Figure 10 and Figure 11 The explicit area in the guide screen of the third display example shown is set to a shape such as a circle.

[0129] Next, a first action example will be described regarding the wireless tag communication device 10 according to the embodiment, which displays a guide screen including a second image as a masking image, as shown in the first, second, and third display examples.

[0130] Figure 12 This is a flowchart illustrating a first operational example of the wireless tag communication device 10 involved in the embodiment.

[0131] The processor 21 of the wireless tag communication device 10 operates in search mode based on the operator's instructions. In search mode, the processor 21 receives settings (ACT11) based on the operator's selection of the RFID tag as the search target. The operator uses an input device 115 or similar device to specify information about the RFID tag as the search target. The processor 21 sets the RFID tag as the search target according to the operator's specifications.

[0132] In addition, the processor 21 receives various setting instructions for reading RFID tags that are the search targets. The operator uses the input device 115, etc., to specify the action settings for reading RFID tags. The processor 21 performs the action settings for reading RFID tags according to the operator's specifications (ACT12).

[0133] After executing the RFID tag as the search target and setting the action, the processor 21 of the wireless tag communication device 10 accepts the search start instruction from the operator. The processor 21 of the wireless tag communication device 10 starts the operation (search processing) in search mode according to the operator's instruction to start the search.

[0134] While operating in search mode, processor 21 displays the image (first image) captured by camera 29 on display 114 (ACT13). For example, processor 21 displays the image captured by camera 29 at a predetermined frame rate on display 114. Processor 21 also displays the image (first image) captured by camera 29 on display 114 as the background image in a guide screen.

[0135] Additionally, the processor 21 of the wireless tag communication device 10 executes RFID tag reading processing (ACT14) according to the operator's instruction to start the search. For example, the processor 21 receives responses from each RFID tag within the reading range (communication range) based on the communication control circuit 24 and the antenna 25. The processor 21 determines whether the response received from each RFID tag is from the RFID tag that is the target of the search (ACT15). If no RFID tag that is the target of the search is read (ACT15, NO), the processor 21 returns to ACT14 and repeats the RFID tag reading process.

[0136] Upon reading the RFID tag being searched (ACT15, YES), the processor 21 begins tag location estimation processing and display processing of the second image corresponding to the tag location. The wireless tag communication device 10 of this embodiment estimates the location of the RFID tag being searched based on the tag orientation and the device's position.

[0137] The processor 21 infers the tag orientation (ACT16) based on the direction in which the RFID tag being searched exists. For example, the processor 21 infers the direction in which the RFID tag being searched exists based on information such as the RSSI value and phase value contained in the RFID tag reading results. In addition, the processor 21 stores the inferred tag orientation result in the memory 22.

[0138] Additionally, the processor 21 estimates the current location of the wireless tag communication device as the location of its own device (ACT17). For example, the processor 21 uses spatial recognition technology to estimate the location of its own device from images captured by the camera 29 and detection results from the sensor 23. Furthermore, the processor 21 correlates the estimated location of its own device with the estimated tag orientation and stores the results in the memory 22.

[0139] After inferring the tag orientation and the location of the device, processor 21 infers the tag location (ACT18) as the location where the RFID tag exists (detection location), with the RFID tag as the search target. Processor 21 infers the location (detection location) where the RFID tag exists based on the inferred tag orientation and the location of the device. For example, processor 21 calculates the detection location based on multiple device locations (inferred locations) obtained in a time sequence and the tag orientation at each inferred location.

[0140] The processor 21 sets a specified area (ACT19) based on the inferred tag location, which includes the location where the RFID tag is located, as the search target. That is, the processor 21 specifies the location (tag detection location) of the RFID tag that is presumed to exist in the image (first image) captured by the camera 29. Here, the processor 21 determines the size and shape of the specified area in the first image, with the tag detection location as the base point. For example, the processor 21 may also determine the size and shape of the specified area based on the location of the device and the distance (presumed distance) between the RFID tag and the search target. Thus, the processor 21 sets a specified area in the first image with the designated tag detection location as the base point.

[0141] When the processor 21 sets a visible area indicating the detection location of the tag, it measures the brightness or illuminance in the first image via the sensor 31 (ST19). Based on the brightness or illuminance measured by the sensor 31 as a sensor value, the processor 21 determines the concentration (masking concentration) of the area outside the visible area (ST20). In the first operation example, as... Figures 3 to 11 As shown, the second image is a masked image in which the areas outside the highlighted area are masked with a masking density (transparency) corresponding to the brightness in the first image.

[0142] For example, processor 21 measures the brightness (average or maximum value) of the entire first image. When measuring the overall brightness of the first image, processor 21 sets a masking density corresponding to the overall brightness of the first image. In this case, processor 21 can generate a second image that masks the masked area with an easily observable masking density corresponding to the overall brightness of the first image.

[0143] Additionally, the processor 21 can also measure the brightness (average or maximum value) of the area outside the highlighted area (the occluded area) in the first image. When measuring the brightness of the area outside the highlighted area in the first image, the processor 21 sets the occlusion density based on the brightness of the area outside the highlighted area in the first image. In this case, the processor 21 can generate a second image with an occlusion density that allows for easy observation of the area outside the highlighted area.

[0144] Additionally, the processor 21 can also measure the brightness (average or maximum value) of a predetermined area in the first image. When measuring the brightness of a predetermined area in the first image, the processor 21 sets the masking density based on the brightness of the predetermined area (the guided display area) in the first image. For example, the processor 21 measures the brightness of the guided display area on the first image, where characters or images are displayed. When measuring the brightness of a predetermined area, the processor 21 sets the masking density based on the brightness of the predetermined area. In this case, the processor 21 can generate a second image with a masking density that allows for easy observation of information displayed in the predetermined area, such as the guided display area.

[0145] When the masking concentration is set, the processor 21 causes the display 114 to display a first image and a second image (ACT20) representing the indicated area (detection position) in the first image. For example, the processor 21 generates a second image that masks areas outside the indicated area with a masking concentration set according to the brightness measured by the sensor 31. The processor 21 updates the guide screen displayed on the display 114 by overlaying the second image onto the image captured by the camera 29 (first image). For example, the processor 21 displays the image captured by the camera 29 (first image) on the display 114 in real time. The processor 21 overlays and displays the second image, which masks areas outside the indicated area in the first image with a masking concentration set according to the brightness of the first image, onto the first image.

[0146] When the guide screen displayed on the monitor 114 is updated, the processor 21 again executes the reading process of the RFID tag being searched (ACT23). Here, if there is an indication to end or abort the search process (ACT24, YES), the processor 21 ends the series of search processes.

[0147] When performing an RFID tag read, if there is no indication of search completion (ACT24, NO), processor 21 proceeds to ACT16 and repeats the above process. Processor 21 repeatedly performs tag position estimation and repeatedly displays a guide screen that masks areas outside the indicated area representing the tag's detection position with a masking density corresponding to the brightness. As a result, a first image captured by the camera and a second image showing the updated tag position as the device moves, represented by the indicated area, are displayed on display 114.

[0148] As described above, in the first operating example, the processor of the wireless tag communication device calculates the detection position of the tag of the target object using the detection results of the orientation of the target RFID tag and the position of the device itself. The processor displays a guide screen on the display, which masks the area outside the explicit area representing the detection position of the tag in the image captured by the camera with a masking density corresponding to the brightness. According to the first operating example, the wireless tag communication device can display a guide screen that makes the masked image area easy to observe and intuitively understands the position of the RFID tag of the target object.

[0149] Furthermore, in the first operating example, the processor of the wireless tag communication device changes the size of the set area indicating the detection location of the tag based on the location of the device and the distance to the target RFID tag. According to the first operating example, the wireless tag communication device can intuitively and easily guide the user to the relative distance to the location of the RFID tag being searched in a guide screen that is masked with easily observable density.

[0150] The following describes an example of a guide screen that displays a second image, such as a marker image indicating the detection location of a label or an operation guide image.

[0151] For example, the marker image, as the second image, can be any image representing the location (tag detection position) of the RFID tag being searched in the image captured by camera 29. In this embodiment, the marker image, as the second image, is displayed in a color that is easily visually identifiable, even when overlaid on the image captured by camera 29. That is, the wireless tag communication device 10 displays the marker image, as the second image, on display 114 using a color set according to the color information of the image captured by camera 29. For example, the marker image, as the second image, is generated using a color set according to the color information of the image captured by camera 29. Alternatively, the marker image, as the second image, can be selected from multiple pre-stored pattern marker images based on the color information of the image captured by camera 29.

[0152] Furthermore, the operation guide image for the second image, like the tag image described above, can be displayed in easily visually recognizable colors even when overlaid on the image captured by camera 29 (the first image). That is, the wireless tag communication device 10 can also display the operation guide image for the second image on the display 114 in colors set according to the color information of the image captured by camera 29.

[0153] Next, a fourth display example of the wireless tag communication device 10 shown on the guide screen of the display 114 will be described.

[0154] Figure 13This is a diagram illustrating a fourth display example where the wireless tag communication device 10 displays a guide screen containing an operation guide image on the display 114 as the second image.

[0155] Figure 13 The fourth display example shown is a guide screen that displays an operation guide image (operation guide image IMB and character message MEB) as a second image on an image captured by camera 29 (first image). Figure 13 In the example shown, the operation guidance image IMB displays an image used to urge the user to change the orientation of the wireless tag communication device 10. Additionally, the character message MEB is a message that provides the user with operation guidance for the wireless tag communication device 10 in characters.

[0156] The colors of the operation guidance image IMB and the character message MEB are set based on the color information in the first image. For example, memory 22 stores image data, which is used to display the operation guidance image IMB and the character message MEB as a second image superimposed on the first image. The wireless tag communication device 10 displays the operation guidance image IMB and the character message MEB stored in memory 22 on the display 114 with colors based on the color information in the first image.

[0157] Additionally, the memory 22 can also pre-store display information (image data) of multiple displayable patterns as an operation guidance image IMB and a character message MEB. The display information of multiple patterns includes, for example, image data of an operation guidance image composed of multiple colors and image data of a character message composed of multiple colors. The wireless tag communication device 10 selects the display information to be displayed as the operation guidance image IMB or the character message MEB based on the color information in the first image.

[0158] Furthermore, the wireless tag communication device 10 can also divide the first image into multiple regions and generate (or select) a second image with colors corresponding to the color information in each of the divided regions. For example, such as Figure 13 As shown, the wireless tag communication device 10 is divided into three areas: Ra, Rb, and Rc. Figure 13 In the example shown, area Ra is the area where the character message MEB is displayed, and area Rb is the area where the operation guide image IMB is displayed.

[0159] exist Figure 13 In the example shown, the wireless tag communication device 10 generates (selects) a character message MEB with a color corresponding to the color information of region Ra in the first image. Thus, the wireless tag communication device 10 can display the character message MEB, which serves as a second image, on the first image with a color that is easily visually recognizable.

[0160] In addition, Figure 13 In the example shown, the wireless tag communication device generates (selects) an operation guidance image IMB with a color corresponding to the color information of region Rb in the first image. Thus, the wireless tag communication device can display the operation guidance image IMB, which serves as the second image, on the first image with a color that is easily visually recognizable.

[0161] Figure 14 This is a diagram illustrating a fifth display example where the wireless tag communication device 10 displays a guide screen on the display 114 containing a tag image as a second image.

[0162] Figure 14 The fifth display example shown is a boot screen that overlays the marker image IMC and the character message MEC onto the first image. Figure 14 In the example shown, the tag image IMC is an image representing the detection location of the tag in the first image. Additionally, the character message MEC is a message indicating that a product bearing an RFID tag intended for search has been detected.

[0163] The colors of the display tag image IMC and character message MEC are set based on the color information in the first image. For example, memory 22 stores image data used to display the tag image IMC and character message MEC as a second image superimposed on the first image. The wireless tag communication device 10 displays the tag image IMC and character message MEC stored in memory 22 on display 114 with colors based on the color information in the first image.

[0164] Additionally, the memory 22 can also pre-store display information (image data) of multiple displayable patterns as marker image IMC and character message MEC. The display information of multiple patterns is, for example, image data of a marker image composed of multiple colors and image data of a character message composed of multiple colors. The wireless tag communication device 10 can also select image data to be displayed as marker image IMC and character message MEC based on the color information in the first image.

[0165] Furthermore, the wireless tag communication device 10 can also be compatible with... Figure 14 For each of the regions Ra, Rb, and Rc shown, a second image is generated (or selected) with colors corresponding to the color information of the first image. Figure 14 In the example shown, region Ra is the region where the character message MEC is displayed, and region Rb is the region where the marker image IMC is displayed.

[0166] exist Figure 14In the example shown, the wireless tag communication device 10 generates (selects) a character message MEC based on the color information corresponding to region Ra in the first image. Thus, the wireless tag communication device 10 can display the character message MEC, which serves as the second image, on the first image in a color that is easily visually recognizable.

[0167] In addition, Figure 14 In the example shown, the wireless tag communication device 10 generates (selects) a marker image IMC representing the detection location of the tag using a color corresponding to the color information of region Rb in the first image. Thus, the wireless tag communication device 10 can display the marker image IMC, which serves as a second image, on the first image in a color that is easily visually recognizable.

[0168] Next, a second example of an operation will be described regarding the wireless tag communication device 10 according to the embodiment, which displays a guide screen including a second image such as a fourth display example and a fifth display example.

[0169] Figure 15 This is a flowchart illustrating a second operational example of the wireless tag communication device 10 involved in the embodiment.

[0170] The processor 21 of the wireless tag communication device 10 operates in search mode according to the operator's operation. In search mode, the processor 21 receives settings (ACT31) based on the RFID tag selected as the search target by the operator. The operator uses an input device 115 or the like to specify information indicating the RFID tag selected as the search target. The processor 21 sets the RFID tag selected as the search target according to the operator's specifications.

[0171] In addition, the processor 21 receives various setting instructions for reading RFID tags that are the targets of the search. The operator uses the input device 115, etc., to specify the action settings for reading RFID tags. The processor 21 performs the action settings for reading RFID tags according to the operator's specifications (ACT32).

[0172] After executing the RFID tag selection and action settings, the processor 21 of the wireless tag communication device 10 receives an instruction to start the search based on the operator's instructions. The processor 21 of the wireless tag communication device 10 then begins the search process (search processing) in search mode according to the operator's instructions.

[0173] In search mode operation, processor 21 displays an image (first image) captured by camera 29 on display 114 (ACT33). For example, processor 21 displays an image captured by camera 29 at a predetermined frame rate on display 114. Processor 21 displays the image (first image) captured by camera 29 on display 114 as a background image in a guide screen.

[0174] Additionally, the processor 21 of the wireless tag communication device 10 performs RFID tag reading processing (ACT34) according to the operator-initiated search start instruction. For example, the processor 21 receives responses from each RFID tag within the reading range (communication range) based on the communication control circuit 24 and the antenna 25.

[0175] Furthermore, when the RFID tag reading begins, the processor 21 of the wireless tag communication device 10 analyzes the color information in the image (first image) captured by the camera 29 (ACT35). Based on the color information in the first image, the processor 21 sets the color of a second image, such as a character message or operation guidance image displayed on the first image (ACT36). When the processor 21 sets the color of the second image, it displays a guidance image on the display 114, in which the set color of the second image is superimposed on the first image (ACT37).

[0176] For example, processor 21 divides the first image into predetermined regions and obtains color information for each region. Processor 21 displays a second image, such as a character message or operation guide image, in a color set according to the color information of each region. Processor 21 may also calculate lightness as color information in the first image.

[0177] Alternatively, the area for color analysis can be set according to the display position of the second image superimposed on the first image. For example, the processor 21 displays... Figure 13 In the case of the guidance screen shown, a separate area is set for displaying the character message MEB and the operation guidance image IMB. In this case, the processor 21 can display the character message in a color according to the color information in the display area of ​​the character message MEB. Additionally, the processor 21 can display the operation guidance screen in a color corresponding to the color information in the display area of ​​the operation guidance image IMB.

[0178] Furthermore, after starting the reading of RFID tags, the processor 21 determines whether the response received from each RFID tag is from the RFID tag being searched (ACT38). The processor 21 determines whether a response from the RFID tag being searched has been received from the RFID tag being searched (ACT38). If no RFID tag being searched has been read (ACT38, NO), the processor 21 returns to ACT34 and repeats the reading of RFID tags.

[0179] Upon reading the RFID tag being searched (ACT38, YES), the processor 21 begins the process of inferring the tag's location and displaying a second image representing the tag's location. The wireless tag communication device 10 of this embodiment infers the location of the RFID tag being searched based on the tag's orientation and the device's position.

[0180] The processor 21 infers the tag orientation (ACT39), which is the direction in which the RFID tag exists, and the RFID tag is the search target. For example, the processor 21 infers the orientation of the RFID tag (tag orientation) based on information such as the RSSI value and phase value contained in the RFID tag reading results. In addition, the processor 21 stores the inferred tag orientation result in the memory 22.

[0181] Additionally, the processor 21 estimates the location of its own device based on the current location of the wireless tag communication device (ACT40). For example, the processor 21 uses spatial recognition technology to estimate the location of its own device from images captured by the camera 29 and detection results from the sensor 23. Furthermore, the processor 21 stores the estimated location of its own device in the memory 22, corresponding to the estimated tag orientation.

[0182] After inferring the tag orientation and the location of the device, processor 21 infers the tag location (ACT41) as the location where the RFID tag exists, with the RFID tag as the search target. Processor 21 infers the location where the RFID tag exists (tag detection location) based on the inferred tag orientation and the location of the device. For example, processor 21 calculates the tag detection location based on multiple device locations (inferred locations) obtained in a time sequence and the tag orientation at each inferred location.

[0183] When the processor 21 infers the tag position, it analyzes the color information in the image (first image) captured by the camera 29 (ACT42). Based on the color information in the first image, the processor 21 sets the color of the second image, including the tag image and character messages displayed on the first image (ACT43). When the processor 21 sets the color of the second image, it displays a guide screen on the display 114 that overlays the set color of the second image onto the first image (ACT44).

[0184] Here, the processor 21 of the wireless tag communication device 10 can also divide the first image into predetermined regions and obtain the color information of each region. Furthermore, the divided regions can be set according to the display position of the second image superimposed on the first image. That is, the processor 21 displays the second image, including the tag image and character messages, in colors corresponding to the color information of each region in the first image.

[0185] The processor 21 calculates the brightness of the display area of ​​the marker image in the first image, so as to set the color of the marker image according to the brightness of the display area of ​​the marker image in the first image.

[0186] Additionally, the character message is a message that guides the detection of an RFID tag that is the target of the search. The character message is displayed in the guidance display area of ​​the first image. The processor 21 calculates the brightness of the guidance display area in the first image and sets the color of the character message to correspond to the brightness of the guidance display area in the first image.

[0187] For example, processor 21 in the display Figure 14 In the case of the shown guide screen, a separate area is set for displaying the character message MEC (guide display area) and the marker image IMC. The processor 21 sets the color of the character message MEC to be displayed based on the color information of the display area of ​​the character message MEC in the first image. Therefore, the processor 21 can display the character message MEC superimposed on the first image in an easily observable color. Furthermore, the processor 21 sets the color of the marker image IMC to be displayed based on the color information of the display area of ​​the marker image IMC in the first image. Therefore, the processor 21 can display the marker image indicating the detection position of the tag superimposed on the first image in an easily observable color.

[0188] When the guide screen displayed on the monitor 114 is updated, the processor 21 again executes the reading process of the RFID tag being searched (ACT45). Here, if there is an indication to end or abort the search process (ACT46, YES), the processor 21 ends the series of RFID tag search processes.

[0189] Furthermore, if the processor 21 does not receive an indication that the RFID tag search has ended (ACT46, NO), it proceeds to ACT39 and repeats the above process. The processor 21 repeatedly performs the tag position estimation and repeatedly analyzes the color information in the image (first image) captured by the camera 29. The processor 21 sets the color of the second image, including the marker image and character messages displayed on the first image, based on the color information in the first image (ACT43). As a result, the first image captured by the camera and the second image, which indicates the tag position and is updated with the movement of the device, are displayed on the display 114 in easily observable colors.

[0190] As described above, in the second operational example, the processor of the wireless tag communication device searches for RFID tags within the camera's field of view. While searching for tags, the processor 21 displays a second image, such as operation instructions, on a display screen over the first image captured by the camera, using colors corresponding to the color information in the first image. Thus, the wireless tag communication device can display a guide screen that provides easy-to-observe operation instructions for tag searching.

[0191] Furthermore, in the second operational example, the processor of the wireless tag communication device calculates the detected position of the tag using the detection results of the direction of the tag being searched and the position of the device itself. The processor displays a second image, such as a marker image representing the detected position of the tag, on a display screen on top of a first image captured by a camera, using a color corresponding to the color information in the first image. Thus, the wireless tag communication device can display a guidance screen that makes it easy to observe the detected position of the tag and easily and intuitively understand the position of the tag being searched.

[0192] Furthermore, in the above embodiments, the case where the processor-executed program is pre-stored in the device's internal memory was described. However, the processor-executed program can be downloaded to the device from a network or installed on the device from a storage medium. As the storage medium, any storage medium capable of storing programs and readable by the device, such as a CD-ROM, is acceptable. Additionally, functions obtained through pre-installation or download can be implemented in conjunction with the device's internal OS (operating system).

[0193] While several embodiments of the invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. Furthermore, these embodiments and their variations are included within the scope and spirit of the invention, and are included within the scope of the invention as described in the claims and its equivalents.

Claims

1. A wireless tag communication device, characterized in that, include: Antennas are directional; The communication control circuit communicates with the wireless tag via the antenna; A camera captures a first image in the direction where the antenna's directivity is maximized and the camera's imaging direction is aligned. The sensor detects the brightness in the first image captured by the camera; as well as The processor calculates the detection location of the wireless tag that is the search target in the first image, and displays the first image and the second image on the display, wherein the second image is an image of the first image with a masking density corresponding to the brightness detected by the sensor, covering the area outside the explicit area with the detection location of the wireless tag as the base point.

2. The wireless tag communication device according to claim 1, wherein, The processor calculates the distance between the location of the wireless tag being searched and the location of the wireless tag communication device, and changes the size of the indicated area based on the calculated distance.

3. The wireless tag communication device according to claim 2, wherein, The processor measures the average brightness of the entire first image and sets a masking density corresponding to the average brightness of the entire first image.

4. The wireless tag communication device according to claim 2, wherein, The processor measures the average brightness of the area outside the highlighted area in the first image and sets a masking density corresponding to the average brightness of the area outside the highlighted area in the first image.

5. The wireless tag communication device according to claim 2, wherein, The first image has a display area that displays a message indicating that a wireless tag has been detected as the search target. The processor measures the average brightness of the display area in the first image and sets a masking density corresponding to the average brightness of the display area.

Images