Information processing device and program
By displaying device images and location information on the device selection interface, combined with historical connection records and image update mechanisms, the problem of users having difficulty identifying devices is solved, and a more efficient device connection process is achieved.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-09-02
- Publication Date
- 2026-04-01
AI Technical Summary
Users may find it difficult to identify the device to connect by simply displaying the device string, leading to connection problems.
By displaying the device string along with the device image and installation location, and combining the device's historical connection records, the system dynamically controls the display or hiding of the image and updates the image in a timely manner to improve recognition accuracy.
It improves the convenience and accuracy of user device identification, reduces the possibility of misconnection, and enhances the reliability of device connection.
Smart Images

Figure 0007838234000001 
Figure 0007838234000002 
Figure 0007838234000003
Abstract
Description
Technical Field
[0001] The present invention relates to an information processing apparatus and a program.
Background Art
[0002] A string (for example, a string indicating the name of a device) for identifying a destination device (for example, a printer) is displayed on a terminal device, and a user selects the destination device by referring to the displayed string, and the terminal device may connect to the device selected by the user.
[0003] Patent Document ① describes a system that associates and registers identification information of a device and location information of the device using a network camera.
[0004] Patent Document ② describes a system that registers an Internet-connected printer as a printer to be searched and posts data of the printer on the web.
[0005] Patent Document ③ describes a system that outputs client information and device information of an image forming apparatus at the time of a test print, extracts the respective IP addresses and locations of the client apparatus and the image forming apparatus by photographing the client information and the device information, and registers the client apparatus and the image forming apparatus based on the IP address and the location.
Prior Art Documents
Patent Documents
[0006]
Patent Document ①
Patent Document ②
Patent Document ③
Summary of the Invention
[0007] When a user selects a device to connect to on a terminal device, displaying only a string of characters to identify the device can make it difficult for the user to determine which device is the one they intended to connect to.
[0008] The objective of the present invention is to make it easier for the user to identify the device to connect to, compared to when only a string of characters identifying the device is displayed when the user selects the device to connect to. [Means for solving the problem]
[0009] The invention according to claim 1 has a processor, the processor has a string of characters for identifying the connected device and an image representing the device and the location where the device is installed, The string and the image are obtained from the device in which they are registered. Information processing device that displays on a screen An information processing apparatus characterized by displaying the image on the display or not displaying the image on the display, depending on the history of the device's connection to the equipment. That is the case.
[0010] Reference example of an information processing device The information processing apparatus according to claim 1 is characterized in that the processor further displays access information for accessing the image on the display, and displays the image on the display when the access information is manipulated by the user.
[0011] Another example of an information processing device. The information processing apparatus according to claim 1 or 2, further comprising a memory, wherein the processor, when the device is a device to which the apparatus has previously been connected, stores the image in the memory and displays a string of characters for identifying the connected device on the display, and when the image is not stored in the memory, retrieves the image and displays it on the display, and when the image is stored in the memory, does not display the image on the display.
[0013] Claim 2 The invention relating to this is An information processing device having a processor and memory, wherein the processor acquires a string of characters for identifying a connected device and an image representing the device and the location where the device is installed from a device in which the string of characters and the image are registered, and displays them on a display, The aforementioned processor ,before When the device in question is a device that the device has previously connected to, the image is stored in the memory and a string of characters for identifying the connected device is displayed on the display. In this case, for devices that the device has previously connected to, the image stored in the memory is displayed on the display. The feeling It is an information processing device.
[0014] Claim 3 The invention relating to this invention is characterized in that, when the image is stored in an image storage device for storing images, the processor further displays a string of characters for identifying a connected device on the display, and if the image has not been updated in the image storage device and is stored in the memory, it displays the image stored in the memory on the display, and if the image has been updated in the image storage device, it retrieves the updated image from the image storage device and displays it on the display. 2 This is the information processing device described above.
[0015] Claim 4 The invention relating to the present invention is characterized in that the image is stored in an image storage device that stores images, and the image is associated with location information indicating the location of the device, and the processor further requests the image storage device to update the image with the other image when it acquires another image representing the device and the location where the device is installed, provided that the location information associated with the other image falls within the acceptable range of the location information associated with the image. 3 It is an information processing device described in any one of the items.
[0016] Claim 5The invention according to claim [claim number] is characterized in that the processor further causes the display to display information for guiding the user to take the other image, and requests the image storage device to update the image with the other image when the position information associated with the other image generated by the photographing is included within the allowable range of the position information associated with the image. 4 The information processing apparatus according to claim [claim number].
[0017] Claim 6 The invention according to claim [claim number] is characterized in that the image is an image generated by photographing, and when the image generated by photographing is not an image capable of identifying the device and the location where the device is installed, the processor causes the display to display information prompting the user to take a photograph again. 5 The information processing apparatus according to any one of claims 1 to [claim number].
[0018] Claim 7 The invention according to claim [claim number] is a program for causing a computer to operate so as to display, on a display, a character string for identifying a connected device and an image representing the device and the location where the device is installed. The string and the image are obtained from the device in which they are registered. A program characterized in that, depending on the history of the computer's connection to the device, it displays the image on the display or does not display the image on the display.
Advantages of the Invention
[0019] According to the invention of claim 1, 7 when the user selects a connected device, it is easier to identify the connected device compared to the case where only the character string for identifying the connected device is displayed. Furthermore, the display of images can be controlled according to the device's usage history.
[0020] Reference example According to [claim number], when the connected device is a device that the own device has never connected to, it is easier to identify the device compared to the case where only the character string for identifying the device is displayed.
[0022] According to the invention of claim [claim number], 2 the image can be displayed without acquiring the image from an external device.
[0023] Claim 3 According to the invention, if the image has not been updated, the image can be displayed without acquiring the image from an external device, and if the image has been updated, the updated image can be displayed.
[0024] Claim 4 According to the invention, the image can be updated using location information indicating the position of the device.
[0025] Claim 5 According to the invention, the image can be updated with another image obtained in response to guidance given to the user.
[0026] Claim 6 According to the invention, compared to cases where the user is not prompted to take another picture, there is a higher probability of obtaining an image that can identify the device and the location. [Brief explanation of the drawing]
[0027] [Figure 1] This is a block diagram showing the configuration of the information processing system according to the embodiment. [Figure 2] This is a block diagram showing the configuration of an information management device. [Figure 3] This is a block diagram showing the configuration of a terminal device. [Figure 4] This is a block diagram showing the configuration of the equipment. [Figure 5] This is a flowchart showing the device registration process. [Figure 6] This is a flowchart showing the process for searching for equipment. [Figure 7] This is a diagram showing an image of the equipment. [Figure 8] This is a diagram showing an image of the equipment. [Figure 9] This is a diagram showing an image of the equipment. [Figure 10] This is a diagram showing a database of equipment information. [Figure 11] This is a diagram showing the results of the equipment search. [Figure 12] This is a diagram showing the results of the equipment search. [Figure 13] This diagram shows the screen for connecting. [Figure 14] This is a diagram of the equipment. [Figure 15] This diagram shows the screen for connecting. [Figure 16] This is a diagram showing the screen used for shooting. [Figure 17] This is a diagram showing the registration screen. [Figure 18] This diagram shows the flow of the image recognition process. [Modes for carrying out the invention]
[0028] The information processing system according to the embodiment will be described with reference to Figure 1. Figure 1 shows an example of the configuration of the information processing system according to the embodiment.
[0029] The information processing system according to this embodiment includes an information management device 10, a terminal device 12, and one or more devices. In the example shown in Figure 1, the information processing system includes, for example, devices 14A, ..., and 14M. Hereinafter, when it is not necessary to distinguish between devices 14A, ..., and 14M, each device will be referred to as "device 14". Although one terminal device 12 is shown in Figure 1, multiple terminal devices 12 may be included in the information processing system. The information management device 10 may consist of one device or multiple devices.
[0030] The information management device 10, terminal device 12, and equipment 14 have the function of communicating with other devices. This communication may be wired communication using cables or wireless communication. In other words, each device may be physically connected to other devices by cables to send and receive information, or it may send and receive information by wireless communication. Wireless communication includes, for example, short-range wireless communication and Wi-Fi (registered trademark). Short-range wireless communication includes, for example, Bluetooth (registered trademark) and RFID (Radio Frequency Identifier). In the example shown in Figure 1, each device communicates with other devices via a communication path N such as a LAN (Local Area Network) or the Internet.
[0031] The information management device 10 is a device that manages information related to the device 14. Hereinafter, the information related to the device 14 will be referred to as "device information".
[0032] The device information includes, for example, information indicating a string to identify device 14, and an image representing device 14 and the location where device 14 is installed. The device information may further include information indicating the performance and functions of device 14, and information indicating the location where device 14 is installed. Hereinafter, the image representing device 14 and the location where device 14 is installed will be referred to as the "device image".
[0033] The string used to identify device 14 may be, for example, a string indicating the name of device 14, a string indicating the IP address of device 14, or a string indicating the MAC address of device 14. Images representing the name, IP address, or MAC address may be included in the device information along with the information indicating these strings, or in place of the information indicating these strings. The IP address of device 14 is an example of information for connecting to device 14.
[0034] Information indicating the location where the device 14 is installed includes, for example, location information of the device 14 obtained using GPS (Global Positioning System), or information indicating the location (e.g., room) where the device 14 is installed within a building.
[0035] The equipment image includes, for example, an image that represents the characteristics of the location where the equipment 14 is installed, and is an image that can identify the equipment 14 and the location where the equipment 14 is installed. The equipment image may show the external appearance of the equipment 14, or it may show the internal structure of the equipment 14.
[0036] Information other than the device image, that is, information other than images representing the external appearance and internal structure of the device 14, is included in the device information as information indicating a string to identify the device 14, or information other than a string to identify the device 14.
[0037] The terminal device 12 is, for example, a personal computer (hereinafter referred to as "PC"), a tablet PC, a smartphone, or a mobile phone.
[0038] Device 14 may include, for example, a printer, scanner, copier, facsimile, multifunction device (e.g., a device with functions such as printing, scanning, and copying), PC, display, home appliance (e.g., air conditioner, lighting, refrigerator, etc.), or other devices. These are merely examples of devices 14, and other devices may also be included in the information processing system as devices 14.
[0039] In this embodiment, device information is stored in the information management device 10. For example, the device information of each of the multiple devices 14 is stored in the information management device 10, and the device information of each of the multiple devices 14 is managed by the information management device 10.
[0040] When a user requests a search for device 14 using terminal device 12, the device information of the searched device 14 is displayed on terminal device 12. For example, a string to identify the searched device 14 (e.g., a string indicating the name of device 14 or an IP address) and an image of the device 14 and the location where it is installed are displayed on terminal device 12.
[0041] The hardware configuration of the information management device 10 will be described below with reference to Figure 2. Figure 2 shows an example of the hardware configuration of the information management device 10.
[0042] The information management device 10 includes, for example, a communication device 16, a UI 18, a memory 20, and a processor 22.
[0043] The communication device 16 is a communication interface having a communication chip, communication circuit, etc., and has the function of transmitting information to other devices and receiving information from other devices. The communication device 16 may have wireless communication capabilities or wired communication capabilities. The communication device 16 may communicate with other devices, for example, by using short-range wireless communication, or by communicating with other devices via a communication path N.
[0044] UI18 is a user interface and includes at least one of a display and an input device. The display is a liquid crystal display or an EL display, etc. The input device is a device such as a keyboard or a pointing device (e.g., mouse, trackball, touch pad, pen tablet, etc.). UI18 may also be a UI such as a touch panel that combines a display and an input device. UI18 may also include a microphone and a speaker.
[0045] Memory 20 is a device that constitutes one or more storage areas for storing data. Memory 20 is, for example, a hard disk drive (HDD), a solid state drive (SSD), various types of memory (e.g., RAM, DRAM, or ROM), other storage devices (e.g., optical discs), or a combination thereof. One or more memories 20 are included in the information management device 10.
[0046] Device information is stored in memory 20. For example, device information for each device 14 is stored in memory 20, and a database (DB) of device information is constructed. The information management device 10 is an example of an image storage device.
[0047] The processor 22 is configured to control the operation of each part of the information management device 10. The processor 22 may also have memory.
[0048] For example, in response to a search request from the terminal device 12, the processor 22 searches the device information database for device information, extracts the device information, and transmits the extracted device information to the terminal device 12. The processor 22 may also display the extracted device information on the terminal device 12.
[0049] The hardware configuration of terminal device 12 will be described below with reference to Figure 3. Figure 3 shows an example of the hardware configuration of terminal device 12.
[0050] The terminal device 12 includes, for example, a communication device 24, a UI 26, a memory 28, and a processor 30.
[0051] The communication device 24 is a communication interface having a communication chip, communication circuit, etc., and has the function of transmitting information to other devices and receiving information from other devices. The communication device 24 may have wireless communication capabilities or wired communication capabilities. The communication device 24 may communicate with other devices, for example, by using short-range wireless communication, or by communicating with other devices via a communication path N.
[0052] UI26 is a user interface and includes at least one of a display and an input device. The display is a liquid crystal display or an EL display, etc. The input device is a device such as a keyboard or a pointing device (e.g., mouse, trackball, touch pad, pen tablet, etc.). UI26 may also be a UI such as a touch panel that combines a display and an input device. UI26 may also include a microphone and a speaker.
[0053] Memory 28 is a device that constitutes one or more storage areas for storing data. Memory 28 is, for example, a hard disk drive (HDD), a solid state drive (SSD), various types of memory (e.g., RAM, DRAM, ROM, etc.), other storage devices (e.g., optical discs, etc.), or a combination thereof. One or more memory 28 are included in the terminal device 12.
[0054] The processor 30 is configured to control the operation of each part of the terminal device 12. The processor 30 may also have memory.
[0055] The terminal device 12 is used by the user. For example, the processor 30 of the terminal device 12 accesses the device 14 according to the user's instructions, requests the device 14 to execute a process, sends information to the device 14, and receives information from the device 14. The processor 30 also displays the device information received from the information management device 10 on the UI 26 display. For example, the processor 30 displays a string to identify the device 14 and an image of the device 14 on the UI 26 display.
[0056] The device information for each device 14 may be stored in the memory 28 of the terminal device 12. In this case, the processor 30 of the terminal device 12 may display the device information stored in the memory 28 on the display of the UI 26.
[0057] The hardware configuration of device 14 will be described below with reference to Figure 4. Figure 4 shows an example of the hardware configuration of device 14. In this example, device 14 is a printer, or a multifunction device including a printer.
[0058] The device 14 shown in Figure 4 includes, for example, a communication device 32, a UI 34, a memory 36, a processor 38, and a print unit 39.
[0059] The communication device 32 is a communication interface having a communication chip, communication circuit, etc., and has the function of transmitting information to other devices and receiving information from other devices. The communication device 32 may have wireless communication capabilities or wired communication capabilities. The communication device 32 may communicate with other devices, for example, by using short-range wireless communication, or by communicating with other devices via a communication path N.
[0060] UI34 is a user interface and includes at least one of a display and an input device. The display is a liquid crystal display or an EL display, etc. The input device is a device such as a keyboard or a pointing device (e.g., mouse, trackball, touch pad, pen tablet, etc.). UI34 may also be a UI such as a touch panel that combines a display and an input device. UI34 may also include a microphone and a speaker.
[0061] Memory 36 is a device that constitutes one or more storage areas for storing data. Memory 36 is, for example, a hard disk drive (HDD), a solid state drive (SSD), various types of memory (e.g., RAM, DRAM, ROM, etc.), other storage devices (e.g., optical discs, etc.), or a combination thereof. One or more memory 36 are included in the device 14.
[0062] The processor 38 is configured to control the operation of each part of the device 14. The processor 38 may have memory.
[0063] The printing unit 39 forms the image or document to be printed on a recording medium such as paper. This prints the image or document onto the recording medium. The printing method can be any method. For example, the printing unit 39 prints according to methods such as inkjet, electrophotography, thermal, or thermal transfer.
[0064] For example, print data including the image or document to be printed and the print conditions is transmitted from the terminal device 12 to the device 14, and the print unit 39 prints the image or document onto the recording medium.
[0065] The device 14 shown in Figure 4 includes a scanner and may generate or copy images by scanning. The images may be transmitted to the terminal device 12. The device 14 may also include a facsimile machine.
[0066] The following provides a detailed explanation of the processing performed by the information processing system.
[0067] (Registration of device 14) Referring to Figure 5, the process for registering device 14 with the information management device 10 will be explained. Figure 5 is a flowchart showing the registration process for device 14.
[0068] First, the administrator starts the registration process for the device 14 using the administrator terminal device 12 (S01). For example, application software for registering the device 14 with the information management device 10 is installed on the terminal device 12, and the processor 30 of the terminal device 12 starts the application software in accordance with the administrator's startup instruction. As a result, a registration screen is displayed on the display of the terminal device 12.
[0069] Next, the administrator photographs the device 14 to be registered with a camera (S02). For example, if the terminal device 12 is equipped with a camera, the administrator photographs the device 14 to be registered with the camera on the terminal device 12. At this time, the administrator photographs the device 14 and the location where the device 14 is installed so that both the device 14 and the location where the device 14 is installed are captured in the image. For example, the administrator photographs the device 14 together with its surroundings using the camera. This generates an image of the device. Alternatively, the device 14 to be registered may be photographed with a camera not provided on the terminal device 12, and the resulting image of the device may be sent to the terminal device 12.
[0070] Next, when the administrator gives an instruction to register the device 14 to be registered, the processor 30 of the terminal device 12 transmits the device information of the device 14 to the information management device 10 (S03). This device information includes the device image generated by the capture in step S02. The administrator also inputs a string to identify the device 14 to be registered (for example, a string indicating the name or IP address of the device 14), information indicating the performance and functions of the device 14, and information indicating the location where the device 14 is installed, on the registration screen displayed on the display of the terminal device 12. The information entered here is included in the device information of the device 14 and transmitted to the information management device 10. The terminal device 12's GPS function may acquire its location information, and this location information may be included in the device information as information indicating the location where the device 14 is installed. Furthermore, the processor 30 of the terminal device 12 may acquire and include in the device information information information that indicates a string of characters for identifying the device 14, information indicating the performance and functions of the device 14, and information indicating the location where the device 14 is installed.
[0071] When the processor 22 of the information management device 10 receives device information transmitted from the terminal device 12, it stores the device information in the memory 20 of the information management device 10 and registers the device information in the device information database (DB) built in the information management device 10 (S04). As a result, the device 14 to be registered is registered in the information management device 10.
[0072] If device 14 is a printer, the device information of the printer is registered in the information management device 10. For example, a string indicating the name of the printer, the IP address of the printer, information indicating the performance and functions of the printer, information indicating the location where the printer is installed, and a device image representing the printer and the location where it is installed are registered in the information management device 10 as the device information of the printer.
[0073] For example, when equipment 14 is installed, equipment 14 is photographed and its equipment information is registered in the information management device 10. Alternatively, equipment 14 may be photographed and its equipment information registered in the information management device 10 when it is being maintained, or it may be photographed periodically and its equipment information registered in the information management device 10. Of course, the administrator may also photograph equipment 14 and register its equipment information in the information management device 10 at any time they choose. If the equipment information for equipment 14 is already registered in the information management device 10, equipment 14 may be photographed again and its equipment information registered in the information management device 10 may be updated.
[0074] (Search for device 14) The following describes the process for searching for device 14, referring to Figure 6. Figure 6 is a flowchart showing the search flow for device 14.
[0075] First, a user who wishes to use device 14 instructs their terminal device 12 to search for the device 14 to connect to (S11). For example, the user instructs their terminal device 12 to search for devices 14 connected to the same network as their terminal device 12. For example, application software for using device 14 is installed on the user's terminal device 12, and the processor 30 of the terminal device 12 starts the application software in accordance with the user's startup instruction. The user gives a search instruction on the application software. If the device 14 to connect to is a printer, print application software is installed on the terminal device 12, and the print application software is started, and the user instructs it to search for the printer to connect to. Note that for the sake of explanation, the administrator's terminal device 12 and the user's terminal device 12 are given the same designation, but the administrator and the user each use their own terminal device 12.
[0076] When a user gives a search instruction, the processor 30 of the terminal device 12 requests the information management device 10 to acquire device information by sending information indicating a request to acquire device information (S12).
[0077] The processor 22 of the information management device 10 searches the device information database (DB) for device information of devices 14 connected to the same network as the user's terminal device 12, and retrieves the retrieved device information (S13, S14). In other words, the processor 22 of the information management device 10 retrieves device information of devices 14 connected to the same network as the user's terminal device 12 from the memory 20 of the information management device 10. For example, the processor 22 of the information management device 10 searches for device information of devices 14 that have the same network address as the user's terminal device 12.
[0078] Next, the processor 22 of the information management device 10 transmits the device information obtained from the device information database to the user's terminal device 12 (S15).
[0079] When the processor 30 of the user's terminal device 12 receives device information from the information management device 10, it displays the device information on the display of the terminal device 12 (S16). As a result, a string of characters for identifying the device 14 and an image of the device are displayed on the display. If device information for multiple devices 14 is obtained from the database and sent to the user's terminal device 12, the processor 30 of the terminal device 12 displays a list of the device information on the display of the terminal device 12.
[0080] The user selects the device 14 to connect to by referring to the device information displayed on the terminal device 12's display (S17). Since the device image included in the device information is displayed on the display, the user may compare the device image with the actual scenery to select the device 14 that they intend to use. For example, if device 14 is installed in front of the user, the user may compare the scenery represented in the device image (i.e., device 14 and the scenery around it) with the actual scenery in front of them to determine whether the device 14 installed in front of the user is the device 14 that the user intends to use. If the user determines that the device 14 installed in front of them and the scenery around it match or are similar to the device 14 and scenery represented in the device image, then it is highly likely that the device 14 installed in front of the user is the device 14 that the user intends to use.
[0081] When a user selects a device 14 from a list of device information, the processor 30 of the user's terminal device 12 connects to the selected device 14 via the network. The device information for the device 14 includes the IP address of the device 14 as information for connecting to the device 14. The processor 30 of the terminal device 12 connects to the device 14 via the network using the IP address of the device 14.
[0082] If the connected device 14 is a printer, a list of printer device information is displayed on the user's terminal device 12. When the user selects a printer from the list, the processor 30 of the user's terminal device 12 connects to the selected printer via the network. When the user issues a print command specifying the image or document to be printed using print application software, the processor 30 of the terminal device 12 sends print data, including the image or document to be printed and the print conditions, to the printer selected by the user. Upon receiving the print data, the printer prints the image or document onto a recording medium such as paper.
[0083] When selecting a device 14 to connect to, if only a string to identify the device 14 is displayed without displaying an image of the device, the user will select the device 14 they intend to use based solely on that string. For example, if a device 14 is placed in front of the user, and the device image is not displayed but a list of strings to identify the device 14 is displayed on the terminal device 12's screen, the user will use the list of strings to determine whether the device 14 in front of them is the device 14 they intend to use. For example, if a list of strings indicating the name of a printer, which is an example of a device 14, is displayed, the user will use the displayed strings indicating the name to select a printer. However, even with the help of strings such as names, it is difficult for the user to determine which device 14 they want to use. For example, it is difficult for the user to determine whether the device 14 placed in front of them is the device 14 they want to use.
[0084] According to this embodiment, an image of the device 14 and the location where the device 14 is installed is displayed, and the user can select the device 14 to connect to by referring to the device image of each device 14. This makes it easier for the user to identify the device to connect to when selecting the device 14 to connect to, compared to when only a string of characters identifying the device 14 is displayed.
[0085] The embodiments will be explained in more detail below with specific examples.
[0086] (Registration of device 14) Referring to Figures 7 to 10, a specific example of the process for registering equipment 14 with the information management device 10 will be explained. Figures 7 to 9 show examples of equipment images.
[0087] For example, the administrator turns on the location information acquisition function (e.g., GPS function) of the administrator terminal device 12 and uses the camera of the terminal device 12 to photograph the device 14, including the surrounding scenery. This generates a device image representing the device 14 and the scenery surrounding it. Location information indicating the position of the terminal device 12 at the time of shooting is also acquired. This location information is associated with the device information.
[0088] In the example shown in Figure 7, the device 14A to be registered is a printer. A window 40 is installed around the device 14A. For example, the administrator takes a picture of the device 14A, including the window 40, using the camera on the terminal device 12. In other words, the administrator takes a picture of the device 14A and the window 40 together, including both within the shooting range (i.e., the area captured in the image) of the camera on the terminal device 12. This photograph generates a device image 42 showing the device 14A and the window 40. In addition, location information indicating the position of the terminal device 12 at the time of the photograph is obtained using a location information acquisition function such as GPS.
[0089] The equipment image 42 shows not only the equipment 14A but also the scenery surrounding the equipment 14A (for example, the scenery including the window 40). The scenery surrounding the equipment 14A characterizes the location where the equipment 14A is installed, and the part of the equipment image 42 that shows the scenery surrounding the equipment 14A can be said to represent the location where the equipment 14A is installed.
[0090] The device image 42 shows the device 14A along with the window 40 located near the device 14A. Therefore, by referring to the device image 42, the user can infer from the image 42 that the window 40 is located near the device 14A. In other words, by referring to the device image 42, the user can recognize the characteristics of the location where the device 14A is installed.
[0091] For example, the administrator inputs a string indicating the name of device 14A, the IP address of device 14A, information indicating the performance and functions of device 14A, and information indicating the location where device 14A is installed, on a registration screen displayed on the administrator's terminal device 12. Location information acquired by the location information acquisition function of the administrator's terminal device 12 may be used as information indicating the location where device 14A is installed. This location information precisely indicates the location of the administrator's terminal device 12, but since the administrator photographs device 14A from near it, this location information can be said to indicate the approximate location of device 14A. Alternatively, location information of device 14A may be acquired by the location information acquisition function of device 14A and transmitted to the terminal device 12, and this information may be used as information indicating the location where device 14A is installed.
[0092] When an administrator gives instructions to register device 14A using the administrator terminal device 12, the processor 30 of the terminal device 12 transmits device information of device 14A to the information management device 10, including a device image 42 and various pieces of information (for example, a string indicating the name, an IP address, information indicating performance and functions, and information indicating the location (for example, location information)).
[0093] The processor 22 of the information management device 10 receives the device information of device 14A transmitted from the terminal device 12, stores the device information of device 14A in the memory 20 of the information management device 10, and registers the device information in the device information database. As a result, device 14A is registered with the information management device 10.
[0094] Figure 8 shows another example of a captured image. The device to be registered, 14B, is a printer. A bookshelf 44 is installed around the device 14B. The administrator takes a picture of the device 14B, including the bookshelf 44, using the camera on the terminal device 12. This photograph generates a device image 46 showing both the device 14B and the bookshelf 44. In addition, location information indicating the position of the terminal device 12 at the time of the photograph is obtained using a location information acquisition function such as GPS.
[0095] The equipment image 46 shows not only the equipment 14B but also the surrounding scenery (for example, the scenery including the bookshelf 44). The scenery surrounding the equipment 14B characterizes the location where the equipment 14B is installed, and it can be said that the part of the equipment image 46 that shows the scenery surrounding the equipment 14B represents the location where the equipment 14B is installed.
[0096] Similar to the device image 42 shown in Figure 7, the following information is input: a string indicating the name of device 14B, its IP address, information indicating its performance and functions, and information indicating the location where device 14B is installed (for example, location information obtained by the location information acquisition function).
[0097] When the administrator gives instructions to register device 14B, the processor 30 of terminal device 12 transmits device information of device 14B to information management device 10, including a device image 46 and various pieces of information (for example, a string indicating the name, an IP address, information indicating performance and functions, and information indicating the location (for example, location information)).
[0098] The device information for device 14B is stored in the memory 20 of the information management device 10, and this device information is registered in the device information database. As a result, device 14B is registered with the information management device 10.
[0099] Figure 9 shows another example of a captured image. The device to be registered, 14C, is a printer. Potted plants 48 are placed around the device 14C. The administrator takes a picture of the device 14C, including the potted plants 48, using the camera on the terminal device 12. This photograph generates a device image 50 showing both the device 14C and the potted plants 48. In addition, location information indicating the position of the terminal device 12 at the time of the photograph is obtained using a location information acquisition function such as GPS.
[0100] The equipment image 50 shows not only the equipment 14C but also the scenery surrounding the equipment 14C (for example, the scenery including the potted plants 48). The scenery surrounding the equipment 14C characterizes the location where the equipment 14C is installed, and the part of the equipment image 50 that shows the scenery surrounding the equipment 14C can be said to represent the location where the equipment 14C is installed.
[0101] Similar to the device image 42 shown in Figure 7, the following information is input: a string indicating the name of device 14C, its IP address, information indicating its performance and functions, and information indicating the location where device 14C is installed (for example, location information obtained by the location information acquisition function).
[0102] When an administrator gives instructions to register device 14C, the processor 30 of terminal device 12 transmits device information of device 14C to information management device 10, including a device image 50 and various pieces of information (for example, a string indicating the name, an IP address, information indicating performance and functions, and information indicating the location (for example, location information)).
[0103] The device information for device 14C is stored in the memory 20 of the information management device 10, and this device information is registered in the device information database. As a result, device 14C is registered with the information management device 10.
[0104] Figure 10 shows an example of a database of device information.
[0105] In the device information database, each device 14 is associated with a string indicating the name of the device 14, the IP address of the device 14, information indicating the performance and functions of the device 14, information indicating the location where the device 14 is installed (e.g., location information), and a device image representing the device 14 and the location where it is installed.
[0106] Figure 10 shows the device information for each of the devices 14A, 14B, and 14C shown in Figures 7 to 9. Furthermore, the function of device 14 is indicated as a printer, and its function is either color printing or monochrome printing.
[0107] For example, the name of device 14A is "A001". Device 14A has a "color printing" function and is installed in a location called "12F West". Also, device image 42 is registered in the database as the device image of device 14A. The file name of device image 42 is "img1.jpg".
[0108] The name of device 14B is "A002". Device 14B does not have a "color printing" function, but it does have a "monochrome printing" function and is installed in a location called "12F East". In addition, device image 46 is registered in the database as a functional image of device 14B. The file name of device image 46 is "img2.jpg".
[0109] The name of device 14C is "B002". Device 14C has a "color printing" function and is installed in a location called "10F East". In addition, device image 50 is registered in the database as the device image of device 14C. The file name of device image 50 is "img3.jpg".
[0110] (Search for device 14) Referring to Figures 11 to 13, the process for searching for device 14 will be explained. Figures 11 and 12 show the results of the search for device 14. Figure 13 shows the screen for connecting to device 14. In this example, device 14 is a printer, and the user searches for the printer.
[0111] First, a user who wishes to use a printer instructs their terminal device 12 to search for the printer they wish to connect to. As an example, the user instructs their terminal device 12 to search for a printer connected to the same network. For instance, if print application software is installed on the user's terminal device 12, the user launches the print application software on the terminal device 12 and instructs it to search for the printer they wish to connect to.
[0112] When a user gives a search command, the processor 30 of the terminal device 12 sends information to the information management device 10 indicating a request to obtain printer device information.
[0113] The processor 22 of the information management device 10 searches for device information of printers connected to the same network as the user's terminal device 12 in the database shown in Figure 10, for example, and retrieves the retrieved device information. For example, the processor 22 of the information management device 10 searches for and retrieves device information of printers having the same network address as the user's terminal device 12. The processor 22 of the information management device 10 transmits the retrieved device information to the user's terminal device 12.
[0114] The processor 30 of the terminal device 12 receives device information transmitted from the information management device 10 and displays the received device information on the display of the terminal device 12. For example, a list of device information is displayed on the display.
[0115] Figure 11 shows an example of a list of device information. In this example, device 14A, named "A001," and device 14B, named "A002," are connected to the same network as the user's terminal device 12. The device information for devices 14A and 14B is retrieved and displayed on the display of the user's terminal device 12.
[0116] As shown in Figure 11, the names of the searched devices 14A and 14B, their IP addresses, information indicating their functions and performance, information indicating their installation location, and device images are displayed on the terminal device 12's display. For example, thumbnail images of the device images are displayed.
[0117] Not only is the string indicating the name of device 14A displayed, but the device image 42 of device 14A is also displayed. The same applies to device 14B; not only is the string indicating the name of device 14B displayed, but the device image 46 of device 14B is also displayed.
[0118] For example, a user can compare the device images 42 and 46 displayed on the screen of their terminal device 12 with the actual printer in front of them and the surrounding scenery to determine whether the printer in front of them is the printer they intend to use.
[0119] To illustrate with a specific example, a user can go to device 14A to use it, compare the actual device 14A and its surroundings with the device image 42 displayed on the screen, and recognize that the device 14A in front of the user is a printer named "A001". In this way, a user can compare the device image with the actual scenery to determine whether the connected device 14 and the device 14 they intend to use are the same device.
[0120] In the example shown in Figure 11, the device image itself is included in the list of search results for device information and displayed. However, the device image itself may not be included in the list, and instead, access information for accessing the device image may be included and displayed.
[0121] Access information is, for example, an address (e.g., a URL) that indicates the location where the device image is stored. When a user manipulates the access information (for example, when a user clicks or touches the access information on the screen), the processor 30 of the terminal device 12 accesses the manipulated address, retrieves the device image stored at that address, and displays it on the display of the terminal device 12.
[0122] In the example shown in Figure 12, instead of device images 42 and 46, the access information for each of the device images 42 and 46 is displayed in the list of device information search results. For example, link 52 indicates the address of the location where device image 42 is stored, and link 54 indicates the address of the location where device image 46 is stored.
[0123] For example, when a user operates the terminal device 12 and clicks or touches a link 52 displayed on the screen, the processor 30 of the terminal device 12 accesses the address indicated by the link 52 to obtain the device image 42 and displays it on the terminal device 12's screen. The device image 42 is stored in the memory 20 of the information management device 10. The processor 30 of the terminal device 12 accesses the information management device 10 and obtains the device image 42 stored at the address indicated by the link 52. The same process is followed for the device image 46.
[0124] Figure 13 shows a screen 56 for connecting to device 14. For example, if a printer is selected by the user from the list shown in Figure 11, or if a link in the list shown in Figure 12 is operated by the user to obtain a device image, the processor 30 of the terminal device 12 displays the connection screen 56 on the display of the terminal device 12. The processor 30 of the terminal device 12 displays the device image of the selected printer or the obtained device image on screen 56.
[0125] In the example shown in Figure 13, device 14A has been selected by the user, and the device image 42 of device 14A is displayed on screen 56. At this stage, the user may also compare the device image 42 displayed on screen 56 with the actual printer and its surroundings to confirm whether device 14A is the device the user intends to use.
[0126] Screen 56 displays a button 58 for instructing a connection and a button 60 for canceling a connection.
[0127] When a user presses button 58 on screen 56 (for example, by clicking or touching button 58), the processor 30 of terminal device 12 connects to device 14A via the network. For example, when a user gives a print command using terminal device 12, the processor 30 of terminal device 12 sends the print data to be printed to device 14A to request printing. Device 14A receives the print data sent from terminal device 12 and prints according to the request.
[0128] When the user presses button 60 on screen 56, the processor 30 of the terminal device 12 turns off the connection screen 56 from the display and displays the list shown in Figure 11 or Figure 12 on the display.
[0129] The following describes some variations.
[0130] (Variation 1) In Modification 1, the processor 30 of the user's terminal device 12 stores information indicating the history of connections made by the terminal device 12 to the device 14 in the memory 28 of the terminal device 12, thereby managing the history of connections to the device 14. For example, the processor 30 of the terminal device 12 stores history information in the memory 28 of the terminal device 12, which includes device information of the device 14 to which the terminal device 12 connected, information indicating the date and time of the connection, and information indicating the content of the processing requested from the device 14 (e.g., printing).
[0131] When the processor 30 of the terminal device 12 displays a list of search results for device information, it may display the device image of device 14 on the display of the terminal device 12, or it may not display the device image on the display, depending on the history of the device's connection to device 14.
[0132] For example, when the processor 30 of terminal device 12 displays a list of search results for device information, it displays the device image of a device 14 that it has never connected to on the display of terminal device 12, but does not display the device image of a device 14 that it has connected to. In other words, the processor 30 of terminal device 12 displays the device image of a device 14 for which there is no connection history information, but does not display the device image of a device 14 for which there is connection history information.
[0133] For example, let's assume that device 14A is a device that the user's terminal device 12 has connected to before, and device 14B is a device that the terminal device 12 has not connected to before. In this case, in the example shown in Figure 11, the processor 30 of the terminal device 12 does not display the device image 42 of device 14A in the list, but displays the device image 46 of device 14B in the list. In the example shown in Figure 12, the processor 30 of the terminal device 12 does not display the link 52 to the device image 42 of device 14A in the list, but displays the link 54 to the device image 46 of device 14B in the list. Since the connection history information for device 14A is stored in the memory 28 of the terminal device 12, and the connection history information for device 14B is not stored in the memory 28 of the terminal device 12, the device image 46 or link 54 of device 14B is displayed, and the device image 46 or link 52 of device 14B is not displayed.
[0134] A device 14 (e.g., device 14B) for which there is no connection history information may be a device 14 that the user has never used before. In this case, by displaying the device image of the device 14 (e.g., device image 46), even if the device the user is trying to use is a device 14 that the user has never used before, the user can recognize the device 14 they are trying to use by referring to its device image. For example, a device 14 for which there is no connection history information may be a device 14 installed in a place the user has never been to before, or it may not be a device 14 installed in a place the user has never been to before, but it may be a device 14 that the user has never used before.
[0135] Since a device 14 with connection history information (for example, device 14A) is a device 14 that the user has used before, the user may be able to recognize the device 14 they are trying to use even without displaying the device image of that device 14 (for example, device image 42).
[0136] Furthermore, if a predetermined amount of time has elapsed since the last connection to device 14, device 14 may be treated as a device that terminal device 12 has never connected to.
[0137] (Modification 2) In the modified example 2, the processor 30 of the user's terminal device 12 stores device information of devices 14 that the terminal device 12 has connected to in the memory 28 of the terminal device 12. For example, the processor 30 of the terminal device 12 caches the device information of devices 14 that the terminal device 12 has connected to.
[0138] When the processor 30 of the terminal device 12 displays a list of search results for device information, it displays cached device information on the display of the terminal device 12 for devices that have been cached, and retrieves uncached device information from the information management device 10 and displays it on the display of the terminal device 12. In other words, the processor 30 of the terminal device 12 displays cached device information on the display of the terminal device 12 for devices 14 that the terminal device 12 has been connected to.
[0139] As a result, cached device images are displayed for devices 14 that the terminal device 12 has previously connected to. This allows the device images to be displayed without having to acquire them via a communication path such as a network.
[0140] As shown in Figure 12, a link to a cached device image may be displayed, and the cached device image may be displayed when the user clicks or touches that link.
[0141] When the user's terminal device 12 displays a list of search results for device information, the processor 30 of the information management device 10 may query the information management device 10 to determine whether the device images stored in the memory 20 of the information management device 10 have been updated (i.e., whether the device images registered in the device information database have been updated). In response to this query, the processor 22 of the information management device 10 sends information to the terminal device 12 indicating whether the device images have been updated.
[0142] In this case, if the device image of the searched device 14 has not been updated in the information management device 10, and the device information including the device image is cached in the terminal device 12, the processor 30 of the terminal device 12 will display the cached device information on the display of the terminal device 12.
[0143] On the other hand, if the device image of the searched device 14 has been updated in the information management device 10, the processor 30 of the terminal device 12 retrieves the updated device image from the information management device 10 and displays the updated device image on the display of the terminal device 12.
[0144] In other words, when displaying a list of search results for device information, if the device image of the searched device 14 has not been updated in the information management device 10 and the device information of the device 14 is cached in the terminal device 12, the cached device information is displayed on the terminal device 12's display. On the other hand, if the device image of the searched device 14 has been updated in the information management device 10, the updated device image is retrieved and displayed on the terminal device 12's display, regardless of whether the device information of the device 14 is cached in the terminal device 12 or not. Thus, if the device image has not been updated, the cached device image is displayed, and if the device image has been updated, the updated device image is retrieved from the information management device 10 and displayed.
[0145] (Variation 3) In the third modified example, the processor 30 of the user's terminal device 12 stores device information of the devices 14 that the terminal device 12 has connected to in the memory 28 of the terminal device 12. For example, the processor 30 of the terminal device 12 caches the device information of the devices 14 that the terminal device 12 has connected to.
[0146] When displaying a list of search results for device information, if the device information for the searched device 14 is not cached in the terminal device 12, the processor 30 of the terminal device 12 retrieves the device information for the device 14 from the information management device 10 and displays it on the display of the terminal device 12. In this case, the processor 30 of the terminal device 12 also displays the device image of the device 14 on the display of the terminal device 12. If the device information for the searched device 14 is cached in the terminal device 12, the processor 30 of the terminal device 12 does not display the device image of the device 14 on the display of the terminal device 12, but displays the device information other than the device image of the device 14 on the display of the terminal device 12.
[0147] Devices 14 whose device information is cached in terminal device 12 are devices 14 that terminal device 12 has connected to before. Devices 14 whose device information is not cached in terminal device 12 are devices that terminal device 12 has never connected to before. In other words, when displaying a list of search results for device information, the device images of devices 14 that terminal device 12 has connected to before will not be displayed, while the device images of devices 14 that terminal device 12 has never connected to will be displayed.
[0148] Since the device information of device 14 is cached on terminal device 12, and this device 14 is one that the user's terminal device 12 has connected to in the past, it may be easy for the user to recognize the device 14 even if its device image is not displayed.
[0149] On the other hand, if a device 14 whose device information is not cached in the terminal device 12 is a device 14 that the user's terminal device 12 has never connected to before, the user may not be able to easily recognize the device 14 unless its device image is displayed. In this case, displaying the device image of the device 14 allows the user to recognize the device 14 more easily than if the device image were not displayed. For example, a device 14 installed in a place the user is visiting for the first time is a device that the user's terminal device 12 has never connected to before, so displaying the device image of the device 14 in this case allows the user to recognize the device 14 more easily than if the device image were not displayed.
[0150] For example, in the example shown in Figure 11, if the device information for device 14A is cached in the terminal device 12, but the device information for device 14B is not cached in the terminal device 12, the processor 30 of the terminal device 12 will display the device image of device 14B on the display instead of the device image 42 of device 14A when displaying a list of search results for device information.
[0151] (Modification 4) In variation 4, the device image stored in the memory 20 of the information management device 10 is updated. In other words, the device image registered in the device information database is updated.
[0152] The processor 30 of the administrator or user's terminal device 12 requests the information management device 10 to update the device image if it acquires a new device image (i.e., a different device image from the one registered in the database) that represents device 14 and the location where device 14 is installed.
[0153] For example, an administrator or user may take a photograph of the device 14 using the camera of their terminal device 12, thereby generating a different device image from the one registered in the database. This newly generated device image corresponds to a newly acquired device image. Location information is acquired at the time of the photograph using a location information acquisition function such as GPS, and this location information is associated with the new device image.
[0154] The processor 30 of the terminal device 12 transmits another device image to the information management device 10, to which location information is associated, and requests the information management device 10 to update the device image. For example, the processor 30 of the terminal device 12 requests the information management device 10 to update the device image to which location information is associated, provided that the difference between the location information associated with that device image is within an acceptable range.
[0155] The processor 22 of the information management device 10, upon receiving a request to update the other device image, updates the device image with the location information registered in the device information database, where the difference between the location information and the location information associated with the other device image falls within an acceptable range. For example, the processor 22 of the information management device 10 updates the device image with the other device image, where the location information matches that of the other device image.
[0156] Furthermore, the processor 30 of the terminal device 12 may display information on the display of the terminal device 12 instructing the user to take an image of another device. The administrator or user then takes an image of the device 14 according to the instructions.
[0157] The following provides a detailed explanation of Modification 4, using specific examples.
[0158] One example of a situation where the device image of device 14 might be updated is when the location where device 14 is installed remains unchanged, but the surrounding environment of device 14 has changed. Examples of situations where the surrounding environment of device 14 has changed include when the objects installed around device 14 have changed, or when the layout of the objects has changed.
[0159] For example, as shown in Figure 14, before the change, a bookshelf 44 was installed next to equipment 14B, but after the change, a table 62 is installed next to equipment 14B, and a bookshelf Number 44 is not installed.
[0160] The equipment information database contains the equipment image before the change. In other words, the equipment image representing equipment 14B and bookshelf 44 is included in the equipment information and registered in the database as the equipment image for equipment 14B. The location information acquired when the equipment image was taken is associated with this equipment image.
[0161] If the objects surrounding device 14B are changed from bookshelf 44 to table 62, an administrator or user may take a photograph of device 14B and its surroundings using the camera of their terminal device 12 so that device 14B and table 62 are shown together in the image. This generates a separate device image representing device 14B and table 62. The location information at the time of shooting is acquired and associated with this separate device image.
[0162] Another device image representing device 14B and table 62 is transmitted from terminal device 12 to information management device 10 along with a request to update the device image. The location information associated with the original device image representing device 14B and bookshelf 44 matches the location information associated with the modified alternative device image, or the difference between these location information is within an acceptable range. Therefore, the processor 22 of information management device 10 updates the original device image representing device 14B and bookshelf 44 to the modified alternative device image representing device 14B and table 62. As a result, the original device image representing device 14B and bookshelf 44 is not registered in the device information database as a device image included in the device information of device 14B, and the modified alternative device image representing device 14B and table 62 is registered.
[0163] The following provides a more detailed explanation of the fourth example.
[0164] Figure 15 shows a screen 64 for connecting to device 14. Here, as an example, device 14B has been selected by the user from the list shown in Figure 11 or Figure 12, and the device image 46 of device 14B is displayed on screen 64. Similar to screen 56 shown in Figure 13, screen 64 displays a button 58 for instructing a connection and a button 60 for canceling a connection.
[0165] Furthermore, screen 64 displays a button 66 for updating the device image registered in the device information database. When an administrator or user presses button 66 on screen 64 (for example, by clicking or touching button 66), the processor 30 of the terminal device 12 displays a screen for taking a picture of the device 14 on the display of the terminal device 12.
[0166] Figure 16 shows a screen 68 for photographing device 14. When button 66 is pressed on screen 64, screen 68 is displayed on the terminal device 12's display. Screen 68 displays a message instructing the user to photograph device 14 and its surroundings so that if the surrounding scenery depicted in the device image differs from the actual scenery, an image representing device 14 (a printer in the example shown in Figure 16) and its surroundings will be generated. This message can be considered an example of information that guides the user to photograph a different device.
[0167] Furthermore, screen 68 displays a button 70 for instructing the camera to take a picture and a button 72 for canceling the picture. When button 70 is pressed by the administrator or user (for example, when button 70 is clicked or touched), a picture is taken by the camera of the terminal device 12. When button 72 is pressed by the administrator or user, the screen returns from screen 68 to screen 64.
[0168] For example, when an administrator changes the layout around equipment 14B, they might press button 66 on screen 64 and button 70 on screen 68 to take a picture of the modified equipment 14B and its surroundings. To give a specific example, if an administrator replaces the bookshelf 44 with a table 62 next to equipment 14B, as shown in Figure 14, they might take a picture of equipment 14B and table 62 to generate a separate equipment image representing both equipment 14B and table 62.
[0169] As another example, a user might select device 14B from a list of device information search results when attempting to use device 14B. In this case, screen 64 is displayed on the user's terminal device 12. Even if a table 62 is placed next to device 14B instead of the bookshelf 44, if the device image of device 14B has not been updated in the device information database, screen 64 will display the device image 46 before the change, representing both device 14B and the bookshelf 44. The user might compare the surrounding scenery of device 14B shown in the device image 46 on screen 64 with the actual scenery, and if they recognize a difference in scenery, they might press button 66 on screen 64. This will cause screen 68 to be displayed on the terminal device 12's screen for updating the device image.
[0170] The administrator or user turns on the location information acquisition function of their terminal device 12 and takes a picture of the device 14B and table 62 with the camera of their terminal device 12. This generates a separate device image representing the device 14B and table 62. The location information acquired by the location information acquisition function is then associated with this separate device image.
[0171] Figure 17 shows a screen 73 for registering another device image in the device information database. For example, when button 70 is pressed on screen 68 to take a picture, the processor 30 of the terminal device 12 displays screen 73 on the terminal device 12's display instead of screen 68. Screen 73 displays the device image 74 generated by the picture. When device 14B and table 62 are photographed, a device image 74 representing device 14B and table 62 is generated and displayed on screen 73. Device image 74 is an example of another device image of device 14B.
[0172] Furthermore, screen 73 displays a button 76 for reporting changes to the equipment image to the information management device 10 and requesting the information management device 10 to update the equipment image, and a button 78 for canceling that request.
[0173] When button 76 is pressed by an administrator or user (for example, when button 76 is clicked or touched), the processor 30 of the terminal device 12 transmits a device image 74, which is another device image, and information indicating a request to update the device image to the information management device 10.
[0174] The processor 22 of the information management device 10 updates the device image 74 in the device information database with the device image 74 to which the location information matches the location information associated with the device image 74. As another example, the processor 22 of the information management device 10 updates the device image 74 to which the device image 74 to which the location information associated with the device image 74 is within an acceptable range.
[0175] For example, the location information associated with the original equipment image 46 representing equipment 14B and bookshelf 44 matches the location information associated with the modified equipment image 74 representing equipment 14B and table 62, or the difference between these location information is within an acceptable range. In this case, the processor 22 of the information management device 10 updates the original equipment image 46 representing equipment 14B and bookshelf 44 to the modified equipment image 74 representing equipment 14B and table 62. As a result, the equipment information database does not register the original equipment image 46 representing equipment 14B and bookshelf 44 as an equipment image included in the equipment information of equipment 14B, but instead registers the modified equipment image 74 representing equipment 14B and table 62.
[0176] If the location where device 14 is installed changes, the administrator turns on the location information acquisition function of their terminal device 12 and takes a picture of device 14 and its surroundings with the camera of their terminal device 12. This generates a different image of device 14. When the administrator uses their terminal device 12 to instruct the device information database to be updated for device 14, the processor 30 of the administrator's terminal device 12 sends the new device information, including the different device image and location information, and information indicating a request to update the device information of device 14, to the information management device 10. The new device information includes a string indicating the name of device 14, an IP address, etc. This string and IP address, etc., are entered, for example, by the administrator. When the processor 22 of the information management device 10 receives the new device information, it updates the device information of device 14 in the device information database with the new device information. In this way, if the installation location of device 14 changes, the device information of device 14 registered in the device information database is updated with the new device information. Furthermore, updating device information may be performed by users other than the administrator.
[0177] (Variation 5) In Modification 5, if the device image is not an image that can identify the device 14 shown in the image and the location where the device 14 is installed, information prompting the user to take another photograph of the device 14 and the location where the device 14 is installed is output. For example, this information is displayed on the display of the user's terminal device 12. In Modification 5, "user" is a concept that includes both the administrator who installs and registers the device 14 and the user who uses the device 14. Hereinafter, an image that can identify the device 14 and the location where the device 14 is installed will be referred to as an "appropriate image," and an image that cannot identify the device 14 and the location where the device 14 is installed will be referred to as an "inappropriate image."
[0178] An appropriate image is, for example, one that shows the entirety of device 14, where the image of device 14 does not occupy the entire image, and which differs from other device images of device 14 registered in the device information database.
[0179] Inappropriate images include, for example, images that do not show the entire device 14, images in which the image of device 14 occupies the entire image, and images that do not differ from device images of other devices 14 registered in the device information database.
[0180] For example, when registering device information in the device information database, the processor 22 of the information management device 10 receives a device image transmitted from the terminal device 12 and determines whether the device image is an "appropriate image". If the device image is not an "appropriate image", that is, an "inappropriate image", the processor 22 of the information management device 10 sends information to the terminal device 12 prompting the user to take another picture of the device. This information is displayed on the display of the terminal device 12.
[0181] The following describes the modification 5 in detail with reference to Figure 18. Figure 18 shows the flow of the image recognition process.
[0182] Images 80 and 82 are generated when the camera of the terminal device 12 photographs the device 14.
[0183] When registering device information in the device information database, or when updating device images registered in the database, images 80 and 82 are transmitted from the terminal device 12 to the information management device 10 (S21).
[0184] When the information management device 10's processor 22 receives images 80 and 82, it determines whether images 80 and 82 are "appropriate images" (S22).
[0185] Image 80 does not show the entire device 14, but only a small part of it. Image 82 is an image in which the image of device 14 occupies the entire image, and the surrounding scenery of the device 14 is not shown at all. Also, the entire device 14 is not shown in image 82. Therefore, the processor 22 of the information management device 10 determines that images 80 and 82 are "inappropriate images" (S22, NG).
[0186] If image 80 or image 82 is determined to be an "inappropriate image," the processor 22 of the information management device 10 sends information to the terminal device 12 prompting the user to take another picture of the device (S23). For example, the processor 22 of the information management device 10 sends a sample 84 of an "appropriate image" to the terminal device 12 and displays it on the terminal device 12's display. The user may then take a picture of the device 14 using the sample 84 as a reference.
[0187] For example, image 86 is generated by taking another photograph and transmitted from terminal device 12 to information management device 10 (S24).
[0188] When the information management device 10's processor 22 receives image 86, it determines whether or not image 86 is an "appropriate image" (S25). Image 86 shows the entire device 14 and the scenery surrounding the device 14. Therefore, the information management device 10's processor 22 determines that image 86 is an "appropriate image" (S25, OK), and registers image 86 as the device image of the device 14 in the device information database (S26).
[0189] Furthermore, if the image is determined to be an "appropriate image" in step S22, the image is registered as an equipment image in the equipment information database, and no information prompting the user to take another picture is sent from the information management device 10 to the terminal device 12.
[0190] (Experimental variation 6) In variation 6, the equipment 14 is a booth such as a partitioned room or small room. Equipment such as a table, chair, lighting, communication equipment (e.g., a Wi-Fi® router), display, printer, and air conditioner may be installed inside the booth. One booth may be installed in one location, multiple booths may be installed in a row, multiple booths may be installed at a certain spatial interval, or multiple booths may be installed in close proximity.
[0191] Booth reservations may be managed by a management system. Users who reserve a booth are permitted to use that booth during their reserved time slot. For example, the booth door may be locked with an electronic lock. Users who reserve a booth are given information to unlock the electronic lock, and they can use that information to unlock the lock and enter the booth. Users can then enter the booth and work. For example, a user might use Wi-Fi to communicate. Booth use may be free or paid.
[0192] The equipment image in Modification 6 is an image representing the booth and the location where the booth is installed. For example, an equipment image representing the booth and its surroundings is generated by photographing the booth and its surroundings together. For example, an equipment image is generated when the booth is photographed by the manager responsible for its installation and management. Examples of the surrounding scenery include signs, markers, vending machines, and public telephones installed around the booth. Of course, other scenery may also be photographed.
[0193] Information about the booth (for example, a string indicating the booth name, information about communications available within the booth (for example, the SSID and password of the Wi-Fi router), information indicating the location where the booth is installed, etc.) and images of the booth's equipment are included in the booth's equipment information and stored in the memory 20 of the information management device 10. As a result, the booth's equipment information is registered in the equipment information database.
[0194] When a user provides search criteria for booths using the terminal device 12 and issues a search command, the processor 22 of the information management device 10 searches for booths that match the search criteria (for example, the location of the booth or time slots that are not reserved) and transmits the equipment information of the found booths to the terminal device 12. The processor 30 of the terminal device 12 displays the equipment information of the found booths on the display of the terminal device 12. As a result, equipment images representing the booths and the surrounding scenery are displayed on the display of the terminal device 12.
[0195] The system displays an image of the booth and the surrounding scenery, allowing the user to identify the booth they intend to use by referring to the image. For example, by referring to the image, the user can determine whether the booth in front of them is the one they intend to use (e.g., the booth they reserved).
[0196] (Example 7) The processor 30 of the terminal device 12 may display an image of the device 14 on the display of the terminal device 12, and may also overlay an image representing the performance and functions of the device 14 onto the display. For example, if the device 14 is a printer and has a color printing function, an image representing that the device 14 has a color printing function will be overlaid on the device image of the device 14. In addition, images representing the print speed or application software installed on the device 14 may be overlaid on the device image.
[0197] By overlaying an image representing the performance and functions of device 14 onto the device image, users can more easily recognize the performance and functions of device 14 compared to when the image is not displayed. For example, there may be cases where multiple devices 14 are installed that have the same or similar appearance but different performance and functions. In this case, displaying an image representing the performance and functions of device 14 makes it easier for users to recognize the performance and functions.
[0198] The functions of each part of the information management device 10, terminal device 12, and equipment 14 described above are realized, for example, through the cooperation of hardware and software. For instance, the processor of each device reads and executes a program stored in the memory of that device, thereby realizing the functions of each device. The program is stored in memory via a recording medium such as a CD or DVD, or via a communication path such as a network.
[0199] In each of the above embodiments, the term "processor" refers to a processor in a broad sense, including general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.). Furthermore, the operation of the processor in each of the above embodiments may not be performed by a single processor, but may be performed by multiple processors located in physically separate locations working together. In addition, the order of the processor's operations is not limited to the order described in each of the above embodiments, and may be changed as appropriate. [Explanation of symbols]
[0200] 10 information management devices, 12 terminal devices, 14A, ..., 14M equipment, 22, 30 processors.
Claims
1. It has a processor, The aforementioned processor, A string of characters for identifying the connected device and an image representing the device and the location where the device is installed are obtained from a device where the string of characters and the image are registered, and displayed on a display. An information processing device, Depending on the history of the device's connection to the equipment, the image may be displayed on the display, or the image may not be displayed on the display. An information processing device characterized by the following:
2. Having a processor and memory, The aforementioned processor, A string of characters for identifying the connected device and an image representing the device and the location where the device is installed are obtained from a device where the string of characters and the image are registered, and displayed on a display. An information processing device, The aforementioned processor, If the aforementioned device is one that the device has previously connected to, the image is stored in the memory. When displaying a string of characters on the display to identify the connected device, for devices that the device has previously connected to, the image stored in the memory is displayed on the display. An information processing device characterized by the following:
3. The aforementioned image is stored in an image storage device that stores images. The aforementioned processor further, When displaying a string of characters for identifying the connected device on the display, if the image has not been updated in the image storage device and is stored in the memory, the image stored in the memory is displayed on the display; if the image has been updated in the image storage device, the updated image is retrieved from the image storage device and displayed on the display. The information processing apparatus according to feature 2.
4. The aforementioned image is stored in an image storage device that stores images, and is associated with location information indicating the location of the device. The aforementioned processor further, When, with respect to the equipment shown in the image stored in the image storage device, another image representing the equipment and the location where the equipment is installed is acquired, the image storage device is requested to update the image to the other image if the location information associated with the other image falls within the acceptable range of the location information associated with the image. The information processing apparatus according to any one of claims 1 to 3.
5. The aforementioned processor further, Information guiding the user to take the aforementioned other image is displayed on the display. The image storage device is requested to update the image to the other image if the location information associated with the other image generated by the capture falls within the acceptable range of the location information associated with the image. The information processing apparatus according to feature 4.
6. The aforementioned image is an image generated by photography, The aforementioned processor, If the image generated by the photograph is not an image that can identify the device and the location where the device is installed, information prompting the user to take another photograph will be displayed on the display. The information processing apparatus according to any one of claims 1 to 5.
7. Computers A string of characters for identifying the connected device and an image representing the device and the location where the device is installed are obtained from a device where the string of characters and the image are registered, and displayed on a display. A program designed to make it work in that way. Depending on the history of the computer's connection to the device, the image may be displayed on the display, or the image may not be displayed on the display. A program characterized by the following features.
Citation Information
Patent Citations
Printer retrieval system
JP2004110587A
Image forming device, image forming system, and program
JP2009172914A
Mobile communication terminal and printing system
JP2009187103A
Configuration management system, control method of configuration management system, and program
JP2015106314A
Device information registration system, management apparatus, information processing apparatus, control method of management apparatus, control method of information processing apparatus, and program
JP2017062680A