Information processing system, image processing device, information processing method, and information processing program

Abstract

To allow a user to grasp a processing result of an imaging device.SOLUTION: An information processing system includes an information processing device that is communicable with an imaging device and an image processing device. The information processing device includes: a first setting unit that sets setting information in which an identifier of the information processing device, an identifier of an imaging device, and an identifier of an image processing device are associated with one another; and a connection unit that transmits a connection request and the setting information which is set by the first setting unit, to the image processing device, to connect therewith. The imaging device includes: a second setting unit that sets the information processing device and the image processing device based on the setting information which is set by the first setting unit; and a first transmission unit that transmits a captured image to the image processing device based on the setting information which is set by the second setting unit. The image processing device includes: a third setting unit that sets the imaging device based on the connection request which is transmitted by the connection unit; and a second transmission unit that transmits a result of processing which is performed by the processing unit, to the information processing device.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an information processing system, an image processing apparatus, an information processing method, and an information processing program.

Background Art

[0002] Conventionally, a technique has been proposed in which an image captured by an imaging device is transmitted to an external storage device such as a server, and when the transmission is completed, the image held by the imaging device is automatically deleted (for example, Patent Document 1).

Summary of the Invention

Problems to be Solved by the Invention

[0003] However, when the imaging device does not include a display unit, the imaging device cannot output the result transmitted to the external storage device. Therefore, since the user cannot receive information regarding the transmission state, there has been a problem that the user cannot receive feedback on the processing result of the processing executed by the imaging device.

[0004] The present invention has been made in view of the above, and an object thereof is to enable a user to grasp the result processed by an imaging device.

Means for Solving the Problems

[0005] In order to solve the above-described problems and achieve the object, the present invention is an information processing system including an imaging device, an image processing apparatus, and an information processing apparatus capable of communicating with the imaging device and the image processing apparatus, wherein the information processing apparatus includes a first setting unit that sets setting information associating an identifier for identifying the information processing apparatus, an identifier for identifying the imaging device, and an identifier for identifying the image processing apparatus, and the connection unit that transmits and connects the setting information set by the first setting unit to the image processing apparatus, and the imaging device is based on the image processing apparatus , the above The setting information set by the first setting unit of And a connection unit that transmits and connects The imaging device includes a display unit that displays information recognizable by the imaging device, The imaging device is Image capturing the aforementioned recognizable information Based on , the above Image processing apparatus Identifier that identifies the userA second setting unit that sets the and the second setting unit that sets Identifier for image processing device Based on this, the image processing device transmits the captured image. 2 The image processing device comprises a transmitting unit and the connection unit, and the image processing device receives the Configuration Information Based on the imaging device Identifier that identifies the user A third setting unit for setting the above 2 The transmitting unit transmits the image to a processing unit that performs image processing on the image, and the information processing unit transmits the processing results performed by the processing unit to the information processing unit. 3 A transmitting unit, The information processing device further includes an output unit that outputs the processing result. It is characterized by the following: [Effects of the Invention]

[0006] According to the present invention, the effect is that the results processed by the imaging device can be understood. [Brief explanation of the drawing]

[0007] [Figure 1] Figure 1 is a block diagram showing an example of the configuration of an information processing system according to an embodiment. [Figure 2] Figure 2 is a hardware configuration diagram showing an example of an information processing device according to the present invention. [Figure 3] Figure 3 is a hardware configuration diagram showing an example of an imaging device according to this embodiment. [Figure 4] Figure 4 is a hardware configuration diagram showing an example of an image processing device and external storage device according to an embodiment. [Figure 5] Figure 5 is a functional configuration diagram showing an example of the functional configuration of the information processing system according to the embodiment. [Figure 6] Figure 6 shows an example of the display of the output processing by the information processing device according to the embodiment. [Figure 7] Figure 7 shows an example of the display of the output processing by the information processing device according to the embodiment. [Figure 8] Figure 8 shows an example of the display of output processing by the information processing device according to the embodiment. [Figure 9] Figure 9 shows an example of the display of the output processing by the information processing device according to the embodiment. [Figure 10] Figure 10 is a sequence diagram showing an example of the operation of the information processing system according to the embodiment. [Figure 11] Figure 11 is a sequence diagram showing an example of the operation of the information processing system according to the embodiment. [Modes for carrying out the invention]

[0008] Embodiments of the information processing system, image processing device, information processing method, and information processing program will be described in detail below with reference to the attached drawings.

[0009] Figure 1 is a diagram showing the schematic configuration of an information processing system according to an embodiment. As shown in Figure 1, the information processing system 100 includes an information processing device 1, an imaging device 2, an image processing device 3, and an external storage device 4. The information processing device 1, imaging device 2, image processing device 3, and external storage device 4 are interconnected via a predetermined external network 5, such as a wireless network, LAN (Local Area Network), or the Internet.

[0010] Information processing device 1 outputs the results processed by imaging device 2. Imaging device 2 captures an image of a subject and transmits the captured image to image processing device 3. Image processing device 3 performs image processing on the image transmitted by image processing device 3 and transmits it to external storage device 4. External storage device 4 stores the image transmitted from image processing device 3. External storage device 4 is, for example, a cloud server.

[0011] The information processing system 100 of such an embodiment connects the information processing device 1 to any of the above-mentioned devices (for example, wireless communication, etc.) by means of a device setting tool installed in the information processing device 1, and based on the unique information of the device (for example, an identifier, etc.), determines whether it already holds information to be supplied to the device, such as setting information. When it holds the information, the held information is transmitted from the information processing device 1 to the device. Thereby, on the device side, the information received from the information processing device 1 is reflected. Thereby, even in an environment where it is difficult to connect to the external network 5, the device can complete settings based on the information received from the information processing device 1.

[0012] On the other hand, when the information processing device 1 does not include information for the device to be set, the information processing device 1 acquires information from, for example, the image processing device 3 that is transmitting information and transfers it to the device. Thereby, even in an environment where it is difficult to connect to the external network 5, the device can complete settings based on the information received from the information processing device 1 as described above.

[0013] The hardware configuration of the information processing device 1 will be described using FIG. 2. The information processing device 1 is, for example, a smartphone. FIG. 2 is a hardware configuration diagram of the information processing device 1. The information processing device 1 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, an EEPROM (Electrically Erasable Programmable Read-Only Memory) 104, a CMOS (Complementary Metal Oxide Semiconductor) sensor 105, an imaging device I / F (Interface) 106, an acceleration / azimuth sensor 107, a media I / F 109, and a GPS (Global Positioning System) receiver 111.

[0014] Among these, the CPU 101 controls the operation of the entire information processing device 1. The ROM 102 stores programs used for driving the CPU 101 such as the CPU 101 and IPL. The RAM 103 is used as a work area for the CPU 101. The EEPROM 104 reads or writes various data such as the information processing device 1 program according to the control of the CPU 101.

[0015] The CMOS sensor 105 is a type of built-in imaging means that captures a subject (mainly a self-image) according to the control of the CPU 101 to obtain image data. Note that an imaging means such as a CCD (Charge Coupled Device) sensor instead of the CMOS sensor may also be used. The imaging device I / F 106 is a circuit that controls the driving of the CMOS sensor 105.

[0016] The acceleration / azimuth sensor 107 is various sensors such as an electronic magnetic compass that detects geomagnetism, a gyrocompass, and an acceleration sensor. The media I / F 109 controls the reading or writing (storage) of data to / from the recording media 108 such as a flash memory. The GPS receiver 111 receives GPS signals from GPS satellites.

[0017] Also, the information processing device 1 includes a long-distance communication circuit 112, a CMOS sensor 113, an imaging device I / F 114, a microphone 115, a speaker 116, an audio input / output I / F 117, a display 118, an external device connection I / F 119, a short-distance communication circuit 120, an antenna 120a of the short-distance communication circuit 120, and a touch panel 121.

[0018] Among these, the long-distance communication circuit 112 is a circuit that communicates with other devices via the external network 5. The CMOS sensor 113 is a type of built-in imaging means that captures a subject according to the control of the CPU 101 to obtain image data. The imaging device I / F 114 is a circuit that controls the driving of the CMOS sensor 113. The microphone 115 is a built-in circuit that converts sound into an electrical signal. The speaker 116 is a built-in circuit that converts an electrical signal into physical vibration to generate sounds such as music and voice.

[0019] The audio input / output interface 117 is a circuit that processes the input and output of audio signals between the microphone 115 and the speaker 116 according to the control of the CPU 101. The display 118 is a type of display means such as liquid crystal or organic EL (electroluminescence) that displays images of subjects and various icons. The external device connection interface 119 is an interface for connecting various external devices. The short-range communication circuit 120 is a communication circuit such as NFC (Near Field Communication) or Bluetooth (registered trademark).

[0020] The touch panel 121 is a type of input means that allows the user to operate the information processing device 1 by pressing the display 118. The information processing device 1 also includes a bus line 110. The bus line 110 is an address bus, data bus, etc., for electrically connecting the various components such as the CPU 101 shown in Figure 2.

[0021] Next, the hardware configuration of the imaging device 2 will be explained using Figure 3. Figure 3 is a hardware configuration diagram of the imaging device 2. In the following, the imaging device 2 will be described as a 360-degree (omnidirectional) 360-degree imaging device using two image sensors, but it may have more than two image sensors. Furthermore, it is not necessarily required to be a device dedicated to omnidirectional imaging; a standard digital camera or smartphone can be fitted with an aftermarket omnidirectional imaging unit to achieve essentially the same functionality as the imaging device 2.

[0022] As shown in Figure 3, the imaging device 2 consists of an imaging unit 201, an image processing unit 204, an imaging control unit 205, a microphone 208, a sound processing unit 209, a CPU 211, a ROM 212, an SRAM (Static Random Access Memory) 213, a DRAM (Dynamic Random Access Memory) 214, an operation unit 215, an external device connection interface 216, a communication unit 217, an antenna 217a, an acceleration / direction sensor (electronic compass) 218, a gyro sensor 219, an acceleration sensor 220, and a recessed terminal 221 for Micro USB.

[0023] Of these, the imaging unit 201 is equipped with wide-angle lenses (so-called fisheye lenses) 202a and 202b, each having a field of view of 180° or more for forming a hemispherical image, and two image sensors 203a and 203b, which are provided corresponding to each of the wide-angle lenses 202a and 202b.

[0024] The image sensors 203a and 203b include an image sensor such as a CMOS sensor or CCD sensor that converts the optical image from the wide-angle lenses 202a and 202b into electrical signal image data and outputs it, a timing generation circuit that generates horizontal or vertical synchronization signals and pixel clocks for the image sensor, and a group of registers in which various commands and parameters necessary for the operation of the image sensors 203a and 203b are set.

[0025] The image sensors 203a and 203b of the imaging unit 201 are each connected to the image processing unit 204 via a parallel I / F bus. On the other hand, the image sensors 203a and 203b of the imaging unit 201 are connected to the imaging control unit 205 via a serial I / F bus (such as an I2C bus). The image processing unit 204, the imaging control unit 205, and the sound processing unit 209 are connected to the CPU 211 via bus 210. Furthermore, ROM 212, SRAM 213, DRAM 214, operation unit 215, external device connection I / F 216, communication unit 217, and acceleration / direction sensor 218 are also connected to bus 210.

[0026] The image processing unit 204 receives image data output from image sensors 203a and 203b via a parallel I / F bus, performs predetermined processing on each image data, and then combines these image data to create equirectangular projection image data.

[0027] The imaging control unit 205 generally uses the I2C bus to set commands and other information in the registers of the image sensors 203a and 203b, with the imaging control unit 205 as the master device and the image sensors 203a and 203b as slave devices. It receives the necessary commands and other information from the CPU 211. The imaging control unit 205 also uses the I2C bus to acquire status data and other information from the registers of the image sensors 203a and 203b and send it to the CPU 211.

[0028] Furthermore, the imaging control unit 205 instructs the image sensors 203a and 203b to output image data when the shutter button 215a on the operation unit 215 is pressed.

[0029] Furthermore, as will be described later, the imaging control unit 205 also functions as a synchronization control means that works in cooperation with the CPU 211 to synchronize the output timing of image data from the image sensors 203a and 203b. In this embodiment, the imaging device 2 is not provided with a display, but a display unit may be provided.

[0030] Microphone 208 converts sound into sound (signal) data. Sound processing unit 209 receives the sound data output from microphone 208 through the I / F bus and performs predetermined processing on the sound data.

[0031] The CPU 211 controls the overall operation of the imaging device 2 and performs necessary processing. The ROM 212 stores various programs for the CPU 211. The SRAM 213 and DRAM 214 are work memories that store programs executed by the CPU 211 and data in progress. In particular, the DRAM 214 stores image data in progress and processed equirectangular projection image data from the image processing unit 204.

[0032] The control unit 215 is a collective term for the operation buttons, such as the shutter button 215a. The user inputs various shooting modes and shooting conditions by operating the control unit 215.

[0033] The external device connection interface 216 is an interface for connecting various external devices. These external devices include, for example, USB (Universal Serial Bus) memory and PCs (Personal Computers). The equirectangular projection image data stored in DRAM 214 can be recorded to external media via the external device connection interface 216, or transmitted to external terminals (devices) such as smartphones via the external device connection interface 216 as needed.

[0034] The communication unit 217 communicates with an external terminal (device) such as a smartphone via an antenna 217a provided on the imaging device 2, using short-range wireless communication technologies such as Wi-Fi, NFC (Near Field Communication), or Bluetooth (registered trademark). This communication unit 217 can also transmit equirectangular projection image data to an external terminal (device) such as a smartphone.

[0035] The acceleration / direction sensor 218 calculates the orientation of the imaging device 2 from the Earth's magnetic field and outputs orientation information. This orientation information is an example of related information (metadata) in accordance with Exif and is used for image processing such as image correction of captured images. The related information also includes the date and time the image was captured and the data size of the image data. The acceleration / direction sensor 218 is also a sensor that detects changes in angle (Roll angle, Pitch angle, Yaw angle) associated with the movement of the imaging device 2. Changes in angle are an example of related information (metadata) in accordance with Exif and are used for image processing such as image correction of captured images.

[0036] Furthermore, the acceleration / orientation sensor 218 is a sensor that detects acceleration in three axes. Based on the acceleration detected by the acceleration / orientation sensor 218, the imaging device 2 calculates its own orientation (angle relative to the direction of gravity). By providing the acceleration / orientation sensor 218 to the imaging device 2, the accuracy of image correction is improved.

[0037] Figure 4 illustrates the hardware configuration of the image processing device 3. Figure 4 also serves as the hardware configuration diagram for the external storage device 4. The hardware configuration of the external storage device 4 is the same as that of the image processing device 3. Therefore, please refer to the following description of the hardware configuration of the image processing device 3 for details on the external storage device 4.

[0038] As shown in Figure 4, the image processing device 3 is built by a computer and includes a CPU 301, ROM 302, RAM 303, HD 304, HDD (Hard Disk Drive) controller 305, display 306, external device connection I / F 308, network I / F 309, bus line 310, keyboard 311, pointing device 312, DVD-RW (Digital Versatile Disk Rewritable) drive 314, and media I / F 316.

[0039] Of these, the CPU 301 controls the operation of the entire image processing device 3. The ROM 302 stores programs used to drive the CPU 301, such as IPL. The RAM 303 is used as the work area for the CPU 301. The HD 304 stores various data such as programs. The HDD controller 305 controls the reading or writing of various data to the HD 304 according to the control of the CPU 301.

[0040] Display 306 displays various information such as cursors, menus, windows, characters, or images. External device connection 3 / F108 is an interface for connecting various external devices. In this case, external devices include, for example, USB memory or printers. Network I / F309 is an interface for data communication using the external network 5. Bus line 310 is an address bus, data bus, etc., for electrically connecting various components such as the CPU 301 shown in Figure 4.

[0041] The keyboard 311 is a type of input means equipped with multiple keys for inputting characters, numbers, and various instructions. The pointing device 312 is a type of input means for selecting and executing various instructions, selecting processing targets, and moving the cursor. The DVD-RW drive 314 controls the reading or writing of various data to the DVD-RW 313, which is an example of a removable recording medium. Note that it is not limited to the DVD-RW 313; it may also be a DVD-R or the like. The media I / F 316 controls the reading or writing (storage) of data to the recording medium 315, such as flash memory.

[0042] Figure 5 is a functional configuration diagram showing an example of the functional configuration of the information processing device 1, the imaging device 2, and the image processing device 3. The information processing device 1 includes a first connection unit 11, a first setting unit 12, a third connection unit 13, a first transmission unit 14, a second receiving unit 15, and an output unit 16. The imaging device 2 includes a second connection unit 21, a second setting unit 22, an imaging unit 23, an acquisition unit 24, and a second transmission unit 25. The image processing device 3 includes a fourth connection unit 31, a third setting unit 32, a first receiving unit 33, a processing unit 34, and a third transmission unit 35.

[0043] First, the functional configuration of the information processing device 1 will be described. The first connection unit 11 connects to the imaging device 2. Specifically, the first connection unit 11 communicates with the imaging device 2 in cooperation with the short-range communication circuit 120 and connects to the imaging device 2. The first setting unit 12 sets setting information that links and manages the identifiers of the information processing device 1, the imaging device 2, and the image processing device 3. The setting information will be described later.

[0044] The third connection unit 13 connects to the image processing device 3. Specifically, the third connection unit 13 works in cooperation with the long-distance communication circuit 112 to connect to the image processing device 3 based on the setting information set by the first setting unit 12. The setting information set by the first setting unit 12 and the third connection unit 13 will now be described.

[0045] The information processing device 1 and the imaging device 2 are located on the same local area network. The information processing device 1 uses a discovery protocol (for example, SSDP (Simple Service Discovery Protocol)) to find the imaging device 2, or the user can manually specify the destination to recognize the imaging device 2. Figure 6 shows an example of the connection process displayed on the display 118 of the information processing device 1.

[0046] Figure 6 shows the IP address of the local area network to which the information processing device 1 and the imaging device 2 belong, the device ID indicating the identifier of the imaging device 2, and information indicating the cooperation status. The first connection unit 11 requests connection processing from the imaging device 2, and the imaging device 2 performs the connection processing. After the connection processing is completed, the first setting unit 12 associates the identifier of the information processing device 1 (for example, the user ID) and the identifier of the imaging device 2 (for example, the device ID) and sets them as setting information.

[0047] As described above, the third connection unit 13 connects to the image processing device 3 (for example, by logging into a service provided by the image processing device 3). After connecting to the image processing device 3, the third connection unit 13 transmits the setting information set by the first setting unit 12 to the image processing device 3 in order to link the identifiers of the imaging device 2 and the image processing device 3. The third setting unit 32, which will be described later, updates the setting information by linking the identifiers of the information processing device 1, the imaging device 2 and the image processing device 3 based on the setting information transmitted by the third connection unit 13. Figure 7 shows an example of the setting information updated by the image processing device 3. Figure 7 shows the result displayed on the display 118 of the information processing device 1.

[0048] Figure 7 shows the user ID of the information processing device 1, the device ID of the imaging device 2, the session ID between the image processing device 3 and the information processing device 1, an identifier indicating the connection destination of the image processing device 3 (for example, a URL), the value of the identifier, and a description thereof. This allows the information processing system 100 to associate the identifiers of the information processing device 1, the imaging device 2, and the image processing device 3.

[0049] Returning to Figure 5, the first transmission unit 14 sends a notification request to the image processing device 3. Specifically, the first transmission unit 14 sends a notification to the image processing device 3 instructing it to notify the image processing device 3 of the results of the image processing when the image processing device 3 has performed image processing on the image transmitted by the imaging device 2.

[0050] Furthermore, the first transmission unit 14 can send further notification requests in response to the notification results from the image processing device 3. Specifically, the first transmission unit 14, in cooperation with the touch panel 121, sends a notification request to the image processing device 3 to notify it of detailed results corresponding to the image processing results.

[0051] The second receiving unit 15 receives the image processing results transmitted by the image processing device 3. Specifically, the second receiving unit 15 receives the image processing results transmitted by the image processing device 3 in response to the notification request transmitted by the first transmitting unit 14. In addition, the second receiving unit 15 receives the detailed results transmitted by the image processing device 3 in response to further notification requests transmitted by the first transmitting unit 14.

[0052] The output unit 16 outputs the results of the connection with the imaging device 2. The output unit 16 also outputs setting information. Furthermore, the output unit 16 outputs the notification content transmitted by the image processing device 3.

[0053] Figure 8 shows an example of detailed results transmitted by the image processing device 3. Figure 8 shows the results displayed on the display 118 of the information processing device 1. Figure 8 shows the results of image processing performed by the image processing device 3. Furthermore, if the user requests more detailed notification results, they can request notification from the image processing device 3 by pressing the button labeled "Show detailed results."

[0054] Figure 9 shows an example of detailed results transmitted by the image processing device 3. Figure 9 shows the results displayed on the display 118 of the information processing device 1. Figure 9 shows the results of image processing performed by the image processing device 3. Specifically, Figure 9 shows the execution date and time transmitted by the imaging device 2, and the execution date and time when the image processing device 3 performed image processing on the image captured by the imaging device 2. It also shows information representing the status of the processing performed by the imaging device 2 and the image processing device 3 (for example, status related to normal or abnormal). This allows the information processing device 1 to understand the results processed by the imaging device.

[0055] Next, the functional configuration of the imaging device 2 will be described. The second connection unit 21 connects to the information processing device 1 and the image processing device 3. Specifically, the second connection unit 21 works in cooperation with the antenna 217a to connect to the information processing device 1 and the image processing device 3 based on the setting information set by the second setting unit 22.

[0056] The second setting unit 22 sets the identifier of the information processing device 1 and the identifier of the image processing device 3 based on the setting information set by the information processing device 1. Specifically, after the second connection unit 21 connects with the information processing device 1, the second setting unit 22 sets the user ID of the information processing device 1 and the connection destination of the image processing device 3 based on the setting information set by the first setting unit 12.

[0057] The imaging unit 23 captures an image of the subject. Specifically, the imaging unit 23 works in cooperation with the imaging control unit 205 to capture an image of the subject. The acquisition unit 24 acquires the image captured by the imaging unit 23. Specifically, the acquisition unit 24 works in cooperation with the imaging control unit 205 to acquire the image.

[0058] The second transmission unit 25 transmits an image. Specifically, the second transmission unit 25 transmits the image acquired by the acquisition unit 24 to the image processing device 3 based on the setting information set by the second setting unit 22.

[0059] Next, the functional configuration of the image processing device 3 will be described. The fourth connection unit 31 connects to the information processing device 1 and the imaging device 2. Specifically, the fourth connection unit 31 connects to the information processing device 1 and the imaging device 2 in cooperation with the network I / F 309 based on the setting information set by the third setting unit 32.

[0060] Furthermore, the fourth connection unit 31 issues a session ID to the information processing device 1 and maintains the connection. As a result, the identifier of the information processing device 1 is set in the configuration information of the image processing device 3, and the image processing device 3 can send notifications to the information processing device 1. The technology that enables the above-mentioned connection is, for example, Websocket.

[0061] The third setting unit 32 sets the identifier of the information processing device 1 and the identifier of the imaging device 2 based on the setting information set by the information processing device 1. Specifically, the third setting unit 32 sets the user ID of the information processing device 1 and the device ID of the imaging device 2.

[0062] The first receiving unit 33 receives notification requests. Specifically, the first receiving unit 33 receives notification requests transmitted by the information processing device 1. The processing unit 34 performs image processing. Specifically, the processing unit 34 receives images transmitted by the imaging device 2. The processing unit 34 also performs image processing on the received images. Image processing includes, for example, enlarging or reducing the captured images, processing to make them compatible with display devices, and transmitting the images to the external storage device 4. The processing content related to image processing is not limited to these. Furthermore, the processing unit 34 transmits the processed images to the external storage device 4.

[0063] The third transmission unit 35 transmits the image processing results. Specifically, the third transmission unit 35 transmits the image processing results performed by the processing unit 34 to the information processing device 1.

[0064] Next, the operation of the information processing system 100 of the embodiment having the above-described configuration will be explained with reference to Figures 10 and 11.

[0065] First, in order for the image processing device 3 to process the image captured by the imaging device 2, it is necessary to associate identifiers for the imaging device 2 and the image processing device 3. Therefore, the following process is performed.

[0066] The first connection unit 11 connects to the imaging device 2 (step S1). The first setting unit 12 then sets setting information that links and manages the identifiers of the information processing device 1, the imaging device 2, and the image processing device 3.

[0067] Next, the third connection unit 13 connects to the image processing device 3 based on the setting information set by the first setting unit 12 (step S2). Subsequently, the third setting unit 32 sets the identifier of the information processing device 1 and the identifier of the imaging device 2 based on the setting information set by the information processing device 1 (step S3). After connecting to the image processing device 3, the third connection unit 13 transmits the setting information updated by the first setting unit 12 to the image processing device 3.

[0068] Next, the first transmission unit 14 sends a notification request to the image processing device 3 (step S4). Subsequently, the fourth connection unit 31 issues a session ID to the information processing device 1 and maintains a connection with the information processing device 1 (step S5). Once the process in step S5 is completed, the identifiers of the imaging device 2 and the image processing device 3 are linked.

[0069] Next, we will describe the process by which the information processing device 1 receives notification content transmitted from the image processing device 3. This process will describe the process that takes place after the imaging device 2 has captured an image of the subject.

[0070] The second transmission unit 25 transmits the image acquired by the acquisition unit 24 to the image processing device 3 (step S11). Subsequently, the processing unit 34 performs image processing on the image transmitted by the second transmission unit 25 (step S12). Subsequently, the processing unit 34 transmits the processed image to the external storage device 4 (step S13).

[0071] Next, the third transmission unit 35 transmits the results of the image processing performed by the processing unit 34 to the information processing device 1 (step S14). Subsequently, the output unit 16 outputs the notification content transmitted by the third transmission unit 35 (step S15).

[0072] The first transmission unit 14 sends a notification request to the image processing device 3 corresponding to the detailed image processing results (step S16). Subsequently, the third transmission unit 35 sends the detailed image processing results from the processing unit 34 to the information processing device 1 (step S17). Subsequently, the output unit 16 outputs the detailed results sent by the third transmission unit 35 (step S18). When the processing in step S15 is completed, the information processing device 1 completes the process of receiving the notification content sent from the image processing device 3.

[0073] As described above, the information processing system 100 according to this embodiment sets setting information to link identifiers of the information processing device 1, the imaging device 2, and the image processing device 3, and outputs the image processing results corresponding to the image captured by the imaging device 2 based on the setting information. In this way, the information processing system 100 allows the user to understand the results processed by the imaging device 2.

[0074] The embodiments described above can also be modified and implemented as appropriate by changing some of the configurations or functions of each of the devices described above. Therefore, several modifications of the embodiments described above will be described below as other embodiments. In the following, we will mainly describe the differences from the embodiments described above, and will omit detailed explanations of points that are common with what has already been described. Furthermore, the modifications described below may be implemented individually or in combination as appropriate.

[0075] (modified version) In the above-described embodiment, the third connection unit 13 was described as connecting to the image processing device 3 based on the setting information set by the first setting unit 12, but it is not limited to this. For example, the third connection unit 13 may connect to the image processing device 3 based on the information captured by the imaging device 2.

[0076] In realizing the above configuration, for example, the output unit 16 of the information processing device 1 displays information that the imaging device 2 can recognize (for example, a QR code (registered trademark), etc.) on the display 118. The recognizable information includes the identifier of the information processing device 1.

[0077] The imaging unit 23 of the imaging device 2 captures recognizable information displayed by the information processing device 1. The acquisition unit 24 acquires the captured image. The second setting unit 22 sets the identifier of the information processing device 1, the identifier of the imaging device 2, and the identifier of the image processing device 3, which are included in the image acquired by the acquisition unit 24, into the setting information. The second connection unit 21 connects to the information processing device 1 based on the setting information set by the second setting unit 22. Subsequently, the second connection unit 21 transmits the setting information to the information processing device 1.

[0078] The first setting unit 12 of the information processing device 1 sets the setting information based on the setting information transmitted by the second connection unit 21. The third connection unit 13 connects to the image processing device 3 based on the setting information set by the first setting unit 12. As a result, the image processing device 3 can obtain the identifiers of the information processing device 1 and the imaging device 2, and can associate the identifiers of the information processing device 1 and the imaging device 2 and set them as setting information.

[0079] Each of the functions of the embodiments described above can be realized by one or more processing circuits. Hereinafter, "processing circuit" as used herein includes processors programmed to execute each function by software, such as processors implemented by electronic circuits, as well as devices such as ASICs (Application Specific Integrated Circuits), DSPs (Digital Signal Processors), FPGAs (Field Programmable Gate Arrays), and conventional circuit modules designed to execute each of the functions described above.

[0080] The apparatus described in the examples represents only one of several computing environments for carrying out the embodiments disclosed herein. In one embodiment, the first apparatus includes several computing devices, such as a server cluster. The several computing devices are configured to communicate with each other via any type of communication link, including a network or shared memory, and to perform the processing disclosed herein.

[0081] The program executed by the information processing system 100 of this embodiment is provided pre-installed in ROM or the like. Alternatively, the program executed by the information processing system of this embodiment may be provided as an installable or executable file recorded on a computer-readable recording medium such as a CD-ROM, flexible disk (FD), CD-R, or DVD (Digital Versatile Disk).

[0082] Furthermore, the program executed by the information processing system 100 of this embodiment may be stored on a computer connected to a network such as the Internet and provided by downloading it via the network. Alternatively, the program executed by the imaging system of this embodiment may be provided or distributed via a network such as the Internet. [Explanation of Symbols]

[0083] 1. Information Processing Device 2. Imaging device 3 Image Processing Device 4 External storage device 11. First connection section 12. First Setting Section 13. Third connection section 14. First Transmitter 15. Second receiving unit 16 Output section 21 Second connection section 22 Second Setting Section 23 Imaging Unit 24 Acquisition Department 25 Second Transmitter 31 Fourth connection section 32 Third Setting Section 33 First Receiving Unit 34 Processing Unit 35 Third Transmitter 101 CPU 102 ROM 103 RAM 104 EEPROM 108 Recording media 118 displays 119 External device connection interface 120 Near field communication circuit 121 Touch Panel [Prior art documents] [Patent Documents]

[0084] [Patent Document 1] Japanese Patent Publication No. 2004-320222

Claims

1. An information processing system comprising an imaging device, an image processing device, and an information processing device capable of communicating with the imaging device and the image processing device, The information processing device includes a first setting unit that sets setting information linking an identifier for the information processing device, an identifier for the imaging device, and an identifier for the image processing device, A connection unit that transmits and connects to the image processing device, the first setting unit has set the setting information, The imaging device includes a display unit that displays information recognizable by the imaging device, The imaging device includes a second setting unit that sets an identifier for identifying the image processing device based on an image in which the recognizable information has been captured, The system includes a second transmission unit that transmits an image captured to the image processing device based on an identifier that identifies the image processing device set by the second setting unit, The image processing device includes a third setting unit that sets an identifier for identifying the imaging device based on the setting information transmitted by the connection unit, A processing unit performs image processing on the image transmitted by the second transmitting unit, The information processing device comprises a third transmission unit that transmits the processing results performed by the processing unit to the aforementioned information processing device, The information processing device further includes an output unit that outputs the processing result. Information processing system.

2. The aforementioned information processing device is It includes a first transmission unit that sends a notification request to notify the user of detailed processing results in response to user operations, The third transmission unit transmits the detailed processing results of the image processing performed by the processing unit to the information processing device. The output unit outputs the detailed processing results. The information processing system according to claim 1.

3. An information processing method performed in an information processing system comprising an imaging device, an image processing device, and an information processing device capable of communicating with the imaging device and the image processing device, The information processing device includes a first setting step of setting setting information that links an identifier for identifying the information processing device, an identifier for identifying the imaging device, and an identifier for identifying the image processing device, A connection step which transmits and connects the setting information set in the first setting step to the image processing device, The imaging device includes a display step of displaying information that can be recognized by the imaging device, The imaging device includes a second setting step of setting an identifier to identify the image processing device based on an image from which the recognizable information has been captured, The second transmission step includes transmitting the captured image to the image processing device based on an identifier that identifies the image processing device set in the second setting step, The image processing device includes a third setting step of setting an identifier for identifying the imaging device based on the setting information transmitted in the connection step, The second transmission step includes a processing step which performs image processing on the image transmitted in the second transmission step, The third transmission step includes transmitting the processing results performed in the processing step to the information processing device, The information processing device further includes an output step of outputting the processing result, Information processing methods.

Images