Information processing system, image processing device and program
By displaying the QR code on the camera and automatically obtaining and transmitting registration information to the server, the problem of users in the prior art requiring manual input of email addresses to register the camera is solved, and a simpler registration process is realized and the user experience is improved.
Patent Information
- Application Number
- JP2022012431
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2021-03-24
- Filing Date
- 2022-01-28
- Publication Date
- 2025-04-28
- Estimated Expiration
- 2042-01-28
AI Technical Summary
In the prior art, users need to manually enter an email address through the camera's user interface to register the camera and the server. The process is cumbersome and inconvenient for users to register without an email account.
By displaying the QR code containing a random string and a server URL on the camera, users can capture the QR code through other devices (such as smartphones or personal computers), automatically obtain and transmit registration information to the server, realizing automatic registration between the camera and the server.
The process of camera registration is simplified, reducing the complexity of user operations, especially for users without an email account, and improving the convenience and user experience of registration.
Smart Images

Figure 0007669302000001 
Figure 0007669302000002 
Figure 0007669302000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing system, an image processing device, an information processing device, a server device, an information processing method, and a program for registering an image processing device in a server device. [Background technology]
[0002] There is a function to send images taken with an image processing device such as a digital camera (hereinafter referred to as a camera) to an external web service via wireless communication such as Wi-Fi (registered trademark). Examples of external web services include Facebook (registered trademark) and Google Photo (registered trademark). In this case, there is a web server (server device) that acts as an intermediary between the camera and the external web service, and there is a system in which the camera can be registered on the web server to send images from the camera to the web server, and the web server can then transfer the images to the external web service.
[0003] To register a camera on a web server, it is necessary to link the camera with account information for the service provided by the web server. For this purpose, it is known that a user inputs information required for registration on the web server via a user interface of the camera, and the camera communicates with the web server or an information processing device such as a smartphone or a personal computer.
[0004] In the system described in Patent Document 1, an input of an email address from a user is accepted via a user interface of the camera, and the camera is registered on a Web server using the input email address. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2015-114724 A Summary of the Invention [Problem to be solved by the invention]
[0006] In the system described in Patent Document 1, as described above, the user needs to operate the camera to input an email address. However, inputting characters via a camera's user interface is generally less user-friendly than inputting characters via a personal computer or smartphone, and therefore requires a lot of effort.
[0007] In addition, since camera owners do not necessarily have email accounts, users who do not have email accounts must create an email account in order to register the camera, which is inconvenient.
[0008] SUMMARY OF THE PRESENTLY PREFERRED EMBODIMENTS In view of the above-mentioned problems, an object of the present invention is to reduce the number of operations required on the image processing device side to register the image processing device with a server device, thereby reducing the time and effort required for registration. [Means for solving the problem]
[0009] The above purpose etc. In order to achieve this, As one aspect The information processing system includes an image processing device, an information processing device, and a server. and An information processing system comprising: before Note identification information including at least a random character string used to register the image processing device to a web service provided by the server, and a QR (Quick Response) code including a URL (Uniform Resource Locator) related to the server; Display to show images control Means, A communication control means for controlling communication of the identification information with the server; of Yes The information processing device The display control means of the image processing device The above displayed QR Code An image capturing means for capturing an image, QR Code image Analyze the data and obtain the identification information and URL. Acquisition means; Obtained by analytical processing Identification information A first transmission control means for transmitting to an outside using the URL obtained by the analysis process. And, Yes , the said server B teeth, The identification information communicated with the image processing device, and the identification information obtained by the analysis process as a result of access using the URL of the information processing device The identification information matched After judging that , the image processing device To the above web service A registration means for registering; Have It is characterized by:
[0010] In addition, the present invention Another aspect The information processing system is an information processing system including an image processing device, an information processing device, and a server device, wherein the image processing device comprises a generation means for generating identification information, a display means for displaying the identification information generated by the generation means, and a first transmission means for transmitting the identification information generated by the generation means to the server device, the information processing device comprises an input means for accepting input from a user of the identification information displayed by the display means, and a second transmission means for transmitting the identification information input by the input means to the server device, and the server device comprises a first receiving means for receiving the identification information transmitted by the first transmission means, a second receiving means for receiving the identification information transmitted by the second transmission means, and a registration means for registering the image processing device based on a match between the identification information received by the first receiving means and the identification information received by the second receiving means.
[0011] According to another aspect of the present invention, there is provided an image processing device that communicates with a Web service, the image processing device comprising: a display control unit that controls display of identification information including at least a random character string used to register the image processing device with a related Web service, and an image of a Quick Response (QR) code including a Uniform Resource Locator (URL) related to the Web service; and a communication control unit that controls communication of the identification information with the Web service, The image of the QR code was scanned Other information processing devices providing the identification information included in the QR code to register the image processing device to the Web service according to the present invention; As a result of the further communication, when the image processing device recognizes that the registration process to the Web service has been completed, the display control means controls the display to display a notification indicating that the process has been completed.
[0012] In addition, the present invention Another aspectThe information processing device is an information processing device capable of communicating with an image processing device and a server device, and is characterized in that it comprises an imaging means for capturing an image displayed on the image processing device, an acquisition means for acquiring identification information based on the image captured by the imaging means, a transmission means for transmitting the identification information acquired by the acquisition means to the server device, and a notification means for notifying a user that the registration is complete when the image processing device is registered to the server device based on a match between the identification information transmitted by the transmission means and the identification information transmitted from the image processing device to the server device.
[0013] In addition, the present invention Another aspect The server device is a server device capable of communicating with an image processing device and an information processing device, and includes a first receiving means for receiving, from the image processing device, identification information generated by the image processing device, and a second receiving means for receiving, from the information processing device that has captured an image displayed on the image processing device, the identification information acquired based on the captured image; before The image processing device is characterized in that it further comprises a registration means that registers the image processing device based on a match between the identification information received by the first receiving means and the identification information received by the second receiving means. Effect of the Invention
[0014] According to the present invention, it is possible to reduce the effort required for registering an image processing device in a server device. [Brief description of the drawings]
[0015] [Figure 1] FIG. 1 is a block diagram of a camera 100 according to first and second embodiments. [Diagram 2] FIG. 1 is an external view of a camera 100 according to first and second embodiments. [Diagram 3] FIG. 2 is a block diagram of a Web server according to the first and second embodiments. [Figure 4] 1 is a schematic diagram of an entire system according to a first embodiment. [Diagram 5]FIG. 2 is an overall sequence diagram of processing in the first embodiment. [Figure 6] FIG. 4 is a flowchart showing the operation of the camera 100 in the first embodiment. [Figure 7] FIG. 4 is a flowchart illustrating the operation of the Web server 400 in the first embodiment. [Figure 8] FIG. 4 is a flowchart illustrating the operation of the smartphone 500 according to the first embodiment. [Figure 9] FIG. 11 is a schematic diagram of the entire system according to the second embodiment. [Figure 10] FIG. 11 is an overall sequence diagram of processing in the second embodiment. [Figure 11] FIG. 11 is a flowchart showing the operation of the personal computer 600 in the second embodiment. [Figure 12] 1A to 1C are diagrams showing examples of screens displayed on the camera 100 in the first and second embodiments. [Figure 13] FIG. 11 is a flowchart illustrating the operation of the camera 100 in the third embodiment. [Figure 14] FIG. 13 is a flowchart illustrating the operation of the Web server 400 in the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0016] [First embodiment] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples, and the present invention is not limited to the configurations shown in the drawings.
[0017] 1 shows an example of the hardware configuration of a camera 100 according to an embodiment of the present invention. Note that, although the camera 100 will be described as an example of an image processing device in this embodiment, the image processing device is not limited to the camera 100 as long as it is a device for processing images, such as a printer that prints images or a video camera that can capture moving images.
[0018] The control unit 101 controls each unit of the camera 100 in accordance with input signals and a program described below. Note that instead of the control unit 101 controlling the entire device, the entire device may be controlled by multiple hardware devices sharing the processing.
[0019] The imaging unit 102 is composed of, for example, an optical system that controls an optical lens unit, an aperture, zoom, focus, etc., and an imaging element for converting light (image) introduced through the optical lens unit into an electrical image signal. As the imaging element, a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD) is generally used. Under the control of the control unit 101, the imaging unit 102 converts the subject light imaged by the lens included in the imaging unit 102 into an electrical signal using the imaging element, performs noise reduction processing, etc., and outputs the digital data as image data. In the camera 100 of this embodiment, the image data is recorded on the recording medium 110 in accordance with the DCF (Design Rule for Camera File system) standard.
[0020] The non-volatile memory 103 is an electrically erasable and recordable non-volatile memory, and stores programs, etc., which are described below, executed by the control unit 101. The working memory 104 is used as a buffer memory for temporarily storing image data captured by the imaging unit 102, an image display memory for the display unit 106, a working area for the control unit 101, etc.
[0021] The operation unit 105 functions as a user interface for receiving instructions for the camera 100 from the user. The operation unit 105 includes, for example, a power button for the user to instruct on / off of the power supply of the camera 100, a release button for instructing shooting, and a playback button for instructing playback of image data. In addition, the operation unit 105 includes operation members such as a dedicated connection button for starting communication with an external device via a wireless communication unit 111 described later. In addition, a touch panel formed on a display unit 106 described later is also included in the operation unit 105. The release button has a switch 1 and a switch 2. When the release button is pressed halfway, the switch 1 is turned on. This accepts instructions for preparing for shooting, such as AF (autofocus) processing, AE (automatic exposure) processing, AWB (auto white balance) processing, and EF (flash pre-flash) processing. When the release button is pressed fully, the switch 2 is turned on. This accepts instructions for shooting.
[0022] The display unit 106 displays the viewfinder image during shooting, displays the captured image data, and displays characters for interactive operation. It also displays the on / blink / off state of a lamp or the like. Examples of the state include the access state to the recording medium 110 described below, and the communication state of the wireless communication unit 111. Note that the display unit 106 does not necessarily have to be built into the camera 100. The camera 100 can be connected to an internal or external display unit 106, and it is sufficient that the camera 100 has at least a display control function for controlling the display of the display unit 106.
[0023] The authentication information generating unit 107 generates authentication information used when registering the camera 100 in the Web server 400. The authentication information includes a random number and a QR code (registered trademark) described later. Note that the authentication information generating unit 107 may be provided as a software module realized by the control unit 101, rather than as a hardware module.
[0024] Recording medium 110 can record image data output from imaging unit 102. Recording medium 110 may be configured to be detachable from camera 100, or may be built into camera 100. In other words, camera 100 needs to have at least a means for accessing recording medium 110.
[0025] The wireless communication unit 111 is an interface for connecting to an external device. The camera 100 of this embodiment can exchange data with an external device via the wireless communication unit 111. For example, image data generated by the imaging unit 102 can be transmitted to the external device via the wireless communication unit 111. In this embodiment, the wireless communication unit 111 includes an interface for communicating with the external device via so-called Wi-Fi (registered trademark) in accordance with the IEEE802.11 standard. The control unit 101 realizes wireless communication with the external device by controlling the wireless communication unit 111. The communication method is not limited to Wi-Fi (registered trademark), and includes, for example, an infrared communication method. The wireless communication unit 111 is an example of a first wireless communication means. It is assumed that the smartphone 500 described later has the same hardware configuration as the camera 100 described using FIG. 1. Here, the smartphone 500 will be described as an example of an information processing device, but any information processing device capable of capturing an image such as a QR code may be used other than the smartphone 500.
[0026] Next, the external appearance of the camera 100 will be described. Figures 2(a) and (b) are diagrams showing an example of the external appearance of the camera 100. The release button 105a, the playback button 105b, the directional keys 105c, the touch panel 105d, and the power lever 105e are operation members included in the operation unit 105 described above. In addition, the display unit 106 displays an image obtained as a result of imaging by the imaging unit 102, a QR code (described later), and a notification indicating the result of registration of the camera 100 to the Web server 400.
[0027] 3 shows an example of the hardware configuration of a Web server 400 as an example of a server device that registers the camera 100. A control unit 401 controls each unit of the Web server 400 in accordance with input signals and a program described below. Note that instead of the control unit 401 controlling the entire device, the entire device may be controlled by multiple pieces of hardware sharing the processing.
[0028] The non-volatile memory 403 is an electrically erasable and recordable non-volatile memory, and stores programs executed by the control unit 401 (to be described later) and information on the camera 100 to be registered.
[0029] The authentication information processing unit 410 performs login authentication of a user who uses the Web server 400 from an information processing device such as a smartphone 500 described later. If the login authentication is successful, it generates an authentication key that uniquely identifies the information processing device. It also performs authentication when a random number is notified from the camera 100. Note that the authentication information processing unit 410 may be provided as a software module realized by the control unit 401, rather than as a hardware module.
[0030] The communication unit 411 is an interface for connecting to an external device via the public network 300. The Web server 400 of this embodiment can exchange data with the camera 100 and the smartphone 500 via the public network 300. Note that in this embodiment, the communication unit 411 is not limited to being wireless or wired.
[0031] 4 is a schematic diagram of an entire system including a camera 100, an access point 200, a public network 300, a Web server 400, and a smartphone 500. In the system of this embodiment, the camera 100, the Web server 400, and the smartphone 500 are connected to each other so that they can communicate with each other.
[0032] FIG. 5 is a sequence diagram of the process in this embodiment in which the QR code displayed on the camera 100 is captured by the smartphone 500 and the camera 100 is registered in the web server 400.
[0033] First, in order to log in to the Web server 400, the smartphone 500 notifies the Web server 400 of an account ID and password (M401). The account ID and password may be stored in the smartphone 500, or may be input by the user each time the user logs in. The Web server 400 performs login authentication using the authentication information processing unit 410, and if the authentication is successful, generates an authentication key that uniquely identifies the user and distributes it to the smartphone 500 (M402).
[0034] On the other hand, when the camera 100 receives an instruction to register the Web server 400 from the user via the operation unit 105, the control unit 101 instructs the authentication information generation unit 107 to generate a random number (M403). Then, a QR code is generated based on the random number generated in M403 and an authentication URL that the smartphone 200 accesses to perform authentication processing with the Web server 400 (M404). After generating the QR code, the control unit 101 causes the display unit 106 to display the QR code and the random number (M405). Note that, although the random number and the QR code are used as examples of identification information and an example of an image indicating the identification information, the present invention is not limited to these examples. For example, a combination of numbers other than random numbers may be used as identification information, and an image in a format other than a QR code may be used.
[0035] When the QR code is displayed in M405, the smartphone 500 captures an image of the QR code (M406). The smartphone 500 analyzes the captured QR code and obtains a random number and an authentication URL (M407). Next, the smartphone 500 accesses the authentication URL and notifies the Web server 400 of the random number and the authentication key distributed by the Web server in M402 (M408).
[0036] When the Web server 400 receives the random number and the authentication key from the smartphone 500, the authentication information processing unit 410 checks whether the same random number has been received twice (M409). Here, duplicate reception includes reception from the smartphone 500 or reception from an information processing device other than the smartphone 500. When it is confirmed that there is no duplication, the Web server 400 temporarily stores the authentication key and random number as provisional registration information (M410), and notifies the smartphone 500 that provisional registration has been completed (M411).
[0037] The smartphone 500 displays a message that the provisional registration has been completed, and prompts the user to continue the registration process (M412). The guidance given to the user here includes a message prompting the user to operate the camera 100. If the random numbers notified by the smartphone 500 in M408 are duplicated, the Web server 400 does not perform provisional registration, and notifies the smartphone 500 of the duplication (error). Furthermore, the previously provisionally registered information is also deleted.
[0038] After provisional registration, the camera 100 starts wireless communication 111 based on the user's operation on the operation unit 105, and starts a connection with the Web server 400 via the access point 200 and the public network 300 (M413). Then, the camera 100 notifies the Web server 400 of the random number generated in M403 and information unique to the camera 100 (hereinafter referred to as camera information or "device information") (M414). The information unique to the camera 100 includes, for example, the camera's serial number, MAC address, model ID, etc.
[0039] Note that the wireless communication unit 111 may be started up before M403. In this embodiment, the wireless communication unit 111 is started up in M413, thereby suppressing power consumption by the wireless communication unit 111 in the period from M403 to M412.
[0040] The Web server 400, which has received the random number, collates the received random number with the random numbers contained in the temporarily stored provisional registration information to determine whether there is a match (M415). If a match is found, the authentication information processing unit 410 generates camera identification information (device identification information) for uniquely identifying the camera (M416). After the camera 100 is registered with the Web server 400, when communicating with the Web server 400 (uploading image data), the camera identification information is included in the transmission. The Web server 400 identifies the camera 100 based on the camera identification information. Next, the account information linked to the authentication key, the camera information, and the camera identification information are stored in association with each other (M417). The associated information is stored in the non-volatile memory 403. Through this process, the camera 100 is registered with the Web server 400.
[0041] When the camera 100 is registered in M417, the Web server 400 notifies the smartphone 500 that registration is complete and provides the camera information (M418). The smartphone 500 displays the camera information along with a notification that registration is complete (M419). The camera information is displayed here to allow the user to confirm that the correct camera has been registered.
[0042] The Web server 400 then notifies the camera 100 that registration was successful and the camera identification information (M420). When the control unit 101 of the camera 100 receives the registration success result and the camera identification information, it stops the wireless communication unit 111 (M421). Then, the display unit 106 displays the camera information, indicating that registration to the Web server 400 was successful, and asking whether to save the camera identification information (M422). When the user confirms that the camera information displayed on the smartphone 500 in M419 matches the camera information displayed in M422, he or she selects OK (M423). This causes the control unit 101 to store the camera identification information in the non-volatile memory 103 (M424). After storage, the display unit 106 displays a message indicating that registration has been completed (M425).
[0043] It should be noted that if the camera information is notified in M414 before the smartphone 500 captures the QR code in M406, i.e., before the random number is sent from the smartphone 500 to the Web server 400 in M408, the Web server 400 notifies the camera 100 of registration failure.
[0044] Furthermore, if the random number and camera information are not received from the camera 100 even after a certain time has elapsed since the Web server 400 notified the smartphone 500 of the success of the provisional registration in M411, the Web server 400 deletes the provisional registration information.
[0045] FIG. 6 is a flow chart illustrating the operation of the camera 100 in this embodiment.
[0046] When a user instructs the camera 100 to register with the web server 400 via the operation unit 105 of the camera 100, the control unit 101 generates a random number and causes the display unit 106 to display a QR code that encodes data including the random number and the numerical value of the random number itself (S501).
[0047] Fig. 12 shows an example of a screen displayed in S501. Information 1201 at the top of the screen is a random number, and information 1202 on the left side of the screen is a QR code. Furthermore, the guidance to the user displayed on the smartphone 500 in M412 includes a message encouraging the user to operate the operation button 1203 in Fig. 12.
[0048] When the operation button 1203 is operated, the control unit 101 activates the wireless communication unit 111 to start a wireless connection with the access point 200 (S502). The control unit 101 checks whether the wireless connection between the wireless connection unit 111 and the access point 200 has been successful (S503). If the connection is successful in S503, the control unit 101 transmits the random number and camera information to the Web server 400 via the wireless communication unit 111 and the public network 300 (S504).
[0049] Thereafter, the control unit 101 receives the registration result and the camera identification information that uniquely specifies the camera registered by the Web server 400 from the Web server 400 via the wireless communication unit 111 (S505), and the control unit 101 stops the wireless communication unit 111 (S506). After stopping the wireless communication unit 111, the control unit 101 checks whether the result is successful (S507). If the registration is successful, the control unit 101 displays the camera information, indicating that the registration to the Web server 400 was successful and asking whether the camera identification information should be saved (S508). The user selects OK or Cancel on the operation unit 105 (S509). The purpose of making the selection here is to have the user check whether the intended camera is registered in the Web server 400. If OK is selected in S509, the control unit 101 stores the camera identification information in the non-volatile memory 103 (S510). Then, the control unit 101 causes the display unit 106 to display a message indicating that registration in the Web server 400 has been completed (S511).
[0050] If the wireless connection fails in S503, the control unit 101 stops the wireless communication unit 111 (S512). The control unit 101 then instructs the display unit 106 to display an error (S513). Here, an error message is displayed indicating that the wireless connection has failed.
[0051] Also, if the registration fails in S507, the control unit 101 instructs the display unit 106 to display an error (S513). In this case, the process may proceed to S512 and the wireless communication unit 111 may be stopped. Here, a message is displayed indicating that the registration process to the Web server 400 has failed. A cause of the error is when the smartphone 500 has not yet performed temporary registration. Other causes include a case where the temporary registration is not performed for a certain period of time after the temporary registration and the expiration date has expired without the random number and camera information being sent to the Web server 400, or a case where another user has temporarily registered with the same random number. Other possible causes include access concentration or a system error occurring on the Web server 400 side. The contents of the error to be displayed may be displayed for each of the listed cases, or only a message indicating the failure may be displayed.
[0052] If cancel is selected in S509, the camera identification information received from the Web server 400 is discarded (S514). The camera 100 behaves as if it is not registered with the Web server 400.
[0053] FIG. 7 is a flow chart for explaining the operation of the Web server 400 in this embodiment.
[0054] First, an account ID and password for logging in are received from the smartphone 500 (S601). The authentication information processing unit 410 of the Web server 400 generates an authentication key that is unique to the user based on the received account ID (S602) and notifies the smartphone 500 (S603).
[0055] Next, the random number and authentication key are received from the smartphone 500 that captured the QR code displayed on the camera 100 (S604). At this time, the authentication information processing unit 410 checks whether another authentication key has been registered with the same random number as the random number received in S604, and checks whether provisional registration is possible with the notified authentication key (S605). If provisional registration is possible, that is, if there is no other authentication key with the same random number, the authentication key and the random number are stored in association with each other in the non-volatile memory 403 (S606). Then, the control unit 401 notifies the smartphone 500 that provisional registration was successful (S607). The control unit 401 activates a timer for checking the expiration date of provisional registration (S608).
[0056] Then, the random number and the camera information are received from the camera 100 via the communication unit 411 (S609). The authentication information processing unit 410 checks whether the same random number as the random number received in S609 exists among the provisionally registered authentication keys (S610). If the same random number exists, the control unit 401 checks whether it is within the expiration date (S611). If it is within the expiration date, the registration is deemed successful, and camera identification information is generated (S612). After generating the camera identification information, the account ID and unique information of the camera 100 received in (S601) are associated with the camera identification information and stored in the non-volatile memory 403 (S613). After storing, the smartphone 500 is notified that the registration of the camera 100 has been completed and the unique information of the camera 100 (S614). Then, the camera 100 is notified that the registration of the camera 100 has been completed and the camera identification information (S615).
[0057] In the above example, the process from S609 onwards is started after the processes from S601 to S608, but in reality, the processes from S609 to S608 and the processes from S609 onwards may be performed in parallel and independently of each other. Therefore, when the random number is received from the camera 100 in S609, provisional registration may not be completed. In this case, the result of the determination in S610 is that the same random number does not exist.
[0058] If it is determined in S605 that the same random number has been registered for another authentication key, the authentication key and random number received in S604 are not stored, and the provisional registration information for the other authentication key is erased from the non-volatile memory 403 (S616). This prevents the camera 100 from being unintentionally associated with another user. Then, the smartphone 500 and the information processing device that distributed the other authentication key are notified of the provisional registration failure due to the duplication of the random number (S617). In addition, if the random number notified from the camera 100 in S610 is not found among the random numbers of the provisionally registered authentication key, the camera 100 and the smartphone 500 are notified of the registration failure due to the absence of provisional registration information (S618). In addition, if the expiration date has passed in S611, the camera 100 and the smartphone 500 are notified of the registration failure due to the expiration date (S619). By setting an expiration date, the possibility of the random numbers being duplicated is gradually reduced.
[0059] FIG. 8 is a flow chart showing the operation of the smartphone 500 in this embodiment.
[0060] The user inputs an account ID and password on the smartphone 500 and sends them to the Web server 400 (S701). Once sent, an authentication key is received from the Web server 400 (S702). The user then captures an image of the QR code displayed on the camera 100 with the smartphone 500 (S703). From the read QR code, the smartphone 500 acquires a random number and an authentication URL (S704). The smartphone 500 transmits the authentication key and the random number to the Web server 400 (S705). The smartphone 500 receives a response from the Web server and confirms the provisional registration result (S706). If provisional registration is successful, the smartphone 500 displays a message on the camera 100 urging the user to continue the registration process (S707).
[0061] Thereafter, the smartphone 500 receives the registration result of the camera 100 and the unique information of the camera 100 from the Web server 400 (S708). It is then confirmed whether the registration was successful (S709). If successful, the smartphone 500 displays a message indicating that registration has been completed and the serial number of the camera 100 (S710).
[0062] If the provisional registration fails in S706, the smartphone 500 displays a message to that effect (S711). If the official registration fails in S709, the smartphone 500 checks whether the validity period has expired (712). If the validity period has expired, a message to that effect is displayed (S713). If the validity period has not expired, a message to the effect that the registration has failed is displayed, as in S711.
[0063] As described above, according to this embodiment, the smartphone 500 captures the QR code generated and displayed by the camera 100, and the camera 100 can be registered in the Web server 400 without inputting complex information in the operation unit 105 of the camera. That is, in an information processing system including the camera 100 (image processing device), the smartphone 500 (information processing device), and the Web server 400 (server device), the camera 100 generates a random number (identification information) and displays a QR code (image) indicating the generated random number. The camera 100 also transmits the generated random number to the Web server 400 (first transmission). The smartphone 500 captures the QR code displayed on the camera 100, acquires a random number based on the captured QR code, and transmits the acquired random number to the Web server 400 (second transmission). The Web server 400 receives the random number transmitted from the camera 100 (first reception) and the random number transmitted from the smartphone 500 (second reception), and registers the camera 100 based on the match between the random numbers. This improves ease of use for the user.
[0064] [Second embodiment] A second embodiment of the present invention will be described below. The hardware configurations of the camera 100 and the smartphone 500 are the same as those in FIG. 1, and the hardware configuration of the Web server 400 is the same as those in FIG.
[0065] Fig. 9 is a schematic diagram of the entire system in this embodiment, which differs from Fig. 4, which is a schematic diagram of the first embodiment, in that the smartphone 500 is replaced with a personal computer 600. In this embodiment, it is assumed that an information device terminal that does not have a QR code reading function, such as the smartphone 500, is used.
[0066] FIG. 10 is a sequence diagram in this embodiment for registering the camera 100 with the Web server 400 by accessing the authentication URL displayed on the camera 100 with the personal computer 600 and entering a random number.
[0067] Since M901 to M905 are similar to M401 to M405 in the sequence (FIG. 5) in the first embodiment, a description thereof will be omitted.
[0068] The user manually enters the authentication URL of the Web server 400 into the personal computer 600 to access it (M906). The authentication URL is assumed to be written on a Web page or in an instruction manual, but may also be displayed on the camera 100. After accessing the authentication URL from the personal computer 600, the user enters the random number displayed on the camera 100 (M907).
[0069] Since M908 to M925 are similar to M408 to M425 in the sequence (FIG. 5) in the first embodiment, a description thereof will be omitted.
[0070] 11 is a flow chart showing the operation of the personal computer 600 in this embodiment. The flow chart for the camera 100 and the Web server 400 is the same as that in the first embodiment, so a description thereof will be omitted.
[0071] Since steps S1001 to S1002 are similar to the flowchart (FIG. 8) in the first embodiment, the description thereof will be omitted.
[0072] The authentication URL of the Web server 400 is manually entered and accessed on the personal computer 600 (S1003). After accessing the authentication URL, the user enters the random number displayed on the camera 100 on the personal computer 600 (S1004).
[0073] Since steps S1005 to S1013 are similar to the flowchart (FIG. 8) in the first embodiment, the description thereof will be omitted.
[0074] As described above, according to this embodiment, even if a personal computer 600 that cannot read QR codes is used, the camera 100 can be registered in the Web server 400 without inputting setting information for registering the camera 100 in the operation unit 105 of the camera 100. That is, in an information processing system including the camera 100 (image processing device), the smartphone 500 (information processing device), and the Web server 400 (server device), the camera 100 generates a random number (identification information) and displays the generated random number. The camera 100 also transmits the generated random number to the Web server 400 (first transmission). The smartphone 500 accepts an input of the random number displayed on the camera 100 from a user, and transmits the accepted random number to the Web server 400 (second transmission). The Web server 400 receives the random number transmitted from the camera 100 (first reception) and the random number transmitted from the smartphone 500 (second reception), and registers the camera 100 based on the match between the random numbers. This improves ease of use for the user.
[0075] Furthermore, by displaying the QR code and the random number on the same screen in camera 100, it becomes unnecessary for the user to select whether to use smartphone 500 or personal computer 600 with camera 100. This simplifies the operation of camera 100 and improves usability for the user.
[0076] [Third embodiment] A third embodiment of the present invention will now be described. The hardware configurations of the camera 100 and smartphone 500 are the same as those in FIG. 1, and the hardware configuration of the Web server 400 is the same as those in FIG.
[0077] Fig. 13 is a flowchart for explaining the operation of the camera 100 in this embodiment, and corresponds to Fig. 6 explained in the first embodiment. Comparing with Fig. 6, it can be seen that S515 and S516 have been added.
[0078] In S515, the control unit 101 checks whether the error is a busy state (server congestion) caused by concentrated access to the Web server 400. If it is not a busy state, the camera 100 ends the registration process to the Web server 400. If it is a busy state, a message is displayed on the display unit 106 asking whether or not to end the registration process to the Web server 400, and an instruction from the user is received (S516). If an instruction not to end is received, the random number generated in S501 is maintained and the process returns to S502. This makes it possible to resume the registration process without having to read the QR code again with the smartphone 500.
[0079] If registration fails in S507, it may be determined whether to stop wireless communication unit 111 depending on the error content. That is, if the error content is a busy state due to concentrated access to Web server 400, wireless communication unit 111 may not be stopped and may be restarted from S504. This allows restarting from a state in which the wireless connection between wireless connection unit 111 and access point 200 is maintained, thereby making it possible to save the time required for wireless connection.
[0080] Fig. 14 is a flow chart for explaining the operation of the Web server 400 in this embodiment, and corresponds to Fig. 7 explained in the first embodiment. Comparing with Fig. 7, it can be seen that S620 and S621 have been added.
[0081] In S620, the control unit 401 checks whether or not there is a concentration of access to the Web server 400. If there is no concentration of access, the process proceeds to S610. On the other hand, if there is congestion due to a concentration of access to the Web server 400, an error notification that the Web server 400 is congested is transmitted to the camera 100 (S621).
[0082] As described above, in this embodiment, if an error is caused by server congestion, a retry (retransmission) can be performed without regenerating the authentication key, thereby reducing the processing load and operational procedures.
[0083] [Other embodiments] A recording medium on which the program code of the software for realizing the above-mentioned functions is recorded may be supplied to the system or device, and the computer (CPU, MPU) of the system or device may read and execute the program code stored in the recording medium. In this case, the program code itself read from the storage medium will realize the functions of the above-mentioned embodiments, and the storage medium on which the program code is stored will constitute the above-mentioned device.
[0084] Examples of storage media for supplying the program code include flexible disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, CD-Rs, magnetic tapes, non-volatile memory cards, ROMs, and DVDs.
[0085] In addition, the above-mentioned functions may be realized not only by the computer executing the read program code, but also by the OS running on the computer performing all or part of the actual processing based on the instructions of the program code. OS is an abbreviation for Operating System.
[0086] Furthermore, the program code read from the storage medium may be written to a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, and a CPU provided in the function expansion board or function expansion unit may perform part or all of the actual processing based on instructions in the program code to realize the above-mentioned functions.
[0087] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. [Explanation of symbols]
[0088] 100 Cameras 101 Control section 106 Display section 107 Authentication information generation unit 111 Wireless Communication Department 400 Web Server 410 Authentication information processing unit 500 Smartphones
Claims
1. An information processing system including an image processing device, an information processing device, and a server, The image processing device includes: a display control means for displaying an image of a QR (Quick Response) Code (registered trademark) including identification information including at least a random character string used for registering the image processing device to a web service provided by the server and a URL (Uniform Resource Locator) related to the server; A communication control means for controlling communication of the identification information with the server; having The information processing device includes: an imaging means for capturing an image of the QR code displayed by the display control means of the image processing device; an acquisition means for performing an analysis process of analyzing the image of the QR code captured by the imaging means and acquiring identification information and a URL; a first transmission control means for transmitting the identification information obtained by the analysis process to an outside using a URL obtained by the analysis process; having The server, a registration means for registering the image processing device to the Web service after determining that the identification information communicated with the image processing device matches the identification information obtained by the analysis process as a result of accessing the information processing device using the URL; An information processing system comprising:
2. The information processing system according to claim 1, characterized in that the image processing device further has a generation means for generating the random character string, and the communication control means of the image processing device communicates the identification information including at least the random character string generated by the generation means to the server.
3. 3. The information processing system according to claim 1, wherein the registration unit registers the image processing device in association with account information of the Web service.
4. 4. The information processing system according to claim 1, wherein the registration unit registers the image processing device by storing a serial number or a MAC address of the image processing device.
5. The information processing system according to any one of claims 1 to 4, characterized in that the server further comprises a means for generating device identification information for identifying the image processing device when the image processing device is registered by the registration means, and notifying the image processing device of the device identification information.
6. 6. The information processing system according to claim 1, wherein the server further comprises a unit for notifying the image processing device and / or the information processing device that the image processing device has been registered by the registration unit.
7. the server performs control so that, when identification information of a random character string is obtained as a result of access using the URL, the identification information of the random character string and information related to an account are temporarily stored; The information processing system according to any one of claims 1 to 6, characterized in that the server further has a means for notifying an error to the information processing device that made the new access when identification information matching the identification information of the temporarily stored random string is obtained as a result of a new access using the URL.
8. 8. The information processing system according to claim 1, wherein the server exchanges information with an external device via a public network.
9. The information processing system according to claim 2, further comprising: a means for notifying the image processing device of an error upon receiving the communication if a condition that access to the server is concentrated is met when the image processing device communicates the identification information including at least the random string generated by the generation means to the server.
10. The information processing system according to claim 9, characterized in that, when the image processing device receives a notification of the error, it performs a retry process, and in the retry process, the identification information including at least the generated random character string is resent.
11. The information processing system according to claim 10, characterized in that the retry processing is executed when a notification of the error is received and in response to a first user instruction in response to a user inquiry made following the receipt of the notification of the error.
12. 12. The information processing system according to claim 1, wherein the image processing apparatus registered in the Web service uploads image data to the Web service.
13. The information processing system according to any one of claims 1 to 12, characterized in that after performing a login process for the Web service based on credential information received from a user, a first transmission control means of the information processing device transmits to the outside the identification information obtained by the analysis process using the URL obtained by the analysis process together with an identifier corresponding to the information processing device that is generated when the login process is successful.
14. The information processing system according to any one of claims 1 to 13, characterized in that the information processing device is a smartphone, and the image processing device is a camera having at least a release button capable of detecting a half-pressed state and a fully-pressed state, and a touch panel display that displays an image of the QR code.
15. 15. The information processing system according to claim 1, wherein the display control means controls so as to display a human readable character string indicating the identification information together with the image of the QR code.
16. 15. The information processing system according to claim 14, wherein the display control means controls so as to further display a display item including a human-readable character string "MENU" together with the image of the QR code.
17. An image processing device that communicates with a web service, a display control unit for controlling to display an image of a QR (Quick Response) code including identification information at least a random character string used for registering the image processing device to a related Web service and a URL (Uniform Resource Locator) related to the Web service; A communication control means for controlling communication of the identification information with the web service; having The image processing device is characterized in that, when the image processing device recognizes based on the results of further communication that a registration process to the Web service has been performed as a result of a process of providing the identification information contained in the QR code in order to register the image processing device to the Web service by another information processing device that has read the image of the QR code, the display control means controls to display a notification indicating that the process has been completed.
18. The method further comprises: generating means for generating the random character string; 18. The image processing apparatus according to claim 17, wherein the communication control means communicates the identification information including at least the random character string generated by the generation means to a server that provides the Web service.
19. 18. The image processing device according to claim 17, wherein the image processing device is a camera having at least a release button capable of detecting whether the release button is half-pressed or fully pressed, and a touch panel display for displaying an image of the QR code.
20. 20. The image processing apparatus according to claim 17, wherein the display control means controls so as to display a human readable character string indicating the identification information together with the image of the QR code.
21. 21. The image processing apparatus according to claim 20, wherein the display control means controls so as to further display a display item including a human-readable character string "MENU" together with the image of the QR code.
22. A communication interface for performing Wi-Fi (registered trademark) communication is provided. The image processing device according to any one of claims 17 to 21, characterized in that the communication control means communicates the identification information between the image processing device and a server providing the Web service by communication via the communication interface, the communication being via an access point to which the image processing device is wirelessly connected.
23. 23. The image processing apparatus according to claim 17, wherein after registration with the Web service is completed, image data is uploaded to the Web service.
24. 24. The image processing device according to claim 23, wherein the image data is image data conforming to the DCF (Design rule for Camera File system) standard, and the image data is image data recorded on a storage medium built into the image processing device or a storage medium attached to the image processing device and accessible by the image processing device.
25. A program for causing a computer to function as each of the means according to any one of claims 17 to 24.
Citation Information
Patent Citations
Method and apparatus for registering devices capable of device-to-device communication in server
EP2887718A1
Interlocking system and method of TV and smartphone using image authentication key, and computer readable storage medium
JP2014010833A
Apparatus management system, communication apparatus, apparatus management device, control method, and program
JP2015114724A
Imaging apparatus and imaging system
JP2016051981A
Communication device, control method for communication device, and program
JP2016146608A