Communication apparatus and control method thereof
Patent Information
- Application Number
- JP2022156469
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2022-09-29
- Publication Date
- 2025-09-30
- Estimated Expiration
- 2042-09-29
AI Technical Summary
Communication devices capable of supporting multiple communication standards face challenges in determining whether information about an external device is stored or deleted, particularly when reconnection requests are made, due to varying timing of identification information acquisition across different standards.
A communication device equipped with first and second communication means for different standards, along with a control mechanism that determines the presence of external device information based on the specific standard of the reconnection request, and outputs warnings or prompts for deletion if necessary.
Enables efficient management of external device connections by accurately determining the status of stored information, reducing unnecessary reconnection attempts and improving user convenience by promptly addressing deleted device information.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a communication device and a control method thereof, and more particularly to a communication device compatible with a plurality of communication standards and a control method thereof. [Background technology]
[0002] By registering information about an external device with which a connection has been established and using the information when a reconnection request is made, it is possible to execute an operation corresponding to the reconnected external device. However, if the information about the external device requesting reconnection is deleted, it becomes impossible to execute an operation corresponding to the external device. In this case, in order to re-register the information about the external device, it is necessary to have the external device send a new connection request instead of a reconnection request.
[0003] Therefore, when a reconnection request is received from an external device, it should be determined whether information about that external device exists (whether it is still registered or has been deleted), and if not, a warning should be issued to send a new connection request. To determine whether information about the external device that sent the reconnection request exists, unique information (identification information) of that external device is required. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent Publication No. 2021-78002 Summary of the Invention [Problem to be solved by the invention]
[0005] On the other hand, the timing at which identification information of an external device can be acquired differs depending on the communication standard. Therefore, in a communication device capable of establishing a connection with an external device that complies with a plurality of communication standards, as described in Patent Document 1, it is necessary to perform an appropriate determination operation depending on which communication standard the reconnection request relates to. However, conventionally, a communication device capable of performing such a determination operation has not been known.
[0006] In one aspect, the present invention provides a communication device that is compatible with multiple communication standards and that, when a reconnection request is received from an external device, can determine whether information about the external device is stored in a manner depending on which communication standard the reconnection request relates to. [Means for solving the problem]
[0007] The above-mentioned object can be achieved by a communication device comprising a first communication means capable of establishing a connection with an external device according to a first communication standard, a second communication means capable of establishing a connection with an external device according to a second communication standard, a storage means for storing information about the external device registered in an application that utilizes communication with the external device, and a control means for outputting a warning when a reconnection request is received from the external device through the first communication means or the second communication means and if the registration of the external device in the application has been deleted, wherein the control means determines whether the registration of the external device in the application has been deleted based on identification information of the external device obtained through different procedures depending on whether the reconnection request is received through the first communication means or the second communication means. Effect of the Invention
[0008] According to the present invention, it is possible to provide a communication device that is compatible with multiple communication standards and that, when a reconnection request is received from an external device, can determine whether information about the external device is stored in a manner depending on which communication standard the reconnection request relates to. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the functional configuration of a digital camera as an external device according to an embodiment; [Diagram 2] FIG. 1 is a block diagram showing an example of a functional configuration of a smartphone as a communication device according to an embodiment; [Diagram 3] FIG. 1 is a schematic diagram showing a configuration example of a communication system according to an embodiment; [Figure 4] FIG. 1 is a diagram showing an example of a software configuration of a smartphone according to an embodiment; [Diagram 5] FIG. 13 is a diagram showing an example of a screen of a camera communication application according to an embodiment; [Figure 6] FIG. 13 is a diagram showing an example of a registered camera list used in the embodiment. [Figure 7] FIG. 1 is a sequence diagram of a wireless LAN connection operation between a digital camera and a smartphone according to an embodiment. [Figure 8] A sequence diagram of a BLE connection operation between a digital camera and a smartphone in an embodiment. [Figure 9] FIG. 13 is a sequence diagram of a wireless LAN reconnection operation between a digital camera and a smartphone according to an embodiment. [Figure 10] FIG. 13 is a diagram showing an example of a warning screen presented by a camera communication application in an embodiment. [Figure 11] Flowchart of the operation of the smartphone corresponding to FIG. [Figure 12] A sequence diagram of a BLE reconnection operation between a digital camera and a smartphone in an embodiment. [Figure 13] Flowchart of the operation of the smartphone corresponding to FIG. 12 [Figure 14] FIG. 11 is a diagram showing an example of a warned camera list used in the second embodiment. [Figure 15] 11 is a flowchart showing the operation of a digital camera when a wireless LAN reconnection request is received in the second embodiment. [Figure 16] 11 is a flowchart showing an operation of a digital camera when a BLE reconnection request is received in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] The present invention will be described in detail below based on its exemplary embodiments with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. In addition, although multiple features are described in the embodiments, not all of them are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numbers are used for the same or similar configurations, and duplicated explanations are omitted.
[0011] In the following embodiment, the present invention will be described with respect to a case where the present invention is implemented in a smartphone. However, the present invention can be implemented in any electronic device that supports multiple communication standards. Such electronic devices include computer devices (personal computers, tablet computers, media players, PDAs, etc.), game consoles, imaging devices, etc. These are merely examples, and the present invention can also be implemented in other electronic devices.
[0012] ●(First embodiment) <Example of digital camera configuration> 1 is a block diagram showing an example of the functional configuration of a digital camera 100 as an example of an external device. The external device may be any electronic device capable of communicating with a smartphone in accordance with one or more communication standards. Such electronic devices include computer devices (personal computers, tablet computers, media players, PDAs, etc.), game consoles, etc.
[0013] The control unit 101 has one or more processors (hereinafter referred to as CPUs) capable of executing programs, and for example, reads a program stored in a non-volatile memory 103 into a working memory 104 and executes it. The control unit 101 controls the operation of each functional block by executing the program, and realizes the functions of the digital camera 100.
[0014] Non-volatile memory 103, which may be rewritable, stores programs executable by the CPU of control unit 101, settings of digital camera 100, GUI data, etc. Non-volatile memory 103 also stores information regarding external devices with which it has communicated.
[0015] It is assumed that the operation of the digital camera 100 , which will be described later, is realized by executing a program stored in the non-volatile memory 103 .
[0016] The working memory 104 is, for example, a volatile memory, and is used to load the programs executed by the CPU of the control unit 101 and to store values required during the execution of the programs. In addition, a part of the working memory 104 may be used as a display memory for the display unit 106.
[0017] The imaging unit 102 is a camera unit having an imaging optical system, an imaging element, and the like. The imaging unit 102 captures images under the control of the control unit 101, and stores the obtained image data in the work memory 104. The control unit 101 applies a predetermined image processing to the image data to generate an image data file. The control unit 101 records the image data file, for example, in a recording medium 107. The control unit 101 also applies a predetermined image processing to the image data to generate image data for display. The control unit 101 stores the image data for display in a video memory area of the work memory 104, synthesizes an image showing information such as current setting values, and displays it on the display unit 106.
[0018] By immediately displaying a moving image on the display unit 106 while the image capturing unit 102 is capturing the moving image, the display unit 106 can function as an electronic viewfinder (EVF). The moving image displayed in order to cause the display unit 106 to function as an EVF is called a live view image.
[0019] Operation unit 105 is a general term for input devices provided in digital camera 100. Operation unit 105 may include, but is not limited to, a touch panel provided on display unit 106, a power switch, a shutter button, a video recording button, directional keys, a setting button, a menu button, and the like. When control unit 101 detects an operation on operation unit 105, it executes an operation corresponding to the detected operation.
[0020] The display unit 106 is used to display images captured by the imaging unit 102, images recorded in the recording medium 107, menu screens, etc. The digital camera 100 may be connectable to an external display device.
[0021] The recording medium 107 may be, for example, a semiconductor memory card, provided separately from the non-volatile memory 103. The recording medium 107 is used as a recording destination for image data files generated by the control unit 101, for example.
[0022] The connection unit 108 is a communication interface. The connection unit 108 performs communication with an external device in accordance with one or more of known wired and wireless communication standards, including a wireless communication standard. The connection unit 108 has a circuit (such as an antenna, a connector, a transceiver, etc.) corresponding to the communication standard to which it conforms.
[0023] The short-range wireless communication unit 109 is also a communication interface. The short-range wireless communication unit 109 performs communication with an external device in accordance with one or more known short-range wireless communication standards. The connection unit 108 has a circuit (such as an antenna, a transceiver, etc.) corresponding to the communication standard to be complied with.
[0024] For convenience, connection unit 108 and short-range wireless communication unit 109 described below are assumed to conform to different wireless communication standards. Connection unit 108 is also assumed to conform to a communication standard that has a wider communication range and a higher communication speed than short-range wireless communication unit 109, and also requires more power for operation than short-range wireless communication unit 109. There are no particular limitations on the combination of communication standards to which connection unit 108 and short-range wireless communication unit 109 conform as long as the above-mentioned relationship is satisfied.
[0025] In this embodiment, the digital camera 100 communicates with a connection unit 208 and a short-range wireless communication unit 212 of the smartphone 200, which will be described later. Therefore, it is assumed that the connection units 108 and 208 conform to the same communication standard, and that the short-range wireless communication units 112 and 212 conform to the same communication standard.
[0026] In the following, as an example, it is assumed that the connection units 108 and 208 are wireless communication interfaces that comply with the wireless LAN (IEEE 802.11 series) standard, and that the short-range wireless communication units 112 and 212 are wireless communication interfaces that comply with Bluetooth (registered trademark) ver. 4.0 or later standards, particularly Bluetooth Low Energy (BLE). Note that the connection unit 108 and the short-range wireless communication unit 109 may share part of the circuitry.
[0027] Furthermore, the connection unit 108 communicates with the connection unit 208 in infrastructure mode, and therefore functions as an access point (AP). That is, the connection unit 108 has a function of forming a network to which the smartphone 200 can connect. However, the connection unit 108 functions as a simple AP that does not have a gateway function of transferring data received from an external device connected to the network that the connection unit 108 has formed to another network. The connection unit 108 can also connect to another AP instead of functioning as a simple AP.
[0028] <Example of smartphone configuration> 2A is a block diagram showing an example of a functional configuration of a smartphone 200 as an example of a communication device according to an embodiment. The smartphone 200 may be any electronic device capable of communicating with each of the connection unit 108 and the short-range wireless communication unit 112 of the digital camera 100, which is an external device.
[0029] The control unit 201 has one or more processors (hereinafter referred to as CPUs) capable of executing programs, and for example, reads a program stored in a non-volatile memory 203 into a working memory 204 and executes it. The control unit 201 controls the operation of each functional block by executing the program, and realizes the functions of the smartphone 200.
[0030] Non-volatile memory 203, which may be rewritable, stores programs (basic software (OS), applications, etc.) executable by the CPU of control unit 201, setting values of smartphone 200 and applications, user data, etc. As will be described later, smartphone 200 also stores in non-volatile memory 203 information on an external device with which it has communicated, and information required to resume communication with the external device with which it has communicated.
[0031] The operation of the smartphone 200, which will be described later, is realized by executing an application stored in the non-volatile memory 203. The application does not need to include all of the programs for realizing its functions, and can use the functions provided by the OS as appropriate. For example, the OS can provide basic functions related to wireless communication with an external device that conforms to a specific wireless communication standard, such as checking the presence or absence of an external device, and establishing and disconnecting a wireless connection (link) with an external device.
[0032] The working memory 204 is, for example, a volatile memory, and is used to read the programs executed by the CPU of the control unit 201 and to store values required during the execution of the programs. In addition, a part of the working memory 204 may be used as a display memory for the display unit 206.
[0033] The imaging unit 202 is a camera unit having an imaging optical system, an imaging element, etc. The imaging unit 202 captures images under the control of the control unit 201, and stores the obtained image data in the working memory 204. The control unit 201 applies predetermined image processing to the image data to generate an image data file. The control unit 201 records the image data file, for example, on a recording medium 207.
[0034] The operation unit 205 is a general term for input devices provided in the smartphone 200. The operation unit 205 may include, but is not limited to, a touch panel provided in the display unit 206, a power switch, a volume adjustment button, and the like. When the control unit 201 detects an operation on the operation unit 205, it executes an operation corresponding to the detected operation.
[0035] The display unit 206 is a touch display. Screens provided by the OS and applications are displayed on the display unit 206. Note that the smartphone 200 may be connectable to an external display device.
[0036] The recording medium 207 is provided separately from the nonvolatile memory 203, and may be, for example, a semiconductor memory card. The recording medium 207 is used, for example, as a recording destination for image data files generated by the control unit 201, data downloaded by the user, etc. The recording medium 207 may be used as a part of the nonvolatile memory 203 (to expand the capacity of the nonvolatile memory 203).
[0037] The connection unit 208 (second communication means) is a communication interface. The connection unit 208 executes communication with an external device in accordance with one or more of known wired and wireless communication standards, including a wireless communication standard. The connection unit 208 has a circuit (antenna, connector, transceiver, etc.) corresponding to the communication standard to which it conforms.
[0038] The short-range wireless communication unit 212 (first communication means) is also a communication interface. The short-range wireless communication unit 212 performs communication with an external device in accordance with one or more known short-range wireless communication standards. The connection unit 208 has a circuit (such as an antenna, a transceiver, etc.) corresponding to the communication standard to be complied with.
[0039] As described above, it is assumed here that the connection unit 208 is a wireless communication interface that complies with the wireless LAN (IEEE 802.11 series) standard, and the short-range wireless communication unit 212 is a wireless communication interface that complies with Bluetooth Low Energy (BLE).
[0040] The public network connection unit 209 is a communication interface with a mobile communication network, and complies with one or more communication standards (such as 3G, 4G, and 5G) established by, for example, the Third Generation Partnership Project (3GPP).
[0041] The connection unit 208, the short-range wireless communication unit 212, and the public network connection unit 209 may share a part of the circuit.
[0042] The microphone 210 is used for making calls and inputting voice commands. The microphone 210 as an input device for voice commands is included in the operation unit 205. The speaker 211 is used for conversation and audio reproduction.
[0043] 2(b) is a diagram showing an example of the appearance of the smartphone 200. The power button 205a, the home button 205b, and the touch panel 205c are input devices included in the operation unit 205. When the home button 205b is operated, the control unit 201 suspends the execution of an application and displays a home screen on the display unit 206.
[0044] Items (for example, icons) corresponding to applications are arranged on the home screen of the smartphone 200. From the home screen, it is possible to start an application or bring an application running in the background into the foreground.
[0045] Here, item 221 is an item of a camera communication application that provides functions that utilize communication between smartphone 200 and digital camera 100. Item 222 is an item of an image application that allows viewing and editing of images stored in smartphone 200. Item 223 is an item of an SNS (social network service) application that allows sharing of images, text, etc. with other users by communicating with a server.
[0046] In this embodiment, the camera communication application is provided by the manufacturer of the digital camera 100 and installed via an application distribution site. The SNS application is provided by a third party and installed via an application distribution site. Meanwhile, the image application is pre-installed as standard on the smartphone 200. It is assumed that whether each application is pre-installed or installed via an application distribution site is stored in, for example, the non-volatile memory 203.
[0047] When an operation on an item (for example, a touch operation) is detected, the control unit 201 checks the state of the application corresponding to the operated item. If the application is not running or needs to be started, the control unit 201 starts the application. On the other hand, if the application is running in the background (inactive) and does not need to be started, the control unit 201 moves the application to the foreground (activates it). As a result, the application screen is displayed on the display unit 206.
[0048] In addition to the operation of items, the smartphone 200 can also change the state of an application by switching the application according to the OS. Specifically, the application can be switched between background (inactive) and foreground (active). If necessary, the control unit 201 starts the application that has been switched from background to foreground. Note that even if the application transitions to background (inactive), it can continue to execute some of its functions.
[0049] <Connection type overview> Fig. 3 is a diagram showing a schematic diagram of a connection form between the digital camera 100 and the smartphone 200. In this embodiment, the digital camera 100 and the smartphone 200 can establish a connection in two forms shown in Fig. 3(a) and Fig. 3(b).
[0050] 3A shows a form in which a digital camera 100 and a smartphone 200 participate in a wireless LAN network formed by an external AP 300, which is an example of a relay device. The digital camera 100 and the smartphone 200 detect a beacon signal periodically transmitted by the external AP 300 and participate in the wireless LAN network formed by the external AP 300. By participating in the same wireless LAN network, the digital camera 100 and the smartphone 200 recognize each other and establish a connection between the devices by executing a predetermined procedure, enabling them to communicate with each other through the wireless LAN network.
[0051] The external AP 300 can be connected to an external network such as the Internet through a public network, etc. Therefore, the smartphone 200 can transmit data to a device on the Internet via the external AP 300.
[0052] 3B shows a configuration in which the digital camera 100 and the smartphone 200 are directly connected without going through a relay device. This is the configuration when the connection unit 108 of the digital camera 100 operates as a simple AP and when communication is performed by BLE between short-range wireless communication units. Note that in this embodiment, the ad-hoc mode of wireless LAN is not used.
[0053] In this embodiment, when the smartphone 200 and the digital camera 100 establish a BLE connection, the smartphone 200 acts as a central device (parent device), and the digital camera 100 acts as a peripheral device (child device). Therefore, the digital camera 100 periodically transmits a BLE advertisement signal from the short-range wireless communication unit 112. In addition, the smartphone 200 executes a scan operation by the short-range wireless communication unit 212, and receives the BLE advertisement signal transmitted by the digital camera 100.
[0054] The smartphone 200 recognizes the presence of the digital camera 100 by receiving the BLE advertisement signal. The smartphone 200 transmits a connection request to the digital camera 100. After that, procedures such as exchanging encryption keys are performed, and once a BLE connection is established, communication through the BLE connection becomes possible.
[0055] When the connection unit 108 of the digital camera 100 functions as a simple AP, the connection unit 108 periodically transmits a beacon signal. The smartphone 200 detects the presence of the digital camera 100 by receiving the beacon signal via the connection unit 208. The smartphone 200 then transmits a participation request to the wireless LAN network created by the connection unit 108 of the digital camera 100. Thereafter, a connection between the devices is established by executing a predetermined procedure, and the devices become capable of communicating with each other.
[0056] It should be noted that the digital camera 100 does not have a communication function for connecting to an external network such as the Internet. Therefore, when joining a wireless LAN network created by the digital camera 100, the smartphone 200 cannot transmit data to an external network such as the Internet.
[0057] <Software configuration of smartphone 200> Next, an example of the software configuration of the smartphone 200 will be described with reference to FIG. 4. Various programs executed by the control unit 201 are stored in the non-volatile memory 203 of the smartphone 200. FIG. 4 representatively shows operating system (OS) 240 and a camera communication application 230 as an example of application software. The camera communication application provides a function that utilizes communication between the digital camera 100 and the smartphone 200. Note that in practice, applications that are installed as standard in the smartphone 200 and applications installed by the user are stored in the non-volatile memory 203.
[0058] When a user turns on a power switch included in an operation unit 205 of the smartphone 200, the smartphone 200 starts up, and the control unit 201 reads the OS 240 from the non-volatile memory 203, expands it in the work memory 204, and executes it. The control unit 201 also controls each unit of the smartphone 200 by executing the OS 240 and installed applications.
[0059] The OS 240 provides various services to applications in addition to providing basic functions of the smartphone 200 to the user. In Fig. 4, a communication service 241 is shown as a representative example of the multiple services that the OS provides to applications.
[0060] The communication service 241 provides functions such as turning on and off (enabling / disabling) functions for each type (communication standard) of the communication function supported by the smartphone 200, generating and managing encryption keys required for communication, establishing a connection with an external device, and communicating with the connected external device. It provides data obtained from an external device through communication to an application, and provides a function for transmitting and receiving data to and from an external device in response to a request from an application.
[0061] The camera communication application 230 has various functional modules. Here, a display control module 231 that generates a screen to be displayed on the display unit 206 and a communication service control module 232 that provides a function for utilizing communication with the digital camera 100 via a communication service 241 provided by the OS 240 are representatively shown.
[0062] Note that information required for communication with external devices, such as pairing information in BLE, is managed by the communication service 241 of the OS 240, and therefore cannot be deleted from the camera communication application 230. To delete information managed by the OS 240, it is necessary to use a dedicated application, such as a setting application.
[0063] On the other hand, the registered camera list, which will be described later, is managed by the camera communication application 230. Therefore, it is possible to delete camera information from the registered camera list via the camera communication application 230. Note that even if camera information is deleted from the registered camera list, information required for communication with the digital camera corresponding to the deleted camera information is still managed by the OS 240 and is not automatically deleted.
[0064] <Explanation of the menu screen of the camera communication application 230> 5 is a diagram showing an example of a menu screen provided by the camera communication application 230 in the foreground state. The camera communication application 230 in this embodiment stores information about a digital camera that has established a connection with the smartphone 200, and provides a menu screen for each stored digital camera. When multiple digital cameras are stored, the user can switch the menu screen to display the menu screen of a desired digital camera to be used through the camera communication application 230.
[0065] An example of a screen that is generated by the display control module 231 and displayed on the display unit 206 as a result of the control unit 201 executing the camera communication application 230 will be described below with reference to FIG. 5(a) shows an example of a menu screen 400 that is displayed when no digital camera is registered when starting up the camera communication application 230. The menu screen 400 has a camera registration button 401 and a registration confirmation button 402.
[0066] When the camera registration button 401 is operated, the control unit 201 executes the registration operation of the digital camera. When the registration is completed, the control unit 201 generates a menu screen for the registered digital camera and displays it on the display unit 206. The operations of the smartphone 200 and the digital camera 100 when registering the digital camera will be described in detail later.
[0067] When the registration confirmation button 402 is operated, the control unit 201 displays, on the display unit 206, a list of information on the digital cameras registered in the camera communication application 230.
[0068] 5(b) shows an example of a menu screen 400a that is displayed when a connection is established between a registered digital camera and smartphone 200 when camera communication application 230 is started. Here, it is assumed that a connection is established between a digital camera (name: Camera A) that is registered in camera communication application 230 and smartphone 200. Therefore, menu screen 400a is a menu screen for Camera A. It is assumed that Camera A and Camera B, which will be described later, both have the same functional configuration as digital camera 100.
[0069] On the menu screen 400a, for example, an icon 403a indicating the appearance, a name 404a (Camera-A), and a connection method 405a are displayed as information on the connected Camera A. Here, an icon is listed for each method (communication standard name) by which the smartphone 200 and Camera A can connect, and when a connection is established, the icon is displayed brighter than when the connection is not established. Note that other display methods may be used, such as showing only the methods by which a connection is established. The example in FIG. 5(b) shows that the smartphone 200 and Camera A have established a BLE connection, but have not established a Wi-Fi connection.
[0070] In this embodiment, information required to establish a connection between the connection units 208 and 108 (e.g., identification information, a password or encryption key, address information, etc.) can be acquired from the digital camera 100 through the connection between the short-range wireless communication units 212 and 112. Switching the communication interface used for communication with the same external device between the short-range wireless communication unit 112 and the connection unit 108 is referred to as handover here.
[0071] A wireless LAN connection is required for functions executed by operating function buttons 406a to 408a, which will be described later. However, if a BLE connection is established, handover to a wireless LAN connection is possible. Therefore, on menu screen 400a, function buttons 406a to 408a are displayed as valid functions. If handover is not possible, function buttons 406a to 408a are displayed as invalid functions.
[0072] The function buttons 406a to 409a correspond to functions that the camera communication application 230 can provide for Camera A. Note that the functions shown here are merely examples, and the types and number of functions may vary depending on the camera communication application 230 and the digital camera.
[0073] For example, any function related to the registered digital camera may be used, such as a function for changing the settings of the digital camera, a function for connecting to an external site where the instruction manual for the digital camera can be viewed, etc. Furthermore, the number and types of function buttons displayed on the menu screen may differ depending on the digital camera.
[0074] Function button 406 a is a button for executing a function of acquiring an image recorded in storage medium 110 from Camera A and displaying it on display unit 206 . The function button 407a is a button for acquiring a live view image from Camera A and using the display unit 206 as an EVF for Camera A. Function button 408a is a button for setting an automatic transmission function for transferring the generated record image data to smartphone 200 when a still image is captured by Camera A. The function button 409a is a button for causing the smartphone 200 to function as a remote control for issuing shooting instructions to Camera A. Note that the remote control function only outputs shooting instructions and does not cause the display unit 206 to function as an EVF for Camera A.
[0075] Here, it is assumed that the functions corresponding to the function buttons 406a to 408a are registered in the camera communication application 230 as functions that require communication via wireless LAN when executed. On the other hand, it is assumed that the function corresponding to the function button 409a is registered in the camera communication application 230 as a function that does not require communication via wireless LAN when executed (can be executed via BLE communication). It is assumed that the relationship between the functions provided by the camera communication application 230 and the communication method required when executed is determined in advance according to, for example, the amount of data communicated between the digital camera and the smartphone 200 when the function is executed, the type of data, etc. For example, a function that requires image data to be transmitted from the digital camera to the smartphone 200 can be a function that requires a communication method capable of high-speed communication among the communication methods supported by the smartphone 200.
[0076] The camera communication application 230 determines whether the function buttons are enabled or disabled depending on the connection method between the smartphone 200 and Camera A, and changes the display form of the function buttons depending on the determination.
[0077] 5B shows a state in which Camera A and smartphone 200 have established a connection via BLE, but have not established a connection via wireless LAN. In this case, control unit 201 determines that a remote control function that does not require communication via wireless LAN is enabled. As a result, function button 409a corresponding to the remote control function is displayed in a form indicating that it is enabled. Here, function buttons corresponding to enabled functions are displayed brighter than function buttons corresponding to disabled functions.
[0078] On the other hand, the functions corresponding to the function buttons 406a to 408a require communication via wireless LAN when executed, and therefore are invalid in the current connection method. However, since it is possible to establish a wireless LAN connection using the currently established BLE connection, the control unit 201 also displays the function buttons 406a to 408a in a form indicating that they are valid.
[0079] In the menu screen 400a, the page marks 410a have a number equal to the number of switchable menu screens. Here, since one digital camera has been registered, one page mark 410a is displayed, indicating that there is no switchable menu screen. For example, if there is one more switchable menu screen, two page marks 410a are displayed, one of which is displayed in black. The page mark 410a displayed in black indicates the currently displayed menu screen. Furthermore, among the multiple page marks 410a, the position of the page mark displayed in black indicates the page number of the currently displayed menu screen, and corresponds to the index number of the registered camera list described later.
[0080] The control unit 201 stores the page number of the currently displayed menu screen in the working memory 204. Furthermore, when the camera communication application 230 transitions from the foreground to the background or is terminated, the control unit 201 stores the page number in the non-volatile memory 203. This makes it possible to reproduce the state in which the same menu screen as the previous time is displayed the next time the camera communication application 230 is started.
[0081] Fig. 5(c) shows an example of a menu screen 400b that is displayed when smartphone 200 establishes a wireless LAN connection with Camera B when camera communication application 230 is started. Assume that Camera B, which is a digital camera different from Camera A, has already been registered in camera communication application 230 in addition to Camera A. Of the items displayed on menu screen 400b, items with the same reference numbers as those in Fig. 5(b) are the same as those on menu screen 400a, and therefore will not be described here.
[0082] On the menu screen 400b, information about the connected Camera B is displayed, for example, an icon 404a indicating the appearance, a name 404b (Camera-B), and a connection method 405b.
[0083] Note that, since Camera B has not established a BLE connection with smartphone 200, BLE is not displayed in connection method 405b. In addition, if a wireless LAN connection has been established, disconnection button 411b is displayed.
[0084] When the disconnection button 411b is operated, the control unit 201 transmits a request to disconnect the wireless LAN connection to Camera B. Upon receiving the disconnection request, the control unit 101 of Camera B stops the operation of the connection unit 108. As a result, the network that the connection unit 108 generated as a simple AP disappears.
[0085] Because a wireless LAN connection is established, control unit 201 determines that the functions corresponding to function buttons 406b to 408b are enabled, and displays function buttons 406b to 408b brightly. On the other hand, because a BLE connection is not established, control unit 201 determines that the remote control function is disabled, and displays function button 409b darkly.
[0086] Two page marks 410b are displayed, one in black and the other in white. This is because two cameras, Camera A and 100b, are registered and two pages of the menu screen are generated. Of the two page marks 410b, the left one is displayed in black and the right one is displayed in white, so it is clear that there is another page of the menu screen on the right side. Therefore, when a flick operation, for example, to the left, is detected on the display unit 206, the control unit 201 switches to the menu screen 400a.
[0087] 5(d) shows an example of a registered camera list screen 400c that displays a list of information on digital cameras registered in the camera communication application 230. The registered camera list screen 400c is displayed in response to operating the registration confirmation button 402 of the menu screens 400 to 400b. In this example, Camera A and Camera B are registered, so information on Camera A and Camera B is displayed.
[0088] The information displayed for each registered digital camera is the same as the content displayed on the menu screen of each digital camera, so a description will be omitted. A title character string 412 indicates that the registered camera list screen 400c is displayed. When the back button 414 is operated, the control unit 201 returns the display to the screen that was displayed immediately before the registered camera list screen 400c was displayed.
[0089] Delete buttons 413a, 413b are displayed for each registered digital camera. When a delete button is operated, the control unit 201 deletes information about the corresponding digital camera from the registered camera list stored in the non-volatile memory 203. For example, when the delete button 413a is operated, the control unit 201 deletes information about Camera A from the registered camera list. The control unit 201 also updates the display of the registered camera list screen 400c so that information about the digital camera deleted from the registered camera list is not displayed.
[0090] <Example of a registered external device list> Fig. 6 is a diagram showing an example of a registered camera list as an example of a registered external device list in which information acquired from an external device with which the smartphone 200 has established a connection is registered. The registered camera list is stored in the non-volatile memory 203. Note that, for ease of explanation and understanding, the registered camera list is shown in a table format in Fig. 6, but the format of the registered camera list is arbitrary. The camera communication application 230 handles a digital camera whose information is recorded in the registered camera list as a registered digital camera.
[0091] The camera information has, for each camera, an index 501, a name 502, and identification information 503. Note that other information, such as information on functions supported by the camera, may also be included. The index 501 is a numerical value indicating an index (serial number) of the camera information, and is assigned in order starting from 1. Name 502 is a character string indicating the name to be displayed on the menu screen. Note that the name is different from the model name and is a nickname that the user can set for the digital camera. The identification information 503 is unique information that differs for each individual digital camera. In this embodiment, a character string indicating a MAC address assigned to the connection unit 108 (wireless LAN interface) is used as the identification information 503. Note that the identification information 503 may be other information, such as a serial number, as long as it differs for each individual digital camera and is information that can be obtained from the outside.
[0092] In the process of establishing a connection with the digital camera, or by using the established connection, the control unit 201 acquires the MAC address and name of the connection unit 108. The method and timing of acquiring the camera information differ depending on the connection method (communication standard), as described below.
[0093] The control unit 201 compares the identification information (MAC address) acquired from the digital camera 100 with the identification information 503 of the camera information stored in the non-volatile memory 203. If the identification information acquired from the digital camera 100 has not been registered as camera information, the control unit 201 determines that the digital camera 100 has been newly connected. The control unit 201 then adds the name and identification information of the digital camera 100 together with the new index to the camera information stored in the non-volatile memory 203. In this way, when a digital camera for which no identification information is stored is connected, it is added to the camera information as a new digital camera.
[0094] On the other hand, if the identification information acquired from digital camera 100 is registered as camera information, control unit 201 determines that the registered digital camera has been reconnected. In this case, the registered camera information does not need to be updated. However, since the name setting in digital camera 100 may have been changed, the name in the registered camera information of digital camera 100 may be updated.
[0095] <Wireless LAN connection sequence> Next, a procedure for establishing a wireless LAN connection between the digital camera 100 and the smartphone 200 will be described with reference to FIG. The procedure shown in Fig. 7 is executed in a state where the function of connecting to an external device via wireless LAN is enabled in both the digital camera 100 and the smartphone 200 (a state where the connection units 108 and 208 are operable). The connection units 108 and 208 can be switched between enabled and disabled by any known method, such as operating a menu screen of the digital camera 100 or an operating a setting application of the smartphone 200. It is also assumed that a BLE connection has not been established and handover from BLE is not possible. It is also assumed that the digital camera 100 and the smartphone 200 are located within a distance where they can communicate via wireless LAN.
[0096] At T701, the control unit 101 activates the connection unit 108 and operates it as a simple AP. As a result, the connection unit 108 periodically broadcasts a wireless LAN advertisement signal (beacon frame) to notify the presence of the connection unit 108. Here, the wireless LAN advertisement signal includes at least an application ID, a name, and a wireless LAN Mac address as device information of the digital camera 100.
[0097] The application ID is an identifier for uniquely identifying a connection destination device. It is specified only when a reconnection is requested to a specific device. For example, when a connection with the smartphone 200 has been previously established and a reconnection with the smartphone 200 is requested, the application ID previously acquired from the smartphone 200 is specified. The application ID is specified only when a reconnection is made, and is not specified when a new connection is made (it is empty and contains no value).
[0098] At T702, the control unit 201 of the smartphone 200 activates the connection unit 208 and starts a search process for a wireless LAN advertising signal. At T703, the control unit 201 receives the wireless LAN advertisement signal transmitted by the digital camera 100 via the connection unit 208.
[0099] In T704, the control unit 201 analyzes the received wireless LAN advertising signal and acquires device information of the digital camera 100. The control unit 201 checks whether the application ID included in the device information is blank, and if it is blank, it determines that the request is a new connection request and executes T705. On the other hand, if the application ID is not blank, the control unit 201 checks whether the application ID matches the application ID of the smartphone 200. If they match, the control unit 201 determines that the request is a reconnection request from the digital camera 100 to the smartphone 200 and executes T710. If they do not match, the control unit 201 determines that the request is a reconnection request to another device. In this case, if the control unit 201 has not received any other advertising signals, it may terminate the operation of the connection unit 208.
[0100] Here, it is assumed that the application ID in the device information included in the advertising signal is null. At T705, the control unit 201 displays on the display unit 206 a screen inquiring of the user as to whether or not to start a connection via wireless LAN. The control unit 201 can display a screen including options such as "Connect" and "Cancel" together with the name of the digital camera 100 acquired from the device information, for example.
[0101] When control unit 201 detects an operation to instruct a connection, such as the operation of a "connect" button, it executes T706, and when it detects an operation to instruct not to connect, such as the operation of a "cancel" button, it does not execute the subsequent processes. In this case, control unit 201 may execute T702 or may end the operation of connection unit 208.
[0102] In T706, the control unit 201 transmits a connection initiation request from the connection unit 208 to the digital camera 100. The connection initiation request includes at least the application ID and name as the smartphone 200 device information.
[0103] The control unit 101 receives a connection request signal from the smartphone 200 via the connection unit 108. The control unit 101 checks whether or not an application ID included in the device information included in the connection start request signal from the smartphone 200 is stored in the non-volatile memory 103. If the application ID of the received device information is not stored in the non-volatile memory 103, the control unit 101 determines that the connection start request is from a new device and executes T707. On the other hand, if the application ID of the received device information is stored in the non-volatile memory 103, the control unit 101 determines that the connection start request is a request for reconnection and executes T711. This corresponds to the case where the connection start request signal transmitted in T710 has been received.
[0104] At T707, the control unit 101 displays a screen inquiring of the user as to whether or not to start a connection via wireless LAN on the display unit 106. For example, the control unit 101 can display a screen including options such as "Connect" and "Cancel" together with the name of the smartphone 200 acquired from the device information.
[0105] When the control unit 101 detects an operation on the screen, it transmits a response signal according to the detection result from the connection unit 108 to the smartphone 200. When the control unit 101 detects an operation instructing a connection, such as an operation of a "connect" button, it transmits a response signal permitting the connection. When the control unit 101 detects an operation instructing not to connect, such as an operation of a "cancel" button, it transmits a response signal not permitting the connection. Here, it is assumed that a response signal permitting the connection is transmitted.
[0106] When the control unit 201 receives a response signal permitting the connection from the digital camera 100 via the connection unit 208, the control unit 201 executes a process for establishing a connection with the control unit 101. As a result, a wireless LAN connection is established between the digital camera 100 and the smartphone 200.
[0107] When the connection to the wireless LAN is established, at T708, the control unit 101 stores the device information (here, the application ID and device name) of the smartphone 200 in the non-volatile memory 103. In the non-volatile memory 103 of the digital camera 100, device information can be stored in the same manner as the camera information shown in FIG. 5.
[0108] Also, at T709, the control unit 201 stores the device information (here, the name and wireless LAN Mac address) of the digital camera 100 in the non-volatile memory 203 as camera information.
[0109] In the case of reconnection, at T710, the control unit 201 transmits a connection start request from the connection unit 208 to the digital camera 100, where the connection application ID of the smartphone 200 is set in the device information. As described above, the control unit 101 determines that the connection start request is a reconnection request based on the connection application ID.
[0110] When receiving a reconnection request, without asking the user whether to start the connection or not, at T711, the control unit 101 transmits a response signal permitting the connection. Thereafter, the control units 201 and 101 establish the connection in the same manner as in the case of a new connection request. In the case of reconnection, the control units 101 and 201 do not newly store the device information of the connection partner. As described above, if necessary, the registered name may be updated.
[0111] <Bluetooth connection sequence> Subsequently, with reference to FIG. 8, the procedure for establishing a Bluetooth (BLE) connection between the digital camera 100 and the smartphone 200 will be described. 8 is executed in a state where the function of connecting to an external device via BLE is enabled (where the short-range wireless communication units 112 and 212 are operable) in both the digital camera 100 and the smartphone 200. The short-range wireless communication units 112 and 212 can be enabled / disabled by any known method, such as operating a menu screen of the digital camera 100 or an application setting application of the smartphone 200. Furthermore, it is assumed that the digital camera 100 and the smartphone 200 are located within a distance where they can communicate with each other via BLE.
[0112] At T801, the control unit 101 periodically broadcasts a BLE advertisement signal for notifying surrounding devices of the presence of the digital camera 100 from the short-range wireless communication unit 112. The BLE advertisement signal includes at least an application ID and a name as device information of the digital camera 100.
[0113] When a new connection is requested in a BLE advertisement signal, the control unit 101 sets the application ID in the device information to null. When a connection to a specific device is requested, the control unit 101 sets the application ID corresponding to the device in the BLE advertisement signal.
[0114] At T802, the control unit 201 causes the short-range wireless communication unit 212 to start a search process for a BLE advertising signal. At T803, the control unit 201 receives the BLE advertise signal transmitted by the digital camera 100 via the short-range wireless communication unit 212.
[0115] In T804, the control unit 201 analyzes the received BLE advertisement signal and acquires device information of the digital camera 100. The control unit 201 checks whether the application ID included in the device information is blank, and if it is blank, determines that the request is a new connection request and executes T805. On the other hand, if the application ID is not blank, the control unit 201 checks whether the application ID matches the application ID of the smartphone 200. If they match, the control unit 201 determines that the request is a reconnection request from the digital camera 100 to the smartphone 200 and executes T814. If they do not match, the control unit 201 determines that the request is a reconnection request to another device. In this case, the control unit 201 can execute the search operation of T802.
[0116] Here, it is assumed that the application ID in the device information included in the advertising signal is null. At T805, the control unit 201 displays on the display unit 206 a screen inquiring of the user as to whether or not to start a connection via BLE. The control unit 201 can display a screen including options such as "Connect" and "Cancel" together with the name of the digital camera 100 acquired from the device information, for example.
[0117] The control unit 201 executes T806 when it detects an operation instructing a connection, such as the operation of a "connect" button, and does not execute the subsequent processes when it detects an operation instructing not to connect, such as the operation of a "cancel" button. In this case, the control unit 201 can execute the search operation of T802.
[0118] In T806, the control unit 201 transmits a connection initiation request from the short-range wireless communication unit 212 to the digital camera 100. The connection initiation request includes at least an application ID as the smartphone 200 device information.
[0119] The control unit 101 receives a connection request signal from the smartphone 200 through the short-range wireless communication unit 112. The control unit 101 checks whether or not an application ID included in device information included in the connection start request signal from the smartphone 200 is stored in the non-volatile memory 103. If the application ID of the received device information is not stored in the non-volatile memory 103, the control unit 101 determines that the connection start request is from a new device. On the other hand, if the application ID of the received device information is stored in the non-volatile memory 103, the control unit 101 determines that the connection start request is a reconnection request. This corresponds to a case where a connection start request signal transmitted in T819, which will be described later, is received. The control unit 101 transmits a response signal from the short-range wireless communication unit 112 to the smartphone 200, whether it is a new connection request or a reconnection request.
[0120] At T807, the control unit 201 receives a response signal from the digital camera 100 via the short-range wireless communication unit 212. The control unit 201 displays on the display unit 106 a screen inquiring of the user as to whether or not to start pairing with the digital camera 100. The control unit 201 can display a screen including options such as "pair" and "cancel" together with the name of the digital camera 100 acquired from the device information, for example.
[0121] The control unit 201 executes T808 when it detects an operation to instruct pairing, such as the operation of a "pair" button, and does not execute the subsequent processes when it detects an operation to instruct not to pair, such as the operation of a "cancel" button. In this case, the control unit 201 can execute the search process of T802.
[0122] In T808, the control unit 201 (communication service 241) generates an encryption key for encrypted communication. Then, in T809, the control unit 201 transmits to the digital camera 100 an encryption key exchange request to which the generated encryption key is attached.
[0123] At T810, the control unit 101 receives an encryption key exchange request from the smartphone 200. Then, the control unit 101 stores the encryption key attached to the encryption key exchange request in the non-volatile memory 103 in association with the identification information of the smartphone 200. At T811, the control unit 101 generates an encryption key for encrypted communication. Then, in T812, the control unit 101 transmits to the smartphone 200 an encryption key exchange response to which the generated encryption key is attached.
[0124] At T813, the control unit 201 receives the encryption key exchange response from the digital camera 100. Then, the control unit 201 registers the encryption key attached to the encryption key exchange response in the communication service 241 of the OS 240. At this time, identification information assigned to the digital camera 100 by the OS may be associated with the encryption key. Note that, in practice, the encryption key may be stored in the non-volatile memory 203. This establishes encrypted communication (BLE connection) between the digital camera 100 and the smartphone 200.
[0125] When the BLE connection is established, in T814, the control unit 201 transmits a registration request including device information of the smartphone 200 to the digital camera 100. The device information includes at least the application ID and name of the smartphone 200.
[0126] When the control unit 101 receives the registration request from the smartphone 200 via the short-range wireless communication unit 112, at T815, the control unit 101 displays on the display unit 106 a screen inquiring of the user as to whether or not to register the smartphone 200. For example, the control unit 101 can display a screen including options such as "Register" and "Cancel" together with the name of the smartphone 200 acquired from the device information.
[0127] When the control unit 101 detects an operation on the screen, it transmits a response signal according to the detection result from the short-range wireless communication unit 112 to the smartphone 200. When the control unit 101 detects an operation instructing registration, such as an operation of a "Register" button, it transmits a response signal permitting registration. When the control unit 101 detects an operation instructing not to register, such as an operation of a "Cancel" button, it transmits a response signal not permitting registration. Here, it is assumed that a response signal permitting registration has been transmitted.
[0128] In T816, the control unit 101 stores in the non-volatile memory 103 the device information of the smartphone 200 included in the registration request received in T814.
[0129] At T817, the control unit 201 transmits a wireless LAN Mac address acquisition request signal to the digital camera 100 via the short-range wireless communication unit 212 in order to acquire the identification information of the digital camera 100.
[0130] The control unit 101 receives a wireless LAN Mac address acquisition request signal from the smartphone 200 through the short-range wireless communication unit 112. The control unit 101 generates a response signal including the wireless LAN Mac address of the connection unit 108, and transmits the response signal from the short-range wireless communication unit 112 to the smartphone 200.
[0131] In T818, the control unit 201 acquires the Wireless LAN Mac address of the digital camera 100 from the response signal received via the short-range wireless communication unit 212. Then, the control unit 201 stores the Wireless LAN Mac address and the name of the digital camera 100 acquired from the BLE advertising signal in T803 as new camera information in the non-volatile memory 203. In addition, the communication service 241 may associate the Wireless LAN Mac address with the encryption key saved in T813. This completes the process of establishing a new connection between the digital camera 100 and the smartphone 200.
[0132] In the case of reconnection, at T819, the control unit 201 transmits a connection start request, in which the connection application ID of the smartphone 200 is set in the device information, to the digital camera 100 from the short-range wireless communication unit 212. As described above, the control unit 101 determines that the connection start request is a reconnection request based on the connection application ID.
[0133] When a reconnection request is received, the control unit 101 reads the encryption key of the smartphone 200 from the non-volatile memory 103 at T820. Similarly, the control unit 201 reads the encryption key of the digital camera 100 from the communication service 241 (non-volatile memory 203) at T821. Then, the control units 101 and 201 execute processing for establishing encrypted communication. As a result, encrypted communication (BLE connection) between the digital camera 100 and the smartphone 200 is established.
[0134] Through the above steps, a connection conforming to wireless LAN and BLE can be established between the digital camera 100 and the smartphone 200. In addition, by saving information required to establish a connection with a partner device and using it when reconnecting, the time required to reestablish a connection can be reduced.
[0135] On the other hand, if the information of the smartphone 200 remains in the digital camera whose camera information has been deleted from the registered camera list of the camera communication application 230, a problem will occur the next time a connection is made. If the information of the smartphone 200 remains in the digital camera 100, the smartphone 200 will be indicated as a connection destination to the digital camera 100. Then, when an instruction to connect to the smartphone 200 is given, the digital camera 100 transmits an advertising signal (reconnection request) including the application ID of the smartphone 200.
[0136] However, when the camera communication application 230 receives an advertising signal including the application ID of the smartphone 200, it does not execute a reconnection process until it is confirmed that the external device that sent the signal is in the registered camera list. This is because the camera communication application is configured to execute a process (for example, display of a unique menu screen) using registered camera information for a registered digital camera. As a result, the digital camera 100 repeatedly transmits a reconnection request. If an error state such as a time error occurs thereafter, an error message is displayed on the display unit 106 of the digital camera 100, and the user finally becomes aware of the abnormality.
[0137] In order to improve user convenience, when a reconnection request is received from an external device whose information does not exist (has been deleted) in the registered external device list (registered camera list), it is necessary to promptly notify the user to delete the information about smartphone 200 from the external device.
[0138] In order to determine whether the information of the external device that has sent the reconnection request is present in the list of registered external devices, the external device's unique information (identification information) is required. Meanwhile, the timing at which the identification information of the external device can be obtained differs depending on the communication standard.
[0139] For example, in the case of the wireless LAN standard, the MAC address included in the advertisement signal can be used as the identification information of the external device. On the other hand, in the case of the BLE standard, the advertisement signal does not include the identification information of the external device. Note that the name of the device included in the advertisement signal can be arbitrarily set by the user, so it cannot be used as the identification information of the external device. Therefore, when a BLE reconnection is requested, it is necessary to communicate with the external device to obtain the identification information.
[0140] Therefore, the smartphone 200 of this embodiment changes the procedure (T710 and onwards in FIG. 7, and T819 and onwards in FIG. 8) when a reconnection request is received from an external device as described below.
[0141] Specifically, when a reconnection request is received from an external device, the smartphone 200 acquires identification information of the external device by a method according to the communication standard, and determines whether or not the connection information of the external device is saved. If it is determined that the connection information is not saved, the smartphone 200 promptly ends the reconnection procedure and prompts the external device to delete the connection information of the smartphone 200 saved therein.
[0142] <Wireless LAN reconnection sequence> The procedure for re-establishing a wireless LAN connection between the digital camera 100 and the smartphone 200 in this embodiment will be described with reference to FIG.
[0143] In the sequence chart of Fig. 9, T901 to T904 are the same as T701 to T704 described with reference to Fig. 7, and therefore description thereof will be omitted. At T904, the application ID of the smartphone 200 is included in the advertisement signal of the wireless LAN, and the process after the control unit 201 determines that the signal is a request for reconnection differs from that in Fig. 7. The following operation of the control unit 201 is also realized by the control unit 201 executing the camera communication application 230.
[0144] In T905, the control unit 201 acquires the Mac address of the wireless LAN included in the wireless LAN advertisement signal received in T903. Then, the control unit 201 refers to the registered camera list stored in the non-volatile memory 203 and checks whether there is camera information having identification information that matches the acquired Mac address.
[0145] If the registered camera list contains camera information having identification information that matches the acquired Mac address, the control unit 201 determines that reconnection is possible. Then, the control unit 201 executes T906.
[0146] In T906, similarly to T710, the control unit 201 transmits a connection start request from the connection unit 208 to the digital camera 100. After that, the procedure described with reference to FIG.
[0147] On the other hand, if the camera information having identification information matching the acquired Mac address is not in the registered camera list, the control unit 201 determines that reconnection is not possible. This corresponds to the case where the stored camera information has been deleted from the registered camera list. Then, the control unit 201 executes T907.
[0148] At T907, the control unit 201 displays on the display unit 206 a warning screen that prompts the user to delete the registration information of the smartphone 200 from the external device that is attempting to connect to the smartphone 200.
[0149] 10(a) shows an example of a warning screen displayed on the display unit 206 at T907. The warning screen includes a message prompting the user to delete the information of the smartphone 200 registered in the digital camera 100. Note that the name of the digital camera 100 included in the advertising signal may be included in the warning screen so that the user can easily identify the device.
[0150] <Operation of the Smartphone 200 Corresponding to the Wireless LAN Reconnection Sequence> Fig. 11 is a flowchart relating to the operation of the smartphone 200 in the sequence chart shown in Fig. 9. The operation described below is realized by the control unit 201 executing the camera communication application 230.
[0151] In S1101, the control unit 201 instructs the connection unit 208 to start searching for a wireless LAN advertisement signal being transmitted to the currently connected network (T902 in FIG. 9).
[0152] Next, in S1102, the control unit 201 determines whether or not a wireless LAN advertising signal has been received by the connection unit 208. If it is determined that a wireless LAN advertising signal has been received (T903), the control unit 201 executes S1103, and if not, the control unit 201 repeatedly executes S1102.
[0153] In S1103, the control unit 201 analyzes the received wireless LAN advertisement signal and acquires device information (application ID, name, and wireless LAN Mac address) of the transmission source device (T904). Since reconnection is assumed here, the device information includes the application ID of the smartphone 200.
[0154] In S1104, the control unit 201 uses the MAC address of the wireless LAN included in the device information to refer to the registered camera list stored in the non-volatile memory 203 (T905).
[0155] In S1105, the control unit 201 determines whether or not the registered camera list contains camera information that includes the Mac address of the wireless LAN included in the device information as identification information, and if it is determined that there is camera information, it executes S1106, and if not, it executes S1107.
[0156] In S1106, the control unit 201 transmits a connection start request from the connection unit 208 to the external device (digital camera 100) that transmitted the Wireless LAN advertising signal (T906). Thereafter, as described in Fig. 7, the control unit 201 executes the procedure for reconnecting with the digital camera 100 and establishes a connection with the digital camera 100. In this way, when the control unit 201 receives an advertising signal including its own application ID, it executes the reconnection procedure if information about the external device that transmitted the advertising signal is registered.
[0157] On the other hand, in S1107, the control unit 201 displays a warning screen as shown in Fig. 10(a) on the display unit 206 (T907). In this way, when the control unit 201 receives an advertisement signal including its own application ID, if the information of the external device that is the source of the advertisement signal is not registered, it does not execute the reconnection procedure. Then, the control unit 201 displays a warning screen prompting to delete the information of the smartphone 200 registered in the external device to which the smartphone 200 is about to connect.
[0158] As a result, the user can establish the connection between the smartphone 200 and the digital camera 100 by deleting the information of the smartphone 200 registered in the digital camera 100 and starting the connection operation to the smartphone 200 again.
[0159] <BLE Reconnection Sequence> The procedure for the digital camera 100 and the smartphone 200 to establish BLE reconnection in this embodiment will be described with reference to Fig. 12.
[0160] In the sequence chart of Fig. 12, since T1201 to T1207 are the same as T801 to T804 and T819 to T821 described with respect to Fig. 8, the description is omitted.
[0161] After the connection is established with the digital camera 100, at T1208, the control unit 201 transmits a request for acquiring identification information (Mac address of the wireless LAN) to the digital camera 100 from the short-range wireless communication unit 212. In response, the control unit 101 transmits the Mac address of the connection unit 108 to the smartphone 200 through the short-range wireless communication unit 112.
[0162] At T1209, the control unit 201 refers to the registered camera list using the Mac address acquired from the digital camera 100. If camera information including the acquired Mac address of the wireless LAN as identification information exists in the registered camera list, since the reconnection has already been established, the process ends without doing anything.
[0163] On the other hand, when the camera information including the acquired Mac address of the wireless LAN does not exist in the registered camera list, at T1210, the control unit 201 transmits a disconnection start request from the short-range wireless communication unit 212 to the digital camera 100.
[0164] When the control unit 101 receives a disconnection start request from the smartphone 200 through the short-range wireless communication unit 112, it transmits a disconnection start request response to the smartphone 200. As a result, the connection between the digital camera 100 and the smartphone 200 is disconnected.
[0165] At T1211, the control unit 201 displays a warning screen on the display unit 206 to prompt the deletion of the registration information of the smartphone 200 from the external device attempting to connect to the smartphone 200.
[0166] FIG. 10(b) shows an example of the warning screen displayed on the display unit 206 at T1211. The warning screen includes a message prompting the user to un-pair the smartphone 200 from the digital camera 100 (delete the information of the smartphone 200). Note that the name of the digital camera 100 included in the advertisement signal may be included in the warning screen so that the user can easily identify the device.
[0167] As a result, the user can delete the information of the smartphone 200 registered in the digital camera 100 and start the connection operation to the smartphone 200 again, thereby establishing the connection between the smartphone 200 and the digital camera 100.
[0168] <Operation of the smartphone 200 corresponding to the BLE reconnection sequence> FIG. 13 is a flowchart regarding the operation of the smartphone 200 in the sequence chart shown in FIG. 12. The operations described below are realized by the control unit 201 executing the camera communication application 230.
[0169] In S1301, the control unit 201 instructs the short-range wireless communication unit 212 to start searching for a BLE advertising signal (T1202 in FIG. 11).
[0170] Next, in S1302, the control unit 201 determines whether or not a BLE advertising signal has been received by the short-range wireless communication unit 212, and if it is determined that a BLE advertising signal has been received (T1203), executes S1303, and if not, repeatedly executes S1302.
[0171] In S1303, the control unit 201 analyzes the received BLE advertisement signal and acquires device information (application ID and name) of the transmission source device (T1204). Since reconnection is assumed here, the device information includes the application ID of the smartphone 200.
[0172] In S1304, the control unit 201 transmits a connection start request to the digital camera 100 via the short-range wireless communication unit 212 (T1205).
[0173] In S1305, the control unit 201 reads out the encryption key of the digital camera 100 managed by the communication service 241 in order to start encrypted communication with the digital camera 100 (T1206). Meanwhile, in the digital camera 100, the control unit 101 reads out the encryption key of the smartphone 200 in response to receiving the connection start request (T1207). As a result, a BLE connection is established between the digital camera 100 and the smartphone 200.
[0174] In S1306, the control unit 201 transmits a request to acquire identification information (here, the Mac address of the wireless LAN) to the digital camera 100 via the short-range wireless communication unit 212 (T1208), and acquires the Mac address.
[0175] In S1307, the control unit 201 uses the Mac address acquired from the digital camera 100 to refer to the registered camera list stored in the non-volatile memory 203 (T1209).
[0176] In S1308, the control unit 201 determines whether camera information including the acquired wireless LAN Mac address as identification information exists in the registered camera list, and if it is determined that camera information exists, ends the processing in Fig. 13. In other words, if the digital camera 100 that sent the reconnection request has not been deleted from the registered camera list, the control unit 201 maintains the connection established in S1305.
[0177] On the other hand, if it is not determined that the camera information including the acquired Mac address of the wireless LAN as identification information exists in the registered camera list, the control unit 201 executes step S1309.
[0178] In S1309, the control unit 201 transmits a disconnection start request to the digital camera 100 from the short-range wireless communication unit 212 (T1210). When the control unit 101 receives the disconnection start request from the smartphone 200 via the short-range wireless communication unit 112, it transmits a disconnection start request response to the smartphone 200. This causes the connection between the digital camera 100 and the smartphone 200 to be disconnected.
[0179] In S1310, the control unit 201 displays on the display unit 206 a warning screen (FIG. 10(b)) that prompts the digital camera 100 attempting to connect to the smartphone 200 to cancel the pairing with the smartphone 200 (T1211). In other words, if the digital camera 100 that has sent the reconnection request has been deleted from the registered camera list, the control unit 201 disconnects the connection established in S1305. Then, the control unit 201 prompts the digital camera 100 to cancel the pairing with the smartphone 200.
[0180] In this way, when a communication device according to the present embodiment receives a reconnection request from an external device, it can appropriately determine whether information about the external device is stored, depending on which communication standard the reconnection request relates to. If the information is not stored, the communication device can prompt the user to delete their own information from the external device, thereby helping the user to take appropriate action without making the user wait longer than necessary.
[0181] ●(Second embodiment) Next, a second embodiment of the present invention will be described. In the first embodiment, if information about an external device that has sent a reconnection request has been deleted from the communication device, a warning screen is displayed every time a reconnection request is received from the external device. In other words, the warning screen is repeatedly displayed until information about the communication device is deleted from the external device. Also, every time a BLE reconnection request is received, it is necessary to establish communication with the external device that has sent the request and obtain identification information.
[0182] This embodiment reduces the number of times a warning screen is displayed and the number of times a connection is established with an external device requesting a BLE reconnection when a reconnection request is received multiple times from the same external device.
[0183] <Warned Camera List> Fig. 14 is a diagram showing an example of a warned camera list in which smartphone 200 registers information of cameras deleted from the registered camera list. The warned camera list is stored in non-volatile memory 203 or working memory 204. Note that, for ease of explanation and understanding, Fig. 14 shows the warned camera list in a table format, but the registered camera list may have any format. The camera communication application 230 handles a digital camera whose information is recorded in the warned camera list as a digital camera whose registration has been deleted.
[0184] The warned camera list is made up of an index 1401 and identification information 1402 for each camera. The index 1401 is a numerical value indicating an index (serial number) and is assigned in order starting from 1. The identification information 1402 is unique information that differs for each individual digital camera. In this embodiment, as in the first embodiment, a character string indicating a MAC address assigned to the connection unit 108 (wireless LAN interface) can be used. Furthermore, in this embodiment, for a digital camera whose registration has been deleted regarding a BLE connection, it is possible to use identification information assigned by the OS.
[0185] However, if the OS 240 of the smartphone 200 can acquire the MAC address of the short-range wireless communication unit 212 of the BLE device, the MAC address of the short-range wireless communication unit 212 may be used as the identification information 1402. Note that the identification information 1402 may be other information, such as a serial number, as long as it differs for each individual digital camera and can be acquired from the outside.
[0186] The OS 240 (communication service 241) assigns identification information to the newly paired BLE device and registers it in, for example, the non-volatile memory 203. Thereafter, the same identification information is used for the same BLE device. On the other hand, since the identification information assigned by the OS 240 may be initialized by an update of the OS 240, etc., there is no guarantee that the identification information can be used permanently for the same BLE device. Therefore, when the identification information assigned by the OS is used as the identification information for the BLE device, the warned camera list is reset (deleted) when the camera communication application is terminated.
[0187] <Operation of the Smartphone 200 in Wireless LAN Reconnection Processing> 15 is a flowchart related to the operation of the smartphone 200 in the wireless LAN reconnection process in this embodiment. The operation described below is realized by the control unit 201 executing the camera communication application 230. The states of the smartphone 200 and the digital camera 100 before the process starts are the same as those in the first embodiment.
[0188] Since S1501 to S1503 are the same as S1101 to S1103 in FIG. 11, the description thereof will be omitted. Here, since reconnection is assumed, it is assumed that the device information of the wireless LAN advertisement signal includes the application ID of the smartphone 200.
[0189] In S1504, the control unit 201 refers to the warning camera list stored in the non-volatile memory 203 or the working memory 204 by using the Mac address of the wireless LAN included in the device information acquired in S1503.
[0190] In S1505, the control unit 201 determines whether or not the Mac address of the wireless LAN included in the device information is included in the warning camera list as identification information. If it is determined that it is included, the reconnection process is terminated. If it is not determined, S1506 is executed.
[0191] As described above, in the present embodiment, if the detected wireless LAN device is a device registered in the warning camera list (a device deleted from the registered camera list), the reconnection process is terminated without issuing a warning.
[0192] Since S1506 to S1509 are the same as S1104 to S1107 in FIG. 11, the description thereof will be omitted. In S1510, the control unit 201 adds the identification information of the digital camera 100 (the Mac address of the wireless LAN acquired in S1503) to the warning camera list and terminates the reconnection process. If the warning camera list has not been generated, the control unit 201 newly generates it.
[0193] According to the present embodiment, when a reconnection request for the wireless LAN is received from an external device deleted from the registration list, a warning screen is displayed only for the first reconnection request, and the warning screen is not displayed for the second and subsequent reconnection requests. Therefore, even if a reconnection request is repeatedly received from the external device, it is possible to avoid repeatedly displaying the warning screen.
[0194] <Operation of the smartphone 200 in the BLE reconnection process> 16 is a flowchart related to the operation of the smartphone 200 in the BLE reconnection process in this embodiment. The operation described below is realized by the control unit 201 executing the camera communication application 230. The states of the smartphone 200 and the digital camera 100 before the process starts are the same as those in the first embodiment.
[0195] 13, the description of S1601 to S1603 will be omitted. Since reconnection is assumed here, the device information in the BLE advertisement signal is assumed to include the application ID of the smartphone 200.
[0196] In S1604, the control unit 201 acquires, from the communication service 241 of the OS 240, identification information assigned by the communication service 241 to the external device (digital camera 100) that is the source of the BLE advertising signal.
[0197] In S1605, the control unit 201 refers to the warned camera list stored in the non-volatile memory 203 or the work memory 204, using the identification information acquired in S1604.
[0198] In S1606, the control unit 201 determines whether the warned camera list includes the identification information assigned to the digital camera 100 by the OS 240 (communication service 241), and if so, terminates the reconnection process; if not, executes S1607.
[0199] Thus, in this embodiment, if the detected BLE device is a device registered in the warned camera list (a device that has been deleted from the registered camera list), the reconnection process is terminated without issuing a warning.
[0200] S1607 to S1613 are similar to S1304 to S1310 in FIG. 13, and therefore the description will be omitted.
[0201] In S1614, the control unit 201 adds the identification information of the digital camera 100 (the identification information acquired in S1504 and assigned by the OS 240 (communication service 241)) to the warned camera list, and ends the reconnection process. If the warned camera list has not been generated, the control unit 201 generates a new one.
[0202] According to this embodiment, when a BLE reconnection request is received from an external device deleted from the registration list, a warning screen is displayed only for the first reconnection request, and the warning screen is not displayed for the second or subsequent reconnection requests. Therefore, even if reconnection requests are repeatedly received from the external device, the warning screen can be avoided from being repeatedly displayed.
[0203] In this example, the warning screen is not displayed for the second and subsequent reconnection requests, but the frequency of displaying the warning screen may be reduced, for example, by displaying the warning screen once every n times (n>2) from the second request onward. In this case, the control unit 201 stores the number of times the warning screen was not displayed, and when the number of times reaches n, the control unit 201 performs control so that the warning screen is displayed the next time a reconnection request is received.
[0204] (Other embodiments) In the above embodiment, the communication standard capable of transmitting an advertising signal including identification information of a transmission source device has been described as the WLAN standard, and the communication standard incapable of transmitting an advertising signal including identification information of a transmission source device has been described as the BLE standard. However, the present invention can be similarly applied to other communication standards having similar characteristics.
[0205] In the above embodiment, when the smartphone 200 receives a reconnection request from an external device that has been deleted from the registered external device list, a warning screen is displayed on the display unit 206 of the smartphone 200. However, the smartphone 200 may establish a connection with the external device that has sent the reconnection request, and cause the external device to display a warning screen or transmit an instruction to delete information about the smartphone 200.
[0206] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0207] The disclosure of the present embodiment includes the following communication device, a control method for the communication device, and a program. (Item 1) A communication device, comprising: a first communication means capable of establishing a connection with an external device according to a first communication standard; a second communication means capable of establishing a connection with an external device according to a second communication standard; A storage means for storing information on an external device registered in an application that utilizes communication with the external device; a control means for outputting a warning when a reconnection request is received from an external device via the first communication means or the second communication means and the registration of the external device in the application is deleted; The control means determines whether the registration of the external device in the application has been deleted based on identification information of the external device obtained by different procedures depending on whether the reconnection request was received through the first communication means or the second communication means. (Item 2) The communication device described in item 1, characterized in that when the control means receives the reconnection request through the first communication means, it acquires the identification information without establishing a connection with the external device, and when the control means receives the reconnection request through the second communication means, it establishes a connection with the external device and acquires the identification information. (Item 3) 3. The communication device according to item 2, wherein the control means, when receiving the reconnection request through the first communication means, acquires the identification information from an advertising signal of the external device. (Item 4) 4. The communication device according to any one of claims 1 to 3, wherein the control means does not accept the reconnection request when the registration of the external device in the application has been deleted. (Item 5) The communication device according to any one of claims 1 to 4, characterized in that the control means reduces the frequency of outputting the warning when a reconnection request is received multiple times from an external device whose registration with the application has been deleted. (Item 6) The communication device according to any one of claims 1 to 4, characterized in that the control means stores information about the external device that output the warning, and reduces the frequency of outputting the warning if the information about the external device that sent the reconnection request is stored. (Item 7) The communication device described in item 6, characterized in that if the control means stores identification information assigned to the external device by the operating system (OS) on which the application runs as information about the external device, the control means deletes the stored information about the external device when the application is terminated. (Item 8) 8. The communication device according to any one of items 5 to 7, wherein the output of the warning is the output of a warning screen on a display device of the communication device. (Item 9) The communication device according to any one of items 5 to 7, characterized in that the output of the warning is the output of a warning screen to the external device or the transmission of an instruction to delete information about the communication device from the external device. (Item 10) A communication device described in any one of items 1 to 9, characterized in that even if the registration of the external device to the application is deleted, the registration of the external device to the operating system (OS) on which the application runs is not deleted. (Item 11) 11. The communication device according to any one of items 1 to 10, wherein the first communication standard is a wireless LAN standard, and the second communication standard is a Bluetooth (registered trademark) Low Energy (BLE) standard. (Item 12) a first communication means capable of establishing a connection with an external device according to a first communication standard; a second communication means capable of establishing a connection with an external device according to a second communication standard; A control method executed by a communication device having a storage means for storing information of an external device registered in an application that utilizes communication with the external device, the control method comprising: When a reconnection request is received from an external device via the first communication means or the second communication means, acquiring identification information of the external device in a different procedure depending on whether the reconnection request is received through the first communication means or the second communication means; determining whether or not a registration of the external device with the application has been deleted based on the identification information; and outputting a warning when it is determined that the registration of the external device in the application has been deleted. (Item 13) a first communication means capable of establishing a connection with an external device according to a first communication standard; a second communication means capable of establishing a connection with an external device according to a second communication standard; A program for causing a computer of a communication device having a storage means for storing information of an external device registered in an application that utilizes communication with the external device to function as a control means possessed by the communication device described in any one of items 1 to 11.
[0208] The present invention is not limited to the above-described embodiments, and various modifications and variations are possible without departing from the spirit and scope of the invention. Therefore, the following claims are appended to disclose the scope of the invention. [Explanation of symbols]
[0209] 100... digital camera, 200... smartphone, 101, 201... control unit, 108, 208... connection unit, 112, 212... short-range wireless communication unit
Claims
1. 1. A communication device, comprising: a first communication means capable of establishing a connection with an external device according to a first communication standard; a second communication means capable of establishing a connection with an external device according to a second communication standard; A storage means for storing information on an external device registered in an application that utilizes communication with the external device; a control means for outputting a warning when a reconnection request is received from an external device via the first communication means or the second communication means and the registration of the external device in the application is deleted; A communication device characterized in that the control means determines whether the registration of the external device in the application has been deleted based on identification information of the external device obtained by different procedures depending on whether the reconnection request was received through the first communication means or the second communication means.
2. The communication device according to claim 1, characterized in that when the control means receives the reconnection request through the first communication means, it acquires the identification information without establishing a connection with the external device, and when the control means receives the reconnection request through the second communication means, it establishes a connection with the external device and acquires the identification information.
3. 3. The communication device according to claim 2, wherein the control means, when receiving the reconnection request through the first communication means, acquires the identification information from an advertising signal of the external device.
4. 2. The communication device according to claim 1, wherein the control means does not accept the reconnection request when the registration of the external device in the application has been deleted.
5. 2. The communication device according to claim 1, wherein the control means reduces the frequency of outputting the warning when a reconnection request is received multiple times from the external device whose registration with the application has been deleted.
6. The communication device according to claim 1, characterized in that the control means stores information about the external device that output the warning, and reduces the frequency of outputting the warning if information about the external device that sent the reconnection request is stored.
7. The communication device according to claim 6, characterized in that, when the control means stores, as information about the external device, identification information assigned to the external device by the operating system (OS) on which the application runs, the stored information about the external device is deleted when the application is terminated.
8. 6. The communication device according to claim 5, wherein the output of the warning is a warning screen output on a display device of the communication device.
9. 6. The communication device according to claim 5, wherein the output of the warning is output of a warning screen to the external device, or transmission of an instruction to delete information about the communication device from the external device.
10. 2. The communication device according to claim 1, wherein even if the registration of the external device with the application is deleted, the registration of the external device with respect to the operating system (OS) on which the application runs is not deleted.
11. 2. The communication device according to claim 1, wherein the first communication standard is a wireless LAN standard, and the second communication standard is a Bluetooth (registered trademark) Low Energy (BLE) standard.
12. a first communication means capable of establishing a connection with an external device according to a first communication standard; a second communication means capable of establishing a connection with an external device according to a second communication standard; A control method executed by a communication device having a storage means for storing information of an external device registered in an application that utilizes communication with the external device, the control method comprising: When a reconnection request is received from an external device via the first communication means or the second communication means, acquiring identification information of the external device in a different procedure depending on whether the reconnection request is received through the first communication means or the second communication means; determining whether or not a registration of the external device with the application has been deleted based on the identification information; and outputting a warning when it is determined that the registration of the external device in the application has been deleted.
13. a first communication means capable of establishing a connection with an external device according to a first communication standard; a second communication means capable of establishing a connection with an external device according to a second communication standard; A program for causing a computer of a communication device having a storage means for storing information of an external device registered in an application that utilizes communication with an external device to function as a control means possessed by the communication device described in any one of claims 1 to 11.