Communication device and its control method
By introducing multi-standard connectivity and identification information processing procedures into communication equipment, the problem of difficulty in judging device reconnection request information is solved, thereby improving the efficiency and reliability of device reconnection operations.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- CANON KK
- Filing Date
- 2022-09-29
- Publication Date
- 2026-07-03
AI Technical Summary
When existing communication equipment supports multiple communication standards, it cannot effectively determine the information storage status when an external device requests reconnection, which requires the external device to re-initiate the connection request, affecting operational efficiency.
A communication device was designed with the ability to connect to multiple communication standards. It obtains the identification information of external devices through different processing procedures, determines the standard corresponding to the reconnection request, and issues a warning or executes a new connection request when necessary.
It enables accurate determination of the information storage status of external devices under multiple communication standards, improving the efficiency and reliability of device reconnection operations.
Smart Images

Figure 0007884416000001 
Figure 0007884416000002 
Figure 0007884416000003
Abstract
Description
Technical Field
[0001] The present invention relates to a communication device and a control method thereof, and particularly to a communication device compatible with a plurality of communication standards and a control method thereof.
Background Art
[0002] By registering information of an external device for which a connection has been established and using it when a reconnection request is received, it is possible to execute an operation according to the reconnected external device. However, if the information of the external device that requests reconnection is deleted, it becomes impossible to execute an operation according to the external device. In this case, in order to register the information of the external device again, it is necessary to cause the external device to transmit a new connection request instead of a reconnection request.
[0003] Therefore, when a reconnection request is received from an external device, it should be warned to determine whether information of the external device exists (whether it remains registered or has been deleted), and if it does not exist, a new connection request should be transmitted. In order to determine whether information of the external device that is the transmission source of the reconnection request exists, unique information (identification information) of the external device is required.
Prior Art Documents
Patent Documents
[0004]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0005] On the other hand, the timing at which identification information of external devices can be obtained differs depending on the communication standard. Therefore, a communication device that can establish connections with external devices in accordance with multiple communication standards, such as the one described in Patent Document 1, needs to perform an appropriate determination operation depending on which communication standard the reconnection request is related to. However, until now, no communication device capable of performing such a determination operation has been known.
[0006] In one aspect, the present invention provides a communication device that supports multiple communication standards and can determine whether or not information about an external device is stored when a reconnection request is received from that external device, in a manner that corresponds to which communication standard the reconnection request relates to. [Means for solving the problem]
[0007] The above objective is achieved by a communication device comprising: a first communication means capable of establishing a connection with an external device in accordance with a first communication standard; a second communication means capable of establishing a connection with an external device in accordance with a second communication standard; a storage means for storing information of an external device registered in an application that uses communication with the external device; and a control means that, upon receiving a reconnection request from an external device through the first or second communication means, outputs a warning if the registration of the external device in the application has been deleted, wherein the control means determines whether or not the registration of the external device in the application has been deleted based on identification information of the external device obtained by different procedures depending on whether the reconnection request was received through the first or second communication means. [Effects of the Invention]
[0008] According to the present invention, it is possible to provide a communication device that supports multiple communication standards and can determine whether or not information about an external device is stored when a reconnection request is received from that external device, in a manner that corresponds to which communication standard the reconnection request relates to. [Brief explanation of the drawing]
[0009] [Figure 1] Block diagram showing an example of the functional configuration of a digital camera as an external device according to the embodiment. [Figure 2] Block diagram showing an example of the functional configuration of a smartphone as a communication device according to this embodiment. [Figure 3] A schematic diagram showing an example configuration of a communication system according to the embodiment. [Figure 4] A diagram showing an example of the software configuration of a smartphone according to this embodiment. [Figure 5] A diagram showing an example screen of the camera communication application according to the embodiment. [Figure 6] A diagram showing an example of a registered camera list used in the embodiment. [Figure 7] Sequence diagram of wireless LAN connection operation between a digital camera and a smartphone in an embodiment [Figure 8] Sequence diagram of BLE connection operation between a digital camera and a smartphone in an embodiment [Figure 9] Sequence diagram of the wireless LAN reconnection operation between a digital camera and a smartphone in the embodiment. [Figure 10] This figure shows an example of a warning screen presented by a camera communication application in the embodiment. [Figure 11] Flowchart of smartphone operation corresponding to Figure 9 [Figure 12] Sequence diagram of BLE reconnection operation between a digital camera and a smartphone in an embodiment [Figure 13] Flowchart of smartphone operation corresponding to Figure 12 [Figure 14] A diagram showing an example of a list of alerted cameras used in the second embodiment. [Figure 15] Flowchart relating to the operation of the digital camera when a wireless LAN reconnection request is received in the second embodiment. [Figure 16] Flowchart of the operation of the digital camera when a BLE reconnection request is received in the second embodiment.
Best Mode for Carrying Out the Invention
[0010] Hereinafter, the present invention will be described in detail based on its exemplary embodiments with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Also, although a plurality of features are described in the embodiments, not all of them are essential to the invention, and the plurality of features may be arbitrarily combined. Furthermore, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.
[0011] In the following embodiments, the present invention will be described with respect to the case where it is implemented on a smartphone. However, the present invention can be implemented on any electronic device compatible with a plurality of communication standards. Such electronic devices include computer devices (personal computers, tablet computers, media players, PDAs, etc.), game machines, imaging devices, and the like. These are examples, and the present invention can also be implemented on other electronic devices.
[0012] ●(First Embodiment) <Configuration Example of Digital Camera> FIG. 1 is a block diagram showing a functional configuration example of a digital camera 100 as an example of an external device. Note that the external device may be any electronic device capable of communicating in accordance with one or more communication standards with a smartphone. Such electronic devices include computer devices (personal computers, tablet computers, media players, PDAs, etc.), game machines, and the like.
[0013] The control unit 101 has one or more processors (hereinafter referred to as CPUs) capable of executing programs, and reads and executes, for example, a program stored in the nonvolatile memory 103 into the working memory 104. The control unit 101 controls the operations of each functional block by executing the program, and realizes the functions of the digital camera 100.
[0014] The rewritable non-volatile memory 103 stores programs that the CPU of the control unit 101 can execute, settings of the digital camera 100, GUI data, and the like. The non-volatile memory 103 also stores information about external devices with which communication has taken place.
[0015] The operation of the digital camera 100, as described later, is achieved by executing a program stored in the non-volatile memory 103.
[0016] The working memory 104 is, for example, volatile memory and is used to load programs executed by the CPU of the control unit 101 and to save values necessary during program execution. In addition, a portion of the working memory 104 may be used as display memory for the display unit 106.
[0017] The imaging unit 102 is a camera unit having an imaging optical system, an image sensor, etc. The imaging unit 102 takes images according to the control of the control unit 101 and stores the obtained image data in the working memory 104. The control unit 101 applies predetermined image processing to the image data to generate an image data file. The control unit 101 records the image data file on, for example, a recording medium 107. The control unit 101 also applies predetermined image processing to the image data to generate image data for display. The control unit 101 stores the image data for display in the video memory area of the working memory 104, synthesizes an image showing information such as the current setting value, and displays it on the display unit 106.
[0018] By recording video with the imaging unit 102 and immediately displaying the recorded video on the display unit 106, the display unit 106 can be made to function as an electronic viewfinder (EVF). The video displayed on the display unit 106 to enable it to function as an EVF is called a live view image.
[0019] The operation unit 105 is a general term for the input devices provided on the digital camera 100. The operation unit 105 may include, but is not limited to, the touch panel, power switch, shutter button, video recording button, directional keys, setting button, menu button, etc., provided on the display unit 106. When the control unit 101 detects an operation on the operation unit 105, it executes an action corresponding to the detected operation.
[0020] The display unit 106 is used to display images captured by the imaging unit 102, images recorded on the recording medium 107, menu screens, and the like. An external display device may also be connected to the digital camera 100.
[0021] The recording medium 107 is provided separately from the non-volatile memory 103 and may be, for example, a semiconductor memory card. The recording medium 107 is used, for example, as a recording destination for image data files generated by the control unit 101.
[0022] The connection unit 108 is a communication interface. The connection unit 108 performs communication with an external device in accordance with one or more known wired and wireless communication standards, including wireless communication standards. The connection unit 108 has circuits (antenna, connector, transceiver, etc.) corresponding to the communication standard it conforms to.
[0023] Near field communication department 112 This is also a communication interface. (Short-range wireless communication section) 112 It performs communication with an external device in accordance with one or more known short-range wireless communication standards. Near field wireless communication section 112 It has circuits (antennas, transceivers, etc.) that conform to the communication standard it complies with.
[0024] For convenience, here we will refer to the connection part 108 and close Distance Wireless Communication Section 112 These shall comply with different wireless communication standards. In addition, the connection part 108 is a short-range wireless communication unit. 112 It conforms to a communication standard that has a wider communication range and higher communication speed than the standard, and the power consumption required for operation is also lower for the short-range wireless communication unit. 112It shall be larger. Connection part 108 and short-range wireless communication part 112 The combination of communication standards to which it conforms is not particularly limited, as long as the above-mentioned relationship is satisfied.
[0025] In this embodiment, the digital camera 100 communicates with the connection unit 208 and the short-range wireless communication unit 212 of the smartphone 200, which will be described later. Therefore, it is assumed that the connection units 108 and 208 comply with the same communication standard, and that the short-range wireless communication units 112 and 212 comply with the same communication standard.
[0026] In the following example, it is assumed that connection units 108 and 208 are wireless communication interfaces compliant with the Wireless LAN (IEEE 802.11 series) standard. Furthermore, it is assumed that short-range wireless communication units 112 and 212 are wireless communication interfaces compliant with Bluetooth® ver. 4.0 or later standards, particularly Bluetooth Low Energy (BLE). Note that the connection unit 108 and the short-range wireless communication unit 112 They may share a part of the circuit.
[0027] Furthermore, the connection unit 108 communicates with the connection unit 208 in infrastructure mode and functions as an access point (AP). That is, the connection unit 108 has the function of forming a network to which the smartphone 200 can connect. However, the connection unit 108 functions as a simple AP and does not have a gateway function to transfer data received from external devices connected to the network it has formed to another network. Alternatively, instead of functioning as a simple AP, the connection unit 108 can also connect to other APs.
[0028] <Example of smartphone configuration> Figure 2(a) is a block diagram showing an example of the functional configuration of a smartphone 200 as an example of a communication device according to the embodiment. The smartphone 200 may be any electronic device capable of communicating with the connection part 108 and the short-range wireless communication unit 112 of an external device, the digital camera 100.
[0029] The control unit 201 has one or more processors (hereinafter referred to as CPUs) capable of executing programs, and for example, it reads a program stored in the non-volatile memory 203 into the working memory 204 and executes it. By executing the program, the control unit 201 controls the operation of each functional block and realizes the functions of the smartphone 200.
[0030] The rewritable non-volatile memory 203 stores programs that the CPU of the control unit 201 can execute (such as the operating system (OS) and applications), settings for the smartphone 200 and applications, and user data. Furthermore, as will be described later, the smartphone 200 stores in the non-volatile memory 203 information about external devices with which it has communicated, and information necessary to resume communication with those external devices.
[0031] The operation of the smartphone 200, as described later, is achieved by executing applications stored in the non-volatile memory 203. The applications do not need to contain all the necessary programs to implement their functions; they can utilize functions provided by the OS as appropriate. For example, the OS can provide basic functions related to wireless communication with external devices that comply with specific wireless communication standards, such as checking for the presence of external devices and establishing and disconnecting wireless connections (links) with external devices.
[0032] The working memory 204 is, for example, volatile memory and is used to load programs executed by the CPU of the control unit 201 and to save values necessary during program execution. Additionally, a portion of the working memory 204 may be used as display memory for the display unit 206.
[0033] The imaging unit 202 is a camera unit having an imaging optical system, an image sensor, etc. The imaging unit 202 takes images according to the control of the control unit 201 and stores the obtained image data in the working memory 204. The control unit 201 applies predetermined image processing to the image data to generate an image data file. The control unit 201 records the image data file on a recording medium 207, for example.
[0034] The operation unit 205 is a general term for the input devices provided on the smartphone 200. The operation unit 205 may include, but is not limited to, the touch panel, power switch, volume control buttons, etc., provided on the display unit 206. When the control unit 201 detects an operation on the operation unit 205, it executes an action corresponding to the detected operation.
[0035] The display unit 206 is a touch display. The display unit 206 displays screens provided by the OS or applications. The smartphone 200 may also be capable of connecting to an external display device.
[0036] The recording medium 207 is provided separately from the non-volatile memory 203 and may be, for example, a semiconductor memory card. The recording medium 207 is used as a recording destination for image data files generated by the control unit 201 or data downloaded by the user. The recording medium 207 may also be used as part of the non-volatile memory 203 (to expand the capacity of the non-volatile memory 203).
[0037] The connection unit 208 (second communication means) is a communication interface. The connection unit 208 performs communication with an external device in accordance with one or more known wired and wireless communication standards, including wireless communication standards. The connection unit 208 has circuits (antenna, connector, transceiver, etc.) corresponding to the communication standard it conforms to.
[0038] The short-range wireless communication unit 212 (first communication means) is also a communication interface. The short-range wireless communication unit 212 performs communication with an external device in accordance with one or more known short-range wireless communication standards. Near field communication department 212It has circuits (antennas, transceivers, etc.) that conform to the communication standard it complies with.
[0039] As described above, the connection unit 208 is assumed to be a wireless communication interface compliant with the Wireless LAN (IEEE 802.11 series) standard. Furthermore, the short-range wireless communication unit 212 is assumed to be a wireless communication interface compliant with Bluetooth Low Energy (BLE).
[0040] The public network connection section 209 is a communication interface with a mobile communication network and conforms to one or more communication standards (such as 3G, 4G, and 5G) established by, for example, the Third Generation Partnership Project (3GPP).
[0041] Furthermore, the connection unit 208, the short-range wireless communication unit 212, and the public network connection unit 209 may share a portion of their circuits.
[0042] The microphone 210 is used for phone calls and voice command input. The microphone 210, as a voice command input device, is included in the control unit 205. Speaker 211 is used for phone calls and audio playback.
[0043] Figure 2(b) shows an example of the appearance of the smartphone 200. The power button 205a, home button 205b, and touch panel 205c are input devices included in the operation unit 205. When the home button 205b is pressed, the control unit 201 interrupts the execution of the application and displays the home screen on the display unit 206.
[0044] The home screen of the Smartphone 200 contains items (such as icons) corresponding to applications. From the home screen, you can launch applications or bring applications running in the background to the foreground.
[0045] Here, item 221 is an item for a camera communication application that provides functions utilizing communication between the smartphone 200 and the digital camera 100. Item 222 is an item for an image application that allows users to view and edit images stored on the smartphone 200. Item 223 is an item for an SNS (Social Networking Service) application that communicates with a server to share images, text, and other content with other users.
[0046] In this embodiment, the camera communication application is provided by the manufacturer of the digital camera 100 and installed via an app distribution site. The SNS application is provided by a third party and installed via an app distribution site. On the other hand, the image application is pre-installed on the smartphone 200 as standard. Whether each application is pre-installed or installed via an app distribution site is stored, for example, in the non-volatile memory 203.
[0047] When the control unit 201 detects an operation on an item (e.g., a touch operation), it checks the status of the application corresponding to the operated item. If the application is not running or requires to be started, the control unit 201 starts the application. On the other hand, if the application is running in the background (inactive) and does not require to be started, the control unit 201 moves the application to the foreground (activates it). As a result, the application screen is displayed on the display unit 206.
[0048] Furthermore, in addition to operating items, the smartphone 200 allows users to change the state of applications by switching applications according to the OS. Specifically, it can switch between background (inactive) and foreground (active) states. The control unit 201 will launch the application that has been switched from background to foreground if necessary. Note that even when an application transitions to background (inactive), it may continue to execute some of its functions.
[0049] <Overview of connection types> Figure 3 is a schematic diagram illustrating the connection configuration between the digital camera 100 and the smartphone 200. In this embodiment, the digital camera 100 and the smartphone 200 can establish a connection in two configurations, as shown in Figures 3(a) and 3(b).
[0050] Figure 3(a) shows a configuration in which a digital camera 100 and a smartphone 200 participate in a wireless LAN network formed by an external AP300, which is an example of a relay device. The digital camera 100 and the smartphone 200 detect beacon signals transmitted periodically by the external AP300 and participate in the wireless LAN network formed by the external AP300. By participating in the same wireless LAN network, the digital camera 100 and the smartphone 200 recognize each other, establish a connection between the devices by performing predetermined procedures, and become able to communicate with each other through the wireless LAN network.
[0051] Furthermore, the external AP300 can connect to external networks such as the internet via public networks. Therefore, the smartphone 200 can transmit data to devices on the internet via the external AP300.
[0052] Figure 3(b) shows a configuration in which the digital camera 100 and the smartphone 200 are directly connected without the use of a relay device. This configuration is used when the connection unit 108 of the digital camera 100 operates as a simple AP and when BLE communication is performed between the short-range wireless communication units. In this embodiment, the ad-hoc mode of the wireless LAN is not used.
[0053] In this embodiment, when a smartphone 200 and a digital camera 100 establish a BLE connection, the smartphone 200 acts as the central device (master unit) and the digital camera 100 acts as the peripheral device (slave unit). Therefore, the digital camera 100 periodically transmits BLE advertisement signals from its short-range wireless communication unit 112. The smartphone 200 also performs a scan operation using its short-range wireless communication unit 212 and receives the BLE advertisement signals transmitted by the digital camera 100.
[0054] Smartphone 200 recognizes the presence of digital camera 100 by receiving a BLE advertised signal. Smartphone 200 sends a connection request to digital camera 100. After performing procedures such as exchanging encryption keys, once a BLE connection is established, communication via the BLE connection becomes possible.
[0055] When the connection unit 108 of the digital camera 100 functions as a simple access point (AP), the connection unit 108 periodically transmits a beacon signal. The smartphone 200 detects the presence of the digital camera 100 by receiving the beacon signal through the connection unit 208. The smartphone 200 then sends a request to join the wireless LAN network generated by the connection unit 108 of the digital camera 100. Subsequently, by performing a predetermined procedure, a connection between the devices is established, and they become able to communicate with each other.
[0056] Furthermore, the digital camera 100 does not have the capability to communicate with external networks such as the internet. Therefore, when participating in the wireless LAN network generated by the digital camera 100, the smartphone 200 cannot transmit data to external networks such as the internet.
[0057] <Software configuration of Smartphone 200> Next, an example of the software configuration of the smartphone 200 will be explained using Figure 4. The non-volatile memory 203 of the smartphone 200 stores various programs executed by the control unit 201. Figure 4 typically shows the basic software (OS) 240 and a camera communication application 230 as an example of application software. The camera communication application provides a function that utilizes communication between the digital camera 100 and the smartphone 200. In reality, applications that are standardly installed on the smartphone 200 and applications installed by the user are stored in the non-volatile memory 203.
[0058] When the user turns on the power switch included in the control unit 205 of the smartphone 200, the smartphone 200 starts up, and the control unit 201 reads the OS 240 from the non-volatile memory 203, loads it into the working memory 204, and executes it. The control unit 201 also controls the various parts of the smartphone 200 by executing the OS 240 and the installed applications.
[0059] OS240 provides users with the basic functions of the smartphone 200, as well as various services to applications. Figure 4 shows a representative example of the communication service 241, one of the multiple services that the OS provides to applications.
[0060] Communication service 241 provides functions for the communication functions supported by the smartphone 200, such as turning functions on / off (enabling / disabling), generating and managing encryption keys necessary for communication, establishing connections with external devices, and communicating with connected external devices, for each type (communication standard). It also provides data obtained from external devices through communication to applications, and provides functions for sending and receiving data with external devices in response to requests from applications.
[0061] The camera communication application 230 has various functional modules. Here, we typically show a display control module 231 that generates the screen to be displayed on the display unit 206, and a communication service control module 232 that provides the function of using communication with the digital camera 100 through the communication service 241 provided by the OS 240.
[0062] Furthermore, information necessary for communication with external devices, such as pairing information in BLE, is managed by the OS240's communication service 241 and cannot be deleted from the camera communication application 230. To delete information managed by the OS240, a dedicated application, such as a settings application, is required.
[0063] On the other hand, the registered camera list, which will be described later, is managed by the camera communication application 230. Therefore, camera information can be deleted from the registered camera list through the camera communication application 230. However, even if camera information is deleted from the registered camera list, the OS240 still manages the information necessary for communication with the digital camera corresponding to the deleted camera information, and this information is not automatically deleted.
[0064] <Explanation of the menu screen for camera communication application 230> Figure 5 shows an example of a menu screen provided by the camera communication application 230 in the foreground state. In this embodiment, the camera communication application 230 stores information of digital cameras that have established a connection with the smartphone 200 and provides a menu screen for each stored digital camera. If multiple digital cameras are stored, the user can switch menu screens to display the menu screen of the desired digital camera to be used through the camera communication application 230.
[0065] The following describes an example of a screen generated by the display control module 231 and displayed on the display unit 206 when the control unit 201 executes the camera communication application 230, using Figure 5. Figure 5(a) shows an example of the menu screen 400 that is displayed when no digital cameras are registered when the camera communication application 230 is started. The menu screen 400 has a camera registration button 401 and a registration confirmation button 402.
[0066] When the camera registration button 401 is pressed, the control unit 201 performs the digital camera registration operation. Once registration is complete, the control unit 201 generates a menu screen for the registered digital camera and displays it on the display unit 206. Details of the operation of the smartphone 200 and digital camera 100 during digital camera registration will be described later.
[0067] When the registration confirmation button 402 is pressed, the control unit 201 displays a list of digital camera information registered in the camera communication application 230 on the display unit 206.
[0068] Figure 5(b) shows an example of the menu screen 400a that is displayed when the camera communication application 230 is started and a connection has been established between the registered digital camera and the smartphone 200. Here, it is assumed that a connection has been established between the digital camera (name: Camera A) registered with the camera communication application 230 and the smartphone 200. Therefore, menu screen 400a is the menu screen for Camera A. Note that both Camera A and Camera B, which will be described later, are assumed to have the same functional configuration as the digital camera 100.
[0069] The menu screen 400a displays information about the connected Camera A, such as an icon 403a indicating its appearance, its name 404a (Camera-A), and its connection method 405a. Here, icons for each method (communication standard name) that the smartphone 200 and Camera A can connect to are listed, and icons for established connections are displayed brighter than those for unestablished connections. Other display methods may also be used, such as showing only established connection methods. In the example in Figure 5(b), it is shown that the smartphone 200 and Camera A have established a BLE connection, but a Wi-Fi connection has not been established.
[0070] In this embodiment, information necessary to establish a connection between connection units 208 and 108 (e.g., identification information, password or encryption key, address information, etc.) can be obtained from the digital camera 100 through the connection between the short-range wireless communication units 212 and 112. Switching the communication interface used for communication with the same external device between the short-range wireless communication unit 112 and the connection unit 108 is referred to here as handover.
[0071] The functions performed by operating the function buttons 406a to 408a, described later, require a Wi-Fi connection. However, if a BLE connection is established, a handover to a Wi-Fi connection is possible. Therefore, the menu screen 400a displays function buttons 406a to 408a as enabled functions. If a handover is not possible, function buttons 406a to 408a will be displayed as disabled functions.
[0072] Function buttons 406a to 409a correspond to the functions that the camera communication application 230 can provide for Camera A. Note that the functions shown here are merely examples, and the types and number of functions may vary depending on the camera communication application 230 and the digital camera.
[0073] For example, any function related to a registered digital camera is acceptable, such as a function to change the settings of the digital camera or a function to connect to an external website where the digital camera's instruction manual can be viewed. Also, the number and types of function buttons displayed on the menu screen may differ depending on the digital camera.
[0074] Function button 406a is labeled from Camera A. Record This button is for executing the function of acquiring an image recorded on the medium 110 and displaying it on the display unit 206. The function button 407a is used to acquire a live view image from Camera A and to use the display unit 206 as the EVF of Camera A. Function button 408a is used to set an automatic transmission function that transfers the generated recording image data to the smartphone 200 when a still image is taken with Camera A. The function button 409a is used to enable the smartphone 200 to function as a remote control for giving shooting commands to the Camera A. Note that the remote control function only outputs shooting commands and does not enable the display unit 206 to function as the Camera A's EVF.
[0075] Here, functions corresponding to function buttons 406a to 408a are registered in the camera communication application 230 as functions that require wireless LAN communication during execution. On the other hand, functions corresponding to function button 409a are registered in the camera communication application 230 as functions that do not require wireless LAN communication during execution (functions that can be executed using BLE communication). The relationship between the functions provided by the camera communication application 230 and the communication methods required during execution is predetermined, for example, based on the amount and type of data communicated between the digital camera and the smartphone 200 during function execution. For example, a function that requires sending image data from the digital camera to the smartphone 200 may be a function that requires a high-speed communication method from among the communication methods supported by the smartphone 200.
[0076] The camera communication application 230 determines whether to enable or disable the function buttons depending on the connection method between the smartphone 200 and Camera A, and displays the function buttons in a different format depending on the determination.
[0077] Figure 5(b) shows a state where Camera A and smartphone 200 have established a connection via BLE, but not via Wi-Fi. In this case, the control unit 201 determines that the remote control function, which does not require Wi-Fi communication, is enabled. As a result, the function button 409a corresponding to the remote control function is displayed in a way that indicates it is enabled. Here, the function button corresponding to an enabled function is displayed brighter than the function button corresponding to an disabled function.
[0078] On the other hand, the functions corresponding to function buttons 406a to 408a require wireless LAN communication during execution and are therefore disabled with the current connection method. However, since it is possible to establish a wireless LAN connection using the currently established BLE connection, the control unit 201 displays function buttons 406a to 408a in a way that indicates they are enabled.
[0079] On menu screen 400a, the number of page marks 410a is equal to the number of switchable menu screens. In this case, since there is only one registered digital camera, one page mark 410a is displayed, indicating that there are no switchable menu screens. For example, if there is another switchable menu screen, two page marks 410a will be displayed, one of which will be displayed in black. The black page mark 410a indicates the currently displayed menu screen. Furthermore, the position of the black page mark among the multiple page marks 410a indicates the page number of the currently displayed menu screen, and corresponds to the index number in the registered camera list described later.
[0080] The control unit 201 stores the page number of the currently displayed menu screen in the working memory 204. Furthermore, when the camera communication application 230 transitions from the foreground to the background or terminates, the control unit 201 stores the page number in the non-volatile memory 203. This allows the next time the camera communication application 230 is launched, it to reproduce the same menu screen as the previous launch.
[0081] Figure 5(c) shows an example of menu screen 400b that is displayed when the smartphone 200 establishes a wireless LAN connection with Camera B when the camera communication application 230 is launched. It is assumed that Camera A and Camera B, which is a different digital camera from Camera A, are already registered in the camera communication application 230. Among the items displayed on menu screen 400b, items with the same reference numbers as in Figure 5(b) are the same as those on menu screen 400a, so their explanation is omitted.
[0082] The menu screen 400b displays information about the connected Camera B, such as an icon 40 indicating its appearance. 3b Then, the name 404b (Camera-B) and connection method 405b are displayed.
[0083] Note that Camera B has never established a BLE connection with smartphone 200, so BLE is not displayed in connection method 405b. Also, if a Wi-Fi connection is established, the disconnect button 411b will be displayed.
[0084] When the disconnect button 411b is pressed, the control unit 201 sends a request to Camera B to disconnect the wireless LAN connection. When Camera B's control unit 101 receives the disconnect request, it stops the operation of the connection unit 108. As a result, the network that the connection unit 108 had created as a simple AP disappears.
[0085] Since a wireless LAN connection is established, the control unit 201 determines that the functions corresponding to function buttons 406b to 408b are enabled and displays function buttons 406b to 408b brightly. On the other hand, since a BLE connection is not established, the control unit 201 determines that the remote control function is disabled and displays function button 409b dimly.
[0086] Page mark 410b appears twice, one black and one white. This is Camera A. Camera B This is because two devices are registered, and two menu screens are generated. Of the two page marks 410b, the left one is displayed in black and the right one in white, indicating that there is another menu screen on the right side. Therefore, when a leftward flick operation is detected on the display unit 206, the control unit 201 switches to menu screen 400a.
[0087] Figure 5(d) shows an example of the registered camera list screen 400c, which displays a list of information about digital cameras registered in the camera communication application 230. The registered camera list screen 400c is displayed when the registration confirmation button 402 on the menu screens 400 to 400b is operated. In this case, since Camera A and Camera B are registered, the information for Camera A and Camera B is displayed.
[0088] The information displayed for each registered digital camera is the same as what is displayed on the menu screen of each individual digital camera, so an explanation is omitted. The title string 412 indicates that the registered camera list screen 400c is being displayed. When the back button 414 is pressed, the control unit 201 returns the display to the screen that was displayed immediately before the registered camera list screen 400c was displayed.
[0089] Delete buttons 413a and 413b are displayed for each registered digital camera. When a delete button is pressed, the control unit 201 deletes the information of the corresponding digital camera from the registered camera list stored in the non-volatile memory 203. For example, when delete button 413a is pressed, the control unit 201 deletes the information of Camera A from the registered camera list. The control unit 201 also updates the display on the registered camera list screen 400c so that the information of the digital camera deleted from the registered camera list is not displayed.
[0090] <Example of a registered external device list> Figure 6 shows an example of a registered camera list, which is an example of a registered external device list in which information obtained from an external device with which the smartphone 200 has established a connection is registered. The registered camera list is stored in the non-volatile memory 203. In Figure 6, the registered camera list is shown in tabular format for ease of explanation and understanding, but the format of the registered camera list is arbitrary. The camera communication application 230 treats digital cameras with information recorded in the registered camera list as registered digital cameras.
[0091] Each camera has an index 501, a name 502, and identification information 503. Other information may also be included, such as information about the functions supported by the camera. Index 501 is a numerical value that indicates the index (sequential number) of the camera information, and is assigned sequentially starting from 1. Name 502 is a string of characters that indicates the name displayed on the menu screen. Note that this name is different from the model name and is a nickname that the user can set for the digital camera. Identification information 503 is unique information specific to each digital camera. In this embodiment, the identification information 503 is a string indicating the MAC address assigned to the connection unit 108 (wireless LAN interface). pieces It may differ for each individual unit, and any information that can be obtained externally, such as a serial number, may also be acceptable.
[0092] The control unit 201 obtains the MAC address and name of the connection unit 108 during the process of establishing a connection with the digital camera, or using the established connection. The method and timing of obtaining camera information differ depending on the connection method (communication standard), as will be described later.
[0093] The control unit 201 compares the identification information (MAC address) obtained from the digital camera 100 with the identification information 503 of the camera information stored in the non-volatile memory 203. If the identification information obtained from the digital camera 100 is not registered as camera information, the control unit 201 determines that the digital camera 100 has been newly connected. The control unit 201 then adds the name and identification information of the digital camera 100, along with a new index, to the camera information stored in the non-volatile memory 203. In this way, when a digital camera whose identification information is not stored is connected, it is added to the camera information as a new digital camera.
[0094] On the other hand, if the identification information obtained from the digital camera 100 is registered as camera information, the control unit 201 will determine that the registered digital camera has been reconnected. In this case, it is not necessary to update the registered camera information. However, since the name setting on the digital camera 100 may have been changed, the name in the registered camera information of the digital camera 100 may be updated.
[0095] <Wireless LAN connection sequence> Next, the procedure for establishing a wireless LAN connection between the digital camera 100 and the smartphone 200 will be explained with reference to Figure 7. The procedure shown in Figure 7 is performed with the wireless LAN connection function to external devices enabled on both the digital camera 100 and the smartphone 200 (with the connection units 108 and 208 operational). The connection units 108 and 208 can be enabled or disabled using any known method, such as operating the menu screen on the digital camera 100 or the settings application on the smartphone 200. Furthermore, it is assumed that a BLE connection has not been established and that handover from BLE is not possible. In addition, it is assumed that the digital camera 100 and the smartphone 200 are within wireless LAN communication range.
[0096] In T701, the control unit 101 activates the connection unit 108 and operates it as a simple AP. As a result, the connection unit 108 periodically broadcasts a wireless LAN advertisement signal (beacon frame) to announce its presence. Here, the wireless LAN advertisement signal is assumed to include at least the application ID, name, and wireless LAN MAC address as device information for the digital camera 100.
[0097] The Application ID is an identifier used to uniquely identify the connected device. It is specified only when requesting a reconnection to a specific device. For example, if you previously established a connection with smartphone 200 and wish to request a reconnection with smartphone 200, you would specify the Application ID previously obtained from smartphone 200. The Application ID is specified only during reconnection and not during new connections (it will be empty with no value).
[0098] In T702, the control unit 201 of the smartphone 200 activates the connection unit 208 and starts the process of searching for wireless LAN advertised signals. In T703, the control unit 201 receives the wireless LAN advertisement signal transmitted by the digital camera 100 at the connection unit 208.
[0099] In T704, the control unit 201 analyzes the received wireless LAN advertised signal and obtains the device information of the digital camera 100. The control unit 201 checks whether the application ID included in the device information is empty or not. If it is empty, it determines that it is a new connection request and executes T705. On the other hand, if the application ID is not empty, the control unit 201 checks whether the application ID matches the application ID of the smartphone 200. If they match, the control unit 201 determines that it is a reconnection request from the digital camera 100 to the smartphone 200 and executes T710. If they do not match, the control unit 201 determines that it is a reconnection request to another device. In this case, if the control unit 201 has not received any other advertised signals, it may terminate the operation of the connection unit 208.
[0100] Here, we assume that the application ID in the device information included in the advertised signal was empty. In the T705, the control unit 201 displays a screen on the display unit 206 asking the user whether to start a wireless LAN connection. The control unit 201 can, for example, display a screen that includes the name of the digital camera 100 obtained from the device information, along with options such as "Connect" and "Cancel".
[0101] When the control unit 201 detects an operation that instructs connection, such as pressing the "Connect" button, it executes T706. When it detects an operation that instructs not to connect, such as pressing the "Cancel" button, it does not perform any further processing. In this case, the control unit 201 may execute T702 or terminate the operation of the connection unit 208.
[0102] In T706, the control unit 201 sends a connection start request to the digital camera 100 from the connection unit 208. The connection start request shall include at least the application ID and name as device information for the smartphone 200.
[0103] The control unit 101 receives a connection from the smartphone 200 via the connection unit 108. start request The control unit 101 receives the connection start request from the smartphone 200. To The control unit 101 checks whether the application ID included in the device information is stored in the non-volatile memory 103. If the application ID of the received device information is not stored in the non-volatile memory 103, the control unit 101 determines that it is a connection start request from a new device and executes T707. On the other hand, if the application ID of the received device information is stored in the non-volatile memory 103, the control unit 101 determines that it is a reconnection request and executes T711. This is because the connection start request sent in T710 Request This corresponds to the case where it is received.
[0104] In the T707, the control unit 101 displays a screen on the display unit 106 asking the user whether to start a wireless LAN connection. The control unit 101 can, for example, display a screen that includes the name of the smartphone 200 obtained from the device information, along with options such as "Connect" and "Cancel".
[0105] When the control unit 101 detects an operation on the screen, it sends a response signal from the connection unit 108 to the smartphone 200 according to the detection result. When the control unit 101 detects an operation that instructs connection, such as pressing the "Connect" button, it sends a response signal that permits connection. Also, when the control unit 101 detects an operation that instructs not to connect, such as pressing the "Cancel" button, it sends a response signal that does not permit connection. Here, we assume that a response signal permitting connection has been sent.
[0106] When the control unit 201 receives a response signal from the digital camera 100 via the connection unit 208 that permits connection, it performs a process to establish a connection with the control unit 101. This establishes a wireless LAN connection between the digital camera 100 and the smartphone 200.
[0107] When the connection to the wireless LAN is established, at T708, the control unit 101 stores the device information (here, the application ID and device name) of the smartphone 200 in the non-volatile memory 103. In the non-volatile memory 103 of the digital camera 100, device information can be stored in the same manner as the camera information shown in Fig. 6 It can store device information in the same manner as the camera information shown in Fig.
[0108] Also, at T709, the control unit 201 stores the device information (here, the name and the wireless LAN Mac address) of the digital camera 100 as camera information in the non-volatile memory 203.
[0109] In the case of reconnection, at T710, the control unit 201 transmits a connection start request from the connection unit 208 to the digital camera 100, where the connection application ID of the smartphone 200 is set in the device information. As described above, the control unit 101 determines that the connection start request is a reconnection request based on the connection application ID.
[0110] When receiving a reconnection request, without asking the user whether to start the connection or not, at T711, the control unit 101 transmits a response signal permitting the connection. Thereafter, the control units 201 and 101 establish the connection in the same manner as in the case of a new connection request. In the case of reconnection, the control units 101 and 201 do not newly store the device information of the connection partner. As described above, if necessary, the registered name may be updated.
[0111] <Bluetooth connection sequence> Subsequently, the procedure for establishing a Bluetooth (BLE) connection between the digital camera 100 and the smartphone 200 will be described with reference to Fig. 8. The procedure shown in Figure 8 is performed with the BLE connection function to external devices enabled on both the digital camera 100 and the smartphone 200 (meaning the near-field communication units 112 and 212 are operational). The near-field communication units 112 and 212 can be enabled or disabled using any known method, such as operating the menu screen on the digital camera 100 or the settings application on the smartphone 200. Furthermore, it is assumed that the digital camera 100 and the smartphone 200 are within BLE communication range.
[0112] In T801, the control unit 101 periodically broadcasts a BLE advertisement signal from the short-range wireless communication unit 112 to notify surrounding devices of its presence. The BLE advertisement signal shall include at least the application ID and name as device information for the digital camera 100.
[0113] When requesting a new connection via a BLE advertisement signal, the control unit 101 sets the application ID in the device information to empty. Furthermore, when requesting a connection to a specific device, the control unit 101 sets the application ID corresponding to that device in the BLE advertisement signal.
[0114] In T802, the control unit 201 instructs the short-range wireless communication unit 212 to start the BLE advertise signal search process. In T803, the control unit 201 receives the BLE advertisement signal transmitted by the digital camera 100 with the short-range wireless communication unit 212.
[0115] In T804, the control unit 201 analyzes the received BLE advertised signal to obtain device information for the digital camera 100. The control unit 201 checks whether the application ID included in the device information is empty or not. If it is empty, it determines that it is a new connection request and executes T805. On the other hand, if the application ID is not empty, the control unit 201 checks whether the application ID matches the application ID of the smartphone 200. If they match, the control unit 201 determines that it is a reconnection request from the digital camera 100 to the smartphone 200 and executes T814. If they do not match, the control unit 201 determines that it is a reconnection request to another device. In this case, the control unit 201 can execute the search operation of T802.
[0116] Here, we assume that the application ID in the device information included in the advertised signal was empty. In the T805, the control unit 201 displays a screen on the display unit 206 asking the user whether to initiate a BLE connection. The control unit 201 can, for example, display a screen that includes the name of the digital camera 100 obtained from the device information, along with options such as "Connect" and "Cancel".
[0117] When the control unit 201 detects an operation that instructs connection, such as pressing the "Connect" button, it executes T806. When it detects an operation that instructs not to connect, such as pressing the "Cancel" button, it does not perform any further processing. In this case, the control unit 201 can execute the search operation of T802.
[0118] In T806, the control unit 201 transmits a connection start request to the digital camera 100 from the short-range wireless communication unit 212. The connection start request shall include at least an application ID as device information for the smartphone 200.
[0119] The control unit 101 receives a connection from the smartphone 200 via the short-range wireless communication unit 112. start requestThe control unit 101 receives the connection start request from the smartphone 200. To The control unit 101 checks whether the application ID included in the device information is stored in the non-volatile memory 103. If the application ID of the received device information is not stored in the non-volatile memory 103, the control unit 101 determines that it is a connection start request from a new device. On the other hand, if the application ID of the received device information is stored in the non-volatile memory 103, the control unit 101 determines that it is a reconnection request. This is a connection start request sent by T819, which will be described later. Request This corresponds to the case where a signal is received. Whether it is a request for a new connection or a request for reconnection, the control unit 101 transmits a response signal from the short-range wireless communication unit 112 to the smartphone 200.
[0120] In the T807, the control unit 201 receives a response signal from the digital camera 100 via the short-range wireless communication unit 212. The control unit 201 displays a screen on the display unit 106 asking the user whether to start pairing with the digital camera 100. The control unit 201 can display a screen that includes, for example, the name of the digital camera 100 obtained from the device information, along with options such as "Pair" and "Cancel".
[0121] When the control unit 201 detects an operation that instructs pairing, such as pressing the "Pair" button, it executes T808. When it detects an operation that instructs not to pair, such as pressing the "Cancel" button, it does not perform any further processing. In this case, the control unit 201 can execute the search process of T802.
[0122] In T808, the control unit 201 (communication service 241) generates an encryption key for encrypted communication. Then, in T809, the control unit 201 sends an encryption key exchange request to the digital camera 100, to which the generated encryption key is attached.
[0123] In T810, the control unit 101 receives an encryption key exchange request from the smartphone 200. The control unit 101 then associates the encryption key attached to the encryption key exchange request with the identification information of the smartphone 200 and stores it in the non-volatile memory 103. In T811, the control unit 101 generates an encryption key for encrypted communication. Then, in T812, the control unit 101 sends an encryption key exchange response with the generated encryption key attached to the smartphone 200.
[0124] At T813, the control unit 201 receives an encryption key exchange response from the digital camera 100. The control unit 201 then registers the encryption key attached to the encryption key exchange response with the OS 240's communication service 241. At this time, the OS may associate identification information assigned to the digital camera 100 with the encryption key. In practice, the encryption key may be stored in the non-volatile memory 203. This establishes encrypted communication (BLE connection) between the digital camera 100 and the smartphone 200.
[0125] Once a BLE connection is established, the control unit 201 in T814 sends a registration request to the digital camera 100 that includes the device information of the smartphone 200. The device information shall include at least the application ID and name of the smartphone 200.
[0126] When the control unit 101 receives a registration request from the smartphone 200 via the short-range wireless communication unit 112, it displays a screen on the display unit 106 in T815 asking the user whether to register the smartphone 200. The control unit 101 can, for example, display a screen that includes the name of the smartphone 200 obtained from the device information, along with options such as "Register" and "Cancel".
[0127] When the control unit 101 detects an operation on the screen, it transmits a response signal corresponding to the detection result from the short-range wireless communication unit 112 to the smartphone 200. When the control unit 101 detects an operation that instructs registration, such as pressing the "Register" button, it transmits a response signal that permits registration. Conversely, when the control unit 101 detects an operation that instructs not to register, such as pressing the "Cancel" button, it transmits a response signal that does not permit registration. Here, we assume that a response signal permitting registration has been transmitted.
[0128] At T816, the control unit 101 stores the device information of the smartphone 200 included in the registration request received at T814 in the non-volatile memory 103.
[0129] In T817, the control unit 201 transmits a wireless LAN MAC address acquisition request signal to the digital camera 100 via the short-range wireless communication unit 212 in order to acquire identification information for the digital camera 100.
[0130] The control unit 101 receives a wireless LAN MAC address acquisition request signal from the smartphone 200 via the short-range wireless communication unit 112. The control unit 101 generates a response signal including the wireless LAN MAC address of the connection unit 108 and transmits it to the smartphone 200 via the short-range wireless communication unit 112.
[0131] In T818, the control unit 201 obtains the wireless LAN MAC address of the digital camera 100 from the response signal received via the short-range wireless communication unit 212. Then, the wireless LAN MAC address and the name of the digital camera 100 obtained from the BLE advertisement signal in T803 are stored in the non-volatile memory 203 as new camera information. The communication service 241 may also associate the wireless LAN MAC address with the encryption key stored in T813. This completes the process of establishing a new connection between the digital camera 100 and the smartphone 200.
[0132] In the case of reconnection, the control unit 201 in T819 sends a connection start request from the short-range wireless communication unit 212 to the digital camera 100, with the connection application ID of the smartphone 200 set in the device information. As described above, the control unit 101 determines that the connection start request is a reconnection request based on the connection application ID.
[0133] When a reconnection request is received, the control unit 101 in T820 reads the encryption key of the smartphone 200 from the non-volatile memory 103. Similarly, the control unit 201 in T821 reads the encryption key of the digital camera 100 from the communication service 241 (non-volatile memory 203). Then, the control units 101 and 201 execute the process to establish encrypted communication. This establishes encrypted communication (BLE connection) between the digital camera 100 and the smartphone 200.
[0134] By following the above procedure, a wireless LAN and BLE-compliant connection can be established between the digital camera 100 and the smartphone 200. Furthermore, by saving the information necessary to establish a connection with the other device and using it when reconnecting, the time required to re-establish the connection can be reduced.
[0135] On the other hand, if the information of the smartphone 200 remains on a digital camera whose camera information has been removed from the registered camera list of the camera communication application 230, a problem will occur the next time a connection is made. If the information of the smartphone 200 remains on the digital camera 100, the digital camera 100 will be shown the smartphone 200 as a connection destination. When instructed to connect to the smartphone 200, the digital camera 100 will send an advertisement signal (reconnection request) that includes the application ID of the smartphone 200.
[0136] However, when the camera communication application 230 receives an advertisement signal containing the application ID of the smartphone 200, it does not perform the reconnection process until it can confirm that the transmitting external device is present in the registered camera list. This is because the camera communication application is configured to perform processing using the registered camera information (for example, displaying a unique menu screen) for registered digital cameras. As a result, the digital camera 100 repeatedly sends reconnection requests. Subsequently, if an error condition such as a timeout occurs, an error message is displayed on the display unit 106 of the digital camera 100, and the user finally becomes aware of the abnormality.
[0137] To improve user convenience, if a reconnection request is received from an external device whose information is not present (deleted) in the registered external device list (registered camera list), it is necessary to promptly notify the external device to delete the information of the smartphone 200.
[0138] To determine whether the information of the external device that sent the reconnection request exists in the registered external device list, the unique information (identification information) of the external device is required. However, the timing at which the identification information of the external device can be obtained varies depending on the communication standard.
[0139] For example, in the case of wireless LAN standards, the MAC address included in the advertised signal can be used as identification information for an external device. On the other hand, in the case of BLE standards, the advertised signal does not include identification information for an external device. Furthermore, since the name of the device included in the advertised signal can be arbitrarily set by the user, it cannot be used as identification information for an external device. Therefore, when a BLE reconnection is requested, it is necessary to communicate with the external device to obtain its identification information.
[0140] Therefore, the procedure for when the smartphone 200 of this embodiment receives a reconnection request from an external device (from T710 onwards in Figure 7, and from T819 onwards in Figure 8) is modified as described below.
[0141] Specifically, when a reconnection request is received from an external device, the smartphone 200 obtains the external device's identification information in a manner appropriate to the communication standard and determines whether or not the external device's connection information is stored. If it is determined that the connection information is not stored, the smartphone 200 promptly terminates the reconnection procedure and prompts the external device to delete the smartphone 200's connection information stored on it.
[0142] <Wireless LAN reconnection sequence> The procedure for the digital camera 100 and the smartphone 200 to re-establish a wireless LAN connection in this embodiment will be described with reference to Figure 9.
[0143] In the sequence chart of Figure 9, steps T901 to T904 are the same as those T701 to T704 described in Figure 7, so their explanation is omitted. At T904, the application ID of the smartphone 200 is included in the wireless LAN advertisement signal, and the processing after the control unit 201 determines that this is a reconnection request differs from that in Figure 7. The operation of the control unit 201 in the following steps is also achieved by the control unit 201 executing the camera communication application 230.
[0144] At T905, the control unit 201 obtains the MAC address of the wireless LAN included in the wireless LAN advertisement signal received by T903. Then, the control unit 201 refers to the registered camera list stored in the non-volatile memory 203 and checks whether there is camera information with identification information that matches the obtained MAC address.
[0145] If camera information with identification information matching the acquired MAC address is found in the registered camera list, the control unit 201 determines that reconnection is possible. Then, the control unit 201 executes T906.
[0146] At T906, the control unit 201, similar to T710, sends a connection start request from the connection unit 208 to the digital camera 100. Subsequently, the procedure described in Figure 7 is executed, and the reconnection between the smartphone 200 and the digital camera 100 is established.
[0147] On the other hand, if there is no camera information in the registered camera list that matches the acquired MAC address, the control unit 201 determines that reconnection is impossible. This occurs when the saved camera information has been deleted from the registered camera list. Then, the control unit 201 executes T907.
[0148] In T907, the control unit 201 displays a warning screen on the display unit 206 prompting the external device attempting to connect to the smartphone 200 to delete the registration information of the smartphone 200.
[0149] Figure 10(a) shows an example of a warning screen displayed on the display unit 206 of the T907. The warning screen includes a message prompting the user to delete the information of the smartphone 200 registered with the digital camera 100. The name of the digital camera 100, which is included in the advertisement signal, may also be included in the warning screen to make it easier for the user to identify the device.
[0150] <Operation of Smartphone 200 in response to Wi-Fi reconnection sequence> Figure 11 is a flowchart showing the operation of the smartphone 200 in the sequence chart shown in Figure 9. The operation described below is achieved by the control unit 201 executing the camera communication application 230.
[0151] In S1101, the control unit 201 instructs the connection unit 208 to start searching for wireless LAN advertised signals being transmitted to the currently connected network (T902 in Figure 9).
[0152] Next, in S1102, the control unit 201 determines whether or not it has received a wireless LAN advertisement signal at the connection unit 208. If it determines that it has received the signal, it executes (T903) S1103; otherwise, it repeatedly executes S1102.
[0153] In S1103, the control unit 201 analyzes the received wireless LAN advertisement signal and obtains the device information of the source device (application ID, name, and wireless LAN MAC address) (T904). Since reconnection is assumed here, the device information is assumed to include the application ID of the smartphone 200.
[0154] In S1104, the control unit 201 uses the wireless LAN MAC address included in the device information to refer to the registered camera list stored in the non-volatile memory 203 (T905).
[0155] In S1105, the control unit 201 determines whether there is camera information in the registered camera list that includes the wireless LAN MAC address included in the device information as identification information. If it determines that there is such information, it executes S1106; otherwise, it executes S1107.
[0156] In S1106, the control unit 201 sends a connection start request (T906) from the connection unit 208 to the external device (digital camera 100) that transmitted the wireless LAN advertisement signal. Subsequently, as explained in Figure 7, the control unit 201 performs the reconnection procedure with the digital camera 100 and establishes a connection with the digital camera 100. In this way, when the control unit 201 receives an advertisement signal containing its own application ID, it performs the reconnection procedure if the information of the external device that transmitted the advertisement signal is registered.
[0157] On the other hand, in S1107, the control unit 201 displays a warning screen as shown in Fig. 10(a) on the display unit 206 (T907). Thus, when the control unit 201 receives an advertisement signal including its own application ID, if the information of the external device that is the source of the advertisement signal is not registered, it does not execute the reconnection procedure. Then, the control unit 201 displays a warning screen that prompts the smartphone 200 to delete the information of the smartphone 200 registered in the external device to which the smartphone 200 is about to connect.
[0158] As a result, the user can establish a connection between the smartphone 200 and the digital camera 100 by deleting the information of the smartphone 200 registered in the digital camera 100 and starting the connection operation to the smartphone 200 again.
[0159] <BLE Reconnection Sequence> Regarding the procedure for establishing BLE reconnection between the digital camera 100 and the smartphone 200 in this embodiment, it will be described with reference to Fig. 12.
[0160] In the sequence chart of Fig. 12, since T1201 to T1207 are the same as T801 to T804 and T819 to T821 described with respect to Fig. 8, the description is omitted.
[0161] After establishing a connection with the digital camera 100, at T1208, the control unit 201 transmits a request to obtain identification information (wireless LAN Mac address) to the digital camera 100 from the short-range wireless communication unit 212. In response, the control unit 101 transmits the Mac address of the connection unit 108 to the smartphone 200 through the short-range wireless communication unit 112.
[0162] At T1209, the control unit 201 refers to the registered camera list using the Mac address acquired from the digital camera 100. If camera information including the acquired wireless LAN Mac address as identification information exists in the registered camera list, since reconnection has already been established, the process ends without doing anything.
[0163] On the other hand, when the camera information including the obtained MAC address of the wireless LAN does not exist in the registered camera list, at T1210, the control unit 201 transmits a disconnection start request from the short-range wireless communication unit 212 to the digital camera 100.
[0164] When the control unit 101 receives a disconnection start request from the smartphone 200 through the short-range wireless communication unit 112, it transmits a disconnection start request response to the smartphone 200. Thereby, the connection between the digital camera 100 and the smartphone 200 is disconnected.
[0165] At T1211, the control unit 201 displays a warning screen on the display unit 206 to prompt the deletion of the registration information of the smartphone 200 from the external device attempting to connect to the smartphone 200.
[0166] FIG. 10(b) shows an example of the warning screen displayed on the display unit 206 at T1211. The warning screen includes a message prompting the user to unregister the smartphone 200 from the digital camera 100 (delete the information of the smartphone 200). Note that the name of the digital camera 100 included in the advertisement signal may be included in the warning screen so that the user can easily identify the device.
[0167] Thereby, the user can delete the information of the smartphone 200 registered in the digital camera 100 and start the connection operation to the smartphone 200 again, thereby establishing the connection between the smartphone 200 and the digital camera 100.
[0168] <Operation of Smartphone 200 Corresponding to BLE Reconnection Sequence> FIG. 13 is a flowchart regarding the operation of the smartphone 200 in the sequence chart shown in FIG. 12. The operations described below are realized by the control unit 201 executing the camera communication application 23:
[0169] In S1301, the control unit 201 instructs the short-range wireless communication unit 212 to start searching for BLE advertised signals (T1202 in Figure 11).
[0170] Next, in S1302, the control unit 201 determines whether or not the short-range wireless communication unit 212 has received a BLE advertised signal. If it determines that it has received a signal, (T1203) S1303 is executed; otherwise, S1302 is repeatedly executed.
[0171] In S1303, the control unit 201 analyzes the received BLE advertised signal and obtains the device information (application ID and name) of the transmitting device (T1204). Since reconnection is assumed here, the device information is assumed to include the application ID of the smartphone 200.
[0172] In S1304, the control unit 201 transmits a connection start request to the digital camera 100 via the short-range wireless communication unit 212 (T1205).
[0173] In S1305, the control unit 201 reads the encryption key of the digital camera 100, which is managed by the communication service 241, in order to initiate encrypted communication with the digital camera 100 (T1206). Meanwhile, in the digital camera 100, the control unit 101 reads the encryption key of the smartphone 200 in response to the receipt of the connection start request (T1207). As a result, a BLE connection is established between the digital camera 100 and the smartphone 200.
[0174] In S1306, the control unit 201 sends a request to the digital camera 100 via the short-range wireless communication unit 212 to obtain identification information (in this case, the MAC address of the wireless LAN) (T1208), and obtains the MAC address.
[0175] In S1307, the control unit 201 uses the MAC address obtained from the digital camera 100 to refer to the registered camera list stored in the non-volatile memory 203 (T1209).
[0176] In S1308, the control unit 201 determines whether camera information containing the acquired wireless LAN MAC address as identification information exists in the registered camera list. If it determines that such information exists, it terminates the process shown in Figure 13. In other words, if the digital camera 100, which is the source of the reconnection request, has not been removed from the registered camera list, the control unit 201 maintains the established connection in S1305.
[0177] On the other hand, if the control unit 201 does not determine that camera information containing the acquired wireless LAN MAC address as identification information exists in the registered camera list, it executes S1309.
[0178] In S1309, the control unit 201 transmits a disconnection start request from the short-range wireless communication unit 212 to the digital camera 100 (T1210). When the control unit 101 receives a disconnection start request from the smartphone 200 via the short-range wireless communication unit 112, it transmits a disconnection start request response to the smartphone 200. This disconnects the connection between the digital camera 100 and the smartphone 200.
[0179] In S1310, the control unit 201 displays a warning screen (Figure 10(b)) on the display unit 206 prompting the digital camera 100, which is attempting to connect to the smartphone 200, to unpair the smartphone 200 (T1211). In other words, if the digital camera 100, which is the source of the reconnection request, has been removed from the registered camera list, the control unit 201 disconnects the connection established in S1305. The control unit 201 then prompts the digital camera 100 to unpair the smartphone 200.
[0180] Thus, when the communication device according to this embodiment receives a reconnection request from an external device, it can appropriately determine whether or not the information of that external device is stored, depending on which communication standard the reconnection request pertains to. If the information is not stored, the device can prompt the external device to delete its own information, thereby helping the user take appropriate action without making them wait unnecessarily.
[0181] ●(Second Embodiment) Next, a second embodiment of the present invention will be described. In the first embodiment, if the information of the source external device of a reconnection request has been deleted from the communication device, a warning screen is displayed each time a reconnection request is received from that external device. In other words, the display of the warning screen is repeated until the information of the communication device is deleted from that external device. In addition, each time a BLE reconnection request was received, it was necessary to establish communication with the requesting external device and obtain identification information.
[0182] This embodiment reduces the number of times a warning screen is displayed and the number of times a connection is established with an external device requesting BLE reconnection when multiple reconnection requests are received from the same external device.
[0183] <List of cameras that have been warned> Figure 14 shows an example of a warning camera list, which registers information about cameras that have been removed from the registered camera list by the smartphone 200. The warning camera list is stored in non-volatile memory 203 or working memory 204. In Figure 14, the warning camera list is shown in tabular format for ease of explanation and understanding, but the format of the registered camera list is arbitrary. The camera communication application 230 treats digital cameras whose information is recorded in the warning camera list as digital cameras whose registration has been deleted.
[0184] The alerted camera list consists of an index 1401 and identification information 1402 for each camera. Index 1401 is a numerical value that indicates the index (sequential number), which is assigned sequentially starting from 1. Identification information 1402 is unique information specific to each digital camera. In this embodiment, as in the first embodiment, a string indicating the MAC address assigned to the connection unit 108 (wireless LAN interface) can be used. Furthermore, in this embodiment, for digital cameras whose registration with respect to BLE connection has been deleted, identification information assigned by the OS can be used.
[0185] However, if the OS 240 of the smartphone 200 can obtain the MAC address of the BLE device's short-range wireless communication unit 212, the MAC address of the short-range wireless communication unit 212 may be used as the identification information 1402. Note that the identification information 1402 is unique to each digital camera and may be other information such as a serial number, as long as it is information that can be obtained from an external source.
[0186] OS240 (communication service 241) assigns identification information to newly paired BLE devices and registers it, for example, in non-volatile memory 203. Thereafter, the same identification information is used for the same BLE device. On the other hand, the identification information assigned by OS240 can be initialized by OS240 updates, so there is no guarantee that it can be permanently used for the same BLE device. Therefore, when using the identification information assigned by the OS as the identification information for a BLE device, the alerted camera list is reset (deleted) when the camera communication application is terminated.
[0187] <Operation of smartphone 200 during wireless LAN reconnection process> Figure 15 is a flowchart showing the operation of the smartphone 200 during the wireless LAN reconnection process in this embodiment. The operation described below is achieved by the control unit 201 executing the camera communication application 230. The state of the smartphone 200 and digital camera 100 before the start of processing is the same as in the first embodiment.
[0188] Since S1501 to S1503 are the same as S1101 to S1103 in FIG. 11, the description is omitted here. Since reconnection is assumed here, it is assumed that the device information of the wireless LAN advertisement signal includes the application ID of the smartphone 200.
[0189] In S1504, the control unit 201 refers to the warned camera list stored in the non-volatile memory 203 or the working memory 204 using the Mac address of the wireless LAN included in the device information acquired in S1503.
[0190] In S1505, the control unit 201 determines whether the Mac address of the wireless LAN included in the device information is included in the warned camera list as identification information. If it is determined that it is included, the reconnection process is terminated. If it is not determined, S1506 is executed.
[0191] As described above, in the present embodiment, if the detected wireless LAN device is a device registered in the warned camera list (a device deleted from the registered camera list), the reconnection process is terminated without issuing a warning.
[0192] Since S1506 to S1509 are the same as S1104 to S1107 in FIG. 11, the description is omitted. In S1510, the control unit 201 adds the identification information of the digital camera 100 (the Mac address of the wireless LAN acquired in S1503) to the warned camera list and terminates the reconnection process. If the warned camera list has not been generated, the control unit 201 newly generates it.
[0193] According to the present embodiment, when a reconnection request for the wireless LAN is received from an external device deleted from the registration list, a warning screen is displayed only for the first reconnection request, and the warning screen is not displayed for the second and subsequent reconnection requests. Therefore, even if a reconnection request is repeatedly received from an external device, it is possible to avoid repeatedly displaying the warning screen.
[0194] <Operation of the smartphone 200 in the BLE reconnection process> Figure 16 is a flowchart showing the operation of the smartphone 200 during the BLE reconnection process in this embodiment. The operation described below is achieved by the control unit 201 executing the camera communication application 230. The state of the smartphone 200 and digital camera 100 before the start of processing is the same as in the first embodiment.
[0195] Steps S1601 to S1603 are the same as steps S1301 to S1303 in Figure 13, so their explanation will be omitted. Since reconnection is assumed here, the device information in the BLE advertised signal is assumed to include the application ID of smartphone 200.
[0196] In S1604, the control unit 201 obtains identification information assigned by the communication service 241 of the OS240 to the source external device (digital camera 100) of the BLE advertisement signal.
[0197] In S1605, the control unit 201 uses the identification information obtained in S1604 to refer to the list of warned cameras stored in the non-volatile memory 203 or the working memory 204.
[0198] In S1606, the control unit 201 determines whether the warning camera list contains the identification information assigned to the digital camera 100 by the OS 240 (communication service 241). If it determines that the information is included, it terminates the reconnection process; otherwise, it executes S1607.
[0199] Thus, in this embodiment, if the detected BLE device is a device registered in the alerted camera list (a device that has been removed from the registered camera list), the reconnection process is terminated without issuing a warning.
[0200] Since steps S1607 to S1613 are the same as steps S1304 to S1310 in Figure 13, their explanation will be omitted.
[0201] In S1614, the control unit 201 adds the identification information of the digital camera 100 (the identification information assigned by OS240 (communication service 241), acquired in S1504) to the list of warned cameras and terminates the reconnection process. If the list of warned cameras does not exist, the control unit 201 generates a new one.
[0202] According to this embodiment, when a BLE reconnection request is received from an external device that has been removed from the registration list, a warning screen is displayed only for the first reconnection request, and the warning screen is not displayed for subsequent reconnection requests. Therefore, even if reconnection requests are repeatedly received from an external device, the warning screen will not be displayed repeatedly.
[0203] In this example, the warning screen is not displayed for the second and subsequent reconnection requests. However, the frequency of displaying the warning screen may be reduced, for example, by displaying the warning screen once every n times (n>2) after the second request. In this case, the control unit 201 stores the number of times the warning screen was not displayed, and when it reaches n times, it controls the system to display the warning screen the next time a reconnection request is received.
[0204] (Other embodiments) In the embodiments described above, a communication standard capable of transmitting an advertisement signal containing the identification information of the source device was described as a wireless LAN standard, and a communication standard that cannot transmit an advertisement signal containing the identification information of the source device was described as a BLE standard. However, the present invention can be similarly applied to other communication standards having similar characteristics.
[0205] Furthermore, in the above-described embodiment, when the smartphone 200 received a reconnection request from an external device that had been removed from the list of registered external devices, a warning screen was displayed on the display unit 206 of the smartphone 200. However, the smartphone 200 may also establish a connection with the external device that sent the reconnection request and cause the external device to display a warning screen or send an instruction to delete the information on the smartphone 200.
[0206] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.
[0207] This embodiment includes the following communication device, a method for controlling the communication device, and a program. (Item 1) A communication device, A first communication means capable of establishing a connection with an external device in accordance with a first communication standard, A second communication means capable of establishing a connection with an external device in accordance with a second communication standard, A storage means for storing information about external devices registered in an application that uses communication with external devices, The system includes a control means that, upon receiving a reconnection request from an external device via the first or second communication means, outputs a warning if the external device's registration with the application has been deleted, The control means is characterized by determining whether the registration of the external device to the application has been deleted based on identification information of the external device obtained in different procedures depending on whether the reconnection request was received through the first communication means or the second communication means. (Item 2) The communication device according to item 1, characterized in that the control means acquires the identification information without establishing a connection with the external device when it receives the reconnection request through the first communication means, and establishes a connection with the external device and acquires the identification information when it receives the reconnection request through the second communication means. (Item 3) The communication device according to item 2, characterized in that the control means acquires the identification information from the advertising signal of the external device when it receives the reconnection request through the first communication means. (Item 4) The communication device according to any one of items 1 to 3, characterized in that the control means does not accept the reconnection request if the registration of the external device to the application has been deleted. (Item 5) The communication device according to any one of items 1 to 4, characterized in that the control means reduces the frequency of outputting the warning when it receives multiple reconnection requests from an external device whose registration to the application has been deleted. (Item 6) The communication device according to any one of items 1 to 4, characterized in that the control means stores information of the external device that output the warning, and reduces the frequency of outputting the warning if information of the source external device of the reconnection request is stored. (Item 7) The communication device according to item 6, characterized in that, if the control means stores identification information assigned to the external device by the operating system (OS) on which the application runs, the stored information about the external device is deleted when the application terminates. (Item 8) The communication device according to any one of items 5 to 7, characterized in that the output of the warning is the output of a warning screen to the display device of the communication device. (Item 9) The communication device according to any one of items 5 to 7, characterized in that the output of the warning is either the output of a warning screen to the external device, or the transmission of an instruction from the external device to delete the information of the communication device. (Item 10) A communication device according to any one of items 1 to 9, characterized in that even if the registration of the external device with the application is deleted, the registration of the external device with the operating system (OS) on which the application runs is not deleted. (Item 11) A communication device according to any one of items 1 to 10, characterized in that the first communication standard is a wireless LAN standard and the second communication standard is a Bluetooth® Low Energy (BLE) standard. (Item 12) A first communication means capable of establishing a connection with an external device in accordance with a first communication standard, A second communication means capable of establishing a connection with an external device in accordance with a second communication standard, A control method executed by a communication device having a storage means for storing information of an external device registered in an application that uses communication with an external device, If a reconnection request is received from an external device through the first communication means or the second communication means, The identification information of the external device is obtained in a different procedure depending on whether the reconnection request was received through the first communication means or the second communication means, To determine whether the registration of the external device to the application has been deleted, based on the identification information, A method for controlling a communication device, characterized by outputting a warning when it is determined that the registration of the external device to the application has been deleted. (Item 13) A first communication means capable of establishing a connection with an external device in accordance with a first communication standard, A second communication means capable of establishing a connection with an external device in accordance with a second communication standard, A program to cause a computer of a communication device having a storage means for storing information of an external device registered in an application that uses communication with an external device, to function as a control means of the communication device described in any one of items 1 to 11.
[0208] The present invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]
[0209] 100…Digital camera, 200…Smartphone, 101,201…Control unit, 108,208…Connection unit, 112,212…Short-range wireless communication unit
Claims
1. A communication device, A first communication means capable of establishing a connection with an external device in accordance with a first communication standard, A second communication means capable of establishing a connection with an external device in accordance with a second communication standard, A storage means for storing information about external devices registered in an application that uses communication with external devices, The system includes a control means that, upon receiving a reconnection request from an external device via the first or second communication means, outputs a warning if the external device's registration with the application has been deleted. The control means is characterized by determining whether the registration of the external device to the application has been deleted based on identification information of the external device obtained in different procedures depending on whether the reconnection request was received through the first communication means or the second communication means.
2. The communication device according to claim 1, characterized in that the control means acquires the identification information without establishing a connection with the external device when it receives the reconnection request through the first communication means, and establishes a connection with the external device and acquires the identification information when it receives the reconnection request through the second communication means.
3. The communication device according to claim 2, characterized in that the control means acquires the identification information from the advertising signal of the external device when it receives the reconnection request through the first communication means.
4. The communication device according to claim 1, characterized in that the control means does not accept the reconnection request if the registration of the external device to the application has been deleted.
5. The communication device according to claim 1, characterized in that the control means reduces the frequency of outputting the warning when it receives multiple reconnection requests from an external device whose registration to the application has been deleted.
6. The communication device according to claim 1, characterized in that the control means stores information of the external device that issued the warning, and reduces the frequency of issuing the warning if information of the source external device of the reconnection request is stored.
7. The communication device according to claim 6, characterized in that, if the control means stores identification information assigned to the external device by the operating system (OS) on which the application runs, the stored information about the external device is deleted when the application terminates.
8. The communication device according to claim 5, characterized in that the output of the warning is the output of a warning screen to the display device of the communication device.
9. The communication device according to claim 5, characterized in that the output of the warning is the output of a warning screen to the external device, or the transmission of an instruction from the external device to delete the information of the communication device.
10. The communication device according to claim 1, characterized in that even if the registration of the external device to the application is deleted, the registration of the external device to the operating system (OS) on which the application runs is not deleted.
11. The communication device according to claim 1, characterized in that the first communication standard is a wireless LAN standard and the second communication standard is a Bluetooth® Low Energy (BLE) standard.
12. A first communication means capable of establishing a connection with an external device in accordance with a first communication standard, A second communication means capable of establishing a connection with an external device in accordance with a second communication standard, A control method executed by a communication device having a storage means for storing information of an external device registered in an application that uses communication with an external device, If a reconnection request is received from an external device through the first communication means or the second communication means, The identification information of the external device is obtained in a different procedure depending on whether the reconnection request was received through the first communication means or the second communication means, To determine whether the registration of the external device to the application has been deleted, based on the identification information, A method for controlling a communication device, characterized by outputting a warning when it is determined that the registration of the external device to the application has been deleted.
13. A first communication means capable of establishing a connection with an external device in accordance with a first communication standard, A second communication means capable of establishing a connection with an external device in accordance with a second communication standard, A program to cause a computer of a communication device having a storage means for storing information of an external device registered in an application that uses communication with an external device, to function as a control means of the communication device described in any one of claims 1 to 11.