Communication device and its control method
Patent Information
- Application Number
- JP2022156468
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-09-29
- Publication Date
- 2026-09-18
- Estimated Expiration
- 2042-09-29
AI Technical Summary
【0007】 本発明によれば、1つの外部装置と接続を確立している状態で他の外部装置との接続を確立した際、適切な外部装置を対象とした動作が可能な通信装置およびその制御方法を提供することができる。
Smart Images

Figure 0007923675000001 
Figure 0007923675000002 
Figure 0007923675000003
Abstract
Description
[[Technical Field]]
[0001] The present invention relates to a communication apparatus and a control method therefor, and particularly relates to a communication apparatus capable of communicating with a plurality of external apparatuses and a control method therefor. [[Background Art]]
[0002] When there are a plurality of communicable external apparatuses, it is necessary to determine which external apparatus is to be targeted for operation. Patent Document 1 discloses a communication apparatus that automatically switches the target of data communication to an external apparatus with which a connection is established later, when a connection with another external apparatus is established while a connection with one external apparatus is already established. [[Prior Art Documents]] [[Patent Documents]]
[0003] [[Patent Document 1]] Japanese Unexamined Patent Publication No. 2020-123841 [[Summary of the Invention]] [[Problem to be Solved by the Invention]]
[0004] However, with the method described in Patent Document 1, if the external apparatus with which a connection is established later is not the one intended by the user, the target of data communication will be switched to an external apparatus not intended by the user.
[0005] In view of such problems of conventional technology, according to one aspect of the present invention, there is provided a communication apparatus and a control method therefor that enable an operation targeting an appropriate external apparatus when a connection with another external apparatus is established while a connection with one external apparatus is already established. [[Means for Solving the Problem]]
[0006] The above-mentioned objective is to provide a communication device capable of communicating with an external device using a first connection method and a second connection method, wherein the communication device determines whether or not to automatically display a screen on the display means for using the external device when a connection with the external device is established, depending on the connection method with the external device and Before A control means that determines whether the external device is newly connected or reconnected, and The control means decides not to automatically display the screen if the external device is reconnected and the connection method to the external device is a first connection method that allows for the establishment of connections in parallel with different external devices, and decides to automatically display the screen if the external device is reconnected and the connection method to the external device is a second connection method that does not allow for the establishment of connections in parallel with different external devices. This is achieved by a communication device characterized by the following: [Effects of the Invention]
[0007] According to the present invention, when a connection is established with another external device while a connection is already established with one external device, it is possible to provide a communication device and a control method thereof that can perform operations targeting the appropriate external device. [Brief explanation of the drawing]
[0008] [Figure 1] Schematic diagram of a communication system according to an embodiment [Figure 2] Block diagram showing an example of the functional configuration of a digital camera as an external device according to the embodiment. [Figure 3] Block diagram showing an example of the functional configuration of a smartphone as a communication device according to this embodiment. [Figure 4] This figure shows an example of the menu screen of the camera communication application according to the embodiment. [Figure 5] This figure shows an example of the menu screen of the camera communication application according to the embodiment. [Figure 6] A diagram showing an example of camera information registered in the embodiment. [Figure 7] Sequence diagram of the wireless LAN connection operation between a digital camera and a smartphone in the embodiment. [Figure 8] Sequence diagram of BLE connection operation between a digital camera and a smartphone in an embodiment [Figure 9] Flowchart relating to the screen display control operation of a smartphone in the embodiment [Figure 10]This figure shows an example of screen display control for a camera communication application in an embodiment. [Figure 11] A diagram describing the screen display control in each embodiment for each connection method. [Modes for carrying out the invention]
[0009] The present invention will be described in detail below with reference to the attached drawings, based on exemplary embodiments thereof. Note that the following embodiments do not limit the invention to the claims. Furthermore, while multiple features are described in the embodiments, not all of them are essential to the invention, and the multiple features may be combined arbitrarily. In addition, in the attached drawings, the same or similar configurations are given the same reference numeral, and redundant descriptions are omitted.
[0010] In the following embodiments, the present invention will be described in relation to its implementation using a smartphone. However, the present invention can be implemented using any electronic device capable of establishing connections with multiple external devices. Such electronic devices include computer equipment (personal computers, tablet computers, media players, PDAs, etc.), game consoles, imaging devices, etc. These are examples, and the present invention can be implemented using other electronic devices.
[0011] <System Configuration> Figure 1 schematically shows an example of a connection configuration between a smartphone 200, which is an example of a communication device according to an embodiment of the present invention, and digital cameras 100a and 100b, which are examples of multiple external devices. Note that the external devices do not necessarily need to have an imaging function; they may be any electronic devices capable of communicating with the smartphone 200.
[0012] Smartphone 200 has a communication interface compliant with the Bluetooth® standard and a communication interface compliant with the Wireless LAN (Wi-Fi) standard. Smartphone 200 may also have communication interfaces compliant with other wireless communication standards. Furthermore, smartphone 200 may have one or more wired communication interfaces.
[0013] It is assumed in FIG. 1 that the smartphone 200 establishes a Bluetooth connection with the digital camera 100a and a wireless LAN (Wi-Fi) connection with the digital camera 100b, respectively. Note that the smartphone 200 may establish connections conforming to the same communication standard with both the digital cameras 100a and 100b. For example, such a connection is possible under the Bluetooth standard. On the other hand, the wireless LAN standard does not allow establishing multiple connections simultaneously.
[0014] Furthermore, communication in accordance with the wireless LAN standard is performed in infrastructure mode, and the digital camera functions as a simplified access point (AP). Note that a configuration in which the smartphone 200 and the digital camera 100b connect to a common access point may also be adopted.
[0015] Although details will be described later, it is assumed that the digital camera 100a is stored as "Camera A" and the digital camera 100b is stored as "Camera B" in the smartphone 200.
[0016] <Configuration Example of Digital Camera> The configurations of the digital cameras 100a and 100b will be described. In the present specification, it is assumed that the main functional configurations of the digital cameras 100a and 100b are identical. Furthermore, the digital cameras 100a and 100b are collectively referred to as the digital camera 100. Accordingly, the description regarding the digital camera 100 applies to both the digital cameras 100a and 100b.
[0017] FIG. 2 is a block diagram showing an example of the functional configuration of the digital camera 100. The control unit 101 includes one or more processors capable of executing programs (hereinafter referred to as CPUs), and reads out a program stored in, for example, the non-volatile memory 103 into the working memory 104 and executes the program. By executing the program, the control unit 101 controls the operation of each functional block and implements the functions of the digital camera 100.
[0018] The rewritable non-volatile memory 103 stores programs that the CPU of the control unit 101 can execute, settings of the digital camera 100, GUI data, and the like. The non-volatile memory 103 also stores information about external devices with which communication has taken place.
[0019] The operation of the digital camera 100, as described later, is achieved by executing a program stored in the non-volatile memory 103.
[0020] The working memory 104 is, for example, volatile memory and is used to load programs executed by the CPU of the control unit 101 and to save values necessary during program execution. In addition, a portion of the working memory 104 may be used as display memory for the display unit 106.
[0021] The imaging unit 102 is a camera unit having an imaging optical system, an image sensor, etc. The imaging unit 102 takes images according to the control of the control unit 101 and stores the obtained image data in the working memory 104. The control unit 101 applies predetermined image processing to the image data to generate an image data file. The control unit 101 records the image data file on, for example, a recording medium 107. The control unit 101 also applies predetermined image processing to the image data to generate image data for display. The control unit 101 stores the image data for display in the video memory area of the working memory 104, synthesizes an image showing information such as the current setting value, and displays it on the display unit 106.
[0022] By recording video with the imaging unit 102 and immediately displaying the recorded video on the display unit 106, the display unit 106 can be made to function as an electronic viewfinder (EVF). The video displayed on the display unit 106 to enable it to function as an EVF is called a live view image.
[0023] The operation unit 105 is a general term for the input devices provided on the digital camera 100. The operation unit 105 may include, but is not limited to, the touch panel, power switch, shutter button, video recording button, directional keys, setting button, menu button, etc., provided on the display unit 106. When the control unit 101 detects an operation on the operation unit 105, it executes an action corresponding to the detected operation.
[0024] The display unit 106 is used to display images captured by the imaging unit 102, images recorded on the recording medium 107, menu screens, and the like. An external display device may also be connected to the digital camera 100.
[0025] The recording medium 107 is provided separately from the non-volatile memory 103 and may be, for example, a semiconductor memory card. The recording medium 107 is used, for example, as a recording destination for image data files generated by the control unit 101.
[0026] The connection unit 108 is a communication interface. The connection unit 108 performs communication with an external device in accordance with one or more known wired and wireless communication standards, including wireless communication standards. The connection unit 108 has circuits (antenna, connector, transceiver, etc.) corresponding to the communication standard it conforms to.
[0027] Near field communication department 1 12 This is also a communication interface. Short-range wireless communication unit 1 12 It performs communication with an external device in accordance with one or more known short-range wireless communication standards. Near field wireless communication section 112 It has circuits (antennas, transceivers, etc.) that conform to the communication standard it complies with.
[0028] For convenience, here we will refer to the connection part 108 and close Distance wireless communication unit 1 12 These shall comply with different wireless communication standards. In addition, the connection part 108 is the short-range wireless communication unit 1 12 It conforms to a communication standard that has a wider communication range and higher communication speed than the standard, and the power consumption required for operation is also lower for the short-range wireless communication unit 1 12It shall be larger. Connection part 108 and short-range wireless communication part 1 12 The combination of communication standards to which it conforms is not particularly limited, as long as the above-mentioned relationship is satisfied.
[0029] In this embodiment, the digital camera 100 communicates with the connection unit 208 and the short-range wireless communication unit 212 of the smartphone 200, which will be described later. Therefore, it is assumed that the connection units 108 and 208 comply with the same communication standard, and that the short-range wireless communication units 112 and 212 comply with the same communication standard.
[0030] In the following example, it is assumed that connection units 108 and 208 are wireless communication interfaces compliant with the Wireless LAN (IEEE 802.11 series) standard. Furthermore, it is assumed that short-range wireless communication units 112 and 212 are wireless communication interfaces compliant with Bluetooth® ver. 4.0 or later standards, particularly Bluetooth Low Energy (BLE). Note that the connection unit 108 and the short-range wireless communication unit 1 12 They may share a part of the circuit.
[0031] Furthermore, the connection unit 108 communicates with the connection unit 208 in infrastructure mode and functions as an access point (AP). In other words, the connection unit 108 has the function of forming a network to which the smartphone 200 can connect. However, the connection unit 108 functions as a simple AP and does not have a gateway function to transfer data received from external devices connected to the network it has formed to another network.
[0032] <Example of smartphone configuration> Figure 3(a) is a block diagram showing an example of the functional configuration of a smartphone 200 as an example of a communication device according to the embodiment. The smartphone 200 may be any electronic device capable of communicating with the connection part 108 and the short-range wireless communication unit 112 of an external device, the digital camera 100.
[0033] The control unit 201 has one or more processors (hereinafter referred to as CPUs) capable of executing programs, and for example, it reads a program stored in the non-volatile memory 203 into the working memory 204 and executes it. By executing the program, the control unit 201 controls the operation of each functional block and realizes the functions of the smartphone 200.
[0034] The rewritable non-volatile memory 203 stores programs that the CPU of the control unit 201 can execute (such as the operating system (OS) and applications), settings for the smartphone 200 and applications, and user data. Furthermore, as will be described later, the smartphone 200 stores in the non-volatile memory 203 information about external devices with which it has communicated, and information necessary to resume communication with those external devices.
[0035] The operation of the smartphone 200, as described later, is achieved by executing applications stored in the non-volatile memory 203. The applications do not need to contain all the necessary programs to implement their functions; they can utilize functions provided by the OS as appropriate. For example, the OS can provide basic functions related to wireless communication with external devices that comply with specific wireless communication standards, such as checking for the presence of external devices and establishing and disconnecting wireless connections (links) with external devices.
[0036] The working memory 204 is, for example, volatile memory and is used to load programs executed by the CPU of the control unit 201 and to save values necessary during program execution. Additionally, a portion of the working memory 204 may be used as display memory for the display unit 206.
[0037] The imaging unit 202 is a camera unit having an imaging optical system, an image sensor, etc. The imaging unit 202 takes images according to the control of the control unit 201 and stores the obtained image data in the working memory 204. The control unit 201 applies predetermined image processing to the image data to generate an image data file. The control unit 201 records the image data file on a recording medium 207, for example.
[0038] The operation unit 205 is a general term for the input devices provided on the smartphone 200. The operation unit 205 may include, but is not limited to, the touch panel, power switch, volume control buttons, etc., provided on the display unit 206. When the control unit 201 detects an operation on the operation unit 205, it executes an action corresponding to the detected operation.
[0039] The display unit 206 is a touch display. The display unit 206 displays screens provided by the OS or applications. The smartphone 200 may also be capable of connecting to an external display device.
[0040] The recording medium 207 is provided separately from the non-volatile memory 203 and may be, for example, a semiconductor memory card. The recording medium 207 is used as a recording destination for image data files generated by the control unit 201 or data downloaded by the user. The recording medium 207 may also be used as part of the non-volatile memory 203 (to expand the capacity of the non-volatile memory 203).
[0041] The connection unit 208 (second communication means) is a communication interface. The connection unit 208 performs communication with an external device in accordance with one or more known wired and wireless communication standards, including wireless communication standards. The connection unit 208 has circuits (antenna, connector, transceiver, etc.) corresponding to the communication standard it conforms to.
[0042] The short-range wireless communication unit 212 (first communication means) is also a communication interface. The short-range wireless communication unit 212 performs communication with an external device in accordance with one or more known short-range wireless communication standards. Near field communication department 212 It has circuits (antennas, transceivers, etc.) that conform to the communication standard it complies with.
[0043] As described above, the connection unit 208 is assumed to be a wireless communication interface compliant with the Wireless LAN (IEEE 802.11 series) standard. Furthermore, the short-range wireless communication unit 212 is assumed to be a wireless communication interface compliant with Bluetooth Low Energy (BLE).
[0044] The public network connection section 209 is a communication interface with a mobile communication network and conforms to one or more communication standards (such as 3G, 4G, and 5G) established by, for example, the Third Generation Partnership Project (3GPP).
[0045] Furthermore, the connection unit 208, the short-range wireless communication unit 212, and the public network connection unit 209 may share a portion of their circuits.
[0046] The microphone 210 is used for phone calls and voice command input. The microphone 210, as a voice command input device, is included in the control unit 205. Speaker 211 is used for phone calls and audio playback.
[0047] Figure 3(b) shows an example of the appearance of the smartphone 200. The power button 205a, home button 205b, and touch panel 205c are input devices included in the operation unit 205. When the home button 205b is pressed, the control unit 201 interrupts the execution of the application and displays the home screen on the display unit 206.
[0048] The home screen of the Smartphone 200 contains items (such as icons) corresponding to applications. From the home screen, you can launch applications or bring applications running in the background to the foreground.
[0049] Here, item 221 is an item for a camera communication application that provides functions utilizing communication between the smartphone 200 and the digital camera 100. Item 222 is an item for an image application that allows users to view and edit images stored on the smartphone 200. Item 223 is an item for an SNS (Social Networking Service) application that communicates with a server to share images, text, and other content with other users.
[0050] In this embodiment, the camera communication application is provided by the manufacturer of the digital camera 100 and installed via an app distribution site. The SNS application is provided by a third party and installed via an app distribution site. On the other hand, the image application is pre-installed on the smartphone 200 as standard. Whether each application is pre-installed or installed via an app distribution site is stored, for example, in the non-volatile memory 203.
[0051] When the control unit 201 detects an operation on an item (e.g., a touch operation), it checks the status of the application corresponding to the operated item. If the application is not running or requires to be started, the control unit 201 starts the application. On the other hand, if the application is running in the background (inactive) and does not require to be started, the control unit 201 moves the application to the foreground (activates it). As a result, the application screen is displayed on the display unit 206.
[0052] Furthermore, in addition to operating items, the smartphone 200 allows users to change the state of applications by switching applications according to the OS. Specifically, it can switch between background (inactive) and foreground (active) states. The control unit 201 will launch the application that has been switched from background to foreground if necessary. Note that even when an application transitions to background (inactive), it may continue to execute some of its functions.
[0053] <Explanation of the menu screen for the camera communication application on the Smartphone 200> Figure 4 shows an example of a menu screen provided by a camera communication application in the foreground state. In this embodiment, the camera communication application stores information of digital cameras that have established a connection with the smartphone 200 and provides a menu screen for each stored digital camera. If multiple digital cameras are stored, the user can switch menu screens to display the menu screen of the desired digital camera to be used through the camera communication application.
[0054] The following describes an example of a screen displayed on the display unit 206 when the control unit 201 executes a camera communication application, using Figures 4 and 5. Figure 4(a) shows an example of a menu screen 400 that is displayed when no digital cameras are registered when the camera communication application is started. The menu screen 400 has a camera registration button 401 and a registration confirmation button 402.
[0055] When the camera registration button 401 is pressed, the control unit 201 performs the digital camera registration operation. Once registration is complete, the control unit 201 generates a menu screen for the registered digital camera and displays it on the display unit 206. Details of the operation of the smartphone 200 and digital camera 100 during digital camera registration will be described later.
[0056] When the registration confirmation button 402 is pressed, the control unit 201 displays a list of information about the digital cameras registered in the camera communication application on the display unit 206.
[0057] Figure 4(b) shows an example of menu screen 400a that is displayed when the camera communication application is launched and a connection has been established between the registered digital camera and the smartphone 200. Here, it is assumed that a connection has been established between the digital camera 100a, which is registered with the camera communication application, and the smartphone 200. Therefore, menu screen 400a is the menu screen for the digital camera 100a.
[0058] The menu screen 400a displays information about the connected digital camera 100a, such as an icon 403a indicating its appearance, a name 404a (Camera-A), and a connection method 405a. Here, icons for each method (communication standard name) that the smartphone 200 and the digital camera 100a can connect to are listed, and the icon is displayed brighter when a connection is established than when a connection is not established. Note that other display methods may be used, such as showing only the methods for which a connection has been established. In the example in Figure 4(b), it is shown that the smartphone 200 and the digital camera 100a have established a BLE connection, but a Wi-Fi connection has not been established.
[0059] In this embodiment, information necessary to establish a connection between connection units 208 and 108 (e.g., identification information, password or encryption key, address information, etc.) can be obtained from the digital camera 100 through the connection between the short-range wireless communication units 212 and 112. Switching the communication interface used for communication with the same external device between the short-range wireless communication unit 112 and the connection unit 108 is referred to here as handover.
[0060] The functions performed by operating the function buttons 406a to 408a, described later, require a Wi-Fi connection. However, if a BLE connection is established, a handover to a Wi-Fi connection is possible. Therefore, the menu screen 400a displays function buttons 406a to 408a as enabled functions. If a handover is not possible, function buttons 406a to 408a will be displayed as disabled functions.
[0061] Function buttons 406a to 409a correspond to the functions that the camera communication application can provide for the digital camera 100a. Note that the functions shown here are merely examples, and the types and number of functions may vary depending on the camera communication application and the digital camera.
[0062] For example, any function related to a registered digital camera is acceptable, such as a function to change the settings of the digital camera or a function to connect to an external website where the digital camera's instruction manual can be viewed. Also, the number and types of function buttons displayed on the menu screen may differ depending on the digital camera.
[0063] Function button 406a is described from the digital camera 100a. Record medium 1 07 This button is for executing the function of acquiring the image recorded in the device and displaying it on the display unit 206. The function button 407a is used to acquire a live view image from the digital camera 100a and to use the display unit 206 as the EVF of the digital camera 100a. Function button 408a is used to set an automatic transmission function that transfers the generated recording image data to the smartphone 200 when a still image is taken with the digital camera 100a. The function button 409a is used to enable the smartphone 200 to function as a remote control for issuing shooting commands to the digital camera 100a. Note that the remote control function only outputs shooting commands and does not enable the display unit 206 to function as the EVF of the digital camera 100a.
[0064] Here, functions corresponding to function buttons 406a to 408a are registered in the camera communication application as functions that require wireless LAN communication during execution. On the other hand, functions corresponding to function button 409a are registered in the camera communication application as functions that do not require wireless LAN communication during execution (functions that can be executed using BLE communication). The relationship between the functions provided by the camera communication application and the communication method required during execution is predetermined according to, for example, the amount of data and the type of data communicated between the digital camera 100 and the smartphone 200 during the execution of the function. For example, a function that requires sending image data from the digital camera 100 to the smartphone 200 may be a function that requires a high-speed communication method from among the communication methods supported by the smartphone 200.
[0065] The camera communication application determines whether to enable or disable the function buttons depending on the connection method between the smartphone 200 and the digital camera 100a, and displays the function buttons in a different way depending on the determination.
[0066] Figure 4(b) shows a state where the digital camera 100a and the smartphone 200 have established a connection via BLE, but not via Wi-Fi. In this case, the control unit 201 determines that the remote control function, which does not require Wi-Fi communication, is enabled. As a result, the function button 409a corresponding to the remote control function is displayed in a way that indicates it is enabled. Here, the function button corresponding to an enabled function is displayed brighter than the function button corresponding to an disabled function.
[0067] On the other hand, the functions corresponding to function buttons 406a to 408a require wireless LAN communication during execution and are therefore disabled with the current connection method. However, since it is possible to establish a wireless LAN connection using the currently established BLE connection, the control unit 201 displays function buttons 406a to 408a in a way that indicates they are enabled.
[0068] On menu screen 400a, the number of page marks 410a is equal to the number of switchable menu screens. In this case, since there is only one registered digital camera, one page mark 410a is displayed, indicating that there are no switchable menu screens. For example, if there is another switchable menu screen, two page marks 410a will be displayed, one of which will be displayed in black. The black page mark 410a indicates the currently displayed menu screen. Furthermore, among the multiple page marks 410a, the position of the black page mark indicates the page number of the currently displayed menu screen and corresponds to the index number of the camera information described later.
[0069] The control unit 201 stores the page number of the currently displayed menu screen in the working memory 204. Furthermore, when the camera communication application transitions from the foreground to the background or terminates, the control unit 201 stores the page number in the non-volatile memory 203. This allows the next time the camera communication application is launched, it to reproduce the same menu screen as the previous launch.
[0070] Figure 5(a) shows an example of menu screen 400b that is displayed when the camera communication application is launched and the smartphone 200 establishes a wireless LAN connection with digital camera 100b, with digital cameras 100a and 100b already registered. Among the items displayed on menu screen 400b, those with the same reference numbers as those in Figure 4(b) are the same as those on menu screen 400a, so their explanation is omitted.
[0071] The menu screen 400b displays information about the connected digital camera 100b, such as an icon 40 indicating its appearance. 3b Then, the name 404b (Camera-B) and connection method 405b are displayed.
[0072] Note that the digital camera 100b has never established a BLE connection with the smartphone 200, so BLE is not displayed in connection method 405b. Also, if a wireless LAN connection is established, the disconnect button 411b will be displayed.
[0073] When the disconnect button 411b is pressed, the control unit 201 sends a request to the digital camera 100b to disconnect the wireless LAN connection. When the control unit 101 of the digital camera 100b receives the disconnect request, it stops the operation of the connection unit 108. As a result, the network that the connection unit 108 had created as a simple AP disappears.
[0074] Since a wireless LAN connection is established, the control unit 201 determines that the functions corresponding to function buttons 406b to 408b are enabled and displays function buttons 406b to 408b brightly. On the other hand, since a BLE connection is not established, the control unit 201 determines that the remote control function is disabled and displays function button 409b dimly.
[0075] Two page marks 410b are displayed, one in black and the other in white. This is because two digital cameras, 100a and 100b, are registered, and two menu screens have been generated. Of the two page marks 410b, the left one is displayed in black and the right one in white, indicating that there is another menu screen on the right side. Therefore, when a leftward flick operation is detected on the display unit 206, the control unit 201 switches to menu screen 400a.
[0076] Figure 5(b) shows the updated state of the menu screen 400a in Figure 4(b) after the control unit 201 detects that the BLE connection with the digital camera 100a has been disconnected. The BLE connection may be disconnected intentionally by the user through the operation unit 105 of the digital camera 100a, or it may be disconnected due to other factors.
[0077] When the BLE connection is disconnected, the established connection with the digital camera 100a is lost. Therefore, the control unit 201 updates the BLE display in connection method 405a on the menu screen 400a and the displays of function buttons 406a to 409a. Specifically, the control unit 201 dims the BLE display in the same way as Wi-Fi. In addition, the control unit 201 dims the displays of function buttons 406a to 409a to indicate that they are disabled.
[0078] Figure 5(c) shows the updated state of menu screen 400b in Figure 5(a) after the control unit 201 detects that the wireless LAN connection with the digital camera 100a has been disconnected. The wireless LAN connection may be intentionally disconnected, for example, by the user operating the disconnect button 411b, or it may be disconnected due to other factors.
[0079] When the wireless LAN connection is disconnected, the established connection with the digital camera 100b is lost. Therefore, the control unit 201 updates the Wi-Fi display in the connection method 405b on the menu screen 400b and the displays of the function buttons 406b to 408b. Specifically, the control unit 201 dims the Wi-Fi display to indicate that the connection is disconnected. In addition, the control unit 201 dims the displays of the function buttons 406b to 408b to indicate that they are disabled.
[0080] <Example of registered camera information> Figure 6 shows an example of camera information acquired by a smartphone 200 from a digital camera with which it has established a connection, and stored in the non-volatile memory 203. Note that while Figure 6 shows the camera information in a table format for ease of explanation and understanding, the actual format of the stored camera information is arbitrary. The camera communication application treats the digital camera with information recorded in the non-volatile memory 203 as a registered digital camera.
[0081] Each camera has an index 501, a name 502, and identification information 503. Other information may also be included, such as information about the functions supported by the camera. Index 501 is a numerical value that indicates the index (number) of the camera information, and is assigned sequentially starting from 1. Name 502 is a string of characters that indicates the name displayed on the menu screen. Note that this name is different from the model name and is a nickname that the user can set for the digital camera. Identification information 503 is unique information specific to each digital camera. In this embodiment, the identification information 503 is a string indicating the MAC address assigned to the connection unit 108 (wireless LAN interface). pieces If the information differs for each individual unit, other information such as serial numbers may also be acceptable.
[0082] The control unit 201 obtains the MAC address and name of the connection unit 108 during the process of establishing a connection with the digital camera, or using the established connection. The method and timing of obtaining camera information vary depending on the connection method (communication standard).
[0083] The control unit 201 compares the identification information (MAC address) obtained from the digital camera 100 with the identification information 503 of the camera information stored in the non-volatile memory 203. If the identification information obtained from the digital camera 100 is not registered as camera information, the control unit 201 determines that the digital camera 100 has been newly connected. The control unit 201 then adds the name and identification information of the digital camera 100, along with a new index, to the camera information stored in the non-volatile memory 203. In this way, when a digital camera whose identification information is not stored is connected, it is added to the camera information as a new digital camera.
[0084] On the other hand, if the identification information obtained from the digital camera 100 is registered as camera information, the control unit 201 will determine that the registered digital camera has been reconnected. In this case, it is not necessary to update the registered camera information. However, since the name setting on the digital camera 100 may have been changed, the name in the registered camera information of the digital camera 100 may be updated.
[0085] <Wireless LAN connection sequence> Next, the procedure for establishing a wireless LAN connection between the digital camera 100 and the smartphone 200 will be explained with reference to Figure 7. The procedure shown in Figure 7 is performed with the wireless LAN connection function to external devices enabled on both the digital camera 100 and the smartphone 200 (with the connection units 108 and 208 operational). The connection units 108 and 208 can be enabled or disabled using any known method, such as operating the menu screen on the digital camera 100 or the settings application on the smartphone 200. Furthermore, it is assumed that a BLE connection has not been established and that handover from BLE is not possible. In addition, it is assumed that the digital camera 100 and the smartphone 200 are within wireless LAN communication range.
[0086] In T601, the control unit 101 activates the connection unit 108 and operates it as a simple AP. As a result, the connection unit 108 periodically broadcasts a wireless LAN advertisement signal (beacon frame) to announce its presence. Here, the wireless LAN advertisement signal is assumed to include at least the application ID, name, and wireless LAN MAC address as device information for the digital camera 100.
[0087] The Application ID is an identifier used to uniquely identify the connected device. It is specified only when requesting a reconnection to a specific device. For example, if you previously established a connection with smartphone 200 and wish to request a reconnection with smartphone 200, you would specify the Application ID previously obtained from smartphone 200. The Application ID is specified only during reconnection and not during new connections (it will be empty with no value).
[0088] In T602, the control unit 201 of the smartphone 200 activates the connection unit 208 and starts the process of searching for wireless LAN advertised signals. In T603, the control unit 201 receives the wireless LAN advertisement signal transmitted by the digital camera 100 at the connection unit 208.
[0089] In T604, the control unit 201 analyzes the received wireless LAN advertised signal to obtain device information for the digital camera 100. The control unit 201 checks whether the application ID included in the device information is empty or not. If it is empty, it determines that it is a new connection request and executes T605. On the other hand, if the application ID is not empty, the control unit 201 checks whether the application ID matches the application ID of the smartphone 200. If they match, the control unit 201 determines that it is a reconnection request from the digital camera 100 to the smartphone 200 and executes T610. If they do not match, the control unit 201 determines that it is a reconnection request to another device. In this case, if the control unit 201 has not received any other advertised signals, it may terminate the operation of the connection unit 208.
[0090] Here, we assume that the application ID in the device information included in the advertised signal was empty. In the T605, the control unit 201 displays a screen on the display unit 206 asking the user whether to start a wireless LAN connection. The control unit 201 can, for example, display a screen that includes the name of the digital camera 100 obtained from the device information, along with options such as "Connect" and "Cancel".
[0091] When the control unit 201 detects an operation that instructs connection, such as pressing the "Connect" button, it executes T606. When it detects an operation that instructs not to connect, such as pressing the "Cancel" button, it does not perform any further processing. In this case, the control unit 201 may execute T602 or terminate the operation of the connection unit 208.
[0092] In T606, the control unit 201 sends a connection start request to the digital camera 100 from the connection unit 208. The connection start request shall include at least the application ID and name as device information for the smartphone 200.
[0093] The control unit 101 receives a connection from the smartphone 200 via the connection unit 108. start request The control unit 101 receives the connection start request from the smartphone 200. To The control unit 101 checks whether the application ID included in the device information is stored in the non-volatile memory 103. If the application ID of the received device information is not stored in the non-volatile memory 103, the control unit 101 determines that it is a connection start request from a new device and executes T607. On the other hand, if the application ID of the received device information is stored in the non-volatile memory 103, the control unit 101 determines that it is a reconnection request and executes T611. This is because the connection start request sent in T610 Request This corresponds to the case where it is received.
[0094] In T607, the control unit 101 displays a screen on the display unit 106 asking the user whether to start a wireless LAN connection. The control unit 101 can, for example, display a screen that includes the name of the smartphone 200 obtained from the device information, along with options such as "Connect" and "Cancel".
[0095] When the control unit 101 detects an operation on the screen, it sends a response signal from the connection unit 108 to the smartphone 200 according to the detection result. When the control unit 101 detects an operation that instructs connection, such as pressing the "Connect" button, it sends a response signal that permits connection. Also, when the control unit 101 detects an operation that instructs not to connect, such as pressing the "Cancel" button, it sends a response signal that does not permit connection. Here, we assume that a response signal permitting connection has been sent.
[0096] When the control unit 201 receives a response signal from the digital camera 100 through the connection unit 208 that permits connection, it performs a process to establish a connection with the control unit 101. This establishes a wireless LAN connection between the digital camera 100 and the smartphone 200.
[0097] Once a wireless LAN connection is established, the control unit 101 in T608 stores the device information of the smartphone 200 (in this case, the application ID and device name) in the non-volatile memory 103. The non-volatile memory 103 of the digital camera 100 can store device information in the same way as the camera information shown in Figure 5.
[0098] In addition, the control unit 201 in T609 stores the device information of the digital camera 100 (in this case, the name and wireless LAN MAC address) as camera information in the non-volatile memory 203.
[0099] In the case of reconnection, the control unit 201 in T610 sends a connection start request from the connection unit 208 to the digital camera 100, with the connection application ID of the smartphone 200 set in the device information. As described above, the control unit 101 determines that the connection start request is a reconnection request based on the connection application ID.
[0100] When a reconnection request is received, the control unit 101 transmits a response signal permitting connection at T611 without inquiring of the user whether to start the connection. Thereafter, the control units 201 and 101 establish a connection in the same manner as when a new connection request is made. In the case of reconnection, the control units 101 and 201 do not newly store device information of the connection partner. Note that, as described above, registered names may be updated as necessary.
[0101] <Bluetooth connection sequence> Next, a procedure for establishing a Bluetooth (BLE) connection between the digital camera 100 and the smartphone 200 will be described with reference to FIG. 8. The procedure shown in FIG. 8 is executed on both the digital camera 100 and the smartphone 200 in a state where the function of connecting to an external device via BLE is enabled (a state where the short-range wireless communication units 112 and 212 are operable). Enabling / disabling of the short-range wireless communication units 112 and 212 can be switched by any known method, such as operation of a menu screen of the digital camera 100 or operation of a setting application of the smartphone 200. Further, it is assumed that the digital camera 100 and the smartphone 200 are located within a distance where they can communicate via BLE.
[0102] At T701, the control unit 101 causes the short-range wireless communication unit 112 to periodically broadcast a BLE advertise signal for notifying surrounding devices of its own existence. It is assumed that the BLE advertise signal includes at least an application ID and a name as device information of the digital camera 100.
[0103] When requesting a new connection, the control unit 101 sets the application ID of the device information to empty also in the BLE advertise signal. Further, when requesting connection to a specific device, the control unit 101 sets an application ID corresponding to that device in the BLE advertise signal.
[0104] In T702, the control unit 201 instructs the short-range wireless communication unit 212 to start the BLE advertise signal search process. In T703, the control unit 201 receives the BLE advertisement signal transmitted by the digital camera 100 with the short-range wireless communication unit 212.
[0105] In T704, the control unit 201 analyzes the received BLE advertised signal to obtain device information for the digital camera 100. The control unit 201 checks whether the application ID included in the device information is empty or not. If it is empty, it determines that it is a new connection request and executes T705. On the other hand, if the application ID is not empty, the control unit 201 checks whether the application ID matches the application ID of the smartphone 200. If they match, the control unit 201 determines that it is a reconnection request from the digital camera 100 to the smartphone 200 and executes T714. If they do not match, the control unit 201 determines that it is a reconnection request to another device. In this case, the control unit 201 can execute the search operation of T702.
[0106] Here, we assume that the application ID in the device information included in the advertised signal was empty. In the T705, the control unit 201 displays a screen on the display unit 206 asking the user whether to initiate a BLE connection. The control unit 201 can, for example, display a screen that includes the name of the digital camera 100 obtained from the device information, along with options such as "Connect" and "Cancel".
[0107] When the control unit 201 detects an operation that instructs connection, such as pressing the "Connect" button, it executes T706. When it detects an operation that instructs not to connect, such as pressing the "Cancel" button, it does not perform any further processing. In this case, the control unit 201 can execute the search operation of T702.
[0108] In T706, the control unit 201 transmits a connection start request to the digital camera 100 from the short-range wireless communication unit 212. The connection start request shall include at least an application ID as device information for the smartphone 200.
[0109] The control unit 101 receives connections from the smartphone 200 via the short-range wireless communication unit 112. start request The control unit 101 receives the connection start request from the smartphone 200. To The control unit 101 checks whether the application ID included in the device information is stored in the non-volatile memory 103. If the application ID of the received device information is not stored in the non-volatile memory 103, the control unit 101 determines that it is a connection start request from a new device. On the other hand, if the application ID of the received device information is stored in the non-volatile memory 103, the control unit 101 determines that it is a reconnection request. This is a connection start request sent by T714, which will be described later. Request This corresponds to the case where a signal is received. Whether it is a request for a new connection or a request for reconnection, the control unit 101 transmits a response signal from the short-range wireless communication unit 112 to the smartphone 200.
[0110] In the T707, the control unit 201 receives a response signal from the digital camera 100 via the short-range wireless communication unit 212. The control unit 201 displays a screen on the display unit 106 asking the user whether to start pairing with the digital camera 100. The control unit 201 can, for example, display a screen that includes the name of the digital camera 100 obtained from the device information, along with options such as "Pair" and "Cancel".
[0111] When the control unit 201 detects an operation that instructs pairing, such as pressing the "Pair" button, it executes T708. When it detects an operation that instructs not to pair, such as pressing the "Cancel" button, it does not perform any further processing. In this case, the control unit 201 can execute the search process of T702.
[0112] In the T708, the control unit 201 and control unit 101 generate an encryption key for encrypted communication. Then, the short-range wireless communication units 112 and 212 perform communication to exchange the generated encryption keys. The control unit 201 stores the received encryption key in the non-volatile memory 203, associating it with the identification information of the digital camera 100. Similarly, the control unit 101 stores the received encryption key in the non-volatile memory 103, associating it with the identification information of the smartphone 200. The encryption key may also be stored as part of the camera information shown in Figure 6. This establishes encrypted communication (BLE connection) between the digital camera 100 and the smartphone 200.
[0113] Once a BLE connection is established, the control unit 201 in T709 sends a registration request to the digital camera 100 that includes the device information of the smartphone 200. The device information shall include at least the application ID and name of the smartphone 200.
[0114] When the control unit 101 receives a registration request from the smartphone 200 via the short-range wireless communication unit 112, the T710 displays a screen on the display unit 106 asking the user whether to register the smartphone 200. The control unit 101 can, for example, display a screen that includes the name of the smartphone 200 obtained from the device information, along with options such as "Register" and "Cancel".
[0115] When the control unit 101 detects an operation on the screen, it transmits a response signal corresponding to the detection result from the short-range wireless communication unit 112 to the smartphone 200. When the control unit 101 detects an operation that instructs registration, such as pressing the "Register" button, it transmits a response signal that permits registration. Conversely, when the control unit 101 detects an operation that instructs not to register, such as pressing the "Cancel" button, it transmits a response signal that does not permit registration. Here, we assume that a response signal permitting registration has been transmitted.
[0116] At T711, the control unit 101 stores the device information of the smartphone 200 included in the registration request received at T709 in the non-volatile memory 103.
[0117] In T712, the control unit 201 transmits a wireless LAN MAC address acquisition request signal to the digital camera 100 via the short-range wireless communication unit 212 in order to acquire identification information for the digital camera 100.
[0118] The control unit 101 receives a wireless LAN MAC address acquisition request signal from the smartphone 200 via the short-range wireless communication unit 112. The control unit 101 generates a response signal including the wireless LAN MAC address of the connection unit 108 and transmits it to the smartphone 200 via the short-range wireless communication unit 112.
[0119] In T713, the control unit 201 obtains the wireless LAN MAC address of the digital camera 100 from the response signal received via the short-range wireless communication unit 212. Then, the wireless LAN MAC address and the name of the digital camera 100 obtained from the BLE advertisement signal in T703 are stored as new camera information in the non-volatile memory 203. This completes the process of pairing the smartphone 200 with the digital camera 100.
[0120] In the case of reconnection, the control unit 201 in T714 sends a connection start request from the short-range wireless communication unit 212 to the digital camera 100, with the connection application ID of the smartphone 200 set in the device information. As described above, the control unit 101 determines that the connection start request is a reconnection request based on the connection application ID.
[0121] When a reconnection request is received, the control unit 101 reads the encryption key of the smartphone 200 from the non-volatile memory 103. Similarly, the control unit 201 reads the encryption key of the digital camera 100 from the non-volatile memory 203. Then, the control units 101 and 201 execute the process to establish encrypted communication. This establishes encrypted communication (BLE connection) between the digital camera 100 and the smartphone 200.
[0122] <Menu screen display control> Next, the display control operation of the menu screen in the camera communication application will be explained using the flowchart shown in Figure 9. The camera communication application determines which menu screen to display depending on whether the connected device is a new device or not and the connection method.
[0123] Here, we assume that the smartphone 200 and the digital camera 100b are connected to the same wireless LAN network. Alternatively, the smartphone 200 may be connected to a network generated by the connection port 108 of the digital camera 100b as a simple access point (AP). Furthermore, the digital camera 100b and the smartphone 200 may be connected to a network generated by a Wi-Fi router (not shown) as an AP.
[0124] The operation shown in the flowchart of Figure 9 is achieved when the control unit 201 executes the camera communication application. This operation is also performed when the menu screen is displayed, such as when the camera communication application is launched on the smartphone 200. Furthermore, digital camera 100a is connected to the smartphone 200 via BLE, and digital camera 100b is connected via Wi-Fi.
[0125] In S801, the control unit 201 instructs the short-range wireless communication unit 212 to start the BLE advertise signal search process.
[0126] In S802, the control unit 201 determines whether or not it has received a BLE advertised signal through the short-range wireless communication unit 212. If the control unit 201 determines that it has received a BLE advertised signal, it executes S803; otherwise, it executes S812.
[0127] In S803, the control unit 201 obtains the application ID from the device information contained in the received BLE advertised signal. The control unit 201 then determines whether the obtained application ID matches the application ID of the smartphone 200 (for example, the application ID transmitted in T709 in Figure 8).
[0128] If the two application IDs are determined to match, the control unit 201 determines that it is a reconnection from a registered device and executes S804. If the BLE advertised signal does not contain an application ID, the control unit 201 determines that it is a new connection request and executes S809. If the BLE advertised signal contains an application ID and is not determined to match the application ID of the smartphone 200, the control unit 201 determines that the advertised signal is a connection request to another device and executes S812. (BLE reconnection process) In S804, the control unit 201 performs a BLE reconnection process with the digital camera 100a via the short-range wireless communication unit 212 and re-establishes the BLE connection. This reconnection process is the same as the process described from T714 onwards in Figure 8, so the explanation is omitted.
[0129] In S805, the control unit 201 determines the update content to reflect the reconnection on the menu screen. At this point, the display is not yet updated. The control unit 201 decides to make the BLE icon for connection method 405a brighter and the Wi-Fi icon dim, and to make the function buttons 406a to 409a on the menu screen brighter.
[0130] In S806, the control unit 201 identifies the page position of the menu screen 400a of the digital camera 100a that was reconnected in S804. The page position of the menu screen 400a of the reconnected digital camera 100a matches the index 501 of the camera information of the digital camera 100a stored in the non-volatile memory 203.
[0131] Therefore, the control unit 201 can determine the page position of the menu screen 400a of the reconnected digital camera 100a by obtaining the index of the digital camera 100a from the camera information stored in the non-volatile memory 203. If necessary, the control unit 201 may obtain identification information (wireless LAN MAC address) from the digital camera 100a in S806. Alternatively, the control unit 201 may obtain the index of the digital camera 100a from the camera information using the name of the digital camera 100a included in the BLE advertised signal received in S802.
[0132] The acquired index is used by the control unit 201 in S807 to determine whether the menu screen currently displayed on the display unit 206 of the smartphone 200 is the menu screen 400a of the reconnected digital camera 100a.
[0133] In S807, the control unit 201 determines whether the menu screen currently displayed on the display unit 206 is the menu screen 400a of the digital camera 100a that was reconnected in S804. The control unit 201 obtains the page position of the menu screen indicated by the page mark 410 from the working memory 204 and compares it with the index obtained in S806. Since the page position of the menu screen corresponds to the index, if the two values are the same, the control unit 201 can determine that the menu screen currently displayed on the display unit 206 is the menu screen 400a of the digital camera 100a. On the other hand, if the two values are different, the control unit 201 can determine that the menu screen currently displayed on the display unit 206 is not the menu screen 400a of the digital camera 100a.
[0134] If the control unit 201 determines in S804 that the menu screen displayed on the display unit 206 is the menu screen 400a of the digital camera 100a that was reconnected, it executes S808; otherwise, it terminates the process shown in Figure 9.
[0135] The reason the menu screen 400a of the reconnected digital camera 100a is not displayed on the display unit 206 is, for example, if a wireless LAN connection has already been established between the digital camera 100b and the smartphone 200. In this case, when the digital camera 100a reconnects to the smartphone 200 using S804, the menu screen 400b of the digital camera 100b is displayed on the display unit 206 (Figure 10(a), left side).
[0136] Thus, in this embodiment, even if a connection is established with another device while the menu screen of a device with which a connection has already been established is being displayed, the system does not automatically switch to displaying the menu screen of the other device. Therefore, as shown on the right side of Figure 10(a), the menu screen 400b continues to be displayed.
[0137] In S808, the control unit 201 updates the menu screen 400a displayed on the display unit 206 based on the changes determined in S805. Specifically, when a BLE connection is established, the BLE icon for connection method 405a and the function buttons 406a to 409a are made brighter. After the update, the menu screen 400a is displayed in the form shown in Figure 4(b). However, the number of page marks 410a may vary depending on the number of indexes in the registered camera information.
[0138] Furthermore, when a connection is established between the digital camera 100a and the wireless LAN, the Wi-Fi icon for connection method 405a and the function buttons 406a to 408a are displayed brightly. Conversely, the BLE icon for connection method 405a and the function button 409a are displayed dimly. As a result, the menu screen 400a is displayed in the form shown in Figure 5(a). In this case as well, the number of page marks 410a may vary depending on the number of indexes in the registered camera information.
[0139] The BLE standard has a function that automatically reconnects when a paired device is detected within communication range. Therefore, when a wireless LAN connection is established between the digital camera 100b and the smartphone 200, the digital camera 100a will automatically reconnect when it approaches the smartphone 200. This automatic reconnection process is performed by the control unit 201 regardless of whether the camera communication application is in the foreground or background. Furthermore, the smartphone 200 can establish BLE connections with multiple digital cameras simultaneously. Thus, depending on the communication standard, automatic reconnection may be performed regardless of the user's intentions.
[0140] Therefore, if the menu screen of the last connected device is displayed, for example, an unintended automatic reconnection may cause the menu screen to switch, interrupting operations the user was performing on another device. In this embodiment, if the menu screen of another device is displayed when one device is reconnected, the menu screen is not switched, thereby avoiding the above problem and improving usability. (BLE new connection process) Returning to Figure 9, we will now describe the behavior when the BLE advertised signal does not contain an application ID, i.e., when a new connection is established. In S809, the control unit 201 performs a new BLE connection process with the digital camera 100a via the short-range wireless communication unit 212 and establishes a BLE connection. This new connection process is the same as the process described in T705~713 of Figure 8, so the explanation is omitted.
[0141] In S810, the control unit 201 generates a menu screen for the newly connected digital camera. Based on the camera information registered in T713 in Figure 8, the control unit 201 generates the menu screen shown in Figure 4(b) for the digital camera 100a.
[0142] The control unit 201 reads the name of the digital camera 100a from the camera information stored in the non-volatile memory 203 and sets it as name 404a. The icon 403a representing the appearance of the digital camera 100a can be obtained from icons pre-registered in the camera communication application, according to the model name obtained from the digital camera 100a. It may also be obtained by other methods. Furthermore, for connection method 405a, the control unit 201 sets the BLE icon to be displayed brightly because a BLE connection has been established with S809, and the Wi-Fi icon to be displayed dimly because a wireless LAN connection has not been established.
[0143] Furthermore, since a BLE connection has been established, the control unit 201 is set to display all function buttons 406a to 409a brightly. In addition, the control unit 201 sets the maximum value of the camera information index registered in the non-volatile memory 203 as the number of page marks 410a. Based on these settings, the control unit 201 generates image data for the menu screen 400a.
[0144] In S811, the control unit 201 displays the menu screen 400a generated in S810 on the display unit 206. For example, if the digital camera that established the BLE connection in S809 is the first digital camera registered with the smartphone, the menu screen switches from the menu screen 400 in Figure 4(a) to the menu screen 400a in Figure 4(b).
[0145] Since new connections are not made automatically, it is assumed that the user is making the connection intentionally. Therefore, when a new device is connected, the display will switch to the menu screen for the newly connected device. When menu screen 400a is displayed in S811, the control unit 201 terminates the process shown in the flowchart of Figure 9.
[0146] (Wireless LAN connection) Next, we will explain the operations performed from S812 onwards if S802 does not receive a BLE advertised signal. Digital camera 100b and smartphone 200 are connected to the same wireless LAN network. Smartphone 200 can connect to the wireless LAN network, for example, by operating the settings application provided by its OS. Similarly, digital camera 100b can connect to the wireless LAN network through its menu screen. It is assumed that the necessary connection information, such as the password, is already known.
[0147] In step S812, the control unit 201 searches for the presence of the digital camera 100b on the connected wireless LAN network via the connection unit 208. If the wireless LAN function of the digital camera 100b is enabled, it transmits a wireless LAN advertisement signal from the connection unit 108 (T601 in Figure 7). Therefore, the control unit 201 instructs the connection unit 208 to search for the wireless LAN advertisement signal.
[0148] Note that the process of searching for the digital camera 100b on the wireless LAN network can only be executed when the camera communication application is in the foreground. Therefore, if the camera communication application moves to the background, the search process will stop.
[0149] In S813, the control unit 201 determines whether or not it has received a wireless LAN advertisement signal through the connection unit 208. If the control unit 201 determines that it has received a wireless LAN advertisement signal, it executes S814; otherwise, it executes S801.
[0150] In S814, the control unit 201 checks whether the received wireless LAN advertised signal contains an application ID. If it contains an application ID, the control unit 201 determines it to be a reconnection request and executes S815. If it does not contain an application ID, the control unit 201 determines it to be a new connection request and executes S817.
[0151] (Wireless LAN reconnection) In step S815, the control unit 201 performs the wireless LAN reconnection process with the digital camera 100b. The wireless LAN reconnection process is the same as the process from T610 onwards in Figure 7, so the explanation is omitted.
[0152] Once a wireless LAN connection is established between the digital camera 100b and the smartphone 200 in S815, the control unit 201 executes S816.
[0153] In S816, the control unit 201 determines the update content to reflect the reconnection on the menu screen, similar to S805. At this point, the display is not yet updated. The control unit 201 decides to dim the BLE icon for connection method 405b and brighten the Wi-Fi icon, and to brighten the function buttons 406b to 408b on the menu screen and dim 409b.
[0154] In S817, the control unit 201, similar to S806, identifies the page position of the menu screen 400b of the reconnected digital camera 100b. The page position of the menu screen 400b of the reconnected digital camera 100b matches the index 501 of the camera information of the digital camera 100b stored in the non-volatile memory 203.
[0155] The control unit 201 uses the wireless LAN MAC address of the digital camera 100b included in the wireless LAN advertised signal to obtain the camera information index 501 of the digital camera 100b from the camera information stored in the non-volatile memory 203. For example, if the camera information shown in Figure 5 is registered in the non-volatile memory 203, the camera information index of the digital camera 100b will be "2". Alternatively, the camera information index 501 of the digital camera 100b may be obtained using the name of the digital camera 100b, "Camera B", included in the wireless LAN advertised signal received by S812.
[0156] Subsequently, the control unit 201 generates image data for the menu screen 400b for the reconnected digital camera 100b, reflecting the decisions made in S816 and the index acquired in S817.
[0157] In step S811, the control unit 201 displays the generated menu screen 400b on the display unit 206 and terminates the process shown in the flowchart of Figure 9.
[0158] For example, when the menu screen 400a for digital camera 100a, which is not yet connected, is displayed, the change in the menu display when the wireless LAN connection with digital camera 100b is re-established is shown in Figure 1. 10 As shown in (b), since a connection to the digital camera 100a has not been established, each item on the menu screen 400a is displayed in dim light (Figure 10 (b) Left side). If the wireless LAN connection is re-established with the digital camera 100b in this state, Figure 10 The display switches to menu screen 400b shown on the right side of (b).
[0159] (New wireless LAN connection) Next, we will explain the behavior when the wireless LAN advertisement signal does not contain an application ID, i.e., when a new connection is established. In S818, the control unit 201 performs a new wireless LAN connection process with the digital camera 100a via the connection unit 208 and establishes a wireless LAN connection. This new connection process is the same as the process described in T606~609 of Figure 7, so the explanation is omitted.
[0160] In S819, the control unit 201 generates a menu screen for the newly connected digital camera 100b. Based on the camera information registered in T609 in Figure 7, the control unit 201 generates the menu screen shown in Figure 5(a) for the digital camera 100b.
[0161] The control unit 201 reads the name of the digital camera 100b from the camera information stored in the non-volatile memory 203 and sets it as name 404b. The icon 403b, which represents the appearance of the digital camera 100b, can be obtained from icons registered in the camera communication application in advance, according to the model name obtained from the digital camera 100b. It may also be obtained by other methods. Furthermore, for connection method 405b, the control unit 201 sets the Wi-Fi icon to be displayed brightly because a wireless LAN connection has been established with S818, and the BLE icon to be displayed dimly because a BLE connection has not been established.
[0162] Furthermore, since the BLE connection has not been established, the control unit 201 is set to display function buttons 406b to 408b brightly and 409b dimly. In addition, the control unit 201 sets the maximum value of the camera information index registered in the non-volatile memory 203 as the number of page marks 410b. Based on these settings, the control unit 201 generates image data for the menu screen 400b. In the case of a new connection, the page position of the menu screen will be the last, so it does not need to be specified.
[0163] Subsequently, the control unit 201 executes S811, displays the generated menu screen 400b on the display unit 206, and terminates the process shown in the flowchart of Figure 9.
[0164] In this way, for wireless LAN connections, whether it's a reconnection or a new connection, once the connection is established, a menu screen for the connected device will be displayed. Compared to BLE, Wi-Fi connections consume more power, and are generally only used when a function requiring Wi-Fi communication is in use, so they can be considered user-initiated connections. Therefore, by automatically displaying the menu screen of the connected device when a Wi-Fi connection is established, functions using the connected device can be executed without manually switching menu screens.
[0165] According to this embodiment, in a communication device capable of communicating with an external device using multiple connection methods, when an external device is connected, the device determines whether or not to automatically display a screen for the connected external device depending on the connection method and whether it is a new connection or a reconnection. Specifically, if there is a high probability that the user intentionally connected the external device, the screen for the connected external device is automatically displayed; otherwise, the screen for the connected external device is not automatically displayed. This makes it possible to improve user convenience.
[0166] (Other embodiments) In the above embodiment, if a BLE connection is re-established and a menu screen of a different device is displayed, the menu screen is not switched. However, if communication is not established with the device whose menu screen is displayed, the display may be automatically switched to the menu screen of the device that re-established the BLE connection.
[0167] Furthermore, in the above-described embodiment, the connection between BLE and wireless LAN was explained. However, the connection unit 208 may be a USB interface, and the external device may be connected to the smartphone by a USB cable (referred to as a USB connection). Alternatively, a connection method that utilizes proximity wireless communication (NFC) by the near-field communication unit 212 for wireless LAN connection, also known as tap-to-connect, may be used (referred to as an NFC connection).
[0168] In both cases, the user physically connects or brings close the digital camera and smartphone to establish a connection, and therefore these are considered intentional connections. For this reason, when a USB or NFC connection is established with an external device, the display can automatically switch to the menu screen for the external device.
[0169] Figure 11 summarizes the display control for initial and reconnection for each connection method: BLE, Wi-Fi, USB, and NFC.
[0170] Furthermore, if a wireless LAN connection is established after a USB connection has been established, or if a USB connection is established after a wireless LAN connection has been established, the display will not be switched. Also, in this embodiment, it is assumed that no other devices have established a wireless LAN connection during the wireless LAN connection process. However, if other devices have established a wireless LAN connection, new wireless LAN connection requests may be not accepted. This is because a function that utilizes an already established connection may be running between the external device and the smartphone.
[0171] Furthermore, in this embodiment, the camera communication application has been described as always being in the foreground. However, the camera communication application may be moved to the background. When the camera communication application is in the background, the control unit 201 will not execute the connection process even if it detects a USB connection or NFC connection operation. When the camera communication application returns from the background to the foreground, the control unit 201 can execute or resume the connection process.
[0172] The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.
[0173] This embodiment includes the following communication device, its control method, and program. (Item 1) A communication device capable of communicating with an external device using a first connection method and a second connection method, Display means and When a connection with an external device is established, a control means determines whether or not to automatically display a screen on the display means for using the external device from the communication device, depending on the method of connection with the external device and / or whether the external device is newly connected or reconnected. A communication device characterized by having the following features. (Item 2) The communication device according to item 1, characterized in that the control means decides not to automatically display the screen if the connection method is a first connection method that can establish connections simultaneously with different external devices. (Item 3) The communication device according to item 2, characterized in that the control means decides to automatically display the screen when the connection method is a second connection method that cannot establish a connection with different external devices simultaneously. (Item 4) The communication device according to item 1, characterized in that the control means determines not to automatically display the screen if the connection method is a first connection method that automatically reconnects to another external device while the communication device has established a connection with an external device. (Item 5) The communication device according to any one of items 1 to 4, characterized in that the control means, when a connection with the external device is established, determines to automatically display a screen for using the external device from the communication device if there is no external device that has established a connection with the communication device. (Item 6) The communication device according to item 1, characterized in that the control means does not accept further connection requests by the second connection method if a connection by the second connection method has been established. (Item 7) The communication device according to any one of items 1 to 6, characterized in that the second connection method enables faster communication and consumes more power than the first connection method. (Item 8) A communication device according to any one of items 1 to 7, characterized in that the first connection method is a connection method compliant with the Bluetooth standard, and the second connection method is a connection method compliant with the wireless LAN standard. (Item 9) The communication device according to any one of items 1 to 7, characterized in that the second connection method is a connection method compliant with the USB standard, or a connection method that utilizes proximity wireless communication for a connection compliant with the wireless LAN standard. (Item 10) A control method performed by a communication device capable of communicating with an external device using the first connection method and the second connection method, To detect that a connection with an external device has been established, The display device is configured to automatically display a screen for using the external device on which the connection has been established from the communication device, depending on the method of connection to the external device and / or whether the external device has been newly connected or reconnected. A method for controlling a communication device, characterized by having the following features. (Item 11) A program to cause a computer to function as a control means of a communication device described in any one of items 1 through 9.
[0174] The present invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention. [Explanation of Symbols]
[0175] 100…Digital camera, 200…Smartphone, 101,201…Control unit, 108,208…Connection unit, 112,212…Short-range wireless communication unit
Claims
1. A communication device capable of communicating with an external device using a first connection method and a second connection method, Display means and When a connection with an external device is established, a control means determines whether or not to automatically display a screen on the display means for using the external device from the communication device, depending on the method of connection with the external device and whether the external device is newly connected or reconnected. It has, The control means is If the external device is reconnected and the connection method to the external device is a first connection method that allows establishing connections in parallel with different external devices, it is decided not to automatically display the screen. A communication device characterized in that it decides to automatically display the screen when the external device is reconnected and the method of connection with the external device is a second connection method that does not allow the establishment of a connection with a different external device in parallel.
2. The first connection method is a connection method that automatically performs reconnection, The communication device according to claim 1, characterized in that the control means determines that if another external device reconnects using the first connection method while the communication device has established a connection with an external device, the screen will not be automatically displayed.
3. The communication device according to claim 1, characterized in that when a connection with the external device is established, if there are no other external devices that have established a connection with the communication device, the control means decides to automatically display a screen for using the external device from the communication device, regardless of the method of connection with the external device and whether the external device is newly connected or reconnected.
4. The communication device according to claim 1, characterized in that the control means does not accept further connection requests by the second connection method if there is an external device with which a connection by the second connection method has been established.
5. The communication device according to claim 1, characterized in that the second connection method enables faster communication and consumes more power than the first connection method.
6. The communication device according to claim 1, characterized in that the first connection method is a connection method compliant with the Bluetooth standard, and the second connection method is a connection method compliant with the wireless LAN standard.
7. The communication device according to claim 1, characterized in that the second connection method is a connection method compliant with the USB standard, or a connection method that utilizes proximity wireless communication for a connection compliant with the wireless LAN standard.
8. A control method performed by a communication device capable of communicating with an external device using the first connection method and the second connection method, To detect that a connection with an external device has been established, The display device has a function that determines whether or not to automatically display a screen for using the external device on which the connection has been established from the communication device, depending on the method of connection to the external device and whether the external device has been newly connected or reconnected. The above decision is, If the external device is reconnected and the connection method to the external device is a first connection method that allows for the establishment of connections with different external devices in parallel, it is decided not to automatically display the screen. The system includes determining to automatically display the screen if the external device is reconnected and the method of connection to the external device is a second connection method that does not allow for the establishment of a connection with a different external device in parallel, A method for controlling a communication device, characterized by the features described above.
9. A program for causing a computer to function as a control means of a communication device according to any one of claims 1 to 7.
Citation Information
Patent Citations
System and program for radio connection
JP2018056773A
Wireless communication system and wireless communication terminal control method
JP2020057899A
Communication device, communication method, and communication program
JP2020123841A
Communication device and computer program therefor
JP2021057760A