Communication system, communication devices and associated control procedures

The described communication system optimizes energy use by controlling Bluetooth connections in devices like digital cameras and smartphones through display packets, ensuring connections are made only when user-intended operations are performed, thereby reducing unintended activation and energy waste.

DE102018132407B4Active Publication Date: 2025-12-18CANON KK
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
DE102018132407
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2017-12-19
Filing Date
2018-12-17
Publication Date
2025-12-18
Estimated Expiration
2038-12-17

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Communication system with a first communication device (100) and a second communication device (200), wherein the first communication device comprises (100) a device (112) for sending an initial notification for connection processing during short-range wireless communication while operating in a first power mode, and a device (112) for sending a second notification containing restriction information for performing link processing at a time that is restricted compared to the first notification, for link processing in short-range wireless communication during operation in a second power mode in which power is saved more than in the first power mode, and a device (101) for performing a transition of a power mode from the second power mode to the first power mode when a connection request is received in response to the second notification, and the second communication device (200) comprises a receiving device (209) for receiving either the first notification or the second notification sent by the first communication device, and a device (201) for starting connection processing at any time when the first notification is received, and, when the second notification is received, for starting connection processing at a time that is restricted compared to the case when the first notification is received, and a device (201) for displaying a device currently connected by short-range wireless communication and a device for transmitting the notification containing the restriction information to a display unit (206) as currently connected devices.
Need to check novelty before this filing date? Find Prior Art

Description

BACKGROUND OF THE INVENTION Area of ​​the invention

[0001] The present invention relates to a communication system, communication devices and associated control methods. Description of the related technique

[0002] Recently, a method has been developed for establishing wireless communication between a digital camera and a smartphone, allowing the digital camera to be operated from the smartphone. There is also a method where the digital camera, when in sleep mode to conserve power, receives a wireless signal from the smartphone to wake it from sleep mode. This method utilizes a short-range wireless communication technology such as Bluetooth. ® , which has a lower power consumption than wireless LAN, is gaining attention.

[0003] The use of energy-efficient, short-range wireless communication (such as a Bluetooth connection) allows, for example, a digital camera to maintain a Bluetooth connection with a smartphone even in sleep mode, which requires minimal power. The user can therefore remotely control the digital camera at any time, even while it is in sleep mode, using their smartphone, and can also wake the camera from sleep mode. Remote control of the digital camera via smartphone allows, for example, remotely initiating a shooting process and browsing images on the digital camera's screen.

[0004] Although power consumption is lower than with wireless LAN communication, power is always consumed in sleep mode when Bluetooth communication is performed while the digital camera is in sleep mode. To solve this problem, Japanese patent application JP 2017-144627 A proposes a method for reducing power consumption by using a device with a plurality of sleep modes to control a display packet transmission interval according to the sleep mode.

[0005] However, in the arrangement described in Japanese patent publication JP 2017-144627 A, a communication link is automatically established upon response to a display packet. Consequently, a disadvantage can arise in that the device is activated at a time unintended by the user. Furthermore, the arrangement suffers from the problem that activation at an unintended time results in energy waste.

[0006] US 2015 / 0173018A1 discloses an environmental information meter that changes the type of advertisement to type "ADV_IND" or type "ADV_NON-CONN_IND" based on a determination of whether a transmission condition is met, where the transmission condition specifies whether data transmission is required. The environmental information meter then transmits the advertisement of the changed type to a communication terminal. The communication terminal controls the connection to the environmental information meter based on the type of advertisement received. The environmental information meter does not transmit data such as temperature, relative humidity, and a WBGT value to the communication terminal unless the environmental information meter receives a connection request signal from the communication terminal. SUMMARY OF THE INVENTION

[0007] One embodiment of the present invention provides a method for more suitable control of the establishment of a short-range wireless connection.

[0008] According to the invention, a communication system, communication devices and associated control methods as defined in the accompanying patent claims are provided.

[0009] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 shows a block diagram of the arrangement of a digital camera according to the first embodiment, Fig. Figure 2 shows a block diagram of the arrangement of a smartphone according to the first embodiment, Fig. Figure 3 shows an example of the arrangement of a communication system according to the first embodiment. Fig. Figure 4 shows an illustration of examples of a display package of the digital camera according to the first embodiment, Fig. Figure 5 shows a representation of a sequence according to the first embodiment when the digital camera returns from sleep mode and then enters sleep mode, and the smartphone is operated in sleep mode. Fig. Figure 6A shows a flowchart of a procedure according to the first embodiment when the digital camera returns from sleep mode. Fig. Figure 6B shows a flowchart of a procedure according to the first embodiment when the digital camera enters the sleep state. Fig. 7A shows a flowchart of the procedure for display processing and processing according to user operation on the smartphone according to the first embodiment, Fig. 7B shows a flowchart of the procedure for processing according to the first embodiment when a function is started on the smartphone, the Fig. 8A and Fig. Figures 8B each show an example of a menu display on a smartphone according to the first embodiment. Fig. Figure 9 shows an example of the network arrangement of digital cameras and a smartphone according to the second embodiment. Fig. Figure 10 shows an illustration of an example of a display package of the digital camera according to the second embodiment, Fig. 11A shows a flowchart of the procedure for display processing and processing according to user operation on the smartphone according to the second embodiment. Fig. Figure 11B shows a flowchart of the display processing procedure and the processing according to user operation on the smartphone according to the second embodiment. Fig. 11C shows a flowchart of the procedure of a processing according to the second embodiment when a function is started on the smartphone, Fig. Figure 11D shows a table of an example of a setup list according to the second embodiment, which is stored in the smartphone. Fig. Figure 12 shows an example of a display list of cameras on the smartphone according to the second embodiment. Fig. Figure 13 shows an illustration of examples of a display package of a digital camera according to the third embodiment, Fig. Figure 14 shows a flowchart of a procedure according to the third embodiment when the digital camera enters the sleep state. Fig. 15A shows a flowchart of the procedure for display processing and processing according to user operation on a smartphone according to the third embodiment, Fig. Figure 15B shows a flowchart of the procedure of a processing according to the third embodiment when a function is started on the smartphone, and Fig. Figure 16 shows an illustration of an example of a warning message displayed on the smartphone according to the third embodiment. DESCRIPTION OF THE EXAMPLES OF EXECUTION

[0010] An embodiment of the present invention is described in more detail below with reference to the accompanying drawings. It should be noted that the following embodiments are merely examples of implementation means of the present invention and can be suitably modified or changed depending on the various conditions and arrangements of devices in which the present invention is applied. The embodiments can also be suitably combined. [First embodiment]<Anordnung der Digitalkamera 100>

[0011] Fig. Figure 1 shows a block diagram of an example of the arrangement of the digital camera 100 as an example of the first communication device according to the first embodiment. It is noted that an image recording device (digital camera) is described as an example of the first communication device. However, the communication device is not limited to this. The first communication device can, for example, be an information processing device such as a portable media player, a so-called tablet device, or a personal computer.

[0012] For example, a control unit 101 contains a CPU and controls the individual units of the digital camera 100 according to an input signal and a program (described below). The control unit 101 controls the entire device by executing a program stored in non-volatile memory 103. It is noted that instead of the control unit 101 controlling the entire device, a plurality of hardware components can control the entire device through distributed processing.

[0013] An image acquisition unit 102 comprises, for example, an optical unit, an optical system for controlling stopping, zooming, focusing, and the like, and an image sensor for converting light (video) incident through the optical unit into an electrical video signal. A CMOS (complementary metal oxide semiconductor) or CCD (charge-coupling device) is generally used as the image sensor. Under the control of the control unit 101, the image acquisition unit 102 causes the image sensor to convert object light imaged by a lens in the image acquisition unit 102 into an electrical signal, perform noise reduction processing, and the like, and output digital data as image data. The digital camera 100 according to this embodiment records the image data on a recording medium 110 according to the DCF (Design Rule for Camera File System) standard.

[0014] The non-volatile memory 103 is an electrically erasable and writable non-volatile memory and stores programs which, when executed by the control unit 101, implement respective processes (described below). A working memory 104 is used as a buffer memory for temporarily storing image data acquired by the image acquisition unit 102, as image display memory for a display unit 106, as a working area for the control unit 101, and for the like.

[0015] An operating unit 105 is used to receive instructions from the user for the digital camera 100. The operating unit 105 includes, for example, a power switch used by the user to instruct the digital camera 100 to be switched ON / OFF, a shutter release used to instruct a recording, a motion capture switch used to instruct motion capture, and a playback button used to instruct image data playback. The operating unit 105 includes a control element, such as a dedicated connect button, used to initiate communication with an external device via a communication unit 111 (described below). The operating unit 105 also includes an interactive control panel formed on the display unit 106 (described below).It is noted that half-pressing the shutter release activates the first switch, and fully pressing the shutter release activates the second switch. When the first switch is activated, the Control Unit 101 begins preparing for shooting, including AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, EF (pre-flash) processing, and the like. When the second switch is activated, the Control Unit 101 takes the photograph.

[0016] The display unit 106 shows a viewfinder image at the time of recording, recorded image data, symbols for interactive controls, and the like. It should be noted that the display unit 106 need not always be included in the digital camera 100. The digital camera 100 can be connected to the internal or an external display unit 106 and only needs to have at least one display control function for controlling the display of the display unit 106. The recording medium 110 can record image data output from the image acquisition unit 102. The recording medium 110 can be detachable from the digital camera 100 or it can be included in the digital camera 100. That is to say, the digital camera 100 only needs to have at least one means of accessing the recording medium 110.

[0017] The communication unit 111 serves as an interface for establishing a connection with an external device. The digital camera 100 can exchange data with the external device via the communication unit 111. For example, the digital camera 100 can send image data generated by the image acquisition unit 102 to the external device via the communication unit 111. It should be noted that in this embodiment, the communication unit 111 includes an interface for communicating with the external device via a so-called wireless LAN, which conforms to the IEEE 802.11 standard. The control unit 101 implements wireless communication with the external device by controlling the communication unit 111. The communication method of the communication unit 111 is not limited to the wireless LAN, and, for example, an infrared communication method or the like can be used.A short-range wireless communication unit 112 performs short-range wireless communication with the external device. In this example, a Bluetooth® wireless unit is used as the short-range wireless communication unit 112 to perform Bluetooth communication. The short-range wireless communication unit 112 performs Bluetooth communication with the smartphone 200 (which is described below). It should be noted that this embodiment describes an example of the use of BLE (Bluetooth Low Energy) among the Bluetooth communication standards. Even if, for example, the control unit 101 of the digital camera 100 is not powered, the communication unit 112 can operate if it is powered independently of the control unit 101.However, if the communication unit 111 does not cooperate with the control unit 101, the possible communication is limited. According to this embodiment, the communication unit 111 can generate a display signal even if at least the control unit 101 is inactive.

[0018] The digital camera 100 with the aforementioned arrangement can operate in a variety of power modes, including the first and second power modes. The second power mode saves more energy than the first. For example, when the control unit 105 is used to turn on the power switch, the digital camera 100 operates in a normal state as the first power mode. When the power switch is turned off, the digital camera 100 enters a sleep state as the second power mode. If the power switch is turned off while the camera is in sleep mode, the digital camera 100 returns from sleep to normal mode when the power switch on the control unit 105 is turned on.The Digital Camera 100 features an auto-off function that automatically cuts off the power supply to conserve energy and enters sleep mode if the Digital Camera 100 is left in a non-operated state with the power switch on for a predetermined period. If the Digital Camera 100 is in sleep mode (hereinafter also referred to as the auto-off state) due to the auto-off function, it returns to normal operation by pressing the shutter release or the playback button on the control unit 105.

[0019] In sleep mode, the digital camera 100 establishes a Bluetooth connection with the smartphone 200 upon receiving a request from the smartphone 200, thereby waking it from sleep mode. For example, if the digital camera 100 is fixed in place with a tripod or similar device for remote control recording, it will enter sleep mode (auto-shutdown mode) if left unattended with the power switch on. At this point, the user can activate the smartphone 200 at any time to wake the digital camera 100 from sleep mode, causing it to take a picture. If the digital camera 100 is left unattended after the recording is complete, it will automatically switch off again and enter sleep mode.If the user does not take a picture, the Digital Camera 100 is therefore in sleep mode, thus preventing unnecessary power consumption by the Digital Camera 100. <Anordnung des Smartphones 200>

[0020] Fig. Figure 2 shows a block diagram of an example of the arrangement of the smartphone 200 as an example of the second communication device according to the first embodiment. It is noted that the smartphone is described as an example of the information processing device, but the information processing device is not limited to it. The second communication device could, for example, be a digital camera, a tablet device, or a personal computer, for example, with a wireless function.

[0021] A control unit 201, for example, comprises a CPU and controls the individual units of the smartphone 200 according to an input signal and a program (described below). The control unit 201 controls the entire device by executing a program stored in non-volatile memory 203. It is noted that instead of the control unit 201 controlling the entire device, a plurality of hardware components can control the entire device by distributing the processing. An image acquisition unit 202 converts object light, imaged by a lens contained in the image acquisition unit 202, into an electrical signal, performs noise reduction processing and the like, and outputs digital data as image data.The recorded image data is accumulated in a buffer memory, is subjected to a predetermined calculation by the control unit 201, and is then recorded on the recording medium 207.

[0022] The non-volatile memory 203 is an electrically erasable and writable non-volatile memory. The non-volatile memory 203 stores an operating system (OS) as basic software executed by the control unit 201 and an application for implementing a practical function in cooperation with the OS. In this embodiment, the non-volatile memory 203 stores an application for performing remote control by communicating with the digital camera 100. A working memory 204 is used as image display memory for a display unit 206, a working area for the control unit 201, and the like. An operating unit 205 is used to receive instructions from the user for the smartphone 200. The operating unit 205 includes, for example, controls such as a power switch used by the user to instruct the smartphone 200 to be switched ON / OFF, and an interactive control panel formed on the display unit 206.

[0023] The display unit 206 shows image data, characters for interactive operation, and the like. It should be noted that the display unit 206 does not always have to be contained within the smartphone 200. The smartphone 200 can be connected to the display unit 206 and only needs to have at least one display control function for controlling a display on the display unit 206. A recording medium 207 can record image data output from the image capture unit 202. The recording medium 207 can be detachable from the smartphone 200 or it can be contained within the smartphone 200. That is, the smartphone 200 only needs to have at least one means of accessing the recording medium 207.

[0024] A communication unit 208 serves as an interface for establishing a connection with an external device. The smartphone 200 can exchange data with the digital camera 100 via the communication unit 208. The communication unit 208 contains an antenna, and the control unit 201 can establish a wireless connection with the digital camera 100 via the communication unit 208. It is noted that the connection to the digital camera 100 via the communication unit 208 can be a direct connection or a connection via an access point. For example, PTP / IP (Picture Transfer Protocol over Internet Protocol) can be used as the protocol for data communication over a wireless LAN. It is noted that the communication between the communication unit 208 and the digital camera 100 is not limited to this.The communication unit 208 can, for example, contain an infrared communication module, a wireless communication module such as wireless USB, or a wired connection such as a USB cable or HDMI. ® or IEEE 1394 can be used.

[0025] A short-range wireless communication unit 209, for example, is a Bluetooth wireless unit for performing Bluetooth communication. Bluetooth communication with the digital camera 100 is carried out via the short-range wireless communication unit 209. A public network communication unit 211 serves as an interface used to perform public wireless communication. The smartphone 200 can perform voice communication with another device via the public network communication unit 211. At this point, the control unit 201 implements voice communication by inputting and outputting voice signals via a microphone 212 and a loudspeaker 213.In this embodiment, the public network communication unit 211 includes an antenna, and the control unit 201 can establish a wireless connection to a public network via the public network communication unit 211. It is noted that the communication unit 208 and the public network communication unit 211 can share an antenna.

[0026] The user can remotely control the Digital Camera 100 via the remote control application running on the Smartphone 200. The application's menu screen features a control UI (sometimes referred to below as the function key) for remotely controlling the Digital Camera 100. The user can remotely control the Digital Camera 100 using this control UI. By selecting the desired function by pressing the function key, the user can, for example, browse images recorded on the Digital Camera 100's recording medium 110 on the Smartphone 200, or remotely take photos using the Digital Camera 100 on the Smartphone 200. <Anordnung des Kommunikationssystems>

[0027] Fig. Figure 3 shows a schematic representation of an example of a communication system according to the first embodiment. In the communication system according to the first embodiment, the digital camera 100 and the smartphone 200 perform Bluetooth communication. As shown in Fig. As shown in Figure 3, the communication system is formed by the digital camera 100 and the smartphone 200, and they can communicate with each other via short-range wireless communication using the Bluetooth method. <Beispiel eines Anzeigepakets>

[0028] Fig. Figure 4 shows examples of a display package used by the digital camera 100 according to the first embodiment. The display package is a message for connection processing in short-range wireless communication. The display package comprises a variety of AD structures. Restriction information, which specifies the time of a Bluetooth connection, is described in one of the AD structures. The digital camera 100 changes the information (the value) according to its own power state (normal state or sleep state). The "AD Type" of the AD structure describes a code that specifies a description of restriction information.

[0029] When the power switch of the Digital Camera 100 is turned on and the Digital Camera 100 is not in sleep mode, the Digital Camera 100 uses display data 1 as a display packet during Bluetooth communication. Upon receiving display data 1 from the Digital Camera 100, the Smartphone 200 recognizes that a Bluetooth connection to the Digital Camera 100 is not restricted. In this case, the Smartphone 200 sends a Bluetooth connection request to the Digital Camera 100. This allows the Digital Camera 100 to establish a Bluetooth connection with the Smartphone 200, provided the Digital Camera 100 is not in sleep mode.

[0030] If, on the other hand, the digital camera 100 is in sleep mode, it uses display data 2 as a display packet during Bluetooth communication. Upon receiving display data 2, the smartphone 200 recognizes that the timing of a Bluetooth connection with the digital camera 100 should be restricted. Therefore, the smartphone 200 does not send a Bluetooth connection request to the digital camera 100 in response to receiving display data 2. In this case, a Bluetooth connection request is initiated by waiting for a predetermined action from the user. Thus, if the digital camera 100 is in sleep mode, an unnecessary Bluetooth connection with the smartphone 200 at a time unattended by the user is prevented.

[0031] When the user performs a predefined operation on the smartphone 200, the smartphone 200 sends a Bluetooth connection request to the digital camera 100. Therefore, even if the digital camera 100 is in sleep mode, a Bluetooth connection can be established when a predefined operation is performed on the smartphone 200. In this embodiment, each display packet contains a string that specifies a setup name as the name of the digital camera 100. The setup name is displayed on the display unit 206 of the smartphone 200, which receives the display packet. This allows the user to identify the digital camera that can be remotely controlled by the smartphone 200. <Sequenz hinsichtlich Übergang in den Sleep-Zustand und Rückkehr aus dem Sleep-Zustand der Digitalkamera 100>

[0032] With reference to Fig. Section 5 describes a sequence in which the digital camera 100 returns from sleep mode and then enters sleep mode, and the smartphone 200 is operated while the digital camera 100 is in sleep mode. Upon returning from sleep mode, the digital camera 100 connects to the smartphone 200 via Bluetooth. Upon entering sleep mode, the digital camera 100 disconnects the Bluetooth connection from the smartphone 200. If the user performs a predefined operation on the smartphone 200 while the digital camera 100 is in sleep mode, the digital camera 100 returns from sleep mode and connects to the smartphone 200 via Bluetooth.

[0033] At this point, it is assumed that the digital camera 100 and the smartphone 200 have been paired to establish Bluetooth communication. It is noted that pairing indicates a state in which the devices recognize each other as communication partners and register information about one another. The smartphone 200 sends a Bluetooth connection request only in response to the display packet from the paired digital camera 100. Even if the digital camera 100 receives a connection request from a device other than the paired smartphone 200, it does not establish a Bluetooth connection.

[0034] In step S501, the digital camera 100 returns from sleep mode to auto-off mode in response to the operation of a specific control element (for example, the shutter release or playback button) of the control unit 105. After returning from sleep mode, in step S502, the digital camera 100 sends a display packet as the first message for connection processing in short-range wireless communication. At this time, the display packet represents the Fig. The 4 displayed display data 1 indicates that the Bluetooth connection is not restricted.

[0035] Upon receiving the display packet, the smartphone 200 confirms its contents in step S503 and determines whether the Bluetooth connection is restricted. Since the display data contains information indicating that the Bluetooth connection is not restricted, the smartphone 200 determines that the Bluetooth connection with the digital camera 100 is not restricted. Therefore, in step S504, the smartphone 200 sends a Bluetooth connection request to the digital camera 100. Upon receiving the Bluetooth connection request from the smartphone 200, the digital camera 100 establishes a Bluetooth connection. In step S505, the digital camera 100 and the smartphone 200 are connected via Bluetooth.

[0036] If the digital camera 100 is left in a non-operated state, the auto-off function activates, and the digital camera 100 enters sleep mode in step S506 by automatically switching off the power supply. At this point, in step S507, the digital camera 100 disconnects the Bluetooth connection and, in step S508, sends a display packet as a second message for connection processing during short-range wireless communication. The display packet sent at this time represents the display data 2 of Fig. 4. The information contains data indicating that the Bluetooth connection is restricted. Display data 2 is an example of the second message, which contains restriction information for performing connection processing during short-range wireless communication at a more limited time compared to display data 1 (the first message). This prevents the digital camera 100 from being activated for a connection.

[0037] Upon receiving the display data 2 in step S502, the smartphone 200 confirms the contents of the display data 2 and determines whether a Bluetooth connection is restricted. Since the display data 2 contains information indicating that the Bluetooth connection is restricted, the smartphone 200 determines that the Bluetooth connection with the digital camera 100 is restricted and does not send a Bluetooth connection request.

[0038] In step S510, the smartphone 200 detects that a predetermined operation has been performed on the control unit 205. The predetermined operation is an operation for remotely controlling the digital camera 100. For example, the predetermined operation is an operation for the smartphone 200 to browse recorded images stored on the recording medium 110 of the digital camera 100, or to perform a remote shooting operation using the digital camera 100 on the smartphone 200. Upon detecting that the predetermined operation is being performed, the smartphone 200 sends a Bluetooth connection request to the digital camera 100 in step S511. Since it is obvious in this case that the user will use the digital camera 100, the fact that the digital camera 100 is activated as a result of sending a Bluetooth connection request does not contradict the user's intention.Upon receiving the Bluetooth connection request from the smartphone 200, the digital camera 100 returns from sleep mode in step S512. In step S513, the digital camera 100 and the smartphone 200 are connected via Bluetooth.

[0039] When the digital camera 100 is in sleep mode, no Bluetooth connection is established immediately, even if the smartphone 200 receives a display packet, as described above. However, when the smartphone 200 performs a predetermined operation, it establishes a Bluetooth connection with the digital camera 100. Therefore, when the digital camera 100 is in sleep mode, the smartphone 200 can establish a Bluetooth connection with the digital camera 100 according to an operation, although the smartphone 200 does not maintain the Bluetooth connection. This can cause the digital camera 100 to return from sleep mode. According to this embodiment, by establishing a Bluetooth connection only when the user deems it necessary, wasteful power consumption is prevented.

[0040] It is noted that the behavior upon returning from sleep mode (auto-off mode) with the power switch on and re-entering sleep mode (auto-off mode) has been described. Even if the digital camera returns from sleep mode by switching on the power switch while it is off, and enters sleep mode by switching the power switch off again, the same procedure for establishing Bluetooth communication is performed. The short-range wireless communication unit 112 transmits display data 1 during a first period and transmits display data 2 during a second period. The first and second periods can be the same; however, for power-saving reasons, the second period is preferably longer than the first. <Betrieb des Rückkehrens aus dem Sleep-Zustand durch die Digitalkamera 100>

[0041] Fig. Figure 6A shows a flowchart of the processing of a return from sleep mode by the digital camera 100. If the digital camera 100 enters sleep mode while its power switch is ON (in the auto-off state), it returns from sleep mode upon operation of the shutter release or playback button on the control unit 105. If the digital camera 100 was put into sleep mode by switching off its power switch, it returns from sleep mode when the power switch on the control unit 105 is switched on.

[0042] When the digital camera 100 returns from sleep mode, the control unit 101 confirms in step S601 whether the digital camera 100 is paired with the smartphone 200. If it is determined that the digital camera 100 is paired with the smartphone 200 (YES in step S601), the control unit 101 confirms in step S602 whether the digital camera 100 returns from sleep mode via a Bluetooth connection request from the smartphone 200. That is, it determines whether the reason for returning from sleep mode is a Bluetooth connection request from the smartphone 200. If the control unit 101 confirms that the digital camera 100 returns from sleep mode via the Bluetooth connection request from the smartphone 200 (YES in step S602), the control unit 101 performs Bluetooth connection processing with the smartphone 200 in step S603.The processing of the return from sleep state via the Bluetooth connection request from the smartphone 200 corresponds to steps S511, S512 and S513 of . Fig. 5.

[0043] If, on the other hand, the control unit 101 determines that the digital camera 100 is returning from sleep mode for a reason other than the Bluetooth connection request from the smartphone 200 (NO in step S602), the process proceeds to step S604. In step S604, the control unit 101 stops sending display data 2, which contains the information indicating that a Bluetooth connection is restricted. In step S605, the control unit 101 sends display data 1, which contains the information indicating that a Bluetooth connection is not restricted. The processing in which the digital camera 100 returns from sleep mode for a reason other than the Bluetooth connection request from the smartphone 200 corresponds to steps S501 and S502 of Fig. 5.

[0044] If the control unit 101 determines in step S601 that the digital camera 100 is not paired with the smartphone 200, the process terminates immediately. Since the control unit 101 does not establish a Bluetooth connection with the smartphone 200 in this case, no display packet is output in sleep mode, and therefore nothing happens even after the unit returns from sleep mode. <Betrieb des Übergangs in den Sleep-Zustand durch die Digitalkamera>

[0045] Fig. Figure 6B shows a flowchart of an operation in which the digital camera 100 enters sleep mode. There are two cases in which the digital camera 100 enters sleep mode. One case is when the digital camera 100 enters sleep mode due to the automatic power-off function (automatic shutdown of the power supply) when the digital camera 100 is left in the non-operated state with the power switch on. The other case is when the digital camera 100 enters sleep mode by switching off the power switch of the control unit 105. In both cases, the Fig. The processing shown in 6B is enabled to perform a transition to the sleep state.

[0046] When the digital camera 100 enters sleep mode, the control unit 101 confirms in step S611 whether the remaining battery charge is greater than a predetermined amount. If the control unit 101 determines that the remaining battery charge is greater than the predetermined amount (YES in step S611), the control unit 101 confirms in step S612 whether the digital camera 100 is paired with the smartphone 200 via Bluetooth. If the control unit 101 determines that the digital camera 100 is paired with the smartphone 200 via Bluetooth (YES in step S612), the control unit 101 confirms in step S613 whether the digital camera 100 is in a Bluetooth connection state with respect to the smartphone 200.

[0047] When the control unit 101 determines that the digital camera 100 is in the Bluetooth connection state (YES in step S613), the control unit 101 disconnects the Bluetooth connection in step S614. In step S615, the control unit 101 sends the display data 2. The processing in which the digital camera 100 disconnects the Bluetooth connection in the Bluetooth connection state with respect to the smartphone 200 and sends the display data 2 to the smartphone 200 to enter sleep mode corresponds to steps S506, S507, and S508 of Fig. 5.

[0048] If, in step S613, control unit 101 determines that digital camera 100 is not in the Bluetooth connection state, control unit 101 stops sending display data 1 in step S616, which contains information indicating that a Bluetooth connection is not restricted. In step S615, control unit 101 sends display data 2, which contains information indicating that a Bluetooth connection is restricted. The state in which digital camera 100 is paired with smartphone 200 (YES in step S612) and is not in the Bluetooth connection state (NO in step S613) includes, for example, the following cases.That is, there is a case where the power of the smartphone 200 is switched off, a case where the Bluetooth function of the smartphone 200 is inactive, and a case where no Bluetooth communication can be carried out because the digital camera 100 and the smartphone 200 are far apart.

[0049] If step S612 confirms that the digital camera 100 is not paired with the smartphone 200, the digital camera 100 will not establish a Bluetooth connection with the smartphone 200, and thus the process ends. Fig. 6B shows the processing directly.

[0050] If, in step S611, the control unit 101 determines that the remaining battery charge is less than or equal to the predetermined amount, it confirms in step S618 whether the digital camera 100 is in a Bluetooth connection state with respect to the smartphone 200. If the control unit 101 determines that the digital camera 100 is in a Bluetooth connection state (YES in step S618), it disconnects the Bluetooth connection in step S619. In step S620, the control unit 101 stops sending the display packet. Conversely, if the control unit 101 determines in step S618 that the digital camera 100 is not in a Bluetooth connection state with respect to the smartphone 200, it stops sending the display packet in step S620.

[0051] If the remaining battery charge is less than or equal to the predetermined amount, the digital camera 100 cannot perform a shooting operation, even if the control unit 105 is operated, and cannot display any captured image data on the display unit 106. Therefore, even if the smartphone 200 is used to wake the digital camera 100 from sleep mode, nothing can be done, resulting in wasteful power consumption. If the remaining battery charge is less than or equal to the predetermined amount, the digital camera 100 does not perform Bluetooth communication with the smartphone 200 while in sleep mode, as described above. <Ablaufdiagramm bei Start einer Menüanzeige und Funktion des Smartphones>

[0052] With reference to the in the Fig. 7A and Fig. The flowcharts shown in 7B next describe the processing by the smartphone 200.

[0053] Fig. Figure 7A shows a flowchart of the processing of a main screen display by an application running on the Smartphone 200 and the processing according to user operation. It is noted that below is an example of a main screen display with reference to the Fig. 8A and Fig. 8B is described. When an application for communication with the digital camera is activated according to an operation for the control unit 205 on the smartphone 200, the control unit 201 starts the operation described in Fig. Processing shown in 7A.

[0054] In step S701, the control unit 201 initializes the main screen displayed on the display unit 206. Specifically, the control unit 201 displays function keys in an inactive state and shows "no camera" in a display area intended to show the name of a usable camera. In step S702, the control unit 201 confirms whether the smartphone 200 and the digital camera 100 are in Bluetooth connection mode. If the control unit 201 determines that the smartphone 200 and the digital camera 100 are not connected via Bluetooth (NO in step S702), the process proceeds to step S703; otherwise (YES in step S702), the process proceeds to step S710.

[0055] In step S703, the control unit 201 confirms whether the display packet originating from the digital camera 100 has been received. If the control unit 201 determines that the display packet has been received (YES in step S703), the process proceeds to step S704; otherwise (NO in step S703), the process proceeds to step S714.

[0056] In step S704, the control unit 201 confirms whether the transmitting source of the display signal, i.e., the detected digital camera 100, is paired. If the control unit 201 determines that the digital camera 100 is paired (YES in step S704), the process proceeds to step S705; otherwise (NO in step S704), the process proceeds to step S714. In this embodiment, the control unit 201 confirms whether the smartphone 200 is paired with the digital camera 100 by determining whether a BLE encryption code, which was shared with the digital camera 100 as a common encryption code at the time of pairing, is stored. A method for determining whether pairing has occurred is not limited to this.

[0057] In step S705, the control unit 201 stores the setup name contained in the display packet received as information from the connected camera. Next, in step S706, the control unit 201 confirms the contents of the received display packet (in this example, whether the received display packet represents display data 1 or 2). If the control unit 201 determines that the display packet represents display data 1, the process proceeds to step S707. If the control unit 201 determines that the display packet represents display data 2, the process proceeds to step S710.

[0058] In step S707, the control unit 201 sends a Bluetooth connection request to the digital camera 100. This processing corresponds to step S504 of Fig. 5. Next, in step S708, the control unit 201 displays "no camera" as the name of a usable digital camera on the main screen of the display unit 206. In step S709, the control unit 201 displays the function keys of the main screen in an inactive state.

[0059] As described above, the smartphone 200 receives a short-range wireless communication (BLE) notification (display packet) sent by the digital camera 100 as an external communication device. The smartphone 200 determines whether the received notification represents display data 2 with the restriction information indicating that the timing of connection processing is restricted in short-range wireless communication, or display data 1 without restriction information (step S703). If display data 1 is received without restriction information, the smartphone 200 sends a connection request for connection processing at the earliest possible time (in this example, immediately after receiving display data 1) and performs the connection processing (step S707).

[0060] On the other hand, in step S710, the control unit 201 confirms the stored facility name and displays it on the display unit 206. The digital camera information used in step S710 is stored in step S705 before the control unit 201 establishes a Bluetooth connection between the digital camera 100 and the smartphone 200. When the display data 2 (the message with the restriction information) is received, the smartphone 200, even if it is in a state where short-range wireless communication is disconnected, is treated as if it were a currently connected external device and displayed accordingly.

[0061] In step S711, the control unit 201 displays the function keys on the display unit 206 in an active state. In step S712, the control unit 201 confirms whether an operation for the function key is detected. If the control unit 201 detects the operation for the function key, it performs processing at the time of the function key operation in step S713. Details of the processing at the time of the function key operation are described below with reference to Fig. 7B described. If, on the other hand, the control unit 201 determines in step S712 that no operation for the function key is detected, the process proceeds to step S714.

[0062] In step S714, the control unit confirms whether the main screen display should be terminated. If the operating unit 205 of the smartphone 200 accepts an application termination request or starts the remote control function during processing in step S713, the control unit 201 determines whether the main screen display should be terminated. If the control unit 201 determines whether the main screen should be terminated, the process ends in Fig. 7A processing shown; otherwise the process returns to step S702, and the control unit 201 repeats the processing described above.

[0063] The processing (the processing in step S713) performed by control unit 201 upon detection of the operation for the function key is next described with reference to Fig. 7B described. Fig. Figure 7B shows a flowchart of a processing operation that is carried out when the control unit 201 of the smartphone 200 detects the operation for the function key.

[0064] In step S721, the control unit 201 confirms whether the smartphone 200 and the digital camera 100 are in a Bluetooth connection state. If the control unit 201 determines that the smartphone 200 and the digital camera 100 are not in a Bluetooth connection state (NO in step S721), the process proceeds to step S722; otherwise (YES in step S721), the process proceeds to step S724.

[0065] In step S722, the control unit 201 sends a Bluetooth connection request to the digital camera 100. This processing corresponds to step S511 of Fig. 5. In step S723, the control unit 201 waits until a Bluetooth connection is established between the digital camera 100 and the smartphone 200. After the control unit 201 sends the Bluetooth connection request in step S722, the digital camera 100 performs Bluetooth connection processing (step S513 of Fig. 5 corresponds) thereby establishing a Bluetooth connection. When the display data 2 with the restriction information is received, the smartphone 200 performs connection processing at a time (in this example, when responding to the user's operation of the smartphone 200's function key) that is restricted compared to a case where the display data 1 is received.

[0066] It is noted that, as with reference to Fig. As described in section 5, in the state where the digital camera 100 generates the display data 2 (i.e., in the sleep state), the Bluetooth connection is initiated in response to the Bluetooth connection request from the smartphone 200, thereby establishing a connection. During a time interval between the Bluetooth connection request (step S511) from the smartphone 200 and the establishment of a Bluetooth connection, the digital camera 100 returns from the sleep state (step S512) and performs Bluetooth connection processing (step S513). Since the time required to perform these processes can be used, the control unit 201 can display a message or icon on the display unit 206 indicating a ready state while the control unit 201 waits in step S723 for the Bluetooth connection state to occur. This can reduce user concern if the Bluetooth connection processing takes some time.

[0067] When the digital camera 100 and the smartphone 200 are in Bluetooth pairing mode, the control unit 201 starts the remote control function corresponding to the pressed function button in step S724. For example, if the button for browsing captured images is pressed, the control unit 201 requests the digital camera 100 to send images and displays the received images on the display unit 206. The processing performed by the control unit 201 when the operation for the function button is detected has been described. <Beispiel einer Anzeige eines Menübildschirms des Smartphones>

[0068] The Fig. 8A and Fig. Figure 8B shows an example of the menu screen displayed by the control unit 201 on the display unit 206 when the application is running on the smartphone 200 as described above. Function keys 802 and 803 are provided as operating elements for a remote control. Fig. Figure 8A shows an example of the menu screen when function keys 802 and 803 are displayed in the inactive state on the Smartphone 200. Fig. Figure 8B, on the other hand, shows an example of the menu screen when function keys 802 and 803 are displayed in the active state.

[0069] According to the Fig. 8A and Fig. 8B uses a setup name display area 801 to display the setup name of a remote digital camera. In steps S701, S708, and S710 of Fig. 7A updates the control unit 201 in the display in the facility name display area 801. In a state where the digital camera 100 and the smartphone 200 are not connected via Bluetooth, and the digital camera 100 is not generating any display data 2, it is impossible to remotely control the digital camera 100 from the smartphone 200. Therefore, in the example of Fig. 8A displays “no camera” in the facility name display area 801. It is noted that this is only an example, and the display is not limited to this. For example, if it is impossible to remotely control the digital camera 100, the control unit 201 can set the facility name display area 801 to a non-display state.

[0070] On the other hand, in the Fig. In the example shown in Figure 8B, "Camera A" is displayed as the setup name in the setup name display area 801. It should be noted that in the first embodiment, the model name of the digital camera is displayed as the setup name. However, the display content is not limited to this. For example, a nickname that can be set by the user or similar in the digital camera can be displayed. Instead of characters, a symbol representing the model of the digital camera or similar can be displayed.

[0071] Function key 802 for browser display and function key 803 for remote shooting are examples of a function control UI for remotely controlling the Digital Camera 100. Fig. 8A displays each function key in its inactive state. This is an example of a display performed by control unit 201 in step S701 or S709. On the other hand, in Fig. 8B displays each function key in its active state. This is an example of a display performed by control unit 201 in step S711.

[0072] In this embodiment, the control unit 201, in Bluetooth connection state or at the time of receiving the display data 2, shows the function keys in the active state as shown in Fig. Figure 8B illustrates this. Even when the digital camera 100 is in sleep mode, the smartphone 200 can inform the user that the functions are available using the same message as in the Bluetooth connection state. In this embodiment, when the function button is pressed, the control unit 201 confirms the Bluetooth connection state. Only if the smartphone 200 is not connected via Bluetooth does the control unit 201 send a Bluetooth connection request to the digital camera and start the function. Therefore, the digital camera 100 and the smartphone 200 establish a suitable Bluetooth connection during function use without increasing the user's effort associated with the Bluetooth connection.When the Digital Camera 100 is in sleep mode, a Bluetooth connection is only established if an action is performed on the other side of the device (smartphone side) to request a Bluetooth connection. This reduces wasteful power consumption while the camera is in sleep mode.

[0073] It is noted that in this embodiment, a Bluetooth connection request to the digital camera 100 is sent without activating the function key at the time the display data 1 is received, and then the function keys are displayed in the active state at the time a Bluetooth connection is established. However, the time at which the function display switches is not limited to this. For example, the function keys can be displayed in the active state when the display data 1 is received. [Second embodiment]

[0074] The first embodiment described the case in which the smartphone 200 exchanges data with a digital camera 100. Alternatively, there may be a case in which the smartphone 200 can communicate with a multitude of digital cameras. The second embodiment describes processing in a smartphone 200 that supports a case in which communication with a multitude of digital cameras is possible. In the second embodiment, it is further assumed that the smartphone 200 also exchanges data with a digital camera that maintains Bluetooth communication even in sleep mode.

[0075] It should be noted that many sections of the second embodiment are common to the first embodiment, and their description is omitted. The focus is primarily on describing sections specific to the second embodiment. <systemanordnung>

[0076] Fig. Figure 9 shows a schematic representation of an example of a communication system according to this embodiment. As in Fig. As shown in Figure 9, the communication system comprises a plurality of digital cameras 100a, 100b, and 100c and the smartphone 200. The smartphone 200 can communicate with each camera via short-range wireless communication using Bluetooth. The digital camera 100a is a type of digital camera that maintains a Bluetooth connection even in sleep mode. Since the Bluetooth connection is not restricted regardless of whether the digital camera 100a is in sleep mode, a generated display packet is not switched between sleep mode and resuming from sleep mode. On the other hand, each digital camera 100b and 100c, like the digital camera 100 according to the first embodiment, switches a display packet accordingly, depending on whether the digital camera is in sleep mode, and generates it without maintaining a Bluetooth connection in sleep mode. <Beispiel (Anzeigedaten 0) eines Anzeigepakets>

[0077] Fig. Figure 10 shows an example of a display package generated by the digital camera according to the second embodiment. The in Fig. The 10-display package shown contains, unlike the one in Fig. The four displayed display packages (display data 1 or 2) have no restriction information. This display package is set to display data 0.

[0078] The display data 0 represents a display packet originating from digital camera 100a, which can establish a Bluetooth connection even in sleep mode. For digital camera 100a, which generates the display data 0, it is irrelevant whether the Bluetooth connection is restricted, regardless of whether the digital camera 100a is in sleep mode. Therefore, digital camera 100a always generates display data 0 to respond to a connection request. The processing performed by digital camera 100b or 100c is similar to that described in the first embodiment ( Fig. 6A and Fig. 6B). However, the display package is not switched for the 100a digital camera as described above. <Ablaufdiagramm bei Start einer Menüanzeige und Funktion des Smartphones 200>

[0079] The following describes a processing operation performed by the Smartphone 200, which can be connected to a variety of digital cameras via Bluetooth. Fig. 11A and Fig. Figure 11B shows flowcharts of main screen display processing and processing according to user operation in an application running on the Smartphone 200. It is noted that examples of a main screen display are the same as those in the first embodiment ( Fig. 8A and Fig. 8B). When an operating unit 205 activates the application, a control unit 201 starts the process in the Fig. 11A and Fig. Processing shown in 11B.

[0080] In step S1105, the control unit 201 initializes the main screen displayed on a display unit 206. Specifically, the control unit 201 displays function keys in their inactive state and shows "no camera" in a setup name display area 801, which would normally display the name of a usable camera. In step S1102, the control unit 201 confirms whether a display packet has been received from the digital camera 100. If the control unit 201 determines that a display packet has been received (YES in step S1102), the process proceeds to step S1103; otherwise (NO in step S1102), the process proceeds to step S1108.

[0081] In step S1103, the control unit 201 confirms whether the transmitting source of the display signal, i.e., the detected digital camera 100, is a paired device. If the control unit 201 determines that the digital camera 100 is a paired device (YES in step S1103), the process proceeds to step S1104; otherwise (NO in step S1103), the process proceeds to step S1108.

[0082] In step S1104, the control unit 201 adds / updates a setup list based on the contents of the display package. The setup list stores the necessary information for each digital camera during application operation, enabling the control unit 201 to manage the connection to the digital camera. Fig. Figure 11D shows an example of the data structure of the setup list. The setup list stores for each digital camera a setup name 1151, a communication status 1152 of the setup, and the presence / absence 1153 of a display during application.

[0083] The device name 1151 specifies the name of the digital camera. The device's communication state 1152 indicates whether the device is currently connected to the digital camera via Bluetooth, whether a connection request from the smartphone 200 is being processed, or the status of the generated display packet. The presence / absence 1153 of the display in the application indicates whether the device is displayed in the application. The presence / absence of the display in the application depends on the device's communication state, and a device that is currently connected via Bluetooth or is currently generating the display data 2 will be displayed in the application (i.e., as in the first embodiment).

[0084] It is noted that the Smartphone 200 deletes a digital camera from the setup list if it is not connected via Bluetooth and no display packet is captured for a predetermined period. This is to record the removal of a digital camera. It is noted that one method for recording removal is not limited to this. For example, the setup list can be reset once by providing a reset button and pressing it.

[0085] According to Fig. In step S1105, control unit 201 confirms the contents of the received display packet. If control unit 201 determines that the display packet represents display data 0 or 1, it sends a Bluetooth connection request to digital camera 100, from which the display packet originated, in step S1106. In step S1107, control unit 201 updates the connection status 1152 of the setup in the setup list to "Connection request in progress." If, on the other hand, control unit 201 determines in step S1103 that the display packet represents display data 2, the process proceeds to step S1108 without sending a Bluetooth connection request.

[0086] In step S1108, the control unit 201 confirms whether the Bluetooth connection status has changed (i.e., whether a new Bluetooth connection with the digital camera has been established or a Bluetooth connection has been disconnected). If the control unit 201 determines that the connection status has changed (YES in step S1108), the process proceeds to step S1109; otherwise, the process proceeds to step S1112.

[0087] In step S1109, the control unit 201 confirms whether the Bluetooth connection status change is a disconnection or a connection. If the control unit 201 determines that a Bluetooth "disconnection" has occurred, it deletes the device's information from the device list in step S1110. Conversely, if the control unit 201 determines that a Bluetooth "connection" has occurred in step S1109, it updates the device's communication status 1152 in the device list to "currently connected via Bluetooth" in step S1111.

[0088] In step S1112, the control unit 201 confirms the setup list and determines whether a digital camera to be displayed is present. If at least one digital camera is present, whose presence / absence is indicated by the "Display" indicator in the setup list (1153), the control unit 201 determines that a digital camera to be displayed exists. If the control unit 201 determines that there is no digital camera to be displayed (NO in step S1112), the process proceeds to step S1113; otherwise (YES in step S1112), the process proceeds to step S1115.

[0089] In step S1113, the control unit 201 updates the display of the facility name display area 801 from "no camera" on the display unit 206 to display the name of a usable digital camera. In step S1114, the control unit 201 displays the function key in its inactive state. The process then proceeds to step S1119.

[0090] In step S1115, the control unit 201 updates the display of the setup name in the setup name display area 801. If, at this time, a plurality of digital cameras are present, the presence / absence of which is represented by the setup list display 1153, the control unit 201 displays "Camera: Multiple". It should be noted that this is merely an example of a display to indicate that a plurality of digital cameras can be used. The present invention is not limited to this. For example, all setup names of the plurality of digital cameras can be arranged and displayed. Then, in step S1116, the control unit 201 displays the function keys in their active state.

[0091] In step S1117, control unit 201 confirms whether an operation for the function key is being detected. If control unit 201 determines that an operation for the function key is being detected (YES in step S1117), control unit 201 performs processing at the time of the function key operation in step S1118. It is noted that the processing at the time of the function key operation is described below with reference to Fig. 11C is described. If, on the other hand, the control unit 201 determines that no operation for the function key is detected (NO in step S1117), the process proceeds to step S1119.

[0092] In step S1119, the control unit 201 confirms whether the main screen display should be terminated. If the smartphone 200's control unit 205 accepts an application termination request, or the remote control function starts during processing in step S1118, the control unit 201 determines whether the main screen display should be terminated. If the control unit 201 determines that the main screen should be terminated (YES in step S1119), the process described in the Fig. 11A and Fig. 11B processing shown; otherwise (NO in step S1119) the process returns to step S1102 to repeat the above described in the Fig. 11A and Fig. 11B shown processing back.

[0093] Next, with reference to Fig. Section 11C describes a processing operation that is performed when the control unit 201 detects the operation for the function key. This processing operation corresponds to the processing operation performed by the control unit 201 in step S1118.

[0094] In step S1121, the control unit 201 confirms the setup list and verifies whether there are two or more digital cameras to be displayed. It is noted that the setup list contains at least one digital camera to be displayed, as step S1112 confirms that there are one or more cameras to be displayed.

[0095] If the control unit determines that the number of digital cameras to be displayed is 1 (NO in step S1121), control unit 201 sets the single digital camera to be displayed as the remote control target in step S1122. The process then proceeds to step S1126.

[0096] If, on the other hand, the control unit 201 determines that there are two or more digital cameras to be displayed (YES in step S1121), the control unit 201 displays a list of the setup names of the digital cameras to be displayed on the display unit 206 in step S1123. At this point, the control unit 201 indicates any digital camera displayed on the display unit 206 as selectable by the operating unit 205. In step S1124, the control unit 201 remains in standby mode until one of the digital cameras displayed in the list is selected by the operating unit 205. If the selection of the digital camera is detected (YES in step S1124), the control unit 201 sets the selected digital camera as the remote control target in step S1125.

[0097] In step S1126, the control unit 201 confirms whether the smartphone 200 and the remote-controlled digital camera are in Bluetooth connection mode. If the control unit 201 determines that the smartphone 200 and the remote-controlled digital camera are not in Bluetooth connection mode (NO in step S1126), the process proceeds to step S1127; otherwise (YES in step S1126), the process proceeds to step S1129.

[0098] In step S1127, the control unit 201 sends a Bluetooth connection request to the digital camera to be remotely controlled. This processing corresponds to step S511 of Fig. 5. In step S1128, the control unit 201 remains in standby mode until the digital camera 100 and the smartphone 200 are connected via Bluetooth. After the control unit 201 sends the Bluetooth connection request in step S1127, the digital camera 100 performs Bluetooth connection processing (step S513 of Fig. 5 corresponds) to establish a Bluetooth connection.

[0099] When the control unit 201 determines that the smartphone 200 and the remotely controlled digital camera are in the Bluetooth connection state (YES in step S1128), the process proceeds to step S1129. In step S1129, the control unit 201 starts the remote control function to execute the function corresponding to the pressed function button. For example, if the button for browsing captured images is pressed during the remote control function, the control unit 201 requests the digital camera 100 to send images and displays the received images on the display unit 206. The above processing is the processing performed by the control unit 201 when it detects the operation of the function button. <Anzeigebeispiel einer Kameraliste auf dem Smartphone>

[0100] Fig. Figure 12 shows an example of the list display of the digital cameras, which is implemented by the control unit 201 in step S1123 of Fig. 11C is displayed on the display unit 206. If it is determined that a large number of digital cameras to be displayed (i.e., digital cameras usable for remote control) are present in the setup list, the control unit 201 displays a selection dialog window 1201. When a list of digital cameras is displayed in the selection dialog window 1201, the user can select the usable digital cameras. The control unit 201 displays a list of the setup names of the digital cameras to be displayed in a digital camera display area 1202. When the control unit 205 detects that one of the digital cameras displayed in the digital camera display area 1202 has been selected, the control unit 201 performs the processes in steps S1125 to S1129, if necessary. This allows the user to use the selected function.

[0101] As described above, the control unit 201 stores a Bluetooth connection state for the digital camera and a display origin state in the setup list. If one or more digital cameras in the setup list are in the Bluetooth connection state or are generating display data 2, the control unit 201 displays the function keys for remote control in the active state. Even with multiple digital cameras, the smartphone 200 can thus indicate to the user, using the same display, that the functions are available, regardless of whether the digital camera is in sleep mode or the Bluetooth connection state.There may be a case where a digital camera that can always establish a Bluetooth connection (a digital camera that generates display data 0) and a digital camera that restricts the Bluetooth connection in sleep mode (a digital camera that switches between display data 1 and 2) are both present. Even in the state where these digital cameras are both present in the communication system, the smartphone 200, according to this embodiment, can display the available functions to the user using the same expression.

[0102] In this embodiment, if there are multiple digital cameras for which remote control is applicable, the control unit 201 displays a list of the device names on the display unit 206. When the user selects a digital camera to use, the control unit 201 establishes a Bluetooth connection if necessary. Thus, even in sleep mode, the camera can establish a Bluetooth connection appropriately, simply when the digital camera is selected as the remote control target and the function is used, without increasing the user's effort associated with the Bluetooth connection. Consequently, wasteful power consumption in sleep mode can be prevented until the function is used.

[0103] It is noted that if step S1121 specifies that only one digital camera is to be displayed, the control unit 201 does not display the selection dialog window 1201 in this embodiment and automatically sets the digital camera as the remote control target. However, even if the number of digital cameras to be displayed is 1, the Bluetooth connection and the function can be started after the selection dialog window is displayed and the user selects the displayed digital camera, similar to the case where multiple digital cameras are to be displayed. [Third embodiment]

[0104] The first embodiment described an arrangement in which, for example, after the digital camera 100 has been placed in the auto-off state (sleep state) by securing it with a tripod or similar device and left with the power switch on, the digital camera 100 can return from the sleep state by a user operating the smartphone 200 and taking a picture. If the digital camera 100 is left unattended after the picture has finished, the power is automatically switched off again to enter the auto-off state, thus setting the sleep state. The power switch of the digital camera 100 can also be switched off to set the sleep state. The third embodiment describes returning from the sleep state via operation on a smartphone 200 when a digital camera 100 enters the sleep state by switching off its power switch.

[0105] Even if the digital camera 100 returns from sleep mode in the case described above, it is not possible to perform a shooting operation because the power switch is OFF. Furthermore, the digital camera 100 does not display anything on a display unit 106. In this embodiment, the smartphone 200 can cause the digital camera 100 to send captured images, which are recorded on a recording medium 110, and to display the images on a display unit 206. That is, although remote shooting of the digital camera 100 by the smartphone 200 is limited, the captured images on the digital camera 100 can be browsed remotely. Since the digital camera 100 does not display anything on the display unit 106, no power is consumed unnecessarily, and no recording takes place, even if a control unit 105 is operated.Therefore, if an unintentional operation is carried out in a bag or the like, no recording or the like will ever be carried out.

[0106] Operating the Digital Camera 100 in sleep mode via the Smartphone 200 varies depending on the power switch position. If the power switch is ON and the Digital Camera 100 is not in sleep mode, shooting and browsing can be performed remotely. If the power switch is ON and the Digital Camera 100 is in auto-shutdown mode, shooting and browsing can be performed remotely after the camera returns from sleep mode. If the power switch is OFF, only browsing can be performed remotely after the camera returns from sleep mode. <Beispiele des Anzeigepakets>

[0107] Fig. Figure 13 shows an illustration of examples of a display package for the digital camera 100 according to this embodiment. The example of the display package is shown below. Fig. In section 4, information about the energy state of the digital camera 100 is added, and a value is changed according to the energy state of the digital camera 100. The value according to the energy state indicates a reason for the occurrence of a transition from the normal state (the first energy mode) to the sleep state (the energy-saving second energy mode). In this embodiment, examples of causes are a transition to the sleep state due to the auto-off function and a transition to the sleep state due to the power switch being turned off.

[0108] Through in Fig. 13 Display data shown is an example of the display package shown when the power switch of the digital camera 100 is ON, the digital camera 100 is not in sleep mode, and a Bluetooth connection with the smartphone 200 is not restricted. The in Fig. The display data shown in Figure 13 represents a display packet sent in the normal state, and information indicating the power state may be omitted. If the information indicating the power state is omitted, the data shown in Figure 1 is... Fig. 13 of the displayed data are the same as those shown in Fig. 4 displayed display data 1.

[0109] Upon receiving display data 1, the smartphone 200 knows that the digital camera 100 can establish a Bluetooth connection and that the power switch is ON. Therefore, the smartphone 200 sends a Bluetooth connection request to the digital camera 100. If the digital camera 100 is not in sleep mode, it can connect to the smartphone 200 via Bluetooth, and the remote shooting and browser functions can be operated from the smartphone 200.

[0110] In Fig. The 13 displayed data 2-1 represents an example of the display package when the digital camera 100 is in sleep mode, cannot establish a Bluetooth connection with the smartphone 200, and is in auto-off mode (the power switch is ON). The display data 2-1 is generated by recording information (information indicating the auto-off mode) into the Fig. 4 Display data 2 are obtained, the information indicating that the cause of the transition from the normal state to the sleep state is that the digital camera 100 was left untouched for a period of time exceeding a predetermined time.

[0111] Upon receiving display data 2-1, the smartphone 200 knows that "the timing of the Bluetooth connection to the digital camera 100 should be restricted and that the digital camera 100 is in auto-off mode (the power switch is ON)." In this case, the smartphone 200 does not immediately send a Bluetooth connection request to the digital camera 100. Therefore, if the digital camera 100 is in sleep mode, the digital camera 100 and the smartphone 200 will not connect via Bluetooth. When a predefined operation is performed on the smartphone 200, the smartphone 200 sends a Bluetooth connection request to the digital camera 100. If the digital camera 100 is in auto-off mode and sleep mode, a Bluetooth connection can be established in response to a predefined operation on the smartphone 200, and the remote shooting and browser functions can be operated via the smartphone 200.

[0112] In Fig. The 13 displayed data 2-2 represents an example of the display package when the digital camera 100 is in sleep mode and cannot establish a Bluetooth connection with the smartphone 200, and the power switch is OFF. The display data 2-2 is generated by recording information (information indicating that the power switch is OFF) into the Fig. 4. Display data 2 is obtained, the information indicating that the cause of the transition from the normal state to the sleep state is the operation of the power switch to turn it off.

[0113] Upon receiving display data 2-2, the smartphone 200 knows that "the timing of the Bluetooth connection to the digital camera 100 should be restricted and the power switch is OFF." In this case, the smartphone 200 does not immediately send a Bluetooth connection request to the digital camera 100. Therefore, if the digital camera 100 is in sleep mode, the digital camera 100 and the smartphone 200 will not connect via Bluetooth. When the smartphone 200 is operated, a Bluetooth connection request is sent to the digital camera 100. If the power switch of the digital camera 100 is OFF and the digital camera 100 is in sleep mode when the smartphone 200 is operated, a Bluetooth connection can be established. However, since the power switch of the digital camera 100 is OFF, the remote shooting function is restricted and not activated, while the browser function can be used. <Ablaufdiagramm zur Zeit des Eintretens in den Sleep-Zustand durch die Digitalkamera>

[0114] Fig. Figure 14 shows a flowchart of operation according to the third embodiment when the digital camera 100 enters the sleep state. There are two cases in which the digital camera 100 enters the sleep state. In one case, the digital camera enters the sleep state by the automatic power-off function when the inactivity persists for a period exceeding a predetermined time (the digital camera 100 is left continuously on its own for the predetermined time) while the power switch is ON. In the other case, the digital camera enters the sleep state by operating the control unit 105 to turn off the power switch. It is noted that in Fig. 14 the same step numbers as those in Fig. 6B refers to the same processes. Steps S1405, S1406 and S1407 are mainly different from those in Fig. The processes shown in 6B are different.

[0115] A control unit 101 of the digital camera 100 disconnects the Bluetooth connection (step S614) or stops sending display data 1, depending on whether the digital camera 100 and the smartphone 200 are in a Bluetooth connection state. After processing in step S614 or S616, the control unit 101 confirms the state of the power switch in step S1405. If the control unit 101 determines in step S1405 that the power switch is ON, the control unit 101 sends display data 2-1 in step S1406. If the control unit 101 determines in step S1405 that the power switch is OFF, the control unit 101 sends display data 2-2 in step S1407. <Ablaufdiagramm bei Start einer Menüanzeige und Funktion des Smartphones>

[0116] Next, the processing by the smartphone 200 will be discussed with reference to the Fig. 15A and Fig. 15B described.

[0117] Fig. Figure 15A shows a flowchart of main screen display processing and processing according to user operation in a camera control application running on the smartphone 200. When an operating unit 205 activates the camera control application, a control unit 201 starts the process described in Figure 15A. Fig. Processing shown in 15A. Fig. 15A denotes the same step numbers as in Fig. 7A the same processes. Mainly, steps S1505, S1506 and S1513 are from Fig. 7A are different and are described below.

[0118] When the control unit 201 determines in step S704 that the smartphone 200 and the digital camera 100 have been paired, the process proceeds to step S1505. In step S1505, the control unit 201 stores the setup name and state of the display package. Storing the display package state refers to storing information indicating whether the display package is showing display data 1, 2-1, or 2-2.

[0119] In step S1506, control unit 201 confirms the contents of the received display packet. If control unit 201 determines that the display packet represents display data 1, the process proceeds to step S707. If control unit 201 determines that the display packet represents display data 2-1 or 2-2, the process proceeds to step S710.

[0120] When the control unit 201 determines that an operation for the function key is detected (YES in step S712), the control unit 201 performs processing at the time of the function key operation in step S1513. If display data 2-1 has been received, the control unit 201 can perform the remote shooting function and browser function of the digital camera 100. If display data 2-2 has been received, the remote shooting function cannot be performed, but the browser function can be performed. The processing that is performed when the control unit 201 detects the operation for the function key (YES in step S712) is described below with reference to Fig. 15B described. This corresponds to the processing carried out by the control unit 201 in step S1513.

[0121] Fig. Figure 15B shows a flowchart of the processing performed by the control unit 201 of the smartphone 200 when an operation for the function key is detected. Fig. 15B refers to the same step numbers as in Fig. 7B the same processes. Mainly, the following are described below. Fig. 7B different processes (steps S1522, S1526 and S1527) are described.

[0122] In step S1522, control unit 201 confirms the state of the display packet of digital camera 100, which is stored in step S1505, and determines whether the stored display packet represents display data 2-2. If control unit 201 determines that the display packet represents display data 2-2 (YES in step S1522), the process proceeds to step S1526. Otherwise (NO in S1522), the process proceeds to step S722.

[0123] In step S1526, the control unit 201 determines whether the function (i.e., the function for which a start request is received) corresponding to the function key operated in step S712 is usable. If the function key operated in step S712 is the button for the function to browse images in the camera, the function is usable even if the power switch of the digital camera 100 is OFF, and thus the control unit 201 specifically determines that the function is usable. If, on the other hand, the function key selected in step S712 is the button for the recording function, the function is not usable if the power switch of the digital camera 100 is OFF, and thus the control unit 201 determines that the function is not usable. If the control unit 201 determines in step S1526 that the function is usable (YES in step S1526), ​​the process proceeds to step S722. Otherwise (NO in step S1526) the process goes to step S1527.

[0124] In step S1527, the control unit 201 displays a warning message on the display unit 206 indicating that the function is not usable. The in Fig. The processing shown in Figure 15B ends without executing a Bluetooth connection request or function start processing. The processing described above is executed by control unit 201 when an operation for the function key is detected. <Beispiel einer Nachrichtenanzeige des Smartphones>

[0125] Fig. Figure 16 shows an example of a warning message displayed by control unit 201 in step S1527 of Fig. 15B is displayed on display unit 206. According to Fig. 16 The control unit 101 informs the user by means of a warning dialog window 1601 of a state in which the function is not usable because the power switch is OFF.

[0126] As described above, in the third embodiment, control unit 201 displays the function keys as shown in Fig. 8B is displayed in the active state when the smartphone is in Bluetooth connection mode or when display data 2 is received. If an operation for the function key is detected, the control unit 201 also determines, based on the contents of the display packet received from the digital camera 100, whether the function is usable. Only if it is determined that the function is usable does the control unit 201 send a Bluetooth connection request to the digital camera 100, if necessary, thereby starting the function. This allows the digital camera 100 and the smartphone 200 to establish a Bluetooth connection appropriately, depending on whether the function is usable, without increasing the user's operational effort associated with the Bluetooth connection. Therefore, wasteful power consumption in sleep mode can be prevented.Since no Bluetooth connection request is sent when the function is unusable, unnecessary waiting time for the user caused by the Bluetooth connection can be eliminated.

[0127] It is noted that in the third embodiment, when the display data 2-2 is received from the digital camera 100, the function button of the unusable function in the digital camera, from which the display data 2-2 originates, is shown in the active state (step S711). If the user assumes operation of the function button of the unusable function, a warning is displayed (step S1527), and no Bluetooth connection request is sent to the digital camera 100. A method in which no Bluetooth connection request is sent to the digital camera 100, from which the display data 2-2 originates, when the unusable function is to be used on the smartphone 200 is not limited to this. For example, if the display data 2-2 is acknowledged in step S1506, the control unit 201 can display the function button of the unusable function in the inactive state to avoid assuming operation by the user.If the display data 2-2 is confirmed in step S1506, the control unit 201 may not display the function key of the unusable function (the function key of the recording function in this embodiment) or may display the function key in the inactive state. [Further examples]

[0128] The preferred embodiments of the present invention have been described above. However, the invention is not limited to these embodiments, and various changes and modifications can be made within the scope of protection of the present invention.

[0129] An embodiment(s) of the invention can also be implemented by a computer of a system or device which reads and executes computer-executable instructions (for example, one or more programs) recorded on a storage medium (which can also be more fully referred to as a "non-volatile computer-readable storage medium") for carrying out the functions of one or more of the embodiments described above, or which comprises one or more circuits (for example, an application-specific integrated circuit (ASIC)) for carrying out the functions of one or more of the embodiments described above.and by means of a computer of the system or device, for example, by reading and executing the computer-executable instructions from the storage medium to perform the functions of one or more of the embodiments described above and / or by controlling one or more circuits to perform the functions of one or more of the embodiments described above. The computer may comprise one or more processors (for example, a central processing unit (CPU), microprocessing unit (MPU)) and may include a network of separate computers or separate processors for reading and executing the computer-executable instructions. The computer-executable instructions may be provided to the computer, for example, by a network or the storage medium. The storage medium may, for example, be a hard disk, random access memory (RAM),a read-only memory (ROM), a distributed computing system memory, an optical disk (such as a compact disc (CD), digital versatile disc (DVD) or Blu-ray disc (BD™), a flash memory device, a memory card or the like.

[0130] Although the invention has been described with reference to exemplary embodiments, it is evident that the invention is not limited to the disclosed exemplary embodiments.< / systemanordnung>

Claims

[1] Communication system comprising a first communication device (100) and a second communication device (200), wherein the first communication device comprises (100) a device (112) for sending an initial notification for connection processing during short-range wireless communication while operating in a first power mode, and a device (112) for sending a second notification containing restriction information for performing link processing at a time that is restricted compared to the first notification, for link processing in short-range wireless communication during operation in a second power mode in which power is saved more than in the first power mode, and a device (101) for performing a transition of a power mode from the second power mode to the first power mode when a connection request is received in response to the second notification, and the second communication device (200) comprises a receiving device (209) for receiving either the first notification or the second notification sent by the first communication device, and a device (201) for starting connection processing at any time when the first notification is received, and, when the second notification is received, for starting connection processing at a time that is restricted compared to the case when the first notification is received, and a device (201) for displaying a device currently connected by short-range wireless communication and a device for transmitting the notification containing the restriction information to a display unit (206) as currently connected devices. [2] Communication device (100) which is configured to operate either in a first energy mode or in a second energy mode in which energy is saved more than in the first energy mode, with a device (112) for sending a notification for a connection request in short-range wireless communication and a device (112) for carrying out a transition of an energy mode from the first energy mode to the second energy mode, where the device is set up to send Sending an initial notification as the notification during operation in the first energy mode, and Sending a second notification, as the notification containing restriction information for performing connection processing at a time that is more restricted compared to the first notification, during operation in the second power mode, where, upon receiving a connection request on the second notification, the setup for performing a transition to perform the transition of the energy mode from the second energy mode to the first energy mode is set up. [3] Device according to claim 2, further comprising a device for disconnecting the short-range wireless communication when the energy mode transitions from the first energy mode to the second energy mode. [4] Device according to claim 2 or 3, further comprising a device for performing the connection processing after transitioning to the first energy mode when the connection request is received on the second notification. [5] Device according to one of claims 2 to 4, wherein the device for sending is configured to send the first notification during a first time period and to send the second notification during a second time period which is longer than the first time period. [6] Device according to any one of claims 2 to 5, wherein the second notification further contains information indicating a cause of the occurrence of a transition from the first energy mode to the second energy mode by the device for carrying out a transition. [7] Device according to claim 6, further comprising a device for limiting a function to be activated based on the cause when a transition from the second energy mode to the first energy mode is carried out in response to the receipt of the connection request on the second notification. [8] Device according to claim 7, wherein the information indicating the cause specifies whether the transition to the second energy mode occurs because the device is left on for a period of time exceeding a predetermined time, or occurs in response to the operation of a switch. [9] Device according to claim 8, wherein, if the cause is the operation of the on switch, the device for limiting the function to be activated is set up in comparison to the case in which the cause is that the device is left on for the period of time exceeding the predetermined time. [10] Device according to claim 9, wherein, if the cause is that the device is left on for the period exceeding the predetermined time, the device is provided to restrict the activation of a remote shooting function by an image capture device from an external device and a function for browsing a stored captured image, and if the cause is the operation of the on switch, the device is provided to restrict the remote shooting function. [11] Communication device (200) with a device (209) for receiving a notification for short-range wireless communication from an external communication device, a device (201) for determining whether the received notification contains restriction information indicating that a time of executing a connection request is restricted in short-range wireless communication, and a device (209) to send a connection request for connection processing at a first time when the restriction information is not included, and to send the connection request at a second time that is more restricted than the first time when the restriction information is included, and a device (201) for displaying an external device currently connected via short-range wireless communication and an external device of a transmitting source of the notification containing the restriction information on a display unit (206) as currently connected external devices. [12] Device according to claim 11, wherein the second time point is a time point at which an execution of a predetermined operation for the communication device is detected. [13] Device according to claim 11 or 12, wherein the first time point is a time point immediately after receipt of the notification. [14] Device according to any one of claims 11 to 13, further comprising a device for indicating the presence / absence of an external device on a display unit currently connected by short-range wireless communication, wherein, when the notification containing the restriction information is received, the device for indicating the presence / absence of an external device is configured to treat a sending source of the notification as the currently connected external device in a state in which the short-range wireless communication is disconnected. [15] Device according to one of claims 11 to 14, further comprising a device for performing remote control of an external device currently connected by short-range wireless communication and a communication device of a transmitting source of the notification containing the restriction information. [16] Device according to claim 15, further comprising a device for displaying a control element on a display unit, corresponding to a function operated by the remote control. [17] Device according to claim 16, wherein the device for sending the connection request in response to a detection of a user operation for the control element is configured when the device for performing a transition as the target of the remote control sets the communication device of the sending source of the notification containing the restriction information. [18] Device according to claim 17, wherein the device for displaying a predetermined display on the display unit is configured for a period of time from the sending of the connection request by the device for sending in response to the detection of the user operation for the control element until the completion of the short-range wireless communication connection by the connection processing. [19] Device according to one of claims 16 to 18, wherein, in response to the detection of user operation for the control element, the device for displaying a list of the external device currently connected by short-range wireless communication and the communication device of the sending source of the notification containing the restriction information is set up, and prompts a user to select a communication device as the target of the remote control. [20] Device according to one of claims 16 to 19, wherein the notification containing the restriction information includes information to determine whether a function is to be restricted as the target of the remote control, and, if it is determined based on the information to restrict the function, the device for carrying out a remote control to restrict an execution of the restricted function is set up. [21] Device according to claim 20, wherein, when a control element corresponding to the restricted function is selected by a user operation, the device for displaying notification is set up that an execution of the function is restricted. [22] Device according to claim 20, wherein the device for displaying is configured to display an operating element corresponding to the restricted function in the inactive state. [23] Control method for a communication device (100) operating in a first energy mode and a second energy mode in which energy is saved more than in the first energy mode, with Sending (S502) an initial notification for a connection request during short-range wireless communication while operating in first power mode, Performing (S506) a transition of an energy mode from the first energy mode to the second energy mode, Sending (S508) a second notification containing restriction information for executing connection processing at a time more restricted than the time of execution of connection processing by the first notification, during operation in the second power mode, and Performing (S512) a transition of the power mode from the second power mode to the first power mode when a connection request is received on the second notification (S511). [24] Control procedure for a communication device, with Receiving (S502, S508) a notification for short-range wireless communication from an external communication device, Determine (S503, S509) whether the notification received contains restriction information indicating that a time of execution of a connection processing in short-range wireless communication is restricted, Sending (S504) a connection request for connection processing at a first time when the constraint information is not included, and sending (S511) the connection request at a second time that is more restricted than the first time when the constraint information is included, and Displays (S1123) of an external device currently connected via short-range wireless communication and of an external device of a transmitting source of the notification containing the restriction information on a display unit as currently connected external devices.

Citation Information

Patent Citations

  • Image formation apparatus, control method, and program of the same

    JP2017144627A

  • Wireless communication device, wireless communication system, wireless communication method, computer-readable medium, and peripheral

    US20150173018A1

  • JP002017144627A