Information processing device and information processing method

Abstract

Efficiently maintain connections between terminals forming a mesh network. [Solution] The information processing device includes an acquisition means for acquiring information on the remaining battery level and power consumption of each of a plurality of imaging devices forming a mesh network, a determination means for determining which imaging device will act as a relay for relaying communication between other imaging devices in the mesh network, based on the information on the remaining battery level and power consumption of each of the plurality of imaging devices, and a connection management means for determining the communication path between the plurality of imaging devices relayed by the relay.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and an information processing method.

Background Art

[0002] In shooting such as sports games, a plurality of cameras are installed in a stadium. If the installed plurality of cameras can be controlled from a control room, even a single user can shoot the entire stadium area, achieving labor savings. Connecting the plurality of cameras and the control room with a wired network would be costly for camera installation and layout changes. Therefore, by constructing a wireless mesh network with a plurality of cameras having a wireless function, a user can control each camera from an information terminal such as a tablet or a smartphone. In a mesh network, communication between a camera installed in a location far from the control room and the information terminal is relayed by other cameras. In this case, the cameras performing the relay consume power for the relay process. Patent Documents 1 and 2 describe techniques for reducing the power consumption of a terminal by determining the communication path of a mesh network according to the power source type of the terminal and the remaining amount of the power resources of the terminal.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, even considering the power source type and remaining power resources, the operating time of devices such as cameras varies depending on the power consumption of each device. Devices with higher power consumption will experience faster battery depletion. When there is variation in operating time among devices, it becomes difficult to efficiently maintain connectivity between devices within a mesh network.

[0005] Therefore, the present invention aims to provide an information processing device that can efficiently maintain connections between terminals forming a mesh network. [Means for solving the problem]

[0006] The information processing device according to the present invention is characterized by comprising: acquisition means for acquiring information on the remaining battery level and power consumption of each of a plurality of imaging devices forming a mesh network; determination means for determining which imaging device will serve as a relay for relaying communication between other imaging devices in the mesh network, based on the information on the remaining battery level and power consumption of each of the plurality of imaging devices; and connection management means for determining the communication path between the plurality of imaging devices relayed by the relay. [Effects of the Invention]

[0007] According to the present invention, connections between terminals forming a mesh network can be efficiently maintained. [Brief explanation of the drawing]

[0008] [Figure 1] This diagram illustrates the configuration of a mesh network. [Figure 2] This is a flowchart of the mesh network construction process in the first embodiment. [Figure 3] This diagram illustrates how to set priorities for selecting repeaters. [Figure 4A] This diagram illustrates the configuration of an imaging device. [Figure 4B]This diagram illustrates the configuration of an imaging device connected to an information terminal. [Figure 4C] This is a diagram illustrating the configuration of an information terminal. [Figure 5] This is a flowchart of the mesh network construction process in the third embodiment. [Figure 6] This is a flowchart of the mesh network construction process in the fourth embodiment. [Figure 7] This figure illustrates the configuration of the mesh network according to the fifth embodiment. [Figure 8] This figure shows the mesh network connection management table of the fifth embodiment. [Figure 9] This is a flowchart of the mesh network update process in the fifth embodiment. [Figure 10] This figure illustrates the configuration of the mesh network according to the sixth embodiment. [Figure 11] This figure shows the mesh network connection management table of the sixth embodiment. [Figure 12] This is a flowchart of the mesh network update process in the sixth embodiment. [Figure 13] This is a flowchart of the mesh network update process in the seventh embodiment. [Figure 14] This is a flowchart of the mesh network construction process in the eighth embodiment. [Modes for carrying out the invention]

[0009] <First Embodiment> Hereinafter, the first embodiment will be described. FIGS. 1(A) and 1(B) are diagrams illustrating the configuration of a mesh network. The imaging devices 100a to 100g and the imaging device 200 in FIG. 1(A) are cameras that are set in a stadium for shooting a sports game or the like and can shoot moving images or still images. The imaging devices 100a to 100g and the imaging device 200 can perform wireless communication with the information terminal 300 via Wi-Fi or the like. The imaging device 200 is a mesh controller having a function for determining a communication path of the mesh network. The imaging devices 100a to 100g and the imaging device 200 may be terminal devices capable of forming a mesh network. If the imaging devices 100a to 100g and the imaging device 200 are not distinguishable from each other as imaging devices forming a mesh network, they are collectively referred to as the imaging device 100.

[0010] The information terminal 300 can perform various shooting settings including the resolution of moving images or still images on the imaging device 100. The user can check the data shot by the imaging device 100 on the information terminal 300. The information terminal 300 is an electronic device such as a tablet or a smartphone, and can control the mesh network based on the user's operation.

[0011] Even if the imaging device 100 is arranged at a position far from the information terminal 300, the imaging device 100 forms a mesh network so as to enable wireless communication with the information terminal 300. The communication standard used for the mesh network may be IEEE 802.11s, Wi-Fi EasyMesh (registered trademark), or other proprietary standards. FIG. 1(A) shows a state where communication is performed between adjacent imaging devices, but the connection between the imaging devices is switched in accordance with the mesh network standard. By constructing the mesh network, even when the imaging device 100d is not arranged at a position where direct wireless communication with the information terminal 300 is possible, the imaging device 100d and the information terminal 300 can communicate via the relay of the imaging devices 100a to 100c and the imaging device 200.

[0012] The imaging device 200 is a mesh controller having a function for determining a communication path of a mesh network. The mesh controller is an example of the information processing apparatus according to the present invention. FIG. 1(A) shows a state where the imaging device 200, which is a mesh controller, communicates directly with the information terminal 300. However, the imaging device 200 may communicate with the information terminal 300 via, for example, the imaging device 100g as a relay. That is, the mesh controller is not limited to the imaging device 200 that communicates directly with the information terminal 300, and any imaging device 100a to 100g forming the mesh network may be used. The communication path of the mesh network is determined in accordance with the communication standard used in the mesh network.

[0013] FIG. 1(B) shows an example of a communication path that does not use the imaging devices 100a, 100c, 100d, and 100f as repeaters. A repeater is an imaging device 100 that relays communication between other imaging devices in a mesh network. The communication path shown in FIG. 1(B) can reduce the power consumption of the imaging devices 100a, 100c, 100d, and 100f that are not repeaters as compared with the communication path shown in FIG. 1(A). The method for constructing the communication path of the mesh network shown in FIG. 1(B) will be described with reference to FIG. 2.

[0014] FIG. 2 is a flowchart of the mesh network construction process according to the first embodiment. In the mesh network construction process, the imaging device 200 determines a communication path between a plurality of imaging devices forming the mesh network. In the following description, the process mainly performed by the imaging device 200 is executed by the control unit 201 described in FIG. 4B.

[0015] In step S201, the imaging device 200, which is a mesh controller, creates a new network based on an operation by the user. The user can also operate the mesh controller via the information terminal 300 wirelessly connected to the mesh controller to create a new network.

[0016] In step S202, the imaging device 200, which is a mesh controller, registers the imaging devices 100a to 100g in the new network created in step S201 as repeaters, based on user input.

[0017] In step S203, the imaging device 200, which is the mesh controller, constructs a mesh network using the repeater information registered in step S202. In the mesh network constructed in step S203, imaging devices 100a, 100c, 100d, and 100f are registered as repeaters, so their power consumption increases compared to when they are not registered as repeaters. Therefore, in the processing of steps S204 to S209, the imaging device 200 changes the imaging device 100 that will be a repeater.

[0018] In step S204, the imaging device 200, which is a mesh controller, queries each of the imaging devices 100 for information on battery level and power consumption. In step S205, the imaging device 200 obtains information on the battery level and power consumption of each imaging device 100 based on the responses from each imaging device 100.

[0019] In step S206, the imaging device 200, which is the mesh controller, sets a priority for each imaging device 100 as a repeater based on the battery level and power consumption information obtained from each imaging device 100. Based on the set priority, the imaging device 200 determines which imaging device 100 will act as a repeater in the mesh network. That is, the repeaters are determined based on the battery level and power consumption information of each imaging device 100.

[0020] Refer to Figure 3 to explain the setting of priority for selecting repeaters. Figure 3 shows examples of battery levels and power consumption for imaging devices 100a to 100g. First, the priority of imaging device 100e, which is powered by AC power, is set to 1.

[0021] The priority of the battery-powered imaging devices 100 is set based on the operating time of each imaging device 100. The operating time of each battery-powered imaging device 100 may be expressed as a relative value to the operating time of a reference imaging device 100. The reference imaging device 100 can be any battery-powered imaging device 100, and in the example shown in Figure 3, the reference imaging device 100 is imaging device 100a.

[0022] The battery charge ratio of imaging device 100b to imaging device 100a is 100 / 100. The power consumption ratio of imaging device 100b to imaging device 100a is 10 / 15. The operating time is proportional to the battery charge ratio and inversely proportional to the power consumption ratio. Therefore, the relative operating time of imaging device 100b can be calculated as (100 / 100) / (10 / 15) = 3 / 2. The relative operating times of the other imaging devices 100c, 100d, 100f, and 100g can be calculated similarly. The priority for selecting a repeater is set in descending order of the relative operating time.

[0023] In the example in Figure 3, the battery level information used to set the priority is expressed as a percentage, but it may also be expressed as battery capacity [mAh]. When calculating the relative operating time using battery capacity [mAh], the imaging device 200, which is the mesh controller, should query the imaging device 100 for information on battery capacity and power consumption. Alternatively, the mesh controller may use battery voltage [V], which is approximately proportional to the battery level, as information on the battery level. When calculating the relative operating time using battery voltage [V], the mesh controller should query the imaging device 100 for information on battery voltage and power consumption.

[0024] Furthermore, in the example in Figure 3, the driveable time used to set the priority is calculated as a relative value to the driveable time of the reference imaging device 100a, but the actual driveable time may be calculated and used. For example, the driveable time can be calculated using the following (Equation 1). t = (C / IB) × 60 × α … (Equation 1) Here, t is the operating time [min], C is the remaining battery capacity [mAh], IB is the battery discharge current [mA], and α is a constant determined by the battery. When calculating the operating time using (Equation 1), the imaging device 200, which is the mesh controller, only needs to query the imaging device 100 for information on the remaining battery capacity and the battery discharge current. Alternatively, the mesh controller may query the imaging device 100 for the operating time [min] calculated by (Equation 1) in the imaging device 100.

[0025] The nominal capacity of the battery and the degree of degradation due to differences in the number of battery uses may vary from one imaging device 100 to another. In this case, it is preferable to calculate the operating time or the relative value of the operating time using the remaining battery capacity [mAh] or battery voltage [V] rather than the remaining battery charge [%].

[0026] In step S207 of Figure 2, the imaging device 200, which is the mesh controller, determines a new repeater based on the set priority. For example, the mesh controller excludes the imaging device 100f, which has the lowest priority, from being a repeater and allows it to join the wireless network as a terminal. At this time, the communication paths within the mesh network are switched in accordance with the communication standards applicable to the mesh network.

[0027] The imaging device 200, which is the mesh controller, checks whether it is possible for the mesh controller and each imaging device 100 to communicate via the mesh network, with the imaging device 100f excluded from the relay. This check of whether the mesh controller and the imaging devices 100 can communicate may be performed by exchanging predetermined commands, or by using commands such as PING.

[0028] If the imaging device 200, which is the mesh controller, can communicate with each imaging device 100 in the mesh network, the mesh controller removes the imaging device with the next lowest priority (for example, imaging device 100c) from the repeater. With imaging device 100c removed from the repeater, imaging device 200 checks whether the mesh controller and each imaging device 100 can communicate via the mesh network. In this way, the mesh controller sequentially removes imaging devices 100 with lower priority from the repeater, and checks whether each imaging device 100 in the mesh network can communicate with each other.

[0029] If an imaging device 100 becomes unable to communicate within the mesh network, the imaging device 200, which is the mesh controller, determines a new repeater combination that includes the imaging device 100 that was previously removed from the repeater. Figure 1(B) shows an example where imaging devices 100b, 100e, and 100g are determined to be the new repeater.

[0030] In step S208, the imaging device 200, which is the mesh controller, changes the network configuration to a mesh network that uses the repeaters determined in step S207. Specifically, the mesh controller determines the communication paths between the multiple imaging devices that will be relayed by the determined repeaters.

[0031] In step S209, the imaging device 200, which is the mesh controller, connects the imaging devices 100 that are not repeaters to the network as terminals. The imaging devices 100 that did not become repeaters can connect to the wireless network as terminals using a known SSID (Service Set IDentifier) ​​and password.

[0032] The configurations of the imaging device 100, imaging device 200, and information terminal 300 will be described with reference to Figures 4A to 4C. The imaging device 100 shown in Figure 4A corresponds to the imaging devices 100a to 100g in Figure 1(A). In addition to the configuration of imaging device 100, imaging device 200 has a configuration for functioning as a mesh controller.

[0033] Figure 4A is a diagram illustrating the configuration of the imaging device 100. The imaging device 100 includes a control unit 101, an imaging unit 102, an image processing unit 103, a communication unit 104, an operation unit 105, a power supply unit 106, a battery level acquisition unit 107, and a power consumption acquisition unit 108.

[0034] The control unit 101 controls the operation of the entire imaging device 100. The imaging unit 102 is a CMOS image sensor or a CCD image sensor, etc. The imaging unit 102 performs pixel reset, exposure, and pixel data readout according to the synchronization signal from the control unit 101, and outputs the pixel data to the image processing unit 103. The image processing unit 103 performs digital signal processing such as sensor correction processing, debayering processing, development processing, gamma processing, and encoding processing on the pixel data from the imaging unit 102, and outputs it as image data to the control unit 101. The control unit 101 outputs the image data output by the image processing unit 103 to the communication unit 104 or the recording unit.

[0035] The communication unit 104 transmits image data to another imaging device 100 or imaging device 200. The communication unit 104 transmits and receives control data and other information not only to image data but also to the imaging device 200 and the information terminal 300. The communication unit 104 outputs the received data to the control unit 101. The communication unit 104 also has a relay function that transmits image data and control data received from another imaging device 100 to an imaging device 100 or imaging device 200 other than the source.

[0036] The control unit 101 and the image processing unit 103 are microcontrollers, CPUs, ASICs, FPGAs, etc. It may be implemented using a separate IC (Integrated Circuit), or it may be implemented using the same IC. The communication unit 104 includes a microcontroller, CPU, ASIC, FPGA, etc., and an antenna for sending and receiving data to and from the outside. The communication unit 104 may be implemented using the same IC as the control unit 101.

[0037] The operation unit 105 includes switches, buttons, dials, a touch panel, etc. The user's operation results on the operation unit 105 are output to the control unit 101 as analog or digital signals. The control unit 101 changes the operation of the imaging device 100 according to the analog or digital signals based on the user's operation. The control unit 101 can change the operation of the imaging unit 102, image processing unit 103, and communication unit 104 by changing shooting settings, communication settings, power saving settings, etc., based on the user's operation. The control unit 101 can also change the operation of the imaging device 100 according to control data transmitted from the information terminal 300 via the communication unit 104.

[0038] The power supply unit 106 includes a DC power source such as a battery and an AC adapter, and a power supply circuit such as a DC / DC converter and a linear regulator that generates various voltages from the DC power source according to the operation of the imaging device 100. The power supply unit 106 drives the entire imaging device 100.

[0039] The battery level acquisition unit 107 acquires information regarding the battery level of the power supply unit 106 by communicating with the battery or by measuring its voltage. The control unit 101 can output the battery level information acquired by the battery level acquisition unit 107 to the outside via the communication unit 104.

[0040] The battery level acquisition unit 107 can acquire information about the battery level through communication with the battery. The method of communication with the battery differs depending on the type of battery. The battery level acquisition unit 107 can communicate with USB Power Delivery compatible batteries using the CC (Configuration Channel) line. Depending on the type of battery, the battery level acquisition unit 107 can use SPI (Serial Peripheral Interface) communication, I 2 The battery may communicate using C (Inter-Integrated Circuit) communication or a proprietary communication standard.

[0041] Furthermore, the battery level acquisition unit 107 can measure the current voltage by performing an A / D conversion on the voltage output from the battery. The battery level acquisition unit 107 can estimate the remaining battery level by comparing the measured current voltage with a known battery voltage when fully charged. In general electronic devices such as the imaging device 100, the number of usable battery cells is fixed; the voltage when a 2-cell battery is fully charged is approximately 8.4V, and the voltage when a 3-cell battery is fully charged is approximately 12.6V. The battery level acquisition unit 107 can acquire, for example, the ratio of the current voltage value to the voltage value when the battery is fully charged as information regarding the remaining battery level.

[0042] When the battery remaining capacity is used, the battery level acquisition unit 107 only needs to acquire the ratio of the current capacity value to the capacity value when the battery is fully charged as information regarding the battery level. The battery level acquisition unit 107 may acquire information regarding the battery level by any method, as long as it is a value that represents the battery level or a value that is proportional to the battery level.

[0043] The power consumption acquisition unit 108 acquires information regarding the power consumption of the imaging device 100 by communicating with the battery, measuring current and voltage, or by referring to a power consumption table. The control unit 101 can output the power consumption information acquired by the power consumption acquisition unit 108 to the outside via the communication unit 104.

[0044] The power consumption acquisition unit 108 can confirm the battery's discharge current and terminal voltage through communication with the battery, and acquire the power consumption value, which is the product of these, as information regarding power consumption.

[0045] Furthermore, the power consumption acquisition unit 108 can measure the current and voltage by performing an A / D conversion on the current and voltage output from the battery, and acquire the power consumption value, which is the product of these values, as information regarding power consumption.

[0046] Furthermore, the power consumption acquisition unit 108 can acquire information regarding power consumption by referring to a power consumption table pre-stored in the memory unit. The power consumption table is, for example, a table that stores the power consumption of each imaging device 100.

[0047] The battery level acquisition unit 107 and the power consumption acquisition unit 108 may be implemented using a microcontroller, CPU, ASIC, FPGA, etc., or they may be implemented using the same IC as the control unit 101.

[0048] Figure 4B illustrates the configuration of an imaging device 200 connected to an information terminal 300. The imaging device 200 includes a control unit 201, an imaging unit 102, an image processing unit 103, a communication unit 104, an operation unit 105, a power supply unit 106, a battery level acquisition unit 107, a power consumption acquisition unit 108, a repeater determination unit 202, and a connection management unit 203. Components identical to those of the imaging device 100 shown in Figure 4A are denoted by the same reference numerals and their explanation is omitted.

[0049] The control unit 201 controls the operation of the entire imaging device 200. The repeater determination unit 202 sets the priority order for each imaging device 100 (including the imaging device 200) when it is used as a repeater, based on information regarding the remaining battery level and power consumption of each imaging device 100. Based on the set priority order, the repeater determination unit 202 determines which repeater will relay communication between other imaging devices in the mesh network. The repeater determination unit 202 can also determine which imaging device 100 will become a repeater based on instructions from the user.

[0050] The connection management unit 203 constructs a mesh network so that the imaging device 100 designated as a repeater relays communication between other imaging devices.

[0051] Figure 4C illustrates the configuration of the information terminal 300. The information terminal 300 includes a control unit 301, a display unit 302, an operation unit 303, and a communication unit 304. The control unit 301 controls the overall operation of the information terminal 300. The display unit 302 is equipped with a touch panel and displays screens of various application software installed on the information terminal 300. The application software installed on the information terminal 300 includes application software for setting up shooting, communication, and power saving settings for the imaging device 100 and imaging device 200. The application software installed on the information terminal 300 also includes application software for displaying image data received from the imaging device 100 and imaging device 200.

[0052] The operation unit 303 includes switches, buttons, dials, touch panels, etc. The user's operation results on the operation unit 303 are output to the control unit 301 as analog or digital signals. The control unit 301 changes the operation of the information terminal 300 according to the analog or digital signals based on the user's operation. The control unit 301 may also transmit the analog or digital signals based on the user's operation as control data to the imaging device 100 and imaging device 200 via the communication unit 304. The imaging device 100 and imaging device 200, having received the control data from the information terminal 300, change their settings based on the control data. Thus, the control unit 301 of the information terminal 300 can change the settings of the imaging device 100 and the imaging device 200 based on user operations on the information terminal 300. The communication unit 304 transmits and receives image data and control data between the imaging device 100 and the imaging device 200.

[0053] In the first embodiment described above, the imaging device 200, which is a mesh controller, determines the repeaters and communication paths between imaging devices, taking into account the remaining battery level and power consumption of each imaging device 100. Therefore, the mesh controller can reduce the power consumption of battery-powered imaging devices among the imaging devices 100 that form the mesh network. In addition, the mesh controller can maintain imaging by the mesh network for a longer period of time.

[0054] Furthermore, the mesh controller is not limited to the imaging device 200 connected to the information terminal 300, but may be any of the imaging devices 100a to 100g that form the mesh network. In other words, the information processing device according to the present invention is not limited to being included in the imaging device 200 which is the mesh controller, but may be included in any of the imaging devices 100.

[0055] Furthermore, although Figure 3 illustrates an example where the priority for selecting a repeater is set for imaging devices 100a to 100g, the priority may also be set to include imaging device 200. If imaging device 200 is not determined to be a repeater, the mesh controller should be changed to one of the imaging devices 100a to 100g that have been determined to be a repeater. Also, if imaging device 200 is not determined to be a repeater, the connection destination of the information terminal 300 should be changed to one of the imaging devices 100a to 100g that have been determined to be a repeater.

[0056] <Second Embodiment> The second embodiment will now be described. The configuration of the imaging device 100, imaging device 200, and information terminal 300 according to the second embodiment is the same as that of the first embodiment. Furthermore, the flow of the mesh network construction process according to the second embodiment is the same as that of the first embodiment described in Figure 2. The explanation of matters common to the first embodiment will be omitted, and matters that differ from the first embodiment will be described. In the second embodiment, even if the battery of the imaging device 100 does not support communication, the imaging device 200 can determine the priority of the imaging device 100 for repeater selection without measuring the current. For this reason, the battery circuit configuration can be simplified.

[0057] In the first embodiment, the power consumption acquisition unit 108 measures the current for batteries that do not support communication. For this reason, the power consumption acquisition unit 108 is equipped with a dedicated current measurement circuit. In the second embodiment, the imaging device 200, which is a mesh controller, sets the priority for repeater selection based on the image resolution that affects the power consumption of the imaging device 100, instead of power consumption. When the priority is set based on the resolution of the image captured by the imaging device 100, the battery of the imaging device 100 does not need to be equipped with a dedicated current measurement circuit to check the power consumption. In this case, the mesh controller queries each imaging device 100 for the resolution of the image it captures as information regarding power consumption. The power consumption acquisition unit 108 of the imaging device 100 only needs to acquire the resolution of the image captured by the imaging device 100 and transmit it to the mesh controller.

[0058] Generally, the power consumption of the imaging device 100 increases with higher image resolution and decreases with lower image resolution. The repeater determination unit 202, for example, if the battery levels of each imaging device 100 are the same, will set the priority of the imaging device 100 with the highest image resolution to the lowest priority and the imaging device 100 with the lowest image resolution to the highest priority. On the other hand, if the battery levels of each imaging device 100 are different, the repeater selection unit 202 can set a priority for selecting a repeater by knowing in advance the relationship between image resolution and power consumption.

[0059] For example, suppose the image resolution captured by imaging device 100a is 4K, and the image resolution captured by imaging device 100g is 2K. Also, assume that the battery levels of imaging devices 100a and 100g are approximately the same. In this case, even if the power consumption values ​​of imaging devices 100a and 100g are unknown, if it is known that the ratio of power consumption when capturing a 2K image to power consumption when capturing a 4K image is 2:3, then it is possible to set a priority.

[0060] Furthermore, the priority for selecting a repeater may be set considering not only resolution but also image compression format and frame rate. In this case, the relationship between the settings of the shooting settings (resolution, image compression format, frame rate, etc.) and power consumption is stored in advance in a memory unit or similar. The relationship between the settings of the shooting settings and power consumption can be estimated, for example, based on measured values.

[0061] The repeater determination unit 202 acquires shooting setting information as power consumption information from each imaging device 100, and can estimate a power consumption value or a relative power consumption value from the relationship between the pre-estimated shooting setting value and power consumption. Based on the estimated power consumption value or relative power consumption value, the repeater determination unit 202 can set a priority order for repeater selection.

[0062] The priority for selecting a repeater may be set by considering the type and number of accessories (devices) connected to the imaging device 100, such as microphones, lenses, and external recorders, instead of power consumption. In this case, the repeater determination unit 202 obtains information on the type and number of connected accessories from each imaging device 100 as information on power consumption.

[0063] The repeater determination unit 202 can, for example, assign the lowest priority to the imaging device 100 with the most accessories connected if the battery level, shooting settings, and types of connected accessories are the same. Conversely, the repeater determination unit 202 can assign the highest priority to the imaging device 100 with no accessories connected.

[0064] On the other hand, if any of the battery level, shooting settings, or connected accessory types are different, the power consumption value or relative power consumption value is estimated from the relationship between the pre-estimated shooting setting values ​​and power consumption, and the relationship between the accessory type and power consumption. The repeater determination unit 202 can set a priority for repeater selection based on the estimated power consumption value or relative power consumption value.

[0065] In the second embodiment described above, the imaging device 200, which is a mesh controller, determines the repeaters and communication paths between imaging devices by considering information regarding power consumption, such as the shooting settings and the type and number of connected accessories. In this way, the mesh controller can set priorities for repeater selection based on the shooting settings and the type and number of connected accessories. Therefore, each imaging device 100 does not need to be provided with a current measurement circuit to acquire power consumption, and the circuit configuration can be simplified.

[0066] <Third Embodiment> The third embodiment will be described below. Imaging device 100, imaging device according to the third embodiment The configuration of the information terminal 300 is the same as in the first embodiment. The explanation of matters common to the first embodiment will be omitted, and matters that differ from the first embodiment will be explained. In the third embodiment, the imaging device 200 determines the repeaters so that communication within the mesh network is maintained for a target operating time set by the user (hereinafter referred to as the target operating time).

[0067] Figure 5 is a flowchart of the mesh network construction process in the third embodiment. The method for determining the communication path in the third embodiment will be explained with reference to Figure 5. Processes that are the same as those in the mesh network construction process of the first embodiment shown in Figure 2 are given the same reference numerals and their explanation is omitted. In Figure 5, the process in step S502 is added. Also, the processes in steps S206 and S207 are replaced by the process in step S507. In the following explanation, the processes mainly involving the imaging device 200 are executed by the control unit 201 described in Figure 4B.

[0068] In step S201, the imaging device 200, which is the mesh controller, creates a new network based on user input. In step S502, the mesh controller registers the target operating times for the imaging devices 100 that form the mesh network based on user input. The user can also register the target operating times to the mesh controller by operating an information terminal 300 that is wirelessly connected to the mesh controller. The user can set, for example, the duration of a sports match to be photographed as the target operating time. In the following description, the same target operating time is set for each imaging device 100 that forms the mesh network, but the target operating times may be set to different times for each imaging device 100. The processing from steps S202 to S205 is the same as in Figure 2, so the description is omitted.

[0069] In step S205, after obtaining information on battery level and power consumption from each imaging device 100, in step S507, the imaging device 200, which is the mesh controller, determines the repeaters based on the battery level, power consumption, and target operating time. The mesh controller calculates the available operating time for each imaging device 100 from the battery level and power consumption, and determines the imaging device 100 whose available operating time exceeds the target operating time to be the repeater.

[0070] The imaging device 200, which is a mesh controller, may calculate its operating time from its battery level and power consumption, and determine whether it is shorter than the target operating time. If the operating time of the imaging device 200 is shorter than the target operating time, the imaging device 100, which has a longer operating time than the target operating time, is connected to the information terminal 300, and the imaging device 200 can communicate with the information terminal 300 via the imaging device 100 connected to the information terminal 300.

[0071] In the first embodiment, the repeater determination unit 202 determines the repeaters in such a way that the number of repeaters is reduced in order to suppress the power consumption of battery-powered repeaters. In the third embodiment, the imaging device 100, which can operate beyond the target operating time, is used as a repeater, so the number of repeaters is greater than in the first embodiment. Therefore, in the third embodiment, it is possible to obtain more stable communication quality. In a mesh network, the system automatically switches to a communication path with a high communication speed and stability, so the more repeaters there are, the more stable the communication quality becomes.

[0072] The processes in steps S208 and S209 are the same as in Figure 2, so their explanation is omitted.

[0073] According to the third embodiment described above, the imaging device 200, which is a mesh controller, is a battery By determining the repeater based on information regarding remaining battery capacity, power consumption, and target operating time, it becomes possible to obtain stable communication quality while maintaining the target operating time.

[0074] <Fourth Embodiment> The fourth embodiment will now be described. The configuration of the imaging device 100, imaging device 200, and information terminal 300 according to the fourth embodiment is the same as in the first embodiment. The explanation of matters common to the first embodiment will be omitted, and matters that differ from the first embodiment will be described. In the fourth embodiment, the imaging device 200, which is a mesh controller, determines the repeater in order to suppress the power consumption of the imaging device 100 specified by the user. That is, the mesh controller can change the imaging device 100 that becomes a repeater according to instructions from the user.

[0075] Figure 6 is a flowchart of the mesh network construction process in the fourth embodiment. The method for determining the communication path in the fourth embodiment will be explained with reference to Figure 6. Processes that are the same as those in the mesh network construction process of the first embodiment shown in Figure 2 are denoted by the same reference numerals and their explanation is omitted. In Figure 6, the process in step S607 is added. The processes from steps S201 to S206 in Figure 6 are the same as in Figure 2, so their explanation is omitted. In the following explanation, the processes mainly involving the imaging device 200 are executed by the control unit 201 described in Figure 4B.

[0076] In step S607, the imaging device 200, which is a mesh controller, changes the priority of the repeaters determined in step S206 based on the user's instructions. The user can change the priority of the imaging devices 100, for example, via the operation unit 105 of the imaging device 200. Alternatively, the user can change the priority of the imaging devices 100 via the operation unit 303 of the information terminal 300. In this case, the imaging device 200 receives the information about the priority of the imaging devices 100 changed by the user via the operation unit 303 from the information terminal 300 and sets the priority of each imaging device 100.

[0077] For example, a user can extend the imaging time of the imaging device 100g by setting a lower priority for the imaging device 100g in the mesh network shown in Figure 1(A). By allowing users to change the priority for selecting repeaters regardless of battery level and power consumption, users can suppress the power consumption of the desired imaging device 100.

[0078] The processing in steps S207 to S209 is the same as in Figure 2, so the explanation is omitted.

[0079] According to the fourth embodiment described above, by allowing the user to change the priority order for selecting repeaters, the imaging device 200, which is a mesh controller, can suppress the power consumption of the imaging device 100 specified by the user. Note that the priority order for selecting repeaters is not limited to being set for imaging devices 100a to 100g, and the priority order may be set to include the imaging device 200 as well.

[0080] <Fifth Embodiment> The fifth embodiment will now be described. The configuration of the imaging device 100, imaging device 200, and information terminal 300 according to the fifth embodiment is the same as that of the first embodiment. The mesh network construction process of the fifth embodiment is the same as that of the third embodiment. The explanation of matters common to the third embodiment will be omitted, and matters that differ from the third embodiment will be described.

[0081] In the fifth embodiment, the imaging device 200, which is a mesh controller, has a target operating time calculated from the battery level and power consumption of the imaging device 100, which is a repeater. The system checks whether there are any repeaters with a shorter operating time than the target operating time. If there are any repeaters with a shorter operating time than the target operating time, the mesh controller connects the terminals connected to those repeaters to other repeaters. The terminals are imaging devices 100 that form the mesh network but are not repeaters. By connecting terminals connected to repeaters with shorter operating times than the target operating time (hereinafter also referred to as the first repeater) to other repeaters, the mesh controller can reduce the amount of data transmitted to the first repeater and suppress the power consumption of the first repeater. Therefore, the operating time of the entire mesh network can be extended beyond the target operating time.

[0082] In the third embodiment, the imaging device 200, which is a mesh controller, receives battery level and power consumption information from each imaging device 100, and determines the repeater based on the battery level, power consumption, and target operating time. However, if the operating mode of the imaging device is changed or the target operating time is changed, further power consumption reduction may be required.

[0083] Figure 7(A) is a diagram illustrating the configuration of the mesh network according to the fifth embodiment. Figure 7(A) shows an example of a communication path in which imaging devices 100c, 100f, and 200 are determined to be repeaters. The following describes how to configure the communication path when the operating time of imaging device 100f, which operates as a repeater, is less than the target operating time.

[0084] The imaging device 200 operates as a mesh controller and maintains a mesh network connection management table. Figure 8(A) shows the mesh network connection management table of the fifth embodiment. The mesh network connection management table stores information on repeaters, target operating time, available operating time, number of repeater stages, and terminals.

[0085] The repeater information is the information of the imaging device 100 that the repeater determination unit 202 has determined to be a repeater. In the example in Figure 8(A), the repeaters are imaging devices 200, 100f, and 100c.

[0086] The target operating time information is the target operating time registered by the user operating the imaging device 200, which is the mesh controller, and is the target time for driving the imaging devices 100 and 200 that form the mesh network. In the example in Figure 8(A), the target operating time is 2 hours.

[0087] The information on available operating time is calculated from the power consumption and battery level of each imaging device 100 determined by the repeater. The imaging device 200, which is a mesh controller, can obtain the information on the available operating time of the imaging devices 100 determined by the repeater via the communication unit 104. In the example in Figure 8(A), since the imaging device 200 is connected to an AC power supply, the specific information on the available operating time of the imaging device 200 is not stored. The available operating time of imaging device 100f is 1 hour and 50 minutes, and the available operating time of imaging device 100c is 3 hours and 40 minutes.

[0088] The repeater stage number information indicates which repeater the imaging device 100, which the repeater determination unit 202 has determined to be a repeater, is in the communication path from the information terminal 300. In the configuration shown in Figure 7(A), imaging device 200 has 1 repeater stage, imaging device 100f has 2 repeater stages, and imaging device 100c has 3 repeater stages. The communication path in the ascending direction of the repeater stage number, from imaging device 200 → imaging device 100f → imaging device 100c, is defined as the downstream direction, and the communication path in the descending direction of the repeater stage number, from imaging device 100c → imaging device 100f → imaging device 200, is defined as the upstream direction.

[0089] The terminal device information is information about the imaging device 100 that the repeater determination unit 202 did not determine to be a repeater, and is stored in association with the repeater to which it is connected. The terminal device communicates via the corresponding repeater. Communication is performed over a shared network. In the example in Figure 8(A), the terminal connected to imaging device 200 is imaging device 100a. The terminals connected to imaging device 100f are imaging devices 100b and 100g. The terminals connected to imaging device 100c are imaging devices 100d and 100e.

[0090] Figure 9 is a flowchart of the mesh network update process in the fifth embodiment. The method for updating the communication path in the fifth embodiment will be explained with reference to Figure 9. The mesh network update process shown in Figure 9 is started when the mesh network connection management table detects that there is a repeater whose available operating time is shorter than the target operating time. In the example in Figure 8(A), the available operating time of the imaging device 100f (1 hour 50 minutes) is shorter than the target operating time (2 hours), so the mesh network update process shown in Figure 9 is started.

[0091] In step S901, the control unit 201 determines whether there is a repeater upstream of a repeater (the first repeater) whose driveable time is shorter than the target operating time. The upstream side is on the information terminal 300 side of the communication path than the first repeater. The control unit 201 can determine that a repeater exists upstream if there is a repeater with fewer repeater stages than the first repeater. If a repeater exists upstream of the first repeater, the process proceeds to step S902. If there is no repeater upstream of the first repeater, the process shown in Figure 9 ends. In the example in Figure 8(A), the imaging device 100f has 2 repeater stages, and there is an imaging device 200 which is a repeater with 1 repeater stage, so the process proceeds to step S902.

[0092] In step S902, the control unit 201 determines whether a terminal is connected to the first repeater whose driveable time is shorter than the target operating time. If a terminal is connected to the first repeater, the process proceeds to step S903. If no terminal is connected to the first repeater, the process shown in Figure 9 ends. In the example in Figure 8(A), imaging devices 100b and 100g are connected to imaging device 100f as terminals. Therefore, the process proceeds to step S903.

[0093] In step S903, the control unit 201 instructs the first repeater, whose driveable time is shorter than the target operating time, to disconnect from the terminal connected to the first repeater. The first repeater disconnects from the terminal connected to it in accordance with the instruction. In the example in Figure 8(A), the control unit 201 instructs the imaging device 100f to disconnect from imaging devices 100b and 100g, which are connected as terminals. The imaging device 100f disconnects from imaging devices 100b and 100g.

[0094] Furthermore, the control unit 201 is not limited to instructing the first repeater to disconnect from the terminal device, but may also instruct the terminal device to disconnect from the first repeater. In this case, the control unit 201 transmits information about a new repeater (hereinafter also referred to as the second repeater) located upstream of the first repeater to the terminal device that has been instructed to disconnect from the first repeater.

[0095] In step S904, the control unit 201 instructs the upstream repeater (second repeater) of the first repeater, whose driveable time is shorter than the target operating time, to connect with the terminal that was disconnected from the first repeater in step S903. The second repeater connects with the terminal that was disconnected from the first repeater. In the example in Figure 8(A), the imaging device 200 upstream of imaging device 100f connects to the terminal imaging devices 100b and 100g as instructed by the control unit 201. In this way, the control unit 201 can connect the terminal that was connected to the first repeater to the second repeater which is connected to the information terminal 300 side of the communication path, rather than to the first repeater.

[0096] In step S905, the control unit 201 confirms that the terminal's connection destination has been changed from the first repeater to the second repeater. The control unit 201 can check the connection status between each repeater and the terminal using PING or similar methods.

[0097] In step S906, the control unit 201 updates the mesh network connection management table. After confirming that the connection destination of the terminal device has changed in step S905, the control unit 201 re-acquires the available operating time for each repeater and updates the mesh network connection management table.

[0098] A specific example of the process in step S906 will be explained using Figure 8(B). Figure 8(B) shows the mesh network connection management table after it has been updated in step S906. The control unit 201 reacquires the available operating times for imaging devices 200, 100f, and 100c. Imaging device 200 is connected to an AC power supply, the operating time for imaging device 100f is 2 hours and 10 minutes, and the available operating time for imaging device 100c is 3 hours and 40 minutes. In addition, regarding the connection status of the terminal devices, the connection destination of imaging devices 100b and 100g has been changed from imaging device 100f to imaging device 200.

[0099] Figure 7(B) illustrates the configuration of the mesh network after the connection destination of the terminal devices has been changed. As shown by the solid lines in Figure 7(B), the connection destination of imaging devices 100b and 100g has been changed from imaging device 100f to imaging device 200. The amount of data passing through imaging device 100f decreases, reducing the power consumption of imaging device 100f. As a result, the operating time of imaging device 100f has been extended to 2 hours and 10 minutes, exceeding the target operating time.

[0100] Note that the mesh network connection management table is not only updated in step S906, but may also be updated, for example, when the target operating time is set or changed.

[0101] In the fifth embodiment described above, the imaging device 200, which is a mesh controller, connects a terminal connected to a first repeater, whose operating time is shorter than the target operating time, to a second repeater on the information terminal 300 side. This allows the mesh controller to suppress the power consumption of the first repeater and extend the operating time of the first repeater.

[0102] <Sixth Embodiment> The sixth embodiment will now be described. The configuration of the imaging device 100, imaging device 200, and information terminal 300 according to the sixth embodiment is the same as in the first embodiment. The mesh network construction process in the sixth embodiment is the same as in the mesh network construction process in the third embodiment. The explanation of matters common to the third embodiment will be omitted, and matters that differ from the third embodiment will be explained. In the sixth embodiment, the imaging device 200, which is a mesh controller, changes the connection order of repeaters if there are repeaters whose driveable time, calculated from the remaining battery charge and power consumption, is shorter than the target operating time. By connecting repeaters (first repeaters) whose driveable time is shorter than the target operating time to a more downstream position, the mesh controller can reduce the amount of data communication of the first repeater and suppress the power consumption of the first repeater. Therefore, the operating time of the entire mesh network can be made longer than the target operating time.

[0103] In the third embodiment, the imaging device 200, which is a mesh controller, receives battery level and power consumption information from each imaging device 100, and determines the repeater based on the battery level, power consumption, and target operating time. However, if the operating mode of the imaging device is changed or the target operating time is changed, further power consumption reduction may be required.

[0104] Figure 10(A) is a diagram illustrating the configuration of the mesh network in the sixth embodiment. The configuration of the mesh network in Figure 10(A) is the same as the configuration of the mesh network shown in Figure 7(A) of the fifth embodiment, so no explanation is provided. The imaging device 200 operates as a mesh controller and holds a mesh network connection management table. Figure 11(A) is a diagram showing the mesh network connection management table in the sixth embodiment. The mesh network connection management table in Figure 11(A) is the same as the mesh network management table shown in Figure 8(A) of the fifth embodiment, so no explanation is provided.

[0105] Figure 12 is a flowchart of the mesh network update process in the sixth embodiment. The method for updating the communication path in the sixth embodiment will be explained with reference to Figure 12. The mesh network update process shown in Figure 12 is started when the mesh network connection management table detects that there is a repeater whose available operating time is shorter than the target operating time. In the example in Figure 11(A), the available operating time of the imaging device 100f (1 hour 50 minutes) is shorter than the target operating time (2 hours), so the mesh network update process shown in Figure 12 is started.

[0106] In step S1201, the control unit 201 determines whether there is a repeater downstream of a repeater (the first repeater) whose driveable time is shorter than the target operating time. The downstream side is the side of the communication path that is further from the information terminal 300 than the first repeater. The control unit 201 can determine that a repeater exists downstream if there is a repeater with a greater number of repeater stages than the first repeater. If a repeater exists downstream of the first repeater, the process proceeds to step S1202. If there is no repeater downstream of the first repeater, the process shown in Figure 12 ends. In the example in Figure 11(A), the imaging device 100f has 2 repeater stages, and there is an imaging device 100c which is a repeater with 3 repeater stages, so the process proceeds to step S1202.

[0107] In step S1202, the control unit 201 instructs the first repeater, whose driveable time is shorter than the target operating time, to swap the connection order with the downstream repeater (hereinafter also referred to as the third repeater). In the example in Figure 11(A), the control unit 201 instructs the imaging device 100f, which is the first repeater, and the imaging device 100c, which is the third repeater connected downstream, to swap their connection order. The imaging devices 100f and 100c update the mesh network configuration by swapping their connection order with each other, as shown by the solid lines in Figure 10(B).

[0108] In step S1203, the control unit 201 confirms that the connection order between the first repeater and the third repeater has been swapped. The control unit 201 can check the connection status between each repeater and terminal using PING or the like.

[0109] In step S1204, the control unit 201 updates the mesh network connection management table. After confirming that the connection order between the first repeater and the third repeater was swapped in step S1203, the control unit 201 re-acquires the available operating time for each repeater and updates the mesh network connection management table.

[0110] A specific example of the process in step S1204 will be explained using Figure 11(B). Figure 11(B) shows the mesh network connection management table after it has been updated in step S1204. The control unit 201 reacquires the available operating times for imaging devices 200, 100f, and 100c. Imaging device 200 is connected to an AC power supply, the operating time for imaging device 100f is 2 hours and 20 minutes, and the available operating time for imaging device 100c is 3 hours and 10 minutes. In addition, the number of repeater stages for imaging device 100f is 3, and the number of repeater stages for imaging device 100c is 2, and the connection order between imaging device 100f, which is the first repeater, and imaging device 100c, which is the third repeater, has been swapped. .

[0111] Figure 10(B) illustrates the configuration of the mesh network after the relay connection order has been changed. As shown by the solid line in Figure 10(B), the connection order of imaging device 100f and imaging device 100c has been changed by the processing in Figure 12. The amount of data passing through imaging device 100f is reduced, thereby reducing the power consumption of imaging device 100f. As a result, the operating time of imaging device 100f is extended to 2 hours and 20 minutes, exceeding the target operating time.

[0112] In the sixth embodiment described above, the imaging device 200, which is a mesh controller, reverses the connection order between the first repeater and the downstream third repeater when there is a first repeater whose driveable time is shorter than the target operating time. As a result, the mesh controller can suppress the power consumption of the first repeater and extend the driveable time of the first repeater.

[0113] <Seventh Embodiment> The seventh embodiment will now be described. The configuration of the imaging device 100, imaging device 200, and information terminal 300 according to the seventh embodiment is the same as in the first embodiment. The explanation of matters common to the first embodiment will be omitted, and matters that differ from the first embodiment will be described. In the seventh embodiment, the imaging device 200, which is a mesh controller, uses the power consumption information of each imaging device 100 to detect imaging devices 100 whose communication quality has deteriorated and connects them to an appropriate repeater. When the power consumption due to communication between the imaging device 100 and the repeater increases, the mesh controller connects the imaging device 100 to another repeater. As a result, the imaging device 200 can suppress power consumption due to deterioration of communication quality and build a stable mesh network.

[0114] Figure 13 is a flowchart of the mesh network update process in the seventh embodiment. The method for updating the communication path in the seventh embodiment will be explained with reference to Figure 13. The process in Figure 13 starts from a mesh network configuration in which the imaging device 100f, which is a repeater, and the imaging device 100b, which is a terminal, are connected, as shown in Figure 7(A). Similarly, the communication quality can be checked for terminals other than the imaging device 100b, and the mesh network configuration can be updated.

[0115] In step S1301, the power consumption acquisition unit 108 of the imaging device 100b measures the power consumption of the communication unit 104 at regular intervals. When transmitting a certain amount of data under the condition of constant transmission power, if the communication quality deteriorates, the transmission speed decreases, and the data transmission time increases. As the data transmission time increases, the average value of power consumption increases. The power consumption acquisition unit 108 can use this relationship to detect deterioration in communication quality when the power consumption of the communication unit 104 of the imaging device 100b increases. Furthermore, if the imaging device 100b can detect that the communication quality has deteriorated due to a change in the communication method or communication speed, it is also possible to consider the deterioration in communication quality as an increase in the power consumption of the communication unit 104. Factors that cause deterioration in communication quality include obstacles entering between the repeater imaging device 100f and the imaging device 100b, and the movement of either the repeater imaging device 100f or the imaging device 100b, which increases the distance between the devices.

[0116] In step S1302, the power consumption acquisition unit 108 determines whether power consumption has increased or whether communication quality has deteriorated. If power consumption has increased or communication quality has deteriorated, the process proceeds to step S1303. If power consumption has not increased and communication quality has not deteriorated, the process returns to step S1301.

[0117] In step S1303, the control unit 101 of the imaging device 100b is the repeater imaging device The imaging device 200, which acts as the mesh controller, is notified via 100f that power consumption has increased or communication quality has deteriorated. Upon receiving the notification, the control unit 201 of the mesh controller determines the new relay device (which can also be a mesh controller) to which the imaging device 100b will connect.

[0118] The new connection destination may be, for example, a repeater connected to the current connection destination repeater. Furthermore, if the imaging device 100 can acquire location information using the wireless function of the communication unit 104, the control unit 201 may determine the new connection destination repeater based on the location information of each imaging device 100. For example, the control unit 201 can acquire location information from each imaging device 100 and determine the repeater closest to imaging device 100b as the new connection destination.

[0119] In step S1304, the control unit 101 of the imaging device 100b connects to the connection destination determined by the imaging device 200 in step S1303. In the example in Figure 7(B), the imaging device 100b changes its connection destination from imaging device 100f to imaging device 200.

[0120] In step S1305, the power consumption acquisition unit 108 of the imaging device 100b measures the power consumption consumed by the communication unit 104 after the connection destination has been changed. The power consumption acquisition unit 108 may measure the power consumption consumed by the communication unit 104 at regular intervals and use the average value as the power consumption after the connection destination has been changed.

[0121] In step S1306, it is determined whether the power consumption measured in step S1305 is lower than the power consumption measured in step S1301 before the connection destination was changed. If the power consumption is lower than before the connection destination was changed, the imaging device 200 determines that the power consumption and communication environment have improved and terminates the process shown in Figure 13. If the power consumption is not lower than before the connection destination was changed, the process returns to step S1303. Upon returning to step S1303, the control unit 201 of the imaging device 200 (mesh controller) repeats the process from steps S1303 to S1306 until the power consumption of the imaging device 100b is reduced.

[0122] In the seventh embodiment described above, the imaging device 200, which is a mesh controller, detects terminals with degraded communication quality using power consumption information and connects those terminals to an appropriate repeater different from the repeater to which they are currently connected. This allows the mesh controller to suppress power consumption and build a stable mesh network.

[0123] <Eighth Embodiment> The eighth embodiment will now be described. The configuration of the imaging device 100, imaging device 200, and information terminal 300 according to the eighth embodiment is the same as in the first embodiment. The explanation of matters common to the first embodiment will be omitted, and matters that differ from the first embodiment will be described. In the eighth embodiment, each imaging device 100 periodically transmits information regarding the battery level and power consumption to the imaging device 200, which is a mesh controller. The mesh controller sets a priority for selecting repeaters based on the information received from each imaging device 100.

[0124] In the first embodiment, when creating a new network, the imaging device 200 sets the priority of each imaging device 100 as a repeater and constructs a mesh network based on the set priority. In the second embodiment, the imaging device 200 sets the priority of each imaging device 100 as a repeater based on the resolution and frame rate of each imaging device 100.

[0125] In multiple imaging devices 100, the battery level, initial power consumption, and shooting settings are the same. However, actual power consumption may differ. For example, suppose a soccer field is the subject of the photograph, and imaging device A photographs the soccer field at the wide end, while imaging device B photographs the area around the goalposts at the telephoto end. Even if there is no difference in power consumption between imaging device A and imaging device B initially, if people gather around the goalposts and their movements become vigorous, the power consumption of imaging device B will increase due to the encoding process of the image processing unit 103.

[0126] In the first and second embodiments, conditions such as the shooting settings of the imaging device 100 and the type and number of accessories are taken into consideration, but the movement of the subject being photographed is not taken into consideration when determining the repeater. In cases where there is a difference in the movement of the subject due to the difference in the field of view, as in the case of imaging device A and imaging device B described above, the difference in power consumption between imaging device A and imaging device B may become large, so it is desirable to re-select the repeater that was initially determined.

[0127] Therefore, in the eighth embodiment, the imaging device 200, which is a mesh controller, acquires information on the remaining battery level and power consumption of each imaging device 100 at predetermined intervals, and sets the priority of the imaging devices 100 to be used as repeaters based on the acquired information. By determining the repeaters based on the priority set at predetermined intervals, the mesh controller can improve the power supply situation within the mesh network.

[0128] Figure 14 is a flowchart of the mesh network construction process in the eighth embodiment. The method for determining the communication path in the eighth embodiment will be explained with reference to Figure 14. Processes that are the same as those in the mesh network construction process of the first embodiment shown in Figure 2 are denoted by the same reference numerals and their explanation is omitted.

[0129] After obtaining battery level information and power consumption information from each imaging device 100 in step S205, in step S1401, the control unit 201 stores the current time tNOW, counted by the timer, in the variable t1.

[0130] After executing the processes in steps S206 to S209, in step S1402, the control unit 201 reads the current time tNOW from the timer again and determines whether tNOW-t1 is greater than a predetermined time τ. The predetermined time τ can be set, for example, to the time during which the battery level is expected to change by 10% or more.

[0131] If tNOW-t1 is greater than the predetermined time τ, the process returns to step S204 because more than the predetermined time τ has elapsed since the last time the battery level and power consumption information was acquired. Returning to step S204, the control unit 201 again queries each of the imaging devices 100 for battery level and power consumption information. Then, in step S206, the control unit 201 sets a priority for each imaging device 100 as a repeater based on the battery level and power consumption information acquired from each imaging device 100. In step S207, the control unit 201 determines a new repeater based on the set priority. If tNOW-t1 is less than or equal to the predetermined time τ, the process proceeds to step S1403.

[0132] In step S1403, it is detected whether the user has performed a stop operation. If the user has performed a stop operation, the process shown in Figure 14 ends. If the user has not performed a stop operation, the process returns to step S1402.

[0133] According to the process shown in Figure 14, the imaging device 200, which acts as a mesh controller, acquires the latest battery level and power consumption information at predetermined time intervals τ, sets the priority of each imaging device 100 based on the latest information, and can review the repeaters. In other words, the mesh controller sets the priority of each imaging device 100 not only based on the initial battery level and power consumption state, but also based on the latest battery level and power consumption during operation, thereby improving the operational status. This allows for a review of the repeater configuration depending on the situation.

[0134] In the above example, the imaging device 200, which is a mesh controller, sets the priority based on sequential values ​​of battery level and power consumption obtained from the imaging device 100. However, the mesh controller may also set the priority using a relative value of the available operating time or the available operating time itself, as in the first embodiment. When using the available operating time itself, the mesh controller may determine the available operating time using (Equation 1) described in the first embodiment, or it may also determine the available operating time using (Equation 2) below. trem = τ×C' / {C-C'}×α … (Equation 2) Here, C' is the battery level [%] transmitted immediately before, C is the battery level [%] from the time before C', τ is the interval [min] between readings of the battery level, α is a coefficient that takes battery degradation into account, and trem is the remaining operating time [min] from time C'. When calculating the operating time using (Equation 2), the mesh controller queries each of the imaging devices 100 for battery level information in step S204.

[0135] Furthermore, if each imaging device 100 performs the calculation in (Equation 2), in step S204, the imaging device 200, which is the mesh controller, may query each imaging device 100 for the available operating time [min]. In this case, in step S205, each imaging device 100 transmits the available operating time calculated in (Equation 2) to the mesh controller. In step S206, the mesh controller sets a priority for each imaging device 100 as a repeater based on the available operating time transmitted from each imaging device 100. In step S207, the mesh controller determines the repeaters based on the priority.

[0136] The imaging device 200, which is a mesh controller, may, instead of processing steps S206 and S207, determine the repeater based on the result of comparing the drivable time of each imaging device 100 with the target operating time, similar to step S507 in the third embodiment.

[0137] Furthermore, the imaging device 200, which is the mesh controller, may not query each imaging device 100 for information on battery level and power consumption, and each imaging device 100 may transmit this information to the mesh controller at predetermined intervals. In order to avoid increasing the amount of communication, each imaging device 100 may transmit information on battery level and power consumption to the imaging device 200 only when the change in battery level exceeds a predetermined value.

[0138] to According to the eighth embodiment described above, the imaging device 200, which is a mesh controller, can acquire information on the battery level and power consumption of each imaging device 100 at predetermined intervals, and select an appropriate repeater based on the current battery level and power consumption information. Therefore, the mesh controller can appropriately maintain the power supply status of the imaging devices 100 that form the mesh network.

[0139] The present invention also includes cases in which a software program that realizes the functions of each of the embodiments described above is supplied directly from a recording medium or via wired / wireless communication to a system or device having a computer capable of executing the program and executed. The program code itself supplied to and installed on the computer in order to realize the functions and processes of each embodiment can realize the present invention. In other words, the present invention also includes the computer program itself for realizing the functions and processes of each embodiment. The computer program may be object code, a program executed by an interpreter, script data supplied to an OS, etc., as long as it has the functions of a program, and is not limited to the form of a program.

[0140] The recording medium for supplying the program may be, for example, a hard disk, a magnetic recording medium such as magnetic tape, an optical / magneto-optical storage medium, or a non-volatile semiconductor memory. Furthermore, the computer program that implements the functions and processes of each embodiment may be stored on a server on a computer network and supplied to the client computer by the client computer connecting to the server and downloading it.

[0141] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). Multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) may share the processing to control the entire device.

[0142] Furthermore, the above-mentioned processors are processors in a broad sense, including general-purpose processors and specialized processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Specialized processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0143] Furthermore, the embodiments described above (including modified examples) are merely examples, and configurations obtained by appropriately modifying or changing the above-described configurations within the scope of the gist of the present invention are also included in the present invention. Configurations obtained by appropriately combining the above-described configurations are also included in the present invention.

[0144] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit that implements one or more functions.

[0145] This embodiment includes the following configurations, methods, and programs. (Composition 1) An acquisition means for acquiring information on the battery level and power consumption of each of the multiple imaging devices forming a mesh network, A determination means for determining which imaging device will act as a relay for relaying communication between other imaging devices in the mesh network, based on information regarding the battery level and power consumption of each of the plurality of imaging devices, Connection management means for determining the communication path between the plurality of imaging devices relayed by the relay device, An information processing device characterized by having the following features. (Configuration 2) The information processing apparatus according to configuration 1, characterized in that the determination means changes the imaging device which acts as a relay device according to instructions from the user. (Composition 3) The information regarding the remaining battery level is the remaining capacity of the battery of the imaging device. An information processing device according to configuration 1 or 2, characterized by the above. (Composition 4) The information regarding the remaining battery level is relative to the capacity value of the imaging device's battery when fully charged. This is the ratio of the current capacity value. An information processing device according to configuration 1 or 2, characterized by the above. (Composition 5) The information regarding the remaining battery level is the ratio of the current voltage value to the voltage value when the imaging device's battery is fully charged. An information processing device according to configuration 1 or 2, characterized by the above. (Composition 6) The information relating to power consumption is the power consumption value of the imaging device. An information processing device according to any one of configurations 1 to 5, characterized by the above. (Composition 7) The power consumption information is information about the shooting settings of the imaging device, including at least one of the resolution, image compression format, and frame rate. An information processing device according to any one of configurations 1 to 5, characterized by the above. (Composition 8) The information relating to power consumption is at least one of the types and number of devices connected to the imaging device. An information processing device according to any one of configurations 1 to 5, characterized by the above. (Composition 9) The determination means further determines the imaging device that will act as the relay device based on the target operating time of the plurality of imaging devices. An information processing device according to any one of configurations 1 to 8, characterized by the above. (Composition 10) The determination means determines the plurality of repeaters, The connection management means, when the operating time of the first repeater is shorter than the target operating time, causes the imaging device that communicates on the mesh network via the first repeater to be connected to a second repeater that is connected to the information terminal controlling the mesh network on the side of the communication path closer to the information terminal that controls the mesh network than to the first repeater. The information processing apparatus according to configuration 9, characterized by the features described therein. (Composition 11) The determination means determines the plurality of repeaters, The connection management means, when the operating time of the first repeater is shorter than the target operating time, swaps the connection order between the first repeater and a third repeater connected to the communication path that is further away from the information terminal controlling the mesh network than the first repeater. The information processing apparatus according to configuration 9, characterized by the features described therein. (Composition 12) The connection management means, when the power consumption due to communication between the imaging device and the repeater increases, causes the imaging device to connect to another repeater. An information processing device according to any one of configurations 1 to 11, characterized by the above. (Composition 13) The connection management means determines the other repeater based on the location information of the imaging device when the power consumption due to communication between the imaging device and the repeater increases. The information processing device according to configuration 12, characterized by the features described herein. (Composition 14) The acquisition means acquires information regarding the remaining battery level and power consumption of each of the plurality of imaging devices at predetermined intervals. An information processing device according to any one of configurations 1 to 13, characterized by the above. (Composition 15) The acquisition means further acquires the drivable time of each of the plurality of imaging devices at predetermined intervals. The determination means determines the imaging device to be the relay device based on the result of comparing the drivable time and target operating time of each of the plurality of imaging devices. The information processing apparatus according to configuration 14, characterized by the features described herein. (Composition 16) The determination means sets a priority order for each of the multiple imaging devices as a relay device based on information regarding the remaining battery level and power consumption of each of the multiple imaging devices, and determines which imaging device will be the relay device based on the priority order. An information processing device according to any one of configurations 1 to 15, characterized by the above. (Composition 17) The determination means changes the priority based on user instructions. The information processing device according to configuration 16, characterized in that... (method) The steps include obtaining information regarding the battery level and power consumption of each of the multiple imaging devices forming a mesh network, The steps include determining which imaging device will act as a relay for relaying communication between other imaging devices in the mesh network, based on information regarding the battery level and power consumption of each of the plurality of imaging devices, An information processing method characterized by having the step of determining a communication path between the plurality of imaging devices that are relayed by the relay device. (program) A program for causing a computer to function as one of the means of the information processing device described in any of configurations 1 to 17. [Explanation of symbols]

[0146] 100: Imaging device, 107: Battery level acquisition unit, 108: Power consumption acquisition unit, 200: Imaging device (mesh controller), 201: Control unit, 202: Repeater determination unit, 203: Connection management unit

Claims

1. An acquisition means for acquiring information on the battery level and power consumption of each of the multiple imaging devices forming a mesh network, A determination means for determining which imaging device will act as a relay for relaying communication between other imaging devices in the mesh network, based on information regarding the battery level and power consumption of each of the plurality of imaging devices, Connection management means for determining the communication path between the plurality of imaging devices relayed by the relay device, An information processing device characterized by having the following features.

2. The information processing apparatus according to claim 1, characterized in that the determination means changes the imaging device which acts as a relay device according to instructions from the user.

3. The information regarding the remaining battery level is the remaining capacity of the battery of the imaging device. The information processing apparatus according to feature 1.

4. The information regarding the remaining battery level is the ratio of the current capacity value to the capacity value when the imaging device's battery is fully charged. The information processing apparatus according to feature 1.

5. The information regarding the remaining battery level is the ratio of the current voltage value to the voltage value when the imaging device's battery is fully charged. The information processing apparatus according to feature 1.

6. The information relating to power consumption is the power consumption value of the imaging device. The information processing apparatus according to feature 1.

7. The power consumption information is information about the shooting settings of the imaging device, including at least one of the resolution, image compression format, and frame rate. The information processing apparatus according to feature 1.

8. The information relating to power consumption is at least one of the types and number of devices connected to the imaging device. The information processing apparatus according to feature 1.

9. The determination means further determines the imaging device that will act as the relay device based on the target operating time of the plurality of imaging devices. The information processing apparatus according to feature 1.

10. The determination means determines the plurality of repeaters, The connection management means, when the operating time of the first repeater is shorter than the target operating time, causes the imaging device that communicates on the mesh network via the first repeater to be connected to a second repeater that is connected to the information terminal controlling the mesh network on the side of the communication path closer to the information terminal that controls the mesh network than to the first repeater. The information processing apparatus according to feature 9.

11. The determination means determines the plurality of repeaters, The connection management means, when the operating time of the first repeater is shorter than the target operating time, connects the first repeater to the mesh network in the communication path that is shorter than the first repeater. Reverse the connection order between the third relay device, which is connected to the side away from the information terminal controlling the network, and the network control terminal. The information processing apparatus according to feature 9.

12. The connection management means, when the power consumption due to communication between the imaging device and the repeater increases, causes the imaging device to connect to another repeater. The information processing apparatus according to feature 1.

13. The connection management means determines the other repeater based on the location information of the imaging device when the power consumption due to communication between the imaging device and the repeater increases. The information processing apparatus according to feature 12.

14. The acquisition means acquires information regarding the remaining battery level and power consumption of each of the plurality of imaging devices at predetermined intervals. The information processing apparatus according to feature 1.

15. The acquisition means further acquires the drivable time of each of the plurality of imaging devices at predetermined intervals. The determination means determines the imaging device to be the relay device based on the result of comparing the drivable time and target operating time of each of the plurality of imaging devices. The information processing apparatus according to feature 14.

16. The determination means sets a priority order for each of the multiple imaging devices as a relay device based on information regarding the remaining battery level and power consumption of each of the multiple imaging devices, and determines which imaging device will be the relay device based on the priority order. The information processing apparatus according to feature 1.

17. The determination means changes the priority based on user instructions. The information processing apparatus according to feature 16.

18. The steps include obtaining information regarding the battery level and power consumption of each of the multiple imaging devices forming a mesh network, The steps include determining which imaging device will act as a relay for relaying communication between other imaging devices in the mesh network, based on information regarding the battery level and power consumption of each of the plurality of imaging devices, An information processing method characterized by having the step of determining a communication path between the plurality of imaging devices that are relayed by the relay device.

19. A program for causing a computer to function as one of the means of an information processing apparatus described in any one of claims 1 to 17.

Images