Communication device, image capture device, and communication method

The communication device optimizes power usage by assessing data characteristics to reduce unnecessary communication and adjust transmission frequency, addressing the inefficiency of constant communication in conventional devices.

WO2024247494A1PCT designated stage expired Publication Date: 2024-12-05SONY SEMICON SOLUTIONS CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/014289
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-31
Filing Date
2024-04-08
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Conventional communication devices waste power by maintaining constant communication levels even when there are no abnormalities, leading to inefficient power consumption.

Method used

A communication device with a determination unit that assesses data characteristics and adjusts communication based on these results, suspending transmission when no abnormalities are detected and optimizing battery usage by varying data transmission and interval based on battery levels and data changes.

Benefits of technology

Reduces power consumption by minimizing unnecessary communication and extending battery life by only transmitting data when abnormalities are present and adjusting communication frequency according to battery levels and data changes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024014289_05122024_PF_FP_ABST
    Figure JP2024014289_05122024_PF_FP_ABST
Patent Text Reader

Abstract

The present invention makes it possible to reduce wasted power consumption during communication. This communication device is provided with a determination unit that determines characteristics of data, and a communication unit that communicates the determination result of the characteristics of the data on the basis of the determination result. The communication device may be further provided with a characteristic detection unit that detects the characteristics of the data. The communication unit may transmit the determination result when it is determined that there is an abnormality in the characteristics of the data, and may suspend the communication when it is determined that there is no abnormality in the characteristics of the data. The communication device may be further provided with a sensor that generates data. The communication device may be provided with a controller that controls the sensor. The controller may be provided with a determination unit and a communication unit.
Need to check novelty before this filing date? Find Prior Art

Description

Communication device, imaging device, and communication method

[0001] The present technology relates to a communication device, an imaging device, and a communication method, and more particularly to a communication device, an imaging device, and a communication method that are capable of executing communication based on a determination result of data.

[0002] When monitoring for abnormalities, communication may be performed according to the results of the monitoring. For example, a communication device has been proposed that, when it detects that a person wearing the device has fallen, determines the degree to which the transmission path of a wireless signal overlaps with the person's body, and transmits a wireless signal in a transmission mode according to the determination result (see, for example, Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2020-27536

[0004] However, in the above-mentioned conventional technology, communication is carried out at a low output level even when the communication environment is good, which can lead to wasted power consumption when no abnormalities are detected during abnormality monitoring.

[0005] This technology was developed in light of these circumstances, and aims to make it possible to reduce wasteful power consumption during communication.

[0006] The present technology has been made to solve the above-mentioned problems, and a first aspect thereof is a communication device including a determination unit that determines a characteristic of data, and a communication unit that communicates the determination result based on the determination result of the characteristic of the data, thereby providing an effect of reducing the amount of communication based on the determination result of the characteristic of the data.

[0007] In addition, in the first aspect, the data processing device may further include a feature detection unit that detects a feature of the data, thereby providing an effect that the feature of the data can be determined.

[0008] In addition, in the first aspect, a sensor that generates the data may be further provided, thereby providing an effect that data from which characteristics are determined is obtained.

[0009] In the first aspect, the sensor may include the feature detection unit, thereby providing an effect that the feature of the data is detected by the sensor.

[0010] In the first aspect, the sensor may include the determination unit, thereby providing an effect that the characteristics of the data are determined by the sensor.

[0011] In the first aspect, the device may further include a controller that controls the sensor, thereby providing an effect of linking the generation of data by the sensor with the detection of characteristics of the data by the sensor.

[0012] In the first aspect, the controller may include the determination unit and the communication unit, thereby providing an effect that detection of a data characteristic by the sensor and determination of the data characteristic by the controller are linked.

[0013] In addition, in the first aspect, the communication unit may transmit the determination result when it is determined that there is an abnormality in the characteristics of the data, and may suspend the communication when it is determined that there is no abnormality in the characteristics of the data, thereby providing an effect of reducing the amount of communication when it is determined that there is no abnormality in the characteristics of the data.

[0014] In addition, in the first aspect, the device may further include a remaining battery capacity detection unit that detects a remaining battery capacity for powering the determination unit and the communication unit, thereby providing the effect that the determination unit and the communication unit are powered by the battery based on the remaining battery capacity.

[0015] In addition, in the first aspect, the communication unit may transmit the data and the determination result when the remaining battery charge is equal to or greater than a first remaining charge, and may transmit the determination result without transmitting the data when the remaining battery charge is less than the first remaining charge, thereby achieving an effect of reducing communication volume when the remaining battery charge is low.

[0016] In the first aspect, the communication unit may transmit the data and the determination result when the remaining battery charge is equal to or less than a second remaining charge that is less than the first remaining charge, and may transmit the determination result multiple times in a batch when the remaining battery charge is less than the first remaining charge. This reduces the number of communications when the remaining battery charge is low.

[0017] In the first aspect, the communication unit may extend the communication interval based on the remaining charge of the battery, thereby providing an effect that the amount of communication is reduced based on the remaining charge of the battery.

[0018] In addition, in the first aspect, the device may further include a power supply control unit that switches to battery operation using a backup battery based on the remaining battery power, thereby providing the effect of switching to battery operation using the backup battery when the remaining battery power is low.

[0019] In the first aspect, the communication unit may extend the communication interval based on the amount of change in the data, thereby providing an effect that the amount of communication is reduced when the amount of change in the data is small.

[0020] In addition, in the first aspect, the communication unit may transmit the determination result when a characteristic of the data has changed, and may suspend the communication when the characteristic of the data has not changed, thereby achieving an effect of reducing the amount of communication when the characteristic of the data has not changed.

[0021] In the first aspect, the communication unit may transmit the operation status upon activation, thereby providing an effect that the operation status of the communication unit can be recognized while the communication unit can be put into a sleep state.

[0022] A second aspect of the present invention is an imaging device including an imaging unit that captures images, a detection unit that detects characteristics of imaging data generated by the imaging unit, a determination unit that determines the characteristics of the imaging data, and a communication unit that communicates the determination result based on the determination result of the characteristics of the imaging data, thereby providing an effect of reducing communication traffic based on the determination result of the characteristics of the imaging data.

[0023] In addition, in the second aspect, the communication unit may transmit the determination result when it is determined that there is an abnormality in the characteristics of the imaging data, and may suspend transmission of the determination result when it is determined that there is no abnormality in the characteristics of the imaging data, thereby achieving an effect of reducing communication traffic when it is determined that there is no abnormality in the characteristics of the imaging data.

[0024] A third aspect of the present invention is a communication method in which a server determines characteristics of data, and the server receives the determination result based on communication performed in accordance with the determination result of the characteristics of the data, thereby reducing the amount of communication traffic based on the determination result of the characteristics of the data.

[0025] In addition, in a third aspect, the server may receive the determination result when it is determined that there is an anomaly in the characteristics of the data, and may suspend receiving the determination result when it is determined that there is no anomaly in the characteristics of the data, thereby achieving the effect of reducing communication volume when it is determined that there is no anomaly in the characteristics of the data.

[0026] 10 is a block diagram showing an example of a configuration of an imaging device according to a first embodiment. FIG. 11 is a diagram showing an example of a communication sequence according to the first embodiment. FIG. 12 is a diagram showing another example of a communication sequence according to the first embodiment. FIG. 13 is a flowchart showing an example of a communication method according to the first embodiment. FIG. 14 is a block diagram showing an example of a configuration of an imaging device according to a second embodiment. FIG. 15 is a diagram showing an example of a communication sequence according to the second embodiment. FIG. 16 is a flowchart showing an example of a communication method according to the second embodiment. FIG. 17 is a block diagram showing an example of a configuration of an imaging device according to a third embodiment. FIG. 18 is a diagram showing an example of a communication sequence according to the third embodiment. FIG. 19 is a flowchart showing an example of a communication method according to the third embodiment. FIG. 19 is a flowchart showing an example of a communication method according to the fourth embodiment. FIG. 19 is a block diagram showing an example of a configuration of an imaging device according to a fifth embodiment. FIG. 19 is a flowchart showing an example of a communication method according to the fifth embodiment. FIG. 19 is a diagram showing an example of a communication sequence according to a sixth embodiment. FIG. 19 is a flowchart showing an example of a communication method according to the sixth embodiment. FIG. 19 is a diagram showing an example of a communication sequence according to the seventh embodiment. FIG. 19 is a flowchart showing an example of a communication method according to the seventh embodiment. FIG. 19 is a block diagram showing an example of a configuration of an imaging device according to an eighth embodiment. FIG. 19 is a flowchart showing an example of a communication method according to the eighth embodiment.

[0027] Hereinafter, modes for implementing the present technology (hereinafter referred to as embodiments) will be described. The description will be made in the following order. 1. First embodiment (an example in which, when it is determined that there is an abnormality in the characteristics of the imaging data, the determination result is transmitted, and when it is determined that there is no abnormality in the characteristics of the imaging data, communication is suspended) 2. Second embodiment (an example in which, when it is determined that there is an abnormality in the characteristics of the imaging data, an image and the determination result are transmitted if the remaining battery charge is sufficient, and only the determination result is transmitted if the remaining battery charge is low) 3. Third embodiment (an example in which, when it is determined that there is an abnormality in the characteristics of the imaging data, multiple determination results are transmitted together if the remaining battery charge is almost low) 4. Fourth embodiment (an example in which the communication interval is extended if the remaining battery charge is low) 5. Fifth embodiment (an example in which the remaining battery charge is switched to a spare battery if the remaining battery charge is low) 6. Sixth embodiment (an example in which the communication interval is shortened when there is a large change in the imaging data, and the communication interval is extended when there is a small change in the imaging data) 7. 7. Seventh embodiment (an example in which, when it is determined that there is an abnormality in the characteristics of the imaging data, if there is a change from the previous communication, the determination result is transmitted, and if there is no change from the previous communication, the determination result is not transmitted) 8. Eighth embodiment (an example in which a determination unit that determines the characteristics of the imaging data is provided in an image sensor) 9. Ninth embodiment (an example in which semiconductor chips forming a solid-state imaging device are stacked) 10. Application example to a moving body

[0028] 1. First Embodiment FIG. 1 is a block diagram showing an example of the configuration of an imaging device according to a first embodiment.

[0029] In the figure, the camera 100 generates imaging data based on imaging and transmits the imaging data. The camera 100 may be battery-powered. In this case, the camera 100 may be used in an environment where power is not easily secured, such as river monitoring or farm monitoring, or in an environment where power supply construction is difficult, such as shelf monitoring in a convenience store or supermarket. The camera 100 may be mounted on a mobile object such as a drone, or on a mobile terminal such as a smartphone. The camera 100 is an example of an imaging device described in the claims.

[0030] The camera 100 includes an image sensor 110 and an MCU (Micro Controller Unit) 120. The image sensor 110 is connected to the MCU 120. The interface used to connect the image sensor 110 and the MCU 120 may be, for example, a Serial Peripheral Interface (SPI) or a Mobile Industry Processor Interface (MIPI). The MCU 120 is connected to a network 130. Power is supplied to the image sensor 110 and the MCU 120 via a power supply circuit 140. The power supply circuit 140 is connected to a timer 150.

[0031] The image sensor 110 captures an image and generates image data. The image sensor 110 may be an event-based vision sensor or a distance measurement sensor. The image sensor 110 includes an image capture unit 111 and an AI (Artificial Intelligence) processing unit 112.

[0032] The imaging unit 111 generates pixel signals based on the captured image, digitizes the signals, and outputs the signals. The pixels can be arranged in a matrix in the row and column directions. Each pixel may include a photodiode or a SPAD (Single Photon Avalanche Diode). The imaging unit 111 may output an image or an event. Distance measurement data such as depth information may be added to the image. The imaging unit 111 is an example of a sensor described in the claims.

[0033] The AI ​​processing unit 112 detects features of the imaging data. The AI ​​processing unit 112 can perform inference processing, such as anomaly detection, object detection, behavior detection, and posture detection, based on the imaging data. The anomalies detected by the AI ​​processing unit 112 may include, for example, anomalies with low urgency and anomalies with high urgency, or anomalies with low importance and anomalies with high importance. For example, the anomalies detected by the AI ​​processing unit 112 may include anomalies that can be left unattended, anomalies that require attention, anomalies that require periodic attention, and anomalies that require urgent attention. The AI ​​processing unit 112 may include a processor or a neural network. The AI ​​processing unit 112 may perform processing based on a rule base or machine learning. The AI ​​processing unit 112 does not necessarily need to be provided in the image sensor 110 and may also be provided in the MCU 120. The AI ​​processing unit 112 is an example of a feature detection unit described in the claims.

[0034] The MCU 120 controls the image sensor 110 and transmits the imaging data to the network 130 based on the determination result of the characteristics of the imaging data. The characteristics of the imaging data may be an abnormality in the subject of the imaging data, an object or person appearing in the imaging data, the behavior of a person appearing in the imaging data, or the posture of an object or person appearing in the imaging data. For example, in river monitoring, the characteristics may be a rise in water level or flooding of the river. In farm monitoring, the characteristics may be an infestation of pests or withered crops. In convenience store shelf monitoring, the characteristics may be a shortage of displayed products. The MCU 120 may include a processor or a neural network. The MCU 120 includes a determination unit 121, a communication unit 122, a control unit 123, and a power control unit 124. The MCU 120 is an example of a controller described in the claims.

[0035] The determination unit 121 determines the features of the imaging data detected by the AI ​​processing unit 112. For example, the determination unit 121 can determine whether or not a feature of the imaging data detected by the AI ​​processing unit 112 requires notification. At this time, the determination unit 121 can determine whether or not a feature of the imaging data detected by the AI ​​processing unit 112 requires notification based on the urgency and importance of the feature of the imaging data detected by the AI ​​processing unit 112. If the determination unit 121 determines that a feature requires notification, it notifies the communication unit 122 of the determination result. If the determination unit 121 determines that a feature requires notification, it may send the determination result along with the image used for the determination to the communication unit 122. For example, with regard to a person's behavior, the determination unit 121 can determine that a normal movement such as walking is a feature that does not require notification, and that a suspicious movement such as theft is a feature that requires notification. With regard to a person's posture, the determination unit 121 can determine that a feature that does not require notification is when a person is standing upright on the road, and that a feature that does require notification is when a person has fallen on the road. In river monitoring, the determination unit 121 can determine that a feature of a river where the water level is below a specified value does not require notification, and can determine that a feature of a river where the water level is equal to or greater than a specified value requires notification. In shelf monitoring at a convenience store, the determination unit 121 can determine that a shortage of one type of product is a feature where notification does not require notification, and can determine that a shortage of multiple types of products is a feature where notification is required. The determination unit 121 may perform the determination based on a rule base or machine learning.

[0036] The communication unit 122 performs communication based on the determination result of the characteristics of the imaging data. For example, if the communication unit 122 determines that there is an abnormality in the characteristics of the imaging data, it transmits the determination result to the network 130. If the communication unit 122 determines that there is no abnormality in the characteristics of the imaging data, it suspends transmission of the determination result. At this time, the communication unit 122 may transition to a sleep state until the next startup.

[0037] The control unit 123 performs overall control of the entire camera 100. At this time, the control unit 123 can cause the imaging unit 111, the determination unit 121, and the power control unit 124 to operate in cooperation with each other. For example, if the control unit 123 determines that there is an abnormality in the characteristics of the imaging data, the control unit 123 can transition to a sleep state together with the imaging unit 111 after transmitting the determination result. Furthermore, if the control unit 123 determines that there is no abnormality in the characteristics of the imaging data, the control unit 123 can transition to a sleep state together with the imaging unit 111 without transmitting the determination result. The imaging unit 111 and control unit 123 in the sleep state can be periodically woken up based on the timing set in the timer 150 and transition to an active state.

[0038] The power supply control unit 124 controls the power supply circuit 140 and the timer 150. For example, the power supply control unit 124 controls the on / off of the power supply circuit 140 and the operation timing of the timer 150.

[0039] The network 130 provides a communication environment for the camera 100. The network 130 may include a wide area network (WAN) such as the Internet, or a local area network (LAN) such as Wi-Fi or Ethernet (registered trademark). The network 130 may also include a cellular communication network such as a mobile phone network, or a short-range wireless communication network such as near field communication (NFC) or Bluetooth (registered trademark). In this case, the communication partner of the camera 100 may be the cloud, a local server, or storage.

[0040] For example, a management center 160 and a supplier 170 are connected to the network 130. In this case, the camera 100 can communicate with the management center 160 via the network 130. The management center 160 can communicate with the supplier 170 via the network 130.

[0041] The power supply circuit 140 supplies power to the image sensor 110 and the MCU 120. The image sensor 110 and the MCU 120 may have separate power supply systems. The power supply circuit 140 may power the camera 100 using a battery, or may power the camera 100 using power drawn from a power line.

[0042] The timer 150 sets the on / off time of the power supply circuit 140 and sets the sleep time and startup time of the power supply circuit 140. For example, the timer 150 can set the startup timing of the image sensor 110 and the MCU 120 that are in a sleep state other than the timer 150.

[0043] The management center 160 manages the status of the monitoring target monitored by the camera 100. The management center 160 includes a server 161 and a storage unit 162.

[0044] The server 161 determines the characteristics of the data acquired by the camera 100. The server 161 then receives the determination result from the camera 100 based on communication performed in accordance with the determination result of the data characteristics. For example, if the server 161 determines that there is an abnormality in the data characteristics, the server 161 can receive the determination result, and if it determines that there is no abnormality in the data characteristics, the server 161 can suspend reception of the determination result. The storage unit 162 stores management information required for dealing with the determination result of the data characteristics transmitted from the camera 100.

[0045] The server 161 includes a communication unit 163 and a management unit 164. The communication unit 163 receives the determination result of the data characteristics from the camera 100 based on communication performed in accordance with the determination result. The management unit 164 manages the determination results of the data characteristics transmitted from the camera 100. The management unit 164 can also manage the status of the camera 100 based on communication with the camera 100. The status of the camera 100 can include whether the camera 100 is in an activatable state or an inactivatable state. In the following description, it is assumed that the management center 160 manages products in a convenience store.

[0046] At this time, the communication unit 163 receives out-of-stock information about a product from the camera 100 based on communication performed in accordance with the result of determining whether a product displayed on a shelf is out of stock. The management unit 164 manages the replenishment of that product based on the out-of-stock information about the product transmitted from the camera 100. At this time, the memory unit 162 can store the quantities X1, X2 of each product B1, B2, ... to be delivered to each delivery destination A1, .... When the out-of-stock information about the product is transmitted from the camera 100, the management unit 164 can access the memory unit 162, identify the delivery destination and quantity of the out-of-stock product, and instruct the communication unit 163 to notify the delivery company 170. In accordance with the instruction from the management unit 164, the communication unit 163 notifies the delivery company 170 of the delivery destination and quantity of the out-of-stock product via the network 130.

[0047] The delivery company 170 is provided with a server 171 and a display unit 172. The server 171 receives instructions from the management center 160. The display unit 172 displays the out-of-stock status of products based on the instructions from the server 171. For example, the display unit 172 can display whether or not each product B1, B2, ... is out of stock for each delivery destination A1, .... When the server 171 receives instructions from the management center 160, it can update the out-of-stock status of products displayed on the display unit 172. The delivery company 170 can then identify the out-of-stock products and delivery destinations by referring to the display unit 172 and make delivery arrangements for those products.

[0048] 2 is a diagram showing an example of a communication sequence according to the first embodiment. Note that the diagram shows an example of a communication sequence in normal mode. The following description of the communication sequence will be given using shelf monitoring in a convenience store as an example.

[0049] In the figure, a convenience store is equipped with shelves 160. A camera 100 is attached to the convenience store at a position where the shelf 160 is within its field of view. The camera 100 is connected to a network 130.

[0050] The camera 100 can alternate between an active state and a sleep state. The camera 100 can activate the active state, for example, every few tens of minutes. At this time, the camera 100 in the sleep state can transition to the active state based on the setting of the timer 150. When the camera 100 transitions to the active state, the imaging unit 111 captures an image of the shelf 160. Next, the AI ​​processing unit 112 detects whether there is a missing item 162 on the shelf 160, and the determination unit 121 determines whether the missing item 162 requires notification. In normal mode, the communication unit 122 uploads the detection result of the missing item 162 on the shelf 160 to the network 130 (active A1 to A3) without relying on the determination result of the determination unit 121. When the detection result of the missing item 162 on the shelf 160 is uploaded to the network 130, the camera 100 transitions to the sleep state.

[0051] In normal mode, even when notification of a shortage 162 on the shelf 160 is not required, the detection result of the shortage 162 on the shelf 160 is uploaded to the network 130. This lengthens the active state of the camera 100 each time it is started up, and the power consumption of the camera 100 increases accordingly.

[0052] 3 is a diagram showing another example of a communication sequence according to the first embodiment, which illustrates an example of a communication sequence in a power saving mode.

[0053] In the figure, the camera 100 can alternate between an active state and a sleep state. At this time, the camera 100 in the sleep state can transition to the active state based on the setting of the timer 150. In the sleep state, the camera 100 can reduce its power consumption by simply maintaining the power supply circuit 140 and the timer 150 in the active state. When the camera 100 transitions to the active state, the imaging unit 111 captures an image of the shelf 160. Next, the AI ​​processing unit 112 detects whether there is a missing item 162 on the shelf 160, and the determination unit 121 determines whether the missing item 162 requires notification. If notification of the missing item 162 is required, the communication unit 122 uploads the determination result to the network 130 (active A13). On the other hand, if there is no missing item 162, the communication unit 122 does not upload the determination result of the missing item 162 to the network 130 (active A11, A12). Furthermore, if a notification of missing item 162 is not required, communication unit 122 does not upload the determination result to network 130. When it is determined that a notification of missing item 162 is required, camera 100 transitions to a sleep state once the determination result is uploaded to network 130. If there is no missing item 162 or if it is determined that a notification of missing item 162 is not required, camera 100 transitions to a sleep state without uploading the determination result to network 130.

[0054] In the power saving mode, if there is no missing item 162 on the shelf 160 or if notification of the missing item 162 on the shelf 160 is not required, the determination result is not uploaded to the network 130. Therefore, if there is no missing item 162 on the shelf 160 or if notification of the missing item 162 on the shelf 160 is not required, the active state of the camera 100 can be shortened, and the power consumption of the camera 100 can be reduced accordingly.

[0055] FIG. 4 is a flowchart illustrating an example of a communication method according to the first embodiment.

[0056] In the figure, the camera 100 in the sleep state is started up based on the setting of the timer 150 and transitions to the active state (S101).

[0057] Next, when the camera 100 transitions to an active state, the imaging unit 111 captures an image of the monitoring target (S102).

[0058] Next, the AI ​​processing unit 112 detects the characteristics of the imaging data generated by the imaging unit 111 (S103).

[0059] Next, the determination unit 121 determines whether or not there is an abnormality in the characteristics of the imaging data detected by the AI ​​processing unit 112 (S104).

[0060] If there is an abnormality in the characteristics of the imaging data, the communication unit 122 transmits the determination result to the network 130 (S105). On the other hand, if there is no abnormality in the characteristics of the imaging data, the communication unit 122 skips transmitting the determination result and proceeds to S106.

[0061] Next, the determining unit 121 determines how many times the edge device has been started since the previous transmission of the edge device state (S106).

[0062] If the number of activations since the previous transmission of the edge device status is equal to or greater than the set number, the communication unit 122 transmits the edge device status to the network 130 (S107). The edge device status may be the remaining battery level of the camera 100, the settings of the camera 100, or the number of activations of the camera 100. The settings of the camera 100 may be performed via the network 130. In this case, power consumption can be reduced by reducing the transmission frequency. The setting of the transmission frequency may be changed via the network 130 or by using image recognition such as a QR code (registered trademark). On the other hand, if the number of activations since the previous transmission of the edge device status is less than the set number, the transmission of the edge device status is skipped, and the process proceeds to S108.

[0063] Here, if there is no abnormality in the characteristics of the imaging data, the camera 100 does not access the network 130. For this reason, it is not possible to determine from the network 130 whether there is no access from the camera 100 because there is no abnormality in the characteristics of the imaging data, or whether there is an abnormality in the characteristics of the imaging data but the camera 100 is not operating. For this reason, the communication unit 122 can recognize the operation of the camera 100 by transmitting the edge device status to the network 130, and it can be confirmed on the network 130 side that the camera 100 is normally performing an abnormality determination on the characteristics of the imaging data.

[0064] Next, if the number of times the camera 100 has been started after transmitting the edge device status or after transmitting the previous edge device status is less than the set number of times, the camera 100 transitions to a sleep state (S108). Note that during sleep, the sleep mode of each device may be used, or the power of all devices except the timer 150 may be turned off.

[0065] In this way, in the first embodiment described above, the communication unit 122 transmits the determination result when it is determined that there is an abnormality in the characteristics of the imaging data, and suspends communication when it is determined that there is no abnormality in the characteristics of the imaging data. This allows the camera 100 to reduce the amount of communication when there is no abnormality in the characteristics of the imaging data, thereby enabling power saving.

[0066] 2. Second Embodiment In the first embodiment described above, if it is determined that there is an abnormality in the characteristics of the imaging data, the determination result is transmitted, and if it is determined that there is no abnormality in the characteristics of the imaging data, communication is paused. In this second embodiment, if it is determined that there is an abnormality in the characteristics of the imaging data, the image and the determination result are transmitted if the remaining battery power is sufficient, and if the remaining battery power is low, only the determination result is transmitted.

[0067] FIG. 5 is a block diagram showing an example of the configuration of an imaging apparatus according to the second embodiment.

[0068] In the figure, camera 200 includes MCU 220 instead of MCU 120 of the first embodiment described above. Other configurations of camera 200 of the second embodiment are similar to those of camera 100 of the first embodiment described above.

[0069] The MCU 220 includes a determination unit 221 and a control unit 223 instead of the determination unit 121 and the control unit 123 of the first embodiment described above. Furthermore, the MCU 220 includes a battery remaining capacity detection unit 224 in addition to the MCU 120 of the first embodiment described above. Other configurations of the MCU 220 of the second embodiment are the same as the configurations of the MCU 120 of the first embodiment described above. Note that the battery remaining capacity detection unit 224 may be added outside the MCU 120.

[0070] The battery remaining capacity detection unit 224 detects the remaining capacity of the battery that powers the camera 200. In this case, the battery can be mounted on the camera 200. The battery is, for example, a lithium thionyl chloride battery. The battery may also be mounted outside the camera 200.

[0071] The determination unit 221 determines the characteristics of the imaging data detected by the AI ​​processing unit 112. For example, the determination unit 221 can determine whether any of the characteristics of the imaging data detected by the AI ​​processing unit 112 require notification. The determination unit 221 also determines the remaining battery level detected by the battery remaining level detection unit 224. For example, the determination unit 221 can determine whether the remaining battery level detected by the battery remaining level detection unit 224 is sufficient or low. If the determination unit 221 determines that the characteristics of the imaging data require notification, it can adjust the amount of communication based on the remaining battery level. For example, when the remaining battery level is sufficient, the determination unit 221 can notify the communication unit 122 of not only the determination result of the characteristics of the imaging data but also the image used for the determination. On the other hand, when the remaining battery level is low, the determination unit 221 can notify the communication unit 122 of only the determination result of the characteristics of the imaging data.

[0072] The control unit 223 performs overall control of the entire camera 200. At this time, the control unit 223 can cause the imaging unit 111, the determination unit 221, and the power supply control unit 124 to operate in coordination with each other based on the remaining battery level. For example, if the control unit 223 determines that there is an abnormality in the characteristics of the imaging data, it can transition to a sleep state together with the imaging unit 111 after transmitting the determination result or an image together with the determination result, depending on the remaining battery level. Furthermore, if the control unit 223 determines that there is no abnormality in the characteristics of the imaging data, it can transition to a sleep state together with the imaging unit 111 without transmitting the determination result or an image.

[0073] FIG. 6 is a diagram illustrating an example of a communication sequence according to the second embodiment.

[0074] In the figure, camera 200 is equipped with battery 210. Camera 200 can alternate between an active state and a sleep state based on the power supply from battery 210. At this time, camera 200 in the sleep state can transition to the active state based on the setting of timer 150. When camera 200 transitions to the active state, imaging unit 111 captures an image of shelf 160. Next, AI processing unit 112 detects whether there is a missing item 162 on shelf 160, and determination unit 221 determines whether the missing item 162 requires notification. If determination unit 221 determines that the missing item 162 requires notification, it determines the remaining charge of battery 210. Then, if communication unit 122 determines that there is sufficient remaining charge in battery 210, it uploads the determination result of missing item 162 to network 130 along with the image used for the determination (active A23). Furthermore, when it is determined that the remaining charge of the battery 210 is low, the communication unit 122 uploads only the determination result of the missing item 162 to the network 130 (active A25). On the other hand, when there is no missing item 162, the communication unit 122 does not upload the determination result of the missing item 162 to the network 130 (active A21, A22, A24). Furthermore, when a notification of the missing item 162 is unnecessary, the communication unit 122 does not upload the determination result to the network 130. When it is determined that a notification of the missing item 162 is necessary, the determination result or an image together with the determination result is uploaded to the network 130 according to the remaining charge of the battery 210, and the camera 200 transitions to a sleep state. When there is no missing item 162 or when it is determined that a notification of the missing item 162 is unnecessary, the camera 200 transitions to a sleep state without uploading the determination result and image to the network 130.

[0075] Here, by uploading only the determination result of out-of-stock 162 to network 130 when battery 210 has little remaining power, the active state of camera 200 can be shortened compared to when an image is uploaded to network 130. Therefore, the power consumption of camera 200 can be reduced by the amount that the active state of camera 200 is shortened, and the battery life can be extended.

[0076] FIG. 7 is a flowchart illustrating an example of a communication method according to the second embodiment.

[0077] In the figure, this flow is the same as the flow of the first embodiment except that steps S201 and S202 have been added. The other steps in the flow of the second embodiment are the same as those in the flow of the first embodiment.

[0078] In the flow of the second embodiment, when the judgment unit 121 determines that there is an abnormality in the characteristics of the imaging data detected by the AI ​​processing unit 112 (S104), it judges the remaining charge of the battery installed in the camera 200 (S201).

[0079] If the remaining battery power is equal to or greater than the first remaining power, the communication unit 122 transmits the determination result together with the image used for the determination to the network 130 (S202), and the process proceeds to S106. On the other hand, if the remaining battery power is less than the first remaining power, the communication unit 122 transmits only the determination result to the network 130 (S105), and the process proceeds to S106. Note that the first remaining power can be set to a value that indicates that the battery power is sufficient. Furthermore, the type of data transmitted according to the remaining battery power may be changed depending on the use case. For example, the image may be compressed or the file format may be changed according to the remaining battery power.

[0080] In this way, in the second embodiment described above, when it is determined that there is an abnormality in the characteristics of the imaging data, the communication unit 122 transmits the image and the determination result if the remaining battery charge is sufficient, and transmits only the determination result if the remaining battery charge is low. This allows the communication unit 122 to adjust the communication volume according to the remaining battery charge, making it possible to notify of abnormalities in the characteristics of the imaging data while also extending the battery life.

[0081] 3. Third Embodiment In the second embodiment described above, when it is determined that there is an abnormality in the characteristics of the imaging data, the image and the determination result are transmitted if the remaining battery charge is sufficient, and when the remaining battery charge is low, only the determination result is transmitted. In this third embodiment, when it is determined that there is an abnormality in the characteristics of the imaging data, if there is almost no remaining battery charge, multiple determination results are transmitted together.

[0082] FIG. 8 is a block diagram showing an example of the configuration of an imaging apparatus according to the third embodiment.

[0083] In the figure, the camera 300 includes an MCU 320 instead of the MCU 220 of the second embodiment described above. The other configuration of the camera 300 of the third embodiment is the same as the configuration of the camera 200 of the second embodiment described above.

[0084] The MCU 320 includes a determination unit 321 and a control unit 323 instead of the determination unit 221 and the control unit 223 of the second embodiment. The MCU 320 also includes a storage unit 234 in addition to the components of the MCU 220 of the second embodiment. The other configurations of the MCU 320 of the third embodiment are the same as those of the MCU 220 of the second embodiment. The storage unit 234 may be added outside the MCU 220.

[0085] The determination unit 321 determines the characteristics of the imaging data detected by the AI ​​processing unit 112. For example, the determination unit 321 can determine whether any of the characteristics of the imaging data detected by the AI ​​processing unit 112 require notification. The determination unit 321 also determines the remaining battery level detected by the battery remaining level detection unit 224. For example, the determination unit 321 can determine whether the remaining battery level detected by the battery remaining level detection unit 224 is sufficient, low, or almost nonexistent. If the determination unit 321 determines that the characteristics of the imaging data require notification, it can adjust the amount of communication based on the remaining battery level. For example, when the remaining battery level is sufficient, the determination unit 321 can notify the communication unit 122 of not only the determination result of the characteristics of the imaging data but also the image used for the determination. When the remaining battery level is low, the determination unit 321 can notify the communication unit 122 of only the determination result of the characteristics of the imaging data. On the other hand, when the battery is almost empty, the determination unit 321 can notify the communication unit 122 of only the determination results of the characteristics of the imaging data for multiple times all at once.

[0086] The control unit 323 performs overall control of the entire camera 300. At this time, the control unit 323 can coordinate the imaging unit 111, the determination unit 321, the storage unit 324, and the power supply control unit 124 based on the remaining battery level and the number of times that determination results for the characteristics of the imaging data have been accumulated. The control unit 323 can store data in the storage unit 324 based on the determination result of the determination unit 321. For example, if the control unit 323 determines that there is an abnormality in the characteristics of the imaging data, it can store the determination result together with the image used for the determination in the storage unit 324. Then, the control unit 323 can transition to a sleep state together with the imaging unit 111 after transmitting the determination result or an image together with the determination result, depending on the remaining battery level. Furthermore, if the control unit 323 determines that there is an abnormality in the characteristics of the imaging data, it can transition to a sleep state together with the imaging unit 111 after transmitting only the determination result multiple times in a batch, depending on the remaining battery level and the number of times that determination results have been accumulated. Furthermore, if the control unit 323 determines that there is no abnormality in the characteristics of the imaging data, the control unit 323 can transition to a sleep state together with the imaging unit 111 without transmitting the determination result and the image.

[0087] The storage unit 324 stores the determination results of the characteristics of the captured image data. The storage unit 324 may be a volatile memory such as a dynamic random access memory (DRAM) or a non-volatile memory such as a flash memory. When a volatile memory is used as the storage unit 324, the power supply of the storage unit 324 can be maintained even when the camera 300 transitions to a sleep state.

[0088] FIG. 9 illustrates an example of a communication sequence according to the third embodiment.

[0089] In the figure, the camera 300 can alternate between an active state and a sleep state based on power supplied from the battery 210. At this time, the camera 300 in the sleep state can transition to the active state based on the setting of the timer 150. When the camera 300 transitions to the active state, the imaging unit 111 captures an image of the shelf 160. Next, the AI ​​processing unit 112 detects whether there is a missing item 162 on the shelf 160, and the determination unit 321 determines whether the missing item 162 requires notification. If the determination unit 321 determines that the missing item 162 requires notification, it determines the remaining charge of the battery 210. Then, if the communication unit 122 determines that the remaining charge of the battery 210 is sufficient, it uploads the determination result of the missing item 162 along with the image used for the determination to the network 130. Furthermore, if the communication unit 122 determines that the remaining charge of the battery 210 is low, it uploads only the determination result of the missing item 162 to the network 130 (active A33). Furthermore, when it is determined that the battery 210 has almost no remaining charge, the communication unit 122 uploads only the determination results of the out-of-stock 162 for multiple times to the network 130 (active A35). On the other hand, when there is no out-of-stock 162, the communication unit 122 does not upload the determination results of the out-of-stock 162 to the network 130 (active A31, A32). Furthermore, when notification of the out-of-stock 162 is not necessary, the communication unit 122 does not upload the determination results to the network 130. Furthermore, when it is determined that the battery 210 has almost no remaining charge and multiple determination results of the out-of-stock 162 have not been accumulated, the communication unit 122 does not upload the determination results to the network 130 (active A34). When it is determined that notification of the out-of-stock 162 is necessary, the determination results or images together with the determination results are uploaded to the network 130 depending on the remaining battery charge or the number of accumulated determination results of the out-of-stock 162, and the camera 300 transitions to a sleep state. If there is no missing item 162 or if it is determined that notification of the missing item 162 is unnecessary, the camera 300 goes into a sleep state without uploading the determination result and the image to the network 130 .

[0090] Here, when the battery is almost empty, multiple batches of the determination results of out-of-stock items 162 alone are uploaded to the network 130. This allows the active state of the camera 300 to be shortened compared to when only the determination results of out-of-stock items 162 are uploaded to the network 130 individually each time. This allows the power consumption of the camera 300 to be reduced by the amount that the active state of the camera 300 is shortened, thereby enabling the battery life to be extended.

[0091] FIG. 10 is a flowchart illustrating an example of a communication method according to the third embodiment.

[0092] In the figure, this flow is the same as the flow of the second embodiment except that steps S301 to S304 have been added. The other steps in the flow of the third embodiment are the same as those in the flow of the second embodiment.

[0093] In the flow of the third embodiment, if the remaining battery power is equal to or greater than the first remaining power, the communication unit 122 transmits the determination result together with the image used for the determination to the network 130 (S202), and the process proceeds to S106. If the remaining battery power is less than the first remaining power but equal to or greater than the second remaining power, the communication unit 122 transmits only the determination result to the network 130 (S105), and the process proceeds to S106. The second remaining power can be set to a value that indicates that the battery power is almost depleted.

[0094] On the other hand, if the remaining battery charge is less than the second remaining charge, the determination unit 321 determines whether N (N is an integer equal to or greater than 2) abnormality determination results for the imaging data characteristics have been accumulated (S301). If N abnormality determination results for the imaging data characteristics have been accumulated, the communication unit 122 transmits only the N abnormality determination results to the network 130 (S302). Then, the communication unit 122 transmits the edge device status to the network 130 (S304), and then proceeds to S108. On the other hand, if N abnormality determination results for the imaging data characteristics have not been accumulated, the control unit 323 stores the current abnormality determination result for the imaging data characteristics in the storage unit 324 (S303), and then proceeds to S108. The type of data transmitted depending on the remaining battery charge may be changed depending on the use case.

[0095] In this way, in the third embodiment described above, when it is determined that there is an abnormality in the characteristics of the imaging data, if the battery is almost low, the communication unit 122 transmits multiple determination results together. This allows the communication unit 122 to adjust the number of communications according to the battery level, making it possible to notify of abnormalities in the characteristics of the imaging data while also extending the life of the battery.

[0096] If the battery is almost empty, the results of multiple tests may be stored locally. Data may also be transmitted when the battery level increases based on a combination of energy harvesting and solar cells.

[0097] 4. Fourth Embodiment In the second embodiment described above, when an abnormality is determined in the characteristics of the captured image data, the image and the determination result are transmitted if the remaining battery charge is sufficient, and only the determination result is transmitted if the remaining battery charge is low. In this fourth embodiment, the communication interval is extended when the remaining battery charge is low.

[0098] FIG. 11 is a flowchart illustrating an example of a communication method according to the fourth embodiment.

[0099] In the figure, this flow is the same as the flow of the first embodiment except that steps S401 to S403 have been added. The remaining steps in the flow of the fourth embodiment are the same as those in the flow of the first embodiment.

[0100] In the flow of the fourth embodiment, when the AI ​​processing unit 112 detects the characteristics of the imaging data (S103), the determination unit 221 determines the remaining charge of the battery installed in the camera 200 (S401).

[0101] If the remaining battery power is equal to or greater than the first remaining power, the control unit 223 sets the communication interval to normal (S402) and proceeds to S104. On the other hand, if the remaining battery power is less than the first remaining power, the control unit 223 extends the communication interval (S403) and proceeds to S104. For example, the camera 200 can activate the active state at intervals of several tens of minutes when the remaining battery power is equal to or greater than the first remaining power, and can activate the active state at intervals of several hours when the remaining battery power is less than the first remaining power. The communication interval can be stored in a memory unit installed in the camera 200. The communication interval may be set to three or more levels depending on the use case.

[0102] In this way, in the fourth embodiment described above, the communication unit 122 extends the communication interval when the remaining battery power is low, which allows the communication unit 122 to adjust the communication frequency according to the remaining battery power, thereby enabling notification of abnormalities in the characteristics of the imaging data and extending the battery life.

[0103] 5. Fifth Embodiment In the fourth embodiment described above, the communication interval is extended when the remaining battery power is low. In this fifth embodiment, when the remaining battery power is low, the battery is switched to a spare battery.

[0104] FIG. 12 is a block diagram showing an example of the configuration of an imaging apparatus according to the fifth embodiment.

[0105] In the figure, camera 500 includes an MCU 520 and a power supply circuit 540 instead of MCU 220 and power supply circuit 140 of the second embodiment described above. Other configurations of camera 500 of the fifth embodiment are similar to those of camera 200 of the second embodiment described above.

[0106] The MCU 520 includes a control unit 523 instead of the control unit 223 of the second embodiment. Other configurations of the MCU 520 of the fifth embodiment are similar to the configurations of the MCU 220 of the second embodiment.

[0107] The control unit 523 performs overall control of the entire camera 500. At this time, the control unit 523 can coordinate the operation of the imaging unit 111, the determination unit 221, and the power supply control unit 124 based on the remaining battery power. For example, the control unit 523 can instruct the power supply control unit 124 to switch between the normal battery 540A and the backup battery 540B based on the remaining battery power. Furthermore, if the control unit 523 determines that there is an abnormality in the characteristics of the imaging data, it can transition to a sleep state together with the imaging unit 111 after transmitting the determination result. Furthermore, if the control unit 523 determines that there is no abnormality in the characteristics of the imaging data, it can transition to a sleep state together with the imaging unit 111 without transmitting the determination result.

[0108] The power supply circuit 540 includes a normal battery 540A and a backup battery 540B. The normal battery 540A and the backup battery 540B supply power to the image sensor 110 and the MCU 520. The normal battery 540A and the backup battery 540B may be of the same type or different types. The normal battery 540A and the backup battery 540B may have the same capacity or different capacities. For example, the normal battery 540A may be a lithium thionyl chloride battery, and the backup battery 540B may be a LiMnO 2 A battery may also be used. The battery 540A is typically LiMnO 2 The battery 540A and the spare battery 540B may be large-capacity batteries. The normal battery 540A and the spare battery 540B may be added outside the camera 500.

[0109] FIG. 13 is a flowchart illustrating an example of a communication method according to the fifth embodiment.

[0110] In the figure, this flow adds steps S501 to S503 to the flow of the first embodiment. The other steps in the flow of the fifth embodiment are the same as those in the flow of the first embodiment.

[0111] In the flow of the fifth embodiment, when the AI ​​processing unit 112 detects the characteristics of the imaging data (S103), the determination unit 221 determines the remaining charge of the normal battery 540A (S501).

[0112] If the remaining charge of the normal battery 540A is equal to or greater than the first remaining charge, the control unit 523 shifts the process to S104. On the other hand, if the remaining charge of the normal battery 540A is less than the first remaining charge, the control unit 523 switches the power source of the camera 500 from the normal battery 540A to the backup battery 540B (S502), and shifts the process to S104.

[0113] Furthermore, after the communication unit 122 transmits the edge device status (S107), the control unit 523 switches the power source of the camera 500 back from the backup battery 540B to the normal battery 540A (S503).

[0114] In this way, in the fifth embodiment described above, when the remaining charge of the normal battery 540A is low, the control unit 523 switches to the backup battery 540B. This allows the camera 500 to notify of an abnormality in the characteristics of the captured image data based on battery operation, even when the remaining charge of the normal battery 540A is low.

[0115] 6. Sixth Embodiment In the first embodiment described above, if it is determined that there is an abnormality in the characteristics of the imaging data, the determination result is transmitted, and if it is determined that there is no abnormality in the characteristics of the imaging data, communication is paused. In this sixth embodiment, if there is a large change in the imaging data, the communication interval is shortened, and if there is a small change in the imaging data, the communication interval is extended.

[0116] FIG. 14 is a diagram illustrating an example of a communication sequence according to the sixth embodiment.

[0117] In the figure, the camera 100 can alternate between an active state and a sleep state. At this time, the camera 100 in the sleep state can transition to the active state based on the setting of the timer 150. When the camera 100 transitions to the active state, the imaging unit 111 captures an image of the shelf 160. Next, the AI ​​processing unit 112 detects whether there is a missing item 162 on the shelf 160. Next, the determination unit 121 determines the amount of change between the imaging data previously processed by the AI ​​processing unit 112 and the imaging data currently processed by the AI ​​processing unit 112. Then, if the amount of change between the imaging data is large, the determination unit 121 shortens the communication interval, and if the amount of change between the imaging data is small, the determination unit 121 extends the communication interval. Next, if there is a missing item 162 on the shelf 160, the determination unit 121 determines whether there is a need to notify the shelf 160 of the missing item 162. If a notification of the missing item 162 is necessary, the communication unit 122 uploads the determination result to the network 130 (active A62, A63, A64). On the other hand, if there is no missing item 162, the communication unit 122 does not upload the determination result of the missing item 162 to the network 130 (active A61). Furthermore, if a notification of the missing item 162 is not necessary, the communication unit 122 does not upload the determination result to the network 130. When it is determined that a notification of the missing item 162 is necessary and the determination result is uploaded to the network 130, the camera 100 transitions to a sleep state. When there is no missing item 162 or when it is determined that a notification of the missing item 162 is not necessary, the camera 100 transitions to a sleep state without uploading the determination result to the network 130. At this time, the communication interval is changed based on an increase or decrease in the amount of change between the captured image data, and the sleep period is increased or decreased. To increase or decrease the sleep period, the control unit 123 can instruct the power supply control unit 124 to change the setting of the timer 150 based on the determination result of the determination unit 121 .

[0118] By changing the communication interval based on the increase or decrease in the amount of change between the captured image data, it is possible to reduce the amount of communication when there is little change in the state of the stockout 162. As a result, it is possible to reduce the active state of the camera 100 while reducing the redundancy of notifications of the stockout 162, and accordingly reduce the power consumption of the camera 100.

[0119] FIG. 15 is a flowchart illustrating an example of a communication method according to the sixth embodiment.

[0120] In the figure, this flow adds steps S601 to S603 to the flow of the first embodiment. The other steps in the flow of the sixth embodiment are the same as those in the flow of the first embodiment.

[0121] In the flow of the sixth embodiment, when the AI ​​processing unit 112 detects a feature of the imaging data (S103), the determination unit 121 determines whether the change in the imaging data is equal to or greater than a specified value (S601).

[0122] If the change in the imaging data is equal to or greater than a specified value, the determination unit 121 shortens the communication interval (S602) and proceeds to S104. On the other hand, if the change in the imaging data is less than the specified value, the determination unit 121 lengthens the communication interval (S603) and proceeds to S104. The communication interval may be changed over three or more stages depending on the use case. The communication interval may also be set according to temperature, season, time of day, or the like. For example, in a refrigerated shelf where beverages are placed, the communication interval may be shortened during the daytime in summer and at night in winter.

[0123] As described above, in the sixth embodiment, the determination unit 121 shortens the communication interval when there is a large change in the imaging data and extends the communication interval when there is a small change in the imaging data. This allows the communication unit 122 to adjust the communication frequency according to the amount of change in the imaging data, thereby enabling notification of abnormalities in the characteristics of the imaging data and extending battery life. For example, in a convenience store or supermarket, the number of products 161 on the shelves 160 changes drastically during busy times, but the number of products 161 on the shelves 160 changes little during quiet times. By extending the communication interval during quiet times when the number of products 161 on the shelves 160 changes little, it is possible to extend battery life while preventing missed notifications of out-of-stock items 162.

[0124] 7. Seventh Embodiment In the sixth embodiment described above, the communication interval is shortened when there are many changes in the imaging data, and the communication interval is extended when there are few changes in the imaging data. In this seventh embodiment, when it is determined that there is an abnormality in the characteristics of the imaging data, if there is a change from the previous communication, the determination result is transmitted, and if there is no change from the previous communication, the determination result is not transmitted.

[0125] FIG. 16 is a diagram illustrating an example of a communication sequence according to the seventh embodiment.

[0126] In the figure, the camera 100 can alternate between an active state and a sleep state. At this time, the camera 100 in the sleep state can transition to the active state based on the setting of the timer 150. When the camera 100 transitions to the active state, the imaging unit 111 captures an image of the shelf 160. Next, the AI ​​processing unit 112 detects whether there is a missing item 162 on the shelf 160, and the determination unit 121 determines whether the missing item 162 requires notification. If notification of the missing item 162 is required, the determination unit 121 determines whether the status of the missing item 162 matches the status of the missing item 162 at the time of the previous transmission. If the communication unit 122 determines that the status of the missing item 162 at the time of the previous transmission matches, the communication unit 122 does not upload the current determination result to the network 130 (active A73). On the other hand, if the communication unit 122 determines that the status of the missing item 162 at the time of the previous transmission does not match the status of the missing item 162 at the time of the previous transmission, the communication unit 122 uploads the current determination result to the network 130 (active A72, A74). On the other hand, if there is no missing item 162, the communication unit 122 does not upload the determination result of the missing item 162 to the network 130 (active A71, A75). Furthermore, if notification of the missing item 162 is not necessary, the communication unit 122 does not upload the determination result to the network 130. When it is determined that notification of the missing item 162 is necessary, the determination result is uploaded to the network 130, and the camera 100 transitions to a sleep state. If there is no missing item 162 or if it is determined that notification of the missing item 162 is not necessary, the determination result is not uploaded to the network 130, and the camera 100 transitions to a sleep state. Furthermore, if it is determined that the current status of the missing item 162 matches the status of the missing item 162 at the time of the previous transmission, the current determination result is not uploaded to the network 130, and the camera 100 transitions to a sleep state.

[0127] By determining whether or not to transmit based on a change in the status of the out-of-stock item 162, it is possible to prevent communication from being performed if there is no change in the status of the out-of-stock item 162. This makes it possible to shorten the active state of the camera 100 without missing notifications of the out-of-stock item 162, thereby reducing the power consumption of the camera 100 accordingly.

[0128] FIG. 17 is a flowchart illustrating an example of a communication method according to the seventh embodiment.

[0129] In the figure, this flow is the same as the flow of the first embodiment except for the addition of step S701. The other steps in the flow of the seventh embodiment are the same as those in the flow of the first embodiment.

[0130] In the flow of the seventh embodiment, when the judgment unit 121 determines whether there is an abnormality in the characteristics of the imaging data detected by the AI ​​processing unit 112 (S104), it then determines whether the abnormality in the characteristics of the imaging data has changed since the last transmission (S701).

[0131] If the abnormality in the characteristics of the imaging data has changed since the previous transmission, the determination unit 121 shifts the process to S105. On the other hand, if the abnormality in the characteristics of the imaging data has not changed since the previous transmission, the determination unit 121 shifts the process to S106.

[0132] As described above, in the seventh embodiment, when it is determined that there is an abnormality in the characteristics of the imaging data, the communication unit 122 transmits the determination result if there is a change from the previous communication, and does not transmit the determination result if there is no change from the previous communication. As a result, even if there is an abnormality in the characteristics of the imaging data, the communication unit 122 can refrain from transmitting the abnormality in the characteristics of the imaging data if there is no change in the abnormality in the characteristics of the imaging data. This makes it possible to extend the life of the battery without reducing the amount of information to be notified of abnormalities in the characteristics of the imaging data.

[0133] 8. Eighth Embodiment In the first embodiment described above, the determination unit 121 that determines the characteristics of the imaging data is provided in the MCU 120. In this eighth embodiment, a determination unit that determines the characteristics of the imaging data is provided in the image sensor.

[0134] FIG. 18 is a block diagram showing an example of the configuration of an imaging apparatus according to the eighth embodiment.

[0135] In the figure, camera 800 includes an image sensor 810 and an MCU 820 instead of image sensor 110 and MCU 120 of the first embodiment described above. Other configurations of camera 800 of the eighth embodiment are similar to those of camera 100 of the first embodiment described above.

[0136] The image sensor 810 is obtained by adding a determination unit 801 and a power supply control unit 802 to the image sensor 110 of the first embodiment described above. The other configuration of the image sensor 810 of the eighth embodiment is the same as the configuration of the image sensor 110 of the first embodiment described above.

[0137] The MCU 820 includes a control unit 823 instead of the control unit 123 of the first embodiment described above. Furthermore, the MCU 820 is obtained by removing the determination unit 121 from the MCU 120 of the first embodiment described above. Other configurations of the MCU 820 of the eighth embodiment are similar to the configuration of the MCU 120 of the first embodiment described above.

[0138] The determination unit 801 is connected to the AI ​​processing unit 112. At this time, the AI ​​processing unit 112 can output the features of the imaging data detected by the AI ​​processing unit 112 to the determination unit 801 without using an interface. The determination unit 801 determines the features of the imaging data detected by the AI ​​processing unit 112. For example, the determination unit 801 can determine whether or not a feature of the imaging data detected by the AI ​​processing unit 112 requires notification. Then, when the determination unit 801 determines that a feature requires notification, it transmits the determination result to the MCU 820 and notifies the communication unit 122.

[0139] The power supply control unit 802 controls the power supply circuit 140. In this case, the power supply control unit 802 can control the power supply system of the image sensor 810 separately from the power supply system of the MCU 820.

[0140] The control unit 823 performs overall control of the entire camera 800. At this time, the control unit 823 can cause the imaging unit 111, the determination unit 801, and the power control unit 124 to operate in cooperation with each other. For example, when the image sensor 810 notifies the control unit 823 of a determination result that there is an abnormality in the characteristics of the imaging data, the control unit 823 can transition to a sleep state together with the imaging unit 111 after the determination result is transmitted from the communication unit 122. Furthermore, when the image sensor 810 notifies the control unit 823 of a determination result that there is no abnormality in the characteristics of the imaging data, the control unit 823 can transition to a sleep state together with the imaging unit 111 without the determination result being transmitted from the communication unit 122. The imaging unit 111 and the control unit 823 in the sleep state can be periodically woken up based on the timing set in the timer 150 and transition to an active state.

[0141] FIG. 19 is a flowchart showing an example of a communication method according to the eighth embodiment.

[0142] In the figure, this flow is the same as the flow of the first embodiment except that steps S106 and S107 have been deleted. The remaining steps in the flow of the eighth embodiment are the same as those in the flow of the first embodiment.

[0143] If there is an abnormality in the characteristics of the imaging data, the communication unit 122 transmits the determination result of the characteristics of the imaging data to the network 130 (S105), and proceeds to S108. On the other hand, if there is no abnormality in the characteristics of the imaging data, the communication unit 122 skips transmitting the determination result, and proceeds to S108.

[0144] Here, the characteristics of the imaging data are determined within the image sensor 810. Therefore, if there is no abnormality in the characteristics of the imaging data, data transfer from the image sensor 810 to the MCU 820 is not necessary, and power consumption can be reduced accordingly.

[0145] As described above, in the eighth embodiment, the determination unit 801 that determines the characteristics of the imaging data is provided in the image sensor 810. This makes it possible to reduce the time required for data transfer from the AI ​​processing unit 112 to the determination unit 801, and to reduce the time lag between when the imaging unit 111 generates imaging data and when the determination result is generated by the determination unit 801.

[0146] 9. Ninth Embodiment In the first embodiment described above, the imaging unit 111 and the AI ​​processing unit 112 are provided in the image sensor 110. In this ninth embodiment, a semiconductor chip on which a pixel array unit of the imaging unit 111 is provided and a semiconductor chip on which a peripheral circuit of the imaging unit 111 and the AI ​​processing unit 112 are provided are stacked.

[0147] FIG. 20 is a perspective view showing an example of a stack of layers in a solid-state imaging device according to the ninth embodiment.

[0148] In the figure, the solid-state imaging device includes semiconductor chips 921 and 922. The semiconductor chip 922 is stacked on the semiconductor chip 921.

[0149] A pixel array section 930 is formed in the semiconductor chip 922. In the pixel array section 930, pixels 931 are arranged in a matrix in the row and column directions. Pad electrodes 932 and via electrodes 933 are formed around the pixel array section 930. The via electrodes 933 penetrate the semiconductor chip 922 and can electrically connect the semiconductor chips 921 and 922 to each other. The pixel array section 930 can be provided in the imaging section 111.

[0150] The semiconductor chip 921 is formed with a column readout circuit 922, a column ADC 923, a processor 924, a communication interface 925, and an oscillator circuit 926. The column readout circuit 922 can form a source follower with each pixel 931 when reading out a pixel signal from the pixel 931. The column ADC 923 performs analog-to-digital (AD) conversion on the pixel signals from each pixel 931 for each column. The processor 924 processes the pixel signals AD-converted by the column ADC 923. The processor 924 can be provided with an AI processing unit 112. The communication interface 925 transmits data output from the processor 924 to the MCU 120. At this time, the communication interface 925 can transmit data output from the AI ​​processing unit 112 to the MCU 120. The oscillator circuit 926 supplies a clock to the processor 924 and the communication interface 925.

[0151] As described above, in the ninth embodiment, the semiconductor chip 922 on which the pixel array unit 930 of the imaging unit 111 is provided is stacked with the semiconductor chip 921 on which the peripheral circuits of the imaging unit 111 and the AI ​​processing unit 112 are provided. This makes it possible to increase the sensitivity of the image sensor 110 while suppressing an increase in the mounting area of ​​the semiconductor chip 922 on which the pixel array unit 930 is provided.

[0152] In the above-described embodiment, an imaging device that communicates the results of determining the characteristics of imaging data has been described as an example. The present invention is not necessarily limited to imaging devices, but may also be a communication device that communicates the results of determining the characteristics of data. This data is not necessarily limited to imaging data, but may be, for example, event data, temperature data, vibration data, flow rate data, or pressure data.

[0153] 10. Application Examples to Mobile Bodies The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of mobile body, such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, personal mobility, an airplane, a drone, a ship, or a robot.

[0154] FIG. 21 is a block diagram showing a schematic configuration example of a vehicle control system, which is an example of a mobile object control system to which the technology according to the present disclosure can be applied.

[0155] The vehicle control system 12000 includes a plurality of electronic control units connected via a communication network 12001. In the example shown in Fig. 21 , the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an outside-vehicle information detection unit 12030, an inside-vehicle information detection unit 12040, and an integrated control unit 12050. Also shown as functional components of the integrated control unit 12050 are a microcomputer 12051, an audio / video output unit 12052, and an in-vehicle network I / F (interface) 12053.

[0156] The drivetrain control unit 12010 controls the operation of devices related to the drivetrain of the vehicle in accordance with various programs. For example, the drivetrain control unit 12010 functions as a control device for a drive force generating device for generating a drive force of the vehicle, such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting the drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating a braking force of the vehicle.

[0157] The body system control unit 12020 controls the operation of various devices equipped in the vehicle body according to various programs. For example, the body system control unit 12020 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as headlamps, backup lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves transmitted from a portable device that serves as a key or signals from various switches can be input to the body system control unit 12020. The body system control unit 12020 receives these radio waves or signals and controls the vehicle's door lock device, power window device, lamps, etc.

[0158] The outside-vehicle information detection unit 12030 detects information outside the vehicle equipped with the vehicle control system 12000. For example, an imaging unit 12031 is connected to the outside-vehicle information detection unit 12030. The outside-vehicle information detection unit 12030 causes the imaging unit 12031 to capture images outside the vehicle and receives the captured images. The outside-vehicle information detection unit 12030 may perform object detection processing or distance detection processing for people, cars, obstacles, signs, characters on the road surface, etc. based on the received images.

[0159] The imaging unit 12031 is an optical sensor that receives light and outputs an electrical signal corresponding to the amount of light received. The imaging unit 12031 can output the electrical signal as an image or as distance measurement information. The light received by the imaging unit 12031 may be visible light or invisible light such as infrared light.

[0160] The in-vehicle information detection unit 12040 detects information inside the vehicle. For example, a driver state detection unit 12041 that detects the state of the driver is connected to the in-vehicle information detection unit 12040. The driver state detection unit 12041 includes, for example, a camera that captures an image of the driver, and the in-vehicle information detection unit 12040 may calculate the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 12041, or may determine whether the driver is dozing off.

[0161] The microcomputer 12051 can calculate control target values ​​for the driving force generating device, steering mechanism, or braking device based on the information inside and outside the vehicle acquired by the outside-vehicle information detection unit 12030 or the inside-vehicle information detection unit 12040, and output control commands to the drive system control unit 12010. For example, the microcomputer 12051 can perform cooperative control aimed at realizing the functions of an ADAS (Advanced Driver Assistance System), including vehicle collision avoidance or impact mitigation, following driving based on the distance between vehicles, maintaining vehicle speed, vehicle collision warning, vehicle lane departure warning, etc.

[0162] In addition, the microcomputer 12051 can perform cooperative control for the purpose of autonomous driving, which allows the vehicle to travel autonomously without relying on driver operation, by controlling the driving force generating device, steering mechanism, braking device, etc. based on information about the surroundings of the vehicle obtained by the outside vehicle information detection unit 12030 or the inside vehicle information detection unit 12040.

[0163] Furthermore, the microcomputer 12051 can output a control command to the body system control unit 12020 based on the information outside the vehicle acquired by the outside information detection unit 12030. For example, the microcomputer 12051 can control the headlamps according to the position of a preceding vehicle or an oncoming vehicle detected by the outside information detection unit 12030, and perform cooperative control aimed at preventing glare, such as switching from high beams to low beams.

[0164] The audio / video output unit 12052 transmits at least one of audio and video output signals to an output device capable of visually or audibly notifying information to vehicle occupants or the outside of the vehicle. In the example of Fig. 21, the output devices are exemplified by an audio speaker 12061, a display unit 12062, and an instrument panel 12063. The display unit 12062 may include, for example, at least one of an on-board display and a head-up display.

[0165] FIG. 22 is a diagram showing an example of the installation position of the imaging unit 12031.

[0166] In FIG. 22, the imaging unit 12031 includes imaging units 12101, 12102, 12103, 12104, and 12105.

[0167] The imaging units 12101, 12102, 12103, 12104, and 12105 are provided, for example, at positions such as the front nose, side mirrors, rear bumper, back door, and the top of the windshield inside the vehicle cabin of the vehicle 12100. The imaging unit 12101 provided on the front nose and the imaging unit 12105 provided on the top of the windshield inside the vehicle cabin mainly acquire images of the front of the vehicle 12100. The imaging units 12102 and 12103 provided on the side mirrors mainly acquire images of the sides of the vehicle 12100. The imaging unit 12104 provided on the rear bumper or back door mainly acquires images of the rear of the vehicle 12100. The imaging unit 12105 provided on the top of the windshield inside the vehicle cabin is mainly used to detect preceding vehicles, pedestrians, obstacles, traffic lights, traffic signs, lanes, etc.

[0168] 22 shows an example of the imaging ranges of the imaging units 12101 to 12104. Imaging range 12111 indicates the imaging range of the imaging unit 12101 provided on the front nose, imaging ranges 12112 and 12113 indicate the imaging ranges of the imaging units 12102 and 12103 provided on the side mirrors, respectively, and imaging range 12114 indicates the imaging range of the imaging unit 12104 provided on the rear bumper or back door. For example, by overlaying the image data captured by the imaging units 12101 to 12104, an overhead image of the vehicle 12100 viewed from above can be obtained.

[0169] At least one of the image capturing units 12101 to 12104 may have a function of acquiring distance information. For example, at least one of the image capturing units 12101 to 12104 may be a stereo camera made up of multiple image capturing elements, or may be an image capturing element having pixels for phase difference detection.

[0170] For example, based on the distance information obtained from the imaging units 12101 to 12104, the microcomputer 12051 can calculate the distance to each three-dimensional object within the imaging ranges 12111 to 12114 and the change in this distance over time (relative speed with respect to the vehicle 12100), thereby extracting as a preceding vehicle, in particular, the three-dimensional object that is the closest three-dimensional object on the path of the vehicle 12100 and traveling in approximately the same direction as the vehicle 12100 at a predetermined speed (e.g., 0 km / h or higher). Furthermore, the microcomputer 12051 can set a vehicle-to-vehicle distance to be maintained in advance in front of the preceding vehicle, and perform automatic braking control (including follow-up stop control), automatic acceleration control (including follow-up start control), etc. In this way, cooperative control can be performed for the purpose of autonomous driving, which runs autonomously without relying on driver operation.

[0171] For example, the microcomputer 12051 classifies and extracts three-dimensional object data regarding three-dimensional objects into two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects based on distance information obtained from the imaging units 12101 to 12104, and can use the data for automatic obstacle avoidance. For example, the microcomputer 12051 distinguishes obstacles around the vehicle 12100 into obstacles that are visible to the driver of the vehicle 12100 and obstacles that are difficult to see. The microcomputer 12051 then determines a collision risk that indicates the risk of collision with each obstacle, and when the collision risk is equal to or greater than a set value and a collision is possible, the microcomputer 12051 can provide driving assistance for collision avoidance by outputting an alarm to the driver via the audio speaker 12061 or the display unit 12062, or by performing forced deceleration or avoidance steering via the drive system control unit 12010.

[0172] At least one of the image capturing units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, the microcomputer 12051 can recognize a pedestrian by determining whether a pedestrian is present in the images captured by the image capturing units 12101 to 12104. Such pedestrian recognition is performed, for example, by extracting feature points from the images captured by the image capturing units 12101 to 12104 as infrared cameras and performing pattern matching on a series of feature points that indicate the outline of an object to determine whether the object is a pedestrian. When the microcomputer 12051 determines that a pedestrian is present in the images captured by the image capturing units 12101 to 12104 and recognizes the pedestrian, the audio / image output unit 12052 controls the display unit 12062 to superimpose a rectangular outline on the recognized pedestrian for emphasis. The audio / image output unit 12052 may also control the display unit 12062 to display an icon or the like indicating the pedestrian at a desired position.

[0173] An example of a vehicle control system to which the technology according to the present disclosure can be applied has been described above. The technology according to the present disclosure can be applied to the imaging unit 12031 and other components of the above-described configuration. Specifically, for example, the cameras according to the first to ninth embodiments can be applied to the imaging unit 12031 and other components. By applying the technology according to the present disclosure to the vehicle control system 12000, it is possible to provide the imaging unit 12031 with a monitoring function while reducing the power consumption of the imaging unit 12031.

[0174] Note that the above-described embodiment shows an example for realizing the present technology, and the matters in the embodiment and the matters specifying the invention in the claims correspond to each other. Similarly, the matters specifying the invention in the claims and the matters in the embodiment of the present technology with the same title correspond to each other. However, the present technology is not limited to the embodiment, and can be realized by applying various modifications to the embodiment within the scope of the gist. Furthermore, the effects described in this specification are merely examples and are not limited, and other effects may also be present.

[0175] The present technology may also be configured as follows: (1) A communication device comprising: a determination unit that determines a characteristic of data; and a communication unit that communicates the determination result based on the determination result of the characteristic of the data. (2) The communication device according to (1), further comprising: a characteristic detection unit that detects the characteristic of the data. (3) The communication device according to (2), further comprising: a sensor that generates the data. (4) The communication device according to (3), wherein the sensor comprises the characteristic detection unit. (5) The communication device according to (3) or (4), wherein the sensor comprises the determination unit. (6) The communication device according to any of (3) to (5), comprising: a controller that controls the sensor. (7) The communication device according to (6), wherein the controller comprises the determination unit and the communication unit. (8) The communication device according to any of (1) to (7), wherein the communication unit transmits the determination result when it is determined that there is an abnormality in the characteristic of the data, and suspends the communication when it is determined that there is no abnormality in the characteristic of the data. (9) The communication device according to (8), further comprising: a remaining charge detection unit that detects a remaining charge of a battery that powers the determination unit and the communication unit. (10) The communication device according to (9), wherein the communication unit: transmits the data and the determination result when the remaining charge of the battery is equal to or greater than a first remaining charge; and transmits the determination result without transmitting the data when the remaining charge of the battery is less than the first remaining charge. (11) The communication device according to (10), wherein the communication unit: transmits the data and the determination result when the remaining charge is equal to or less than a second remaining charge that is less than the first remaining charge; and transmits the determination result multiple times in a batch when the remaining charge of the battery is less than the first remaining charge. (12) The communication device according to any of (9) to (11), wherein the communication unit extends a communication interval based on the remaining charge of the battery. (13) The communication device according to any of (9) to (12), further comprising: a power supply control unit that switches to battery power using a backup battery based on the remaining charge of the battery. (14) The communication device according to any one of (9) to (13), wherein the communication unit extends a communication interval based on an amount of change in the data.(15) The communication device according to any one of (1) to (14), wherein the communication unit transmits the determination result when a characteristic of the data has changed, and suspends the communication when the characteristic of the data has not changed. (16) The communication device according to any one of (1) to (15), wherein the communication unit transmits an operating state upon startup. (17) An imaging device comprising: an imaging unit that captures images; a detection unit that detects characteristics of imaging data generated by the imaging unit; a determination unit that determines the characteristics of the imaging data; and a communication unit that communicates the determination result based on the determination result of the characteristics of the imaging data. (18) The communication device according to (17), wherein the communication unit transmits the determination result when it is determined that there is an abnormality in the characteristics of the imaging data, and suspends transmission of the determination result when it is determined that there is no abnormality in the characteristics of the imaging data. (19) A communication method, wherein a server determines the characteristics of data, and the server receives the determination result based on communication performed in accordance with the determination result of the characteristics of the data. (20) The communication method described in (19), wherein the server receives the judgment result when it is determined that there is an abnormality in the characteristics of the data, and the server suspends receiving the judgment result when it is determined that there is no abnormality in the characteristics of the data.

[0176] REFERENCE SIGNS LIST 100 Camera 110 Image sensor 120 MCU 130 Network 140 Power supply circuit 150 Timer 111 Imaging unit 112 AI processing unit 121 Determination unit 122 Communication unit 123 Control unit 124 Power supply control unit

Claims

1. A communication device comprising: a determination unit that determines a characteristic of data; and a communication unit that communicates the determination result based on the determination result of the characteristic of the data.

2. The communication device according to claim 1, further comprising a feature detection unit that detects features of the data.

3. The communication device according to claim 2, further comprising: a sensor that generates the data.

4. The communication device according to claim 3, wherein the sensor comprises the feature detection unit.

5. The communication device according to claim 3, wherein the sensor comprises the determination unit.

6. The communication device according to claim 3, further comprising: a controller for controlling the sensor.

7. The communication device according to claim 6, wherein the controller comprises the determination unit and the communication unit.

8. The communication device according to claim 1, wherein the communication unit transmits the determination result when it is determined that there is an abnormality in the characteristics of the data, and suspends the communication when it is determined that there is no abnormality in the characteristics of the data.

9. The communication device according to claim 8, further comprising a remaining charge detection unit that detects the remaining charge of a battery that powers the determination unit and the communication unit.

10. The communication device according to claim 9, wherein the communication unit transmits the data and the determination result when the remaining battery charge is equal to or greater than a first remaining charge, and transmits the determination result without transmitting the data when the remaining battery charge is less than the first remaining charge.

11. The communication device according to claim 10, wherein the communication unit transmits the determination results multiple times in a batch when the remaining amount is less than a second remaining amount that is less than the first remaining amount.

12. The communication device according to claim 9, wherein the communication unit extends the communication interval based on the remaining charge of the battery.

13. The communication device according to claim 9, further comprising a power supply control unit that switches to battery operation using a backup battery based on the remaining charge of the battery.

14. The communication device according to claim 9, wherein the communication unit extends the communication interval based on the amount of change in the data.

15. The communication device according to claim 1, wherein the communication unit transmits the determination result when the characteristics of the data have changed, and suspends the communication when the characteristics of the data have not changed.

16. The communication device according to claim 1, wherein the communication unit transmits an operating status upon startup.

17. An imaging device comprising: an imaging unit that captures images; a detection unit that detects characteristics of imaging data generated by the imaging unit; a determination unit that determines the characteristics of the imaging data; and a communication unit that communicates the determination result based on the determination result of the characteristics of the imaging data.

18. The communication device according to claim 17, wherein the communication unit transmits the determination result when it is determined that there is an abnormality in the characteristics of the imaging data, and suspends transmission of the determination result when it is determined that there is no abnormality in the characteristics of the imaging data.

19. A communication method, comprising: a server causing a characteristic of data to be determined; and the server receiving a result of the determination based on communication performed according to a result of the determination of the characteristic of the data.

20. The communication method according to claim 19, wherein the server receives the determination result when it is determined that there is an abnormality in the characteristics of the data, and the server suspends receiving the determination result when it is determined that there is no abnormality in the characteristics of the data.

Citation Information

Patent Citations

  • Supervisory and control apparatus, monitoring system, monitoring method, program and recording medium

    JP2006279927A

  • Imaging apparatus

    JP2010118754A

  • Wearable item for position calculation, position calculation system, and method for position calculation

    JP2018017572A

  • Fixing cover for stainless sampling tube

    KR1020240148553A

  • Drive control device, drive control method and drive control program

    WO2013099079A1