Counting system comprising portable counting device using artificial intelligence

Abstract

This counting system comprising a portable counting device using artificial intelligence may comprise: at least one counter for extracting information on the number of preset objects, corresponding to a preset region of interest, in a counting mode; a server for receiving the information on the number of objects from the at least one counter; and a host terminal corresponding to a host user.

Description

A counting system including a portable counting device using artificial intelligence

[0001] The present invention relates to a counting system including a portable counting device using artificial intelligence.

[0002] More specifically, the present invention relates to a counting system including a portable counting device using artificial intelligence that can determine the number of objects located in an area of ​​interest even in a situation where power is not supplied.

[0003] These days, disasters such as typhoons, floods, earthquakes, and large-scale forest fires occur frequently.

[0004] In case of a disaster, you can take refuge in a designated shelter.

[0005] To effectively manage shelters, it is necessary to accurately determine the number of people, vehicles, etc. currently staying at the shelter.

[0006] In the past, statistical methods were used to infer the total number of people by counting the number of people in the sample, either by directly counting the number of people or by extracting a sample from a gathered crowd.

[0007] This method has the problem that it requires a lot of labor cost when using human resources and it takes an excessively long time to detect the number of people in the crowd.

[0008] Another object of the present invention is to provide a counting system including a counting device capable of determining the number of objects located in an area of ​​interest using artificial intelligence in an outdoor environment with insufficient infrastructure.

[0009] A counting system including a portable counting device using artificial intelligence according to the present invention may include at least one counter that extracts information on the number of preset objects corresponding to a preset region of interest in a counting mode; a server that receives information on the number of objects from at least one counter; and a host terminal corresponding to a host user.

[0010] At least one of the above counters can transmit a setting image captured in a setting mode to the server, and the server can transmit the setting image to the host terminal.

[0011] The counter may include a tripod; a camera module disposed on the tripod and configured to capture an image of the region of interest; a driving unit configured to analyze the image captured by the camera module and count the number of objects located in the region of interest; a wireless communication module configured to transmit information on the number of counted objects to the server; and a power supply unit configured to supply power required to drive the camera module, the driving unit, and the wireless communication module.

[0012] The above power supply unit may include a solar cell part that generates power using solar energy; and a battery part that stores the power generated by the solar cell part.

[0013] The host terminal transmits setting completion information on the shooting angle of the camera module to the server in response to the setting image received from the server, and the server can terminate the setting mode and enter the counting mode in response to the setting completion information received from the host terminal.

[0014] The above counting system may further include a guest terminal corresponding to a guest user.

[0015] In the above counting mode, the server can transmit information about the number of the target received from at least one counter to at least one guest terminal.

[0016] A counting system including a portable counting device using artificial intelligence according to the present invention has the effect of easily and precisely determining the number of objects located in an area of ​​interest even in a situation where no power is provided.

[0017] FIG. 1 is a drawing for explaining the configuration of a counting system including a portable counting device using artificial intelligence according to the present invention.

[0018] Figures 2 and 3 are drawings for schematically explaining the configuration of a portable counting device using artificial intelligence according to the present invention.

[0019] FIGS. 4 to 9 are drawings for explaining the tripod portion and related parts of a portable counting device using artificial intelligence according to the present invention.

[0020] FIGS. 10 to 16 are drawings for explaining the setting mode and related parts of a counting system including a portable counting device using artificial intelligence according to the present invention.

[0021] FIGS. 17 to 24 are drawings for explaining the counting mode and related parts of a counting system including a portable counting device using artificial intelligence according to the present invention.

[0022] Hereinafter, a portable counter using a tripod and a solar cell according to the present invention will be described in detail with reference to the attached drawings.

[0023] The present invention is susceptible to various modifications and embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. This is not intended to limit the present invention to specific embodiments, but rather to encompass all modifications, equivalents, and alternatives falling within the spirit and technical scope of the present invention.

[0024] FIG. 1 is a drawing for explaining the configuration of a counting system including a portable counting device using artificial intelligence according to the present invention.

[0025] Referring to FIG. 1, a counting system (10S) including a portable counting device using artificial intelligence according to the present invention (hereinafter referred to as a 'counting system') may include at least one counter (1) (or portable counting device), a server (Server, 2), and a terminal corresponding to at least one host user, i.e., a host terminal (Host Terminal, 3).

[0026] Here, the host user may include a user who installs or manages the counter (1). Considering this, the host user can be said to be a user corresponding to the counter (1).

[0027] The counting system (10S) according to the present invention may include a terminal corresponding to at least one guest user, i.e., a guest terminal (Guest Terminal, 4).

[0028] Here, a guest user may be defined as a user who wishes to utilize the information collected by the counter (1). Alternatively, a guest user may also be defined as a user connected to the server (3). The number of guest terminals (4) corresponding to the server (3) may be greater than the number of host terminals (3).

[0029] The counter (1) can extract information on the number of preset objects corresponding to a preset region of interest (ROI) in counting mode.

[0030] Here, the subject may include at least one of a person or a vehicle. For example, the subject may be classified as an adult or a child, or as a passenger vehicle or a large vehicle. The region of interest (ROI) may correspond to a shelter (evacuation area) where people and / or vehicles can take refuge in a disaster situation.

[0031] The counter (1) can transmit extracted information, for example, information on the number of objects located in a region of interest (ROI), to the server (2). The counter (1) can transmit a setting image captured in a setting mode prior to the counting mode to the server (3).

[0032] The server (3) can transmit a configuration image received from at least one counter (1) to the host terminal (3). The server (3) can collect, classify, and store information on the number of objects located in a region of interest (ROI) received from at least one counter (1). In addition, the server (3) can transmit the collected and classified information to at least one guest terminal (4).

[0033] The counter (1) can generate the necessary power using the power supply unit (50, not shown) it contains without receiving power from an external source. Specifically, the power supply unit (50, not shown) of the counter (1) can generate power using solar energy.

[0034] Accordingly, the counter (1) can determine the number of objects located in the area of ​​interest even when no power is supplied.

[0035] In addition, the counter (1) can determine the number of objects located in the area of ​​interest even in an outdoor environment with insufficient infrastructure.

[0036] In addition, the counter (1) can be easily carried. Accordingly, the counter (1) can be referred to as a portable counter (1).

[0037] The counting system (10S) according to the present invention may be preferably applied to disaster situations such as typhoons, floods, large-scale fires, and earthquakes. In disaster situations such as typhoons, floods, large-scale fires, and earthquakes, the likelihood of normal power supply disruptions may be high. Furthermore, in disaster situations, the likelihood of infrastructure damage may be high.

[0038] Considering this, in disaster situations such as typhoons, floods, large-scale fires, and earthquakes, it may be desirable to use a counting system (10S) including a counter (1) that is easy to carry, can supply the necessary power using a battery even when power is not supplied, and can also charge the battery using solar energy.

[0039] Each part of the counting system (10S) according to the present invention will be described in detail below.

[0040] Figures 2 and 3 are schematic diagrams illustrating the configuration of a portable counter using artificial intelligence according to the present invention. The description of the parts described in detail above may be omitted below.

[0041] Looking at FIG. 2, a portable counter (1) using artificial intelligence according to the present invention (hereinafter referred to as a 'counter' or 'counting device') may include a tripod (10), a camera module (20), a driving unit (30), a wireless communication module (40), and a power supply unit (50).

[0042] Since the components illustrated in Fig. 2 are not essential, it is also possible to implement a counter (1) having more or fewer components.

[0043] The tripod unit (10) can support the camera module (20). The tripod unit (10) can be height-adjustable. In addition, the tripod unit (10) can be reduced to a sufficiently small height and volume. Accordingly, the tripod unit (10) can be easily carried.

[0044] As its name suggests, the tripod unit (10) may preferably have three legs. However, in the present invention, the tripod unit (10) may not be limited to three legs. For example, the tripod unit (10) may have various legs, such as four or five. In the present invention, the tripod unit (10) may have any shape as long as it can support the camera module (20).

[0045] The camera module (20) can capture images of a preset region of interest (ROI). Preferably, the camera module (20) can capture images of the region of interest (ROI) from a sufficiently high position. For this purpose, the camera module (20) can be placed at the upper end of the tripod (10).

[0046] The driving unit (30) can receive an image captured by the camera module (20) from the camera module (20). The driving unit (30) can analyze the image captured by the camera module (20) and count the number of objects located in the region of interest (ROI).

[0047] Preferably, the driving unit (30) can use artificial intelligence to analyze the image captured by the camera module (20) to determine the type of object located in the region of interest (ROI) and count the number of objects determined. Here, the type of object may include a person and / or a vehicle.

[0048] Additionally, the driving unit (30) can count the number of objects entering or leaving a preset shelter in a disaster situation. Furthermore, the driving unit (30) can determine the number of objects currently located in the shelter based on the counted information.

[0049] The wireless communication module (40) can transmit information about the number of counted objects to the server (2).

[0050] The power supply unit (50) can supply power required to drive at least one of the camera module (20), the driving unit (30), the tripod (10), or the wireless communication module (40). Although not shown, the power supply unit (50) can generate and supply power using solar energy.

[0051] In Fig. 2, the power supply line (power line) supplied by the power supply unit (50) is indicated by a dotted line. In Fig. 2, the driving unit (30) and the wireless communication module (40) are shown as being separate from the camera module (20), but the present invention may not be limited thereto.

[0052] For example, at least one of the driving unit (30) or the wireless communication module (40) may be incorporated into the camera module (20). In this case, at least one of the driving unit (30) or the wireless communication module (40) may be located at the upper end of the tripod unit (10).

[0053] The logical configuration of the counter (1) and the driving unit (30) can be as shown in Fig. 3.

[0054] Looking at FIG. 3, the driving unit (30) may include a control unit (300), an image analysis unit (310), a target determination unit (320), a counting unit (330), a first interface unit (340), and a memory unit (350).

[0055] The control unit (300) can control the overall function of the driving unit (30) and / or the counter (1). For example, the control unit (300) can control the power generation and power supply of the power supply unit (40).

[0056] The control unit (300) can control the wireless communication of the wireless communication module (40). The control unit (300) can control the video recording of the camera module (20). The control unit (300) can control the shooting angle adjustment of the tripod unit (10).

[0057] The image analysis unit (310) can analyze the image captured by the camera module (20) using artificial intelligence under the control of the control unit (300). The object determination unit (320) can determine objects such as people and vehicles from the image captured by the camera module (20) under the control of the control unit (300) using artificial intelligence. The counting unit (330) can count the number of objects determined by the object determination unit (320) under the control of the control unit (300).

[0058] The first interface unit (340) can provide a passage for connecting the driving unit (30) to another device. For example, a user can install a predetermined program on the driving unit (30) through the first interface unit (340).

[0059] The memory unit (350) can store various programs and data required for driving the driving unit (30) and / or the counter (1) under the control of the control unit (300).

[0060] Below, the tripod part (10) will be described in more detail.

[0061] Figures 4 to 9 are drawings illustrating the tripod and related parts of a portable counter using artificial intelligence. The description of the parts described in detail above may be omitted below.

[0062] Hereinafter, the first direction (DR1) may intersect (be perpendicular to) the second direction (DR2) and the third direction (DR3), and the second direction (DR2) may intersect (be perpendicular to) the third direction (DR3).

[0063] Here, the first direction (DR1) and the second direction (DR2) may be collectively referred to as the horizontal direction (DRRH). In addition, the third direction (DR3) may be referred to as the vertical direction (DRV).

[0064] Looking at Figure 4, the tripod part (10) may include a vertical column part (100), multiple leg parts (110), a support part (120), an angle adjustment part (130), and a rotation part (140).

[0065] The vertical column (100) may include a portion extending in the vertical direction (DRV). A plurality of leg portions (110) may support the vertical column (100). The plurality of leg portions (110) may be positioned at the lower portion of the vertical column (100).

[0066] According to the expression 'triangle' in the tripod (10), it may be desirable for the number of leg parts (110) to be three. However, under the condition that the leg parts (110) can stably support the vertical column part (100), the number of leg parts (110) may be changed to various values ​​such as four or five.

[0067] The tripod part (10) may further include a horizontal reinforcement part (112). The horizontal reinforcement part (112) may reinforce adjacent leg parts (110) by connecting them. The tripod part (10) may further include a joint part (111). At least one leg part (110) may be connected to the joint part (111).

[0068] The joint portion (111) may be located at the lower portion of the support portion (120). From another perspective, the joint portion (111) may be located between the upper end and the lower end of the vertical column portion (100).

[0069] The joint portion (111) can be connected to the vertical column portion (100). Considering this, it can also be seen that the leg portion (110) and the vertical column portion (100) are connected at the joint portion (111).

[0070] The mounting portion (120) may be positioned at the upper end of the vertical column portion (100). The camera module (20) may be firmly and stably placed on the mounting portion (120). For this purpose, the camera module (20) may be connected to the mounting portion (120).

[0071] The mounting portion (120) can be said to be a part for mounting the camera module (20). The mounting portion (120) can include a flat surface for supporting the camera module (20).

[0072] When the camera module (20) is placed on the mounting portion (120) at the upper end of the vertical column (100), the camera module (20) can capture images over a sufficiently wide range. Accordingly, the counting efficiency can be improved.

[0073] It may be desirable to set the overall height (D1) of the tripod unit (10) sufficiently high to sufficiently secure the shooting range of the camera module (20). Preferably, the overall height (D1) of the tripod unit (10) may be higher than or equal to a preset reference height.

[0074] Here, the reference height may be approximately 2 to 3 m (meters). Preferably, the total height (D1) of the tripod part (10) may be 2 m (meters) or more, and more preferably, the total height (D1) of the tripod part (10) may be 3 m (meters) or more.

[0075] As shown in Fig. 5, the angle adjustment unit (130) can adjust the vertical angle of the mounting unit (120) by swinging the mounting unit (120) in the vertical direction (DRV). Considering that the camera module (20) is arranged on the mounting unit (120), the angle adjustment unit (130) can be seen as adjusting the vertical shooting angle of the camera module (20).

[0076] The angle adjustment unit (130) may include a first handle unit (131) for manually adjusting the vertical angle of the mounting unit (120).

[0077] As shown in Fig. 6, the rotating part (140) can adjust the horizontal angle of the mounting part (120) by rotating the mounting part (120) in the horizontal direction (DRH). Considering that the camera module (20) is placed on the mounting part (120), the rotating part (140) can be seen as adjusting the horizontal shooting angle of the camera module (20).

[0078] The rotating part (140) may include a second handle part (141) for manually adjusting the horizontal angle of the mounting part (120). Meanwhile, the angle adjustment part (130) and the rotating part (140) may be automatically driven.

[0079] To this end, as shown in FIGS. 7 and 8, the angle adjustment unit (130) may include an angle adjustment motor (132), and the rotation unit (140) may include a rotation motor (142).

[0080] The angle adjustment motor (132) can automatically adjust the vertical angle of the mounting portion (120) by rotating under the control of the control portion (300) of the driving portion (30). The rotation motor (142) can automatically adjust the horizontal angle of the mounting portion (120) by rotating under the control of the control portion (300) of the driving portion (30).

[0081] The mounting portion (120) may include at least one first fastening hole (FH1) for connecting the camera module (20). In this way, when the angle adjustment portion (130) includes an angle adjustment motor (132) and the rotation portion (140) includes a rotation motor (142), as shown in FIG. 8, the tripod portion (10) may further include a second interface portion (150) that provides a passage for transmitting a control signal to the angle adjustment motor (132) and / or the rotation motor (142).

[0082] Referring to Fig. 9, the camera module (20) may include a camera body part (21) and a camera cover part (22). The camera cover part (22) may cover and protect the camera body part (21).

[0083] The camera cover part (22) can prevent or suppress water, such as snow or rain, from penetrating into the camera body part (21). The camera cover part (22) can include at least one second fastening hole (FH2) corresponding to the first fastening hole (FH1) of the mounting part (120).

[0084] Here, a fastening means (FM), such as a screw or bolt, can pass through the first fastening hole (FH1) and the second fastening hole (FH2) to connect the camera module (20) to the mounting portion (120). The camera cover portion (22) may include a resin material or a plastic material. In this case, the overall weight of the camera module (20) can be reduced.

[0085] The camera body (21) may include a camera part (200), a middle connector part (210), a third interface part (220), and a first power port (230).

[0086] The camera unit (200) can capture images. The intermediate connector unit (210) can electrically connect the camera body unit (21) and the tripod unit (10). Specifically, the intermediate connector unit (210) can be electrically connected to the camera body unit (21) by the intermediate cable unit (211).

[0087] In addition, the intermediate connector portion (210) can be connected to the second interface portion (150) of the tripod portion (10). Power can be supplied from the camera body portion (21) to the tripod portion (10) by the intermediate cable portion (211) and the intermediate connector portion (210).

[0088] In addition, the camera body (21) can transmit a vertical control signal to automatically adjust the vertical angle of the stand (120) to the angle adjustment motor (132) of the angle adjustment unit (130) of the tripod unit (10) through the middle cable unit (211) and the middle connector unit (210).

[0089] In addition, the camera body (21) can transmit a horizontal control signal to automatically adjust the horizontal angle of the stand (120) to the rotation motor (142) of the rotation part (140) of the tripod part (10) through the middle cable part (211) and the middle connector part (210).

[0090] The process of adjusting the vertical angle of the mounting portion (120) by the angle adjustment motor (132) and the process of adjusting the horizontal angle of the mounting portion (120) by the rotation motor (142) can be initially performed in the setting mode. The setting mode will be described in detail later.

[0091] In addition, the data amount of the vertical control signal for adjusting the vertical angle of the mounting part (120) and the horizontal control signal for adjusting the horizontal angle of the mounting part (120) may be relatively small. In addition, it may be preferable that the angle adjustment motor (132) and the rotation motor (142) are driven while the camera module (20) is mounted on the mounting part (120).

[0092] Considering this, it may be desirable for the angle adjustment motor (132) and rotation motor (142) of the tripod unit (10) to receive the necessary power, vertical control signal, and horizontal control signal from the camera module (20) rather than directly from the driving unit (30). In this case, it may be advantageous to simplify the configuration of the counter (1) according to the present invention.

[0093] The third interface unit (220) of the camera body (200) can provide a passage for receiving a camera control signal for driving the camera body (200) from the driving unit (30). In addition, the camera body (200) can transmit a captured image to the driving unit (30) through the third interface unit (220).

[0094] The camera body (200) can receive a vertical control signal for adjusting the vertical angle of the mounting unit (120) and a horizontal control signal for adjusting the horizontal angle of the mounting unit (120) from the driving unit (30) through the third interface unit (220).

[0095] In addition, the camera body (200) can transmit a vertical control signal for adjusting the vertical angle of the mounting unit (120) received from the driving unit (30) and / or a horizontal control signal for adjusting the horizontal angle of the mounting unit (120) to the angle adjustment motor (132) and / or the rotation motor (142) through the intermediate cable unit (211) and the intermediate connector unit (210).

[0096] The camera body (200) can receive power required to drive the camera body (200), angle adjustment motor (132), and rotation motor (142) from the power supply unit (50) through the first power port (230).

[0097] In addition, the camera body (200) can transmit power supplied from the power supply unit (50) to the angle adjustment motor (132) and / or the rotation motor (142) through the intermediate cable unit (211) and the intermediate connector unit (210).

[0098] The camera module (20), preferably the camera body (200), can capture images for a sufficiently long period of time in counting mode. The counting mode will be described in detail later. Accordingly, it may be desirable for the camera module (20) to receive a stable power supply from the power supply unit (50).

[0099] Figures 10 to 16 are drawings for explaining the setting mode and related parts of a counting system including a portable counting device using artificial intelligence according to the present invention. Below, a description of the parts described in detail above may be omitted.

[0100] Referring to Figure 10, in the setting mode for installing and configuring a counter (1), a counter (1) can be installed (S10). For example, in a disaster situation, a counter (1) can be installed in a location adjacent to a shelter. Alternatively, a counter (1) can be installed corresponding to the entrance or exit of a shelter.

[0101] A user, such as a host user, can carry the counter (1) and install it in a suitable location. Since the counter (1) according to the present invention can generate electricity using solar energy and store it in a battery unit (510) for use, there may be relatively few restrictions on the installation location of the counter (1).

[0102] Here, installing the counter (1) may include a process of installing a camera module (20) on the stand (120) of the tripod (10).

[0103] Afterwards, the camera module (20) can be activated while installed on the tripod stand (120) (S100). When the camera module (20) is activated in the setting mode, the camera module (20) can capture images of the surroundings (S110). Here, the image captured by the camera module (20) in the setting mode can be referred to as a setting image (STI).

[0104] The setup image (STI) may include still images such as photographs and / or moving images. If the setup image (STI) is a still image, the camera module (20) may capture the setup image (STI) according to a first cycle (e.g., 5 seconds, 10 seconds, 30 seconds, etc.) preset in the setup mode. If the setup image (STI) is a moving image, the camera module (20) may capture the setup image (STI) continuously during the setup mode.

[0105] Thereafter, at least one setup image (STI) captured by the camera module (20) can be transmitted to the server (2) (S120). For example, when the camera module (20) captures a setup image (STI) in setup mode, the driving unit (30) can control the wireless communication module (40) to transmit the setup image (STI) to the server (2).

[0106] Then, the server (2) can transmit the setting image (STI) received from the counter (1) to the corresponding host terminal (3) (S130). In addition, the server (2) can store the setting image (STI) received from the counter (1).

[0107] For example, let us assume that the first host user installs the first counter (1).

[0108] In this case, the server (2) can determine in advance that the first counter (1) corresponds to the first host user, and can correspond the terminal of the first host user, i.e., the first host terminal (3), to the first counter (1).

[0109] Thereafter, the first counter (1) can be activated to capture at least one setup image (STI) in setup mode and transmit it to the server (2). Then, the server (2) can transmit at least one setup image (STI) received from the first counter (1) to the first host terminal (3) corresponding to the first counter (1).

[0110] The host terminal (3) that receives the setup image (STI) from the server (2) can determine whether setup completion information is input (S140).

[0111] If the judgment result at step S140 indicates that setup completion information is not entered, a setup menu can be displayed on the screen of the host terminal (3) (S160).

[0112] Thereafter, when the host user inputs setting information (S170), the host terminal (3) can transmit the input setting information to the server (2) (S180). Then, the server (2) can transmit the setting information received from the host terminal (3) to the counter (1) (S181).

[0113] Thereafter, the counter (1) that has received the setting information from the server (2) can adjust the mounting unit (120) in response to the received setting information (S190). Here, adjusting the mounting unit (120) can be seen as adjusting the shooting angle of the camera module (20) placed on the mounting unit (120).

[0114] In the step of adjusting the mounting unit (120), as shown in Fig. 11, the counter (1) that has received the setting information from the server (2) can generate a control signal corresponding to the setting information from the driving unit (30) (S191). Thereafter, the driving unit (30) can transmit the generated control signal to the camera module (20) (S192). Then, the camera module (20) can transmit the control signal received from the driving unit (30) to the tripod unit (10) (S193).

[0115] In detail, the camera module (20) can transmit the control signal received from the driving unit (30) to the angle adjustment motor (132) of the angle adjustment unit (130) of the tripod unit (10) and / or the rotation motor (142) of the rotation unit (140) (S193).

[0116] Here, the control signal may include a vertical control signal for adjusting the vertical shooting angle of the camera module (20) and a horizontal control signal for adjusting the horizontal shooting angle of the camera module (20).

[0117] Let us assume that in the setup mode, the camera module (20) captures a setup image (STI) as in Fig. 12.

[0118] The setup image (STI) may be an image corresponding to an available shelter in a disaster situation. This setup image (STI) is transmitted from the counter (1) to the server (2), and the server (2) can transmit the setup image (STI) received from the counter (1) to the host terminal (3).

[0119] Then, a setting image (STI) such as Fig. 12 can be displayed on the screen of the host terminal (3). The host user can check the setting image (STI) displayed on the screen of the host terminal (3).

[0120] In addition, as shown in Fig. 13, a setting menu for inputting setting information may be displayed on the screen of the host terminal (3). Here, if the host user determines that the setting image (STI) is not appropriate for counting the number of targets corresponding to the shelter, the host user may change (adjust) the vertical shooting angle and / or horizontal shooting angle of the camera module (20) using the setting menu displayed on the screen of the host terminal (3).

[0121] In addition, the host user can select the completion menu using a pointer (PT) such as a cursor. Then, the host terminal (3) can transmit information for changing (adjusting) the vertical shooting angle and / or horizontal shooting angle of the camera module (20), i.e., setting information, to the server (2).

[0122] The setting information can also be said to be information for changing the shooting area (SAR) of the camera module (20). Then, the server (2) can transmit the setting information back to the counter (1). The counter (1) that receives the setting information can change (adjust) the vertical shooting angle and / or horizontal shooting angle of the camera module (20) in response to the setting information.

[0123] For example, as shown in Fig. 14, the vertical shooting angle and / or horizontal shooting angle of the camera module (20) can be changed (adjusted) to move the shooting area (SAR) of the camera module (20) in the direction of the arrow.

[0124] The configuration for changing (adjusting) the vertical shooting angle and / or horizontal shooting angle of the camera module (20) has been described in detail in the preceding drawings 5 ​​to 8 and the corresponding detailed descriptions.

[0125] Afterwards, in the counter (1), at least one setup image (STI) can be taken again (S110) while changing the vertical shooting angle and / or horizontal shooting angle of the camera module (20), and the taken setup image (STI) can be transmitted to the server (2) (S120).

[0126] For example, the camera module (20) can capture a setup image (STI) as shown in FIG. 15 corresponding to the changed shooting area (SAR), transmit it to the server (2), and proceed to step S130.

[0127] Meanwhile, if the determination result in step S140 indicates that setup completion information has been entered, the host terminal (3) can transmit the setup completion information to the server (2) (S150). Thereafter, the host user can set the region of interest (ROI) using the setup image (STI) on the host terminal (3).

[0128] After setting the region of interest (ROI), the host terminal (3) can transmit information about the region of interest (ROI), i.e., information about the setting of the region of interest (ROI), to the server (2). Thereafter, the server (2) can transmit information about the region of interest (ROI) to the counter (1). Then, the counter (1) can store information about the region of interest (ROI) in the memory unit (350) and use it.

[0129] After the region of interest (ROI) is set, the server (2) can exit the setting mode (S210). For example, when a setting image (STI) such as that shown in FIG. 15 is transmitted from the server (2) to the host terminal (3), the host user can determine that the setting image (STI) displayed on the screen of the host terminal (3) is appropriate for counting the number of targets corresponding to the shelter.

[0130] Then, the host user can input the setup completion information using the host terminal (3). In addition, the host user can set the region of interest (ROI) in the setup image (STI) using the host terminal (3), as shown in Fig. 16.

[0131] Here, the region of interest (ROI) may correspond to the space in the shelter where objects such as people and vehicles are mainly located. Alternatively, the region of interest (ROI) may correspond to the entrance or exit of the shelter.

[0132] In Figure 16, the region of interest (ROI) is shown to correspond primarily to the parking lot of the shelter, but the region of interest (ROI) can correspond to any space where the number of objects located in the shelter can be effectively counted.

[0133] After setting the region of interest (ROI), you can exit the setting mode and then enter the counting mode according to your choice. Below, the counting mode will be described in detail. The counting mode is a mode in which the counter (1) captures an image, analyzes the captured image, and counts the number of objects located in the region of interest (ROI).

[0134] Figures 17 to 24 are drawings for explaining the counting mode and related parts of a counting system including a portable counting device using artificial intelligence according to the present invention. Below, a description of the parts described in detail above may be omitted.

[0135] Looking at Fig. 17, after the host terminal (3) transmits the setup completion information for the shooting angle of the camera module (20) included in the counter (1), for example, the vertical shooting angle and / or the horizontal shooting angle, to the server (2) in response to the setup image (STI), the setup mode can be terminated (S210) and the counting mode can be entered (S300).

[0136] When entering the counting mode, the camera module (20) of the counter (1) can capture a main image (MAI) (S310). Here, the main image (MAI) can represent an image captured by the camera module (20) in the counting mode. The main image (MAI) can be said to be an image captured in response to the shooting angle of the camera module (20) set in the setting mode.

[0137] Taking this into account, the main image (MAI) may be approximately identical to the final setup image (STI) captured in setup mode. For example, the main image (MAI) may be approximately identical to or sufficiently similar to the setup image (STI) of FIG. 40 above.

[0138] The main image (MAI) may include still images such as photographs and / or moving images. If the main image (MAI) is a still image, the camera module (20) may capture the main image (MAI) according to a second cycle (e.g., 5 seconds, 10 seconds, 30 seconds, etc.) preset in the counting mode. If the main image (MAI) is a moving image, the camera module (20) may capture the main image (MAI) continuously during the counting mode.

[0139] The main image (MAI) captured by the camera module (20) can be transmitted to the driving unit (30). Then, the image analysis unit (310) of the driving unit (30) analyzes the main image (MAI) (S320), and the target determination unit (320) of the driving unit (30) can determine the type of target corresponding to the region of interest (ROI) of the main image (MAI) (S330). For example, the driving unit (30) can determine the type of target, such as a person or a vehicle located in a shelter, corresponding to the main image (MAI).

[0140] Thereafter, the counting unit (330) of the driving unit (30) can count the number of objects corresponding to the region of interest (ROI) of the main image (MAI) based on the determined information (S340). For example, the driving unit (30) can count the number of objects located in the shelter by type corresponding to the main image (MAI).

[0141] Here, the technique of analyzing the main image (MAI) to determine the type of object included in the region of interest (ROI) of the main image (MAI) and counting the number of objects determined is already a widely known technique, so further detailed explanation thereof will be omitted.

[0142] Thereafter, the counter (1) can transmit information on the number of objects counted by the counting unit (330) to the server (2) (S350). Then, the server (2) can classify and store the information on the number of objects received from the counter (1) (S360).

[0143] Thereafter, the server (2) can determine whether there is an information request from the guest user's guest terminal (4) (S370). If there is no information request from the guest terminal (4) as determined in step S370, the first function (Default 1) set in advance can be performed (S390).

[0144] Here, the first function may be, for example, a function that waits until an information request is received from a guest terminal (4). On the other hand, if an information request is received from a guest terminal (4) as a result of the judgment in step S370, information on the number of targets of the shelter corresponding to the counter (1) can be transmitted to the guest terminal (4) (S380).

[0145] Let us assume that the counting system (10S) according to the present invention includes a first counter (1A), a second counter (1B), and a third counter (1C) as counters (1).

[0146] The first counter (1A) may be installed corresponding to shelter 1, the second counter (1B) may be installed corresponding to shelter 2, and the third counter (1C) may be installed corresponding to shelter 3.

[0147] The first counter (1A) can count the number of objects corresponding to the region of interest (ROI) of shelter 1 and transmit information about the number of counted objects to the server (2). The second counter (1B) can count the number of objects corresponding to the region of interest (ROI) of shelter 2 and transmit information about the number of counted objects to the server (2).

[0148] In addition, the third counter (1C) can count the number of objects corresponding to the region of interest (ROI) of shelter 3 and transmit information about the number of counted objects to the server (2). In this case, the server (2) can determine and store the number of objects corresponding to the current shelter 1, for example, the number of people and the number of vehicles taking refuge in shelter 1, based on the information received from the first counter (1A).

[0149] In addition, the server (2) can determine the number of objects that can be added to shelter 1, for example, the number of people and the number of vehicles that shelter 1 can additionally accommodate, based on the information received from the first counter (1A) and the pre-stored information.

[0150] The server (2) can perform the same function for the second counter (1B) and the third counter (1C). An example of information collected by the server (2) in response to shelter 1, shelter 2, and shelter 3 is shown in Fig. 18.

[0151] In this state, a guest user can connect to the server (2) using a guest terminal (4) and request information about each shelter. Then, the server (2) can transmit information corresponding to at least one shelter, as shown in FIG. 18, to the guest terminal (4).

[0152] According to the present invention, the number of objects corresponding to a shelter can be easily determined even in an outdoor or disaster situation where power is not supplied or infrastructure is insufficient.

[0153] Meanwhile, the counter (1) according to the present invention is likely to be used outdoors where infrastructure is lacking or in disaster situations. Considering this, the counter (1) is likely to be used in situations with sufficiently strong winds, so it may be desirable to consider the effects of wind, at least in counting mode. This will be described in detail below.

[0154] Looking at Figure 19, when the camera module (20) of the counter (1) captures the main image (MAI) (S310) and transmits the captured main image (MAI) to the driving unit (30), the driving unit (30) can analyze the main image (MAI) (S320).

[0155] Thereafter, the driving unit (30) can determine the region of interest (ROI) in the main image (MAI) based on the analyzed results (S400). Thereafter, the driving unit (30) can determine whether the region of interest (ROI) is included in the main image (MAI) based on the determined information (S410).

[0156] In step S410, if the main image (MAI) does not include the region of interest (ROI), the driving unit (30) can determine the first time (S420). Here, the first time may refer to the length of time during which the main image (MAI) does not include the region of interest (ROI).

[0157] Thereafter, it can be determined whether the determined first time is greater than or equal to the preset first reference time (S430). If the determined first time is greater than or equal to the preset first reference time as a result of the determination in step S430, the driving unit (30) determines that an abnormality has occurred in the current counter (1) and can notify this to the server (2) (S440).

[0158] Then, information about an abnormality in the counter (1) can be transmitted to the host terminal (3) corresponding to the counter (1). In this case, the host can automatically and easily recognize that an abnormality has occurred in the counter (1).

[0159] Let's assume a disaster situation where the winds can be relatively strong, such as a typhoon or flood.

[0160] In a disaster situation, as shown in Fig. 20, when the camera module (20) is placed on the mounting part (120) at the upper end of the tripod part (10), the tripod part (10) may shake or vibrate due to wind, etc.

[0161] In such cases, the shooting area (SAR) of the camera module (20) may also shake. Here, let us further assume a case where a region of interest (ROI) is set corresponding to a shelter, as shown in Fig. 21.

[0162] In this state, if the camera module (20) is shaken by wind or the like, a main image (MAI) that does not include the region of interest (ROI) may be captured, as shown in FIG. 22.

[0163] In the case of FIG. 22, if the situation in which the main image (MAI) does not include the region of interest (ROI) is maintained for a preset first reference time (e.g., 30 seconds, 1 minute, 2 minutes, etc.), there is a high possibility that an accident such as the tripod (10) on which the camera module (20) is currently placed falling or tilting has occurred.

[0164] In this case, the counter (1) can notify the server (2) that an abnormality has occurred in the counter (1), and the server (2) can notify the host terminal (3) that an abnormality has occurred in the counter (1).

[0165] Meanwhile, if the time determined as a result of the judgment in step S430 is less than the preset first reference time, the process can proceed to step S410, which determines whether the region of interest (ROI) is included in the main image (MAI).

[0166] Meanwhile, in step S410, if the main image (MAI) includes a region of interest (ROI), it can be determined whether the entire region of interest (ROI) is included in the main image (MAI) (S450).

[0167] In the case where the main image (MAI) includes the entire region of interest (ROI) as a result of the judgment at step S450, the driving unit (30) can determine that the current state of the counter (1) is normal (S500).

[0168] Afterwards, the process can proceed to the step (S330) of determining the target in response to the region of interest (ROI) of the main image (MAI).

[0169] Meanwhile, in step S450, if the main image (MAI) does not include the entire region of interest (ROI), the driving unit (30) can determine the proportion of the region of interest (ROI) included in the main image (MAI) (S460).

[0170] Thereafter, the driving unit (30) can determine whether the ratio of the region of interest (ROI) included in the main image (MAI) changes over time (S470).

[0171] If the ratio of the region of interest (ROI) included in the main image (MAI) changes over time as a result of the judgment in step S470, the process can proceed to step S410, which determines whether the region of interest (ROI) is included in the main image (MAI).

[0172] Let us assume that the camera module (20) is repeatedly shaken back and forth or left and right due to wind, etc.

[0173] In such cases, the proportion of the region of interest (ROI) included in the main image (MAI) may change. For example, at the first point in time, a main image (MAI) that does not include an image of interest (ROI) may be captured, as in (A) of FIG. 23.

[0174] Thereafter, at a second point in time, the camera module (20) may be shaken, and a main image (MAI) including a portion of the region of interest (ROI) may be captured, as shown in (B) of FIG. 23. Thereafter, at a third point in time, the camera module (20) may be shaken, and a main image (MAI) including the entire region of interest (ROI) may be captured, as shown in (C) of FIG. 23. Thereafter, at a fourth point in time, the camera module (20) may be shaken, and a main image (MAI) including a portion of the region of interest (ROI) may be captured, as shown in (D) of FIG.

[0175] In the case of Fig. 23, the camera module (20) is shaking, but it can be said that a main image (MAI) that includes the entire region of interest (ROI) is captured periodically.

[0176] In this case, it is highly likely that the tripod (10) with the camera module (20) placed on the stand (120) will not fall over or tilt, although it will shake left and right or back and forth due to wind, etc.

[0177] In addition, when the wind stops or becomes sufficiently weak, the shaking of the tripod (10) stops, and the camera module (20) is likely to continuously capture a main image (MAI) that includes the entire region of interest (ROI).

[0178] Considering this, when a main image (MAI) that includes the entire region of interest (ROI) is captured periodically, or when the main image (MAI) includes the entire region of interest (ROI) periodically, i.e., as in Fig. 23, the driving unit (30) can determine that the current state of the counter (1) is normal.

[0179] On the other hand, if the ratio of the region of interest (ROI) included in the main image (MAI) as a result of the judgment at step S470 does not change over time, the driving unit (30) can determine the second time (S480).

[0180] Here, the second time may refer to the length of time during which the ratio of the region of interest (ROI) included in the main image (MAI) remains unchanged. Thereafter, it may be determined whether the determined second time is greater than or equal to a preset second reference time (S490).

[0181] If the second time determined as a result of the judgment in step S490 is greater than or equal to the preset second reference time, the driving unit (30) determines that an abnormality has occurred in the current counter (1) and can notify this to the server (2) (S440).

[0182] On the other hand, if the second time determined as a result of the judgment in step S490 is less than the preset second reference time, the process can proceed to step S410 of determining whether the main image (MAI) includes a region of interest (ROI).

[0183] For example, as shown in FIG. 24, if a situation in which a part of a region of interest (ROI) is included in the main image (MAI) and the ratio of the region of interest (ROI) included in the main image (MAI) remains constant for a preset second reference time (e.g., 30 seconds, 1 minute, 2 minutes, etc.), there is a high possibility that an accident such as the tripod (10) on which the current camera module (20) is placed falling over or tilting has occurred.

[0184] In this case, the counter (1) can notify the server (2) that an abnormality has occurred in the counter (1), and the server (2) can notify the host terminal (3) that an abnormality has occurred in the counter (1).

[0185] In this way, it will be understood by those skilled in the art that the technical configuration of the present invention described above can be implemented in other specific forms without changing the technical idea or essential features of the present invention.

[0186] Therefore, the embodiments described above should be understood as being exemplary and not restrictive in all respects, and the scope of the present invention is indicated by the claims described below rather than the detailed description described above, and all changes or modifications derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention.

[0187] A counting system including a portable counting device using artificial intelligence according to the present invention can be widely used in various industrial fields where it is necessary to easily and precisely determine the number of objects located in an area of ​​interest even in a situation where power is not provided.

Claims

1. At least one counter for extracting information on the number of preset objects corresponding to a preset region of interest in counting mode; A server that receives information about the number of said objects from at least one of said counters; and Host Terminal corresponding to Host User; Including, At least one of the above counters transmits a setting image taken in the setting mode to the server, A counting system including a portable counting device using artificial intelligence, characterized in that the server transmits the setting image to the host terminal.

2. In paragraph 1, The above counter Tripod; A camera module placed on the tripod and capturing an image of the area of ​​interest; A driving unit that analyzes the image captured by the camera module and counts the number of objects located in the region of interest; A wireless communication module that transmits information about the number of counted objects to the server; and A power supply unit that supplies power required to drive the camera module, the driving unit, and the wireless communication module; Including, The above power supply unit Solar Cell Part that produces electricity using solar energy; and A battery unit that stores the power generated by the solar cell unit; A counting system including a portable counting device using artificial intelligence, characterized by including:

3. In paragraph 2, The host terminal transmits setting completion information for the shooting angle of the camera module to the server in response to the setting image transmitted from the server, A counting system including a portable counting device using artificial intelligence, characterized in that the server terminates the setting mode and enters the counting mode in response to the setting completion information received from the host terminal.

4. In paragraph 3, It further includes a guest terminal corresponding to a guest user, A counting system including a portable counting device using artificial intelligence, characterized in that in the counting mode, the server transmits information on the number of the target received from at least one counter to at least one guest terminal.

Images