Determination device

Abstract

To appropriately assess the living conditions in the target area. [Solution] The determination device includes an extraction unit that extracts a vertical reference line along the vertical direction of an object, including at least one of a building, installation, and equipment, and a vertical reference line indicating the vertical direction within the image, from an image of the target area to be determined, and a determination unit that determines the living conditions of the target area based on the inclination angle of the vertical reference line with respect to the extracted vertical reference line.

Description

Technical Field

[0004] ,

[0006] , , , ,

[0005] , , , , ,

[0001] <000​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​​

[0007] According to the present invention, the living conditions of the target area can be appropriately determined. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a schematic functional block diagram showing an example of an information device according to this embodiment. [Figure 2] Figure 2 is a schematic diagram showing an example of an image of the target area. [Figure 3] Figure 3 schematically shows an example of a state in which the target line and reference line have been extracted from the image. [Figure 4] Figure 4 schematically shows another example of the state in which the target line and reference line have been extracted from the image. [Figure 5] Figure 5 is a flowchart showing an example of a determination method by the control unit, which is a determination device according to this embodiment. [Modes for carrying out the invention]

[0009] Hereinafter, embodiments of the determination device according to the present invention will be described with reference to the drawings. However, the present invention is not limited by these embodiments. Furthermore, the components in the following embodiments include those that are easily substituted or substantially identical to those that are easily substituted by those skilled in the art.

[0010] Figure 1 is a schematic functional block diagram showing an example of an information device 100 according to this embodiment. Examples of information devices 100 shown in Figure 1 include personal computers, smartphones, tablets and other information terminals, and in-vehicle equipment such as car navigation systems and drive recorders.

[0011] The information device 100 comprises an imaging unit 50, a control unit 60, an operation unit 70, and an information output unit 80. The imaging unit 50 photographs an object and generates imaging data. The imaging unit 50 is composed of imaging devices such as a visible light camera, a far-infrared camera, and a near-infrared camera. The imaging unit 50 may be composed of a combination of, for example, a visible light camera, a far-infrared camera, and a near-infrared camera.

[0012] The control unit 60 comprehensively controls the information device 100. The control unit 60 comprises a communication unit 10, a processing unit 20, and a storage unit 30. The control unit 60 is the determination device in this embodiment.

[0013] The communication unit 10 performs wired or wireless communication with external devices. The communication unit 10 includes an interface such as a network interface card.

[0014] The processing unit 20 performs various information processing. The processing unit 20 includes a processor such as a CPU (Central Processing Unit) and memory such as ROM (Read Only Memory) and RAM (Random Access Memory). The processing unit 20 has an extraction unit 21, a determination unit 22, and a notification control unit 23. In this embodiment, the processing unit 20 functions as a determination device that determines the living conditions of a region (hereinafter referred to as the target region) based on images of the streetscape, scenery, etc., of the region, using the extraction unit 21 and the determination unit 22. Examples of living conditions include the status of infrastructure development, the level of administrative services, the public safety situation, and the sanitation situation. In this embodiment, the processing unit 20 also notifies the determination result of the determination unit 22 via the notification control unit 23, for example, through an information output unit 80. The specific processing details of the processing unit 20 will be described later.

[0015] The storage unit 30 stores various programs, data, and other information, applications, etc., for processing in the processing unit 20. The storage unit 30 includes storage such as an HDD (Hard Disk Drive) or SSD (Solid State Drive). The storage unit 30 can store images P, such as images captured by the imaging unit 50 of the information device 100, or images acquired via the network through communication by the communication unit 10.

[0016] The memory unit 30 stores a determination program that causes a computer to perform, for example, the following processes: extracting a vertical reference line along the vertical direction of an object including at least one of a building, installation, and equipment, and a vertical reference line indicating the vertical direction within the image, from an image of the target area to be determined; and determining the living conditions of the target area R based on the angle between the extracted vertical reference line and the vertical reference line.

[0017] In the control unit 60, the processor in the processing unit 20 reads various programs and loads them into memory, thereby executing information processing corresponding to the functions of each of the above-mentioned units. Examples of various programs include programs received by the communication unit 10, programs stored in the storage unit 30, and programs recorded on an external recording medium. The control unit 60 functions as an information processing device (computer) that executes various information processing. Note that other information processing devices different from the control unit 60 may execute various programs, or the control unit 60 and other information processing devices may cooperate to execute various programs.

[0018] The operation unit 70 receives various operations from the user to the control unit 60 and outputs them to the control unit 60 as operation signals. The operation unit 70 can be an input device such as a touch panel, buttons, levers, dials, switches, mouse, or keyboard.

[0019] The information output unit 80 outputs information such as voice, image, vibration, etc. The information output unit 80 includes at least one of a voice output unit such as a speaker, a display unit such as a display, and a vibration generation unit that generates vibration. Note that the information output unit 80 may be configured to output other information different from the above.

[0020] Next, an example of the operation of the information device 100 configured as described above will be described. Hereinafter, the description will focus on the process of determining the living conditions of the target area in the processing unit 20.

[0021] For example, when a predetermined operation is performed by the user via the operation unit 70, the extraction unit 21 of the processing unit 20 acquires one or more images of the target area. The image may be, for example, an image captured by the imaging unit 50, or an image captured by an imaging device different from the imaging unit 5%. Also, the image may be, for example, an image stored in the storage unit 30, or an image acquired via a network such as the Internet by communication of the communication unit 10. Note that the user may select the image P by operating the operation unit 70, and the extraction unit 21 may acquire the selected image P.

[0022] FIG. 2 is a diagram schematically showing an example of an image of the target area. The image P shown in FIG. 2 is an image of the target area R. The image P includes buildings Q1 such as buildings and houses, fixtures Q2 such as signs, and facilities Q3 such as utility poles and streetlights. In FIG. 2, an image of the buildings Q1, fixtures Q2, facilities Q3, etc. from a direction looking parallelly is illustrated, but it is not limited to such an image. For example, an image in a state of extending in the depth direction (a state with a one-point perspective applied, etc.) is also applicable to the present embodiment. The same applies to FIGS. 3 and 4. <0OOOO98>

[0023] The extraction unit 21 extracts the object 40 including at least one of the building Q1, the fixture Q2, and the facility Q3 from the acquired image P by performing image processing.

[0024] The extraction unit 21 extracts a vertical symmetric line and a vertical reference line from the extracted object 40 by image processing. Figure 3 is a schematic diagram showing an example of the state in which the symmetric line and reference line have been extracted from image P. As shown in Figure 3, the vertical symmetric line 41 is a straight line along the vertical direction in the object 40. The vertical reference line 43 is a virtual straight line indicating the vertical direction within image P.

[0025] Furthermore, when the extraction unit 21 acquires multiple images for a single target area, it extracts a vertical reference line 41 and a vertical baseline line 43 for each acquired image. The vertical baseline line 43 can be pre-set, for example, when taking images with the imaging unit 50. When the extraction unit 21 extracts images taken by the imaging unit 50, the extraction unit 21 can extract the pre-set vertical baseline line 43.

[0026] Here, we will explain the principle of how the judgment unit 22 determines living conditions. Buildings such as skyscrapers and houses, installations such as signs, utility poles, streetlights, and other equipment are often installed vertically or horizontally in areas where infrastructure is adequately developed and administrative services are well provided.

[0027] On the other hand, in areas with inadequate infrastructure and insufficient administrative services, aesthetics and coherence tend to be disregarded as long as buildings, installations, and facilities fulfill their basic functions. Consequently, for example, buildings, installations, and facilities tend to be left installed at an angle, either vertically or horizontally. It can be assumed that such areas are likely to have poor public safety and sanitation conditions.

[0028] Therefore, the determination unit 22 appropriately determines the living conditions in the target area R by determining the living conditions based on the inclination angle between the vertical reference line 41 and the vertical reference line 43 of the object 40, which includes at least one building, installation, and equipment in the image P taken of the target area R.

[0029] In terms of specific processing, the determination unit 22 calculates the angle between the extracted vertical symmetric line 41 and the vertical reference line 43 (hereinafter referred to as the inclination angle α), and determines whether the inclination angle α exceeds a predetermined threshold. Figure 3 shows, as an example, the inclination angle α between one vertical symmetric line 41 and the vertical reference line 43. Based on the determination result, the determination unit 22 counts the number of vertical symmetric lines 41 whose inclination angle α exceeds the predetermined threshold. Note that, for example, if multiple vertical symmetric lines 41 are extracted from the object 40, the determination unit 22 may compare two vertical symmetric lines 41 in a brute-force manner and determine the inclination angle α of one relative to the other. In this case, the extracted vertical symmetric line 41 also serves as the vertical reference line 43.

[0030] The determination unit 22 calculates a score indicating the living situation according to the count value of the vertical symmetric line 41 where the inclination angle α exceeds a predetermined threshold. For example, the determination unit 22 can set a lower score indicating the living situation the smaller the count value of the vertical symmetric line 41. Conversely, the determination unit 22 can set a higher score indicating the living situation the larger the count value of the vertical symmetric line 41. It is also possible to set a higher score indicating the living situation the larger the inclination angle α.

[0031] The judgment unit 22 determines the living situation based on the set score. For example, if the score is set as described above, the judgment unit 22 can determine that the lower the score, the better the living situation. Conversely, the judgment unit 22 can determine that the higher the score, the worse the living situation. However, the judgment result by the judgment unit 22 is not limited to determining whether the living situation is good or bad. For example, the judgment unit 22 may use the set score itself as the result of determining the living situation, or it may use an index such as a rank corresponding to the set score (for example, S, A, B, etc., in order from lowest score to highest score) as the result of determining the living situation.

[0032] Figure 4 schematically shows another example of the state in which the target line and reference line have been extracted from image P. As shown in Figure 4, in the above determination operation, when extracting the vertical target line 41 and the vertical reference line 43, the extraction unit 21 may also extract the horizontal target line 42 and the horizontal reference line 44 in addition to the vertical target line 41 and the vertical reference line 43. The horizontal target line 42 is a straight line along the horizontal direction. The horizontal reference line 44 is a virtual straight line indicating the horizontal direction within image P. The horizontal reference line 44 can be set in advance, for example, when taking images with the shooting unit 50. When the extraction unit 21 extracts an image taken by the shooting unit 50, the extraction unit 21 can extract the pre-set horizontal reference line 44. The horizontal reference line 44 may be set to a straight line that intersects perpendicularly with the vertical reference line 43.

[0033] When horizontal symmetry lines 42 and horizontal reference lines 44 are extracted, the determination unit 22 determines the angle between the horizontal symmetry line 42 and the horizontal reference line 44 (hereinafter referred to as the inclination angle β) in addition to the inclination angle α. In Figure 4, as an example, the inclination angle α with respect to the vertical reference line 43 is shown for one vertical symmetry line 41, and the inclination angle β with respect to the horizontal reference line 44 is shown for one horizontal symmetry line 42. The determination unit 22 determines whether the determined inclination angle α and inclination angle β each exceed a predetermined threshold, and counts the number of vertical symmetry lines 41 for which the inclination angle α is determined to exceed the predetermined threshold, and the number of horizontal symmetry lines 42 for which the inclination angle β is determined to exceed the predetermined threshold. Note that, for example, if multiple horizontal symmetry lines 42 are extracted from the object 40, the determination unit 22 may compare two horizontal symmetry lines 42 in a brute-force manner and determine the inclination angle β of one of them relative to the other. In this case, the extracted horizontal symmetry line 42 will also serve as the horizontal reference line 44.

[0034] In this case, the determination unit 22 calculates a score indicating the living situation based on the sum of the count values ​​of the vertical symmetric line 41 where the inclination angle α exceeds a predetermined threshold and the count values ​​of the horizontal symmetric line 42 where the inclination angle β exceeds a predetermined threshold. For example, the smaller the sum of the count values ​​of the vertical symmetric line 41 and the horizontal symmetric line 42, the lower the score indicating the living situation can be set. Also, the larger the sum of the count values ​​of the vertical symmetric line 41 and the horizontal symmetric line 42, the higher the score indicating the living situation can be set. Furthermore, the larger the inclination angle α and inclination angle β, the higher the score indicating the living situation can be set.

[0035] When the determination unit 22 makes a determination regarding the living situation, the notification control unit 23 notifies the user of the information device 100 of the results of the determination regarding the living situation via the information output unit 80.

[0036] For example, the notification control unit 23 determines whether the image P extracted by the extraction unit 21 and used for determination was taken by the imaging unit 50 of the information device 100. If the image P was taken by the imaging unit 50, it can be presumed that it was taken while the user of the information device 100 was in the target area R. Therefore, if the notification control unit 23 determines that the image P was taken by the imaging unit 50, it notifies the user of the information device 100 of the determination result regarding the living conditions in the target area R. This information could include, for example, a warning about poor living conditions. This allows the user to be appropriately alerted.

[0037] Furthermore, the notification control unit 23 can set the content of the information to be notified to the user according to the type of information device 100. For example, if the information device 100 is a terminal device such as a smartphone or tablet, the information device 100 can be notified of information such as criminal acts that may occur in the target area R (e.g., theft, snatching) and dangers caused by the sanitary conditions of the target area R (e.g., food poisoning). With this information, the user of the information device 100 can appropriately understand the living conditions in the target area R and the dangers caused by those living conditions, and can appropriately reflect this in their actions in the target area R.

[0038] Furthermore, if the information device 100 is, for example, an in-vehicle device such as a car navigation system or a dashcam, it can notify the user of the information device 100 of dangerous activities related to automobiles in the target area R (such as staged accidents, hit-and-runs, and car break-ins) and information about poor road conditions. This information allows the user of the information device 100 to understand the living conditions in the target area R and the risks arising from those conditions when driving in the target area R, and to appropriately reflect this in their driving behavior.

[0039] Figure 5 is a flowchart showing an example of a determination method by the control unit 60, which is a determination device according to this embodiment. As shown in Figure 5, in the control unit 60, the extraction unit 21 acquires one or more images P for the target area R (step S10).

[0040] After acquiring image P, the extraction unit 21 extracts the vertical symmetric line 41 and the vertical reference line 43 from the acquired image P by performing image processing (step S20). In step S20, the extraction unit 21 may also extract the horizontal symmetric line 42 and the horizontal reference line 44 in addition to the vertical symmetric line 41 and the vertical reference line 43.

[0041] Next, the determination unit 22 determines the inclination angle α between the acquired vertical symmetry line 41 and the vertical reference line 43 (step S30). If the horizontal symmetry line 42 and the horizontal reference line 44 are extracted in step S20, in step S30, the inclination angle β between the horizontal symmetry line 42 and the horizontal reference line 44 is further determined.

[0042] The determination unit 22 determines whether the calculated inclination angle α exceeds a predetermined threshold (step S40). If the inclination angle β was determined in step S30, in step S40, it further determines whether the inclination angle β exceeds a predetermined threshold.

[0043] The determination unit 22 counts the number of vertical symmetric lines 41 for which it has determined that the inclination angle α exceeds a predetermined threshold (step S50). If a determination is made regarding the inclination angle β in step S40, the determination unit 22 further counts the number of vertical symmetric lines 42 for which it has determined that the inclination angle β exceeds a predetermined threshold in step S50.

[0044] The determination unit 22 calculates a score indicating the living situation according to the count value of the vertical symmetric line 41 where the inclination angle α exceeds a predetermined threshold (step S60). If the inclination angle β is counted in step S50, the determination unit 22 calculates a score indicating the living situation according to the count value of the vertical symmetric line 41 where the inclination angle α exceeds a predetermined threshold and the count value of the horizontal symmetric line 42 where the inclination angle β exceeds a predetermined threshold in step S60. The determination unit 22 determines the living situation based on the calculated score (step S70).

[0045] If the determination unit 22 determines the living situation, the notification control unit 23 notifies the user of the information device 100 of the results of the living situation determination via the information output unit 80 (step S80).

[0046] As described above, the determination device (control unit 60) according to this embodiment includes an extraction unit 21 that extracts a vertical target line 41 along the vertical direction of an object 40 including at least one of a building, installation, and equipment, and a vertical reference line 43 indicating the vertical direction within the image P, from an image P of the target area R that is the subject of determination, and a determination unit 22 that determines the living conditions of the target area R based on the inclination angle α of the vertical target line 41 with respect to the extracted vertical reference line 43.

[0047] With this configuration, the living conditions in the target area R can be appropriately determined by determining the living conditions based on the inclination angle α between the vertical reference line 41 and the vertical reference line 43 of the object 40 in the image P of the target area R.

[0048] In the determination device according to this embodiment, the extraction unit 21 extracts a horizontal symmetric line 42 along the horizontal direction of the object 40 and a horizontal reference line 44 indicating the horizontal direction within the image P, and the determination unit 22 determines the living conditions of the target area R based on the inclination angle β of the horizontal symmetric line 42 with respect to the extracted horizontal reference line 44.

[0049] With this configuration, the living conditions in the target area R can be more appropriately determined by further using the inclination angle β between the horizontal symmetry line 42 and the horizontal reference line 44 of the object 40 in the image P of the target area R.

[0050] In the determination device according to this embodiment, the image P is an image P captured by the imaging unit 50 of an information device 100 having an imaging unit 50, and the device further includes a notification control unit 23 that notifies the user of the information device 100 of information regarding the determination result of the living situation.

[0051] This configuration allows for the user's attention to be drawn to the information device 100 by informing it of the results of the assessment of the user's living situation.

[0052] In the determination device according to this embodiment, the notification control unit 23 sets the content of the information to be notified according to the type of information device 100.

[0053] With this configuration, by setting the content of the information to be notified according to the type of information device 100, appropriate information according to the type of information device 100 can be notified to the user.

[0054] In the determination device according to this embodiment, the determination unit 22 calculates a score indicating the living situation according to the number of vertical symmetric lines 41 in which the inclination angle α exceeds a predetermined threshold, and determines the living situation based on the calculated score.

[0055] With this configuration, living conditions can be determined more accurately by assessing them based on a score corresponding to the number of vertically symmetrical lines 41 where the inclination angle α exceeds a predetermined threshold.

[0056] In the determination device according to this embodiment, the determination unit 22 calculates a score indicating the living situation according to the number of horizontal symmetric lines 42 in which the inclination angle β exceeds a predetermined threshold, and determines the living situation based on the calculated score.

[0057] With this configuration, living conditions can be determined more appropriately by assessing them based on a score corresponding to the number of horizontal symmetric lines 42 where the inclination angle β exceeds a predetermined threshold.

[0058] The technical scope of the present invention is not limited to the embodiments described above, and modifications can be made as appropriate without departing from the spirit of the invention. For example, in the above embodiments, the configuration of the extraction unit 21, the determination unit 22, and the notification control unit 23, which have the function of a determination device, was described as being mounted on the information device 100, but the invention is not limited to this configuration. At least one of the components of the extraction unit 21, the determination unit 22, and the notification control unit 23, which have the function of a determination device, may be provided in a processing device independent of the information device 100.

[0059] Furthermore, although the above embodiment was described using the example of the extraction unit 21 extracting the vertical symmetric line 41, the horizontal symmetric line 42, the vertical reference line 43, and the horizontal reference line 44, the objects to be extracted by the extraction unit 21 are not limited to those described above. For example, the extraction unit 21 may extract specific objects such as sagging power lines, laundry hanging outside the windows of a building, or blue tarpaulins used as substitutes for the walls of a building, based on the image P, through image processing. In this case, the determination unit 22 can set a score indicating that the living conditions are poor for the target area R from which these specific objects are extracted.

[0060] Furthermore, the results of the assessment of living conditions in the target area R calculated in the above embodiment may be stored in the storage unit 30 or an external storage device in association with the location information (latitude, longitude, etc.) of the target area R. This makes it possible to generate a database that associates the location information of the target area R with living conditions. This database can be used as a guideline for infrastructure development, various development plans, etc., in the target area R. [Explanation of symbols]

[0061] α,β… Inclination angle, P… Image, R… Target area, Q1… Building, Q2… Installation, Q3… Equipment, 10… Communication unit, 20… Processing unit, 21… Extraction unit, 22… Judgment unit, 23… Notification control unit, 30… Storage unit, 40… Target object, 41… Vertical reference line, 42… Horizontal reference line, 43… Vertical reference line, 44… Horizontal reference line, 50… Imaging unit, 60… Control unit, 70… Operation unit, 80… Information output unit, 100… Information equipment

Claims

1. An extraction unit extracts a vertical reference line along the vertical direction of an object, including at least one of a building, installation, and equipment, and a vertical reference line indicating the vertical direction within the image, from an image of the area subject to determination. A determination unit determines the living conditions of the target area based on the angle of inclination of the vertical target line with respect to the extracted vertical reference line. A determination device equipped with the following features.

2. The extraction unit extracts a horizontal symmetric line along the horizontal direction of the object and a horizontal reference line indicating the horizontal direction within the image. The determination unit determines the living conditions of the target area based on the angle of inclination of the horizontal target line relative to the extracted horizontal reference line. The determination device according to claim 1.

3. The aforementioned image is an image captured by the imaging unit of an information device having an imaging unit. The device further comprises a notification control unit that notifies the user of the information device of the results of the assessment of the living conditions. The determination device according to claim 1.

4. The notification control unit sets the content of the information to be notified according to the type of information device. The determination device according to claim 3.

5. The determination unit calculates a score indicating the living situation according to the number of vertical lines whose inclination angle exceeds a predetermined threshold, and determines the living situation based on the calculated score. The determination device according to claim 1.

Images