Beverage intake detection device

Abstract

Provided is a beverage intake detection device capable of detecting the human behavior of beverage intake itself. 【Solution means】An inclination detection means for detecting that a human head is inclined backward, a container detection means for detecting that a beverage container is in contact with or close to a human mouth, and based on the fact that the head is inclined backward and the beverage container is in contact with or close to the human mouth, an intake detection means for detecting that the human has ingested the beverage contained in the beverage container.

Description

Technical Field

[0001] The present invention relates to a beverage intake detection device for detecting a human's intake of a beverage.

Background Art

[0002] For example, as disclosed in Patent Document 1, a device that generates a warning for replenishing moisture based on the amount of sweating is disclosed. Thereby, the target human can be prevented to some extent from suffering from heat stroke.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, if the amount of sweating decreases, there is a risk that the timing of replenishing moisture is too late. It is more desirable from the viewpoint of preventing heat stroke in advance to estimate the timing when moisture replenishment is necessary based on the human behavior of beverage intake itself and issue a warning based on the estimate.

[0005] The present invention has been made in view of the above points, and an object thereof is to provide a beverage intake detection device capable of detecting the human behavior of beverage intake itself.

Means for Solving the Problems

[0006] According to the present invention, an inclination detection means for detecting that a human's head is inclined backward, a container detection means for detecting that a beverage container contacts or approaches the human's mouth, Ingestion detection means for detecting that the human has ingested the beverage contained in the beverage container based on the head being inclined rearward and the beverage container contacting or approaching the human's mouth; A beverage ingestion detection device comprising comprising: said container detection means includes imaging means for imaging a subject from above downward so as to include the human nose and a region in front of the nose in an imaging range; means for detecting that the beverage container contacts or approaches the human mouth based on the presence of the beverage container at a position contacting or approaching the nose in the image obtained by the imaging means through the imaging; and the imaging means is arranged such that when the nose is located at the center of the imaging range in the left - right direction of the human, and the nose is located at the rear end portion of the imaging range in the front - rear direction of the human, and the human head is not tilted, the optical axis of the imaging means becomes substantially vertical. A beverage ingestion detection device is provided.

Advantages of the Invention

[0007] According to the present invention, it is possible to detect the human act of beverage ingestion itself.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings.

[0010] [First Embodiment]

[0011] Referring to FIG. 1(a), user 101 is facing the front (left direction in the drawing) and wearing a helmet 103 on the head 102. An imaging unit 401 is attached to the brim 104 of the helmet 103. The imaging unit 401 captures an object from above downward so as to include the nose 105 of the user 101 and the area 106 in front of the nose 105 in the imaging range.

[0012] Also, an acceleration sensor 402 is attached to the helmet 103. The acceleration sensor 402 detects the acceleration along the Y-axis in the orthogonal coordinate system 107 fixed to the helmet 103. Here, if the helmet 103 is worn on the head 102 as usual, the +X direction in the orthogonal coordinate system 107 corresponds to the right direction of the user 101, the -X direction corresponds to the left direction of the user 101, the +Y direction corresponds to the front direction of the user 101, the -Y direction corresponds to the rear direction of the user 101, the +Z direction corresponds to the upward direction of the user 101, and the -Z direction corresponds to the downward direction of the user 101. Note that since the acceleration along the Y-axis is measured as described later, the attachment angle of the acceleration sensor 402 may be adjusted so that the acceleration along the Y-axis becomes zero during normal times.

[0013] Furthermore, a speaker 403 is attached to the helmet 103. The speaker 403 outputs an alarm sound, for example, when the period during which the user 101 has not consumed a beverage after the user last consumed a beverage reaches a predetermined length.

[0014] Figure 1(b) shows a state where the user 101 is consuming the beverage 109 contained in the beverage container 108. The user 101 is tilting the head 102 backward. As a result, the helmet 103 is also undergoing translational movement and rotation. The acceleration sensor 402 attached to the helmet 103 is also undergoing translational movement and rotation together with the helmet 103. At this time, the acceleration sensor 402 detects an acceleration in the -Y direction with a magnitude of g·sinθ. Here, g is the acceleration due to gravity, and θ is the rotation angle of the helmet 103 around the X-axis. Therefore, it can be said that the acceleration sensor 402 detects the component force of the acceleration due to gravity according to the rotation angle θ. The larger the rotation angle θ, the larger the absolute value of the component force according to sinθ. The magnitude of the signal output by the acceleration sensor 402 is, for example, zero in the state of Figure 1(a), but about plus 2 when the user 101 is in a posture of looking at the smartphone. In contrast, in the state of Figure 1(b), it is about minus 6. Therefore, for example, by setting the threshold value to minus 5 and based on whether the output of the acceleration sensor 402 is smaller than the threshold value, it is possible to detect whether the user 101 is in the posture of Figure 1(b) (that is, whether the user 101 is in a posture of consuming the beverage 109 contained in the beverage container 108).

[0015] However, even when the user 101 is not consuming the beverage 109 contained in the beverage container 108, the user may take a similar posture. Therefore, in the present embodiment, the image obtained by the imaging unit 401 through imaging is also used. By doing so, when the user takes such a posture except for the part related to the beverage container 108 although not for the purpose of consuming the beverage 109 contained in the beverage container 108, it is possible to prevent the incorrect detection that the user takes such a posture for the purpose of consuming the beverage 109 contained in the beverage container 108. Next, with reference to Figures 2 and 3, an explanation will be given about this.

[0016] Both FIGS. 2 and 3 show the images output by the imaging unit 401. FIG. 2 is an image when the user 101 takes the posture as shown in FIG. 1(a). FIG. 3 is an image when the user 101 takes the posture as shown in FIG. 1(b).

[0017] The black part in the image shown in FIG. 2 indicates the nose region 301 of the user 101. The point marked with reference numeral 302 corresponds to the tip of the nose. By imaging the nose 105 from above with the imaging unit 401, an image as shown in FIG. 2 can be obtained. Even if the user 101 changes the posture, the relative positional relationship between the nose 105 and the imaging unit 401 is maintained. Therefore, also in the image shown in FIG. 3, a black nose region 301 exists at the same position as in the image shown in FIG. 2.

[0018] The line segment 110 shown in FIG. 1 corresponds to the boundary line between the nose 105 and the beverage container 108 as seen from the imaging unit 401. As seen from the imaging unit 401, the nose 105 and the beverage container 108 are in contact with each other at the boundary line. Therefore, as shown in FIG. 3, the region 301 of the nose 105 and the region 303 of the beverage container 108 are in contact with each other.

[0019] By image processing, it is possible to detect whether or not the region 301 of the nose 105 (see FIG. 3) and the region 303 of the beverage container 108 (see FIG. 3) in contact therewith are included in the image. For example, · Detect the region 301 of the nose 105. · Detect the region 303 of the beverage container 108. · Determine whether or not the regions 301 and 303 are continuous. Perform the above processing. Or, · Detect the region 301 of the nose 105. · Detect the region 303 of the beverage container 108. · Determine whether the boundary of the region 301 and the boundary of the region 303 coincide. Perform the above processing. Or, · Detect the region 301 of the nose 105. · Detect the region 303 of the beverage container 108. Determine whether the shortest distance between area 301 and area 303 is zero. Perform the process described above. Other processes may also be used.

[0020] Since the area 301 of the nose 105 is in contact with the frame located in the -Y direction and has a shape close to a trapezoid or kamaboko shape, the area 301 of the nose 105 can be detected by utilizing this feature.

[0021] The area 303 of the beverage container 108 has a substantially rectangular shape where the length in the Y-axis direction is longer than the length in the X-axis direction, and the length in the X-axis direction is within a predetermined range. Therefore, the area 303 of the beverage container 108 can be detected by utilizing this feature.

[0022] In the present embodiment, when the output of the acceleration sensor 402 is smaller than the threshold value and the area 301 of the nose and the area 303 of the beverage container 108 in contact therewith are included in the image, it is determined that the user 101 is consuming the beverage contained in the beverage container 108.

[0023] FIG. 4 is a functional block diagram showing the configuration of the beverage intake detection device 400 according to the present embodiment.

[0024] As shown in FIG. 4, the beverage intake detection device 400 includes the imaging unit 401, the acceleration sensor 402, and the speaker 403 as shown in FIG. 1. The beverage intake detection device 400 also includes an inclination detection unit 404, a threshold holding unit 405, a container detection unit 406, a beverage intake detection unit 407, a timer 408, a speaker driving unit 409, a log recording unit 410, a GPS receiver 411, a recording medium 412, and a battery 413. These components are not shown in FIG. 1 but are mounted, for example, inside or outside the helmet 103. However, each component shown in FIG. 4 does not necessarily have to be constantly mounted on the helmet 103 and may be detachably attached to the helmet 103. The same applies when other objects are used instead of the helmet 103 as described later.

[0025] The tilt detection unit 404 receives the Y-direction acceleration signal y(t) from the acceleration sensor 402, and when this signal becomes equal to or less than a predetermined threshold value -|Δy|, it sets the logic level of the head tilt detection signal to TRUE. Therefore, when the user 101 tilts the head 102 backward as shown in FIG. 1(b) and drinks the beverage 109 contained in the beverage container 108, the tilt detection unit 404 sets the logic level of the head tilt detection signal to TRUE.

[0026] The threshold holding unit 406 holds the threshold value -|Δy|.

[0027] The container detection unit 406 receives an image signal from the imaging unit 401. Then, when the container detection unit 406 detects, based on the image signal, that the beverage container 108 is being held against or approaching the user 101's mouth, it sets the logic level of the container detection signal to TRUE.

[0028] Based on the head tilt detection signal and the container detection signal, when the beverage intake detection unit 407 detects that the user 101 is consuming a beverage, it sets the logic level of the beverage intake detection signal to TRUE in a pulsed manner.

[0029] The beverage intake detection unit 407 may, for example, make the beverage intake detection signal TRUE in a pulsed manner when the container detection signal is TRUE and the head tilt detection signal changes from FALSE to TRUE. Also, the beverage intake detection unit 407 may, for example, make the beverage intake detection signal TRUE in a pulsed manner when the head tilt signal is TRUE and the container detection signal changes from FALSE to TRUE. Further, the beverage intake detection unit 407 may, for example, make the beverage intake detection signal TRUE in a pulsed manner when the logical level of the logical product of the head tilt detection signal and the container detection signal changes from FALSE to TRUE. Additionally, the beverage intake detection unit 407 may, for example, make the beverage intake detection signal TRUE in a pulsed manner when the period during which the logical level of the logical product of the head tilt detection signal and the container detection signal is TRUE exceeds a threshold value. Moreover, the beverage intake detection unit 407 compares the time when the logical level of the head tilt detection signal changes from FALSE to TRUE with the time when the logical level of the container detection signal changes from FALSE to TRUE, and may make the beverage intake detection signal TRUE in a pulsed manner when it is determined that the difference between the two is less than a predetermined length.

[0030] The timer 408 starts timing after being reset to a predetermined timer value when the logical level of the beverage intake detection signal becomes TRUE in a pulsed manner. Then, when the timer value has elapsed, the logical level of the timeout signal is made TRUE. When the timer 408 is reset again, the logical level of the timeout signal returns to FALSE.

[0031] The speaker drive unit 409 starts driving the speaker 403 when the logical level of the timeout signal changes from FALSE to TRUE. The speaker drive unit 409 ends the driving of the speaker 403 when the logical level of the speaker reset signal becomes TRUE. The speaker drive unit 409 may end the driving of the speaker 403 even if the speaker reset signal is not input, if a predetermined time has elapsed since the start of driving the speaker 403. The speaker reset signal, for example, has a logical level that becomes TRUE when a reset button (not shown) mounted on the helmet is pressed.

[0032] When the logic level of the beverage intake detection signal becomes TRUE in a pulsed manner, the log recording unit 410 acquires the current time and location from the GPS receiver 411 and records the current location and time on a recording medium 412 such as a memory card or SSD. The GPS receiver 411 may be replaced with a clock to record only the current time.

[0033] The battery 413 supplies power to each part of the beverage intake detection device 400.

[0034] [Other Embodiments]

[0035] In the above embodiment, when it is detected that the beverage container 108 is in contact with the nose 105 in the image obtained by imaging, the logic level of the container detection signal is set to TRUE, but this is not the only case. For example, when it is detected that the beverage container 108 is close to the nose 105, the logic level of the container detection signal may be set to TRUE. Also, since the area where the nose exists in the image is almost determined, the position of the beverage container 108 may be detected without using the relative relationship with the actual image of the nose. For example, when it is detected that the beverage container 108 is in a predetermined range assumed in advance in the image, the logic level of the container detection signal may be set to TRUE.

[0036] The acceleration sensor 402 does not necessarily have to be mounted on the helmet 103. The acceleration sensor 402 may be mounted on, for example, any of glasses, an adapter, a hat, goggles, a headband, headphones, and a hairpin as long as the Y-axis is horizontal during normal times and rotates about the X-axis in response to the inclination of the head 102 backward.

[0037] The imaging unit 401 does not necessarily have to be mounted on the helmet 103. The imaging unit 401 may be mounted on, for example, any of glasses, an adapter, a hat, goggles, a headband, headphones, and a hairpin as long as it has the positional relationship shown in FIG. 1 with the head 102.

[0038] The speaker 403 does not necessarily have to be mounted on the helmet 103. The speaker 403 may be, for example, an independent speaker or a speaker of a smartphone as long as it emits an alarm sound that can be perceived by the user 102. Also, when using the speaker of a smartphone, a communication means for short-range communication with the smartphone may be provided on the helmet 103.

[0039] The tilt detection unit 404, the threshold holding unit 405, the container detection unit 406, the beverage intake detection unit 407, the timer 408, the speaker drive unit 409, the log recording unit 410, the GPS receiver 411, the recording medium 412, and the battery 413 do not necessarily have to be mounted on the helmet 103. For example, at least some of the functional block parts may be operated on the cloud. In this case, a communication means for connecting to the Internet may be provided on the helmet. Also, for example, at least some of the functional blocks may be operated within a smartphone. In this case, a communication means for short-range communication with the smartphone may be provided on the helmet.

[0040] Glasses or goggles may be used instead of the helmet 103. For example, as shown in FIG. 5, the glasses 501 may be provided with the imaging unit 401, the acceleration sensor 402, and the speaker 403, and the other parts shown in FIG. 4 may also be provided on the glasses 501. In this case, as shown in FIG. 5, the viewing angle of the imaging unit 401 is adjusted so that the boundary line 110 between the nose 105 and the beverage container 108 enters the imaging range, and the beverage container 108 is arranged near the center of the imaging range when the user 101 takes the posture as shown in FIG. 5.

[0041] A part of the beverage intake detection device 400 may be provided on the helmet, and the remaining part may be provided on the glasses or goggles. For example, the imaging unit 401 may be provided on the helmet, and the remaining part may be provided on the glasses or goggles.

[0042] As the imaging unit 401, a reflective infrared sensor may be used. In this case, a retroreflective sheet such as a microprism type reflective sheet may be attached to the beverage container 108. Alternatively, the beverage container 108 may be housed in a cover with a retroreflective sheet attached to its surface.

[0043] Using the current count value of the timer 408, caution information that changes according to the elapsed time since the last beverage intake may be output. For example, a sound prompting caution may be output starting from a predetermined period before the time when the speaker 403 outputs an alarm sound.

[0044] Instead of, or in addition to, the speaker 403, a lamp or a vibrator for alarms and cautions may be used.

Explanation of Reference Numerals

[0045] 401 Imaging unit 402 Acceleration sensor 403 Speaker 404 Tilt detection unit 406 Container detection unit 407 Beverage intake detection unit 408 Timer 410 Log recording unit

Claims

1. tilt detection means for detecting a backward tilt of a human head; a container detection means for detecting contact or proximity of a beverage container with the person's mouth; an intake detection means for detecting that the person has taken the beverage contained in the beverage container based on the head being tilted backward and the beverage container being in contact with or close to the person's mouth; A beverage intake detection device comprising: The container detection means includes: an imaging means for imaging a subject from above downward so as to include the nose of the person and an area in front of the nose in an imaging range; a means for detecting that the beverage container is in contact with or close to the mouth of the person based on the presence of the beverage container in a position in contact with or close to the nose in the image captured by the imaging means; Equipped with the imaging means is disposed such that, when the nose is located at the center of the imaging range in the left-right direction of the person, the nose is located at the rear end of the imaging range in the front-rear direction of the person, and the head of the person is not tilted, the optical axis of the imaging means is substantially vertical. Beverage intake detection device.

2. The imaging means is attached to an article of clothing worn on the head or is attachable to the article of clothing. The beverage intake detection device according to claim 1 .

3. The imaging means is a reflective type having a light emitting unit and a light receiving unit. The beverage intake detection device according to claim 1 .

4. A beverage intake detection device as claimed in claim 3; A retroreflective sheet attached to the beverage container. Beverage intake detection system.

5. The tilt detection means is an acceleration sensor directly or indirectly fixed to the head so as to detect a component of gravitational acceleration when the head is tilted backward; a means for detecting a backward tilt of the head based on the force component and a threshold value; Equipped with The beverage intake detection device according to claim 1 .

6. The acceleration sensor is attached to an article of clothing worn on the head, or is attachable to the article of clothing.

6. The beverage intake detection device according to claim 5.

7. The device further includes a recording means for recording a time when the intake detection means detects that the person has taken a beverage. The beverage intake detection device according to claim 1 .

8. means for detecting a location where the human is present; The recording means records the location at the time together with the time.

8. The beverage intake detection device according to claim 7.

9. and means for outputting, based on a period during which the person has not consumed a beverage since the intake detection means last detected that the person consumed a beverage, warning information or warning information which changes depending on the length of the period. The beverage intake detection device according to claim 1 .

Images