IMAGE MANAGEMENT SYSTEM, IMAGE MANAGEMENT METHOD, AND IMAGE MANAGEMENT PROGRAM

Abstract

The present invention relates to an image management system, a wearable device, an image management method, and an image management program. The image management system (10) comprises: a wearable device (12) having a camera (48); and an information processing server (16). The information processing server (16) has a server storage unit (100) that stores a captured image received from the wearable device (12). The wearable device (12) or the information processing server (16) has an information organization unit. When determination that the captured image is not a meal image is made by an image determination unit, the information organization unit delates the captured image. When determination that the captured image is a meal image is made by the image determination unit, the server storage unit (100) holds the captured image.

Description

[Technical Field]

[0001] The present invention relates to an image management system. , painting The present invention relates to an image management method and an image management program. [Background technology]

[0002] Japanese Patent Application Laid-Open Publication No. 2019-28625 discloses an image management system that transmits photographed images (meal images) taken with a camera on a user terminal such as a smartphone to a server and stores them in the server. The photographed images stored in the server are used for blood glucose management (such as diabetes treatment guidance and health guidance). Summary of the Invention

[0003] However, with the image management system described above, if a user forgets to carry the user terminal or if the user terminal is in a bag, it may not be possible to quickly photograph a meal. Furthermore, even if a photographed image is not a meal image, the photographed image is stored as is in the server, which may prevent effective health management (blood sugar management) using meal images.

[0004] The present invention has been made in consideration of the above-mentioned problems, and provides an image management system that can efficiently photograph food and effectively manage health using food images. , painting The object of the present invention is to provide an image management method and an image management program.

[0005] A first aspect of the present invention is a medical image management system including a wearable device worn by a user and an information processing server capable of communicating with the wearable device, wherein the wearable device includes a camera for photographing a subject. a notification control unit that performs notification control to prompt the user to input a meal date and time; the information processing server includes a server storage unit that stores the captured image received from the wearable device. a time determination unit that determines whether the time and date of a meal of the user has been acquired, if the time and date acquisition determination unit determines that the time and date of the meal has not been acquired, and determines whether the time elapsed since the last meal date and time has exceeded a predetermined meal interval; and a notification request control unit that requests the wearable device to perform the notification control, if the time determination unit determines that the time elapsed since the last meal date and time has exceeded the predetermined meal interval.wherein either the wearable device or the information processing server has an information organizing unit that organizes the captured image based on the determination result of the image determination unit as to whether the captured image taken by the camera is a food image, and the information organizing unit deletes the captured image when the image determination unit determines that the captured image is not the food image, and the server storage unit holds the captured image when the image determination unit determines that the captured image is the food image.

[0007] The present invention 2 The present invention provides a medical image management method, comprising: a date and time acquisition determination step in which a date and time acquisition determination unit determines whether or not the date and time of a meal of the user has been acquired; a time determination step in which, when it is determined in the date and time acquisition determination step that the date and time of the meal has not been acquired, a time determination step in which a time determination unit determines whether or not the time elapsed since the date and time of the previous meal has exceeded a predetermined meal interval; and a notification request control step in which, when it is determined in the time determination step that the time elapsed since the date and time of the previous meal has exceeded the predetermined meal interval, a notification request control step in which a notification request control unit requests the wearable device to perform notification control that prompts the user to input the date and time of a meal; Wearable by the user The aforementioned The method includes a photographing step of photographing a subject with a camera of a wearable device, an image transmitting step of transmitting the photographed image photographed in the photographing step to an information processing server, a storage step of storing the photographed image received from the wearable device in a server storage unit of the information processing server, and a server information organizing step of organizing the photographed image based on a determination result of an image determination unit as to whether the photographed image photographed by the camera is a food image, wherein in the server information organizing step, if the image determination unit determines that the photographed image is not the food image, the photographed image is deleted, and if the image determination unit determines that the photographed image is the food image, the photographed image is retained in the server storage unit. Computer-generated It is an image management method.

[0008] The present invention 3 The present invention provides a medical image management method, comprising: a date and time acquisition determination step in which a date and time acquisition determination unit determines whether or not the date and time of a meal of the user has been acquired; a time determination step in which, when it is determined in the date and time acquisition determination step that the date and time of the meal has not been acquired, a time determination step in which a time determination unit determines whether or not the time elapsed since the date and time of the previous meal has exceeded a predetermined meal interval; and a notification request control step in which, when it is determined in the time determination step that the time elapsed since the date and time of the previous meal has exceeded the predetermined meal interval, a notification request control step in which a notification request control unit requests the wearable device to perform notification control that prompts the user to input the date and time of a meal; Wearable by the user The aforementionedThe method includes a photographing step of photographing a subject with a camera of a wearable device, a storage step of storing the photographed image photographed in the photographing step in a storage unit of the wearable device, an image determination step of transmitting the photographed image stored in the storage unit to an image determination server and receiving a determination result of the image determination server as to whether the photographed image is a food image, and an information organizing step of organizing the photographed images stored in the storage unit, wherein in the information organizing step, if the wearable device receives a determination result that the photographed image is not the food image, the photographed image is deleted from the storage unit, and if the wearable device receives a determination result that the photographed image is the food image, the photographed image is deleted after being transmitted to an information processing server. Computer-generated It is an image management method.

[0009] The present invention 4 The present invention provides a medical image management program, a date and time acquisition determination step in which a date and time acquisition determination unit determines whether or not the date and time of a meal of the user has been acquired; a time determination step in which, when it is determined in the date and time acquisition determination step that the date and time of the meal has not been acquired, a time determination step in which a time determination unit determines whether or not the time elapsed since the date and time of the previous meal has exceeded a predetermined meal interval; and a notification request control step in which, when it is determined in the time determination step that the time elapsed since the date and time of the previous meal has exceeded the predetermined meal interval, a notification request control step in which a notification request control unit requests the wearable device to perform notification control that prompts the user to input the date and time of a meal; Wearable by the user The aforementioned This image management program causes a computer to execute the following steps: a photographing step of photographing a subject with a camera of a wearable device; an image transmitting step of transmitting the photographed image taken in the photographing step to an information processing server; a storage step of storing the photographed image received from the wearable device in a server memory unit of the information processing server; and a server information organizing step of organizing the photographed image based on the determination result of an image determination unit as to whether the photographed image taken by the camera is a food image; in the server information organizing step, if the image determination unit determines that the photographed image is not a food image, the photographed image is deleted, and if the image determination unit determines that the photographed image is a food image, the photographed image is retained in the server memory unit.

[0010] The present invention 5 The present invention provides a medical image management program, a date and time acquisition determination step in which a date and time acquisition determination unit determines whether or not the date and time of a meal of the user has been acquired; a time determination step in which, when it is determined in the date and time acquisition determination step that the date and time of the meal has not been acquired, a time determination step in which a time determination unit determines whether or not the time elapsed since the date and time of the previous meal has exceeded a predetermined meal interval; and a notification request control step in which, when it is determined in the time determination step that the time elapsed since the date and time of the previous meal has exceeded the predetermined meal interval, a notification request control step in which a notification request control unit requests the wearable device to perform notification control that prompts the user to input the date and time of a meal; Wearable by the user The aforementionedThis image management program causes a computer to execute the following steps: a photographing step of photographing a subject with a camera of a wearable device; a storage step of storing the photographed image taken in the photographing step in a storage unit of the wearable device; an image determination step of sending the photographed image stored in the storage unit to an image determination server and receiving the determination result of the image determination server as to whether the photographed image is a food image; and an information organization step of organizing the photographed images stored in the storage unit.In the information organization step, if the wearable device receives a determination result that the photographed image is not a food image, the photographed image is deleted from the storage unit, and if the wearable device receives a determination result that the photographed image is a food image, the photographed image is sent to an information processing server and then deleted.

[0011] According to the present invention, by wearing a wearable device, a user can quickly take photos of their meal using the camera of the wearable device. This allows for efficient photo-taking of meals. Furthermore, if a captured image is not a food image, it is deleted from the server storage unit (storage unit), allowing for effective health management using food images. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a block diagram of an image management system according to an embodiment of the present invention; [Figure 2] FIG. 2 is a perspective view of the wearable device of FIG. 1. [Figure 3] 3A is a front view of the wearable device of FIG. 2, and FIG. 3B is a longitudinal cross-sectional view taken along line IIIB-IIIB of FIG. 3A. [Figure 4] FIG. 3C is a block diagram of a device body forming the wearable device of FIG. 3B. [Figure 5] 2 is a flowchart illustrating the operation of the wearable device of FIG. 1. [Figure 6]10 is a first flowchart illustrating the operation of the information processing server of FIG. [Figure 7] 10 is a second flowchart illustrating the operation of the information processing server of FIG. [Figure 8] 1 is an example of a blood glucose control graph. [Figure 9] 10 is a flowchart according to a first modified example for explaining the operation of the wearable device of FIG. [Figure 10] 10 is a flowchart according to a second modified example for explaining the operation of the wearable device of FIG. [Figure 11] FIG. 11A is a first explanatory diagram of photographing a subject with a camera of a wearable device, and FIG. 11B is a second explanatory diagram of photographing a subject with a camera of a wearable device. [Figure 12] FIG. 10 is a block diagram illustrating a wearable device according to a modified example. [Figure 13] 13 is a flowchart for explaining the operation of the wearable device of FIG. 12. DETAILED DESCRIPTION OF THE INVENTION

[0013] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An image management system, a wearable device, an image management method, and an image management program according to preferred embodiments of the present invention will be described below with reference to the accompanying drawings.

[0014] An image management system 10 according to one embodiment of the present invention is a medical system for performing health management (for example, blood sugar management) using food images taken by a user 200 (see FIG. 11A).

[0015] As shown in FIG. 1, the image management system 10 includes a wearable device 12, an information processing system 18 having an information processing device 14 and an information processing server 16, an image assessment server 20, and a teaching device 22.

[0016] 11A, wearable device 12 is configured to be worn by user 200. Wearable device 12 is configured to be detachable from the wrist, for example, like a wristband. However, wearable device 12 may be integrally provided with eyeglasses, configured to be detachable from clothing, configured to be detachable from the neck like a necklace, or configured to be detachable from the head. In other words, wearable device 12 may be configured in any way as long as it can be detachably worn by user 200.

[0017] 2 to 3B, wearable device 12 includes device main body 24, and first and second belt parts 26 and 28 for attaching device main body 24 to the wrist of user 200. Device main body 24 has a case 30 formed in the shape of a vertically long box. However, case 30 may also be in the shape of a horizontally long box, a box with a polygonal bottom (other than a rectangular shape), a cylindrical shape, an elliptical cylindrical shape, or the like.

[0018] 2 and 3B, the first belt portion 26 is fixed to one end of the case 30 by a first fixing portion 32. A plurality of locking holes 34 are formed in the first belt portion 26. The plurality of locking holes 34 are arranged at equal intervals in the extension direction of the first belt portion 26. A belt loop hole 36 for passing the second belt portion 28 through is provided at the tip end of the first belt portion 26.

[0019] The second belt portion 28 is fixed to the other end of the case 30 by a second fixing portion 38. A locking pin 40 that can fit into the locking hole 34 of the first belt portion 26 is provided at the tip of the second belt portion 28. The first belt portion 26 and the second belt portion 28 are locked to each other by the locking pin 40 fitting into the locking hole 34.

[0020] 2 to 3B, the device main body 24 has a display unit 42, an indicator 44, a blood glucose sensor mounting unit 46, a camera 48, a light-emitting unit 50, a first communication unit 52, a battery 54, a printed circuit board (PCB) 56, and two operation switches 58.

[0021] The display unit 42 is provided on the front surface side of the case 30. The display unit 42 can be configured as an LED display, an LCD display, a CRT display, a plasma display, a touch screen display, or the like, but is not limited to these.

[0022] The indicator 44 is provided on the case 30 on the side where the first fixing part 32 is located, relative to the display part 42. The indicator 44 is configured as an LED indicator to display the state of the device main body 24.

[0023] The blood glucose sensor attachment section 46 is provided on the side of the case 30 where the second fixing section 38 is located relative to the display section 42. A blood glucose sensor (not shown) that takes in blood is attached to the blood glucose sensor attachment section 46.

[0024] Camera 48 is used to take pictures of the meal of user 200. Camera 48 is provided on the side of case 30 where first fixing part 32 is located, closer to display part 42. Camera 48 is configured as a pinhole camera. However, camera 48 is not limited to a pinhole camera, and may be a camera with a lens.

[0025] 2 and 3A, the light-emitting unit 50 is provided in a position on the case 30 separate from the camera 48 so as not to interfere with the photographing function of the camera 48. Specifically, the light-emitting unit 50 is provided to the side of the camera 48. The light-emitting unit 50 outputs guide light L that indicates the photographing direction of the camera 48 (see FIG. 11B). The guide light L is visible light, but its color can be set appropriately. The emission intensity of the guide light L may be such that it can irradiate an area within 1 m from the light-emitting unit 50.

[0026] The light emitting unit 50 has, for example, a laser diode that emits laser light as guide light L. In this case, the guide light L output from the laser diode passes through an aperture formed in a mask and is output from the projection optical system toward the subject 202 (see FIGS. 11A and 11B). The shape of the aperture can be set appropriately. The light (guide light L) emitted from the laser diode irradiates one point on the subject 202.

[0027] The light-emitting unit 50 may have a light-emitting element such as an LED element. In this case, the guide light L output from the light-emitting unit 50 spreads toward the subject 202. The light-emitting element is not limited to an LED element, and may be an organic EL element, an inorganic EL element, or the like. The guide light L emitted from the light-emitting unit 50 also functions as an AF assist light for the camera 48.

[0028] 3B, the first communication unit 52 is housed in the case 30. The first communication unit 52 establishes a wireless communication line with the server communication unit 88 (see FIG. 1) of the information processing server 16 to communicate information. The standard of the wireless communication line between the first communication unit 52 and the server communication unit 88 is preferably LPWA. However, the standard of the wireless communication line between the first communication unit 52 and the server communication unit 88 may also be, for example, Wi-Fi (registered trademark) or LTE (registered trademark).

[0029] The battery 54 is housed in the case 30 so as to be located closer to the display unit 42 than the first communication unit 52. The battery 54 supplies power to the electronic components of the device main body 24. The battery 54 includes a secondary battery, a capacitor, or the like. The printed circuit board 56 is housed in the case 30 so as to be located closer to the display unit 42 than the battery 54. Electronic components (not shown) are mounted on the printed circuit board 56.

[0030] 2 and 3A, two operation switches 58 (operation units) are provided for taking pictures with the camera 48, one on each of the left and right sides of the case 30. Each operation switch 58 is a push button type switch. However, each operation switch 58 is not limited to the push button type and may be a slide switch or the like.

[0031] In the device main body 24, the arrangement of the indicator 44, blood glucose sensor mounting section 46, first communication section 52, battery 54, and printed circuit board 56 can be changed as appropriate. The number, size, shape, and position of the operation switches 58 can be set as appropriate.

[0032] As shown in FIG. 4, the device main body 24 of the wearable device 12 further includes a biological information measurement unit 60, a second communication unit 62, a notification unit 64, and a control unit 66.

[0033] The biological information measurement unit 60 measures biological information of the user 200. Specifically, the biological information measurement unit 60 has an acceleration sensor 70. The acceleration sensor 70 measures, for example, the number of steps taken by the user 200. The biological information measurement unit 60 may further measure blood pressure, pulse (heart rate), body temperature, etc. In this case, the biological information measurement unit 60 may include, for example, a heart rate detection sensor. The heart rate detection sensor measures the heart rate using any of electrocardiography, photoplethysmography, blood pressure measurement, and phonocardiography.

[0034] The information measured by the biological information measurement unit 60 is displayed on the display unit 42. Specifically, the display unit 42 displays the blood sugar level (glucose concentration), the amount of activity, the number of steps, the heart rate, the sleep time, etc. The display unit 42 also displays the current date and time, whether or not the biological information can be measured, whether or not data (for example, an image captured by the camera 48) can be transmitted, etc. The image captured by the camera 48 itself is not displayed on the display unit 42.

[0035] 1, the second communication unit 62 establishes a wireless communication link with the information processing device 14 to communicate information. The standard of the wireless communication link between the second communication unit 62 and the information processing device 14 is Bluetooth (registered trademark), and in particular, BLE (Bluetooth Low Energy) is preferable. However, the standard of the wireless communication link between the second communication unit 62 and the information processing device 14 may be, for example, Wi-Fi (registered trademark). Furthermore, the second communication unit 62 may establish a wired communication link with the information processing device 14 to communicate information. The second communication unit 62 transmits, for example, biological information (step count information, etc.) to the information processing device 14.

[0036] 4, the notification unit 64 has a speaker 72 and a vibration unit 74. The speaker 72 outputs sound information (voice, electronic sound, etc.). The vibration unit 74 transmits vibrations to the user 200.

[0037] The control unit 66 is a calculator including a microcomputer, and has a CPU (Central Processing Unit), ROM as memory, RAM, etc., and functions as a function realization unit (function realization means) by the CPU reading and executing programs stored in the ROM. Note that the function realization unit can also be configured as a function realization device as hardware.

[0038] The control unit 66 includes a blood glucose measurement control unit 76 , a light emission control unit 78 , a subject determination unit 79 , a camera control unit 80 , a storage unit 82 , a device information organizing unit 84 , and a notification control unit 86 .

[0039] The blood glucose measurement control unit 76 measures the blood glucose level (glucose concentration in plasma) of blood taken into the blood glucose measurement sensor. A continuous glucose monitor may be used to continuously obtain blood glucose information. In this case, the blood glucose measurement control unit 76 obtains the measurement value and measurement time information from the continuous glucose monitor. The light emission control unit 78 controls the operation of the light emission unit 50 to output guide light L from the light emission unit 50. The subject determination unit 79 determines whether the subject 202 within the shooting range of the camera 48 matches or is similar to a predetermined meal image. The camera control unit 80 controls the operation of the camera 48.

[0040] The memory unit 82 stores blood glucose information (measurement values ​​and measurement dates and times acquired by the blood glucose measurement control unit 76) and images captured by the camera 48. The device information organizing unit 84 organizes the captured images stored in the memory unit 82. The notification control unit 86 controls the operation of the notification unit 64. Specifically, the notification control unit 86 causes the speaker 72 to output sound information and the vibration unit 74 to vibrate.

[0041] 1, the information processing device 14 is operated by a user 200. The information processing device 14 is, for example, but not limited to, a smartphone, a laptop, a tablet, etc. The information processing device 14 transmits setting instruction information and operation instruction information for the wearable device 12 to the second communication unit 62 of the wearable device 12, for example.

[0042] The information processing device 14 establishes a wireless communication line with the server communication unit 88 of the information processing server 16 to communicate information. The standard of the wireless communication line between the information processing device 14 and the server communication unit 88 may be the same as the standard of the wireless communication line between the first communication unit 52 of the wearable device 12 and the server communication unit 88 of the information processing server 16. The information processing device 14 transmits, for example, biometric information to the server communication unit 88.

[0043] The information processing server 16 has a server communication unit 88, a determination communication unit 90, and a server control unit 92. The server communication unit 88 establishes a wireless communication line with the training device 22 to communicate information. The standard of the wireless communication line between the server communication unit 88 and the training device 22 may be the same as the standard of the wireless communication line between the first communication unit 52 of the wearable device 12 and the information processing server 16.

[0044] The determination communication unit 90 establishes a wireless communication line with the image determination server 20 to communicate information. The standard of the wireless communication line between the determination communication unit 90 and the image determination server 20 can be the same as the standard of the wireless communication line between the first communication unit 52 of the wearable device 12 and the server communication unit 88. Note that an image determination function may be added to the wearable device 12 instead of the image determination server 20. In this case, the determination communication unit 90 can be omitted.

[0045] The server control unit 92 includes a date and time acquisition determination unit 93, a notification request control unit 94, a server information organizing unit (information organizing unit) 95, a timer 96, a time determination unit 98, a server storage unit 100, and a graph creation unit .

[0046] The date and time acquisition determination unit 93 determines whether or not the meal date and time of the user 200 has been acquired. The notification request control unit 94 requests the wearable device 12 to perform notification control to prompt the input of the meal date and time. The server information organizing unit 95 organizes the captured images stored in the server storage unit 100.

[0047] The timer 96 measures time. The time determination unit 98 determines a predetermined time. The server storage unit 100 stores blood glucose information (blood glucose date and time and glucose concentration) and captured images (meal images). The graph creation unit 102 creates a blood glucose management graph 104 (see FIG. 8) based on the blood glucose information and meal images stored in the server storage unit 100.

[0048] The instruction device 22 is a medical device operated by a medical professional (such as a doctor or a registered dietitian), and is used to perform blood glucose management (such as medical instruction and health instruction) for the user 200.

[0049] Next, a description will be given of an image management method using the image management system 10. First, the operational flow of the wearable device 12 will be described.

[0050] 5, first, the control unit 66 determines whether or not a shooting instruction has been issued (step S1). Specifically, the control unit 66 determines that a shooting instruction has been issued when two operation switches 58 have been operated simultaneously. Note that the control unit 66 determines that a shooting instruction has not been issued when two operation switches 58 have not been operated simultaneously (for example, when only one of the operation switches 58 has been operated). If the control unit 66 determines that a shooting instruction has not been issued (step S1: NO), the process remains in step S1 until a shooting instruction is issued.

[0051] When the control unit 66 determines that a shooting instruction has been issued (step S1: YES), the light emission control unit 78 outputs guide light L from the light emitting unit 50 (step S2). At this time, the user 200 directs the guide light L toward the subject 202.

[0052] Next, the camera control unit 80 causes the camera 48 to capture an image (step S3). Specifically, the subject determination unit 79 determines whether or not the subject 202 that has entered the capture range of the camera 48 corresponds to predetermined meal information. For example, the subject determination unit 79 determines whether or not the subject 202 that has entered the capture range of the camera 48 matches or resembles a predetermined meal image.

[0053] Then, when the subject determination unit 79 determines that the subject 202 that has entered the shooting range of the camera 48 does not correspond to the predetermined meal information, the camera control unit 80 prohibits the camera 48 from shooting the subject 202. In other words, the camera control unit 80 does not shoot the subject 202 with the camera 48 (does not release the shutter) because it is highly likely that the subject 202 is not a meal.

[0054] On the other hand, when the subject determination unit 79 determines that the subject 202 that has entered the photographing range of the camera 48 corresponds to predetermined meal information, the camera control unit 80 permits the camera 48 to photograph the subject 202. That is, the camera control unit 80 photographs the subject 202 by the camera 48 (releases the shutter) because there is a high possibility that the subject 202 is eating. That is, the camera control unit 80 photographs the subject 202 when the subject 202 is eating.

[0055] In step S3, when the camera 48 has completed capturing an image, the camera control unit 80 may output a capturing sound (e.g., a shutter sound) from the speaker 72 or may blink the indicator 44. This allows the user 200 to easily know that capturing an image has been completed.

[0056] Next, the light emission control unit 78 stops the output of the guide light L from the light emission unit 50 (step S4). That is, when the photographing of the subject 202 is completed, the output of the guide light L automatically stops without any particular operation of the operation switch 58. This allows the user 200 to more easily know that the photographing is completed. Thereafter, the device information organizing unit 84 stores the photographed image in the storage unit 82 (step S5).

[0057] Then, the wearable device 12 transmits the captured image stored in the storage unit 82 to the information processing server 16 (step S6). Specifically, the first communication unit 52 transmits the captured image stored in the storage unit 82 to the information processing server 16. In step S6, the second communication unit 62 may transmit the captured image stored in the storage unit 82 to the information processing device 14, and then the information processing device 14 may transmit the captured image to the information processing server 16. This can reduce consumption of the battery 54 of the wearable device 12 compared to when the first communication unit 52 directly transmits the captured image to the information processing server 16.

[0058] Next, the device information organizing unit 84 deletes the captured image from the storage unit 82 (step S7). This reduces the storage capacity of the storage unit 82 required to store the captured image. Thereafter, the operation flow of the wearable device 12 ends.

[0059] Next, the operation flow of the information processing server 16 will be described.

[0060] 6, the date and time acquisition determination unit 93 determines whether the server communication unit 88 has received a meal date and time (step S10). The meal date and time is the date and time when the user 200 actually had a meal (meal start date and time), and is registered in the information processing device 14 by the user 200, for example. The meal date and time registered in the information processing device 14 is transmitted from the information processing device 14 to the information processing server 16.

[0061] If the date and time acquisition determination unit 93 determines that a meal date and time has not been received (step S10: NO), the time determination unit 98 determines whether the elapsed time T1 since the previous meal date and time has exceeded a predetermined meal interval T2 (step S11). Here, the meal interval T2 is set to, for example, 6 hours if the previous meal date and time was breakfast or lunchtime, and set to 12 hours if the previous meal date and time was dinnertime. However, the meal interval T2 can be set as appropriate.

[0062] If the time determination unit 98 determines that the elapsed time T1 from the date and time of the previous meal has not reached the predetermined meal interval T2 (step S11: NO), the process proceeds to step S14, which will be described later.

[0063] If the time determination unit 98 determines that the elapsed time T1 since the last meal date and time exceeds the predetermined meal interval T2 (step S11: YES), the server communication unit 88 transmits a notification control request to the wearable device 12 (step S12). When the first communication unit 52 of the wearable device 12 receives the notification control request, the notification control unit 86 performs notification control to prompt the user 200 to register the meal date and time. Specifically, the notification control unit 86 outputs, for example, a voice message saying "Please register the meal date and time" from the speaker 72. Furthermore, instead of (or in addition to) a voice message, the notification control unit 86 may display a graphic or image on the display unit 42 to prompt the user to register the meal date and time. At this time, the notification control unit 86 may vibrate the vibration unit 74.

[0064] Furthermore, in step S12, the server communication unit 88 may transmit a notification control request to the information processing device 14. In this case, when the information processing device 14 receives the notification control request, the information processing device 14 performs notification control to prompt the user 200 to register the meal date and time. Specifically, the information processing device 14 outputs, for example, a voice message saying "Please register the meal date and time" from a speaker (not shown) of the information processing device 14. Furthermore, instead of (or in addition to) the voice message, the information processing device 14 may display text saying "Please register the meal date and time" on a display (not shown) of the information processing device 14.

[0065] Furthermore, in step S12, the server communication unit 88 may transmit the notification control request to both the wearable device 12 and the information processing device 14. In this case, notification control is performed in both the wearable device 12 and the information processing device 14. After step S12, the process returns to step S10.

[0066] If the server control unit 92 determines that the meal date and time has been received (step S10: YES), the server information organizing unit 95 stores the received meal date and time in the server storage unit 100 (step S13). Next, the server control unit 92 determines whether the server communication unit 88 has received a captured image (step S14). The captured image is transmitted from the first communication unit 52 to the server communication unit 88 by the wearable device 12 performing the process of step S6 in FIG. 5 described above.

[0067] If the server control unit 92 determines that the captured image has not been received (step S14: NO), the process returns to step S10. On the other hand, if the server control unit 92 determines that the captured image has been received (step S14: YES), the captured image is stored in the server storage unit 100 (step S15).

[0068] Next, the determination communication unit 90 transmits the latest captured image stored in the server storage unit 100 to the image determination server 20 (step S16). The image determination server 20 then determines whether the captured image is an image that includes meal information, and if it does include meal information, determines that the captured image is a meal image. The determination communication unit 90 then transmits the determination result to the determination communication unit 90. The determination communication unit 90 receives the determination result as to whether the captured image is a meal image (step S17). Note that in step S16, the image determination server 20 can determine whether the captured image includes a specific image that has been registered in advance in the image determination server 20.

[0069] Next, if the determination communication unit 90 receives a determination result that the most recently captured image is neither a meal image nor a specific image (step S18: NO), the captured image is deleted from the server storage unit 100 (step S19). This reduces the storage capacity of the server storage unit 100 required to store captured images. Furthermore, even if an image that does not include meal information or a specific image (for example, a secretly taken image) is captured by the wearable device 12, the captured image can be deleted from the server storage unit 100. Then, the current operation flow ends (see FIG. 7).

[0070] If the determination communication unit 90 receives a determination result that the most recently captured image includes a meal image or a specific image (step S18: YES), the server control unit 92 determines whether the most recently captured image is related to a meal event (step S20), as shown in FIG. 7. Specifically, if the captured image includes meal information based on the determination of the server control unit 92, the captured image is registered as a meal image and classified as a meal event. If the server control unit 92 determines that the captured image does not include meal information, the captured image is classified as a special event. Alternatively, when taking a photograph using the camera 48 of the wearable device 12, the user 200 may register with the information processing device 14 whether the event related to the photograph is a meal event or a special event.

[0071] The special event includes information related to the user's 200 blood glucose management other than the meal content itself. More specifically, examples of the special event include taking oral medication, injecting insulin, fever, hypoglycemia or hyperglycemia, fatigue, whether or not exercised, the time a meal started, and the time a meal ended. A specific symbol indicating a special event (e.g., an oral medication currently being taken) is pre-registered in each of the information processing device 14 and the information processing server 16. A special event can be determined when a captured image contains any of the registered specific symbols at a predetermined ratio. This simplifies the processing of the information processing device 14 and the information processing server 16, and the user 200 can easily collect and record information by simply capturing a predetermined object with the wearable device 12. The user 200 may manually input information indicating whether the event is a meal event or a special event and transmit this information to the information processing device 14 and the information processing server 16.

[0072] If the server control unit 92 determines that the most recent captured image is related to a meal event (step S20: YES), the server control unit 92 determines whether the captured image is the first captured image for the meal event (step S21). If the server control unit 92 determines that the captured image is the first captured image for the meal event (step S21: YES), the timer 96 starts measuring the meal group classification time T3 (step S22). Thereafter, the most recent captured image is set to the first meal group (step S23).

[0073] On the other hand, if the server control unit 92 determines that the image is not the first image taken during the meal event (i.e., the image is the second or subsequent image taken during the meal event) (step S21: NO), the time determination unit 98 determines whether the meal group classification time T3 has exceeded a predetermined time T4 (step S24). Here, the predetermined time T4 is set to, for example, 30 minutes. However, the predetermined time T4 can be set appropriately and may be one hour.

[0074] If the time determination unit 98 determines that the meal group classification time T3 has not exceeded the predetermined time T4 (step S24: NO), the most recent captured image is set to the first meal group (step S23). This allows multiple captured images captured within a relatively short period of time (predetermined time T4) to be associated with one meal event. Then, the process proceeds to step S27, which will be described later.

[0075] If the time determination unit 98 determines that the meal group classification time T3 has exceeded the predetermined time T4 (step S24: YES), the most recent captured image is set to the second meal group (step S25). As a result, captured images (meal images) acquired after a relatively long time (predetermined time T4) has passed since the first captured image (meal image) in a meal event was acquired are no longer related to that meal event. Then, the process proceeds to step S27, which will be described later.

[0076] If the server control unit 92 determines that the most recent captured image is not related to a meal event (it is related to a special event) (step S20: NO), the server information organizing unit 95 sets the most recent captured image to a special group (step S26). The special group can be set arbitrarily by the user 200, and a corresponding specific graphic may be set for each special group.

[0077] Thereafter, the graph creation unit 102 creates a blood glucose management graph 104 based on the captured image (meal image) and blood glucose information stored in the server storage unit 100 (step S27). Here, the blood glucose information includes the measured glucose concentration value of the sample taken into the glucose sensor and the measurement time. After being measured by the wearable device 12, the blood glucose information is transmitted from the first communication unit 52 to the server communication unit 88. However, the blood glucose information may also be transmitted from the second communication unit 62 to the server communication unit 88 via the information processing device 14.

[0078] The graph creation unit 102 creates, for example, a blood glucose management graph 104 as shown in FIG. 8. As shown in FIG. 8, this blood glucose management graph 104 displays meal images P1 to P3 superimposed on a glucose concentration line 106 that indicates the change in measurement value over time. In the blood glucose management graph 104, the horizontal axis indicates time, and the vertical axis indicates measurement value (glucose concentration). In the blood glucose management graph 104, meal image P1 is displayed at time t1, meal image P2 is displayed at time t2, and meal image P3 is displayed at time t3. In addition, an icon or the like related to the attributes of the special group can be displayed at the time when an image of the special group is acquired. This allows special events to be displayed chronologically on the blood glucose management graph 104.

[0079] Such an image management method includes a photographing step (step S3) of photographing a subject 202 with a camera 48 of a wearable device 12 worn by a user 200, an image transmission step (step S6) of transmitting the photographed image taken in the photographing step to an information processing server 16, a storage step (step S15) of storing the photographed image received from the wearable device 12 in a server memory unit 100 of the information processing server 16, and an information organization step (steps S19 to S26) of organizing the photographed images based on the determination result of an image determination unit (image determination server 20) as to whether the photographed image taken by the camera 48 is a food image.In the server information organization step, if the image determination unit determines that the photographed image is not a food image, the photographed image is deleted, and if the image determination unit determines that the photographed image is a food image, the photographed image is retained in the server memory unit 100.

[0080] The image management method is not limited to the above-described method. For example, if an image determination function is added to the wearable device 12 instead of the image determination server 20, after storing the image captured by the camera 48 in the storage unit 82 (after step S5), the control unit 66 determines whether the captured image stored in the storage unit 82 is a meal image or a specific image. If the captured image stored in the storage unit 82 is neither a meal image nor a specific image, the device information organizing unit 84 (information organizing unit) deletes the most recent captured image from the storage unit 82. If the captured image stored in the storage unit 82 is a meal image or a specific image, the control unit 66 performs the same processes as steps S20 to S26 described above and transmits the captured image to the information processing server 16.

[0081] In this case, the present embodiment provides the following effects.

[0082] The image management system 10 includes a wearable device 12 and an information processing server 16. The wearable device 12 has a camera 48 for capturing an image of a subject 202. The information processing server 16 has a server storage unit 100 that stores captured images received from the wearable device 12, and an information organizing unit (device information organizing unit 84 or server information organizing unit 95) that organizes the captured images based on the determination result of the image determination unit as to whether the captured image captured by the camera 48 is a food image. The information organizing unit deletes the captured image when the image determination unit determines that the captured image is not a food image, and the server storage unit 100 stores the captured image in the server storage unit 100 when the image determination unit determines that the captured image is a food image.

[0083] With this configuration, when user 200 wears wearable device 12, he or she can quickly take photos of meals using camera 48 of wearable device 12. This allows for efficient photographing of meals. Furthermore, because the photographed images are deleted if they are not food images, health management using food images can be performed effectively.

[0084] The image determination unit is an image determination server 20 provided separately from the wearable device 12 and the information processing server 16. The information processing server 16 has a determination communication unit 90 that transmits a captured image stored in the server storage unit 100 to the image determination server 20 and receives the determination result of the image determination server 20 as to whether the captured image is a meal image, and a server information organizing unit 95 that serves as an information organizing unit that organizes the captured images stored in the server storage unit 100. When the determination communication unit 90 receives a determination result that the captured image is not a meal image, the server information organizing unit 95 deletes the captured image from the server storage unit 100, and when the determination communication unit 90 receives a determination result that the captured image is a meal image, the server storage unit 100 retains the captured image.

[0085] With this configuration, since the determination communication unit 90 is located in the information processing server 16 rather than in the wearable device 12, consumption of the battery 54 of the wearable device 12 can be reduced compared to when the determination communication unit 90 is provided in the wearable device 12.

[0086] Wearable device 12 has a memory unit 82 that stores images captured by camera 48, and a device information organizing unit 84 that organizes the images stored in memory unit 82. After transmitting the images stored in memory unit 82 to information processing server 16, device information organizing unit 84 deletes the images from memory unit 82.

[0087] With this configuration, it is possible to reduce the storage capacity of the storage unit 82 required to store the captured images.

[0088] The wearable device 12 has a light emitting unit 50 that outputs guide light L into the imaging range of the camera 48.

[0089] According to this configuration, the user 200 can easily place the subject 202 (meal) within the photographing range of the camera 48 by irradiating the guide light L toward the subject 202 (meal) when photographing.

[0090] The wearable device 12 has two operation switches 58 that can be operated by the user 200, and a light-emission control unit 78 that controls the operation of the light-emitting unit 50. The light-emission control unit 78 outputs guide light L from the light-emitting unit 50 when the two operation switches 58 are operated simultaneously, and does not output guide light L from the light-emitting unit 50 when only one of the two operation switches 58 is operated.

[0091] According to this configuration, when either of the two operation switches 58 is operated by mistake, the guide light L can be prevented from being output from the light-emitting unit 50.

[0092] Wearable device 12 has a subject determination unit 79 that determines whether subject 202 that enters the shooting range of camera 48 corresponds to predetermined meal information, and a camera control unit 80 that controls the operation of camera 48. When subject determination unit 79 determines that subject 202 does not correspond to the predetermined meal information, camera control unit 80 prohibits camera 48 from shooting subject 202, and when subject determination unit 79 determines that subject 202 corresponds to the predetermined meal information, camera control unit 80 permits camera 48 to shoot subject 202.

[0093] This configuration effectively prevents camera 48 of wearable device 12 from capturing images that are not necessary for health management (for example, surreptitious photography).

[0094] The wearable device 12 has a notification control unit 86 that performs notification control to prompt the user 200 to input a meal date and time. The information processing server 16 has a date and time acquisition determination unit 93 that determines whether the meal date and time of the user 200 has been acquired, a time determination unit 98 that determines whether the elapsed time T1 since the previous meal date and time has exceeded a predetermined meal interval T2 when the date and time acquisition determination unit 93 determines that the meal date and time has not been acquired, and a notification request control unit 94 that requests notification control from the wearable device 12 when the time determination unit 98 determines that the elapsed time T1 since the previous meal date and time has exceeded the predetermined meal interval T2.

[0095] According to this configuration, the meal date and time of the user 200 can be acquired effectively.

[0096] Next, an operation flow of the wearable device 12 according to the first modification will be described. As shown in Fig. 9, in this case, the user 200 operates one of the operation switches 58 (step S31) with the camera 48 of the wearable device 12 pointed at the subject 202 (step S30). This causes the light emission control unit 78 to output guide light L from the light emitting unit 50 (step S32).

[0097] Subsequently, when the user 200 operates the other operation switch 58 (step S33), the camera control unit 80 photographs the subject 202 (step S34). Then, when the camera 48 has completed photographing the subject 202, the light-emission control unit 78 stops the output of the guide light L from the light-emitting unit 50 (step S35). That is, when photographing of the subject 202 has been completed, the output of the guide light L automatically stops without the need to particularly operate the operation switch 58. This allows the user 200 to easily know that photographing has been completed.

[0098] Thereafter, the processes of steps S36 to S38 are carried out. Note that the processes of steps S36 to S38 are the same as the processes of steps S5 to S7 in Fig. 5 described above, and therefore a description thereof will be omitted.

[0099] In the wearable device 12 used in such an operation flow, the above-described object determination unit 79 is omitted. The same applies to the wearable device 12 used in the operation flow according to the second modified example described later.

[0100] In the operation flow of the wearable device 12 according to the first variant, the light-emitting control unit 78 outputs guide light L from the light-emitting unit 50 when one of the two operating switches 58 is operated, and the camera control unit 80 causes the camera 48 to take a photograph when the other of the two operating switches 58 is operated.

[0101] With this configuration, the user 200 can take a picture with the camera 48 at his / her own timing.

[0102] Next, an operation flow of wearable device 12 according to the second modification will be described. As shown in Fig. 10, in this case, wearable device 12 acquires information on the wearing position of wearable device 12 of user 200 (step S40). Specifically, user 200 inputs information on whether wearable device 12 is worn on the left or right arm to information processing device 14. This information is then transmitted from information processing device 14 to wearable device 12, and wearable device 12 acquires information on the wearing position of wearable device 12 of user 200.

[0103] Next, user 200 operates one of operation switches 58 (step S41). At this time, control unit 66 determines whether wearable device 12 has rotated so that the orientation of camera 48 changes to face forward and downward from user 200 (step S42). Specifically, control unit 66 determines the rotation direction of wearable device 12 based on the wearing position information of wearable device 12 acquired in step S41 and the output signal of acceleration sensor 70.

[0104] If the control unit 66 determines that the wearable device 12 is not rotated so that the orientation of the camera 48 changes to face forward and downward from the user 200 (step S42: NO), the control unit 66 remains in step S42 until the wearable device 12 rotates so that the orientation of the camera 48 changes to face forward and downward from the user 200.

[0105] On the other hand, if the control unit 66 determines that the wearable device 12 has rotated so that the orientation of the camera 48 changes to face forward and downward of the user 200 (step S42: YES), the light-emitting control unit 78 outputs guide light L from the light-emitting unit 50 (step S43, see Figures 11A and 11B).

[0106] Subsequently, when user 200 operates the other operation switch 58 (step S44), camera control unit 80 photographs subject 202 (step S45). Specifically, camera control unit 80 permits camera 48 to photograph when camera 48 is facing diagonally downward, and prohibits camera 48 from photographing when camera 48 is not facing diagonally downward (for example, when camera 48 is facing diagonally upward).

[0107] If the subject 202 could not be photographed (step S45: NO), the light-emission control unit 78 controls the operation of the light-emitting unit 50 so that the guide light L flashes (step S46). This notifies the user 200 that photographing of the subject 202 has not been completed. However, in step S46, the light-emission control unit 78 is not limited to changing the output pattern of the guide light L, and may control the operation of the light-emitting unit 50 so that the color of the guide light L changes. In this case, the process returns to step S44.

[0108] Then, when the camera 48 completes photographing the subject 202 (step S45: YES), the light emission control unit 78 stops the output of the guide light L from the light emitting unit 50 (step S47). That is, when the photographing of the subject 202 is completed, the output of the guide light L automatically stops without any particular operation of the operation switch 58. This allows the user 200 to easily know that the photographing is completed.

[0109] Thereafter, the processes of steps S48 to S50 are carried out. Note that the processes of steps S48 to S50 are the same as the processes of steps S5 to S7 in Fig. 5 described above, and therefore a description thereof will be omitted.

[0110] In the operation flow of the wearable device 12 relating to the second variant, the camera control unit 80 allows the camera 48 to photograph the subject 202 when the camera 48 is facing diagonally downward, and prohibits the camera 48 from photographing the subject 202 when the camera 48 is not facing diagonally downward.

[0111] According to this configuration, the shooting range can be narrowed down depending on the positional relationship between wearable device 12 and user 200, and therefore, camera 48 can be prevented from being misused (used for taking surreptitious photos).

[0112] The image management system 10 may include a wearable device 12a shown in Fig. 12 instead of the above-described wearable device 12. In the description of the wearable device 12a, the same components as those of the above-described wearable device 12 are denoted by the same reference numerals, and the description thereof will be omitted.

[0113] 12, the device main body 24a of the wearable device 12a includes a determination communication unit 110. In this case, the above-described determination communication unit 90 of the information processing server 16 is omitted. The information processing server 16 cooperates with the training device 22 in the same manner as in FIG. 1.

[0114] The determination communication unit 110 establishes a wireless communication line to communicate information with the image determination server 20. The standard of the wireless communication line between the determination communication unit 110 and the image determination server 20 may be the same as the standard of the wireless communication line between the first communication unit 52 and the server communication unit 88.

[0115] The determination communication unit 110 transmits the captured image stored in the storage unit 82 to the image determination server 20, and receives the determination result of the image determination server 20 as to whether or not the captured image is a food image. When the determination communication unit 110 receives a determination result that the captured image is not a food image, the device information organizing unit 84 deletes the captured image from the storage unit 82, and when the determination communication unit 110 receives a determination result that the captured image is a food image, the device information organizing unit 84 transmits the captured image to the information processing server 16 and then deletes it from the storage unit 82.

[0116] Next, the operational flow of wearable device 12a will be described. As shown in Fig. 13, the processes from step S60 to step S64 are the same as the processes from step S1 to step S5 in Fig. 5 described above, and therefore the description thereof will be omitted.

[0117] After step S64, the determination communication unit 110 transmits the captured image stored in the storage unit 82 to the image determination server 20 (step S65). The image determination server 20 then determines whether the captured image is a food image or a specific image, and transmits the determination result to the determination communication unit 110. The determination communication unit 110 then receives the determination result as to whether the captured image is a food image (step S66).

[0118] Next, if the determination communication unit 110 receives a determination result that the captured image is not a meal image (step S67: NO), it determines whether the captured image includes a specific image (step S68). If the captured image includes a specific image (step S68: YES), the device information organizing unit 84 transmits information corresponding to the type of specific graphic included in the captured image to the information processing server 16 (step S69). Thereafter, the device information organizing unit 84 deletes the specific image from the storage unit 82 (step S70). If the captured image does not include a specific image (step S68: NO), the captured image is deleted from the storage unit 82 (step S70). This reduces the storage capacity of the storage unit 82 required to store the captured image and enables efficient collection of information corresponding to the acquired specific image. Furthermore, even if the wearable device 12a captures an image other than a meal image or a required specific image (for example, a secretly taken image), the captured image can be deleted from the storage unit 82. Then, the current operation flow ends.

[0119] If the determination communication unit 110 receives a determination result that the captured image is a meal image (step S67: YES), the device information organizing unit 84 transmits the captured image stored in the storage unit 82 to the information processing server 16 (step S71). Thereafter, the device information organizing unit 84 deletes the captured image from the storage unit 82 (step S70). Then, the current operation flow ends. Note that the information processing server 16 performs processing in accordance with the flowcharts of FIGS. 6 and 7 described above (however, in this case, steps S16 to S19 are not performed).

[0120] Such an image management method includes a photographing step (step S62) of photographing a subject 202 with the camera 48 of the wearable device 12a worn by the user 200, a storage step (step S64) of storing the photographed image in the photographing step in the storage unit 82 of the wearable device 12a, an image determination step (steps S65 and S66) of transmitting the photographed image stored in the storage unit 82 to the image determination server 20 and receiving the determination result of the image determination server 20 as to whether the photographed image is a food image, and an information organization step (steps S70 and S71) of organizing the photographed images stored in the storage unit 82. In the information organization step, if the wearable device 12a receives a determination result that the photographed image is not a food image, the photographed image is deleted from the storage unit 82, and if the wearable device 12a receives a determination result that the photographed image is a food image, the photographed image is transmitted to the information processing server 16 and then deleted.

[0121] The wearable device 12a includes a camera 48 for capturing an image of a subject 202, a storage unit 82 for storing the captured image captured by the camera 48, a determination communication unit 110 for transmitting the captured image stored in the storage unit 82 to the image determination server 20 and receiving the determination result of the image determination server 20 as to whether the captured image is a food image, and a device information organizing unit 84 for organizing the captured images stored in the storage unit 82. When the determination communication unit 110 receives a determination result that the captured image is not a food image, the device information organizing unit 84 deletes the captured image from the storage unit 82, and when the determination communication unit 110 receives a determination result that the captured image is a food image, the device information organizing unit 84 deletes the captured image after transmitting it to the information processing server 16. The information transmitted to the information processing server 16 is provided to the instruction device 22.

[0122] According to this configuration, if the captured image is not a food image, the captured image is deleted from the storage unit 82, so health management using food images can be performed effectively. Wearable device 12a has the same effects as wearable device 12 described above.

[0123] The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the gist of the present invention.

[0124] The information processing server 16 may request at least one of the wearable devices 12, 12a and the information processing device 14 to perform blood glucose measurement notification control to prompt the user 200 to measure blood glucose after a certain time has elapsed since the user 200 photographed a meal.

[0125] The above embodiments can be summarized as follows.

[0126] The above embodiment discloses a medical image management system (10) comprising a wearable device (12, 12a) worn by a user (200) and an information processing server (16) capable of communicating with the wearable device, wherein the wearable device has a camera (48) for photographing a subject (202), the information processing server has a server memory unit (100) for storing photographed images received from the wearable device, and either the wearable device or the information processing server has an information organizing unit (84, 95) for organizing the photographed images based on the determination result of the image determination unit as to whether the photographed image taken by the camera is a food image, wherein the information organizing unit deletes the photographed image if the image determination unit determines that the photographed image is not the food image, and the server memory unit retains the photographed image if the image determination unit determines that the photographed image is the food image.

[0127] In the above image management system, the image judgment unit is an image judgment server (20) provided separately from the wearable device and the information processing server, and the information processing server has a judgment communication unit (90) that transmits the captured image stored in the server memory unit to the image judgment server and receives the judgment result of the image judgment server as to whether the captured image is a meal image, and a server information organization unit (95) that serves as the information organization unit that organizes the captured images stored in the server memory unit, and the server information organization unit may delete the captured image from the server memory unit when the judgment communication unit receives a judgment result that the captured image is not the meal image, and the server memory unit may retain the captured image when the judgment communication unit receives a judgment result that the captured image is the meal image.

[0128] In the above-mentioned image management system, the wearable device has a memory unit (82) that stores the captured images taken by the camera, and a device information organizing unit (84) that organizes the captured images stored in the memory unit, and the device information organizing unit may delete the captured images from the memory unit after transmitting the captured images stored in the memory unit to the information processing server.

[0129] In the image management system described above, the wearable device may have a light emitting unit (50) that outputs guide light (L) within the shooting range of the camera.

[0130] In the above-mentioned image management system, the wearable device has two operation units (58) that can be operated by the user, and a light-emitting control unit (78) that controls the operation of the light-emitting unit, and the light-emitting control unit may be configured to output the guide light from the light-emitting unit when the two operation units are operated simultaneously, and not output the guide light from the light-emitting unit when only one of the two operation units is operated.

[0131] In the above image management system, the wearable device has a subject determination unit (79) that determines whether the subject (202) that enters the camera's shooting range corresponds to specified meal information, and a camera control unit (80) that controls the operation of the camera, and the camera control unit may prohibit the camera from photographing the subject when the subject determination unit determines that the subject does not correspond to the specified meal information, and may allow the camera to photograph the subject when the subject determination unit determines that the subject corresponds to the specified meal information.

[0132] In the above-mentioned image management system, the wearable device may have two operation units that can be operated by the user, a light-emitting control unit that controls the operation of the light-emitting unit, and a camera control unit that controls the operation of the camera, and the light-emitting control unit may output the guide light from the light-emitting unit when one of the two operation units is operated, and the camera control unit may cause the camera to take an image when the other of the two operation units is operated.

[0133] In the above-mentioned image management system, the wearable device may have a camera control unit that controls the operation of the camera, and the camera control unit may allow the camera to photograph the subject when the camera is facing diagonally downward, and may prohibit the camera from photographing the subject when the camera is not facing diagonally downward.

[0134] In the above image management system, the wearable device may have an alarm control unit (86) that performs alarm control to prompt the user to input a meal date and time, and the information processing server may have a date and time acquisition determination unit (93) that determines whether the user's meal date and time have been acquired, a time determination unit (98) that determines whether the time (T1) elapsed since the previous meal date and time has exceeded a predetermined meal interval (T2) when the date and time acquisition determination unit determines that the meal date and time has not been acquired, and an alarm request control unit (94) that requests the wearable device to perform the alarm control when the time determination unit determines that the time elapsed since the previous meal date and time has exceeded the predetermined meal interval.

[0135] The above embodiment discloses a medical wearable device (12a) that can be worn by a user, the wearable device having a camera for photographing a subject, a memory unit for storing the photographed image taken by the camera, a judgment communication unit (110) for transmitting the photographed image stored in the memory unit to an image judgment server and receiving the judgment result of the image judgment server as to whether the photographed image is a food image, and a device information organizing unit for organizing the photographed images stored in the memory unit, wherein the device information organizing unit deletes the photographed image from the memory unit when the judgment communication unit receives a judgment result that the photographed image is not a food image, and deletes the photographed image from the memory unit after transmitting it to an information processing server when the judgment communication unit receives a judgment result that the photographed image is a food image.

[0136] The above-described wearable device may further include a light emitting unit for emitting guide light to the subject.

[0137] The above-mentioned wearable device may have two operating units that can be operated by the user and a light-emitting control unit that controls the operation of the light-emitting unit, and the light-emitting control unit may be configured to output the guide light from the light-emitting unit when the two operating units are operated simultaneously, and not output the guide light from the light-emitting unit when only one of the two operating units is operated.

[0138] The above-mentioned wearable device may have a subject determination unit that determines whether the subject that enters the camera's shooting range matches or is similar to a specified meal image, and a camera control unit that controls the operation of the camera, and the camera control unit may prohibit the camera from taking pictures if the subject determination unit determines that the subject does not match the specified meal information, and may allow the camera to take pictures if the subject determination unit determines that the subject matches the specified meal information.

[0139] The above-mentioned wearable device may have two operating units that can be operated by the user, a light-emitting control unit that controls the operation of the light-emitting unit, and a camera control unit that controls the operation of the camera, and the light-emitting control unit may output the guide light from the light-emitting unit when one of the two operating units is operated, and the camera control unit may cause the camera to take a picture when the other of the two operating units is operated.

[0140] The above-mentioned wearable device may have a mounting unit (26, 28) for being worn on the user's wrist and a camera control unit for controlling the operation of the camera, and the camera control unit may cause the camera to take pictures by rotating the wearable device so that the camera's shooting range faces downward.

[0141] The above embodiment discloses a medical image management method that includes a photographing step of photographing a subject with a camera of a wearable device worn by a user, an image transmission step of transmitting the photographed image in the photographing step to an information processing server, a storage step of storing the photographed image received from the wearable device in a server memory unit of the information processing server, and a server information organization step of organizing the photographed image based on the determination result of an image determination unit as to whether the photographed image taken by the camera is a food image, wherein in the server information organization step, if the image determination unit determines that the photographed image is not a food image, the photographed image is deleted, and if the image determination unit determines that the photographed image is a food image, the photographed image is retained in the server memory unit.

[0142] The above embodiment discloses a medical image management method that includes a photographing step of photographing a subject with a camera of a wearable device worn by a user, a storage step of storing the photographed image in the photographing step in a storage unit of the wearable device, an image determination step of sending the photographed image stored in the storage unit to an image determination server and receiving the determination result of the image determination server as to whether the photographed image is a food image, and an information organization step of organizing the photographed images stored in the storage unit, wherein in the information organization step, if the wearable device receives a determination result that the photographed image is not a food image, the photographed image is deleted from the storage unit, and if the wearable device receives a determination result that the photographed image is a food image, the photographed image is sent to an information processing server and then deleted.

[0143] The above embodiment discloses a medical image management program that causes a computer to execute the following steps: a photographing step of photographing a subject with a camera of a wearable device worn by a user; an image transmission step of transmitting the photographed image taken in the photographing step to an information processing server; a storage step of storing the photographed image received from the wearable device in a server memory unit of the information processing server; and a server information organization step of organizing the photographed image based on the determination result of an image determination unit as to whether the photographed image taken by the camera is a food image; and in the server information organization step, if the image determination unit determines that the photographed image is not a food image, the photographed image is deleted, and if the image determination unit determines that the photographed image is a food image, the photographed image is retained in the server memory unit.

[0144] The above embodiment discloses a medical image management program that causes a computer to execute the following steps: a photographing step of photographing a subject with a camera of a wearable device worn by a user; a storage step of storing the photographed image in a storage unit of the wearable device; an image determination step of sending the photographed image stored in the storage unit to an image determination server and receiving the determination result of the image determination server as to whether the photographed image is a food image; and an information organization step of organizing the photographed images stored in the storage unit.In the information organization step, if the wearable device receives a determination result that the photographed image is not a food image, the photographed image is deleted from the storage unit; and if the wearable device receives a determination result that the photographed image is a food image, the photographed image is sent to an information processing server and then deleted.

Claims

1. A medical image management system including a wearable device that can be worn by a user and an information processing server that can communicate with the wearable device, The wearable device comprises: A camera for photographing a subject; a notification control unit that performs notification control to prompt the user to input a meal date and time; having The information processing server includes: A server storage unit that stores the captured images received from the wearable device; a date and time acquisition determination unit that determines whether or not a meal date and time of the user has been acquired; a time determination unit that determines whether or not a time elapsed since a previous meal date and time exceeds a predetermined meal interval when the date and time acquisition determination unit determines that the meal date and time has not been acquired; a notification request control unit that requests the wearable device to perform the notification control when the time determination unit determines that the elapsed time from the date and time of a previous meal has exceeded the predetermined meal interval; having Either the wearable device or the information processing server has an information organizing unit that organizes the captured image based on a determination result by an image determination unit as to whether the captured image captured by the camera is a food image, the information organizing unit deletes the photographed image when the image determining unit determines that the photographed image is not the meal image; The server storage unit stores the captured image when the image determination unit determines that the captured image is the meal image.

2. 2. The image management system according to claim 1, the image determination unit is an image determination server provided separately from the wearable device and the information processing server, The information processing server includes: a determination communication unit that transmits the captured image stored in the server storage unit to the image determination server and receives a determination result of the image determination server as to whether the captured image is a food image; a server information organizing unit serving as the information organizing unit that organizes the captured images stored in the server storage unit, the server information sorting unit deletes the photographed image from the server storage unit when the determination communication unit receives a determination result that the photographed image is not the meal image; The server storage unit stores the captured image when the determination communication unit receives a determination result that the captured image is the meal image.

3. 3. The image management system according to claim 2, The wearable device comprises: a storage unit that stores the captured image captured by the camera; a device information organizing unit that organizes the captured images stored in the storage unit, The device information organizing unit transmits the captured image stored in the storage unit to the information processing server, and then deletes the captured image from the storage unit.

4. 4. The image management system according to claim 2, The wearable device is an image management system having a light-emitting unit that outputs guide light within the shooting range of the camera.

5. 5. The image management system according to claim 4, The wearable device comprises: Two operation units operable by the user; A light emission control unit that controls an operation of the light emission unit, the light-emitting control unit outputs the guide light from the light-emitting unit when the two operation units are operated simultaneously, and does not output the guide light from the light-emitting unit when only one of the two operation units is operated.

6. The image management system according to any one of claims 1 to 5, The wearable device comprises: a subject determination unit that determines whether or not the subject that has entered a shooting range of the camera corresponds to predetermined meal information; A camera control unit that controls an operation of the camera, The camera control unit prohibits the camera from photographing the subject when the subject determination unit determines that the subject does not correspond to the specified meal information, and allows the camera to photograph the subject when the subject determination unit determines that the subject corresponds to the specified meal information.

7. A medical image management method, comprising: a date and time acquisition determination step in which a date and time acquisition determination unit determines whether or not a meal date and time of the user has been acquired; a time determination step in which, when it is determined in the date and time acquisition determination step that the meal date and time has not been acquired, a time determination unit determines whether or not a time elapsed since the previous meal date and time has exceeded a predetermined meal interval; a notification request control step of, when it is determined in the time determination step that the elapsed time from the previous meal date and time has exceeded the predetermined meal interval, requesting, from the wearable device, notification control for prompting the user to input a meal date and time by a notification request control unit; A photographing step of photographing a subject with a camera of the wearable device worn by the user; an image transmission step of transmitting the image captured in the imaging step to an information processing server; a storage step of storing the captured image received from the wearable device in a server storage unit of the information processing server; and a server information organizing step of organizing the captured images based on a determination result by an image determination unit as to whether the captured images captured by the camera are food images, In the server information sorting step, a captured image is deleted if the image determination unit determines that the captured image is not a meal image, and the captured image is stored in the server memory unit if the image determination unit determines that the captured image is a meal image, in an image management method performed by a computer.

8. A medical image management method, comprising: a date and time acquisition determination step in which a date and time acquisition determination unit determines whether or not a meal date and time of the user has been acquired; a time determination step in which, when it is determined in the date and time acquisition determination step that the meal date and time has not been acquired, a time determination unit determines whether or not a time elapsed since the previous meal date and time has exceeded a predetermined meal interval; a notification request control step of, when it is determined in the time determination step that the elapsed time from the previous meal date and time has exceeded the predetermined meal interval, requesting, from the wearable device, notification control for prompting the user to input a meal date and time by a notification request control unit; A photographing step of photographing a subject with a camera of the wearable device worn by the user; A storage step of storing the captured image in a storage unit of the wearable device; an image determination step of transmitting the captured image stored in the storage unit to an image determination server and receiving a determination result of the image determination server as to whether the captured image is a food image; and an information sorting step of sorting the captured images stored in the storage unit, In the information sorting step, when the wearable device receives a determination result that the captured image is not the meal image, the captured image is deleted from the memory unit, and when the wearable device receives a determination result that the captured image is the meal image, the captured image is sent to an information processing server and then deleted.This is an image management method performed by a computer.

9. A medical image management program, comprising: a date and time acquisition determination step in which a date and time acquisition determination unit determines whether or not a meal date and time of the user has been acquired; a time determination step in which, when it is determined in the date and time acquisition determination step that the meal date and time has not been acquired, a time determination unit determines whether or not a time elapsed since the previous meal date and time has exceeded a predetermined meal interval; a notification request control step of, when it is determined in the time determination step that the elapsed time from the previous meal date and time has exceeded the predetermined meal interval, requesting, from the wearable device, notification control for prompting the user to input a meal date and time by a notification request control unit; A photographing step of photographing a subject with a camera of the wearable device worn by the user; an image transmission step of transmitting the image captured in the imaging step to an information processing server; a storage step of storing the captured image received from the wearable device in a server storage unit of the information processing server; a server information sorting step of sorting the captured images based on a determination result by an image determination unit as to whether the captured images captured by the camera are food images; In the server information sorting step, an image management program deletes the captured image if the image determination unit determines that the captured image is not the meal image, and stores the captured image in the server memory unit if the image determination unit determines that the captured image is the meal image.

10. A medical image management program, comprising: a date and time acquisition determination step in which a date and time acquisition determination unit determines whether or not a meal date and time of the user has been acquired; a time determination step in which, when it is determined in the date and time acquisition determination step that the meal date and time has not been acquired, a time determination unit determines whether or not a time elapsed since the previous meal date and time has exceeded a predetermined meal interval; a notification request control step of, when it is determined in the time determination step that the elapsed time from the previous meal date and time has exceeded the predetermined meal interval, requesting, from the wearable device, notification control for prompting the user to input a meal date and time by a notification request control unit; A photographing step of photographing a subject with a camera of the wearable device worn by the user; A storage step of storing the captured image in a storage unit of the wearable device; an image determination step of transmitting the captured image stored in the storage unit to an image determination server and receiving a determination result of the image determination server as to whether the captured image is a food image; an information sorting step of sorting the captured images stored in the storage unit; In the information sorting step, an image management program deletes the captured image from the memory unit when the wearable device receives a determination result that the captured image is not the meal image, and deletes the captured image after sending it to an information processing server when the wearable device receives a determination result that the captured image is the meal image.

Images