Display device and display method

Abstract

To provide a display device and a display method with which it is possible to improve the ingestion of necessary food for health maintenance by considering the preferences of each individual.SOLUTION: In a display device 1 according to the present disclosure, an imaging control unit 11 controls an imaging unit so as to perform imaging and acquires a captured image. A detection processing unit 12 detects a food object from the captured image. An association processing unit 13 associates information regarding the preliminarily stored preferences of a user to the food object. A display control unit 14 controls a display unit on the basis of the associated preference information of the user so that display is carried out by differentiating the manner of how the food object looks to the user.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to a display device and a display method. [Background technology]

[0002] Patent Document 1 discloses a technique for appropriately controlling calorie intake from meals, which also presents menus based on the amount of calorie intake. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-135551 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the background art of Patent Document 1 has a problem in that even with an optimized menu, the intake of ingredients necessary for maintaining health is influenced by individual preferences.

[0005] An object of the present disclosure is to provide a display device and a display method that can improve the intake of food ingredients necessary for maintaining health by taking into account the preferences of each individual. [Means for solving the problem]

[0006] The display device of the present disclosure includes: an imaging control unit that controls the imaging unit to take an image and acquires the captured image; A detection processing unit that detects a food object from the captured image; an association processing unit that associates pre-stored user preference information with the meal objects; The display control unit controls the display unit to display the food object in a way that makes the food object appear different for the user based on the associated user preference information.

[0007] The display method of the present disclosure includes: The display device, Controlling the photographing unit to take a photograph and acquiring the photographed image; Detecting a food object from the captured image; Associating the meal object with pre-stored user preference information; The display unit is controlled so as to display the food object in a manner that makes the food object appear different for the user based on the associated preference information of the user. Effect of the Invention

[0008] The present disclosure can provide a display device and a display method that can improve the intake of food ingredients necessary for maintaining health by taking into account the preferences of each individual. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing an example of a configuration of a display device according to a first embodiment. [Diagram 2] 5 is a flowchart showing an example of the operation of the display device according to the first embodiment. [Diagram 3] 6 is a flowchart showing an example of a display change process of the display device according to the first embodiment. [Figure 4] 6 is a flowchart showing an example of a display change process of the display device according to the first embodiment. [Diagram 5] 3 is a diagram showing an example of an eating object detected from a captured image by the display device according to the first embodiment. FIG. [Figure 6] FIG. 11 is a block diagram showing an example of a configuration of a display device according to a second embodiment. [Figure 7] 13 is a flowchart showing an example of a display change process of the display device according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] (First embodiment) First, the configuration of a display device 1 according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing an example of the configuration of the display device 1 according to the first embodiment.

[0011] As shown in Fig. 1, the display device 1 is, for example, an AR (Augmented Reality) type head mounted display (HMD) worn on the head of a user. The display device 1 includes a control unit 10, an imaging unit 20, a display unit 30, a sensor 40, and a communication unit 50. The display device 1 may be a video see-through type HMD or an optical see-through type HMD. In the following description, an optical see-through type HMD is used as an example, and if there are differences in the configuration or processing due to the video see-through type HMD, appropriate explanations will be added.

[0012] The control unit 10 controls the photographing unit 20, the display unit 30, the sensor 40, and the communication unit 50. The control unit 10 is configured by a computer including a processor that controls the display device 1 and a memory, and executes one or more programs including a group of instructions for making the computer execute the algorithm described below. The processor that constitutes the control unit 10 may be, for example, a microprocessor, an MPU (Micro Processing Unit), or a CPU (Central Processing Unit). The processor that constitutes the control unit 10 may include multiple processors. The memory that constitutes the control unit 10 is configured by a combination of a volatile memory and a non-volatile memory. The memory that constitutes the control unit 10 may include a storage located away from the processor. In this case, the processor may access the memory via an I / O interface not shown.

[0013] The image capturing unit 20 is, for example, a camera, and captures images. The captured images include still images and moving images. The image capturing unit 20 is disposed so as to capture an image in front of the user, particularly in the direction in which the user is looking, when the user wears the HMD.

[0014] When the display device 1 is an optical see-through type HMD, the display unit 30 is, for example, a transmissive display panel, and displays information superimposed on the real scenery so that the user can view the real scenery through the transmissive display panel. When the display device 1 is a video see-through type HMD, the display unit 30 is a non-transmissive display panel. The display unit 30 is disposed so that the display contents are displayed within the user's field of vision when the user wears the HMD.

[0015] The sensor 40 is, for example, a gyro sensor, and detects the direction and inclination of the display device 1. The communication unit 50 is, for example, a communication interface, and communicates with other devices, external servers, and the like.

[0016] The control unit 10 includes an imaging control unit 11, a detection processing unit 12, a correspondence processing unit 13, a display control unit 14, a sensor information acquisition unit 15, and a communication control unit 16 as functions realized by hardware or software, or both. The photographing control unit 11 controls the photographing unit 20 to perform photographing. The photographing control unit 11 acquires the photographed image photographed by the photographing unit 20.

[0017] The detection processing unit 12 detects food objects from the captured image based on the detection model. Here, the detection processing unit 12 may detect a plurality of food objects. The food objects are food ingredients (e.g., fish and meat) and menu names (e.g., soup, bread and pasta). It is preferable that the food objects are detectable from the captured image and are units that can reflect the user's preference information. The detection model is, for example, a model learned by machine learning, deep learning, or the like. The detection model may be information that is pre-stored in the display device 1, or information that is pre-stored in an external device and acquired from the external device via the communication unit 50.

[0018] The association processing unit 13 associates the user's preference information with the detected food objects. The user's preference information includes information indicating food objects with high preferences of the user and information indicating food objects with low preferences of the user. The user's preference information may be information pre-stored in the display device 1, or may be information pre-stored in an external device and acquired from the external device via the communication unit 50. The user's preference information is generated or updated based on accumulated information, for example, on whether food objects detected from images taken from the start to the end of a meal were left at the end of the meal or were consumed immediately after the start of the meal or immediately after they were provided, for each user.

[0019] The display control unit 14 controls the display unit 30 to display food objects that appear differently to the user based on the associated user preference information. Specifically, the display control unit 14 controls the display unit 30 to display food objects that are less preferred by the user in a way that stimulates appetite (hereinafter, appetite-increasing display). The display control unit 14 also controls the display unit 30 to display food objects that are more preferred by the user in a way that reduces appetite (hereinafter, appetite-reducing display). Here, the display control unit 14 controls the display unit 30 to perform at least one of an appetite-increasing display and an appetite-reducing display. Furthermore, the display control unit 14 controls the display unit 30 to perform a display in which the appearance of the food object is changed for a predetermined period of time after the food object is detected. The display control unit 14 may also control the display unit 30 to perform a display in which the appearance of the food object is changed for a predetermined period of time after the start of the display in which the appearance of the food object is changed.

[0020] When the display device 1 is an optical see-through HMD, the display control unit 14 performs an appetite-reducing display by displaying a color such as blue in a display range on the display unit 30 corresponding to the food object being viewed by the user. In this case, the user views the food object through a blue display, so the food object appears to have a bluish hue compared to its actual state. Similarly, an appetite-enhancing display is performed by displaying a color such as red. In this case, the user views the food object through a red display, so the food object appears to have a reddish hue compared to its actual state.

[0021] In the case of a video see-through type HMD, the display control unit 14 performs an appetite-reducing display by performing, for example, a process of reducing the red component or increasing the blue component on the display range of the food object on the display unit 30. The appetite-reducing display may be a process of reducing the overall brightness, a process of reducing the overall saturation, a process of reducing the contrast, or the like, on the display range of the food object on the display unit 30, or may be performed in combination with a change in color tone. Similarly, the display control unit 14 performs an appetite-enhancing display by performing, for example, a process of increasing the red component or a process of reducing the blue component on the display range of the food object on the display unit 30. The appetite-enhancing display may be a process of increasing the overall brightness, a process of increasing the overall saturation, a process of improving the contrast, or the like, on the display range of the food object on the display unit 30, or may be performed in combination with a change in color tone.

[0022] The sensor information acquisition unit 15 acquires information on the orientation and inclination of the display device 1 detected by the sensor 40 from the sensor 40. The communication control unit 16 controls the communication unit 50 to communicate with other devices, external servers, and the like.

[0023] Next, the operation of the display device 1 according to the first embodiment will be described with reference to Fig. 2 to Fig. 4. Fig. 2 is a flowchart showing an example of the operation of the display device 1 according to the first embodiment. Figs. 3 and 4 are flowcharts showing an example of a display change process (described later) of the display device 1 according to the first embodiment.

[0024] Each process of the display device 1 described below is started by the user or a third party at the start of a meal. Each process of the display device 1 may be automatically started at the meal time if the meal time is fixed. Each process of the display device 1 is ended in the same way as it was started.

[0025] Moreover, it is desirable that each of the following processes of the display device 1 is executed from start to finish in a state where the display device 1 is worn by the user and the shooting direction of the image capturing unit 20 faces downward from the horizontal. Here, the state where the shooting direction of the image capturing unit 20 faces downward from the horizontal is determined by the control unit 10 of the display device 1 from information detected by the sensor 40.

[0026] As shown in Fig. 2, first, in step S11, the shooting control unit 11 of the display device 1 controls the shooting unit 20 to start shooting by the shooting unit 20. Then, the shooting control unit 11 acquires the captured image captured by the shooting unit 20. In the process of step S11, if the display device 1 is an optical see-through type HMD, shooting by the shooting unit 20 is started as shown in Fig. 2, but if the display device 1 is a video see-through type HMD, shooting by the shooting unit 20 and display of the captured image by the display unit 30 are started.

[0027] Next, in step S12, the detection processing unit 12 detects food objects from the captured image based on the detection model. When the captured image contains multiple food objects, the detection processing unit 12 may detect multiple food objects. If a food object is detected (YES in step S12), the process proceeds to step S13. On the other hand, if a food object is not detected (NO in step S12), the process proceeds to step S14. Here, if a food object is not detected (NO in step S12), this includes not only a case where a food object is not present in the captured image, but also a case where no food detectable as a food object is present in the captured image.

[0028] Next, in step S13, the display device 1 executes a display change process for the detected food objects. Here, if multiple food objects are detected, the display device 1 executes a display change process for the multiple detected food objects. Specifically, the display device 1 executes a display change process of steps S121 to S126 shown in FIG. 3 or a display change process of steps S131 to S136 shown in FIG. 4.

[0029] First, as shown in FIG. 3, in step S121, the association processing unit 13 judges whether or not there is user preference information corresponding to the detected food object. Specifically, the association processing unit 13 judges whether or not there is user preference information corresponding to the detected food object in the pre-stored user preference information. Food objects that are judged to have no user preference information include food objects that do not have corresponding preference information, as well as food objects that do not belong to either food objects with low or high corresponding preference information. If it is judged that there is user preference information for the detected food object (YES in step S121), the process proceeds to step S122. On the other hand, if it is judged that there is no user preference information for the detected food object (NO in step S121), the process ends.

[0030] Next, in step S122, the association processing unit 13 judges whether or not there is a meal object with low user preference among the meal objects judged to have corresponding user preference information. If it is judged that there is a meal object with low user preference (YES in step S122), the process proceeds to step S123. On the other hand, if it is judged that there is no meal object with low user preference (NO in step S122), the process ends.

[0031] Next, in step S123, the display control unit 14 controls the display unit 30 to start an appetite-enhancing display for food objects with low user preference that enhances the appetite. For example, as described above, the display control unit 14 performs an appetite-enhancing display such as a high-brightness display, a display that emphasizes a specific color tone (e.g., red), or a high-contrast display for the target food object.

[0032] Next, in step S124, the display control unit 14 determines whether or not the food object with low preference of the user has become undetected from the captured image. If it is determined that the food object with low preference of the user has not become undetected from the captured image (NO in step S124), the process proceeds to step S125. On the other hand, if it is determined that the food object with low preference of the user has become undetected from the captured image (YES in step S124), the process proceeds to step S126. For example, if the food object with low preference of the user has been consumed by the user, it is determined that the food object has become undetected from the captured image by the user (YES in step S124).

[0033] Next, in step S125, the display control unit 14 determines whether or not a predetermined time has elapsed since the detection processing unit 12 detected the food object. In step S125, the display control unit 14 may determine whether or not a predetermined time has elapsed since the appetite-stimulating display was started. The predetermined time is, for example, 5 to 10 minutes. If it is determined that the predetermined time has elapsed (YES in step S125), the process proceeds to step S126. On the other hand, if it is determined that the predetermined time has not elapsed (NO in step S125), the process returns to step S124. Next, in step S126, the display control unit 14 controls the display unit 30 to end the appetite promotion display.

[0034] 4, in step S131, the association processing unit 13 determines whether or not there is user preference information corresponding to the detected food object. If it is determined that there is user preference information for the detected food object (YES in step S131), the process proceeds to step S132. On the other hand, if it is determined that there is no user preference information for the detected food object (NO in step S131), the process ends.

[0035] Next, in step S132, the association processing unit 13 judges whether or not there is a meal object with high user preference among the meal objects judged to have corresponding user preference information. If it is judged that there is a meal object with high user preference (YES in step S132), the process proceeds to step S133. On the other hand, if it is judged that there is no meal object with high user preference (NO in step S132), the process ends.

[0036] Next, in step S133, the display control unit 14 controls the display unit 30 to start an appetite-reducing display for food objects that are highly preferred by the user, which reduces the appetite. For example, as an example of the appetite-reducing display, the display control unit 14 performs a display with low brightness, a display with a reduced predetermined color tone (e.g., red), a display with an emphasized predetermined color tone (e.g., blue), a display with low contrast, etc., for the food objects, as described above.

[0037] Next, in step S134, the display control unit 14 determines whether or not the food object with low user preference has become undetected from the captured image. If it is determined that the food object with low user preference has not become undetected from the captured image (NO in step S134), the process proceeds to step S135. On the other hand, if it is determined that the food object with low user preference has become undetected from the captured image (YES in step S134), the process proceeds to step S136.

[0038] Next, in step S135, the display control unit 14 determines whether or not a predetermined time has elapsed since the detection processing unit 12 detected the food object. In step S135, the display control unit 14 may determine whether or not a predetermined time has elapsed since the appetite reduction display was started. If it is determined that the predetermined time has elapsed (YES in step S135), the process proceeds to step S136. On the other hand, if it is determined that the predetermined time has not elapsed (NO in step S135), the process returns to step S134. Next, in step S136, the display control unit 14 controls the display unit 30 to end the appetite reduction display.

[0039] Returning to the explanation of FIG. 2, next, in step S14, the display device 1 judges whether or not to end the series of processes. If it is judged that the processes are to be ended (YES in step S14), the process proceeds to step S15. On the other hand, if it is judged that the processes are not to be ended (NO in step S14), the process returns to step S12. For example, if a new food object that is added during a meal is detected by the detection processing unit 12, it is judged that the processes are not to be ended (NO in step S14).

[0040] Next, in step S15, the photography control unit 11 controls the photography unit 20 to end photography by the photography unit 20. In the process of step S15, when the display device 1 is an optical see-through type HMD, as shown in Fig. 2, photography by the photography unit 20 is ended, but when the display device 1 is a video see-through type HMD, photography by the photography unit 20 and display by the display unit 30 are ended.

[0041] Next, the display change processing of the display device 1 according to the first embodiment will be specifically described with reference to Fig. 2 to Fig. 5. The display change processing of the display device 1 is shown in the above-mentioned processing from step S121 to step S126 or the processing from step S131 to step S136.

[0042] 5 is a diagram showing an example of eating objects detected from a captured image by the display device 1 according to the first embodiment. As shown in Fig. 2 and Fig. 5, in step S12, the detection processing unit 12 of the display device 1 detects eating objects Me01, Me02, Me03, Me04, and Me05 from the captured image. In addition, the eating objects Me01 to Me05 are associated with user preference information as follows, respectively. ·Me01:grilled fish:Low palatability ·Me02:tofu:High palatability Me03:salad:No preference information Me04:rice:No preference information ·Me05:miso soup:High palatability

[0043] The display device 1 performs the display change process from step S121 to step S126 as follows. If the answer is YES in step S121, the association processing unit 13 determines that there is corresponding user preference information for the meal objects Me01, Me02, and Me05. If the answer is YES in step S122, the association processing unit 13 determines that the meal object Me01 having low user preference is present among the meal objects Me01, Me02, and Me05 determined to have corresponding user preference information.

[0044] In step S123, the display control unit 14 controls the display unit 30 to start an appetite-increasing display for the food object Me01 having low preference of the user, which increases the appetite. The range of the appetite-increasing display is the detection range of the food object Me01 (within the frame in FIG. 5). The range of the appetite-increasing display may be a range including the detection range, that is, a range including the detection range of the food object Me01 and not including the detection ranges of other detected food objects. If the answer is YES in step S124, the display control unit 14 determines that the food object Me01 having low preference of the user has been undetected from the captured image. In step S126, the display control unit 14 controls the display unit 30 to end the appetite reduction display of the food object Me01.

[0045] Moreover, the display device 1 performs the processes from step S131 to step S136 as follows. If the answer is YES in step S131, the association processing unit 13 determines that there is user preference information corresponding to the meal objects Me01, Me02, and Me05. If the answer is YES in step S132, the association processing unit 13 determines that the meal objects Me02, Me05 having high user preference are present among the meal objects Me01, Me02, and Me05 determined to have corresponding user preference information.

[0046] In step S133, the display control unit 14 controls the display unit 30 to start an appetite reducing display for the food objects Me02 and Me05 that are highly preferred by the user, so as to reduce the appetite. If YES in step S134, the display control unit 14 determines that all of the food objects Me01 with low user preference and the food objects Me03 and Me04 without user preference information have been undetected from the captured image. Note that the display control unit 14 may determine that a predetermined number or more of the food objects Me01 with low user preference and the food objects Me03 and Me04 without user preference information have been undetected from the captured image. In step S136, the display control unit 14 controls the display unit 30 to end the appetite reduction display of the food objects Me02 and Me05.

[0047] As described above, the display device 1 according to the first embodiment controls the display unit 30 so that when the user uses the display unit 30 to view the food object, the display unit 30 displays the food object in a different way based on the associated user preference information. Therefore, the display device 1 can improve the intake of food ingredients necessary for maintaining health by considering the preferences of each individual. In particular, elderly people tend to eat meals centered on food objects that they like or known food objects, and tend to avoid food objects that they do not like or are not known. In such a meal environment, even if a food object that is desired to be consumed for maintaining health is provided, the intake priority is low and it is likely to be left behind. The display device 1 provides an environment in which such food objects that are likely to be left behind are preferentially consumed, and after that, preferred or known food objects can also be consumed, so that a calorie deficiency can be suppressed. In this way, the display device 1 can improve the intake of food ingredients necessary for maintaining health by considering the preferences of each individual. In addition, the display device 1 can reduce waste by providing an environment in which food objects that are likely to be left behind are preferentially consumed.

[0048] In addition, the display device 1 controls the display unit 30 to perform at least one of displaying food objects with low user preference in a way that stimulates the appetite and displaying food objects with high user preference in a way that reduces the appetite. Therefore, by taking into consideration the preferences of each individual, it is possible to further improve the intake of food ingredients necessary for maintaining health.

[0049] Second embodiment Next, the configuration of the display device 2 according to the second embodiment will be described with reference to Fig. 6. Fig. 6 is a block diagram showing an example of the configuration of the display device 2 according to the second embodiment.

[0050] Similar to the configuration of the display device 1 according to the first embodiment, the display device 2 includes a control unit 10, an imaging unit 20, a display unit 30, a sensor 40, and a communication unit 50. The control unit 10 of the display device 2 further includes an order determination unit 17.

[0051] The order determination unit 17 determines the order in which the meal objects are consumed based on the user's preference information associated by the association processing unit 13. The order in which the meal objects are consumed is the order in which the user should consume the meal objects. Note that the order determination unit 17 may determine the order in which the meal objects are consumed based on not only the user's preference information but also nutritional information such as calories and composition of the meal objects, portion sizes of the meal objects, and the like.

[0052] The display control unit 14 controls the display unit 30 to display the food objects in a way that makes them look different, so that the user ingests the food objects in accordance with the intake order of the food objects determined by the order determination unit 17.

[0053] Next, the operation of the display device 2 according to the second embodiment will be described with reference to FIGS.

[0054] As shown in Fig. 2, the display device 2 executes the above-mentioned processes from step S11 to step S15. Here, as the display change process of step S13, the display device 2 executes the display change process of steps S141 to S147 shown in Fig. 7. Fig. 7 is a flowchart showing an example of the display change process of the display device 2 according to the second embodiment.

[0055] 7, first, in step S141, the association processing unit 13 judges whether or not there is user preference information corresponding to the detected food object. If it is judged that there is user preference information for the detected food object (YES in step S141), the process proceeds to step S142. On the other hand, if it is judged that there is no user preference information for the detected food object (NO in step S141), the process ends.

[0056] Next, in step S142, the association processing unit 13 judges whether or not there is a meal object with low or high user preference among the meal objects judged to have corresponding user preference information. If it is judged that there is a meal object with low or high user preference (YES in step S142), the process proceeds to step S143. On the other hand, if it is judged that there is no meal object with low or high user preference (NO in step S142), the process ends.

[0057] Next, in step S143, the order determination unit 17 determines the intake order of the meal objects based on the user's preference information associated by the association processing unit 13. For example, the intake order of the meal objects is determined such that meal objects with low preference of the user or meal objects without preference information of the user are preferentially consumed.

[0058] Next, in step S144, the display control unit 14 controls the display unit 30 to start an appetite-enhancing display or an appetite-reducing display for the food objects based on the determined intake order. For example, the display control unit 14 controls the display unit 30 to start an appetite-enhancing display for food objects that are less preferred by the user and that are earlier in the intake order. The display control unit 14 also controls the display unit 30 to start an appetite-reducing display for food objects that are more preferred by the user and that are later in the intake order. However, depending on the determined intake order, the display control unit 14 may not control the display unit 30 to start an appetite-enhancing display for food objects that are less preferred by the user. The same applies to the appetite-reducing display. The display control unit 14 may adjust the brightness, color tone, and contrast of the display in the appetite-enhancing display or appetite-reducing display of the food objects so that the user can consume the food objects according to the intake order of the food objects.

[0059] Next, in step S145, the display control unit 14 determines whether or not the detection processing unit 12 has undetected the food object that comes first in the intake order from the captured image. If it is determined that the food object that comes first in the intake order has not been undetected from the captured image (NO in step S145), the process proceeds to step S146. On the other hand, if it is determined that the food object that comes first in the intake order has been undetected from the captured image (YES in step S145), the process proceeds to step S147. Here, if it is determined that the food object that comes first in the intake order has been undetected from the captured image (YES in step S145), the order determination unit 17 reconstructs the intake order of the food objects by excluding the undetected food object from the intake order of the food objects.

[0060] Next, in step S146, the display control unit 14 determines whether or not a predetermined time has elapsed since the detection processing unit 12 detected the food object. In step S146, the display control unit 14 may determine whether or not a predetermined time has elapsed since the appetite enhancement display or appetite reduction display was started. If it is determined that the predetermined time has elapsed (YES in step S146), the process proceeds to step S147. On the other hand, if it is determined that the predetermined time has not elapsed (NO in step S146), the process returns to step S145.

[0061] Next, in step S147, the display control unit 14 controls the display unit 30 to end the appetite enhancement display or appetite reduction display based on the reconstructed intake order. For example, when an undetected food object is being displayed as an appetite enhancement display or appetite reduction display, the display control unit 14 controls the display unit 30 to end the appetite enhancement display or appetite reduction display of the undetected food object.

[0062] Next, the display change processing of the display device 2 according to the second embodiment will be specifically described with reference to Fig. 2, Fig. 5, and Fig. 7. The display change processing of the display device 2 is the processing from step S141 to step S147 described above.

[0063] 2 and 5, in step S12, the detection processing unit 12 of the display device 1 detects eating objects Me01, Me02, Me03, Me04, and Me05 from the captured image. In addition, the eating objects Me01 to Me05 are associated with the user's preference information as follows. ·Me01:grilled fish:Low palatability ·Me02:tofu:High palatability Me03:salad:No preference information Me04:rice:No preference information ·Me05:miso soup:High palatability

[0064] As shown in FIGS. 5 and 7, the display device 1 performs a display change process from step S141 to step S147. If the answer is YES in step S141, the association processing unit 13 determines that there is corresponding user preference information for the meal objects Me01, Me02, and Me05. If the answer is YES in step S142, the matching processing unit 13 determines that among the meal objects Me01, Me02, and Me05 that have been determined to have corresponding user preference information, there is a meal object Me01 that has a low user preference and meal objects Me02 and Me05 that have a high user preference. In step S143, the order determination unit 17 determines the intake order of the meal objects based on the user's preference information. The intake order of the meal objects is meal object Me03, meal object Me01, meal object Me04, meal object Me05, and meal object Me02. The intake order of the meal objects is determined so that the meal object Me01, which has a low preference of the user, or the meal objects Me03 and Me04, which have no preference information of the user, are preferentially consumed.

[0065] In step S144, the display control unit 14 controls the display unit 30 to start an appetite-increasing display for the food object Me01 having a low preference of the user, which increases the appetite. Also, the display control unit 14 controls the display unit 30 to start an appetite-reducing display for the food objects Me02 and Me05 having a high preference of the user, which decreases the appetite. If the answer is YES in step S145, the display control unit 14 determines that the first food object Me03 in the intake order is not detected from the captured image. Here, the order determination unit 17 determines the reconstructed intake order based on the user's preference information. The reconstructed intake order is the order of food object Me01, food object Me04, food object Me05, and food object Me02. In step S147, the display control unit 14 controls the display unit 30 to continue the appetite-enhancing display of the meal object Me01, end the appetite-reducing display of the meal object Me05, and continue the appetite-reducing display of the meal object Me02, in accordance with the reconstructed intake order.

[0066] As described above, the display device 2 according to the second embodiment determines the intake order of the food objects based on the associated preference information of the user. Then, the display device 2 controls the display unit 30 to display the food objects in a different appearance so that the user takes the food objects according to the determined intake order. Therefore, the display device 2 can further improve the intake of ingredients necessary for maintaining health by taking into account the intake priority of the food objects.

[0067] Each of the display devices 1 and 2 in the above-described embodiments is configured by hardware or software, or both, and may be configured by one piece of hardware or software, or may be configured by a plurality of pieces of hardware or software.

[0068] The program executed by the computer constituting the display devices 1 and 2 includes a set of instructions (or software code) that, when loaded into the computer, causes the computer to perform one or more functions described in the embodiments. The program may be stored in a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, the computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, optical disk storage, and magnetic storage devices. The program may be transmitted on a transitory computer-readable medium or a communication medium. By way of example and not limitation, the transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagating signals.

[0069] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be appropriately combined with other embodiments.

[0070] Each drawing is merely an example for describing one or more embodiments. Each drawing may relate not only to one particular embodiment, but to one or more other embodiments. As can be understood by those skilled in the art, various features or steps described with reference to any one drawing may be combined with features or steps shown in one or more other drawings to create an embodiment not explicitly shown or described, for example. Not all features or steps shown in any one drawing are necessary to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0071] This disclosure includes matters that contribute to the realization of the Sustainable Development Goals (SDGs) of "Good health and well-being for all," and contribute to value creation through healthcare products and services. [Explanation of symbols]

[0072] 1,2 Display device 10 Control section 11. Shooting control section 12 Detection processing section 13 Processing section 14 Display control section 15 Sensor information acquisition unit 16 Communication control section 17 Order determining part 20. Photography Department 30 Display section 40 Sensors 50 Communications Department

Claims

1. an imaging control unit that controls the imaging unit to take an image and acquires the captured image; A detection processing unit that detects a food object from the captured image; an association processing unit that associates pre-stored user preference information with the meal objects; A display control unit that controls the display unit to display the food object in a different way for the user based on the associated preference information of the user. Display device.

2. The display control unit is A display that stimulates the appetite of the food object having a low preference of the user; and controlling the display unit to perform at least one of: displaying the food object having a high preference of the user in a manner that reduces the appetite of the user. The display device according to claim 1 .

3. The display control unit is Controlling the display unit so as to display the food object in a different appearance for a predetermined period of time after the food object is detected The display device according to claim 1 .

4. An order determination unit that determines an order in which the food objects are taken based on the associated preference information of the user, The display control unit is Controlling the display unit to display the food objects in a manner that changes the appearance of the food objects so that the user ingests the food objects in accordance with the determined intake order. The display device according to claim 1 .

5. The display device, Controlling the photographing unit to take a photograph and acquiring the photographed image; Detecting a food object from the captured image; Associating the meal object with pre-stored user preference information; Controlling a display unit to perform display such that the food object is seen differently for the user based on the associated preference information of the user. Display method.

Images