Method for controlling an electronic device and a food ordering system

An electronic device enhances food ordering systems by using detection data to provide personalized and sustainable menu recommendations, addressing group preferences and reducing waste.

JP7732587B2Active Publication Date: 2025-09-02SONY GROUP CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2024519312
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2021-11-30
Filing Date
2022-10-25
Publication Date
2025-09-02
Estimated Expiration
2042-10-25

AI Technical Summary

Technical Problem

Restaurants face challenges in recommending harmonious and personalized food orders for groups with varying preferences and compositions, while also adhering to sustainable consumption laws and minimizing food waste.

Method used

An electronic device with memory, processor, and interface circuits that obtains detection data from optical devices to control a food ordering system, providing personalized menu recommendations based on individual preferences and group composition, and optimizing dish selection for nutrition and sustainability.

Benefits of technology

Improves food ordering efficiency by offering personalized and harmonious menu suggestions, reducing food waste, and aiding compliance with sustainability regulations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007732587000001
    Figure 0007732587000001
  • Figure 0007732587000002
    Figure 0007732587000002
Patent Text Reader

Abstract

An electronic device is provided, the electronic device configured to obtain sensor data indicative of the items from the optical device, the electronic device configured to control a food ordering system based on the sensor data.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to the field of Internet of Things (IoT) and sensing devices, and to methods for controlling electronic devices and food ordering systems. [Background technology]

[0002] In restaurants that generally serve food for sharing, knowing and deciding what to order and how much to order can be an extremely difficult task for non-local customers. The responsibility for recommending an appropriate set of dishes may lie with the establishment's owner. Tasting menus are offered by restaurants and can be designed to suit specific group sizes, but it can be difficult to account for the large variations presented by group composition and / or individual preferences. One challenge, for example, is recommending a set of dishes that offers a harmonious taste journey while taking into account the calorie intake and / or personal preferences of both the group and the individuals within it. Another challenge is helping restaurants comply with national laws regarding sustainable consumption and food waste. Summary of the Invention [Problem to be solved by the invention]

[0003] Therefore, there is a need for an electronic device and method for controlling a food ordering system that can mitigate, alleviate or address existing problems and that can provide control of the food ordering system. [Means for solving the problem]

[0004] An electronic device is provided, the electronic device comprising a memory circuit, a processor circuit, and an interface circuit, the electronic device is configured to obtain detection data indicative of the items from the optical device, and the electronic device is configured to control a food ordering system based on the detection data.

[0005] Additionally, a method is disclosed that is performed by an electronic device, the method including obtaining sensor data indicative of an item from an optical device, and controlling a food ordering system based on the sensor data.

[0006] Further disclosed herein are electronic devices as disclosed herein and systems comprising one or more electronic devices as disclosed herein.

[0007] The disclosed electronic devices, associated methods, and systems can provide improved control of food ordering systems.

[0008] The disclosed electronic devices, related methods, and systems can provide improved control of food ordering systems, for example, by providing menu data indicating a dish menu. The menu data may include shared menu recommendations. In other words, the food ordering system can be controlled based on the shared menu recommendations. The shared menu recommendations may include recommendations for a particular group size including one or more subjects, such as taking into account personal preferences of one or more subjects in the group. The personal preferences may include calorie intake associated with the personal preferences. The present disclosure can provide menu data indicating a shared menu for a group of subjects, such as a shared menu recommendation for a group of subjects. The menu data can be based on individual assessments of subjects (e.g., customers) taking into account detected data and / or user input, such as additional information regarding gender, age, activity level, and personal preferences. Furthermore, the present disclosure can improve control of food ordering systems by facilitating dish selection and / or adjustment for a subject. For example, it will be appreciated that controlling a food ordering system may include configuring a customized flavor journey and / or selecting dishes for a nutritionally balanced meal based on the composition of a target group and / or based on an individual target. Further, the present disclosure may provide menu data, including food recommendations at an individual level, obtained via user input, by utilizing information from one or more electronic devices, such as, for example, a fitness band and / or activity tracker.

[0009] It will be appreciated that the present disclosure may provide the possibility of obtaining detection data to, for example, continuously monitor intake and encourage consumption of specific dishes to achieve a nutritionally balanced diet. Furthermore, the detection data may be used to continuously consider a subject's (e.g., customer's) calorie intake potential to enable sustainable consumption and avoid food waste. It will be appreciated that the present disclosure may assist food service establishments (e.g., restaurants) in complying with national regulations, such as the Food Waste Prevention Act.

[0010] Additionally, the disclosed electronic devices and associated methods and systems can improve the logistics of food ordering systems (e.g., at restaurants). For example, the present disclosure can improve the efficiency and / or reduce the effort of restaurant employees, saving both the subject (e.g., customer) and the restaurant time and money.

[0011] These and other features and advantages of the present disclosure will become readily apparent to those skilled in the art from the following detailed description of examples which proceeds with reference to the accompanying drawings. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a block diagram illustrating an exemplary system including an electronic device according to the present disclosure. [Figure 2] FIG. 2 is a flowchart illustrating an exemplary method performed by an electronic device according to the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0013] Various examples and details are described below with reference to the drawings, where relevant. It should be noted that the drawings may or may not be drawn to scale, and that elements of similar structure or function are represented by similar reference numerals throughout the drawings. It should also be noted that the drawings are intended only to facilitate the description of the examples. They are not intended as an exhaustive description of the present disclosure or as limitations on the scope of the present disclosure. Moreover, an illustrated example need not have all aspects or advantages shown. An aspect or advantage described in connection with a particular example is not necessarily limited to that example and may be implemented in any other example, even if not so shown or explicitly described.

[0014] The drawings are schematic and simplified for clarity, and they merely show details that aid in understanding the present disclosure, while other details are omitted. The same reference numerals are used throughout to refer to the same or corresponding parts.

[0015] 1 illustrates an exemplary system 1 including an electronic device 300B according to the present disclosure functioning as a server device and an electronic device 300A according to the present disclosure functioning as an electronic device (e.g., an optical device). System 1 may be, for example, a food ordering system. System 1 may include electronic device 300A and / or electronic device 300B.

[0016] FIG. 1 shows a block diagram illustrating an electronic device 300B according to the present disclosure functioning as a server device and a block diagram illustrating an electronic device 300A functioning as an electronic device (e.g., an optical device). Optionally, system 1 (e.g., a food ordering system) may include a food ordering device 306. The food ordering device 306 may include one or more user electronic devices, such as one or more user electronic devices at a table (e.g., a restaurant table) of a food consuming place, such as a restaurant, to enable a subject (e.g., a subject group) to provide user input. The food ordering device 306 may also include one or more user devices, such as a user device and / or a terminal in a kitchen of the food consuming place (e.g., a restaurant) where menu data (e.g., a dish menu, such as an accepted dish menu) may be displayed and / or transmitted. In other words, the food ordering device 306 may be configured to display dish menu data to one or more employees of the food consuming place (e.g., a restaurant), such as being configured to display the dish menu to inform the employee that the contents of the dish menu should be prepared and / or served. In other words, the food ordering device 306 may be controlled by the electronic devices 300A, 300B based on the detection data, and / or the electronic devices 300A, 300B may be configured to communicate with the food ordering device 306. Optionally, the system 1 (e.g., a food ordering system) may include the food ordering device 306 in communication with a food delivery device (e.g., a grocery delivery device) and / or may include the food ordering device 306 with the food delivery device. The food delivery device may be configured to prepare and / or deliver food items based on the menu data. In other words, the food delivery device may be controlled by the electronic devices 300A, 300B based on the detection data.A food ordering system may be considered as a system operating at a location (e.g., a food consumption place such as a restaurant, diner, cafe, or similar) where food products (e.g., edible and / or drinkable products) and / or items may be prepared and / or delivered (e.g., in a kitchen), where the food products and / or items may be ordered by subjects, and where the subjects may consume the food products and / or items (e.g., food and / or beverage products).

[0017] The electronic device 300A, functioning as an electronic device, may be configured to communicate with the electronic device 300B, functioning as a server device, via a network 310 (e.g., an external network such as a wired communication system and / or a wireless communication system).

[0018] In one or more exemplary electronic devices, electronic device 300A is an electronic device that may include food ordering device 306. In one or more exemplary electronic devices, electronic device 300A may include an optical device (e.g., a camera). In one or more exemplary electronic devices, food ordering device 306 may include memory circuitry, interface circuitry (e.g., a display), and processor circuitry. In one or more exemplary electronic devices and / or systems, the optical device (e.g., a camera) may be arranged and / or positioned to provide a substantially unobstructed view of items at the food service location. In other words, the optical device (e.g., a camera) may be positioned to provide a substantially unobstructed view of one or more food objects at the food service location (e.g., a table at the food service location), one or more subjects, the poses of one or more subjects, and / or the faces of one or more subjects. For example, an optical device (e.g., a camera) may be positioned and / or positioned to provide a substantially unobstructed view of plates at a food service location (e.g., one or more tables in a restaurant). The unobstructed view of the optical device may, for example, provide continuous analysis of items. In an exemplary setup, the food service location may include one optical device per table. The positioning of the optical device may be based on the location and / or seating of subjects (e.g., customers) at the food service location. The optical device may be positioned in a manner that allows the optical device to obtain detection data from one or more user groups, such as one or more user recognitions.

[0019] In one or more examples, system 1 comprises an ordering system, such as a food ordering system and / or a beverage ordering system. System 1, such as a food ordering device, may comprise one or more of an electronic slate, a tablet, a smartphone, a touch-enabled food ordering system, and / or a laptop.

[0020] In one or more exemplary electronic devices, electronic device 300B is a server device, such as functions as a server device.

[0021] The electronic devices 300A, 300B comprise memory circuits 301A, 301B, interface circuits 303A, 303B, and processor circuits 302A, 302B. Optionally, the processor circuit 302A comprises an inference circuit 302AA configured to execute, perform, and / or operate according to a detection model, such as a first detection model. Optionally, the processor circuit 302B comprises an inference circuit 302BA configured to execute, perform, and / or operate according to the detection model. Optionally, the inference circuits 302AA, 302BA may comprise a recommendation engine disclosed herein. The electronic device 300A may comprise a detection device (such as one or more of an optical device, a microphone, and a temperature sensor), a portable electronic device, a wireless device, a wired device, and / or an IoT device.

[0022] The electronic devices 300A, 300B may be configured to perform any of the methods disclosed in Figure 2. In other words, the electronic devices 300A, 300B may be configured to control a food ordering system, such as to provide menu data including shared menu recommendations.

[0023] The techniques described in this disclosure may be applied in the context of controlling (e.g., monitoring) a food ordering system of a venue such as a food consumption place, such as a restaurant, diner, cafe, eatery, dining room, bistro, and / or the like.

[0024] The electronic device 300A may include an optical device 304, such as a first optical device, such as a camera (eg, a micro camera and / or an on-board camera sensor).

[0025] The electronic devices 300A, 300B are configured to acquire (using the processor circuitry 302A, 302B and / or via the interface circuitry 303A, 303B) detection data indicative of an item (e.g., an object such as a dish, an item including one or more of a person and a face) from the optical device. In one or more exemplary electronic devices, the item may be considered a restaurant item, a person, and / or a group of people at a location such as a food consumption place like a restaurant or diner.

[0026] Acquiring the detection data may include acquiring first detection data and / or second detection data. Acquiring the detection data may include acquiring detection data from multiple optical devices. In one or more exemplary electronic devices, the electronic device is configured to acquire detection data from one or more optical devices at a location such as a food consumption place, such as a restaurant, a food takeout place, a diner, a food truck, and / or the like.

[0027] An optical device disclosed herein (e.g., optical device 304) may be considered a camera including one or more user-aware vision-based visual sensors. In one or more exemplary electronic devices, the optical device (e.g., optical device 304) may include a visual sensor and / or processing circuitry configured to implement and / or execute a detection model. In one or more exemplary electronic devices, the optical device may be considered one or more of an integrated camera, a micro camera, an action camera, a surveillance camera, a mirrorless camera, a 360-degree view camera, and an infrared camera. In one or more exemplary electronic devices, the optical device may include memory circuitry, interface circuitry, and processing circuitry configured to implement and / or execute a detection model. In one or more examples, the optical device may be configured to detect one or more of a subject's movement, a subject's movement pattern, a group of subjects' movement, and the location and / or quantity of items (e.g., tables, chairs, bowls, plates, glasses, etc.).

[0028] The electronic device 300A may be configured to acquire sensed data indicative of user activity information from a user electronic device. The user electronic device may include one or more of an armband, a wristband, an activity tracker, smart glasses, a smartphone, and / or a wearable electronic device (such as a smart finger ring). In one or more exemplary electronic devices, the user activity information may include one or more of user physical activity routine information (such as number of steps, type of gym workout, etc.), calorie intake, food intake, caffeine intake, etc. In one or more exemplary electronic devices, the user activity information may include health-related information such as a body mass index value, blood pressure, blood glucose level, and / or stress level.

[0029] The electronic device is configured to control (e.g., using processor circuits 302A, 302B and / or via interface circuits 303A, 303B) a food ordering system, such as food ordering system 1, based on the detected data. In one or more example electronic devices, controlling the food ordering system may include outputting information indicative of one or more food items (e.g., food items) to a user of the food ordering system and / or to a food ordering device, such as food ordering device 306. In one or more example electronic devices, controlling the food ordering system may include displaying information (e.g., menu data) indicative of the one or more food items (e.g., food items) to a user of the food ordering system and / or to a food ordering device, such as food ordering device 306. In one or more example electronic devices, controlling the food ordering system may include outputting, e.g., displaying to a user, information (e.g., menu data) indicative of suggestions and / or recommendations (e.g., suggestions and / or recommendations for a menu including one or more food items, such as one or more food items and / or beverage items). In one or more electronic devices, controlling the food ordering system may include controlling one or more food orders, such as food orders and / or beverage orders, at a food consuming place. For example, controlling the food ordering system may include controlling the making (e.g., preparation) of food items and / or food items at a food consuming place, such as a kitchen at the food consuming place. For example, controlling the food ordering system may include controlling the ordering of raw food items and / or food items, such as food products (e.g., fresh food and / or beverage items), from which food items and / or food items are to be prepared. For example, controlling the food ordering system may include controlling the prioritization of production of food items and / or food items, such as in a kitchen. In other words, the preparation of a set of dishes and / or dish items for a group of subjects ordering at the same time is prioritized so that the dishes and / or dish items ordered at substantially the same time are obtained.For example, controlling a food ordering system may include controlling the making (e.g., preparation) of food products and / or food items at a food consumption place based on inventory levels of food products and / or food items, such as inventory levels of food products (e.g., fresh food and / or beverages).

[0030] System 1 may optionally include a network node (e.g., a base station (not shown)) with which electronic device 300B, functioning as a server device, electronic device 300A, and / or food ordering device 306 can communicate. A network node refers to an access point and / or a radio access network node operating in a radio access network, such as a base station, an evolved Node B (eNB), or a next generation Node B (gNB) in New Radio (NR). In one or more examples, the radio access network (RAN node) is a functional unit that may be distributed across several physical units.

[0031] The electronic devices 300A, 300B and the food ordering device 306 may communicate using a cellular system, e.g., a 3GPP® wireless communication system and / or the Internet, and / or a local communication system (e.g., a short-range wireless communication system such as Wi-Fi, Bluetooth®, Zigbee®, IEEE 802.11, IEEE 802.15, etc.), such as via interface circuits 303A, 303B. The electronic device 300B functioning as a server device may be considered a device configured to function as a server that communicates with client devices, and the electronic device 300A, the optical device, and / or the food ordering device 306 are configured to function as clients.

[0032] In one or more exemplary electronic devices, the detection data includes one or more of subject parameters, subject group parameters, object parameters, face parameters, dish parameters, dish tracking parameters, and wireless sensing parameters.

[0033] Subject parameters may be considered to be parameters related to subjects, such as detected subjects (e.g., detected by an optical device). For example, subject parameters may include information indicative of subject items, such as users, subjects at a location (e.g., a restaurant, a diner, a food truck, and / or a food takeout place), and / or users operating user electronic devices, such as food ordering devices 306. Subject parameters may also be considered to include information indicative of items such as user demographics, subject ages, subject genders, and / or subject physical parameters (e.g., a height parameter indicative of a user's height, a weight parameter indicative of a user's weight, etc.).

[0034] The subject group parameter may be considered to be a parameter associated with a subject group, such as a detected subject group (e.g., detected by an optical device). The subject group parameter may be considered to include information indicative of one or more subjects in the subject group. For example, the subject group parameter may include a group including one or more users at a location (e.g., a restaurant, a diner, a food truck, and / or a food takeout place, etc.) and / or one or more users in a group, such as a group of users operating a food ordering device (e.g., a user electronic device). The subject group parameter may be considered to include information indicative of the number of subjects (e.g., users) in a group at a food serving location. In other words, the electronic devices 300A, 300B may be configured to identify multiple subjects at a food serving location, for example, using an optical device and / or a visual sensor. The subject group parameter may be considered to include information indicative of the number of subjects in the group, such as the age of the subjects in the group (e.g., the average age of the subjects in the group), the gender of the subjects in the group, and / or physical parameters of the subjects in the group (e.g., the height of the subjects in the group).

[0035] The object parameters may be considered to be parameters associated with an object, such as a detected object (e.g., detected by an optical device). The object parameters may be considered to include information indicative of an object item, such as one or more objects in a food serving location (e.g., a restaurant, a diner, a food truck, and a food takeout place). The object parameters may be indicative of one or more of cutlery, plates, bowls, glasses, cups, chairs, and tables.

[0036] Facial parameters may be considered to be parameters associated with a face, such as a detected face (e.g., detected by an optical device). Facial parameters may be considered to include information indicative of facial items, such as facial features of one or more subjects. Facial features may be indicative of one or more of the eyes, nose, mouth, ears, chin, forehead, and skin.

[0037] In one or more exemplary electronic devices, the detected data includes a pose parameter. The pose parameter may be considered a parameter associated with a pose (e.g., detected by an optical device) of one or more subjects. The pose parameter may be considered to include information indicative of a pose item, such as one or more poses of one or more subjects at a food-serving location (e.g., a restaurant, a diner, a food truck, or a food takeout place). The pose parameter may indicate one or more of the one or more subjects eating, drinking, not eating, ordering, and / or sitting. Control of a food ordering system may be based on the pose parameter. For example, if the pose parameter indicates that the subject is not eating, which may indicate that the subject has finished the provided food item, the electronic device 300A, 300B may be configured to control the food ordering system to prepare and / or serve the next food item to the subject. Another example is that the pause parameter may indicate a group of subjects not eating, which may indicate that the group of subjects have finished (e.g., completed) a food item that has been served to them, for example, that the group of subjects have finished their ordered starter. In response to the pause parameter indicating that the group of subjects have finished a food item, the electronic devices 300A, 300B may be configured to control the food ordering system to prepare and / or serve the next food item to the group of subjects, such as to prepare and / or serve a main course.

[0038] Cooking parameters may be considered parameters associated with cooking items and / or objects, such as detected cooking items and / or cooking objects (e.g., detected by an optical device). Cooking parameters may be considered to include information indicative of cooking items, such as food items (starter, main course, side dish, dish, beverage, salad, soup, sweets, etc.). Cooking tracking parameters may be considered parameters associated with consumption of cooking items and / or cooking objects, such as detected consumption of cooking items and / or cooking objects (e.g., detected by an optical device). Cooking tracking parameters may be considered to include information indicative of one or more of: cooking item consumption, cooking item quantity, cooking item portion, consumption state, and cooking item state (e.g., solid, liquid, hot and / or cold).

[0039] The wireless detection parameters may be considered to be parameters related to the detection of radio waves. The wireless detection parameters may be considered to include information indicative of the detection of an electronic device, such as near field communication (NFC), Wi-Fi, Bluetooth Low Energy (BLE), etc., for detecting multiple electronic devices, such as a phone, a smartwatch, etc., and / or for detecting the type of electronic device.

[0040] In one or more exemplary electronic devices, the items include one or more of a food object, one or more subjects, a pose, and a face. In other words, the items as disclosed herein may include one or more of a subject item, a group of subject items, an object item, a face item, and a food item. In other words, the detection data is indicative of one or more of a food object, one or more subjects, a pose, and a face.

[0041] A subject item may be considered an item that represents a subject, such as a human being and / or a user. The subject may include a subject at a food consumption place to be controlled by an electronic device as disclosed herein and / or a subject using a food ordering device 306 that functions as a user electronic device.

[0042] A pause may be considered as a posture of a subject, such as eating, drinking, not eating, ordering, and / or sitting. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to acquire item information indicative of a pause (e.g., pause information) from an optical device (e.g., the optical device 304). The electronic device 300A, 300B may be configured to recognize and / or identify an activity and / or a situation, such as a consumption situation, of one or more subjects based on the detection of the pauses of the one or more subjects. For example, the electronic device 300A, 300B may be configured to recognize that one or more subjects are eating, drinking, not eating, ordering, and / or sitting based on the detection of the pauses. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to control a food ordering system based on the detection of one or more pauses, such as the detection data including the pause parameters.

[0043] A target group may be considered as one or more people and / or an item indicative of a group including one or more targets, such as one or more users. A target group may include one or more targets present at a food consumption place. In one or more exemplary electronic devices, electronic device 300A, 300B may be configured to obtain item information indicative of a target group (e.g., target group information) from one or more optical devices (e.g., optical device 304).

[0044] An object may be considered an item representing a tangible item present in a food consumption place (e.g., a plate, a glass, a table, a chair, a spoon, a fork, a knife, etc.). An object may be configured to hold one or more food items (e.g., food, a drink, a soup, etc.). In one or more example electronic devices, electronic device 300A, 300B may be configured to obtain item information (e.g., object information) representing the object from one or more optical devices (e.g., optical device 304).

[0045] A face may be considered an item representing a face of a subject (and / or one or more faces of subjects in a subject group) at a food consumption place (e.g., a restaurant, a food takeout place, a food truck, a diner, etc.). The face may include one or more of the subject's eyes, the subject's nose, the subject's mouth, the subject's cheeks, the subject's beard, and the subject's ears. In one or more exemplary electronic devices, the electronic devices 300A, 300B may be configured to acquire item information representing a face (e.g., face information) from one or more optical devices (e.g., the optical device 304). The electronic devices 300A, 300B may be configured to recognize and / or identify one or more subjects based on face detection. For example, the electronic devices 300A, 300B may be configured to recognize and / or identify the gender of one or more subjects, the identities of one or more subjects, the ages of one or more subjects, and / or the moods of one or more subjects based on face detection. In one or more exemplary electronic devices, the electronic devices 300A, 300B may be configured to control a food ordering system based on detection of one or more faces, such as detection data including facial parameters.

[0046] A cuisine object may be considered an item representing a cuisine item, such as a food item (such as a food, drink, sweet, soup, or combination of food items) at a cuisine consumption place. In other words, a cuisine object may be considered an item consumed by a subject at a cuisine consumption place. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to obtain cuisine object information from one or more optical devices (such as the optical device 304). In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to display a user interface object representing the cuisine object via the cuisine ordering device 306.

[0047] In one or more exemplary electronic devices, the electronic device 300A, 300B includes a recommendation engine. In one or more exemplary electronic devices, the recommendation engine may include and / or be configured to execute a deep neural network. In one or more exemplary electronic devices, the deep neural network may be an offline trained neural network. In one or more exemplary electronic devices, the deep neural network may be dynamically trained at the food serving place. In one or more exemplary electronic devices, the recommendation engine may be configured to output menu data based on the output of the deep neural network. In one or more electronic devices, the recommendation engine may include and / or be configured to execute a trained neural network. In one or more electronic devices, the recommendation engine may be dynamically trained based on detection data, menu data (e.g., historical menu data), user input, and / or user input groups.

[0048] In one or more exemplary electronic devices, the recommendation engine may comprise a neural network including one or more input layers, one or more intermediate layers, and one or more output layers. In one or more exemplary electronic devices, input to the recommendation engine may include one or more of: detection data indicating items; and / or one or more user inputs (e.g., a first user input). In other words, input to the recommendation engine may include one or more of: subject parameters, subject group parameters, object parameters, facial parameters (e.g., expression parameters), cuisine parameters, cuisine tracking parameters, wireless sensing parameters, cuisine preference parameters, allergy parameters, taste parameters, price parameters, duration parameters, and activity parameters. Input to the recommendation engine may include user activity information, user inputs such as a first user input indicating a user's choice and / or preference (e.g., selecting, adding, and / or deleting cuisine items from a cuisine menu). In one or more exemplary electronic devices, the input to the recommendation engine may include input from a detection model.

[0049] In one or more example electronic devices, the recommendation engine may consider as input one or more of a time parameter indicating a time (e.g., time of day), a date parameter indicating a date, and / or a seasonal parameter indicating a season at the location (e.g., a seasonal parameter indicating a type of weather for a season of the year, e.g., a type of weather associated with summer, fall, winter, or spring), a weather parameter indicating the weather at the location (e.g., snow, rain, sunshine, heat, cloudy, showers, etc.), an alert parameter indicating alert information (e.g., water quality at the location, alerts from corresponding agencies, daily news, etc.), and inventory levels of cuisine products and / or cuisine items, e.g., inventory levels of cuisine products (e.g., fresh food and / or beverages). In one or more example electronic devices, the recommendation engine may output an output, such as a first output including menu data, such as a first menu data output indicating a cuisine menu recommendation, such as a first cuisine menu. In one or more exemplary electronic devices, the recommendation engine may output one or more recommendations (e.g., suggestions, advice, offers, reminders, and / or warnings) to one or more subjects at the food consumption place, such as a group of subjects at the food consumption place. The first food menu may include recommendations of one or more food items (e.g., food items representing food products). In one or more exemplary electronic devices, the recommendation engine may be configured to consider a second user input as an input. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to execute and / or perform the recommendation engine using the processor circuitry 302A, 302B and / or via the interface circuitry 303A, 303B.

[0050] In one or more example electronic devices, the recommendation engine may be configured to modify the first cuisine menu (e.g., menu data) and / or generate a second cuisine menu (e.g., updated cuisine menu recommendations) based on the second user input. For example, the second user input may indicate a user choice and / or preference (e.g., accepting, rejecting, modifying, selecting, adding, and / or canceling cuisine items from the cuisine menu).

[0051] In one or more electronic devices, electronic device 300B, functioning as a server device, may include a recommendation engine. In one or more electronic devices, input to electronic device 300B, such as input to the recommendation engine, may include one or more of: detection data indicating items from electronic device 300A; user input from a user, such as user input provided via food ordering device 306; and / or user input from a user. In one or more electronic devices, electronic device 300B may be configured to generate menu data, such as outputting menu data indicating a food menu, based on the input. In one or more electronic devices, electronic device 300B may be configured to control a food ordering system based on the menu data and / or transmit the menu data to electronic device 300A. In one or more electronic devices, controlling the food ordering system may include displaying output generated by electronic device 300B.

[0052] In one or more exemplary electronic devices, the recommendation engine is based on one or more of collaborative filtering, content-based filtering, a session-based recommender, and a hybrid system combining any one or more of these. In other words, an electronic device disclosed herein (e.g., electronic device 300A, 300B) may include a recommendation engine based on one or more of collaborative filtering, content-based filtering, a session-based recommender, and a hybrid system combining any one or more of these. The recommendation engine disclosed herein may take into account detection data indicative of items and user input, such as a first user input, e.g., input from a user electronic device. A recommendation engine as disclosed herein may provide output, such as menu data indicative of a menu of dishes.

[0053] In the one or more exemplary electronic devices, controlling the food ordering system includes generating menu data indicating a dish menu using a recommendation engine based on the detected data and, optionally, a user input (e.g., the first user input). In the one or more exemplary electronic devices, the recommendation engine may generate the menu data, such as a dish menu indicating shared menu recommendations, based on one or more of collaborative filtering, content-based filtering, a session-based recommender, and a hybrid system combining any one or more of these.

[0054] In one or more exemplary electronic devices, a recommendation engine comprising a machine learning (ML) model (e.g., configured to execute an ML model) may be configured to generate menu data (e.g., a food menu showing share menu recommendations) based on a content-based filtering algorithm. In other words, the recommendation engine may generate the menu data using a content-based filtering algorithm. In one or more exemplary electronic devices, a recommendation engine comprising a content-based filtering algorithm may be configured to generate the menu data based on one or more features of the items (e.g., based on feature extraction).

[0055] In one or more exemplary electronic devices, a recommendation engine (e.g., configured to execute an ML model) comprising the ML model may be configured to generate menu data (e.g., a food menu showing share menu recommendations) based on collaborative filtering. In one or more exemplary electronic devices, a recommendation engine (e.g., configured to execute an ML model) comprising the ML model may be configured to generate menu data based on user input associated with one or more features of the items (e.g., based on feature extraction).

[0056] In one or more exemplary electronic devices, a recommendation engine comprising an ML model (e.g., configured to execute the ML model) may be configured to generate menu data (e.g., a food menu showing share menu recommendations) based on a session-based recommender. In one or more exemplary electronic devices, a recommendation engine using a session-based recommender may be configured to generate menu data based on user input during an ongoing period (session) at a food consumption place (e.g., user input during dinner at a restaurant or at a party at a bar).

[0057] In one or more exemplary electronic devices, a recommendation engine (e.g., configured to execute the ML model) comprising the ML model may be configured to generate menu data (e.g., a cuisine menu showing share menu recommendations) based on a hybrid system (including one or more of collaborative filtering, content-based filtering, and a session-based recommender). In one or more exemplary electronic devices, a recommendation engine (e.g., configured to generate menu data) comprising the hybrid system may be configured to generate menu data.

[0058] In one or more exemplary electronic devices, the electronic device 300A, 300B is configured to control a food ordering system. Controlling the food ordering system may include generating menu data indicative of a dish menu. The dish menu may include one or more dish items, such as food items. In one or more exemplary electronic devices, the electronic device 300A, 300B may generate the menu data indicative of the dish menu using a recommendation engine. In one or more exemplary electronic devices, the electronic device 300A, 300B may generate the menu data using the detection data. In one or more exemplary electronic devices, the electronic device 300A, 300B may generate the menu data using a user input (e.g., a first user input). In one or more exemplary electronic devices, the electronic device 300A, 300B may generate the menu data using user activity information. In one or more exemplary electronic devices, the electronic device 300A, 300B may use user input, including information from the subject's associated internet service account (such as a health portal, a travel portal, a blog, and / or a food portal), to generate the menu data. In one or more exemplary electronic devices, the electronic device 300A, 300B may use historical menu data, such as user history data (such as previous visits to a restaurant, previous menus preferred by a user or user group, etc.), to generate the menu data.

[0059] In one or more exemplary electronic devices, electronic device 300A, 300B is configured to control the food ordering system (e.g., using processor circuitry 302A, 302B and / or via interface circuitry 303A, 303B) based on the menu data. In one or more exemplary electronic devices, controlling the food ordering system based on the menu data may include outputting the menu data to an electronic device, such as a user electronic device (e.g., a tablet, a display, and / or a TV). In one or more exemplary electronic devices, controlling the food ordering system based on the menu data may include outputting the menu data to food ordering device 306.

[0060] In one or more exemplary electronic devices, controlling the food ordering system based on the menu data may include transmitting and / or transmitting the menu data to an electronic device, such as a user electronic device in a kitchen of the food consumption place, when a user accepts a food menu, e.g., accepts menu data indicating a food menu by providing user input (e.g., entering acceptance of the food menu). For example, electronic device 300A, 300B may be configured to transmit and / or transmit the menu data to an electronic device configured to display the menu data, e.g., display a food menu. In that case, the contents of the prepared menu data may be provided when the dishes of the menu data are prepared. For example, electronic device 300A, 300B may be configured to transmit and / or transmit the menu data to an electronic device, such as a terminal and / or tablet, in a food preparation area (a food preparation area, e.g., a kitchen in a restaurant).

[0061] In one or more exemplary electronic devices, the menu data includes data indicating a sharing menu (e.g., a collaborative menu) for a target group. In other words, the electronic devices 300A, 300B may be configured to generate a sharing menu for a target group. The electronic devices 300A, 300B may be configured to identify one or more common cooking items and / or cooking products (e.g., ingredients, dishes, and / or beverages) preferred by subjects in the target group.

[0062] In one or more exemplary electronic devices, the electronic device 300A, 300B is configured to generate menu data indicative of a cuisine menu. The cuisine menu may include one or more cuisine items, such as food items. In one or more exemplary electronic devices, the electronic device 300A, 300B may acquire detection data indicative of the items. In one or more exemplary electronic devices, the electronic device 300A, 300B may use a recommendation engine to generate the menu data based on one or more of the detection data, subject input (e.g., user input), subject group input (user group input, e.g., input from one or more individuals in a group), and / or a detection model. In one or more exemplary electronic devices, the menu data may include a cuisine menu for a subject group. The cuisine menu for a subject group may include one or more cuisine items (e.g., food items) for each subject in the subject group. In one or more exemplary electronic devices, the cuisine menu may include a share menu for a subject group, such as a collaborative menu for a subject group. A sharing menu as disclosed herein may be considered a food menu having one or more food items to be shared for consumption among a group of subjects. In one or more example electronic devices, the menu data may include one or more sharing menus (e.g., food menus) corresponding to one or more individual subjects in the group of subjects.

[0063] In one or more exemplary electronic devices, the electronic devices 300A, 300B may obtain user activity information from a target group (e.g., from a user electronic device) and generate menu data indicating a sharing menu (e.g., a food menu) for the target group.

[0064] In one or more exemplary electronic devices, the menu data is based on the dish tracking parameters. In other words, the electronic devices disclosed herein (e.g., electronic devices 300A, 300B) may be configured to generate menu data based on the dish tracking parameters. In other words, the electronic devices 300A, 300B may be configured to track the consumption of dish items and / or dish objects by one or more subjects while the one or more subjects are eating at the dish consumption place based on detection data (e.g., based on one or more visual sensors). The dish tracking parameters may be considered parameters associated with the consumption of dish items and / or dish objects, such as the detected consumption of the dish items and / or dish objects (e.g., detected by an optical device). The dish tracking parameters may be considered to include information indicative of one or more of the following: consumption of the dish items, quantity of the dish items, portions of the dish items, state of consumption, and state of the dish items (e.g., solid, liquid, hot and / or cold). In one or more exemplary electronic devices, the optical device may dynamically monitor the consumption of the dish items by one or more subjects. The generation of menu data may be based on the number of tracked subjects, such as the group of tracked subjects. For example, if the tracking parameters are based on tracking meals from only one or two subjects, the electronic device 300A, 300B may be configured to wait a longer time before recommending menu data (e.g., recommending reorders and / or recommending ordering more food items) than if the tracking parameters are based on tracking ten subjects. In one or more exemplary electronic devices, the electronic device 300A, 300B may dynamically obtain detection data and generate a food menu. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to dynamically update the menu data based on the consumption of one or more food items.In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to dynamically suggest (e.g., by using a food item surrogate ordering system, such as by transmitting and / or displaying menu data, such as updated menu data) cuisine items (e.g., food items) to one or more subjects for consumption based on the cuisine tracking parameters. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to dynamically suggest (e.g., by using a food ordering system, such as by transmitting and / or displaying menu data, such as updated menu data) cuisine items (e.g., food items) to one or more subjects for consumption based on the cuisine tracking parameters. For example, staple dishes, such as rice, bread, and / or sauces, may be reordered in a timely manner as soon as they are emptied. Reordering of staple dishes may be based, for example, on the number of subjects monitored. For example, if the tracking parameters are based on tracking 10 subjects, the time interval for timely reordering may be longer than if the tracking parameters are based on tracking two subjects. Optionally, the user may be required to confirm a reorder to prevent unnecessary orders. An advantage of this may be to enable new types of pricing, such as being able to assign costs to leftover food to account for food waste. For example, by having menu data based on food tracking parameters, food items such as main dishes, side dishes, and / or desserts may be recommended based on the consumption of previous food items such as dishes. This may provide a food menu with balanced food combinations and / or a "taste journey" that the customer (e.g., subject) will enjoy.

[0065] In one or more exemplary electronic devices, the electronic device is configured to obtain a first user input (e.g., using the processor circuits 302A, 302B and / or via the interface circuits 303A, 303B). Obtaining the first user input may include obtaining the user input via a food ordering system, such as via the user electronic device, such as via the food ordering device 306. In one or more exemplary electronic devices, the interface circuits 303A, 303B comprise display circuitry configured to display a user interface and receive the user input. In one or more exemplary electronic devices, the electronic device 300A (e.g., the food ordering device 306) is configured to receive the first input from a user via the user interface.

[0066] The display circuitry of the electronic device 300A (e.g., food ordering device 306) may be configured to detect a first input (e.g., a touch input from a user if the display circuitry includes a touch-sensitive display), and the first input may include a contact on the touch-sensitive display. The touch-sensitive display may provide a user interface (e.g., an input interface) and an output interface between the electronic device 300A (e.g., food ordering device 306) and the user. The processor circuitry 302A of the electronic device 300A may be configured to receive and / or send electrical signals from and / or to the touch-sensitive display. The touch-sensitive display may be configured to display visual output to the user. The visual output optionally includes graphics, text, icons, video, and any combination thereof (collectively referred to as "graphics"). For example, some, most, or all of the visual output may be considered to correspond to some, most, or all of the visual output.

[0067] The processor circuit 302A of the electronic device 300A (e.g., food ordering device 306) may be configured to display one or more user interfaces, such as a user interface screen including a first user interface and / or a second user interface, on the display circuit. The user interfaces may include one or more of: a plurality of user interface objects representing a food menu; a plurality of user interface objects representing a data menu; etc. For example, the first user interface may include a first primary user interface object and / or a first secondary user interface object. The second user interface may include a second primary user interface object and / or a second secondary user interface object. The user interface objects, such as the first primary user interface object and / or the second primary user interface object, may represent food items.

[0068] The electronic device 300A and / or the food ordering device 306 may include display circuitry configured to display a user interface for receiving the first input. The user interface may include one or more user interface objects. The user interface may also be referred to as a user interface screen.

[0069] A user interface object, as used herein, refers to a graphical representation of an object (e.g., an object associated with a food item) displayed on a display circuit of the food ordering device 306 (e.g., a user electronic device). The user interface object may be user-interactive (e.g., a user-interactive food menu) and may be selectable by a first input (e.g., a user input). For example, an image (e.g., an icon), a button, and a text (e.g., a hyperlink) each optionally constitute a user interface object. A user interface object may form part of a widget. A widget may be considered a mini-application that can be used and created by a user. A user interface object may include a prompt, an application launch icon, and / or an action menu. An input, such as the first input and / or the second input, may include a touch (e.g., a tap, a force touch, a long press) and / or a contact movement (e.g., a swipe gesture for toggling, etc.). The contact movement may be detected, for example, by a touch-sensitive surface of a display circuit of the electronic device 300A and / or the food ordering device 306. Thus, the display circuit may be a touch-sensitive display. A first input (e.g., a first user input), such as the first input and / or the second input, may include a lift-off. A user input, such as the first input and / or the second input, may include a touch followed by a lift-off. In one or more example electronic devices, the electronic devices 300A, 300B may be configured to communicate menu data to a device, such as the food ordering device 306. In other words, the electronic devices 300A, 300B may be configured to cause the food ordering device 306 to display user interface objects representing the menu data.

[0070] In one or more exemplary electronic devices, the interface circuitry 303A, 303B may include a user interface, such as a touch-enabled user interface and / or tactile buttons. The subject may provide user input through a user interface of the electronic device (e.g., electronic device 300A, 300B). In one or more exemplary electronic devices, the subject may provide user input through a food ordering system (e.g., food ordering device 306). In one or more exemplary electronic devices, the subject may provide user input through a user interface on the user electronic device (e.g., by using an application on a mobile phone and / or tablet), such as providing user input indicating a selection of an object associated with a food item. In one or more electronic devices, the electronic device 300A, 300B may be configured to control the food ordering system based on the first user input.

[0071] In one or more exemplary electronic devices, the first user input includes one or more of a cuisine preference parameter, an allergy parameter, a taste parameter, a price parameter, a duration parameter, and an activity parameter.

[0072] The cuisine preference parameters may be considered to include information indicative of cuisine item preferences, such as one or more of total calorie intake, portion size, taste, food, and beverage. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to obtain a user input, such as a first user input (e.g., via the cuisine ordering device 306), such as cuisine preference parameters indicative of a user selection of a cuisine item (e.g., a food item to be consumed). In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to generate menu data indicative of a cuisine menu based on the first user input including the cuisine preference parameters.

[0073] The allergy parameters may be considered to include information indicating food items, such as foods and beverages, to which the subject is allergic. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to obtain a user input (e.g., via the food ordering device 306), such as a first user input, such as allergy parameters, indicating a food item (e.g., a food item to be consumed) to which the user is allergic. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to generate menu data indicating a food menu based on the first user input including the allergy parameters. In other words, the electronic device 300A, 300B may be configured to generate menu data indicating a food menu that does not include (e.g., omits) food items to which the subject and / or user, or group of subjects, is allergic, based on the first user input including the allergy parameters.

[0074] The taste parameters may be considered to include information indicative of a subject's taste preferences, such as spicy, mild spicy, salty, sweet, bitter, etc. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to obtain a user input (e.g., via the food ordering device 306), such as a first user input, such as a taste parameter indicative of a taste preference associated with a culinary item (e.g., a food item to be consumed). In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to generate menu data indicative of a culinary menu based on the first user input including the taste parameter. In other words, the electronic device 300A, 300B may be configured to generate menu data indicative of a culinary menu including one or more culinary items that a user and / or user group desires to consume based on the first user input including the taste parameter.

[0075] The price parameters may be considered to include information indicating a price, such as a budget limit, a price of a cuisine menu, and / or a price of a cuisine item. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to obtain a user input (through the food ordering device 306), such as a first user input, such as a price parameter indicating a price (e.g., a price of a cuisine item, such as a food item to be consumed). In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to generate menu data indicating a cuisine menu based on the first user input including the price parameter. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to generate menu data indicating a cuisine menu whose price is lower than a price set by the user based on the first user input including the price parameter. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to generate menu data indicating a cuisine menu whose price is higher than a price set by the user based on the first user input including the price parameter. In other words, the electronic devices 300A, 300B may be configured to generate menu data indicating a menu of dishes with prices equal to the price set by the user based on a first user input including a price parameter.

[0076] The duration parameter may be considered to include information indicating the time required to prepare a food item, such as the cooking time for a particular food item. The duration parameter may be considered to include information indicating the time required from "reorder" to "serve." In other words, the duration parameter may also take into account the delivery time of a food item in addition to the preparation time. For example, the duration parameter may include the total time and / or duration from when an order is placed until the ordered food item is served to the table.

[0077] In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to obtain a user input (e.g., via the food ordering device 306), such as a first user input, such as a duration parameter indicating a user selection of a time to prepare (e.g., a maximum time the user is willing to wait and / or a time the user is willing to spend at the food consumption place, such as a mealtime), and / or consume a food item (e.g., a food item to be consumed). In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to generate, based on the first user input including the duration parameter, menu data indicating a menu of dishes that can be delivered to the user for consumption within the user-selected time frame. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to generate, based on the first user input including the duration parameter, menu data indicating menu selections that can be consumed within the user-selected time frame.

[0078] Activity parameters, such as user activity parameters, may be considered to include data indicative of user activity. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to acquire activity parameters from a user electronic device, such as an armband, wristband, smartphone, smart headphones, and eyeglasses, that can provide metabolic performance information of the user. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to acquire a user input (through the food ordering device 306), such as a first user input, such as activity parameters indicative of user activity data (e.g., the user's daily activity, physical activity such as working out at the gym, etc.). In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to generate menu data indicative of a food menu based on the first user input including the activity parameters.

[0079] In one or more exemplary electronic devices, the electronic device may be configured to obtain a user input (e.g., a first user input) before a user arrives at a place (e.g., a restaurant, a food truck, a diner, a food takeout place, a food consumption place such as a bar, etc.). In one or more exemplary electronic devices, the user input (e.g., the first user input) may be indicative of a number of subjects arriving at the food consumption place. In one or more exemplary electronic devices, the user input (e.g., the first user input) may be indicative of a number of subjects at the food consumption place.

[0080] In one or more exemplary electronic devices, the menu data is based on a first user input. In other words, the electronic devices 300A, 300B may be configured to generate menu data indicating a cuisine menu based on the first user input. In one or more exemplary electronic devices, the first user input includes one or more of a cuisine preference parameter, an allergy parameter, a taste parameter, a price parameter, a duration parameter, and an activity parameter.

[0081] In one or more exemplary electronic devices, the electronic device is configured to output menu data to one or more subjects (via interface circuitry 303A, 303B). In one or more exemplary electronic devices, electronic device 300A, 300B may be configured to output menu data to one or more subjects operating food ordering device 306. In one or more exemplary electronic devices, electronic device 300A, 300B may be configured to output menu data to one or more subjects at a location (e.g., a restaurant, a diner, a food takeout place, a food truck, etc.). In one or more exemplary electronic devices, electronic device 300A, 300B may be configured to output menu data to user electronic devices (tablets, mobile phones, etc.) of one or more subjects. In one or more exemplary electronic devices, electronic device 300A, 300B may be configured to communicate menu data to a device, such as food ordering device 306. In other words, the electronic devices 300A, 300B may be configured to cause the food ordering device 306 to display user interface objects representing menu data.

[0082] In one or more exemplary electronic devices, at a food serving location (e.g., in a restaurant), an electronic device such as electronic device 300A may obtain detection data from an optical device (e.g., a camera device) indicative of items such as the number of subjects at a table. Additionally, electronic device 300A may consider additional information, such as user inputs, such as a first user input (e.g., a user preference) and user activity information (e.g., a user's metabolic capacity). Electronic device 300A may control a food ordering system to generate a food menu based on the detection data, a recommendation engine, and the additional information. Furthermore, electronic device 300A may output the food menu to one or more users, such as via food ordering device 306.

[0083] In one or more exemplary electronic devices, the electronic device is configured to obtain (e.g., using the processor circuitry 302A, 302B and / or via the interface circuitry 303A, 303B) a second user input indicating one or more of: acceptance of the dish menu, rejection of the dish menu, and modification of the dish menu (e.g., user interaction on the dish menu).

[0084] In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to obtain a user input (e.g., through the food ordering device 306), such as a second user input, such as acceptance of the food menu. Acceptance of the food menu may indicate that a user (e.g., a subject) accepts the contents of the food menu, such as accepting one or more food items included in the food menu. In one or more exemplary electronic devices, the electronic device 300A, 300B may be configured to generate a food menu based on the second user input indicating user acceptance of the food menu.

[0085] In one or more example electronic devices, the electronic device 300A, 300B may be configured to obtain a user input (e.g., through the food ordering device 306), such as a second user input, such as a rejection of the dish menu. In one or more example electronic devices, the electronic device 300A, 300B may be configured to generate a dish menu (e.g., an updated dish menu and / or a new dish menu) based on the second user input indicating the user rejection of the dish menu.

[0086] In one or more example electronic devices, the electronic device 300A, 300B may be configured to obtain a user input (e.g., via the food ordering device 306), such as a second user input, such as a change to the food menu. In one or more example electronic devices, the electronic device 300A, 300B may be configured to change the food menu based on the second user input indicating a user change to the food menu.

[0087] In one or more exemplary electronic devices, the electronic device is configured to determine (e.g., using the processor circuitry 302A, 302B) whether the menu data should be updated and / or modified based on the second user input. In other words, in response to a user input indicating a rejection and / or modification of the dish menu, the electronic device 300A, 300B may be configured to update the menu data. In one or more electronic devices, updating the menu data may include generating updated and / or new menu data based on the user input (e.g., the first user input, the second user input) and / or based on the updated detection data. In one or more electronic devices, modifying the menu data may include modifying the menu data based on the user input (e.g., the first user input, the second user input).

[0088] In one or more exemplary electronic devices, the electronic device is a server device.

[0089] In one or more exemplary electronic devices, the electronic device comprises an optical device.

[0090] In one or more electronic devices, the electronic device 300A, 300B may be configured to identify (such as by using an optical device) one or more cuisine items (e.g., food items, beverage items, etc.) ignored by one or more subjects at a food serving place (e.g., a restaurant during dinner). In one or more electronic devices, the electronic device 300A, 300B may be configured to identify one or more cuisine items (e.g., food items, beverage items, etc.) partially consumed by one or more subjects at a food serving place (e.g., a restaurant during lunch). In one or more electronic devices, the electronic device 300A, 300B may be configured to measure the quantity and / or value of one or more cuisine items ordered but not consumed (and / or partially consumed) by a user. In one or more electronic devices, the electronic device 300A, 300B may be configured to determine whether the food consumption place complies with institutional regulations (e.g., regulations from a food waste management agency, regulations from a government, etc.). In one or more electronic devices, the electronic device 300A, 300B may be configured to store one or more of the following: visits of a subject and / or subject group to a food consumption place, preferences of the subject or subject group, and food item selections of the subject or subject group. In one or more electronic devices, the electronic device 300A, 300B may be configured to store information related to menu data (e.g., operations required to produce one or more food items associated with the menu data).

[0091] In one or more electronic devices, the electronic device 300A, 300B may be configured to determine the work required to prepare one or more cuisine items based on menu data (e.g., a cuisine menu, such as a menu of food items to be consumed). In one or more examples, the electronic device 300A, 300B may be configured to generate the menu data using a recommendation engine based on user input indicating the user's cuisine consumption preferences (e.g., veganism, vegetarianism, and / or non-vegetarianism).

[0092] 2 (e.g., any one or more of S104, S106, S108, S109, S110A, S110B, S112). The operations of the electronic devices 300A, 300B may be embodied in the form of executable logic routines (e.g., lines of code, software programs, etc.) stored in a non-transitory computer-readable medium (e.g., memory circuits 301A, 301B) and executed by the processor circuits 302A, 302B.

[0093] Furthermore, the operations of the electronic devices 300A, 300B may be considered as methods that the electronic devices 300A, 300B are configured to perform. Also, while the functions and operations described may be implemented in software, such functions may also be performed via dedicated hardware or firmware, or some combination of hardware, firmware, and / or software.

[0094] The memory circuits 301A, 301B may be one or more of a buffer, flash memory, hard drive, removable media, volatile memory, nonvolatile memory, random access memory (RAM), or other suitable devices. In a typical configuration, the memory circuits 301A, 301B may include nonvolatile memory for long-term data storage and volatile memory that serves as system memory for the processor circuits 302A, 302B. The memory circuits 301A, 301B may exchange data with the processor circuits 302A, 302B via a data bus. There may also be control lines and address buses between the memory circuits 301A, 301B and the processor circuits 302A, 302B (not shown in FIG. 1). The memory circuits 301A, 301B are considered non-transitory computer-readable media.

[0095] The memory circuits 301A, 301B may be configured to store the detection data, the detection model, the recommendation engine, the first user input, and the second user input in a portion of the memory.

[0096] 2 shows a flowchart of an example method 100 performed by an electronic device according to the present disclosure. The method may be performed to recommend a share menu. The method 100 may be performed by an electronic device disclosed herein, such as the electronic devices 300A and 300B of FIG. 1.

[0097] The method 100 includes obtaining S102 detection data indicative of the item from the optical device.

[0098] In one or more exemplary methods, acquiring S102 the detected data includes acquiring first detected data and / or second detected data. In one or more exemplary methods, acquiring S102 the detected data includes acquiring the detected data from one or more optical devices at the location (e.g., optical device 304 of FIG. 1 ). In one or more exemplary methods, acquiring S102 the detected data includes acquiring data indicative of user activity information from user electronic devices (e.g., electronic devices 300A, 300B, 306 of FIG. 1 ).

[0099] In one or more exemplary methods, the method 100 includes communicating with a cooking communication system. In one or more exemplary methods, obtaining S102 the sensed data includes obtaining user activity information.

[0100] The method 100 includes controlling S110 a food ordering system based on the detected data. In one or more exemplary methods, controlling S110 the food ordering system includes displaying menu data indicating one or more food items (e.g., food items). In one or more exemplary methods, controlling the food ordering system includes displaying user interface objects representing the menu data. In one or more exemplary methods, controlling S110 the food ordering system includes controlling one or more food orders. In one or more exemplary methods, controlling S110 the food ordering system includes prioritizing preparation of dishes and / or sets of dish items for target groups. In one or more exemplary methods, controlling S110 the food ordering system includes outputting the menu data.

[0101] In one or more exemplary methods, outputting the menu data includes outputting the menu data to an electronic device, such as a user electronic device (e.g., a tablet, a display, and / or a TV). In one or more exemplary methods, outputting the menu data includes outputting the menu data to a food ordering system.

[0102] In one or more example methods, the detection data includes one or more of a subject parameter, a subject group parameter, an object parameter, a face parameter, a dish parameter, a dish tracking parameter, and a wireless sensing parameter.

[0103] In one or more exemplary methods, the method 100 includes detecting one or more items using an optical device.

[0104] In one or more example methods, the items include one or more of a food object, one or more subjects, a pose, and a face.

[0105] In one or more exemplary methods, an electronic device includes a recommendation engine.

[0106] In one or more exemplary methods, method 100 includes executing, performing, and / or operating a recommendation engine. In one or more exemplary methods, method 100 includes executing, performing, and / or operating a detection model. In one or more exemplary methods, method 100 includes executing, performing, and / or operating a trained neural network. In one or more exemplary methods, method 100 includes obtaining input from a detection model. In one or more exemplary methods, the recommendation engine and / or the detection model is a trained deep neural network. In one or more exemplary methods, method 100 includes modifying menu data, such as by using the recommendation engine.

[0107] In one or more exemplary methods, the recommendation engine is based on one or more of collaborative filtering, content-based filtering, session-based recommenders, and hybrid systems combining any one or more of these.

[0108] In one or more example methods, controlling S110 the food ordering system includes generating S110A menu data indicating a dish menu based on the detection data and using a recommendation engine. In one or more example methods, generating S110A the menu data includes generating menu data, such as a dish menu indicating shared menu recommendations, based on one or more of collaborative filtering, content-based filtering, session-based recommenders, and hybrid systems combining any one or more of these.

[0109] In one or more exemplary methods, method 100 includes controlling S110B the food ordering system based on the menu data. In one or more exemplary methods, controlling S110B the food ordering system based on the menu data may include outputting the menu data to an electronic device, such as a user electronic device (e.g., a tablet, a display, and / or a TV). In one or more exemplary methods, controlling the food ordering system based on the menu data may include outputting the menu data to a food ordering device. In one or more exemplary methods, controlling S110B the food ordering system based on the menu data may include transmitting and / or transmitting the menu data to an electronic device, such as a user electronic device in a kitchen of the food consumption place, when a user accepts a food menu, e.g., when a user accepts menu data indicating a food menu by providing user input (e.g., by inputting acceptance of the food menu). For example, method 100 may include transmitting and / or transmitting the menu data to an electronic device configured to display the menu data, such as displaying a food menu. In that case, the contents of the prepared menu data may be provided when the dishes of the menu data are prepared. For example, the method 100 may include transmitting and / or transmitting menu data to electronic devices, such as terminals and / or tablets, in a food preparation area (such as a kitchen in a restaurant).

[0110] In one or more exemplary methods, the menu data includes data indicating a sharing menu for a target group.

[0111] In one or more exemplary methods, the menu data is based on dish tracking parameters.

[0112] In one or more exemplary methods, method 100 includes obtaining S104 a first user input. In one or more exemplary methods, obtaining S104 the first user input may include obtaining the user input through a food ordering system, such as through a user electronic device, such as through a food ordering device. In one or more exemplary methods, method 100 may include displaying a user interface and receiving the user input. In one or more exemplary methods, method 100 may include receiving the first input from a user through the user interface. In one or more exemplary methods, method 100 includes obtaining one or more first user inputs from a user and / or a group of subjects.

[0113] In one or more example methods, the first user input includes one or more of a food preference parameter, an allergy parameter, a taste parameter, a price parameter, a duration parameter, and an activity parameter.

[0114] In one or more exemplary methods, the menu data is based on a first user input.

[0115] In one or more exemplary methods, the method 100 includes suggesting an item (e.g., a cooking item) to the subject.

[0116] In one or more exemplary methods, method 100 includes receiving an electrical signal from a touch-sensitive display and / or transmitting an electrical signal to a touch-sensitive display.

[0117] In one or more exemplary methods, the method 100 includes outputting S112 the menu data to one or more subjects.

[0118] In one or more exemplary methods, outputting the menu data to one or more subjects S112 may include outputting the menu data to one or more subjects operating a food ordering device. In one or more exemplary methods, method 100 may include outputting the menu data to one or more subjects at a location (e.g., a restaurant, a diner, a food takeout place, a food truck, etc.). In one or more exemplary methods, method 100 may include outputting the menu data to a user electronic device (e.g., a tablet, a cell phone, etc.) of one or more subjects. In one or more exemplary methods, method 100 may include communicating the menu data to a device, such as a food ordering device. In other words, method 100 may include causing a user interface object representing the menu data to be displayed on the food ordering device.

[0119] In one or more exemplary methods, the method 100 includes obtaining S106 a second user input indicating one or more of an acceptance of the cuisine menu, a rejection of the cuisine menu, and a change of cuisine menu. In one or more exemplary methods, the method 100 may include obtaining a user input (e.g., via a food ordering device), such as a second user input, such as an acceptance of the cuisine menu. The acceptance of the cuisine menu may indicate that a user (e.g., a subject) accepts the contents of the cuisine menu, such as accepting one or more cuisine items included in the cuisine menu. In one or more exemplary methods, the method 100 may include generating a cuisine menu based on the second user input indicating that the user accepts the cuisine menu. In one or more exemplary methods, the method 100 includes obtaining the second user input from a user group.

[0120] In one or more example methods, the method 100 includes determining S108 whether the menu data should be updated and / or changed based on the second user input.

[0121] In one or more example methods, method 100 includes updating and / or modifying menu data (e.g., a cuisine menu) based on a second user input in accordance with a determination that the menu data should be updated and / or modified.

[0122] In one or more example methods, method 100 includes stopping S109 updating and / or modifying the menu data (e.g., a cuisine menu) based on the second user input in accordance with a determination that the menu data should not be updated and / or modified. In one or more example methods, updating the menu data includes generating updated and / or new menu data based on the user input (e.g., the second user input).

[0123] In one or more exemplary methods, the electronic device is a server device.

[0124] In one or more exemplary methods, the electronic device comprises an optical device.

[0125] Examples of methods and products (electronic devices) according to the present disclosure are described in the following sections. Item 1. An electronic device (300A, 300B), A memory circuit (301A, 301B), a processor circuit (302A, 302B); interface circuits (303A, 303B); The electronic devices (300A, 300B) are obtaining detection data indicative of the item from the optical device; and and an electronic device configured to control a food ordering system based on the detected data. Item 2. The electronic device of item 1, wherein the detection data includes one or more of subject parameters, subject group parameters, object parameters, face parameters, food parameters, food tracking parameters, and wireless sensing parameters. Item 3. The electronic device of item 1 or 2, wherein the items include one or more of a food object, one or more subjects, a pose, and a face. Item 4. The electronic device according to any one of Items 1 to 3, wherein the electronic device comprises a recommendation engine. Item 5. The electronic device of Item 4, wherein the recommendation engine is based on one or more of collaborative filtering, content-based filtering, session-based recommenders, and hybrid systems combining any one or more of these. Item 6. The electronic device according to item 4 or 5, wherein controlling the food ordering system includes generating menu data indicating a food menu using a recommendation engine based on the detection data. Item 7. The electronic device of item 6, wherein the electronic device is configured to control a food ordering system based on the menu data. Item 8. The electronic device according to item 6 or 7, wherein the menu data includes data indicating a sharing menu for a target group. Item 9. The electronic device of any one of items 6 to 8, wherein the menu data is based on dish tracking parameters. Item 10. The electronic device of any one of items 1 to 9, wherein the electronic device is configured to acquire a first user input, the first user input including one or more of a cuisine preference parameter, an allergy parameter, a taste parameter, a price parameter, a duration parameter, and an activity parameter. Item 11. The electronic device of item 10, wherein the menu data is based on a first user input. Item 12. The electronic device according to any one of Items 6 to 11, wherein the electronic device is configured to output menu data to one or more subjects. Item 13. The electronic device of item 12, wherein the electronic device is configured to obtain a second user input indicating one or more of: acceptance of the dish menu, rejection of the dish menu, and change of the dish menu. Item 14. The electronic device of item 13, wherein the electronic device is configured to determine whether the menu data should be updated and / or modified based on a second user input. Item 15. The electronic device according to any one of Items 1 to 14, wherein the electronic device is a server device. Item 16. The electronic device according to any one of Items 1 to 15, wherein the electronic device comprises an optical device. Item 17. A method performed by an electronic device, acquiring detection data indicative of the article from the optical device (S102); and The method includes controlling (S110) a food ordering system based on the detected data. Item 18. The method of item 17, wherein the detection data includes one or more of subject parameters, subject group parameters, object parameters, face parameters, food parameters, food tracking parameters, and wireless sensing parameters. Item 19. The method of item 17 or 18, wherein the items include one or more of a food object, one or more subjects, a pose, and a face. Item 20. The method according to items 17 to 19, wherein the electronic device is equipped with a recommendation engine. Item 21. The method of item 20, wherein the recommendation engine is based on one or more of collaborative filtering, content-based filtering, session-based recommenders, and hybrid systems combining any one or more of these. Item 22. The method according to Item 21, wherein controlling the food ordering system (S110) includes generating menu data indicating a food menu using a recommendation engine based on the detection data (S110A). Item 23. The method of item 22, wherein the method includes controlling (S110B) a food ordering system based on the menu data. Item 24. The method according to Item 22 or 23, wherein the menu data includes data indicating a sharing menu for a target group. Item 25. The method of items 19 to 24, wherein the menu data is based on dish tracking parameters. Item 26. The method according to any one of Items 17 to 25, wherein the method includes acquiring a first user input (S104), the first user input including one or more of a food preference parameter, an allergy parameter, a taste parameter, a price parameter, a duration parameter, and an activity parameter. Item 27. The method of item 26, wherein the menu data is based on a first user input. Item 28. The method according to Items 22 to 27, wherein the method includes outputting the menu data to one or more target persons (S112). Item 29. The method of item 28, wherein the method includes obtaining (S106) a second user input indicating one or more of: accepting the dish menu, rejecting the dish menu, and changing the dish menu. Item 30. The method of Item 29, wherein the method includes determining whether the menu data should be updated and / or modified based on the second user input (S108). Item 31. The method according to Items 17 to 30, wherein the electronic device is a server device. Item 32. The method according to Items 17 to 31, wherein the electronic device comprises an optical device.

[0126] The use of terms such as "first," "second," "third," and "fourth," "primary," "secondary," and "tertiary" does not imply a particular order, but is included to identify individual elements. Furthermore, the use of terms such as "first," "second," "third," and "fourth," "primary," "secondary," and "tertiary" does not indicate order or importance; rather, terms such as "first," "second," "third," and "fourth," "primary," "secondary," and "tertiary" are used to distinguish one element from another. Note that words such as "first," "second," "third," and "fourth," "primary," "secondary," and "tertiary" are used herein and elsewhere for labeling purposes only and are not intended to indicate a particular spatial or temporal order. Furthermore, the labeling of a first element does not imply the presence of a second element, or vice versa.

[0127] It will be understood that the figures include some circuits or operations shown with solid lines and some circuits, components, features, or operations shown with dashed lines. The circuits or operations included in the solid lines are circuits, components, features, or operations included in the broadest examples. The circuits, components, features, or operations included in the dashed lines are examples that may be included in, or may be part of, circuits, components, features, or operations obtained in addition to the circuits, components, features, or operations of the solid line examples, or are additional circuits, components, features, or operations. It will be understood that these operations need not be performed in the order presented. It will also be understood that not all operations need be performed. The example operations may be performed in any order and in any combination. It will be understood that these operations need not be performed in the order presented. Circuits, components, features, or operations included in the dashed lines may be considered optional.

[0128] Other operations not described herein may be incorporated into the example operations, for example, one or more additional operations may be performed before, after, simultaneously with, or between any of the described operations.

[0129] Certain features described above as separate embodiments may also be implemented in combination in a single embodiment. Conversely, features described as a single embodiment may also be implemented in multiple embodiments separately or in any suitable subcombination. Furthermore, although features are described above as acting in a particular combination, one or more features from a claimed combination may, in some cases, be deleted from that combination, and the combination may be claimed as any subcombination or variation of any subcombination.

[0130] It should be noted that the word "comprising" does not necessarily exclude the presence of other elements or steps than those listed.

[0131] It should be noted that the word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements.

[0132] Furthermore, it should be noted that any reference signs do not limit the scope of the claims, and that examples may be implemented at least in part by both hardware and software, and that several "means," "units," or "devices" may be represented by the same item of hardware.

[0133] As used herein, language of degree, such as "approximately," "about," "generally," and "substantially," refers to a value, amount, or characteristic that is close to the stated value, amount, or characteristic that still performs a desired function or achieves a desired result. For example, the terms "approximately," "about," "generally," and "substantially" may refer to an amount that is 10% or less, 5% or less, 1% or less, 0.1% or less, and 0.01% or less of the stated amount. When the stated amount is zero (e.g., none), the ranges recited above may be specific ranges, not within a specific percentage of the value. For example, within 10 wt. / vol.% or less, within 5 wt. / vol.% or less, within 1 wt. / vol.% or less, within 0.1 wt. / vol.% or less, and within 0.01 wt. / vol.% or less of the stated amount.

[0134] The various example methods, devices, nodes, and systems described herein are described in the general context of method steps or processes that may be implemented in one aspect by a computer program product embodied in a computer-readable medium, including computer-executable instructions, such as program code, executed by computers in a network environment. The computer-readable medium may include removable and non-removable storage devices, including, but not limited to, read-only memory (ROM), random access memory (RAM), compact discs (CDs), digital versatile discs (DVDs), and the like. Generally, program circuitry may include routines, programs, objects, components, data structures, and the like that perform specified tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program circuitry represent examples of program code for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for implementing the functions described in such steps or processes.

[0135] While features have been illustrated and described, they are not intended to limit the claimed disclosure, and it will be apparent to those skilled in the art that various changes and modifications can be made without departing from the scope of the claimed disclosure. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense. The claimed disclosure is intended to cover all alternatives, modifications, and equivalents.

Claims

1. An electronic device (300A, 300B), A memory circuit (301A, 301B), A processor circuit (302A, 302B); interface circuits (303A, 303B); The electronic device (300A, 300B) obtaining detection data indicative of the item from the optical device; and configured to control a food ordering system based on the detected data; the electronic device includes a recommendation engine, and controlling the food ordering system includes generating menu data indicating a dish menu using the recommendation engine based on the detection data, and the electronic device is configured to control the food ordering system based on the menu data; the food menu data includes data indicating a sharing menu for a target group consisting of a plurality of targets, the electronic device generates, for a target group, data indicating a sharing menu for the target group using the recommendation engine based on collaborative filtering; The electronic device generates, as the share menu, a collaborative menu that collaborates with each of a plurality of subjects included in the subject group through the collaborative filtering. Electronic devices.

2. The electronic device of claim 1 , wherein the detection data includes one or more of a subject parameter, a subject group parameter, an object parameter, a face parameter, a food parameter, and a food tracking parameter.

3. The electronic device of claim 1 , wherein the items include one or more of a food object, one or more subjects, a pose, and a face.

4. The electronic device of claim 1 , wherein the recommendation engine is based on one or more of content-based filtering, a session-based recommender, and a hybrid system combining any one or more of these.

5. The electronic device of claim 2 , wherein the menu data is based on the dish tracking parameters.

6. 10. The electronic device of claim 1, wherein the electronic device is configured to obtain a first user input, the first user input comprising one or more of a cuisine preference parameter, an allergy parameter, a taste parameter, a price parameter, a duration parameter, and an activity parameter.

7. The electronic device of claim 6 , wherein the menu data is based on the first user input.

8. 8. The electronic device of claim 1, wherein the electronic device is configured to output the menu data to one or more target persons.

9. 10. The electronic device of claim 8, wherein the electronic device is configured to obtain a second user input indicating one or more of: acceptance of the dish menu, rejection of the dish menu, and modification of the dish menu.

10. The electronic device of claim 9 , wherein the electronic device is configured to determine whether the menu data should be updated and / or modified based on the second user input.

11. The electronic device of claim 1 , wherein the electronic device is a server device.

12. The electronic device of claim 1 , wherein the electronic device comprises the optical device.

13. 1. A method performed by an electronic device, the method comprising: Obtaining detection data indicative of the item from the optical device (S102); and controlling a food ordering system based on the detected data (S110). the electronic device includes a recommendation engine, and controlling the food ordering system (S110) includes generating menu data indicating a food menu using the recommendation engine based on the detection data (S110A), and controlling the food ordering system based on the menu data (S110B); the food menu data includes data indicating a sharing menu for a target group consisting of a plurality of targets, Controlling the food ordering system (S110) includes generating, for a target group, data indicating a sharing menu for the target group using the recommendation engine based on collaborative filtering; Controlling the food ordering system (S110) includes generating, as the shared menu, a collaborative menu that collaborates with each of a plurality of subjects included in the subject group through the collaborative filtering. method.

14. The method of claim 13 , wherein the detection data includes one or more of a subject parameter, a subject group parameter, an object parameter, a face parameter, a food parameter, and a food tracking parameter.

Citation Information

Patent Citations

  • Electronic apparatus

    JP2014123214A

  • Information processing apparatus and information processing program

    JP2019153073A

  • Customer service support system

    JP2019191795A

  • Information processing device, information processing method, and program

    WO2020075623A1

  • Muscle strength management system and muscle strength management method

    WO2020208945A1