SMART SERVICE AND PAYMENT SYSTEM

A machine learning-based smart service and payment system automates food recognition and payment in high-traffic food and beverage establishments, addressing long waiting times and inefficiencies by optimizing customer selection and payment processes.

TR202208003YPending Publication Date: 2026-10-21PROTEL BİLGİSAYAR ANONİM ŞİRKETİ
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
TR202208003U
Authority / Receiving Office
TR · TR
Patent Type
Utility models
Current Assignee / Owner
Filing Date
2022-05-17
Publication Date
2026-10-21
Estimated Expiration
2032-05-17

AI Technical Summary

Technical Problem

Existing food and beverage service technologies face long waiting times and inefficiencies in food selection and payment processes, particularly in high-traffic environments, due to manual data entry and lack of automated food recognition and payment systems.

Method used

A machine learning-based smart service and payment system using modular software and electronic devices for automated food recognition, invoicing, and payment, minimizing human intervention and optimizing customer selection and payment processes.

Benefits of technology

The system reduces waiting times and workload by enabling rapid food recognition and payment processing, improving operational efficiency and customer experience, especially for visually and hearing-impaired individuals, and reducing human error.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention relates to an electronic system designed to reduce potential waiting times caused by high human traffic in service areas where all types of food and beverage activities take place, such as restaurants, cafes, diners, and pastry shops, thereby decreasing the workload of businesses and minimizing human error. The fundamental characteristic of the invention is that it is an intelligent service and payment system that recognizes the food items selected by customers, automatically generates invoices, and guides customers without requiring human intervention. It is controlled and managed by modular software developed with a machine learning-based algorithm.
Need to check novelty before this filing date? Find Prior Art

Description

1 TARIFF SMART SERVICE AND PAYMENT SYSTEM Subject Matter and Technical Scope of the Invention The invention encompasses all types of food and beverage establishments such as restaurants, cafes, eateries, and pastry shops. depending on the density of people in the service areas where it is carried out reducing potential waiting times, decreasing the workload for businesses, and an electronic system designed to minimize human error It is related to the system. The fundamental characteristic of the invention is that it is based on machine learning. 10 controlled and managed via modular software developed with an algorithm without the need for a human being, characterized by electronic devices a system that recognizes the food items chosen by customers, automatically generates invoices, and serves customers It is a smart service and payment system that guides. State of the Art 15 Today, technologies for the service sector are becoming increasingly competitive within the industry. Businesses' ability to accurately predict the future and manage accordingly. by making decisions, they can be more effective in internal and external operations It is used for purposes such as ensuring that services are provided. It is a branch of the service sector and... For service areas where food and beverage activities take place, more service 20 services quality such as operations, booking, ordering and payment systems inventions that serve the main purposes of improving and reducing costs It is observed that improvements have been made. Among the mentioned improvements are service operations. They are divided into two categories: in-house and out-of-house (such as takeaway services). We can evaluate it. Improvements to internal operations; a potential 25 the process including a customer's entry into and exit from a business It encompasses all (mutually beneficial) interactions that occur. One of the operations within the business is the service offered within the business. These are inventions related to calculating the fee to be charged to the customer. 2 In the known state of the art, a fee will be collected from a customer receiving service from a service area. the fee is calculated using a price list, typically provided by a staff member (paper- (calculated manually with the help of a pen or calculator) In order to minimize the disadvantages brought about by the application, the quantity and A database management system that also includes price information, the 5 mentioned. smart devices (tablets, handheld computers, etc.) that have a technical element and are connected to systems Innovations have been developed. These innovations include improvements in operation time and human resources. They have yielded quite effective results in reducing errors; however (however intelligent Even though they may include technical elements such as devices, the products in question are still used by a human being. a 10 that will eliminate the need to manually enter data into the system They do not have the function. The aforementioned improvements are generally related to the service. The names / codes and portion sizes of the products are entered into the system one by one by a staff member. The process involves entering the information, calculating the total price, and collecting the payment. In the known state of the technology, for example in a restaurant selling with a self-service tray The cashier uses the restaurant's payment system to process the plates on the customer's tray. On the screen, you add items one by one, enter the portion sizes into the system, and the total price is displayed. They receive the payment and process it into the system. This process is done manually, especially in busy restaurants. Because it takes a long time to do, it leads to a waste of time for both customers and... This leads to customer loss when people don't want to wait. In addition to the systems mentioned above, the current state of the technology includes 20 cameras. Access neural networks are also used in these systems. These systems generally utilize access neural networks. referred to as convolutional neural networks, and the artificial intelligence model They appear to be developing. These systems are achieved through camera integration. They have advantages such as eliminating the need for cashiers. The top 25 reasons why they need a lot of data to develop models. These are the handicaps. According to the known state of the art, in a Chinese patent document numbered CN112270624A from a machine learning-based invoice recognition and generation system It is stated that the invention in question is essentially: the product selected by the customer. 30 used to define data and send product data to the processing module an identification module; product information sent by the identification module 3 to obtain, retrieve product price information based on product details, and generate payment invoices. and to send product price information and payment invoice to the payment module a processing module used to enable customers to complete their invoice payments Receiving product price information and payment invoices sent by the processing module. a payment module used for and based on the YOLO V3 neural network model visual 5 training module used for training on identifying newly introduced products It appears that a system involving [something] is being discussed. According to the known state of the art, this is a Chinese patent application numbered CN109598877A. It has been discovered. The invention in question is a cashierless payment system for different foods. (with the help of a chip placed on the bottom of the plate or dish) automatically 10 The text describes an intelligent cash register system capable of recognizing cash registers. The invention is fundamentally based on: Smart tableware that is connected to the internet, a database, or information management software. a server containing the codes and activating the smart tableware; with the aforementioned server a base station that facilitates communication between smart tableware; mentioned A standard 15 that controls an indicator light and an alarm device in contact with the server. a detachable and attachable smart module for tableware smart tableware; used to activate the aforementioned smart tableware. An activation device containing a power supply, a control board, and a sensor; a mobile phone. Code payment that can be executed via phone application, data scanning and server It is a cash register system that includes application software used to collect statistics. 20 In the known state of the art, there is an American patent numbered US2021365687A1. in the application, food is processed (in real time) using machine learning methods. from a food recognition engine that identifies and can work in conjunction with mobile devices It is mentioned that the invention in question involves food recognition operated by a processor. The engine consists of a memory communicatively connected to the processor, a multi-object detector, and 25 It includes a classifier and controls the food recognition system. The mobile device The identification process happens simultaneously with the camera being pointed at the food. This is being carried out. The food recognition engine uses food characteristics printed on the packaging. several neural network methods for identifying texts, barcodes, and logos It uses a food identification engine; packaged or unpackaged, branded or 30 It is possible to recognize and identify unbranded, labeled or unlabeled foods, and to recognize them. 4 Information about the food is displayed simultaneously on the phone screen. Users can save the defined food items (with a single swipe) without typing. In the known state of the art, there is an American patent numbered US2016163037A1. In the application, the quantity (by volume) of food on the plate and the type of food should be specified. and a 5 that estimates the nutritional value of food (carbohydrate, sugar, fat content) The system in question consists of a camera and a (light pattern) It includes a projector. It projects a light pattern onto the food using the projector. The image is projected and the resulting images are recorded by a camera. The images in question are interpreted simultaneously by the system, and both The three-dimensional shapes and volumes of the food items are calculated, as well as (image 10 (by segmenting or recognition steps) the food items in the images in question The type is estimated. The invention also includes (accessible information databases). (using) to estimate carbohydrate content and the insulin required for the user. It calculates the dose. Improvements include coding the light pattern, different light The invention includes sources and associated wavelengths, motion compensation, and additional optics. The invention is a 15 an insulin syringe, or one equipped with a test strip port, or a mobile phone. It can also be applied to the control device. In the known state of the art, a Chinese patent numbered CN109740579A describes a plate (dish). This refers to a recognition-based fast food cash register system. The system basically consists of; a server control system, a process display screen, a 20 The camera is characterized by containing a plate (dish). Smart dining. The implementation process for the recognition-based fast food cash register system is generally as follows: a CCD camera to enable real-time image collection and an image acquisition module using a video image acquisition card; a plate Image processing 25, which includes a dish recognition module and a dish processing module. The module can distinguish the type of food, including its color, and each The system's network includes a food processing module capable of matching prices for different food types. It consists of an intelligent assistant module that controls connections such as those to the database. As can be seen above, in the current state of technology, only cameras can be used to capture images. There are systems that enable the identification of foods, as well as systems that allow for the identification of foods. systems that also allow for automatic payment of the transaction They are available. These systems detect food using cameras or placed on plates (dishes) via implanted chips or through plate (dish) shapes It defines it. The main advantage of inventions existing in the prior art is that they reduce operating costs. to reduce, minimize human error and lower the bill at the checkout 5 negative consequences such as delays and customer losses due to payment queues They appear to have been developed to overcome these conditions. The aforementioned and reflecting current technology (especially in both food recognition and invoicing). The biggest disadvantage of inventions that have both functions is that they are not only... 10 based on the automatic identification of food items (foods, products) They are automated payment systems that have been created. Businesses, especially those with high traffic, long waits that cause a loss of money and time during the time intervals they occur Problems arising from time constraints, food alone (via cameras) automatic recognition and subsequent automatic invoice generation It appears that the problems, which can be summarized as follows, are far from being resolved. (Bet 15) The long waiting times experienced only occur during the payment process. not only because of the queues, but also because the customer selection process is lengthy. It also develops depending on the current state of the technology. To solve the problem, one cannot analyze the problem solely by looking at the result (calculation). Instead of trying to resolve the issue (payment stage), a customer was taken to the dining area 20 from entering, optimally selecting the food they desire, and the payment process. including the need for a system that will minimize the duration of these processes. It is seen. Technical Problems That the Invention Aims to Solve 25 The present invention is used to solve the problems mentioned in the previous section. electronic devices and the devices mentioned are based on a machine learning algorithm. It relates to a software-based management system and method that controls and manages. The invention aims to perform image processing in a food and beverage service establishment. With these technologies, data from voice recorders and electronic sensors are collected. 30 6 by evaluating and providing the customer with an optimal selection process. electronic devices that will ensure that processes are completed in the shortest possible time. The devices mentioned are controlled by modular software based on machine learning. The goal is to create and manage a service and payment system. One advantage of the invention is that the customer's preferred food items are given to a designated person. without needing to be used, the image is taken from two cameras in the system. processing and speech through software that operates according to machine learning principles the subject is food recognition that enables the automatic recognition of foods. It includes the module. One advantage of the invention is that it meets 10 of the existing technology's needs for people's food and drink. This occurs in commercial establishments such as restaurants and cafes depending on customer density. to prevent queues from forming at the bill payment point by choosing food options generating billing information simultaneously, offering customers alternatives The options are created by the food recognition module via the main module, customer Smart cash register 15, which works integrated with the recognition module and smart notification module. It includes a smart payment module that is connected to it. Another advantage of the invention is that it is particularly beneficial for individuals with hearing or visual impairments. providing customers with auditory and visual food recommendations, customers food names during food selection and the foods the customer chooses It includes a smart notification module that visually and audibly informs the customer of the price. 20 Another advantage of the invention is that it allows customers to optionally process their bill payments. through the main module that enables it to perform this using a face and voice recognition system. Integrated with a smart payment module and customer recognition via voice recorder. It includes a customer recognition module that is connected to its camera. Another advantage of the invention is that it allows a customer to be absolutely certain about purchasing a food item. 25 Identifying the customer's movements and locations until they reach the decision-making stage. The customer recognition module is integrated with the smart notification module via the main module. a smart device that operates as such and is directly connected to the cameras and sensors in the system It includes a decision module. 7 Another advantage of the invention is that it can work with a smart device, providing customers with personalized solutions. The app allows payment through the application, offering various deals such as discounts. The provider has two separate interfaces, one for operators and one for customers. It includes a service and payment application. To better understand the system described in the invention, please refer to the following 5 figures. will be used. Explaining the Figures Figure 1: The subject of the invention is the service platform in the intelligent service and payment system. It is a conceptual design representation of the electronic components found. 10 Figure 2: The invention manages the service platform in the intelligent service and payment system. and the modules included in the smart service and payment application that controls it The server, through its structure, connects the application in question to the service platform. This is a diagram illustrating the relationship between cloud computing and smart mobile devices. Figure 3 shows the flowchart illustrating the basic operation of the intelligent service and payment system that is the subject of the invention. 15 It is a diagram. Flow Process Stage Name, Section, and Part That Will Help Describe the Invention Part Reference Numbers 1- Voice recorder 20 2- Angled camera 3- Fixed camera 4- Food plate 5- Serving tray 6- Sensor 25 8 7- Display screen 8- Speaker 9- Smart cash register 10- Communication device 11 - Server 5 12- Service table 13- Customer camera 14- Cloud computing 15- Smart mobile device 16- Smart service and payment application 10 17 - Main module 18- Customer identification module 19- Food recognition module 20- Smart decision module 21- Smart notification module 15 22- Smart payment module 23- Database 24- Admin panel 100 - Registration and customer identification phase 200 - Suggestion and service phase 20 300 - Automatic food recognition stage 400 - Automatic account creation and payment stage 9 500 - Archiving stage Detailed Description of the Invention With this invention, businesses that provide food and beverage service, such as restaurants and cafes, For use, especially when selecting food and paying the bill, customer 5 to minimize waiting queues caused by high traffic density Improved food recognition and payment processing without human intervention. through software that allows it to be carried out without needing any additional resources. The aim is to create a managed electronic system. The present invention specifically targets machines. 10 controlled by modular software developed with a learning-based algorithm and a smart service and payment characterized by managed electronic devices. The system is being targeted. The invention concerns an intelligent service and payment system, a service involving electronic devices. a modular platform that manages and controls the aforementioned service platform It is characterized by two main elements: software and... The machine in question is 15. Software developed with an algorithm based on learning can be used on a computer, smartphone, or... It is a feature that can be accessed and managed with any smart device, such as a tablet. Although the invention relates to service areas such as restaurants and cafes, The system will be valid and applicable to all service services. In this respect... The images used in the file are examples for the restaurant but should not be considered binding. 20 It should be kept in mind that protection involves all systems. Figure 1 shows the service platform in the intelligent service and payment system that is the subject of the invention. The electronic components are shown in the form of a conceptual design. The aforementioned components Basically; a service desk (12), at least two sensors (6), at least one voice recorder (1), at least one dinner plate (4), at least one angle camera (2), at least one fixed camera (3), 25 a smart cash register (9), at least one display screen (7), at least one customer camera (13), at least one speaker (8), at least one communication device (10), one server (11), at least one consists of smart mobile devices (15). The subject of the invention is the service desk (12) located in the smart service and payment system. a voice recorder (1) located at the business depending on customer preference The service transmits the voices of incoming customers to the server (11) as an audio file. on the serving tray (5) and food plates (4) on the table (12) There are two cameras positioned. One of the cameras is on the serving tray 5 (5) fixed camera that views and includes the food plates (4) at a right angle. (3) the other is to place the food plates (4) preferably at an angle between 0 and 15 degrees It is an angled camera (2) that displays images. Thus, food plates (4) inside necessary for calculating both the type and volume of the food found The images are transmitted to the server (11) via the aforementioned cameras. Service 10 touch screen display (7) located on the platform, the food on the plates (4) that customers put on the serving tray (5) to the screen where their names, registered images, and prices are displayed in a coordinated manner (7) reflects. The food on the plates (4) placed on the serving tray (5) While simultaneously seen on the display screen (7), 15 from the serving tray (5) If any food plate (4) is removed, the food in question The information is simultaneously deleted from the viewing screen (7). Thus A person can instantly see the type and price of the food he puts on the serving tray (5). can be seen on the display screen (7). Display on the service platform At least one speaker (8) configured together with or separately from the screen (7) 20 There is a speaker (8) mentioned specifically for visually impaired individuals. It is used for the purpose of guiding the customer. It directs the customer to choose their food and... The service verbally informs the customer of the total cost of the food. There are two sensors (6) on the platform. The mentioned sensors (6) are magnetic. It can be a sensor, or it can be a laser sensor. The system can have up to 25 sensors, depending on preference. A magnetic sensor and a laser sensor can be used. Administrative control of electronic elements on the service platform. software located on the server (11) to which they are connected via the communication device (11) or is provided via a virtual server through cloud computing (14). Communication device (10) data sent from the server (11) other 30 on the service platform while enabling transmission to electronic devices, from devices on the mentioned platform It also transmits the data to the server (11). 11 The subject of the invention is the smart cash register (9) which is located in the smart service and payment system. electronic device main module (17) and smart payment module (22) It is managed. The smart cash register (9) accepts credit card, cash, and NFC payments. It can generate invoices by taking the data, as well as use voice and image as a separate application. registered customers (any 5) recorded in the database (23) by module (17) (without receiving payment via physical or credit card, NFC or other method) automatically It can generate physical or electronic invoices. The subject of the invention is the service desk (12) in the smart service and payment system, service metal tray (5), food plates (4) and sensors (6) are positioned on or a load-bearing structure made from raw materials of wood. 10 in the application of the invention The food tray (5) is located on the magnetic strips on it. Its position on the table can be determined. Another aspect of the invention... In the application, the position of the service tray (5) is determined by the sensors on the service table (12). (6) is detected with the help of sensors (6) and the data obtained is communicated via sensors (6) It is transferred to the device (11). 15 The subject of the invention is a voice recording device located in an intelligent service and payment system (1) Customers can record using a voice command or a button, and It sends the data it produces to the server (11) via a communication device. data to enable registered customers to receive faster service It is recorded in the database (23) located on the server (11). 20 The subject of the invention is the smart cash register in the smart service and payment system (9) customers can make payments to their accounts using credit card, NFC, or cash, or via a device. Customers can access this information via a password entered through the provided keys, according to their preference. Depending on the situation, a physical or electronic invoice is generated. These transactions... smart cash register (9) communicates with the communication device (11) and 25 on the server It is managed through the application software that is in place. The subject of the invention is the serving tray (5) in the smart service and payment system. The type of food found in the plates (4) was determined with the help of cameras. It creates a limited space for serving. The serving plates (4) Putting on or taking off the tray (5) is also captured by cameras 30 12 and the generated data is simultaneously sent to the server via the communication device (11) It is being transmitted. The subject of the invention is an intelligent service and payment system, preferably using LED, LCD or The display screen (7), which is an OLED panel, shows images of food, prices It is displayed during customer preferences. 5 The subject of the invention is the communication device (10) in the smart service and payment system the electronic devices located there transmit or receive data to the server (11) providing, the server (11) can connect to the internet and Wi-Fi, Bluetooth preferably accessible via network devices such as ADSL modem, VDSL modem, Cable modem. It is a modem or a device with similar technical specifications. 10 The subject of the invention is a server (11) in the intelligent service and payment system, a main It can be a computer, minicomputer, network computer, or personal computer, as well as a smart device. It may also be a virtual server accessed via telephone or cloud computing (14). The server in question (11) is a modular system that controls and manages the service platform. It is characterized by including application software. 15 The subject of the invention is the service desk (12) located in the smart service and payment system. positioned and depending on customer preference, customers who come to the business a voice recorder (1) that transmits its voice as a sound file to the server (11), service on the serving tray (5) and food plates (4) on the table (12) positioned and food plates (4) on the serving tray (5) on a fixed 20 camera (3), an angle camera (2), a display screen (7), the aforementioned display At least one speaker (8) configured either together with or separately from the screen (7), at least two sensor (6), smart cash register (9), communication device (10), server (11), customer camera (13) a service platform containing and managing, controlling the said service platform smart service and payment 25 which is embedded in a server (11) an electronic system that includes software (16) basically; Voice of customers managed by smart service and payment software (16) preferably recording and producing via voice command or button press. by transmitting the data to the server (11) via a communication device, the 30 13 the customer can be recognized by the smart service and payment software (16) It includes at least one voice recorder (1). Smart service and payment inside the food plates (4) managed by the software (16) a communication device (10) that records the image of food in real time by transmitting the food in question to the server (11) via smart service and 5 Foods that can be recognized by payment software (16) 90 food with a fixed camera (3) that views at a right angle of degrees an angled camera that displays an image at an angle between 0 and 15 degrees It contains at least two cameras, (2). The food plates (4) The type of food inside can be shown using both fixed and angled cameras. 10 with the help of smart service and payment software (16) to be detected creating a limited area, one fixed under the cameras and the other... at least two portable devices that can be used for carrying dinner plates It includes serving trays (5). Serving trays (5) serving table (12) Meal 15 determined by the location on the table and the location of the customers. situations where plates are placed on or removed from the serving tray its location is detected by smart service and payment software (16) It includes at least two sensors (6) that enable smart service and payment software. Data of the food on the plates placed on the serving tray checked with (16) The sample images found at the bottom show the foods individually and in total 20 a LED, LCD or OLED panel that displays prices in real time Includes display screen (7). Especially for visually impaired customers. Smart service and payment software for customers (16) at least one that allows the sounds produced by the company to be transmitted to customers. Includes speaker (8). Smart service and payment software (16) by 25 Managed customers can make account payments via credit card, NFC, or cash. or accessed via a password entered through the keys located on it. a company that generates either a physical or electronic invoice, depending on customer preference It includes smart cash register (9). With smart service and payment software (16) The electronic devices in the controlled system send data to the server (11) 30 enabling the server (11) to transmit or receive data to the internet allows connection and access via network tools such as Wi-Fi and Bluetooth. 14 preferably an ADSL modem, VDSL modem, cable modem, or similar. It includes another device with technical specifications, the communication device (10). The subject of the invention is an intelligent service and payment system containing intelligent services and a mainframe, minicomputer, network computer containing payment software (16) or a server accessible via cloud computing (14) which is a personal computer 5 (11) includes. Figure 2 shows the service platform in the intelligent service and payment system that is the subject of the invention. management included in the smart service and payment application (16) that manages and controls The configuration of the terminal (24), the main module (17) and sub-modules of the smart 10 service and payment application (16) server (11), cloud computing (14) and smart mobile A schematic drawing showing the relationship of the devices (15) is shared. The subject of the invention is smart devices. Smart service and payment application in service and payment system (16) server (11) a smart mobile device can be downloaded via a connected computer or over the internet. It can also be used via device (15). The smart service and payment in question 15 The application (16) has a management terminal (24) with two different functions. Smart management terminal (24) located in the service and payment application (16) for customers In the designed version, a customer has the application installed on a Optionally, when entering the business premises with a smart mobile device (15) By means of the communication device (10) it connects to the server (11) and is 20 by the system It is recognized. Thus, customers entering the business can use online payment, discounts, and The system offers the option to benefit from promotions that include various priorities. It is put into operation. The management found in the smart service and payment application (16) In the version of the terminal (24) designed for administrators, the administrator in question another computer or smart device connected to the server (11) on which the application is installed 25 service and payment system via mobile device (15) and management terminal (24) all administrative tasks such as manual control, access to all databases in the system It will be able to control the functions. The invention concerns electronic components located on the service platform of an intelligent service and management system. It processes the data it receives from the devices (without any external human intervention) mathematically. 30 using models with algorithms based on machine learning methods a modular system that controls and manages the service platform in question by interpreting it It is characterized by its modular software. This modular software is basically a main module (17) and sub-management terminal (24) controlled by main module (17) It includes modules. Sub-modules connected with the main module (17) mentioned; one food recognition module (19), a smart payment module (22), a smart notification module 5 (21), a customer recognition module (18) and an intelligent decision module (20) It consists of. The invention concerns managing electronic devices within an intelligent service and payment system. and smart service and payment developed based on machine learning that controls it The technical elements included in the software are basically: 10 - Directly connected to the server (11) in the smart service and payment system or cloud computing (14) connects to the virtual server via smart service and a smart mobile device (15) containing the application version of the payment software a system that allows connection with the smart service and payment system in question management terminal (24), 15 - Transmitted from electronic devices on the service platform to the server (11) The data is categorized into sub-family categories using a machine learning-based method. transmitting data received from sub-modules to modules via the server (11) by transmitting information to the devices on the platform, managing those devices, and 20 by creating a customer database (23) within the server (11) a constantly updated main module (17), - Voice recorder that records the voice of customers entering the establishment with a command (1) receiving data from the customer camera (13) from the main module (17), word 25 the subject data is audio and video data in the database (23) verified by matching, it was generated according to machine learning methods. a customer identification module (18) that sends customer data to the main module (17), - The food presented on the serving platform is 30. plate (4) and from the serving tray (5), the serving tray (5) at a right angle 16 The main camera displays data from the fixed camera (3) and the angled camera (2). The area from the module (17) with the data in question is the data in the database. by comparing foods based on machine learning methods Determining the type and quantity and sending the data it creates to the main module (17) a food recognition module (19), 5 - The customer is connected to the sensor (6) and service desk (12) on the service platform. data from the recognition module (18) and food recognition modules (19) to the main Through module (17), the field can match the data in question with the data in the database. 10 using a machine learning-based method that compares over time Determining the customer's exact preference and sending the data it generates to the main module (17) a smart decision module (20), - With the display screen (7) and speaker (8) located on the service platform connected, food recognition module (19), customer recognition module (18) and smart 15 receiving data from the decision module (20) via the main module (17), using machine learning methods that compare data with data in the database The food recommendations and visual and auditory notification data it generates are sent to the main module. (17) a smart notification module (21), - Receives data from the smart decision module (20) via the main module (17) and contains it smart systems that offer payment options to customers using machine learning methods Generating an invoice via the cash register (9) and transmitting the invoice to the main module (17) a smart payment module (22), It includes. 25 In one application of the invention, the subject of the invention is an intelligent service and payment system. Software that controls and manages electronic devices smart mobile devices (15) It is also configured as a downloadable mobile application. The application in question... It is available for download via the internet and has a user interface. Mobile 30 which is connected to the management terminal (24) contained in the software on the server (11). The application includes customer and administrator versions for various system-related administrative tasks. able to access the database (23) located on the server (11). 17 It can provide smart services and payments in another application of the invention. The software is located on a virtual server accessible via cloud computing (14). It is located there. The interface of the software in question can be accessed via a website using a phone. or access can be provided via a device such as a computer. The invention, an intelligent service and payment system, also includes a method. 5 The method shown as a flowchart in Figure 3 includes the following steps: It is characterized by its inclusion; Registration and customer identification phase (100), Proposal and service phase (200), Automatic food recognition stage (300), 10 Automatic account creation and payment stage (400), Archiving stage (500). The stages mentioned above are explained in more detail below. Registration and customer identification phase (100); Food and beverage service business When a customer enters, a 15-minute voice recorder (1) is used via the voice recorder, depending on the customer's preference. There is an option to give commands. If the customer is visiting the business for the first time, the option is given. The subject of the recording device (1) is a data server (11) containing the customer's voice information. It sends it to the smart service and payment software (16) inside. The software records the customer's voice information into the database (23). The customer informs the business If the customer has previously visited and registered, then their voice is 20. The data containing the information is again sent to the smart service and payment software within the server (11). (16) is sent. The software in question sends the audio data through the modules it contains. compares the customer information with previous records in the database (23) and Upon finding it, the registration and customer identification (100) stage is completed. Proposal and service phase (200); Smart service and payment software (16) 25 with the help of the display screen (7) and speaker (8) located on the service platform It provides visual and auditory suggestions to the customer. These suggestions are particularly... 18 This includes guiding visually impaired individuals as well as customers. The information offered will include discounts, food details, and promotional offers. Automatic food recognition stage (300); Smart service and payment in this stage. software (16) on the service platform includes angle camera (2) and fixed camera (3) With its help, the food that the customer places on the serving tray is simultaneously 5 It recognizes and displays images and prices of the food items selected by the customer, in real time. preferably via the display screen or audibly through the speaker (8). informs the customer. Automatic account creation and payment stage (400); Smart in this stage service and payment software (16) simultaneously with the customer's selection of food 10 The prices for the food items are calculated and payment is received from the customer. A physical or electronic invoice is generated. Archiving phase (500); Automatic account creation and account payment In this stage, which comes into play after stage (400), smart service and payment software (16) stores all customer information in the database (11) on the server (23) 15 It records. Industrial Application of the Invention The invention concerns an intelligent service and payment system for food and beverage establishments such as restaurants and cafes. It can be used in all businesses offering this service. 20

Claims

19 REQUESTS 1. The subject of the invention is the service desk in the smart service and payment system (12) positioned on it and depending on customer preference, coming to the business a voice recording that transmits the customers' voices to the server as an audio file (11) 5 the appliance (1), food with the serving tray (5) located on the serving table (12) positioned on the plates (4) and on the serving tray (5) food plates (4) a fixed camera (3), an angled camera (2), a display screen (7), combined with the aforementioned display screen (7) or separately configured at least one speaker (8), at least two sensors (6), smart 10 cash register (9), communication device (10), server (11), customer camera (13) a service platform and the entity that manages and controls that service platform and smart service and payment embedded within a server (11) It is an electronic system containing software (16) and its characteristic feature is; - Customer voice managed by smart service and payment software (16) preferably recording and producing via voice command or button press. by transmitting the data to the server (11) via the communication device the customer can be recognized by the smart service and payment software (16) giving at least one voice recording device (1), 20 - Food plates managed by smart service and payment software (16) (4) Simultaneously records the image of the food inside and transmit the food in question to the server (11) via the communication device (10) 25 which allows recognition by smart service and payment software (16) with a fixed camera (3) that views the food at a 90-degree right angle a device that displays the image of food at an angle between 0 and 15 degrees angle camera (2), - Fixed camera 30 showing the type of food inside the dinner plates (4) and by smart service and payment software (16) with the help of an angled camera one of them under the cameras, creating a restricted area for detection. One is stationary, and the other is portable for carrying dinner plates. at least two serving trays available (5), - The position of the serving tray (5) on the serving table (12) and the customers' 5 determining the position and placing the food plates on the serving tray or removal status of smart service and payment software (16) At least two sensors that allow detection by (6), - 10 placed on the service tray controlled by smart service and payment software (16) sample images of the food on the plates found in the database, LED display showing the individual and total prices of food items simultaneously. Display screen which is an LCD or OLED panel (7), - 15 specifically for customers, especially visually impaired customers. voices generated by smart service and payment software (16) to customers at least one loudspeaker (8) that allows transmission, - Customer accounts managed by smart service and payment software (16) Payments can be made by credit card, NFC, cash, or using the buttons on the device. 20 via a password entered through the domain and depending on customer preference a smart cash register that generates a physical or electronic invoice (9), - Located in the system controlled by smart service and payment software (16) 25 electronic devices transmit or receive data to the server (11) providing, enabling the server (11) to connect to the internet and Wi-Fi, preferably an ADSL modem, VDSL, accessible via networking devices such as Bluetooth. modem, cable modem, or other device with similar technical specifications communication device (10), - The subject of the invention is intelligent services and payment systems, including intelligent services and payment systems. a mainframe, minicomputer, network computer containing payment software (16) 21 or a server accessible via cloud computing (14) which is a personal computer (11), It is an intelligent service and management system that includes.

2. The subject of the invention is an intelligent service and payment system service table (12), service tray 5 (5), sensors (6), voice recorder (1), food plate (4), angled camera (2), fixed camera (3), smart cash register (9), display screen (7), customer camera (13), speaker (8), communication device (10), server (11) and smart mobile a service platform consisting of (15) devices and used in the food and beverage sector with a virtual 10 in server (11) or in cloud computing (14). located on the server and managing the aforementioned service platform and a modular system developed based on machine learning that controls it It includes software; - Directly connected to the server (11) in the smart service and payment system or 15 cloud computing (14) connects to the virtual server via smart service and a smart mobile device (15) containing the application version of the payment software a system that allows connection with the smart service and payment system in question management terminal (24), - Transmitted from electronic devices on the service platform to the server (11) The data is categorized into sub-family categories using a machine learning-based method. transmitting data received from sub-modules to modules via the server (11) by transmitting information to the devices on its platform, and managing those devices. by creating a customer database (23) within the server (11) 25 a constantly updated main module (17), - Voice recorder that records the voice of customers entering the establishment with a command (1) receiving data from the customer camera (13) from the main module (17), word The subject data is audio and video data in the database (23) 30 22 verified by matching, it was generated according to machine learning methods. a customer identification module (18) that sends customer data to the main module (17), - Food presented on a serving platform. plate (4) and from the serving tray (5), the serving tray (5) at a right angle 5 The main camera displays data from the fixed camera (3) and the angled camera (2). The area from the module (17) with the data in question is the data in the database. by comparing foods based on machine learning methods Determining the type and quantity and sending the data it creates to the main module (17) a food recognition module (19), 10 - The customer is connected to the sensor (6) and service desk (12) on the service platform. data from the recognition module (18) and food recognition modules (19) to the main Through module (17), the field can match the data in question with the data in the database. 15 using a machine learning-based method that compares over time Determining the customer's exact preference and sending the data it generates to the main module (17) a smart decision module (20), - With the display screen (7) and speaker (8) located on the service platform connected, food recognition module (19), customer recognition module (18) and smart 20 receiving data from the decision module (20) via the main module (17), using machine learning methods that compare data with data in the database The food recommendations and visual and auditory notification data it generates are sent to the main module. (17) a smart notification module (21), - Receives data from the smart decision module (20) via the main module (17) and contains it smart systems that offer payment options to customers using machine learning methods Generating an invoice via the cash register (9) and transmitting the invoice to the main module (17) a smart payment module (22), It is characterized by 30