Information management system, information management program, and information management method

The information management system uses AR-enabled menu boards to display detailed video content and manage customer interactions, addressing the lack of on-site service detail display, thereby increasing purchasing intent and encouraging repeat visits.

JP2026067587AActive Publication Date: 2026-04-21KOKUSHIRO CONSULTING CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
KOKUSHIRO CONSULTING CO LTD
Filing Date
2024-10-09
Publication Date
2026-04-21

AI Technical Summary

Technical Problem

Existing systems fail to effectively display product details for services offered on-site, such as in restaurants, using augmented reality (AR) techniques.

Method used

An information management system with a menu board equipped with markers or tags, linking content IDs to video content, enabling display processing units to show detailed video content on customer terminals, including store overviews and menu items, and managing customer interactions through stamp cards and accounting.

Benefits of technology

Enhances customer purchasing intent by providing detailed product information, encouraging video content viewing, and managing stamp cards to incentivize repeat visits and word-of-mouth marketing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026067587000001_ABST
    Figure 2026067587000001_ABST
Patent Text Reader

Abstract

The objective of this invention is to provide a novel system that can display product details to customers who visit stores such as restaurants. [Solution] To solve the above problems, the present invention provides an information management system for managing customer accounting information, wherein the information management system comprises an information management device and a menu board installed in the store, the information management device has a display processing unit and a database, the menu board has a plurality of menus with embedded markers or tags, the database stores content management information that links content ID or store menu ID and video content, and the display processing unit obtains the content ID or store menu ID via a customer terminal device, processes the video content to display based on the content ID or store menu ID and the content management information, and displays it on the customer terminal device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an information management system, an information management program, and an information management method.

Background Art

[0002] Conventionally, a technique for promoting products or services by associating video content with images is known, for example, as disclosed in Non-Patent Document 1.

[0003] For example, Non-Patent Document 1 describes that by utilizing AR (Augmented Reality) in a product catalog and displaying a video, the purchasing desire of customers can be enhanced.

Prior Art Documents

Non-Patent Documents

[0004]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in Non-Patent Document 1, although the purchasing desire of customers can be enhanced by displaying the details of products described in the catalog, it is not possible to display the details of products in services such as those that provide products on-site in restaurants and the like.

[0006] In view of the above situation, an object to be solved by the present invention is to provide a novel system capable of displaying product details to customers who visit stores such as restaurants.

Means for Solving the Problems

[0007] To solve the above problems, the present invention provides an information management system for managing customer accounting information, wherein the information management system comprises an information management device and a menu board installed in the store, the information management device has a display processing unit and a database, the menu board has a plurality of menus with embedded markers or tags, the database stores content management information that links content IDs or store menu IDs and video content, and the display processing unit obtains the content IDs or store menu IDs via a customer terminal device, processes the video content to display based on the content IDs or store menu IDs and the content management information, and displays it on the customer terminal device.

[0008] This structure allows customers to grasp information from video content that cannot be gleaned solely from the menu. This, in turn, can increase the purchasing intent of customers who view the video content.

[0009] In a more preferred embodiment of the present invention, the video content includes store overview content which includes an overview of the store, the store overview content includes a first store overview video content which includes information about the store and content which encourages the download of the app, and a second store overview video content which includes information about the store, the menu has a store overview field into which a code or tag is embedded for transitioning to a screen that displays the first store overview video content, and a store overview field into which the marker is embedded for displaying the second store overview video content on the screen of the app.

[0010] This configuration allows for the display of a store overview through video content, making it easy for customers to understand information that cannot be grasped from a menu alone. Furthermore, it enables appropriate prompting of customers who have viewed the video content to download the app.

[0011] In a more preferred embodiment of the present invention, the content management information includes a combination of a plurality of three-dimensional images of a three-dimensional object corresponding to the menu and the video content, and the display processing unit displays the video content based on the three-dimensional images and the content management information obtained from the customer terminal device.

[0012] By structuring the menu in this way, even when physical items are displayed, customers can view video content, which can increase their desire to purchase.

[0013] In a more preferred embodiment of the present invention, the information management device further comprises a stamp management unit, the database further stores accounting management information linked to store user identification information and stamp cards, the stamp management unit acquires the store user identification information via the customer terminal device, and updates the stamp card based on the store user identification information after the video content display processing.

[0014] This configuration allows customers who watch videos to collect stamps on a stamp card. This creates a synergistic effect where customers watch videos to collect stamps, and then watch more videos, which increases their desire to purchase.

[0015] In a more preferred embodiment of the present invention, the information management device further comprises an accounting management unit, the accounting management unit acquires store user identification information from the customer terminal device, registers accounting management information including the store user identification information and the accounting status, acquires the store user identification information and the content ID or the store menu ID from the customer terminal device, and registers new accounting management information if the accounting status of the store user identification information is completed.

[0016] This configuration allows for the management of customer accounting information for each customer, based on information that identifies store users, such as customer IDs and table IDs. This prevents problems such as mistakenly using a stamp card that has already been used for payment to manage stamp cards.

[0017] In a more preferred embodiment of the present invention, the information management system further comprises a video viewing management unit, the database stores the viewing status of the video content for each store user identification information and accounting ID, the video viewing management unit updates the viewing status of the video content after the video content has been displayed, and the display processing unit obtains a content ID or store menu ID and the store user identification information from the customer terminal device, and displays the video content based on the content ID or store menu ID, the store user identification information, the content management information, and the viewing status.

[0018] This configuration prevents problems such as customers repeatedly viewing videos they have already watched to update their stamp cards. This allows customers to view videos of various menu items, encouraging them to purchase a variety of items.

[0019] In a more preferred embodiment of the present invention, the information management device further comprises a reservation management unit and a second content identification unit, wherein the video content includes a first menu content and a second menu content, the reservation management unit acquires customer reservation information, the second content identification unit identifies the second menu content based on the reservation information, and the display processing unit displays the video content including the first menu content and the identified second menu content based on the acquired content ID or store menu ID.

[0020] By configuring the system in this way, it becomes possible to display appropriate video content to customers based on their reservation information. This can increase customers' purchasing intent.

[0021] In a more preferred embodiment of the present invention, the information management device further comprises a second content identification unit, the menu table having a store overview section with embedded markers or tags, the video content comprising a store content ID, store overview content including an overview of the store, and store detail content including content about the store's recommended menu items, the second content identification unit identifies the store detail content based on the store content ID obtained from the menu table via the customer terminal device and the store's sales information, and the display processing unit displays the store overview content and the identified store detail content based on the store content ID obtained from the menu table by the customer terminal device and the content management information.

[0022] By configuring the system in this way, it becomes possible to display appropriate video content to customers based on the store's sales information. This allows for the display of video content that is optimal for the store, thereby increasing customer purchasing intent.

[0023] In a more preferred embodiment of the present invention, the information management device further comprises an accounting management unit and a second content identification unit, wherein the video content includes a first menu content and a second menu content, the accounting management unit acquires accounting information including a combination of a table ID and customer order information, the second content identification unit acquires the table ID from the customer terminal device and identifies the second menu content based on the order information corresponding to the table ID, and the display processing unit processes the video content including the first menu content based on the content ID or the store menu ID and the identified second menu content.

[0024] By configuring the system in this way, it becomes possible to display appropriate video content to customers based on their order information. This allows the system to show customers the menu items they are looking for, thereby increasing their purchasing intent.

[0025] In a more preferred form of the present invention, the information management device further includes a reservation management unit. The reservation management unit acquires reservation information including a customer ID, the database stores the customer ID and the stamp card associated therewith, and the stamp management unit identifies the stamp card to be updated based on the customer ID acquired based on the new reservation information.

[0026] With this configuration, the customer's stamp card can be managed by the customer ID. As a result, even if the stamp card cannot be fully filled up in a single accounting, the stamp card can be reused and saved.

Effects of the Invention

[0027] The present invention can provide a novel system capable of displaying details of products to customers who visit stores such as restaurants.

Brief Description of the Drawings

[0028] [Figure 1] It is a diagram of the business model in an embodiment of the present invention. [Figure 2] It is a system configuration diagram in an embodiment of the present invention. [Figure 3] It is an example of a menu list in an embodiment of the present invention. [Figure 4] It is an example of a menu list in an embodiment of the present invention. [Figure 5] It is a hardware configuration diagram of the information management device in an embodiment of the present invention. [Figure 6] It is a functional block diagram of the system in an embodiment of the present invention. [Figure 7] It is a sequence diagram showing the information management process in an embodiment of the present invention. [Figure 8] It is a sequence diagram showing the information management process in an embodiment of the present invention.

Modes for Carrying Out the Invention

[0029] The information management system of the present invention will be described below with reference to the drawings. Note that the embodiments shown below are examples of the present invention, and the present invention is not limited to these embodiments; various configurations can be adopted.

[0030] For example, in this embodiment, the configuration and operation of the information management system will be described, but similar configurations, devices, computer programs, etc., can achieve similar effects. Furthermore, the program may be stored on a recording medium. Using this recording medium, the program can be installed on a computer, for example, thereby configuring an information management device and an information management system. Here, the recording medium on which the program is stored may be a non-transient recording medium such as a CD-ROM.

[0031] <1. Overview of the Invention> This invention relates to a system for managing information on menus installed in restaurants and other food establishments, in order to realize a business model that encourages repeat customer visits and word-of-mouth marketing. Figure 1 is an overview diagram of this business model.

[0032] In this invention, restaurant staff upload video content related to the restaurant's menu and welcome board, as well as images for displaying the video content, to the information management device according to the present invention. An ID for displaying the video content is then issued, an intermediary acquires the ID and the AR display image, and embeds the ID and AR display image in a predetermined location on the menu. In this embodiment, embedding the ID in a predetermined location on the menu means providing the menu with an AR display image corresponding to the ID for displaying the video content, an NFC (Near Field Communication) tag that transmits the ID, and a 2D code corresponding to the ID. In this embodiment, the store overview section of the menu has the AR display image, NFC tag, and 2D code embedded, and the AR display image is embedded for specific menu items on the menu. Specifically, among the multiple menu items included in the menu, the AR display image is embedded for the menu items recommended by the store, and the NFC tag is embedded for the other menu items. Alternatively, the AR display image may be embedded for all menu items.

[0033] Then, customers who visit the store can use their terminal to obtain the ID embedded in the menu and view the corresponding video content. In this embodiment, if the ID is obtained via an NFC tag or 2D code corresponding to the store overview section, video content will be displayed that shows the store overview and prompts the customer to download an application that can read AR display images. The customer then uses the downloaded application to obtain the ID via the AR display image corresponding to the menu and view the video related to that menu.

[0034] Customers earn one stamp by viewing video content, and can participate in a lottery once they collect a predetermined number of stamps. They can then receive a prize by showing the screen displaying the winning voucher to a store employee. In this embodiment, each customer can participate in the lottery once, but it may also be possible for each group to participate once.

[0035] Furthermore, the menu in this embodiment is a menu originally installed in the store with AR display images, NFC tags, and 2D codes embedded within it. Alternatively, it may be a separate menu from the one originally installed in the store.

[0036] <2. System Configuration> Figure 2 is a block diagram showing the configuration of a system in one embodiment. As shown in Figure 2, the information management system 0 comprises an information management device 1, a customer terminal device 3, a store management system 4, an intermediary system 5, and a menu 6. The information management device 1, the customer terminal device 3, the store management system 4, and the intermediary system 5 are configured to communicate with each other via a communication network NW. In this embodiment, the communication network NW is an IP (Internet Protocol) network, but there are no restrictions on the type of communication protocol, nor on the type or size of the network.

[0037] As the information management device 1, a general-purpose server computer or personal computer can be used. Furthermore, as the customer terminal device 3, a personal computer, smartphone, tablet, or wearable device can be used. The information management device 1 may also be composed of multiple computers capable of sending and receiving information via a communication network NW or another network.

[0038] The store management system 4 stores store accounting information, reservation information, and sales information in the store database. Accounting information refers to accounting information managed by a store. This accounting information includes an accounting ID that uniquely identifies the account, order information, table ID, accounting status (completed / incomplete), and the date and time of the accounting. Reservation information refers to information related to restaurant reservations. This information includes a reservation ID that uniquely identifies the reservation, the reservation status (reserved / cancelled, etc.), customer attributes (number of people, male / female, adult / minor, etc.), a customer ID that identifies the customer's account in the reservation app, and the reservation date. Sales information is based on accounting data for each store. The sales information includes total sales, sales information by menu item, and a specified aggregation period. The sales information by menu item includes a menu ID that uniquely identifies the menu item, and the total sales amount for each individual item.

[0039] Menu 6 is a printed document provided on each table in the restaurant that displays multiple menus. Figures 3 and 4 show an example of Menu 6 in this embodiment. In this embodiment, Menu 6 includes a restaurant description section W11 for outputting a description of the restaurant, a menu display section W12 for displaying multiple menus, a lottery explanation section W13 for providing an explanation about the lottery, and a posting prompt section W14 for encouraging customers to post photos of the menus they have taken to social media.

[0040] The store description section W11 has a store description field for describing the store's overview. The store description field has a store content ID embedded in it that corresponds to the store video content that displays information about the store. In this embodiment, store video content translated into multiple languages ​​is registered, and the store content ID corresponding to the store video content in each language related to the store description is embedded. The store description field also has a field with a code or tag embedded for transitioning to a screen that displays the first store description video content, which will be described later, and a field with an AR display image embedded for displaying the second store description video content, which will be described later, on the app screen.

[0041] In the menu display section W12, a combination of the store ID and menu ID of the menu video content related to the menu, or an AR display image (image or photo related to the menu) corresponding to the menu content ID, or an NFC tag is embedded. In the illustrated example, AR display images for four menu items are displayed as the store's recommended menu items.

[0042] The lottery explanation section W13 displays the procedure for conducting the lottery, a 2D code for displaying the lottery screen, and multiple prizes. In this embodiment, the lottery starts when a predetermined number of stamps are collected and the 2D code is read by the customer terminal device 3. Alternatively, a lottery image may be used instead of the 2D code for conducting the lottery.

[0043] In the posting prompting section W14, text encouraging customers to post on social media and store-specific frames that can be added to the captured images are displayed. In this embodiment, by launching the application according to the present invention and taking a picture of the menu, the frame corresponding to the store is automatically added to the captured image.

[0044] <3. Hardware Configuration of the Invention> Figure 5 is a hardware configuration diagram of the information management system 0. As shown in Figure 5(a), the server 10 (information management device 1) comprises a processing unit 101, a storage unit 102, and a communication unit 103.

[0045] The processing unit 101 has one or more processors, such as a CPU, capable of executing instruction sets, and controls the entire operation process of the information management device 1 by executing the information management program, OS, and other applications according to the present invention. The memory unit 102 includes a volatile memory such as RAM capable of storing instruction sets, and a non-volatile recording medium such as an HDD or SSD capable of recording the OS and the information management program according to the present invention. The communication unit 103 has a communication interface device with the communication network NW, and performs communication control with the communication network NW to input and output information.

[0046] As shown in Figure 5(b), the terminal device 9 (customer terminal device 3) includes a processing unit 91, a storage unit 92, a communication unit 93, an input unit 94, and an output unit 95.

[0047] The processing unit 91 has one or more processors, such as a CPU, capable of executing instruction sets, and controls the entire operation process of the terminal device 9 by executing the OS and other applications. The memory unit 92 includes volatile memory such as RAM that can store instruction sets, and non-volatile recording media such as HDDs or SSDs that can store the OS, etc. The communication unit 93 has a communication interface device for connecting to a network and performs communication control with the communication network NW to input and output information. The input unit 94 has an input device capable of input processing, such as a keyboard or a touch panel. The output unit 95 has a display device capable of display processing, such as a display.

[0048] <4. System Functional Configuration> Figure 6 is a functional block diagram of the information management device 1. As shown in Figure 6, the information management device 1 comprises a content management unit 11, an accounting management unit 12, a video viewing management unit 13, a reservation management unit 14, a frame management unit 15, a linkage unit 16, a stamp management unit 17, a second content identification unit 18, a user registration unit 19, a display processing unit 20, and a database 2. This represents the concrete realization of information processing by software (stored in the storage unit 102) by hardware (processing unit 101).

[0049] In this embodiment, the system configuration is a so-called server-client type, where the client receives the processing results performed by the information management device 1 (server) in response to a request from the customer terminal device 3 (client). Alternatively, it may be a so-called standalone type, where the client terminal starts the information management program. In this case, the customer terminal device 3 may include some or all of the functional components (parts) of the information management device 1. For example, the customer terminal device 3 may include a content management unit 11, a video viewing management unit 13, a frame management unit 15, a stamp management unit 17, a second content identification unit 18, a user registration unit 19, and a display processing unit 20, and the information management device 1 may function as a device that acquires and stores various information from the store management system 4.

[0050] <4.1. Database 2> Database 2 stores content management information, accounting management information, video viewing management information, frame management information, customer collaboration information, and stamp management information.

[0051] <4.1.1. Content Management Information> The content management unit 11 registers content management information related to the video content displayed to customers in database 2. This content management information includes store content management information and menu content management information.

[0052] <4.1.1.1. Store Content Management Information> Store content management information refers to information about store video content related to the store's description. This information includes a store content ID that uniquely identifies the store video content, store identification information (store ID or store name), language type, video content, AR display image, and update date. The video content can be a video file or a file that plays moving images (displays animation). The following explanation will use the store ID as the store identification information.

[0053] The store video content includes store overview content about the store's overview and store detail content about the store's recommended products. Furthermore, the store overview content uses a first store overview video content that includes information about the store and content that encourages app downloads, and a second store overview video content that also includes information about the store. In this embodiment, the store detail content is stored in association with the menu ID. In other words, for each menu, store detail content that is introduced as a recommended product is stored.

[0054] In this embodiment, store content management information is stored for each store ID and each language type. However, the language type does not need to be registered; in this case, it is stored for each store ID.

[0055] <4.1.1.2. Menu Content Management Information> Menu content management information refers to information about menu video content related to the menus of each store. The menu content management information includes a menu content ID that uniquely identifies the menu video content, a store ID, a menu ID, the video content itself, an AR display image, and an update date. In this embodiment, a one-to-one correspondence is registered between the menu content ID and the combination of the store ID and menu ID. Hereafter, the combination of the store ID and menu ID will be referred to as the store menu ID.

[0056] Furthermore, the menu video content will consist of a first menu content and a second menu content. The first menu content will display content related to each menu item, corresponding to the menu ID obtained from the customer. The second menu content will consist of content related to menu items that are ordered together with the menu items displayed in the first menu content, and content related to appropriate menu items based on customer attributes.

[0057] Furthermore, the content management unit 11 registers a combination of multiple three-dimensional images of a three-dimensional object corresponding to a menu item, and video content, as menu content management information. The content management unit 11 receives multiple images from a staff member, each taken from a different angle of a three-dimensional object for a menu item (for example, sake or wine), and registers menu content management information that links these multiple images with the menu ID of the menu item.

[0058] In a preferred embodiment of the present invention, menu content management information may be stored for each language type. That is, a one-to-one correspondence is registered between the menu content ID and the store content ID and menu ID.

[0059] In this embodiment, the menu is a single product, but it may also be a product group containing multiple products. Examples of product groups include courses, sets, and variations.

[0060] Furthermore, in the following, when it is not necessary to distinguish between store content IDs and menu content IDs, they will be collectively referred to as content IDs.

[0061] <4.1.2. Accounting Management Information> The accounting management unit 12 registers accounting management information related to customer accounting managed by the information management device 1 in the database 2. In this embodiment, the accounting management unit 12 obtains the accounting ID, store user identification information, store ID, and accounting status from the store management system 4, and registers the accounting management information, including stamp cards. Here, the store user identification information may be a user ID to identify the app user, a terminal ID to identify the customer terminal, a customer ID managed by the store management system 4, or a table ID to identify the store's table.

[0062] <4.1.3. Video Viewing Management Information> The video viewing management unit 13 registers video viewing management information regarding the history of video content viewed by the customer in the database 2. The video viewing management unit 13 obtains store user identification information and content ID from the customer terminal device 3 and registers the store user identification information, content ID, viewing status, and viewing date as video viewing management information for each accounting ID. Note that a user ID may be used instead of the accounting ID.

[0063] In a preferred embodiment of the present invention, the video viewing management unit 13 may register the exit timing for each content ID as video viewing management information.

[0064] <4.1.4. Frame Management Information> The frame management unit 15 registers frame management information regarding the frames set on menu photos taken by customers in the database 2. The frame management unit 15 receives input from the user regarding the setting of frame content and registers the frame ID, which uniquely identifies the frame, and the frame content linked to the store ID as frame management information. Here, the frame content can include the frame image and frame text, etc.

[0065] In a preferred embodiment of the present invention, frame management information including a frame ID and frame content may be stored for each menu ID.

[0066] <4.1.5. Customer Linkage Information> The linking unit 16 states that customer linking information is information related to linking customers together. Customer linking information is stored with multiple customer IDs that uniquely identify each customer linked together. In this embodiment, the linking unit 16 obtains the customer ID of the first customer included in the reservation information from the store management system 4, receives the user ID of the first customer from an external SNS (Social Networking Service), and stores the customer ID and user ID linked together. Then, when the linking unit 16 receives the user ID of the second customer linked to the first customer from the external SNS, it stores the customer ID of the second customer obtained from the store management system 4 linked with the customer ID of the first customer.

[0067] <4.1.6. Stamp Management Information> The stamp management unit 17 registers stamp management information for each customer's stamp card in the database 2. It obtains the customer ID from the reservation information in the store management system 4 and registers stamp management information linked to the stamp card with that customer ID.

[0068] <4.2. Video Viewing Management Section 13> The video viewing management unit 13 updates the viewing status of the viewed video content. The video viewing management unit 13 identifies the video content displayed on the customer terminal device 3 and changes the viewing status of the video content to "viewed".

[0069] Furthermore, the video viewing management unit 13 identifies video content that needs updating based on the timing of when users abandon viewing the video content. The video viewing management unit 13 aggregates the abandonment timing for each content ID in the video viewing management information and identifies video content that has been abandoned more than a predetermined number of times among the video content corresponding to that content ID. The video viewing management unit 13 then sends a notification to the store management system 4 that the identified video content will be updated.

[0070] <4.3. Frame Management Section 15> The frame management unit 15 identifies the frame to be displayed on the customer terminal device 3. The frame management unit 15 obtains the store ID from the customer terminal device 3, identifies the frame to be displayed based on the store ID and frame management information, and transmits it to the customer terminal device 3.

[0071] In a preferred embodiment of the present invention, the frame management unit 15 identifies the frame to be displayed based on the order information obtained from the store management system 4. Specifically, the frame management unit 15 obtains the menu ID from the order information and, based on the menu ID and frame management information, identifies the frame to be displayed that relates to the menu corresponding to the menu ID.

[0072] <4.4. Stamp Management Department 17> The stamp management unit 17 updates the stamp card after the video content is displayed. The stamp management unit 17 obtains store user identification information from the customer terminal device 3 and updates the stamp card based on the store user identification information after the video content is displayed.

[0073] Furthermore, the stamp management unit 17 updates the stamp cards based on customer linkage information. When the first customer views video content, the stamp management unit 17 updates the stamps on the stamp cards linked to the second customer, who is linked to the first customer, via the customer linkage information.

[0074] <4.5. Second Content Identification Section 18> The second content identification unit 18 identifies the second content included in the video content. The second content identification unit 18 identifies the store details content as the second content. The second content identification unit 18 identifies the store details content using sales information obtained from the store management system 4. Specifically, the second content identification unit 18 uses the menu-specific sales information obtained by the accounting management unit 12 from the store management system 4 to identify the menu ID with the highest total individual sales. Then, the second content identification unit 18 identifies the video content corresponding to that menu ID as the store details content. The accounting management unit 12 may also register the sales information in the database 2, linked to the accounting management information.

[0075] In addition, the second content identification unit 18 identifies second menu content as second content, which is menus that are ordered together with the menus displayed in the first content. The second content identification unit 18 identifies second menu content using order information obtained from the store management system 4. Specifically, the second content identification unit 18 uses a correspondence table containing menu sets to identify other menus that correspond to the menus included in each order of the order information obtained by the accounting management unit 12 from the store management system 4, and identifies the video content corresponding to those menus as second menu content.

[0076] Alternatively, instead of a correspondence table, a learning model may be used that outputs a set of menus using the menus included in each order of the order information as training data. Furthermore, the accounting management unit 12 may register the order information in the database 2, linking it to the accounting management information.

[0077] Furthermore, the second content identification unit 18 identifies second menu content, which is appropriate for the customer attributes, as second content. The second content identification unit 18 identifies second menu content using customer attributes from reservation information obtained from the store management system 4. Specifically, the second content identification unit 18 uses a correspondence table including combinations of customer attributes and menus to identify menus corresponding to customer attributes from reservation information obtained by the reservation management unit 14 from the store management system 4, and identifies video content corresponding to those menus as second menu content. For example, if there are many customers, a menu that can be eaten by a large group will be selected, and if there are children among the customers, a menu that children like will be selected.

[0078] Alternatively, instead of a correspondence table, a learning model may be used that outputs menus according to customer attributes, using customer attributes and order information obtained from the store management system 4 as training data. Furthermore, the reservation management unit 14 may register reservation information in the database 2, linking it to accounting management information.

[0079] Furthermore, in a preferred embodiment of the present invention, video content related to recommended menus can be displayed according to the time of video viewing. Specifically, the second content identification unit 18 uses a correspondence table of time and menu to identify recommended menus based on the date on which the content ID or store menu ID was obtained from the customer terminal device 3, and identifies the video content corresponding to that menu as the second menu content.

[0080] Alternatively, instead of a correspondence table, the video viewing management unit 13 may use a learning model that outputs menus using the viewing time of the video and the menu registered as video viewing management information as training data.

[0081] <4.6. User Registration Section 19> The user registration unit 19 receives and registers user information from customers, which is managed on an application capable of reading AR display images. The user registration unit 19 also receives user information input from customers who have viewed the first store overview video content and registers it in database 2.

[0082] <4.7. Display Processing Unit 20> The display processing unit 20 processes the video content for display based on the content management information and displays the display processing result on the customer terminal device 3. The display processing unit 20 processes the video content associated with the content ID or store menu ID obtained from the customer terminal device 3, as well as the content management information. Furthermore, the display processing unit processes the video content, which is associated with the content ID or store menu ID, as the first video content, and displays video content including the first video content and the second content identified by the second content identification unit 18.

[0083] Furthermore, the display processing unit 20 processes video content based on the image of the three-dimensional object acquired from the customer terminal device 3. Based on the acquired image of the three-dimensional object and the menu content management information, the display processing unit 20 identifies the video content associated with the image corresponding to the acquired image of the three-dimensional object and processes the video content for display.

[0084] The display processing unit 20 processes the video content based on the content ID or store menu ID, content management information, store user identification information, and video viewing management information. Specifically, the display processing unit 20 obtains the content ID or store menu ID and table ID from the customer terminal device 3, identifies the video content corresponding to the content ID or store menu ID, and processes the video content to display if the viewing status of the video content corresponding to the table ID is not already viewed. Note that a user ID may be used instead of a table ID.

[0085] In a preferred embodiment of the present invention, menu video content is displayed in the same language as the video displayed in the store video content. Specifically, the display processing unit 20 obtains a store content ID from the customer terminal device 3 and processes the store video content corresponding to the store content ID to display. The display processing unit 20 then obtains a menu ID from the customer terminal device 3, identifies the menu video content corresponding to the menu ID and the obtained store content ID, and processes it to display as video content.

[0086] <5. Processing Flow> Referring to Figures 7 and 8, an information management method using the information management system 0 according to the present invention will be described. Figures 7 and 8 are flowcharts showing the process from registering content management information to displaying video content and updating accounting management information. The process related to the information management method in this embodiment is broadly divided into pre-processing (A), accounting processing (account registration) (B), and accounting processing (accounting management) (C).

[0087] <5.1. Pre-processing (A)> In pre-processing (A), a restaurant employee operates a store terminal device in the store management system 4, which is used to register content management information in database 2.

[0088] First, in step SA1 (hereinafter referred to as "step SXX" or "SXX"), the information management device 1 receives video content, store ID, menu ID, AR display image, and language type from the store management system 4. In this embodiment, the store management system 4 receives input from the staff of each restaurant, including menu video content and store video content as video content, as well as store ID, menu ID, language type, and AR display image, and transmits this information to the information management device 1.

[0089] In SA2, the information management device 1 registers content management information. In this embodiment, the content management unit 11 registers store content management information based on the store video content, store ID, AR display image, and language type transmitted in SA1. Specifically, the content management unit 11 generates store video content translated into the language type based on the store video content and language type, and registers the translated video content in association with the language type.

[0090] Furthermore, the content management unit 11 registers menu content management information based on the menu video content, store ID, menu ID, and AR display image transmitted by SA1.

[0091] In SA3, the information management device 1 transmits the content ID. In this embodiment, the information management device 1 transmits the store content ID of the store content management information and the menu content ID of the menu content management information registered in SA2 to the store management system 4.

[0092] In SA4, the store management system 4 transmits the content ID, store ID, menu ID, and AR display image. In this embodiment, the store management system 4 transmits the store content ID and menu content ID acquired in SA3, the store ID, the menu ID, and the AR display image to the intermediary system 5.

[0093] After the processes SA1-4 described above are executed, the intermediary can obtain a content ID or store menu ID for displaying the video content, and an AR display image. The intermediary then embeds the content ID or store menu ID and the AR display image into menu 6 and provides the menu to the restaurant. Subsequently, the following accounting processes are performed at the restaurant.

[0094] <5.2. Accounting Procedures (Account Registration) (B)> In the accounting process (account registration) (B), the process is executed for customers who have not downloaded an app capable of reading AR-displayed images to register an account by viewing in-store video content.

[0095] <5.2.1. Registration of Accounting Management Information> First, in SB1, the store management system 4 registers accounting information in the store database. In this embodiment, the store management system 4 receives the table ID of a customer who has visited the store and registers the accounting information.

[0096] In SB2, the accounting management unit 12 receives accounting information from the store management system 4. In this embodiment, the accounting management unit 12 receives the accounting ID, table ID, and accounting status from the accounting information. Alternatively, the customer ID from the reservation information may be received instead of the table ID.

[0097] In SB3, the accounting management unit 12 registers accounting management information in database 2. In this embodiment, the accounting management unit 12 registers accounting management information including stamp cards, in addition to the accounting ID, table ID, and accounting status obtained in SB2. Specifically, the accounting management unit 12 registers accounting management information corresponding to the obtained table ID when the accounting status of the accounting management information corresponding to the table ID is completed. If the customer ID and user ID are registered in association, the accounting management information including the customer ID may be registered instead of the table ID.

[0098] Furthermore, the accounting management unit 12 may obtain an accounting ID from the store management system 4 and a table ID from the customer terminal device 3, and register accounting management information that includes the accounting ID and table ID, and whose accounting status is incomplete.

[0099] <5.2.2. User Information Registration> In SB4, the customer terminal device 3 obtains the store content ID. In this embodiment, customers who have not downloaded an app capable of reading AR display images obtain the store content ID by using the customer terminal device 3 to read the 2D code provided on the menu 6, or by performing near-field wireless communication with the NFC tag provided on the menu 6.

[0100] In steps SB5-8, the display processing unit 20 processes the video content for display. In this embodiment, the display processing unit 20 receives the store content ID acquired in step SB4 from the customer terminal device 3 (SB5), identifies the store video content associated with the store content ID (SB6), transmits the display processing result to the customer terminal device 3 (SB7), and displays the video content (SB8). In this embodiment, the displayed store video content includes a store overview video content and store detail content, which are store overview content corresponding to the store overview field in which a 2D code or NFC tag is embedded.

[0101] Then, in the first video content of the store overview, a prompt is displayed to download an app that can read AR display images. The customer downloads the app accordingly, and the following process is executed.

[0102] In SB9 to SB11, the user registration unit 19 receives user information from customers who have viewed the first store overview video content and registers the user information. In this embodiment, the customer terminal device 3 receives input from the user, including the username, contact information, and user attributes (SB9), and the user registration unit 19 receives this information (SB10) and registers the user information, including this information and the user ID, in the database 2 (SB11).

[0103] Once processes SB1-SB11 are executed, it becomes possible to execute the following processes for managing the stamp card.

[0104] <5.3. Accounting Procedures (Accounting Management) (C)> In accounting processing (accounting management) (C), the process is executed from the time that the menu video content is displayed to the customer who visits the restaurant until the accounting management information is updated (see Figure 8).

[0105] <5.3.1. Displaying Video Content> In SC1, the customer terminal device 3 obtains store user identification information and a store menu ID or content ID. In this embodiment, the customer terminal device 3 obtains a table ID and a store menu ID or content ID as store user identification information by reading the AR display image provided on the menu table 6 using a dedicated application. Note that if a user ID is used as store user identification information, it is not necessary to obtain a table ID.

[0106] In SC2-5, the display processing unit 20 processes the video content for display. In this embodiment, the display processing unit 20 receives the table ID and store menu ID or content ID obtained in SC1 from the customer terminal device 3 (SC2), identifies the menu video content associated with the store menu ID or content ID (SC3), transmits the display processing result to the customer terminal device 3 (SC4), and displays the video content (SC5).

[0107] In SC6-7, the stamp management unit 17 updates the stamp card. In this embodiment, the stamp management unit 17 receives notification from the customer terminal device 3 that the menu video content has finished displaying (SC6). The stamp management unit 17 then identifies the stamp card associated with the table ID obtained in SC2 and updates the stamp card to add one stamp to it (SC7). If a user ID is associated instead of a table ID, the stamp card associated with the user ID obtained in SC2 may be updated.

[0108] In this embodiment, the stamp management unit 17 increases the number of stamps by one when a menu video content is viewed. Alternatively, the stamp management unit 17 may change the number of stamps increased depending on the viewed menu video content. In this case, the number of stamps to be increased is registered in the content management information and linked to the menu content ID, and the stamp management unit 17 uses the content ID of the menu video content identified in SC3 to determine the number of stamps to be increased.

[0109] In SC8, the video viewing management unit 13 updates the video viewing management information. In this embodiment, the video viewing management unit 13 updates the viewing status of the video viewing management information corresponding to the menu video content identified in SC3 and the table ID obtained in SC2 to "viewed".

[0110] As described above, by repeating steps SC1 to SC8, the customer can collect a predetermined number of stamps and participate in a prize draw. In this embodiment, a stamp is collected and the viewing status is updated when the menu video content is played to completion. Alternatively, the display processing unit 20 may display an icon for collecting stamps after a predetermined viewing time, and when the icon is pressed, a stamp may be collected and the viewing status may be updated.

[0111] Furthermore, if stamp management information is registered, the stamp management unit 17 updates the stamp cards included in the stamp management information. Specifically, the store management system 4 registers accounting information linked to the customer ID and table ID of the reservation information in the store database, and the accounting management unit 12 acquires this accounting information and registers it in database 2. Then, the stamp management unit 17 identifies the stamp card linked to the table ID acquired in SB4 and the customer ID corresponding to that customer ID, and updates it.

[0112] <5.3.3. Payment Processing> In SC9-10, the store management system 4 executes the payment processing. In this embodiment, the store management system 4 executes the payment processing based on cash, credit card payment, or electronic payment (SC9) and updates the accounting status of the accounting information (SC10).

[0113] In SC11-12, the accounting management unit 12 updates the accounting management information. In this embodiment, the accounting management unit 12 obtains the accounting ID from the store management system 4 among the accounting information for which settlement processing was performed in SC9 (SC11), and updates the accounting status of the accounting management information corresponding to the accounting ID to "accounted" (SC12).

[0114] By executing SA1 to SC12, AR display images or NFC tags corresponding to video content are embedded in the menu. These are read by terminal devices to display the video content, allowing information that cannot be conveyed through the menu alone, as well as the quality of the service, to be visually appealing and attracting customer interest. Furthermore, by setting up a stamp card, it is possible to encourage not only customers to return but also their friends to visit, enabling efficient customer acquisition.

[0115] In this embodiment, video content including the first content and the second content is displayed, but the second content may include multiple instances. Furthermore, the second content may be displayed in an interchangeable manner. Specifically, for example, if a customer has not made a reservation, customer attributes cannot be obtained, and therefore the second menu content based on customer attributes cannot be displayed. For this reason, instead of the second menu content, second menu content based on order information or time may be displayed.

[0116] In this embodiment, the display process refers to the process in which the display processing unit 20 executes a process to generate information necessary for display, transmits the generated information to the terminal device 9, and the terminal device 9 displays the generated information. Alternatively, the display process may also refer to the process in which the display processing unit 20 transmits a processing command to the terminal device 9 to generate information necessary for display, the terminal device 9 generates the information necessary for display, and displays the generated information. [Explanation of symbols]

[0117] 1: Information management device 2: Database 3: Customer terminal device 4: Store Management System 5: Intermediary System 6: Menu 10: Server 101: Processing Unit 102: Communications Department 103: Storage section 9: Terminal device 91: Processing Unit 92: Storage section 93: Communications Department 94: Input section 95: Output section 11: Content Management Department 12: Accounting Department 13: Video Viewing Management Department 14: Reservation Management Department 15: Frame Management Department 16: Liaison Department 17: Stamp Management Department 18: 2nd Content Identification Department 19: User Registration Department 20: Display Processing Unit W11: Store Description Department W12: Menu display section W13: Lottery Explanation Section W14: Submission Reminder Department

Claims

1. An information management system for managing customer accounting information, The aforementioned information management system comprises an information management device and a menu board installed in the store. The aforementioned information management device includes a display processing unit and a database. The aforementioned menu has multiple menus with embedded markers or tags. The aforementioned database stores content management information that links content IDs or store menu IDs with video content. The display processing unit obtains the content ID or store menu ID via the customer terminal device, processes the video content for display based on the content ID or store menu ID and the content management information, and displays it on the customer terminal device. Information management system.

2. The aforementioned video content includes store overview content, which includes an overview of the store. The aforementioned store overview content includes a first store overview video content which includes information about the store and content that encourages app downloads, and a second store overview video content which includes information about the store. The menu includes a store overview section with embedded code or tags for transitioning to a screen displaying the first store overview video content, and a store overview section with embedded markers for displaying the second store overview video content on the app screen. The information management system according to claim 1.

3. The content management information includes a combination of multiple three-dimensional images of three-dimensional objects corresponding to the menu, and the video content. The display processing unit processes the video content based on the stereoscopic image and content management information acquired from the customer terminal device. The information management system according to claim 1.

4. The aforementioned information management device further includes a stamp management unit, The aforementioned database further stores accounting management information linked to store user identification information and stamp cards, The stamp management unit acquires the store user identification information via the customer terminal device and updates the stamp card based on the store user identification information after the video content is displayed. The information management system according to claim 1.

5. The aforementioned information management device further includes an accounting management unit, The accounting management unit acquires store user identification information from the customer terminal device, registers the store user identification information and accounting management information including the accounting status, The store user identification information and the content ID or store menu ID are obtained from the customer terminal device, and if the accounting status of the store user identification information is complete, new accounting management information is registered. The information management system according to claim 1.

6. The aforementioned information management system further includes a video viewing management unit, The aforementioned database stores the viewing status of the video content for each store user identification information and accounting ID. The video viewing management unit updates the viewing status of the video content after the video content has been displayed. The display processing unit obtains a content ID or store menu ID and store user identification information from the customer terminal device, and processes the video content to display based on the content ID or store menu ID, the store user identification information, the content management information, and the viewing status. The information management system according to claim 1.

7. The information management device further comprises a reservation management unit and a second content identification unit. The aforementioned video content includes the first menu content and the second menu content, The aforementioned reservation management department acquires customer reservation information, The second content identification unit identifies the second menu content based on the reservation information, The display processing unit processes the video content, which includes the first menu content based on the acquired content ID or store menu ID, and the identified second menu content. The information management system according to claim 1.

8. The aforementioned information management device further comprises a second content identification unit, The aforementioned menu has a store overview section with embedded markers or tags. The aforementioned video content includes a store content ID, store overview content including an overview of the store, and store details content including information about the store's recommended menu items. The second content identification unit identifies the store details content based on the store content ID and store sales information obtained from the menu via the customer terminal device. The display processing unit processes the store content ID obtained by the customer terminal device from the menu, the store overview content based on the content management information, and the identified store details content to display. The information management system according to claim 1.

9. The aforementioned information management device further comprises an accounting management unit and a second content identification unit. The aforementioned video content includes the first menu content and the second menu content, The aforementioned accounting management department acquires accounting information including a combination of table ID and customer order information. The second content identification unit obtains the table ID from the customer terminal device and identifies the second menu content based on the order information corresponding to the table ID. The display processing unit processes the video content, which includes the first menu content based on the content ID or the store menu ID, and the identified second menu content. The information management system according to claim 1.

10. The aforementioned information management device further includes a reservation management unit, The aforementioned reservation management department obtains reservation information including the customer ID, The aforementioned database stores the customer ID and the stamp card in association, The stamp management unit identifies the stamp card to be updated based on the customer ID obtained based on the new reservation information. The information management system according to claim 4.

11. An information management program that manages customer accounting information, The aforementioned information management program causes the computer to function as a display processing unit and a database. The aforementioned database stores content management information that links content IDs or store menu IDs with video content. The display processing unit obtains the content ID or store menu ID from a menu table having multiple menus with embedded markers or tags via a customer terminal device, and processes the video content to display based on the content ID or store menu ID and the content management information. Information management program.

12. An information management method for managing customer accounting information, The information management device performs a process to store content management information that links content IDs or store menu IDs and video content, The customer terminal device performs a process to obtain the content ID or the store menu ID from a menu table having multiple menus in which markers or tags are embedded, The information management device obtains the content ID or the store menu ID via the customer terminal device, processes the video content to display based on the content ID or the store menu ID and the content management information, and displays it on the customer terminal device. An information management method for executing this process.