showcase

Abstract

To provide a showcase that can optimize the display content of products and advertisements according to the customer's location and behavior. [Solution] A showcase capable of accommodating goods, comprising: a display screen on which the goods are arranged to be visible; a touch position detection device configured to detect touch positions on the display screen; and a controller configured to display product information relating to the goods associated with the touch positions on the display screen according to the touch positions.

Description

Technical Field

[0004] , , , , , , , , ,

[0005]

[0001] The present disclosure relates to a showcase using a transparent display, and more particularly to a showcase that displays product information and advertisements based on touch events by customers.

Background Art

[0002] In the prior art, transparent displays have been adopted to display advertisements and information related to products in showcases. For example, in Patent Document 1, a technique for displaying an advertisement on a transparent display is known. Further, Patent Document 2 discloses a technique for photographing an image of a product with a camera and displaying it on a display. However, in these prior arts, a method for customers to directly obtain detailed product information by touch operation according to the position and behavior of the customer has not been sufficiently provided.

Prior Art Documents

Patent Documents

[0006] The showcase of this disclosure is a showcase for displaying goods, comprising: a display screen on which the goods are displayed in a manner that makes them visible; a touch position detection device configured to detect touch positions on the display screen; and a controller configured to display product information relating to the goods associated with the touch positions on the display screen in accordance with the touch positions. [Effects of the Invention]

[0007] According to the present invention, the content of product and advertisement displays can be optimized according to the customer's location and behavior. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a diagram showing the overall configuration of the showcase system according to Embodiment 1. [Figure 2A] This diagram explains "Advertising Mode," one of the display modes. [Figure 2B] This diagram explains "Transparency Mode," one of the display modes. [Figure 3] Figure 3 shows an example of a display area. [Figure 4] Figure 4 is a diagram illustrating the information used when displaying product information on the screen in response to touch events. [Figure 5] Figure 5 is a flowchart showing the processing procedure in showcase system 1. [Figure 6A] Figure 6A is a diagram illustrating a modified example of Embodiment 1. [Figure 6B] Figure 6B is a diagram illustrating the information used when displaying product information on a screen according to height, in a modified example of Embodiment 1. [Figure 7]FIG. 7 is a flowchart showing a processing procedure in Modification 1 of Embodiment 1. [Figure 8] FIG. 8 is a diagram for explaining parallax that occurs according to the distance between the display and the actual product. [Figure 9] FIG. 9 is a diagram for explaining information used when displaying product information on the screen using corrected touch position coordinates according to Modification 2 of Embodiment 1. [Figure 10] FIG. 10 is a flowchart showing a processing procedure in Modification 2 of Embodiment 1. [Figure 11] FIG. 11 is a diagram for explaining Modification 3 of Embodiment 1. [Figure 12] FIG. 12 is a flowchart showing a processing procedure in Modification 3 of Embodiment 1. [Figure 13] FIG. 13 is a diagram showing switching to a mode in Modification 3 of Embodiment 1. [Figure 14] FIG. 14 is a flowchart showing a processing procedure in Modification 4 of Embodiment 1. [Figure 15] FIG. 15 is a flowchart showing a processing procedure in Modification 5 of Embodiment 1. <000008,0>FIG. 16 is a flowchart showing a processing procedure in Modification 6 of Embodiment 1. [Figure 17] FIG. 17 is a diagram for explaining information used when registering product information according to the replacement button. <, [Figure 18] FIG. 18 is a diagram showing an example of a screen of a replacement button and a product list displayed on the display when replacing from Product A to Product B. [Figure 19] FIG. 19 is a flowchart showing a processing procedure in Modification 7 of Embodiment 1. [Figure 20A] FIG. 20A is a diagram for explaining information used when registering product information using an external device. [Figure 20B] FIG. 20B is a flowchart showing a processing procedure in Modification 8 of Embodiment . [Figure 21] FIG. 21 is a diagram showing an overall configuration diagram of the showcase system according to Embodiment 2. [Figure 22] FIG. 22 is a flowchart showing a processing procedure in Embodiment 2. [Figure 23] FIG. 23 is a diagram showing a display example for displaying hierarchical information. [Figure 24] FIG. 24 is a flowchart showing a processing procedure in Modification Example 3 of Embodiment 2. [Figure 25] FIG. 25 is a diagram showing a display screen of Modification Example 4 of Embodiment 2. [Figure 26] FIG. 26 is a flowchart showing a processing procedure of Modification Example 4 of Embodiment 2.

MODE FOR CARRYING OUT THE INVENTION

[0009] Hereinafter, each embodiment of the present disclosure will be described in detail with reference to the drawings and tables. However, detailed descriptions that are more than necessary, for example, detailed descriptions of well-known matters and duplicate descriptions of substantially the same configurations may be omitted. Note that the following descriptions and the drawings and tables referred to are provided for those skilled in the art to understand the present disclosure, and are not intended to limit the scope of the claims of the present disclosure.

[0010] (Embodiment 1) Referring to FIG. 1, the configuration of the showcase system 1 will be described. As shown in FIG. 1, the showcase system 1 includes a showcase 10, a display controller 20, an overall server 30, and a store terminal 4. Note that the display controller 20 and the overall server 30 are configured to control the display of the transmissive touch display 11 of the showcase 10, and can be regarded as a controller.

[0011] (Showcase 10) Showcase 10 can be installed in locations such as convenience stores, supermarkets, department stores, specialty shops, restaurants, cafes, hotels, hospitality facilities, airports, train stations, exhibition halls, event venues, libraries, museums, offices, corporate facilities, schools, educational facilities, etc., depending on the purpose of use, function, and target users.

[0012] The showcase 10 is equipped with a transparent touch display 11. The showcase 10 may also be equipped with a speaker capable of outputting sound, shelves or trays for displaying products, lighting to enhance the visibility of products, a cooling or heating device for refrigerating or heating products, a temperature sensor for monitoring the internal temperature, a sensor that reacts to customers, a camera 13 for photographing customers, a drainage system for properly draining condensation water and water from thawing that occurs inside the showcase, a condensation prevention heater to prevent condensation on the glass surface, casters to facilitate the movement of the showcase, and the like.

[0013] The showcase 10 can display products inside. The showcase 10 has, for example, a horizontal layout in which multiple products are arranged horizontally, a vertical layout in which multiple products are displayed vertically, a grid layout in which products are arranged in a grid pattern, a zone layout in which the inside of the showcase is divided into zones according to the type and size of the products, and a display layout that combines these. The product display layout can be appropriately selected according to the size of the product, the characteristics of the product, the visibility of the product, etc. The showcase 10 may also be a flat-type showcase in which products are viewed from above. Such flat-type showcases include refrigerated / freezing types used in convenience stores and supermarkets, and types without refrigeration / freezing / heating functions used in jewelry stores and watch shops.

[0014] The showcase 10 has at least one door for customers or staff to put items in and take them out. The door may be located on the front side or on the back side opposite to the front side. When the door is located on the front side, customers can access the items directly, making it suitable for self-service stores or for installations intended for sales promotion. On the other hand, when the door is located on the back side, it is suitable for staff to retrieve and replenish items from the back room. This arrangement is suitable for handling items that require hygienic management, such as food products, or expensive items, by limiting access to the items inside to staff. Furthermore, it is also possible to have doors on both the front and back sides. This allows staff to replenish items from the back room while customers retrieve items from the front side, thus achieving both efficient inventory management and customer convenience at the same time. The door may also be located on the side of the showcase.

[0015] The opening and closing direction of the showcase door 10 may be selected and designed considering various factors such as the available space at the installation location, the characteristics of the products, user convenience, and energy efficiency. The showcase door 10 may be a side-opening (side-hinged) type, as used in convenience stores and supermarkets, or a vertical-opening (upward-opening or downward-opening) type, or a sliding door type.

[0016] The number of doors on the showcase 10 may be selected and designed considering various factors such as the store's operating style, product assortment, temperature control requirements, and customer purchasing behavior. For example, it could be a single-door design with one large door covering the entire showcase, or it could be a multi-door design with the interior divided into multiple sections, each with its own door.

[0017] (Transmissive touch display 11) The showcase 10 includes at least one transparent touch display 11 for displaying product information and advertisements to users, including customers and staff. The transparent touch display 11 may be installed at any position on the showcase 10. For example, the transparent touch display 11 may be installed as a touch display door integrated with the front door of the showcase 10, or if the door is only on the back side, it may be installed on the front side without being integrated with the door. Alternatively, a transparent touch display 11 for customers may be installed on the front side, and a transparent touch display 11 for staff in the back room may be installed on the back side. Furthermore, if the showcase 10 is flat, it may be installed on the top surface.

[0018] The transparent touch display 11 is a display device incorporating touchscreen technology. The transparent display (transparent display device; hereafter sometimes simply referred to as "display") of the transparent touch display 11 is a display whose transparency can be controlled, and it can selectively and stepwise switch between a transparent state and an opaque state (and in some cases a semi-transparent state). The touchscreen is installed on the transparent display of the transparent touch display 11 and is equipped with sensors that detect touch operations by the user's finger or stylus. In this first embodiment, the "display screen" refers to an area where display dots (pixels) are provided, and is the area where images, videos, text, etc., are actually displayed. The size of the display screen is determined, for example, by the physical size and resolution of the transparent touch display 11. In this first embodiment, "touchscreen" refers to an area where a touch sensor is provided and where a user can perform touch operations. In this embodiment 1, the touchscreen is provided integrally with the display screen, and therefore, the "display screen" and the "touchscreen" may collectively be referred to as the "screen" hereafter. The transparent touch display 11 has excellent transparency, so it displays digital information about products without overlapping with the products inside the store, while allowing the customer to see the products inside the store, thereby providing a visual interaction with the customer. The size of the display screen (display area) and the touch screen (touch area) are preferably the same, but they are not necessarily required to be the same. In this embodiment 1, however, the display screen and the touch screen are assumed to be the same size.

[0019] The transparent touch display 11 has modes consisting of a transparent mode, an advertising mode, and a registration mode.

[0020] Figures 2A and 2B illustrate the "Advertising Mode" and "Transparency Mode." These modes are explained using Figures 2A and 2B. As shown in Figure 2A, "Advertising Mode" is a display mode in which information about a product and / or information about an advertisement for a product is displayed on part or the entire screen. In Advertising Mode, among the products A displayed in the showcase, products A located behind or near the display area of ​​the transparent touch display 11 showing information about the product and / or the advertisement for the product are either not visible to the customer or are difficult to see. As shown in Figure 2B, "Transparency Mode" is a display mode that utilizes the transparency of the transparent touch display 11 to make the products A displayed inside the showcase 10 visible, while displaying information about product A and / or information about an advertisement for the product on part of the screen (display area) in response to touch events. Here, "touch event" refers to the detection of an event in which a person touches part of the screen. In Figure 2B, for example, when a customer touches the screen on which product A is displayed, the system identifies the product from the touched location, and the product information B for the identified product is displayed on the screen. "Registration mode" is an operation mode for registering information about the replaced product and advertising information on the screen of the transparent touch display 11 when replacing the products displayed in the showcase 10. "Registration mode" will be explained in Modification 7 of Embodiment 1.

[0021] Switching from "transparency mode" to "advertising mode" is possible, for example, when a customer leaves the area in front of a display case. The camera or motion sensor will detect this situation and automatically switch to advertising mode. Specifically, if it is detected that no one is in front of the display case for a certain period of time, it will automatically switch from transparency mode to advertising mode.

[0022] Switching from advertising mode to transparency mode is possible, for example, when it is detected that a customer is approaching the display case, or when it is detected that a customer is approaching the display case and showing interest in the product (such as looking or touching). Specifically, if the camera detects a customer's gaze or touch and recognizes that a customer is standing in front of the product, it can automatically switch to transparency mode.

[0023] Switching from transparency mode to registration mode is possible, for example, by having a store employee manually select registration mode using a dedicated panel or remote device for maintenance work. Specifically, when a store employee is changing products, they can switch from transparency mode to registration mode by operating the switch button.

[0024] Switching from registration mode to transparency mode is possible, for example, when a store employee presses the "complete work" button after maintenance work is finished, or after a certain period of time has elapsed. Specifically, once product information registration is complete and the store employee presses the "exit mode" button, the system returns to transparency mode. Alternatively, it can also switch automatically after a certain period of time has elapsed.

[0025] Switching from advertising mode to registration mode can be done manually, for example, by a store employee to start maintenance work. Specifically, the employee can switch to registration mode using a remote device or a dedicated panel for the purpose of performing the work.

[0026] Switching from registration mode to advertising mode is possible when maintenance work is completed and a store employee performs the completion operation, or automatically after a certain period of time has elapsed. Specifically, after maintenance work is completed, the system will switch to advertising mode either when a store employee performs the operation or after a certain period of time has elapsed.

[0027] The transparent touch display 11 is equipped with a touch sensor that accurately detects when a customer's finger touches the touchscreen. An example of a touch sensor is a capacitive sensor. A capacitive sensor detects a change in capacitance when a finger touches electrodes placed on the touchscreen. The capacitive sensor has electrodes arranged in a grid in the X and Y directions on the transparent touch display 11, and the transparent touch display 11 is divided into many small sensor cells. The electrodes in the X direction and the electrodes in the Y direction are arranged in different layers, and the points where these electrodes intersect form touch detection points (sensor cells). With this structure, the entire touchscreen becomes a collection of fine sensor cells, and each cell can detect a change in capacitance. When a user's finger touches the surface of the touchscreen, the capacitance between the fingertip and the electrodes on the touchscreen surface changes. This change is maximum at the electrode (in the X and Y directions) at the location where the finger touched. The capacitive sensor can identify the location where the finger touched by detecting this capacitance change in real time. The electrodes in the X and Y directions are scanned sequentially to detect which electrode pair has experienced a change in capacitance. The electrodes in the X direction correspond to "columns," and the electrodes in the Y direction correspond to "rows." The position where the row and column intersect (x,y) is the touched position.

[0028] The transparent touch display 11 receives inputs such as images and videos related to the product or advertisement to be displayed on the transparent touch display 11, video signals that transmit user interface information, and signals for controlling the operation of the display. Audio signals may be output via speakers provided in the showcase 10. The transparent touch display 11 also outputs touch detection signals including coordinate data, and signals to notify external systems of the display's operating status and error status.

[0029] (Display output unit 12) The transparent touch display 11 has a display output unit 12. The display output unit 12 controls the screen of the transparent touch display 11 based on instructions from the display controller 20. Instructions from the display controller 20 include, for example, display content instructions to specify the content to be displayed on the screen (e.g., product information, advertisements, interface elements), layout instructions to specify the arrangement and layout of display areas on the screen, mode switching instructions to switch between modes such as transparent mode and advertising mode, and brightness adjustment instructions to adjust brightness and contrast. The display output unit 12 displays an appropriate screen on the screen of the transparent touch display 11 in accordance with these instructions.

[0030] (Display controller 20) The display controller 20 is a device that manages and controls the information displayed on the screen of the transparent touch display 11. It works in conjunction with the overall server 30 to ensure that appropriate information is displayed on the screen of the transparent touch display 11. The display controller 20 can be installed inside the showcase 10, on the outside rear or side, or in a location separated from the showcase 10. The installation location may be selected based on the use, design, environment, and maintainability of the showcase 10. The display controller 20 may manage and control one transparent touch display 11, or it may manage and control multiple transparent touch displays 11 collectively. The display controller 20 comprises a touch position recognition unit 21 and a display management unit 22.

[0031] (Touch position recognition unit 21) The touch position recognition unit 21 determines the touch position coordinates (x,y) of at least one touch operation performed on the touchscreen of the transparent touch display 11.

[0032] Methods for representing the touch position coordinates (x,y) on a touchscreen include, for example, representing them in pixels, representing them as distances from a reference point, representing them as electrode numbers of the touch sensor, representing them as normalized coordinates, and representing them as zones.

[0033] When representing touch positions using pixel coordinates on the screen, coordinate values ​​(x,y) corresponding to the screen resolution are used. For example, on a screen with a resolution of 1920x1080, touch positions will be detected in the range of x from 0 to 1919 and y from 0 to 1079.

[0034] When representing touch position as the distance from a specific reference point on the screen (e.g., top-left origin, bottom-left origin, or center origin), the unit of distance is not pixels, but rather physical length such as centimeters or inches. This depends on the physical size of the display, so even with the same resolution, the distance value will differ if the display size is different. When using distance as the unit, touch positions and display positions can be set in conjunction with actual physical sizes, such as the size and display position of products in a warehouse, or the height of the customer.

[0035] Regarding methods for representing touch positions based on the electrode numbers used by touch panels, since touch sensors typically have electrodes arranged in a grid on the screen, the touch position can also be identified by the electrode numbers in the vertical and horizontal directions of this grid. For example, if there are 10 electrodes in the x-axis direction and 20 electrodes in the y-axis direction, the position can be represented by the electrode numbers, such as (5,10). Note that the resolution of the touch position depends on the number of electrodes, so if the electrode density is low, it becomes difficult to identify fine touch positions.

[0036] The normalized coordinate method uses normalized coordinates, where the screen width and height are set to 1, to represent the touch position. For example, the top left of the screen is (0,0) and the bottom right is (1,1). This allows for position specification that is independent of the screen's resolution or size.

[0037] The zone representation method involves dividing the screen into several zones or areas and indicating their locations with zone numbers or names. For example, a display could be divided into 15 zones in a 5x3 grid, with each area identified by a number or label.

[0038] The touch position recognition unit 21 may, for example, if there are multiple consecutive touch inputs, validate only the first touch position detected, or only the last touch position detected, or only touch inputs within a predetermined time frame from among multiple consecutive touch inputs. Furthermore, if there are multiple touch inputs simultaneously, the unit may recognize each as a separate touch operation and process them individually. In addition, if there are multiple touch inputs, the touch position recognition unit 21 may output a command to the display output unit 12 to display an error message on the display. This prevents customer errors. Moreover, if there are multiple touch inputs, the touch position recognition unit 21 may output a command to the display output unit 12 to cancel all operations and return to the original state.

[0039] The touch position recognition unit 21 can avoid operational confusion by invalidating a new touch input under certain conditions (for example, when an action already being performed has not been completed).

[0040] The touch position recognition unit 21 may output a command to display visual feedback (e.g., a highlight or effect) at the touched location to inform the customer that a touch has been recognized. It may also output a command to provide acoustic feedback when a touch is recognized, informing the customer that the touch operation has been accepted.

[0041] The touch position recognition unit 21 transmits the position of at least one touch operation performed on the touchscreen of the transparent touch display 11 as coordinate values ​​(x,y) to the touch position management unit 36 ​​of the overall server.

[0042] (Display management section 22) The display management unit 22 outputs instructions to the display output unit 12 for controlling the transparent touch display 11 in response to instructions from the display determination unit 37 of the overall server 30. Instructions from the display determination unit 37 of the overall server 30 include, for example, instructions for displaying content to be displayed on the screen of the transparent touch display 11 (e.g., product information, advertisements, interface elements) in a specified display area, and mode switching instructions for switching between transparent mode, advertisement mode, registration mode, and off mode. Off mode refers to the mode in which the power to the transparent touch display 11 is turned off.

[0043] (Total servers: 30) The overall server 30 is a central computer system in the showcase system 1 that manages the showcases 10 installed in each store, manages advertisements, manages products, determines display content, and processes various data, and is configured to optimize the interaction between customers and products. The overall server 30 centrally manages and controls the information displayed on the transparent touch display 11 and integrates multiple functional modules. The installation location of the overall server 30 can be, for example, the back room or office of a store, a server room, a cloud environment, or a data center. The connection between the overall server 30 and the display controller 20 can be, for example, wired, wireless, or remotely via the internet. The installation location and connection of the overall server 30 can be selected based on the system's operating mode, real-time requirements, and security requirements. As shown in Figure 1, the overall server 30 includes a showcase management unit 31, a display area management unit 32, an advertisement management unit 33, a product management unit 34, an external device linkage unit 35, a touch position management unit 36, a display determination unit 37, and an image recognition unit 38.

[0044] (Showcase Management Department 31) The showcase management unit 31 stores showcase information for each showcase 10 installed in each store. "Showcase information" refers to information about the showcase 10, such as the location of the showcase, the presence or absence of a transparent touch display 11, and the size of the touchscreen.

[0045] An example of "showcase information" may be provided by a database consisting of a store ID, which is a unique identification number for identifying a store; a showcase ID, which is a unique identification number for identifying a showcase 10; a display ID, which is a unique identification number for identifying a transparent touch display 11; and the size of the display, as shown in Table 1.

[0046] [Table 1]

[0047] "Showcase information" may also include information such as showcase specifications, installation location, maintenance status, start date of operation, and date of last maintenance.

[0048] (Display area management section 32) The display area management unit 32 stores display area information for setting which areas on the screen will display product information and / or advertisement information. "Display area information" refers to data about the areas on the screen of the transparent touch display 11 where specific information (products, advertisements, text, images, videos, etc.) will be displayed.

[0049] "Display area information" is provided by a database that includes, for example, a display ID, which is a unique identification number for identifying the transparent touch display 11, a display area ID, which is a unique identification number for identifying the display area on the transparent touch display 11, a display area name, the start position (x1, y1) and end position (x2, y2) of the display area, the size of the display area (width x height), and a product ID, which is a unique identification number for identifying the product, as shown in Table 2. Note that the position and size of the display area are expressed in pixels (the same applies in the following explanation). Furthermore, a "display area" is defined by its position and size on the display screen, and in principle, one product is associated with one display area.

[0050] [Table 2]

[0051] Furthermore, using Table 2 and Figure 2B, the area on the screen where product information B is displayed in Figure 2B corresponds to the display area in Table 2. The position of product information B on the screen corresponds to the start position (x1, y1) and end position (x2, y2) in Table 2, and the size of product information B on the screen corresponds to the size (width x height) of the display area in Table 2. Product information B in Figure 2B corresponds to the product with the product ID in Table 2.

[0052] To explain the first row of Table 2, Display Area 1, which has DisplayArea_1 as its display area ID, is an area on the screen with a start and end position of (100,200) to (600,700), has a size of 500 pixels wide x 500 pixels high, and is an area where information about Product Z, identified as Product_Z, is displayed.

[0053] The values ​​in Table 2 are merely examples. As shown in Table 2, the sizes of the multiple display areas do not have to be the same, nor do they have to be the same shape. The display areas can have any shape. For example, they may be polygons, circles or ellipses with a predetermined point on the screen as the center point, or shapes that mimic the outline of a product. The position and size of the display areas may be set to match the display layout of the products in the corresponding showcase.

[0054] The display area management unit 32 may have an algorithm for automatically setting the position, size, and shape of the display area. For example, an algorithm that optimizes based on user data feedback can be used. The number of times the user touches the display can be accumulated, and for products that the user frequently touches (linked to touch location identification areas that the user frequently touches), the display area can be set to be larger than others to prioritize displaying them larger. Conversely, the display area for product information of products that are touched less frequently can be made larger. The size of the touch location identification area itself can also be changed according to the number of touches. Furthermore, an algorithm that reflects environmental data in real time can be used. Information from environmental sensors and cameras can be taken in, and the display area can be dynamically set according to the intensity of ambient light, the customer's position, and their line of sight. This allows the position and size of the display area to be set based on the angle from which the customer is viewing the display and the distance from them. Furthermore, an algorithm for processing multiple pieces of information simultaneously can be used. When multiple pieces of information are displayed simultaneously, the priority of the information to be displayed can be automatically determined, and the display area can be readjusted to display the information with higher priority in a larger size. This prevents important information from being overlooked by the user. Furthermore, past data can be fed back into machine learning algorithms to streamline the selection and resizing of the display area. This improves the accuracy and efficiency of the displayed information, making the transparent touch display 11 more intuitive and user-friendly to operate.

[0055] "Display area information" is not limited to the information in Table 2, and may also include information regarding the display manner within the display area on the screen, such as the priority order when displaying hierarchically, the size and resolution of fonts and images, display time, display period, and visual effects (presence or absence of effects such as fade-in and slide-in).

[0056] Figure 3 shows an example of a display area. As shown in Figure 3, when a customer interested in product A touches the screen near product A, information about product A corresponding to the touch location is displayed in the display area as product information B. In this case, the display area is set as a donut-shaped area defined by a first circular area (solid line) and a second circular area (dashed line) that is wider than the first circular area. The center of the first circular area (solid line) is, for example, located at a position that overlaps with product A when viewed from the front of product A. The radius of the first circular area (solid line) is set so that this area overlaps with product A. In other words, even if product information B is displayed, the area of ​​the first circular area (solid line) is set so that product information B does not overlap with product A as seen through the transparent touch display 11 when viewed from the front of product A by the customer. The center of the second circular area (dashed line) is, for example, set at the same point as the first circular area (solid line). The radius of the second circular area (dashed line) is set according to the display size of product information B. In Figure 3, the display area is set to a donut shape centered on product A, which is the touch target, but it may also have a polygonal shape with a hollow center.

[0057] (Advertising Management Department 33) The advertising management unit 33 registers and stores advertising information about products to be displayed in the display area on the display screen of the transparent touch display 11. "Product advertising information" refers to short-term, promotional messages and promotional information that are conveyed to target consumers for the purpose of promoting the purchase of a specific product. "Product advertising information" is mainly used when the display mode of the transparent touch display 11 is in advertising mode.

[0058] [Table 3]

[0059] "Product advertising information" is provided as a database consisting of a product ID, which is set to uniquely identify the product, the product name, and the advertising content, as shown in Table 3, for example.

[0060] "Advertising information about a product" is not limited to these and can include a wider variety of information. Specifically, it may include the display time and period of the advertisement, the target customer base, the product price, inventory status, related promotional information, related recipes and product information used in those recipes, manufacturer information, past sales history, customer ratings and reviews, product ingredients and specifications, and even real-time market trends. In particular, with the recent rise in health consciousness, enabling product ingredient labeling allows customers to instantly check the presence and type of allergens and additives for multiple products without having to remove them from the packaging. This reduces the need to open and close doors, suppressing the rise in internal temperature of refrigeration equipment such as display cases where products are stored, thus improving energy efficiency. This information can also be dynamically updated to maximize the effectiveness of the advertisement. Furthermore, this database is not limited to information fixed for a single product; it can also include information shared among multiple products or information corresponding to different product categories. Furthermore, the "product-related advertising information" may have a hierarchical structure. For example, it may be divided into multiple fields or subcategories related to the product, depending on the customer segment or priority, and each may be displayed based on specific conditions. For instance, certain advertising information may be displayed preferentially depending on the customer segment or priority.

[0061] (Product Management Department 34) The product management unit 34 registers and stores product information to be displayed on the display area of ​​the transparent touch display 11 screen. "Product information" refers to factual, objective details, features, functions, usage instructions, ingredients, specifications, and other information that helps consumers understand and use a given product. "Product information" is mainly used when the display mode of the transparent touch display 11 is transparent mode.

[0062] [Table 4]

[0063] "Product information" is provided as a database consisting of, for example, a product ID set to uniquely identify a product, a product name, product details, a category ID set to uniquely identify the product category, and a category name, as shown in Table 4. The category ID can be used when creating a predetermined product list. Subcategory IDs may be provided for more detailed settings. The product list can be used, for example, when creating a product list in product registration mode.

[0064] "Product information" is not limited to these examples and can include a wider variety of information. Specifically, it can include information based on the target customer base (age, gender, region, etc.), sales performance and review information, the total number of times customers have interacted with the product, and even real-time inventory status. This information can be dynamically updated, and product information can also be set based on customer interests and purchase history.

[0065] (External device linkage unit 35) The external device linkage unit 35 exchanges data with external devices such as barcode readers and store terminals 4.

[0066] (Touch position management unit 36) The touch position management unit 36 ​​acquires touch event information related to touch events by the customer. The "touch event information" is provided as a database consisting of a touch ID set to identify the touch event and the position coordinates (x, y) on the screen where the touch occurred, as shown in Table 5, for example.

[0067] [Table 5]

[0068] Although not shown in Table 5, "touch event information" may include the time the touch occurred, a display ID identifying the transparent touch display 11 on which the touch occurred, a store ID, etc. By using touch event information to analyze when and at what times touches occur most frequently, it is possible to understand user behavior patterns. If multiple stores are operated, including the store ID allows for understanding the usage status and frequency of touch events for each store, enabling comparison of store performance and utilization in marketing strategies.

[0069] The touch position management unit 36 ​​further compares the touch position coordinates (x, y) with the coordinate range of a pre-set touch position identification area on the transparent touch display 11 to identify the area to which the touch position coordinates (x, y) belong. The touch position management unit 36 ​​has touch position identification area information for performing this identification.

[0070] [Table 6]

[0071] The "touch location identification area information" is provided as a database consisting of, for example, a touch location identification area ID set to uniquely identify the touch location identification area, a touch location identification area name, the start and end positions of the touch location identification area, the size of the touch location identification area, and a product ID, as shown in Table 6. A "touch location identification area" refers to an area on the display screen that is divided into multiple regions in order to identify the location of a touch, and is a region that links touch events to products. The layout of the "touch location identification areas" is arranged on the screen to match the layout of the products displayed in the showcase. Basically, the arrangement of one touch location identification area matches the arrangement of one product. For example, in the case where three identical products are displayed side by side, the touch location identification area may be set to have three side by side regions corresponding to the three products, or, considering that the three products are the same product, the three products may be treated as one product and the touch location identification area may be set to one.

[0072] For example, when the touch position management unit 36 ​​obtains the touch position coordinates (100,100), it compares the touch position coordinates (100,100) with the coordinate range of the touch position identification area (the start and end positions of the touch position identification area). It determines that the touch position (100,100) belongs to the coordinate range of the touch position identification area A, which is (0,0) to (500,300). Therefore, the touch position management unit 36 ​​identifies the touch position (100,100) as belonging to the touch position identification area A.

[0073] The touch position management unit 36 ​​generates touch position linking information that links touch position coordinates with touch position identification areas. The touch position linking information consists of, for example, a touch ID, a touch position identification area ID, and a product ID, as shown in Table 7.

[0074] [Table 7]

[0075] Table 7 illustrates the example: when a touch event identified as Touch_1 occurs, it indicates that product X (product ID: Product_X), associated with touch location identification area A identified as Region_A, is the target product to be displayed on the screen. Touch location association information plays a role in linking dynamically occurring touch operations with pre-configured static product information. This linking of "dynamic" and "static" information is crucial when displaying product information in real time, and it serves as a mechanism to instantly reflect product information in response to user actions.

[0076] (Display determining section 37) The display determination unit 37 uses the touch position linkage information to query (inquire about) information related to the touch position linkage information and generates display content information that determines which area on the screen the product content and advertising content related to that product will be displayed in. The display content information consists of, for example, the touch ID, display area ID, start position (x1, y1) and end position (x2, y2) of the display area, product ID, product content, and advertising content, as shown in Table 8.

[0077] [Table 8]

[0078] Table 8 explains that when a touch identified by Touch_1 occurs, product details and / or advertising content related to product X are displayed in DisplayArea_3 located at positions (50,100) to (550,600) on the screen.

[0079] Furthermore, the display content information may include the store ID and display ID shown in Table 1. Including store and display information in the display content information allows for the identification of the recipient of the display content information.

[0080] The display determination unit 37 outputs the display content information to the display management unit 22 of the display controller 20. Based on the display content information, the display management unit 22 instructs the display output unit 12 to display the product content and / or advertising content on the screen.

[0081] Figure 4 is a diagram illustrating the information used when displaying product information on the screen in response to a touch event. The information consists of touch event information 40, which is generated in response to a touch event; dynamic condition response information 60, which can be changed in response to events other than touch events; touch position linking information 50, which associates the touch event information 40 and the dynamic condition response information 60; and display content information 51, which is generated from the touch position linking information 50 and the dynamic condition response information 60.

[0082] Touch event information 40 is generated in response to a customer's touch on the screen. The touch position coordinates of the touch event information 40 are compared with the position of the touch position identification area in the touch position identification area information 63 to identify the touch position identification area where the touch event occurred. In other words, this identification links the touch event information 40 and the touch position identification area information 63. Touch position linking information 50 is generated in response to this linking.

[0083] The display content information 51 is generated from the touch position linking information 50 and the dynamic condition response information 60 as a command regarding the display content to be shown on the screen. Based on the display content information 51, the display shows product information and advertisements in the display area on the screen.

[0084] This section describes dynamic conditional response information 60, which can be changed in response to events other than touch events. Dynamic conditional response information 60 includes showcase information 61, display area information 62, touch location identification area information 63, product information 64, and product advertising information 65. This information is interconnected. For example, showcase information 61 and display area information 62 are linked by the display ID, and display area information 62, touch location identification area information 63, product information 64, and product advertising information 65 are linked by the product ID. By dynamically changing some of the information in response to external events (e.g., customer location and actions, environmental sensor data), it is possible to improve the customer experience by adopting a more appropriate display mode for each customer. The ability to change the display mode of multiple stores at once eliminates the need to set and change each store individually. This significantly reduces time and effort and improves the efficiency of management work. Furthermore, batch changes make it possible to simultaneously reflect the same campaign or promotion information in all stores. This allows for the unification of brand image and marketing strategies, and the provision of consistent information to customers.

[0085] Table 9 shows examples of events other than touch events. Some examples of events other than touch events will be explained in the modified embodiment 1 described later.

[0086] [Table 9]

[0087] Figure 5 is a flowchart showing the processing procedure in showcase system 1. The processing procedure of showcase system 1 will be explained using Figure 5.

[0088] In step S1, the transparent touch display 11 of the showcase 10 is set to transparent mode.

[0089] In step S2, it is determined whether or not a touch has been recognized on the touchscreen of the transparent touch display 11. If it is determined that no touch has been recognized, step S2 is executed again. If it is determined that no touch has been recognized, the process proceeds to step S3. The determination of whether or not a touch has been recognized is made by the touch position recognition unit 21 and / or the touch position management unit 36. The touch position recognition unit 21 determines whether or not a touch has been recognized depending on whether or not it can identify the touch position coordinates (x, y). The touch position management unit 36 ​​determines whether or not a touch has been recognized depending on whether or not it can identify which region the touch position coordinates (x, y) belong to.

[0090] In step S3, the touch position coordinates (x, y) are identified, and display information, including the product details and advertising content of the product corresponding to the touch position coordinates (x, y), is displayed in the display area.

[0091] (Modification 1 of Embodiment 1) Using Figure 6A, Modification 1 of Embodiment 1 will be described. Modification 1 of Embodiment 1 is directed towards an example in which the position of product information B is changed according to height, as shown in Figure 6A. It can also be said that Modification 1 of Embodiment 1 is directed towards an example in which dynamic condition response information 60 is changed in response to events other than touch events. Specifically, the showcase 10 is equipped with a camera 13, and is directed towards an example in which the customer's height is identified from the image captured by the camera, and the display area is set according to the identified height. That is, an event other than a touch event is obtaining an image captured by the camera. Then, the display area information 62 of the dynamic condition response information 60 is modified in response to this event. As shown in Figure 1, Modification 1 of Embodiment 1 is equipped with a camera 13 in the showcase 10, and the overall server 30 has an image recognition unit 38.

[0092] (Camera 13) The showcase system 1 according to Modification 1 is equipped with at least one camera 13 on the showcase 10. The camera 13 is installed on the top surface of the showcase. The camera 13 is angled to face the front of the showcase 10 in order to capture the entire person. This is because it is necessary to photograph the person from head to toe. Regarding resolution, an appropriate resolution is necessary to accurately recognize the person's head and entire body; for example, a resolution of HD (1280x720) or higher is recommended. Regarding field of view, a wide field of view (for example, 120 degrees or more) is recommended to capture people of different heights. In addition, multiple cameras may be provided to more accurately recognize height.

[0093] (Image recognition unit 38) The overall server 30 has an image recognition unit 38. The image recognition unit 38 estimates the height of a person based on video or images captured by the camera 13.

[0094] The image recognition unit 38 first detects a person in front of the showcase 10 from the image captured by the camera 13. By extracting the outline of the detected person and understanding the person's overall shape, the unit identifies the person's upper end (head) and lower end (feet) as coordinates on the screen. Based on the coordinates (Y coordinates) of the detected upper and lower ends of the person, the unit estimates the person's height. For example, the height can be estimated based on the relative coordinates from the known frame of the showcase. Based on the coordinate information of the upper and lower ends of the person detected in the image, the estimated height coordinate Y (vertical position on the screen) corresponding to the person's height is estimated.

[0095] Figure 6B is a diagram illustrating the information used when displaying product information on a screen according to height, in a modification 1 of Embodiment 1. Using Figure 6B, the modification 1 of Embodiment 1 will be explained based on the information used.

[0096] (Touch position management unit 36) The touch position management unit 36 ​​acquires touch events by the customer and touch event-height information 40A related to the customer's height. The "touch event-height information 40A" is provided as a database consisting of, for example, a touch ID set to identify the touch event, the touched position coordinates (x, y) on the screen, a person ID assigned to identify the person whose height was estimated, and the estimated height coordinates, as shown in Table 10.

[0097] [Table 10]

[0098] The touch position management unit 36 ​​compares the y-coordinate of the touch position coordinate with the estimated height coordinate Y.

[0099] If the estimated height coordinate Y is higher than the touch position coordinate y, that is, if the person's actual height is higher than the actual touch position, the y coordinates of the default "start position (x1, y1) and end position (x2, y2) of the display area," as shown in display area information 62 of Table 2, are adjusted upward to instruct the product content and / or advertising content to be displayed at a position higher than the touch position.

[0100] If the estimated height coordinate Y is approximately the same as the touch position coordinate y, the system will, for example, modify the y coordinates of the default "start position (x1, y1) and end position (x2, y2) of the display area" as shown in the display area information in Table 2, instructing the system to display the product content and / or advertisement content at approximately the same position as the touch position. Regarding "approximately the same," if the difference between the estimated height coordinate Y and the touch position coordinate Y is within a certain tolerance range, it can be considered "approximately the same." For example, the tolerance range can be set to a range of ±5 cm when converted to actual distance. This means that even if they do not perfectly match, if the error is within this range, they are defined as "approximately the same."

[0101] If the estimated height coordinate Y is lower than the touch position coordinate y, that is, if the person's actual height is lower than the actual touch position, the system will, for example, adjust the y coordinates of the default "start position (x1, y1) and end position (x2, y2) of the display area" as shown in the display area information in Table 2 downwards, instructing the system to display the product content and / or advertisement content at approximately the same position as the touch position.

[0102] (Display determining section 37) The display determination unit 37 queries information related to the touch-linked information 50A using the touch-linked information 50A and the correction instructions regarding the display position from the touch-position management unit 36, and generates display content information 51A that determines which area on the screen the product content and advertising content related to that product will be displayed in. The display content information consists of, for example, the touch ID, area ID, the start position (x, y+α) and end position (x, y+α) of the display area with the y coordinate corrected by α, the product ID, the product content, and the advertising content, as shown in Table 11.

[0103] [Table 11]

[0104] The display determination unit 37 outputs a display area to the display management unit 22 of the display controller 20, in which the y-coordinate has been modified by α for the default start position (x1, y1) and end position (x2, y2) of the display area. The display management unit 22 instructs the display output unit 12 to display the product content and / or advertising content on the screen based on the display content information 51A. Note that α is a positive value when modifying the default display area upwards, and a negative value when modifying it downwards. The value of α is determined, for example, according to the relative difference between the estimated height coordinate Y of a person and the touch position coordinate.

[0105] Figure 7 is a flowchart showing the processing procedure for modified example 1 of Embodiment 1.

[0106] Steps S11 to S12 are identical to the flowchart in Figure 4, so the explanation will be omitted.

[0107] In step S13, the touch position coordinates (x, y) are recognized, and information about the product and / or advertisement corresponding to the touch position coordinates (x, y) is identified.

[0108] In step S14, the position of the product corresponding to the touch position coordinates (x, y) (the "tap position" in Figure 7) is compared with the height estimated by the image recognition unit 38 based on the camera image captured by the camera 13. If the person's height is greater than the product's position, the process proceeds to step S15. If the person's height is less than the product's position, the process proceeds to step S16.

[0109] In step S15, information about the product and / or information about the advertisement is displayed on the screen above the position of the product.

[0110] In step S16, if the person's height is approximately the same as the position of the product, proceed to step S17. If the person's height is not approximately the same as the position of the product, proceed to step S18.

[0111] In step S17, information about the product and / or information about the advertisement is displayed on the screen above or to the side of the product's position.

[0112] In step S18, if the person's height is lower than the position of the product, proceed to step S19.

[0113] In step S19, information about the product and / or information about the advertisement is displayed on the screen below or to the side of the product's position.

[0114] Product information and other elements can be adjusted to a display position that is easily visible to all customers. Note that the comparison between the product's position corresponding to the touch position coordinates and the height estimated by the image recognition unit 38 is not limited to the order shown in Figure 7. For example, the order of the determinations can be changed, determination processes can be omitted, or the display position of product information and advertisements after each determination can be changed.

[0115] According to Modification 1 of Embodiment 1, the display position of product information and advertisements can be flexibly adjusted upwards, to the side, or downwards based on the customer's height, providing an optimal display position that is easy for all customers to view with a natural line of sight. A consistent display effect is obtained for customers of varying heights and body types, making it possible to cater to a wide range of customers. As a result, by adjusting the display position according to the customer's height, the interactive user experience in the store is greatly improved, and products and advertisements can be effectively displayed.

[0116] (Modification 2 of Embodiment 1) A modification 2 of Embodiment 1 will now be described. Modification 2 of Embodiment 1 is directed toward an example that takes into account parallax that occurs depending on the distance between the transparent touch display 11 and the actual product. Specifically, the showcase 10 is equipped with a camera, the customer's position is identified from the image captured by the camera, and corrections are made to take parallax into account according to the identified position. In other words, events other than touch events are obtaining the image captured by the camera. As shown in Figure 1, Modification 2 of Embodiment 1 is equipped with a camera 13 in the showcase 10 and an image recognition unit 38 in the overall server 30.

[0117] Parallax will be explained using Figure 8. In adjacent touch-location identification areas A and B on the screen, from the customer's perspective, even if they select product A which belongs to touch-location identification area A, they may actually touch the adjacent touch-location identification area B, resulting in a problem where information about product B is displayed instead of the intended information about product A. This can occur because the products displayed in the showcase are spaced apart from the transparent touch display 11 and are positioned in a recessed area from the customer's perspective.

[0118] (Camera 13) A depth camera can be used as camera 13. A depth camera is a camera that can measure the distance (depth) to an object, and while a normal 2D camera acquires a planar image, a depth camera can acquire "3D data" that includes physical distance information to the object. This makes it possible to understand the spatial positional relationship between the customer's eye position and the fingertip that touches it. Furthermore, a depth camera can be used as camera 13 to understand the spatial positional relationship between the customer's eye position and the fingertip that touches it and the product in the showcase. A depth camera is a camera that can measure the distance (depth) to an object, and while a normal 2D camera acquires a planar image, a depth camera can acquire "3D data" that includes physical distance information to the object. This makes it possible to understand the spatial positional relationship between the customer's eye position and the fingertip that touches it. Furthermore, the spatial positional relationship between the customer's eye position and the fingertip that touches it and the product in the showcase can be understood, for example, by referring to the frame of the showcase. Therefore, the customer's eye position, the position of the fingertip that touches it, and the position of the product in the showcase can be determined using predetermined reference points on the frame of the showcase.

[0119] (Image recognition unit 38) The image recognition unit 38 identifies products located on the extension of the line segment connecting the customer's eye position coordinates and touch position coordinates. If the product identified by comparing the position of the touch position identification area in the touch position identification area information 63 with the touch position coordinates is the same as the product identified on the extension line, no parallax correction is performed. If the product identified by comparing the position of the touch position identification area in the touch position identification area information 63 with the touch position coordinates is different from the product identified on the extension line, the original product information will not be displayed, so a correction command is output to instruct the system to perform the correction.

[0120] (Example of correction 1) The touch position management unit 36 ​​may, in response to a correction command, determine a correction amount (α, β) corresponding to the difference between the touch position coordinates (x, y) on the touched screen and the line segment connecting the customer's eye position coordinates and the touch position coordinates, and the line segment connecting the customer's eye position coordinates and the touch position coordinates if the customer were to view the product from the front. The unit may then add the correction amount (α, β) to the touch position coordinates (x, y) to generate corrected touch position coordinates (x+α, y+β).

[0121] The touch position management unit 36 ​​further compares the corrected touch position coordinates (x+α, y+β) with the coordinate range of the touch position identification area on the transparent touch display 11, which is set in advance, to determine which area the corrected touch position coordinates (x+α, y+β) belong to. The corrected touch position coordinates (x+α, y+β) are used to perform processing in the same manner as in Embodiment 1.

[0122] Figure 9 illustrates the information used when displaying product information on the screen using the corrected touch position coordinates (x+α, y+β) in Example 1 of the correction. As is clear from Figure 9, the difference from Embodiment 1 shown in Figure 4 is that the corrected touch position coordinates (x+α, y+β) are used as touch position coordinates by adding a correction amount (α, β). Otherwise, the process is the same as in Embodiment 1.

[0123] Figure 10 is a flowchart showing the processing procedure in Modification 2 of Embodiment 1.

[0124] In step S21, the camera is set to continuously capture images of the transparent touch display 11.

[0125] In step S22, the touch position recognition unit determines whether or not the transparent touch display 11 has been touched. If it is determined that it has been touched, the process proceeds to step S23. If it is determined that it has not been touched, the process proceeds to step S28. In step S23, the touch position determination unit detects the actual touch position.

[0126] In step S24, the image recognition unit detects the customer's position and finger position, and transmits this information to the touch position determination unit.

[0127] In step S25, the touch position determination unit corrects the touch position to the location of the product that the customer is likely to have indicated, based on the actual touch location information and the customer's location information. The information display determination unit then displays product information and advertisements on the display that correspond to the product that matches the product location information and touch location information.

[0128] In step S26, the image recognition unit determines whether or not there is a person in the image from the camera. If it is determined that there is a person, step S26 is repeated. If it is determined that there is no person, the process proceeds to step S27.

[0129] In step S27, the information on the display is erased.

[0130] In step S28, nothing is displayed on the screen.

[0131] In the case of flat-type display cases, the accuracy of detecting customer finger positions and other elements can be improved by installing the camera at a relatively high position.

[0132] Furthermore, to correct the touch position, a correction table can be maintained, and a method can be used to identify the product from the table based on information such as the user's standing position and arm orientation. This makes it possible to reduce the amount of computation. The correction table holds predefined correction data based on information such as the user's standing position, arm orientation, and touch position. This table records the relative position of the transparent touch display 11 and the product, as well as correction values ​​based on past user movement patterns. The correction table may include coordinate data based on the customer's gaze and body orientation (e.g., head and arm positions detected by the camera), arm angle and position information when the user touches the product, the correspondence between the product placement on the transparent touch display 11 and the actual product position, and correction history data collected in the past.

[0133] The coordinates used to determine the correction amount can be two-dimensional or three-dimensional, and it is also possible to use only three-dimensional coordinates. In a two-dimensional coordinate system, the position on a plane is represented by two axes, the X and Y axes. For example, the touch position and the position of a product can be adequately represented using two-dimensional coordinates. In a two-dimensional coordinate system, calculations are simpler and computational processing is lighter. In a three-dimensional coordinate system, in addition to the X and Y axes, the Z axis is added, allowing the position to be represented in the entire space. Three-dimensional coordinates are suitable when three-dimensional information is required, such as the height and depth of the transparent touch display 11, or the sense of distance depending on the user's standing position. By adopting a three-dimensional coordinate system, it may be possible to correct the touch position more accurately based on the user's standing position, viewpoint height, and distance by handling three-dimensional information. Also, if the transparent touch display 11 is large relative to the user's height, or if the user operates the transparent touch display 11 from different heights or angles, using Z-axis (height) information allows for more accurate operation. For example, when customers view the transparent touch display 11 from different heights (e.g., tall people, children) or at an angle, the touch position may differ from the actual position on the transparent touch display 11. To correct this discrepancy, it is necessary to consider the customer's height, line of sight, and even the three-dimensional positional information of the product being touched. Using three-dimensional coordinates allows for flexible handling of such situations.

[0134] Alternatively, instead of coordinates, the angle of incidence relative to the head, fingertips, and the display plane can be used. Based on the touch position and angle of incidence, it is possible to correct the touch position of the product indicated by the customer. The angle of incidence refers to the angle formed between the user's fingertips and the display surface when the user touches it. This angle is greatly influenced by the user's head position, fingertip movement, standing position, and even distance to the display. For example, there is a high possibility of a discrepancy between the touch position and the intended product when the user operates the display from directly in front of it compared to operating it from an angle. To correct this discrepancy, the system understands the positional relationship from the head to the fingertips as the angle of incidence and makes corrections based on this information.

[0135] Furthermore, the distance information between the display and the product can either retain default values ​​for each product in each showcase or be entered manually. Since the distance information varies depending on the showcase design and product placement, pre-configured default values ​​can be used. These default values ​​are optimized for each showcase model and are automatically applied during normal operation. For example, in certain showcases, the distance between the display and the product shelf is constant, so using the pre-configured default values ​​allows for highly accurate correction of the touch position. On the other hand, depending on the store design and product layout, the default distance settings may not be suitable. In such cases, the distance information can be entered manually. For example, if a particular product is displayed further back than others, or if a special product layout is employed, the staff can manually adjust the distance information to optimize the correction so that customers can accurately select products.

[0136] According to Modification 2 of Embodiment 1, the problem of selecting a different product than intended due to parallax when a customer touches the location of a product visible through the transparent touch display 11 can be solved. Specifically, by accurately capturing the customer's eye position and touch position with a camera and performing parallax correction based on that positional relationship, it becomes possible to accurately display the product information that the customer actually wants to select. Even in environments where there is a distance between the product and the transparent touch display 11, or where products are displayed at the back of the showcase, accurate operation can be guaranteed in any installation situation by utilizing the parallax correction function. Because it functions effectively even in installation environments where the parallax problem is significant, it can be applied to a wide range of showcases. By using a depth camera to recognize the customer's eye position and touch position in three dimensions and achieving highly accurate parallax correction, customer operation becomes more intuitive and comfortable. As a result, customers can smoothly acquire product information and advertisements without worrying about incorrect operation, improving the showcase operation experience. In this way, a system that minimizes the effects of parallax and accurately displays the product information intended by the customer can be realized, providing a comfortable operating experience. Furthermore, since the opening and closing of doors is suppressed, the rise in internal temperature of refrigerated equipment such as display cases containing goods is suppressed, thus improving energy efficiency.

[0137] (Modification 3 of Embodiment 1) A third modification of Embodiment 1 will be described. This third modification of Embodiment 1 is directed towards an example where the display mode of the display is switched according to the customer's location. The showcase 10 according to this third modification includes a location detection camera 14 for detecting the customer's location, as shown in Figure 11. A third modification of Embodiment 1 will be described. This third modification of Embodiment 1 is directed towards an example where the display mode of the display is switched according to the customer's location.

[0138] (Camera 14 for position detection) The position detection camera 14 is installed in the showcase 10 to accurately detect the customer's position. The position detection camera 14 is installed in an appropriate position on or around the showcase 10 to monitor the movement and position of customers in front of the showcase. The installation angle of the position detection camera 14 is adjusted to capture the entire showcase, allowing it to capture the entire body of customers in front of the showcase. The position detection camera 14 has a wide field of view (e.g., 120 degrees or more) and can cover a wide area in front of the showcase. This allows it to detect the movement of multiple customers simultaneously. The resolution of the position detection camera 14 is, for example, HD (1280x720) or higher, allowing it to capture details such as the customer's posture, face orientation, and gaze. The position detection camera 14 detects the customer's position in real time and transmits the data to the image recognition unit 38. The position detection camera 14 may also be equipped with gaze detection and face recognition functions to detect whether the customer is looking at the showcase or display.

[0139] (Image recognition unit 38) The overall server 30 has an image recognition unit 38. The image recognition unit 38 estimates the distance between the customer and the showcase 10 based on video or images captured by the position detection camera 14, using a predetermined position on the showcase 10 (for example, the lower center of the showcase 10) as a reference. The image recognition unit 38 calculates the distance between the reference point on the showcase 10 and the customer's position based on the captured data from the position detection camera 14. The field of view angle and focal length of the position detection camera 14, and the customer's position (coordinates) in the image are used to calculate the distance. The distance estimation is performed based on the customer's position coordinates (x, y, z) within the field of view of the position detection camera 14. First, the image recognition unit 38 identifies a specific part of the customer's body, such as the head, shoulders, or torso, from the video captured by the position detection camera 14. Based on this, it calculates the center point of the customer's body and detects where the center point is located in the image. Next, based on the focal length and field of view information of the position detection camera 14, and the relative position of the showcase 10 on which the position detection camera 14 is installed from a reference point, the distance to the customer is calculated, for example, using triangulation. When a customer is moving, multiple frames of image data can be used to analyze the direction and speed of the customer's movement, enabling more accurate distance estimation. Specifically, the movement speed is calculated by dividing the change in the customer's position coordinates by time, and the distance to the showcase 10 is corrected in real time. It is also possible to use multiple cameras to integrate image data from different angles and estimate the customer's three-dimensional position with high accuracy. The image recognition unit 38 sets, with respect to the estimated distance, the range R2 in which the customer can see the screen of the showcase 10 and the range R1 in which the customer can recognize the products placed in the showcase 10. Ranges R1 and R2 can be set according to, for example, the estimated distance, the customer's height, the height and size of the showcase, the resolution and size of the display, the direction of the customer's gaze and face, and the ambient light. The boundaries of ranges R1 and R2 may be set as concentric circles, or as the sides or parts thereof of an ellipse, quadrilateral, or polygon.

[0140] The distance from showcase 10 to the customer is the most fundamental parameter in determining the R1 and R2 settings. When the distance is short, R1 is set small, widening the area in which the product can be directly viewed. Conversely, when the distance is far, R2 is set large, prioritizing the visibility of the product and advertisement on the screen.

[0141] The field of view of the position detection camera 14 may be necessary to accurately determine the customer's location. A wider field of view also widens the range of R1 and R2, allowing for the recognition of the movement and gaze of customers at a greater distance.

[0142] The customer's height is a parameter that determines the range of heights at which the screen and products can be viewed. In particular, if the customer is short, it is necessary to adjust R1 and R2 to be smaller. Note that the customer's height can be determined using the disclosure of Modification 1 of Embodiment 1.

[0143] The dimensions (height and width) of showcase 10 directly affect the calculation of R1 and R2. This is because the height of the showcase determines where the products and screens are visible from. For example, if the showcase is tall, R1 and R2 must be set appropriately according to the customer's eye level and height.

[0144] Display resolution and size also affect R2. A high-resolution display makes detailed product and advertising information easier to see from a distance, allowing for a larger R2 setting. On the other hand, with a low resolution or small display, customers can only perceive information when they are closer, so an R2 setting is required.

[0145] By utilizing gaze detection and face orientation detection, it is possible to determine which direction the customer is looking and adjust the application range of R1 and R2 accordingly. For example, if the customer is not facing the display case, R2 may widen, and the visible range may be automatically adjusted.

[0146] The brightness of ambient light can also be taken into consideration. If the surroundings are too bright or too dark, the settings for R1 and R2 can be adjusted. If ambient light is to be used as a parameter, a photometer may be provided in the showcase 10.

[0147] The image recognition unit 38 recognizes the customer's location from the image of the position detection camera and determines, based on the set ranges R1 and R2, whether the customer is in the range R2 where the screen of the showcase 10 is visible or in the range R1 where the customer can recognize the products placed in the showcase 10. The display determination unit 37 outputs a command to the display management unit 22 of the display controller 20 to switch between advertising mode and transparency mode according to the determination of the image recognition unit 38. The transparent touch display 11 switches between advertising mode and transparency mode and displays according to the switching command.

[0148] Figure 12 is a flowchart showing the processing procedure for modified example 3 of Embodiment 1.

[0149] In step S31, the image recognition unit 38 receives video from the position detection camera 14.

[0150] In step S32, the image recognition unit 38 determines whether the customer is within range R1, which is the range in which the products in the showcase 10 can be recognized. If it is determined that the customer is within range R1, the process proceeds to step S33. If it is determined that the customer is not within range R1, the process proceeds to step S34.

[0151] In step S33, the transparent touch display 11 of the showcase 10 is set to transparent mode.

[0152] In step S34, it is determined whether the customer is within range R2 of the screen of showcase 10. If it is determined that the customer is within range R2 of the screen of showcase 10, the process proceeds to step S35. If it is determined that the customer is not within range R2 of the screen of showcase 10, the process returns to step S32.

[0153] In step S35, the display mode of the display is set to advertising mode.

[0154] Alternatively, instead of the position detection camera 14, a distant motion sensor and a nearby motion sensor may be used. This makes it easier to determine if a person is nearby. Also, after the displayed content changes, there is no need to perform the next determination for a while. Specifically, when the display mode of the display (advertising mode and transparency mode) switches, a timer is started, and the image recognition unit 38 temporarily suspends the determination of the new customer's location for a period of time, for example, several seconds to tens of seconds (depending on the situation). This reduces the frequency of screen changes and lessens the burden on the customer.

[0155] As shown in Figure 13, switching to transparent mode is performed from advertising mode or off mode, and switching to advertising mode is performed from transparent mode or off mode. If the position detection camera 14 (or motion sensor) does not detect a person for a predetermined period of time, it may switch from advertising mode or transparent mode to off mode. This reduces unnecessary power consumption and improves energy-saving performance.

[0156] According to Modification 3 of Embodiment 1, when a customer is far from the showcase, the display automatically switches to advertising mode, prominently highlighting the product for the customer. At this time, basic information and features of the product are emphasized, creating a visual impact on the customer and clearly indicating what products are available in the showcase. This motivates the customer to become interested in the showcase and approach it further. On the other hand, when the customer approaches the showcase, the display switches to transparent mode, allowing them to directly view the product through the transparent display. In this transparent mode, the customer can examine the actual product in detail, potentially stimulating deeper interest and purchasing intent. The switching between transparent mode and advertising mode is performed automatically based on cameras and sensors that detect the customer's position and movement in real time, ensuring that the customer always receives the most optimal information.

[0157] (Modification 4 of Embodiment 1) Modification 4 of Embodiment 1 is directed towards an example in which a customer's interest in a product is determined by detecting the customer's gaze or movement, and the display mode is switched according to this determination and whether or not another customer is within the range detected by the camera. The showcase according to Modification 4 has a gaze and movement detection camera for detecting the customer's gaze or movement. The gaze and movement detection camera can be positioned in the same location as, for example, the camera 13 in Modification 1 of Embodiment 1 illustrated in Figure 6A. Alternatively, it can be used interchangeably with, for example, the camera 13 in Modification 1 of Embodiment 1 illustrated in Figure 6A.

[0158] Eye-tracking is the process of identifying where a customer is looking. For eye-tracking, a camera that captures the customer's face and eye movements (e.g., an infrared camera) can be used as an eye-tracking camera. This camera can track the customer's face orientation and pupil movements in real time and determine whether their gaze is directed towards the transparent touch display 11 or a product. In addition to the camera, the image recognition unit 38 may calculate the direction of the gaze using a face detection algorithm and an pupil detection algorithm. The image recognition unit 38 may further process image data from the camera to estimate the direction of the gaze from the pupil position and face orientation and determine whether the customer is looking at a product or advertisement through the transparent touch display 11. Furthermore, pupil movement may be detected using infrared light. Infrared sensors are less affected by external light and can accurately detect the gaze, thus providing stable results even in locations with unstable lighting conditions. Image processing by the camera and / or infrared sensor is performed by the image recognition unit 38.

[0159] Movement detection is a method for tracking customer movements and measuring their level of interest in products based on those movements. By tracking the trajectory of customer movements using a gaze-tracking camera, it is possible to detect from which direction a customer is approaching the display case or which products they are spending a long time in. Multiple cameras may be installed as gaze-tracking cameras to track customer movements from different angles, thereby detecting customer movements in three dimensions. This makes it possible to determine how customers are moving around the display case. Furthermore, the image recognition unit 38 may analyze the video data obtained from the gaze-tracking camera using AI to learn customer movements and behavior patterns. The AI ​​can analyze information such as which products a customer stopped in front of or which products they stayed in front of for a long time, and estimate their level of interest. The processing related to movement detection is performed by the image recognition unit 38.

[0160] The interest estimation parameters used to estimate customer interest include at least one of the following: gaze duration on the display, number of times the customer gazes on the display, dwell time along the customer's movement path, customer approach speed, customer movement direction, and changes in customer facial expression. By analyzing these interest estimation parameters individually or comprehensively, it becomes possible to estimate customer interest with high accuracy and switch to the optimal display mode. The duration of eye contact with a display is determined by measuring how long a customer's gaze lingers on a specific product or advertisement on the display, based on eye-tracking. The longer the eye contact time, the more interested the customer is considered to be in that product.

[0161] The number of times a customer repeatedly looks at a display is determined by measuring how many times they return their gaze to the same product or advertisement. A higher number of repetitions suggests a stronger level of interest. In particular, if a customer looks away and then returns to the display, it suggests a high level of interest.

[0162] The time customers spend in a particular area or product in front of a display case is determined by measuring how long they remain in front of that product or area. If a customer spends a long time in front of a particular product or area, it is considered that they have a high level of interest in that product.

[0163] Customer approach speed can be determined by measuring how quickly customers approach the display case. If customers approach the display case quickly, they may have a high level of interest and purchase intent. Conversely, if they approach slowly or pause briefly, their level of interest may be low.

[0164] The direction of customer movement is determined by tracking the direction from which customers approach the display cases and detecting the direction they are heading as they pass in front of specific products. This allows us to understand which range of products customers are particularly interested in.

[0165] Changes in a customer's facial expression are determined by analyzing their facial expressions using a face detection algorithm. If positive facial expressions such as smiles or eyebrow movements are observed, it can be assumed that the customer has a favorable reaction to the product.

[0166] Figure 14 is a flowchart illustrating the processing procedure according to Modification 4 of Embodiment 1.

[0167] In step S41, the image recognition unit 38 receives video from the gaze-tracking camera.

[0168] In step S42, the image recognition unit 38 determines, based on the video from the eye-tracking detection camera, whether the customer is in a position to recognize the products displayed in the showcase. Furthermore, the image recognition unit 38 determines, based on interest estimation parameters, whether the customer is interested in the products displayed in the showcase.

[0169] If the assessment determines that there is interest, proceed to step S43. If the assessment determines that there is no interest, proceed to step S44.

[0170] In step S43, the display is switched to transparent mode so that the customer can see the product.

[0171] If it is determined in step S44 that the customer is in a position to see the display case screen, the process proceeds to step S45. If it is not determined that the customer is in a position to see the display case screen, the process proceeds to step S46. Note that step S44 in Modification 4 of Embodiment 1 is the same as step S34 in Modification 3 of Embodiment 1, so the details are omitted.

[0172] In step S45, set the display to advertising mode.

[0173] In step S46, the display is set to transparent mode while simultaneously being turned off to off mode.

[0174] According to Modification 4 of Embodiment 1, even if a customer is near the showcase, if they are not interested in the product, the advertisement can be directed to another customer who is far enough away to see the showcase, thereby maximizing the appeal of the showcase. According to Modification 4 of Embodiment 1, the system can detect the customer's gaze and movement to automatically determine their level of interest in the product and optimally switch the display mode. This mechanism dynamically changes the showcase display based on customer behavior, resulting in the following effects: The system switches to transparent mode only when the customer is actually interested, reducing the display of unnecessary information. If the customer does not show interest in the product, the advertising mode switches to target another customer who is far away, effectively promoting the product or service. This ensures that the showcase always functions as an advertising medium, achieving efficient advertising display. If it is determined that the customer is not interested in the showcase or display based on their movement and gaze, the power to the display can be turned off, reducing unnecessary energy consumption. This also contributes to environmentally friendly energy saving. By using AI and image processing technology to track customer movement and gaze and analyze their level of interest, it is possible to understand customer behavior patterns. This provides data that can be used to optimize marketing strategies and improve future product placement and advertising strategies. Eye-tracking and movement detection enable display switching that responds to the behavior of individual customers, allowing for more flexible responses even when multiple customers are using the showcase simultaneously, by displaying content that suits their interests.

[0175] (Modification 5 of Embodiment 1) Modification 5 of Embodiment 1 is directed towards an example in which the display switches between transparent mode, advertising mode, and off mode depending on the customer's position. The configuration of Modification 5 of Embodiment 1 is the same as that of Modification 3 of Embodiment 1, so a detailed explanation is omitted.

[0176] Figure 15 is a flowchart illustrating the processing procedure for modified example 5 of Embodiment 1.

[0177] In step S51, the image recognition unit 38 receives video from the camera 13.

[0178] In step S52, the image recognition unit 38 determines whether the customer is within range R1, which is the range in which the products in the showcase 10 can be recognized. If it is determined that the customer is within range R1, the process proceeds to step S53. If it is determined that the customer is not within range R1, the process proceeds to step S54.

[0179] In step S53, the transparent touch display 11 of the showcase 10 is set to transparent mode. This allows customers who are determined to be within range R1 to recognize the products placed in the showcase 10 through the now transparent transparent touch display 11.

[0180] In step S54, it is determined whether the customer is within range R2 of the screen of showcase 10. If it is determined that the customer is within range R2 of the screen of showcase 10, the process proceeds to step S55. If it is determined that the customer is not within range R2 of the screen of showcase 10, the process proceeds to step S56.

[0181] In step S55, the display mode of the display is set to advertising mode. This allows customers determined to be within range R2 to see the advertisement displayed on the transparent touch display 11.

[0182] In step S56, the system switches to an off mode where the display is made transparent while simultaneously turning off the display's power. This makes it possible to reduce power consumption while the display remains transparent.

[0183] According to Modification 5 of Embodiment 1, energy efficiency can be improved by flexibly switching the display between three modes—transparent mode, advertising mode, and off mode—depending on the customer's position. When the customer is in a position where they cannot recognize the product or the transparent touch display 11, the power to the display is turned off, minimizing unnecessary energy consumption. This improves overall energy efficiency and reduces the environmental impact. When the customer is interested in the product and is within the range (R1) where they can see the product when they look at it, the display is switched to transparent mode, allowing the customer to directly see the product. This allows the product's appeal to be conveyed to the customer visually to the fullest extent, and is expected to stimulate purchasing intent. When the customer is not interested in the product or is away from it, the display is switched to advertising mode, allowing advertisements to be displayed effectively. This allows the showcase to be used not only as a product display but also as an advertising medium, maximizing the promotional effect of products and services. Because the display changes dynamically according to the customer's position and actions, the most appropriate information can be provided to the customer at the appropriate time. This improves the customer experience and is expected to increase interest in the showcase itself. Furthermore, avoiding unnecessary displays and cluttered information can reduce customer stress. Automatically detecting the customer's location and switching display modes accordingly streamlines showcase operation. This eliminates the need for manual operation and adjustments by store staff, leading to increased operational efficiency.

[0184] (Modification 6 of Embodiment 1) Modification 6 of Embodiment 1 relates to an example in which the showcase system 1 of Embodiment 1 is further equipped with a first camera for capturing distant locations and a second camera for capturing nearby locations.

[0185] A modified example 6 of Embodiment 1 of the showcase system includes a first camera that photographs a distant location and a second camera that photographs a nearby location.

[0186] (First camera) The first camera captures distant locations relative to the display case. It is specifically designed to capture distant customers in front of the display case, primarily covering a wide area. This allows for detection of the level of interest distant customers have in the display case and whether they are approaching it. The first camera can capture customers several meters or more away from the display case. Its wide field of view allows for the capture of individual movements even when multiple customers are visible simultaneously. The first camera captures the direction and posture of customers' faces to determine if they are looking at the display case. This allows for the determination of whether customers are showing interest in the display case.

[0187] (Second camera) The second camera captures the immediate vicinity of the showcase. The second camera is specialized in capturing nearby customers near the showcase and is responsible for detecting the movements and gaze of customers who are directly interested in the products. The second camera detects subtle movements and facial orientation of customers when they are very close to the showcase. This allows the system to determine whether customers are looking at or remaining near the products or transparent touch display 11 in the showcase. The second camera tracks the customer's facial orientation and gaze to determine in real time whether the customer is looking at the products or transparent touch display 11 in the showcase.

[0188] (Image recognition unit 38) The image recognition unit 38 is configured to analyze video data collected from two cameras. The first camera captures the overall movement of the customer at a distance, that is, before the customer approaches the transparent touch display 11 or the showcase, while the second camera captures the detailed movement of the customer at a nearby location, that is, when the customer approaches the showcase. The data acquired from these cameras can also be analyzed individually. By independently analyzing the movement at a distance and at nearby locations, it is possible to sequentially track the customer's movements and changes in their gaze from the moment they begin to show interest in the showcase to the moment they actually select a product, and to analyze changes in their level of interest. On the other hand, by analyzing this data complementaryly, it is possible to capture the customer's behavior pattern in a more three-dimensional way. By correlating the movement from a distance with the information on gaze and touch operations at nearby locations, it is possible to analyze how the products or advertisements that the customer initially showed interest in influenced their subsequent behavior. In this way, by combining data acquired from two cameras at different distances, more detailed and accurate behavioral analysis becomes possible.

[0189] The data acquired by these cameras is analyzed using AI and advanced image processing technologies. The AI ​​learns behavioral patterns based on customer movement and gaze data, and understands their level of interest in showcases and displays. For example, it can analyze in detail information such as which part of the display a customer is looking at, how long they maintain that gaze, and when they perform touch operations. This makes it possible to quantitatively evaluate which products customers are interested in and how specific advertisements influenced their behavior.

[0190] By leveraging AI and image processing technology, we can gain a deeper understanding of customer behavior patterns and levels of interest. For example, if a customer tends to approach a display case from a distance and focus their gaze on a particular product, it's highly likely that the advertising and information for that product are working effectively. Furthermore, by analyzing detailed eye-tracking data and touch actions at nearby locations, we can determine whether a customer is actually considering a purchase or is merely showing interest.

[0191] Furthermore, complementary analysis combining distant and nearby data makes it possible to estimate customer interest and purchasing intent based on factors such as their movement and speed as they approach from a distance, and changes in their actions and gaze after approaching. By analyzing in detail how customers approach from a distance, at what point they begin to show interest, and what decision they ultimately make, it is possible to optimize future showcase placement and advertising displays.

[0192] Figure 16 is a flowchart illustrating the processing procedure for a modified example 6 of Embodiment 1.

[0193] In step S61, the video footage of the area in front of the showcase, captured using the first camera and the second camera, is input to the image recognition unit 38.

[0194] In step S62, the image recognition unit 38 determines, based on the image captured by the first camera, that the customer is in a position to recognize the product and that the customer is facing the display case. If the determination result is Yes, the process proceeds to step S63. If the determination result is No, the process proceeds to step S64.

[0195] In step S63, the image recognition unit 38 outputs a command to set the display to transparent mode.

[0196] In step S64, the image recognition unit 38 determines, based on the image captured by the second camera, whether the customer is in a position to see the showcase screen. If the determination result is Yes, the process proceeds to step S65. If the determination result is No, the process proceeds to step S66.

[0197] In step S65, the image recognition unit 38 outputs a command to set the display to advertising mode.

[0198] In step S66, the image recognition unit 38 outputs a command to set the display to transparent mode and then to off mode, which turns off the power to the display.

[0199] By dividing the customer recognition into two cameras, the detection range can be widened.

[0200] According to Modification 6 of Embodiment 1, by combining the first and second cameras, the movements of distant and nearby customers can be detected more accurately. This allows for a detailed understanding of customer movements and gaze, and enables switching to the optimal mode accordingly. Specifically, it is possible to accurately determine whether a distant customer is showing interest in the showcase or whether a nearby customer is actually examining the products. If the first camera detects that a distant customer is interested in the showcase, the advertising mode is triggered, allowing for effective product promotion to the customer. Switching to advertising mode enables the display of advertisements that have a significant impact on customers, and the showcase itself functions as a dynamic advertising medium. If a customer approaches the showcase and shows interest in the products, this is detected by the second camera, and the system switches to transparent mode. In transparent mode, customers can view the actual products through the transparent touch display 11, allowing them to directly confirm the appeal of the products. This is expected to increase customer purchasing intent by showing them the actual products. By using two cameras, the movements of multiple customers can be tracked simultaneously, and even if multiple customers are in different locations, the optimal display mode can be provided for each. For example, by switching between advertising mode for distant customers and transparent mode for nearby customers, the system can cater to diverse customer needs in front of the showcase, improving the customer experience. If a customer shows no interest in the showcase or does not approach the product, the display can be turned off, reducing unnecessary energy consumption. This is expected to result in energy savings, contributing to environmental considerations and reduced operating costs. Because the display is not always on, but switches between advertising mode, transparent mode, and off mode as needed, the display usage time is optimized, and long-term durability is improved. This reduces wear and tear on the display, and is expected to reduce maintenance frequency and costs. Customer movement and gaze data collected by the two cameras can be analyzed using AI and image processing technology to gain a detailed understanding of customer behavior patterns and levels of interest.This will allow us to optimize future marketing strategies, product placement, and advertising content.

[0201] <Modification 7 of Embodiment 1: Product Registration Mode> Modification 7 of Embodiment 1 is an example directed towards a registration mode for registering a different product in the touch position identification area information when replacing a product in the showcase 10 with another product, and the components are the same as those shown in Figure 1.

[0202] A modification of Embodiment 1, Modification 7, will be described using Figure 17. Figure 17 is a diagram illustrating the information used when displaying product information on the screen in response to the swap button.

[0203] (Transition to product registration mode for transparent display) Switching from transparent mode, advertising mode, or off mode to product registration mode is performed, for example, using a display controller or store terminal 4 installed in the store, a tablet or smartphone, physical buttons on the showcase, or menu buttons on the transparent touch display 11 equipped with a display. In the case of store terminal 4, tablets, or smartphones, the instruction to switch to registration mode, made using physical buttons or menu buttons on the display, is received by the external device linkage unit 35 and input to the display determination unit 37. In the case of a showcase, the instruction to switch to registration mode, made using menu buttons on the transparent touch display 11, is received by the touch position recognition unit 21 of the display controller 20 and input to the display determination unit 37. In product registration mode, in order to make the products inside the warehouse visible from the outside, the transparent touch display 11 is initially set to transparent mode, and information necessary for product registration, such as replacement buttons and product names, is displayed for each touch position identification area on the screen.

[0204] (Display determination unit 37: Display of the swap button) The display determination unit 37 outputs a command to the transparent touch display 11 to display a swap button for each of the touch position identification areas on the screen, in response to an event that transitions the display mode to the product registration mode. In response to the swap button display command, the transparent touch display 11 displays the product swap button X and the product name in each of the touch position identification areas on the screen.

[0205] The swap button display command is generated, for example, from the swap button display information shown in Table 12. To explain the first row of Table 12, Button A (Button ID: Button_A) is displayed at button display positions (50,50) to (200,100) within touch position identification area A, and the product name (Product X) is displayed at product name display positions (250,150) to (400,250). Button A is used to swap Product X (Product ID: Product_X) in touch position identification area A (Touch position identification area ID: Region_A) with another product, and pressing Button A will display the product list.

[0206] [Table 12]

[0207] (Touch position recognition unit 21: Detects button touch) The touch position recognition unit 21 identifies the touched button based on the swap button display information.

[0208] (Touch position management unit 36: Product replacement touch event information 400) The touch position management unit 36 ​​creates product replacement touch event information 400 related to the product replacement touch event, according to the button identified by the touch position recognition unit 21. The "product replacement touch event information 400" consists of a touch ID set to identify the product replacement touch event and the button ID on the touched screen, as shown in Table 13, for example.

[0209] [Table 13]

[0210] The touch position management unit 36 ​​generates product list display information 500 that links product replacement touch event information 400 with replacement button display information 66. The product list display information 500 consists of, for example, a touch ID, a button ID, a touch position identification area ID, a product ID, a category ID, an action when the button is pressed, and a display mode for the list, as shown in Table 14.

[0211] [Table 14]

[0212] (Display determination unit 37: Display of product list) The display determination unit 37 creates a product list in response to the product list display information 500 from the touch position management unit 36 ​​and instructs the display to display it. In the example in Table 7, a product list of products belonging to category 1 is created and displayed in list view format.

[0213] When a user selects an item from the product list displayed on the screen, the information in the touch location identification area information 63 is rewritten.

[0214] (Product registration mode) This section explains the processing of each component in product registration mode, using the example of replacing product A with product B. For simplicity, the area, instructions, and product list related to product A are denoted with the letter A.

[0215] Figure 18 shows an example of the swap button and product list screen displayed on the screen when swapping product A with product B. The procedure for swapping product A with product B will be explained using Figure 18. When the store clerk switches to product registration mode, which is one of the maintenance modes, a product swap button and product name are displayed in each of the touch position identification areas on the transparent touch display 11. At this time, the display determination unit 37 controls the transparency of the display parts of the product swap button X and product list Y to a semi-transparent state in which the inside of the showcase and the stored products can be seen through these buttons and lists. Therefore, the store clerk can see the products behind the transparent touch display 11 through these buttons and lists. Note that "semi-transparent" is not limited to a transparency of 50%, but is any transparency greater than 0% and less than 100%. Therefore, the store clerk can see the products behind the transparent touch display 11. When the store clerk presses the product swap button X related to product A, the product list Y is displayed accordingly. The store clerk selects the replacement product B from the product list Y. Depending on the selection of product B, the information in the touch location identification area information 63 is rewritten. In other words, the touch location identification area ID that was associated with product A before rewriting is rewritten to product B after rewriting.

[0216] Figure 19 is a flowchart showing the processing procedure in Modification 7 of Embodiment 1.

[0217] In step S71, the display mode is switched to product registration mode. The display is switched to product registration mode using the store's display controller, physical buttons, terminal, etc. This displays a touch-location identification area on the display and activates the product replacement button.

[0218] In step S72, it is determined that a touch has been made via the product replacement button X. If it is determined that a touch has been made via the product replacement button X, the process proceeds to step S73. If it is determined that a touch has not been made via the product replacement button, the process proceeds to step S76.

[0219] In step S73, the product selection list is displayed. The product selection list is displayed in response to the touched product replacement button X. The user is then able to select a new product from the list.

[0220] In step S74, a product is selected from the product selection list and the register button is pressed. If the register button is pressed, proceed to step S75. If the register button is not pressed, proceed to step S78.

[0221] In step S75, the selected product information is registered at the touched location.

[0222] If a certain amount of time (a predetermined amount of time) has elapsed in step S76, the process proceeds to step S77. If the required amount of time has not elapsed, the process returns to step S72.

[0223] In step S77, the registration mode is terminated. As a result, the buttons and product list on the screen are hidden.

[0224] In step S78, if a certain amount of time (a predetermined time) has elapsed, the process proceeds to step S79. If the required time has not elapsed, the process returns to step S74.

[0225] In step S79, the registration mode is terminated. As a result, the buttons and product list on the screen are hidden.

[0226] According to Modification 7 of Embodiment 1, by utilizing the product registration mode, which enables efficient product replacement, products displayed in the showcase can be quickly and accurately replaced with other products. This reduces the time required for product replacement and improves maintenance efficiency. Furthermore, the frequency and duration of door opening and closing are reduced, suppressing the rise in internal temperature of refrigerated equipment such as showcases containing products, thereby improving energy-saving performance.

[0227] Because products can be selected via touch operation through an intuitive interface (replacement buttons and product lists displayed on a transparent screen), the operation is very intuitive and does not require complex settings, thus reducing the workload of store staff.

[0228] Product information can be easily managed. By pressing the swap button, a list of products categorized by type can be easily displayed, allowing for product selection. This ensures that product information in the showcase is always up-to-date, providing customers with accurate information. In product registration mode, the product name and button positions are clearly displayed on the screen while the product behind it is visible, resulting in high visibility and reduced operational errors. A specific touch area is set for each product, allowing for precise swapping operations for each product. This makes it possible to swap only specific products, enabling partial changes without affecting other products.

[0229] In this way, the efficiency of store staff improves, and they can always provide customers with accurate and up-to-date information, thus improving the overall operation of showcases and product displays.

[0230] <Modification 8 of Embodiment 1: Product registration using an external device> Modification 7 of Embodiment 1 was directed towards an example in which products are registered individually by individually touching the product list displayed on the screen. Modification 8 of Embodiment 1 was directed towards an example in which products are registered using the external device linkage unit 35. A modified example of Embodiment 1, Modification 8, will be described using Figure 20A. Figure 20A is a diagram illustrating the information used when registering a product using the external device linkage unit 35.

[0231] (Transition to product registration mode on the transparent display) Switching from the transparent mode, advertising mode, or off mode to the product registration mode is performed using, for example, a display controller installed in the store, the store terminal 4, a tablet or smartphone, a physical button provided on the showcase, a menu button on the display, and the like.

[0232] (Touch position management unit 36) The touch position management unit 36 acquires touch event information 40 regarding a touch event. The "touch event information 40" is provided as a database composed of, for example, a touch ID set to identify a touch event and position coordinates (x, y) on the touched screen, as shown in Table 15.

[0233] [Table 15]

[0234] The touch position management unit 36 generates touch position association information 50 that associates touch position coordinates with a touch position specific area. The touch position association information 50 is composed of, for example, a touch ID, a touch position specific area ID, and a product ID, as shown in Table 16.

[0235] [Table 16] <�

[0236] (External device cooperation unit 35) The external device cooperation unit 35 is configured to read product information from an external device. The external device may be, for example, the store terminal 4 as a barcode reader for reading a barcode attached to a product, or the store terminal 4 for photographing a barcode attached to a product or reading a QR code (registered trademark) regarding a product.

[0237] The external device cooperation unit 35 receives the touch position association information 50 from the touch position management unit 36 and starts the registration process of the product.

[0238] The external device linkage unit 35 reads the external device product information 70, which is information about a product from the store terminal 4 that has been read by the user. The "external device product information 70" includes, for example, a product ID, as shown in Table 17. The external device product information 70 may also include the product name and product information.

[0239] [Table 17]

[0240] When the external device linkage unit 35 receives external device product information 70 from the store terminal 4, it changes the product ID in the touch position linkage information 50. Specifically, it changes Product_X in the touch position specific area A (Region_A) of the touch position linkage information 50 to Product_Y. Since the changed touch position linkage information 50A, with its changed product ID, is linked to the touch position specific area information 63, changing the product ID in the touch position linkage information 50 to make it touch position linkage information 50A is equivalent to changing the product ID in the touch position specific area information 63. Furthermore, when registering a new product that is not yet registered in the product information 64, the external device linkage unit 35 may be configured to read not only the product ID but also the product name, product details, etc., from the "external device product information 70" and register them as new products.

[0241] (Display determining section 37) The display determination unit 37 may issue a command to the transparent touch display 11 to display the product name in all touch position identification areas on the screen, so that the user can confirm whether the registration has been performed correctly. This full display is performed, for example, when the user touches the product registration confirmation button. When the user presses this confirmation button, all product names registered in the showcase are displayed at once in the corresponding touch position identification areas, allowing the user to visually confirm on the display screen whether the registration has been performed correctly. Furthermore, the full display may be set to be displayed for a certain period of time and then automatically disappear. During this time, the user can compare the displayed product name with the actual location of the product and correct any errors immediately. The user can also manually end the full display by touching the confirmation complete button after completing the confirmation process.

[0242] Figure 20B is a flowchart showing the processing procedure in Modification 8 of Embodiment 1. The processing flow of Modification 8 of Embodiment 1 will be explained using Figure 20.

[0243] In step S81, the display mode is changed to product registration mode.

[0244] In step S82, it is determined whether or not the transparent touch display 11 is being touched. This is determined by the touch position management unit 36, which checks for the presence or absence of a touch event. If a touch is detected, the process proceeds to step S83. If no touch is detected, the process proceeds to step S85.

[0245] In step S83, the user reads product information using an external device such as a barcode reader. The external device linkage unit 35 reads the product information from the external device. If a reading event occurs, the process proceeds to step S84. If no reading event occurs, the process proceeds to step S87.

[0246] In step S84, the product information read at the touched location is registered. That is, the external device linkage unit 35 changes (or registers, if new) the product ID associated with the touch location identification area.

[0247] If a certain amount of time has elapsed in step S85, proceed to step S86. If a certain amount of time has not elapsed, return to step S81.

[0248] In step S86, the registration mode is terminated.

[0249] If a certain amount of time has elapsed in step S87, proceed to step S88. If a certain amount of time has not elapsed, return to step S83.

[0250] In step S88, the registration mode is terminated.

[0251] Furthermore, after step S84, the product name may be displayed across the entire touch-location area on the screen, providing a confirmation step for the user.

[0252] According to Modification 8 of Embodiment 1, even when there are many products, the time required for product registration can be shortened compared to selecting products from a product list, thereby improving work efficiency. By using an external device (e.g., a barcode reader or QR code reader), product registration can be performed quickly and accurately. In particular, the ability to register information about new products significantly improves work efficiency. By reading information from an external device through the external device linkage unit, the touched area and the product are accurately linked, preventing incorrect registration. The display determination unit is equipped with a function to display all registered product information, allowing the user to visually confirm that the product has been registered correctly. This prevents registration errors. Furthermore, the frequency and duration of door opening and closing are reduced, and the rise in internal temperature of refrigeration equipment such as showcases containing products is suppressed, thereby improving energy-saving performance.

[0253] <Modification Example 9 of Embodiment 1: Product Registration Using a Camera> Modification Example 9 of Embodiment 1 is directed to an example in which a product displayed in a showcase is photographed with a camera, the product is identified from the image, a touch position identification area is identified from the position of the product, and the identified product is registered as a product associated with the identified touch position identification area. For example, it focuses on the situation of product registration when significantly changing many products in the inventory situation of products.

[0254] (Transition to the Product Registration Mode of the Transparent Display) The switching from any of the transmission mode, advertisement mode, and off mode to the product registration mode is performed using, for example, a display controller installed in the store, a store terminal 4, a tablet or smartphone, a physical button provided on the showcase, a menu button on the transmissive touch display 11 provided with a display, etc.

[0255] (External Camera) Using an external camera, photograph the product displayed in the showcase from the front of the showcase. Arrange the product package so that it faces the front. This is because the product package is a key feature point for identifying the product. Also, photograph so that an object that can be a reference, for example, the outer frame of the showcase or the outer frame of the display door provided with the transmissive touch display 11, is also reflected in the image. This makes it possible to secure a reference for the position during image analysis.

[0256] (External Device Linkage Unit 35) The external device linkage unit 35 receives the photographed image from the external camera.

[0257] (Image Recognition Unit 38) The image recognition unit 38 processes the photographed image.

[0258] (Identification of the Product) The image recognition unit 38 uses an image analysis algorithm to detect the area of ​​products displayed in the showcase. For example, it uses object detection technology to identify the contours and feature points of each product. Feature points include the shape, color, logo, packaging design, and text (product name or brand name). These feature points are identified based on pixel information in the image and recognized as a unique pattern for each product. Alternatively, OCR (optical character recognition) technology may be used to recognize product names and descriptions written on product packaging, and this information may be used for product identification.

[0259] The image recognition unit 38 identifies the target product by comparing the product image obtained from the captured image with the product image contained in the product information 64 for each feature point. It compares the feature points extracted from the captured image with the data contained in the product information 64. It calculates the degree of agreement for each feature point. For example, if the average value of the degree of agreement for all feature points is greater than or equal to a predetermined value (e.g., 80%), it is determined to be a match. In addition, since text information is an important feature point for identifying a product, weights may be added to the text information.

[0260] (Identifying the central coordinates of the product) The image recognition unit 38 determines the center position coordinates of the product from the product's outline. The image recognition unit 38 detects the product's outline using, for example, an edge detection algorithm. It determines the center position coordinates of the product from the extracted outline. It converts the center position coordinates to pixels on the screen, using a reference object (such as the outer frame of a display case or the outer frame of a door) as a reference.

[0261] (Identifying the touch location area) (Touch position management unit 36) The touch position management unit 36 ​​compares the center position coordinates, which are based on pixels on the screen and obtained by the image recognition unit 38, with the touch position identification area of ​​the touch position identification area information 63 to determine which touch position identification area the center position coordinates belong to.

[0262] (Linking products to specific touch locations) The touch position management unit 36 ​​generates product mapping information consisting of the identified product and the identified touch position identification area. The product mapping information includes, for example, the product ID and product name of the identified product and the touch position identification area ID, as shown in Table 18.

[0263] [Table 18]

[0264] The touch position management unit 36 ​​changes the product ID and touch position identification area ID of the touch position identification area information 63 using the product mapping information.

[0265] (Display determining section 37) The display determination unit 37 may issue a command to the display to display the product name in all touch-location identification areas on the screen, so that the user can confirm whether the registration has been performed correctly. This full display is performed, for example, when the user touches the product registration confirmation button. When the user presses this confirmation button, all product names registered in the showcase are displayed at once in the corresponding touch-location identification areas, allowing the user to visually confirm whether the registration has been performed correctly. Furthermore, the full display may be set to be displayed for a certain period of time and then automatically disappear. During this time, the user can compare the displayed product name with the actual location of the product and correct any errors individually. The user can also manually end the full display by touching the confirmation complete button after completing the confirmation process.

[0266] According to Modification 9 of Embodiment 1, products are photographed in bulk using a camera, and product identification and linking to touch position identification areas are automated through image analysis, significantly improving work efficiency when registering many products at once. This is particularly useful during inventory. Compared to manual registration, using a camera and image recognition technology prevents human error. This reduces problems such as incorrect product registration and information omissions. The display determination unit 37 allows the user to view and confirm the registered product names all at once on the screen, visually verifying the accuracy of the registration. Errors can be corrected on the spot, improving the reliability of the registration process. Bulk photography with a camera and automatic analysis reduce the overall effort and time required for registration. Since individual manual registration is no longer necessary, the efficiency of store operations and inventory management is increased. The product registration process is significantly streamlined, reducing the burden of incorrect registration and verification work. Furthermore, the frequency and duration of door opening and closing are reduced, suppressing the rise in internal temperature of refrigerated equipment such as showcases where products are stored, thus improving energy efficiency.

[0267] <Embodiment 2> In Embodiment 1, a method for determining the touch position based on a touch sensor provided in the transparent touch display 11 was described. Embodiment 2 differs from Embodiment 1 in the following ways: firstly, Embodiment 2 is applicable to existing transparent displays without providing a touch-enabled display; secondly, in Embodiment 2, a camera 13A for detecting the touch position is provided in the showcase 10A; and thirdly, in Embodiment 2, the touch position determination area for determining the touch position is determined from an image captured by the camera 13A. Note that components having the same structure and function as those in Embodiment 1 may be omitted from description.

[0268] Figure 21 is a diagram showing the overall configuration of the showcase system 1A according to Embodiment 2. As shown in Figure 21, the showcase system 1A comprises a showcase 10A, a display controller 20A, a cloud server 30A, and a camera 13A. The display controller 20A and the cloud server 30A are configured to control the display of the transparent display 11A of the showcase 10A, and can be considered as controllers.

[0269] (Showcase 10A) Showcase 10A differs from showcase 10 of Embodiment 1 in that it includes a transparent display 11A and a camera 13A. Therefore, the differences will be explained in detail, and any overlapping parts will be omitted.

[0270] (Transparent display 11A) The transparent display 11A may be integrated with the door that opens and closes a customer-accessible showcase where customers can select and take out products themselves. Alternatively, the transparent display 11A may be installed as the front panel of a staff-accessible showcase where customers do not directly touch the products and staff retrieve them. The transparent display 11A does not need to have touch functionality. This is because, since a camera or image recognition technology that functions as a touch sensor is used, it is possible to automatically detect the area touched by the user even if the user does not directly touch the product.

[0271] (Camera 13A) Camera 13A is provided to recognize the area touched by the user on the transparent display 11A. Camera 13A is installed, for example, on top of the transparent display 11A and positioned to accurately capture the user's finger movements. The installation position of camera 13A is set at a height and angle that allows it to view the entire transparent display 11A, enabling high-precision recognition of touch operations over a wide area, regardless of the user's height or standing position.

[0272] The camera 13A may be installed at the bottom of the transparent display 11A. Installing the camera 13A at the bottom of the transparent display 11A allows for accurate capture of touch operations from a position close to the user's hands. In this configuration, the camera 13A can more easily track hand movements and touch positions, potentially improving recognition accuracy, especially when the user touches the bottom of the display.

[0273] The camera 13A may be installed on the side of the transparent display 11A. By installing the camera 13A on the left and right sides of the transparent display 11A and capturing the user's hand movements from the side, the touch position can be determined in three dimensions. This method can cover the entire transparent display 11A and may provide particularly strong recognition accuracy for lateral movements. It is also possible to use both the left and right cameras 13A to correct for perspective in the image.

[0274] Camera 13A may be installed at the top and bottom. By installing cameras 13A at the top and bottom, the touch position can be grasped three-dimensionally from two directions. This further improves the accuracy of touch recognition and, in particular, allows for coverage of the entire transparent display 11A, enabling a more flexible response to user operations.

[0275] The camera 13A may be installed on the ceiling or at a position higher than the showcase 10A. By installing the camera on the ceiling away from the showcase 10A or at a position higher than the showcase 10A, it is possible to capture a wide-angle image of the transparent display 11A. This is particularly effective when the showcase 10A is large.

[0276] Camera 13A continuously photographs the surface of the showcase 10A where the transparent display 11A is located. Preferably, camera 13A determines its field of view so that the frame and door frame of the showcase 10A are included in the shooting range. By recognizing these frames, the camera can calculate the coordinates for detecting the touch position by referring to the position of the frames. Furthermore, by referring to the frames, camera 13A can always understand the physical boundaries of the showcase 10A, thereby ensuring long-term data consistency.

[0277] (Display controller 20A) The display controller 20A controls the transparent display 11A and determines what content to display on the transparent display 11A according to the image from the camera 13A. The display controller 20A includes an image recognition unit 21A, a touch position determination unit 22A, a product position registration unit 23A, a display area determination unit 24A, and a display content determination unit 25A.

[0278] (Image recognition unit 21A) The image recognition unit 21A uses the image from the camera 13A to recognize the touch position coordinates (x,y) of the customer's touch on the display screen (displayable area; in this embodiment 2, simply referred to as the "screen") of the transparent display 11A. The image recognition unit 21A is equipped with an image processing algorithm for processing the video sent from the camera 13A in real time. It uses the contrast between the transparent display 11A and the background to recognize the outline of the touching finger or hand. Furthermore, it analyzes the movement, shape, and position information of the finger to accurately calculate the actual touch position coordinates (x,y). More specifically, it applies an edge detection algorithm to detect the outline of the user's hand or finger in the video sent from the camera 13A to identify the part of the transparent display 11A that the finger is touching.

[0279] Since camera 13A projects 3D space onto 2D, objects close to camera 13A appear larger, and objects farther away appear smaller. If this perspective phenomenon affects the recognition of touch position, projection transformation or perspective correction may be performed. To correct the distortion attributable to the perspective phenomenon, for example, projection transformation (homography transformation) may be applied. This makes it possible to convert the image coordinates on the 2D image obtained from the camera's viewpoint into screen coordinates on the transparent display 11A. Points can be set on the frame of the showcase 10A, the four corners of the transparent display 11A, or predetermined fixed positions, and projection transformation can be performed based on these coordinates. This makes it possible to accurately map the coordinates on the camera image to the screen coordinates on the transparent display 11A.

[0280] In this way, the image recognition unit 21A recognizes the touch position coordinates (x,y) of the customer's touch on the screen of the transparent display 11A. The reference point and units of the touch position coordinates (x,y) can be set arbitrarily, but it is preferable to set the reference point of the touch position coordinates (x,y) to the reference point of the screen of the transparent display 11A (generally the upper left corner), and to use pixels, which are the units of the screen size of the transparent display 11A, as the units. This ensures consistency between the screen size and the touch position, and since graphic elements (buttons, icons, sliders, etc.) are usually arranged in pixels, if the touch position is in pixels and the starting point of the coordinate system matches, the touch operation and the coordinates of the graphical elements can be directly correlated. Furthermore, since the touch position in pixels perfectly matches the screen coordinate system, there is no need to convert to another coordinate system, which reduces the complexity of data processing and coordinate calculations.

[0281] The image recognition unit 21A can detect a person's gaze based on the image from camera 13A and determine whether or not the person is looking at the transparent display 11A. For example, face detection technology can be used for gaze detection. Camera 13A uses face recognition technology to detect a person in front of the transparent display 11A, recognizing the facial features of the person in the image (such as the relative positions of the eyes, nose, and mouth) and determining the position and orientation of the face. For example, a face detection algorithm can be used. After the face position is determined, the unit further focuses on the eye area and detects the position of the pupil. This is done by detecting the outline of the eye and the dark area of ​​the pupil. Once the pupil position is known, the direction of the gaze can be estimated. For high-precision gaze detection, a technique using a separate infrared camera from camera 13A to precisely detect the pupil position can also be utilized. After detecting the pupil position, the direction of the gaze is estimated in conjunction with the orientation of the entire face. The direction of the gaze can be calculated using the relative positional relationship between the face orientation (horizontal and vertical angles) and the center position of the pupil. This information allows us to determine whether the user is looking at the transparent display 11A or facing another direction. Alternatively, the direction of the gaze may simply be determined based on the orientation of the person's face.

[0282] If the image recognition unit 21A determines that there is no person in front of the transparent display 11A, it may erase the information displayed on the transparent display 11A.

[0283] (Touch position determination unit 22A) The touch position determination unit 22A determines, based on the product position information held by the product position registration unit 23A, which area on the screen was touched by the touch position coordinates (x,y) obtained by the image recognition unit 21A. The product position information can be provided as a database having fields for a division area ID, division area name, start position (x1,y1) and end position (x2,y2) of the division area, size of the division area, and product ID for uniquely identifying the product, as shown in Table 19.

[0284] [Table 19]

[0285] The touch position determination unit 22A uses the product position information to determine which region the touch position coordinates (x,y) belong to.

[0286] (Product location registration unit 23A) The product location registration unit 23A holds product location information relating to the positions on the screen of the transparent display 11A corresponding to the positions of multiple products displayed in the showcase 10A. The product location information may be provided as a database, as shown in Table 19. For example, the first row of Table 19 indicates that Region A, which has Region_A as its division region ID, is defined by (0,0) to (500,300) as its start position (x1,y1) and end position (x2,y2), has a size of 500x300 pixels, and when the touch position coordinates (x,y) fall within this Region A, information about the product with Product_A as its product ID will be displayed at a predetermined position. The display region information held by the display region determination unit 24A is used to determine where on the screen of the transparent display 11A the product information will be displayed.

[0287] The figures in Table 19 are merely examples. As shown in Table 19, the sizes of the divided areas do not have to be the same. The number, size, and shape of the divided areas can be flexibly changed according to the display layout of the multiple products actually displayed in showcase 10A and the shapes of the products, allowing the optimal division to be selected according to the actual usage environment.

[0288] (Display area determination section 24A) The display area determination unit 24A has display area information regarding where on the screen of the transparent display 11A the product information will be displayed.

[0289] [Table 20]

[0290] Display area information is provided by a database containing, for example, a display area for identifying a display area for displaying a product identified by a product ID, a display area name, the start position (x1, y1) and end position (x2, y2) of the display area, the size of the display area (width x height), and a product ID for uniquely identifying the product, as shown in Table 20.

[0291] For example, the first row of Table 20 indicates that display area 1, which has DisplayArea_1 as its display area ID, has a size of 500x500 pixels, defined by a start position (x1, y1) and an end position (x2, y2) of (100, 200) to (600, 700), and that information about the product with Product_Z as its product ID is displayed in area 1.

[0292] The values ​​in Table 20 are merely examples. As shown in Table 20, the size of the display area does not have to be the same. The display area can be flexibly set according to the characteristics of the transparent display 11A and the size of the product information and advertisements. For example, if a product is vertically oriented, it is desirable that the area for displaying the product information be set to expand vertically. In this case, the start and end positions of the display area are determined considering the aspect ratio of the product itself and the display area of ​​the entire display screen of the transparent display 11A. Furthermore, the display area can be set so that important product information (price, features, etc.) is placed in a position that maximizes user visibility. For example, if a product is displayed near the center of the transparent display 11A, the information about that product will be balanced so as not to be too biased towards the top or bottom of the screen. For this reason, the display area determination unit 24A may have an algorithm for automatically setting the appropriate position and size for each product. Moreover, the display area settings may be dynamically changed in response to external events, as in Embodiment 1. In particular, when multiple products are displayed simultaneously and a user taps on multiple products, the display area on the transparent display 11A can be appropriately divided for each product, and adjusted so that the information for each product does not overlap.

[0293] Furthermore, the product location information in Table 19 and the display area information in Table 20 are linked by the product ID. For example, if the touch location is within divided area C, the product information for the product with product ID Product_Z will be displayed. And since the display area for product ID Product_Z in Table 20 corresponds to display area 1, the product information for the product with product ID Product_Z will be displayed in display area 1.

[0294] (Display content determination section 25A) The display content determination unit 25A links product location information, display area information, and product advertising information, and has linking information which is intermediate information between these three pieces of information. These three pieces of information are linked together via a common product ID.

[0295] [Table 21]

[0296] The linking information is provided by a database that includes, for example, a segmented area ID, a segmented area name, a display area ID, a display area name, a product ID, and product information.

[0297] The first row of Table 21 indicates that if the touch position coordinates (x,y) are within the divided area A, the product information for product X will be displayed in the display area 3 on the screen.

[0298] The display content determination unit 25A outputs an instruction to the display unit of the transparent display 11A to display product information in the display area according to the location where the touch position coordinates (x,y) are detected, based on the linked information.

[0299] (Cloud Server 30A) The cloud server 30A is wirelessly connected to the display controller 20A. The cloud server 30A is equipped with a product information storage unit 31A.

[0300] (Product information storage section 31A) The product information storage unit 31A holds product information relating to products and advertisements. The product information includes, for example, a product ID and product advertisement information, as illustrated in Table 3. Figure 22 is a flowchart showing the processing procedure in Embodiment 2. The processing procedure of the showcase system 1A will be explained using Figure 22.

[0301] In step S1A, continuous imaging of the transparent display 11A is started using the camera 13A installed in the showcase 10A.

[0302] In step S2A, the image recognition unit 21A uses the image from the camera 13A to recognize the touch position coordinates (x,y) of the customer's touch on the screen of the transparent display 11A. The touch position determination unit 22A then determines which area was touched based on the touch position coordinates (x,y) on the screen obtained by the image recognition unit 21A, using the product position information held by the product position registration unit 23A. If the touch position determination unit 22A makes an appropriate determination in step S2A, the process proceeds to step S3A. If the touch position determination unit 22A is unable to make an appropriate determination in step S2A, the process proceeds to step S4A.

[0303] In step S3A, the display content determination unit 25A outputs an instruction to the display output unit 12A of the transparent display 11A to display product information in the display area according to the location where the touch position coordinates (x,y) were detected, based on the linked information.

[0304] In step S4A, if the image recognition unit 21A determines that there is no person based on the image from camera 13A, it proceeds to step S6A. If it determines that there is a person, it repeats step S4A.

[0305] In step S5A, the information displayed on the screen is erased.

[0306] In step S6A, nothing is displayed on the screen.

[0307] The showcase system 1A of Embodiment 2 is compatible with a transparent display 11A without touch functionality. It eliminates the need to install a display with touch functionality and is applicable to existing transparent displays. This allows for the detection of touch positions using cameras and image recognition technology without modifying existing displays, significantly reducing implementation costs.

[0308] Furthermore, high-precision touch position detection is possible using camera 13A. By detecting the touch position using camera 13A, touch operations over a wide area can be recognized with high precision, regardless of the user's height or standing position. In particular, the placement of the cameras and the use of multiple cameras for three-dimensional recognition enable more detailed detection of the touch position.

[0309] Furthermore, it contributes to improved hygiene through contactless operation. In Embodiment 2, the touch position can be detected without the user directly touching the display, thus providing a contactless interface. This reduces hygiene risks, especially in public places and stores where many people may touch the display, and provides users with a sense of security.

[0310] Furthermore, energy savings can be achieved through the eye-tracking function. If the customer is not looking at the transparent display 11A, or if there is no one in front of the transparent display 11A, the information on the display 11A can be turned off. This eye-tracking function avoids unnecessary displays and reduces power consumption, enabling environmentally friendly operation.

[0311] Furthermore, the showcase system 1A of Embodiment 2 has broad applicability. Embodiment 2 is compatible with various showcases equipped with a transparent display 11A, and can provide an environment in which customers can examine products without touching them. This makes it a highly versatile system that can be used in both staff-retrieval and customer-retrieval showcases.

[0312] Thus, Embodiment 2 offers advantages such as cost reduction, high-precision operation detection, improved hygiene, and energy saving. Furthermore, since the frequency and duration of door opening and closing are suppressed, the rise in internal temperature of refrigerated equipment such as display cases containing goods is suppressed, thus improving energy saving performance.

[0313] (Modification 1 of Embodiment 2) Modification 1 of Embodiment 2 will now be described. Modification 1 of Embodiment 2 concerns the size of the divided region illustrated in Table 19. According to Modification 1 of Embodiment 2, the size of the divided region is set based on the capabilities of the camera 13A and the image recognition unit 21A.

[0314] Here, "camera 13A capabilities" refer to the resolution, field of view, and frame rate of the images the camera can acquire. The higher the capabilities, the more accurately the area on the display can be captured, and the more accurately touch positions and user movements can be detected. "Image recognition unit 21A capabilities" refer to the processing speed for analyzing image data acquired from camera 13A, the accuracy of object (e.g., fingers and hands) recognition, and the ability to determine touch positions. The higher the processing power of image recognition unit 21A, the more accurately touches can be detected even in smaller divided areas. Conversely, if the recognition accuracy is low, it is necessary to increase the size of the divided area to prevent misrecognition. In this way, the optimal size of the divided area is determined based on the capabilities of camera 13A and image recognition unit 21A.

[0315] (Modification 2 of Embodiment 2) Modification 2 of Embodiment 2 will now be described. Modification 2 of Embodiment 2 concerns a case where the product advertising information exemplified in Table 3 has a hierarchical structure consisting of first product advertising information, second product advertising information, and third product advertising information. The first product advertising information in the first layer is, for example, a section where general information and basic advertisements about the product are displayed. The second product advertising information in the second layer is information that users can access from the first layer by touching the screen or the like if they are interested in the information displayed in the first product advertising information and want to know more detailed information. The second product advertising information in the second layer provides deeper information such as detailed product specifications, function descriptions, and usage instructions. The third product advertising information in the third layer is information that users can access from the second layer if they want to further check the second product advertising information in the second layer. The third product advertising information in the third layer displays more specialized information and user support content. For example, this may include product warranty information, technical specifications, contact information for support desks, or user reviews and Q&A.

[0316] Figure 23 shows an example of displaying the first product advertisement information A at the first level, the second product advertisement information B at the second level, and the third product advertisement information C at the third level. When displaying such hierarchical information, the display area can be allocated so that the first product advertisement information at the first level, the second product advertisement information at the second level, and the third product advertisement information at the third level do not overlap.

[0317] Figure 24 is a flowchart showing the processing procedure for a modified example of Embodiment 2.

[0318] In step S11A, the camera continuously captures images of the display. The images acquired by the camera are used to accurately determine the touch position on the display.

[0319] In step S12A, the image recognition unit 21A and the touch position determination unit 22A determine whether or not a person has touched the product's location. If it is determined that a touch has occurred, the process proceeds to step 13-1A. If it is not determined that a touch has occurred, the process proceeds to step S14A.

[0320] In step S13-1A, the display content determination unit 25A obtains product information and advertisements corresponding to the product that matches the product location information and touch location information from the product information storage unit 31A, the display area determination unit 24A determines the display area, and displays it on the transparent display 11A.

[0321] In step S13-2A, it is determined whether the area where the information is displayed has been touched. If it is determined that it has been touched, the process proceeds to step S13-3A. If it is not determined that it has been touched, the process proceeds to step S15A.

[0322] In step S13-3A, the display content determination unit 25A obtains hierarchical information of information matching the touch position information from the product information storage unit 31A, the display area determination unit 24A determines the display area, and displays it on the transparent display 11A.

[0323] In step S14A, nothing is displayed on the transparent display 11A.

[0324] In step S15A, the image recognition unit 21A determines whether or not there is a person in the image from the camera. If it is determined that there is a person, the process returns to step S13-2A. If it is determined that there is no person, the process proceeds to step S16A.

[0325] In step S16A, the information on the transparent display 11A is erased.

[0326] According to Modification 2 of Embodiment 2, the user experience can be improved by providing hierarchical information. Modification 2 of Embodiment 2 employs a hierarchical information display. The first level provides basic information about the product, and if the user becomes more interested, they can move to the second and third levels to obtain more detailed and specialized information. This mechanism allows users to acquire information step by step according to their interests, thus improving the user experience without displaying excessive information at once. In addition, user satisfaction is improved because they can efficiently access the information they need.

[0327] This improves the efficiency of information display. Because different information is displayed at each level, it avoids displaying unnecessary detailed or specialized information to users who were not interested in the product at the first level. In this way, the information is displayed in stages, making the display of information on the screen more efficient. This reduces the load on the display and prevents unnecessary resource consumption.

[0328] Optimal allocation of display area is possible. Because the display area is allocated so that information at each level does not overlap, the displayed information is visually organized and easy for the user to understand. Furthermore, by displaying different information at each level, the limited display area can be used effectively. This allows users to smoothly access the necessary information and enables intuitive operation.

[0329] Energy savings can be achieved. In steps S14A and S16A mentioned above, a state is achieved where nothing is displayed on the display or information is erased. This function reduces the energy consumption of the display when there is no user or when no unnecessary information is displayed, resulting in energy savings. This improves the overall energy efficiency of the system.

[0330] As described above, according to the modified version 2 of Embodiment 2, technical effects such as the provision of hierarchical information, improved information display efficiency, enhanced interaction, and improved energy efficiency can be obtained. This improves user convenience and the overall operational efficiency of the system.

[0331] (Modification 3 of Embodiment 2) Modification 3 of Embodiment 2 will now be described. Modification 3 relates to a means for returning to the initial state when product advertising information is displayed on the screen after touching the screen of the transparent display 11A. Here, "initial state" refers to the state in which no information is displayed on the screen. As shown in Figure 25, in Modification 3, the divided area corresponding to the user's touch position does not display product advertising information, but a close button for closing the product advertising information displayed in the display area is displayed. When the user presses the close button, the product advertising information displayed in the display area disappears. By providing a close button, the effort required for the user to find the close button when they want to close the information and return to the initial state can be reduced. Also, since it is the position that was first touched, the close button can be pressed regardless of height, etc.

[0332] Figure 26 is a flowchart showing the processing procedure for modified example 3 of Embodiment 2.

[0333] In step S21A, the screen of the transparent display 11A is photographed with the camera 13A.

[0334] In step S22A, the image recognition unit 21A and the touch position determination unit 22A determine if a person has touched the product's location. If a touch is detected, the process proceeds to step S23A; otherwise, the process proceeds to step S26A.

[0335] In step S23A, the display content determination unit 25A retrieves product information and advertisements corresponding to the product that matches the product location information and touch location information from the product information storage unit 31A, the display area determination unit 24A determines the display area, and displays it on the transparent display 11A.

[0336] In step S24A, the image recognition unit 21A determines that the close button has been touched. If it is determined that the button has been touched, the process proceeds to step S25A; otherwise, the process proceeds to step S27A.

[0337] In step S25A, the information on the transparent display 11A is erased.

[0338] In step S26A, nothing is displayed on the transparent display 11A.

[0339] In step S27A, the image recognition unit 21A determines that there is no person in the image from camera 13A. If it is determined that there is no person, the process proceeds to step S25A. If it is determined that there is a person, the process proceeds to step S24A.

[0340] According to Modification 3 of Embodiment 2, a quick return to the initial state is possible. By touching the "close button" to close the product advertisement information displayed on the transparent display 11A, the user can immediately erase the information and return the transparent display 11A to its initial state (nothing is displayed). This allows the user to quickly remove unnecessary information from their field of vision. By displaying the "close button" at the position where the user first touches, the user can easily operate the button regardless of their height or reach. This eliminates the need for the user to scan the entire transparent display 11A to find the close button. Because the close button is displayed directly at the touched position, the risk of the user touching an unintended location is reduced. This improves the accuracy of the operation. Because the close button is automatically displayed at the touch position, an easy-to-use interface is provided for everyone, regardless of height or operating ability. This reduces stress on the user during operation and improves the user experience. Because information and the close button are displayed according to the touch position, the display area of ​​the transparent display 11A can be used efficiently, and information can be provided to the user in an easy-to-see manner.

[0341] In the above-described embodiment, the notation "...part" used for each component may be replaced with other notations such as "...circuitry", "...assembly", "...device", "...unit", or "...module".

[0342] The configurations shown in the above embodiments are merely examples, and it is possible to combine them with other known technologies, combine different embodiments, and omit or modify parts of the configuration without departing from the gist of the invention. [Industrial applicability]

[0343] One embodiment of the present disclosure is useful for a showcase. [Explanation of symbols]

[0344] 1. 1A Showcase System 10, 10A Showcase 11. Transparent Touch Display 11A Transparent Display 12 Display Output Section 13, 13A Camera 14. Camera for position detection 20, 20A Display Controller 21 Touch position recognition unit 22 Display management department 30 Overall Server 31 Showcase Management Department 32 Display area management section 33 Advertising Management Department 34 Product Management Department 35 External Device Integration Section 36 Touch Position Management Unit 37 Display determination section 38 Image Recognition Unit 4 Store terminals 21A Image recognition section 22A Touch position determination unit 23A Product Location Registration Section 24A Display area determination section 25A Display content determination section 30A Cloud Server 31A Product information storage department

Claims

1. A display case capable of accommodating goods, A display screen arranged to allow the aforementioned product to be visible, A touch position detection device configured to detect the touch position on the display screen, A controller configured to display product information relating to the product associated with the touch position on the display screen, according to the touch position, A display case equipped with [unclear] features.

2. The association between the touch position and the product is performed based on the touch position identification area on the display screen. The aforementioned touch position identification area is an area defined by dividing the display screen into multiple areas depending on the product. The showcase according to feature 1.

3. The system is configured to set the position of the product information display area so as to be spaced apart from the touch location identification area where the touch position was detected. The showcase according to feature 2.

4. The association between the touch position and the product is performed based on the touch position identification area on the display screen. The display area associated with the aforementioned product is configured to be set outside the touch position identification area. The showcase according to feature 1.

5. It is further equipped with sensors capable of detecting people, When the person touches the display screen, the controller is configured to change the position of the display area on the display screen according to the height of the person detected by the sensor. The showcase according to claim 3 or 4.

6. The aforementioned controller, The system is configured to correct the touch position identification area based on the position of the person who touched the display screen and the touch position on the display screen. The showcase according to claim 2 or 4.

7. It is further equipped with sensors capable of detecting people, The aforementioned controller, The system is configured to set to an advertising mode that displays the product information across the entire display screen when it is determined that a person is within a first predetermined distance from the showcase. The showcase according to feature 1.

8. The aforementioned controller, The system is configured to change from advertising mode to transparency mode when it is determined that a person is within a second predetermined distance, which is closer to the showcase than the first predetermined distance. The aforementioned transparency mode is a display mode in which the product is visible from the outside and the touch position detection device is in a state where it can detect touch events. The showcase according to claim 7, characterized in that

9. The aforementioned display screen allows for control of transparency. The aforementioned controller, The display screen is configured to switch the display mode, The switching of the aforementioned display modes is performed by: In a transparent mode, the aforementioned product is visible from the outside and the touch position detection device is in a state where it can detect touch events. An advertising mode that displays the product information across the entire display screen, The process is performed between the product being visible from the outside and a power-off mode in which the touch position detection device is not in a state where it can detect touch events. The showcase according to feature 1.

10. The switching of the display mode is performed based on at least one of the following: the time the person's gaze lingers on the display screen, the number of times the person gazes on the display screen, the time the person stays in a line of motion, the speed at which the person approaches, the direction of the person's movement, and the change in the person's facial expression. The showcase according to feature 9.

11. The switching of the display mode is performed based on at least one of the following: the dwell time of the gaze of the person closest to the showcase on the display screen, the number of times the person closest to the showcase gazes on the display screen, the time the person closest to the showcase stays in place along their movement path, the approach speed of the person closest to the showcase, the direction of movement of the person closest to the showcase, and the change in the facial expression of the person closest to the showcase. The showcase according to feature 9.

12. The showcase according to claim 3, characterized in that the size of the display area is set according to the number of times the user touches it.

Images