Control system, control method, and program
A control system adjusts the aerial image's parameters based on user position to prevent others from seeing sensitive information in contactless displays, enhancing privacy in facilities with frequent user changes.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- NEC CORP
- Filing Date
- 2022-11-14
- Publication Date
- 2026-05-19
AI Technical Summary
Contactless displays in facilities like retail stores and government offices face issues with user privacy, as frequent user changes necessitate preventing others from seeing personal information or sensitive screens.
A control system that detects a user's face using a sensor and adjusts the aerial image's height, position, orientation, and size based on the user's position to prevent others from viewing specific screens.
The system effectively deters peeping by making sensitive information difficult for non-users to see while ensuring the display is easily viewable for the intended user.
Smart Images

Figure 0007861860000001 
Figure 0007861860000002 
Figure 0007861860000003
Abstract
Description
Technical Field
[0001] The present disclosure relates to a control system and the like.
Background Art
[0002] Contactless displays are known. For example, Patent Documents 1, 2, and 3 describe forming an image in the air using a contactless display.
[0003] In a contactless display, an aerial image may be displayed so that it is easy for a user to view. For example, Patent Document 1 describes displaying an aerial image within a range that can be perceived by an observer based on the viewpoint position of the observer. Also, for example, Patent Document 2 describes that an aerial display device is installed in a kitchen and adjusting the display position of an image on a display included in the aerial display device according to the height of the user. Further, Patent Document 2 describes providing a control mechanism such as a motor in a housing so that the position or angle of a display and an optical element included in the aerial display device can be finely adjusted.
[0004] Also, in a retail store such as a convenience store, a contactless display may be used for product registration or checkout. For example, Patent Document 3 describes using a contactless display for a self-POS (Point Of Sales).
Prior Art Documents
Patent Documents
[0005]
Patent Document 1
Patent Document 2
Patent Document 3
Summary of the Invention
[0006] For example, when using contactless displays in facilities such as retail stores and government offices, it is expected that users will be changing frequently. In such cases, users may not want their information to be seen by others.
[0007] One example of the purpose of this disclosure is to provide a control system that helps to suppress peeping. [Means for solving the problem]
[0008] A control system in one aspect of the present disclosure includes detection means for detecting a person's face using a sensor, and control means for controlling the aerial image of a non-contact display to have a predetermined height, position, orientation, and size when displaying a screen other than a specific screen from a plurality of screens to be displayed on the non-contact display, wherein the control means controls the height, position, orientation, and size of the aerial image that displays the specific screen to change based on the position of the detected person's face when the specific screen is being displayed.
[0009] A control method in one aspect of the present disclosure involves detecting a person's face using a sensor and, when displaying a screen other than a specific screen from a plurality of screens to be displayed on a non-contact display, executing a process to control the aerial image of the non-contact display to have a predetermined height, predetermined position, predetermined orientation, and predetermined size, wherein, when the specific screen is being displayed, the control process is configured to change at least one of the height, position, orientation, and size of the aerial image displaying the specific screen based on the position of the detected person's face.
[0010] A program in one aspect of the present disclosure causes a computer to perform a process that, when detecting a person's face using a sensor and displaying a screen other than a specific screen from a plurality of screens to be displayed on a non-contact display, controls the aerial image of the non-contact display to be at a predetermined height, predetermined position, predetermined orientation, and predetermined size, and in the controlling process, when the specific screen is being displayed, controls the height, position, orientation, and size of the aerial image that displays the specific screen to be changed based on the position of the detected person's face.
[0011] Each program may be stored on a non-temporary storage medium that is readable by the computer. [Effects of the Invention]
[0012] According to this disclosure, it is possible to deter peeping. [Brief explanation of the drawing]
[0013] [Figure 1] This is a block diagram showing an example configuration of the control system according to Embodiment 1. [Figure 2] This flowchart shows an example of operation of the control system according to Embodiment 1. [Figure 3] This is an explanatory diagram illustrating an example of how an aerial display can be used as a display device in a POS system. [Figure 4] This is a simplified diagram illustrating an aerial display. [Figure 5] This is an explanatory diagram showing an example of connecting the control system to other devices. [Figure 6] This is a block diagram showing an example configuration of a control system according to Embodiment 2. [Figure 7] This is an explanatory diagram illustrating an example of how an imaging device detects a user's face. [Figure 8] This is an explanatory diagram illustrating an example where the angle between the display and the optical elements contained within the aerial display is controlled. [Figure 9] It is an explanatory diagram showing an example in which the display of a display included in an air display is controlled. [Figure 10] It is an explanatory diagram showing an example in which the height of a stand is controlled. [Figure 11] It is an explanatory diagram showing an example in which the name of a user and point information are displayed at a specific position. [Figure 12] It is an explanatory diagram showing an example in which the face of a person other than the user is detected. <opposite [Figure 13] It is an explanatory diagram showing an example of the display position of an aerial image according to the position of the face of another person. [Figure 14] It is an explanatory diagram showing an example of shifting an aerial image to the lower right when another person is taller than the user and is at the left rear. [Figure 15] It is an explanatory diagram showing an example in which a settlement screen and an advertisement of a product are included in an aerial image. [Figure 16] It is an explanatory diagram showing an example of the display position of an aerial image according to the position of the face of another person. [Figure 17] It is an explanatory diagram showing an example of displaying the name of the user and point information at the lower right when another person is taller than the user and is at the left rear. [Figure 18] It is a flowchart showing an example of an operation of a control system according to Embodiment 2. [Figure 19] It is an explanatory diagram showing an example of the hardware configuration of a computer.
Embodiments for Carrying Out the Invention
[0014] Hereinafter, embodiments of a control system, a control method, a program, and a non-temporary recording medium for recording the program according to the present disclosure will be described in detail with reference to the drawings. This embodiment does not limit the disclosed technology.
[0015] Here, when using a non-contact display, facilities where user usage scenes that change one after another occur include various ones such as retail stores, government offices, hospitals, accommodation facilities such as hotels, stations, airports, etc., and are not particularly limited.
[0016] (Embodiment 1) First, the basic functions of the control system in Embodiment 1 will be described. Figure 1 is a block diagram showing an example configuration of the control system according to Embodiment 1. The control system 10 comprises a detection unit 101 and a control unit 102.
[0017] The detection unit 101 detects a person's face using a sensor. The sensor is not particularly limited and can be an imaging device, a human presence sensor, etc. The person may be a user of the non-contact display, or another person who is not a user of the non-contact display. Another person may be, for example, a person standing behind the user. In the following explanation, an aerial display will be used as an example of a non-contact display.
[0018] The control unit 102 controls the aerial display so that the aerial image formed on the aerial display is at a predetermined height, position, orientation, and size when displaying a screen other than a specific screen from among multiple screens to be displayed on the aerial display. The control method will be explained using Embodiment 2. The display mode in which the aerial image is at a predetermined height, position, orientation, and size is also called the default mode.
[0019] The control unit 102 then controls the display of a specific screen by changing at least one of the height, position, orientation, and size of the aerial image that displays the specific screen, based on the position of the detected person's face. A display mode in which at least one of the height, position, orientation, and size of the aerial image is changed from the default mode is also called an individual mode. However, when the control unit 102 controls the display of a specific screen by changing at least one of the height, position, orientation, and size of the aerial image that displays the specific screen, based on the position of the detected person's face, there may be cases in which none of the height, position, orientation, and size of the aerial image are changed from the default mode.
[0020] The specific screen may vary depending on the usage scenario of each facility. For example, the specific screen may contain personal information. Or, for example, the specific screen may contain passwords. The specific screen here may be a screen that displays personal information and passwords, or a screen that inputs personal information and passwords. Screens other than the specific screen may be, for example, a waiting screen or an instruction screen explaining how to use the system.
[0021] Here, if the person is a user of the aerial display, the control unit 102 displays a specific screen so that at least one of the height, position, orientation, and size of the aerial image is aligned with the user's face. For example, because the aerial display has strong directional display, changing the display to suit the user makes it difficult for other people who are peering at the aerial display from behind the user to see the specific screen. Also, for example, if the person is not a user of the aerial display, the control unit 102 changes at least one of the height, position, orientation, and size so that it is difficult for other people to see the specific screen. The specific control will be explained using Embodiment 2.
[0022] (flowchart) Figure 2 is a flowchart showing an example of operation of the control system 10 according to Embodiment 1. The detection unit 101 detects a person's face using a sensor (step S101). The control unit 102, The aerial image projection of the aerial display The screen is displayed at a predetermined height, position, orientation, and size (step S102).
[0023] For example, the control unit 102 determines whether a specific screen is being displayed (step S103). If it is determined that a specific screen is not being displayed (step S103: No), the control unit 102 returns to step S103. On the other hand, if it is determined that a specific screen is being displayed (step S103: Yes), the control unit 102 controls the system to change at least one of the height, position, orientation, and size of the aerial image that displays the specific screen, based on the position of the detected person's face (step S104). The control system 10 then terminates the process.
[0024] Here, a typical display can be easily viewed by others. While privacy filters can be used to prevent peeping, users may find displays with privacy filters difficult to view. Aerial displays have a narrow viewing angle and strong directionality. Therefore, aerial displays are more difficult to pry into than typical displays. However, even with aerial displays, there is a need to further deter peeping. To prevent peeping, for example, if the stand on which the aerial display is installed is surrounded by an object such as a board, it becomes difficult to use it as a simple stand when not displaying anything, thus negating the effectiveness of the aerial display. Using it as a stand means, for example, using it as a bagging stand in a retail store. Also, as mentioned above, depending on the usage scenario of a facility using a contactless display, for example, it is expected that users will change one after another. In this case, for example, when displaying personal information, users may not want others to pry into their view.
[0025] Therefore, in Embodiment 1, when the control system 10 is displaying a specific screen among multiple screens, it controls the height, position, orientation, and size of the aerial image displayed by the aerial display to be changed from the default mode based on the position of the detected person's face. As a result, according to the control system 10, if the person is someone other than the user of the aerial display, the control system 10 can display a specific screen that is difficult for the other person to see. Thus, peeping can be suppressed. Also, because the aerial display has a narrow viewing angle, the display in default mode may be difficult for some users to see. Therefore, according to the control system 10, if the person is the user of the aerial display, the control system 10 can display a specific screen that is easy for the user to see. Also, because the aerial display has a narrow viewing angle, if the aerial image is easy for the user to see, it is highly likely that the aerial image will be difficult for other people to see. Thus, peeping can be suppressed.
[0026] (Embodiment 2) Next, Embodiment 2 will be described in detail with reference to the drawings. Embodiment 2 will describe a specific method for controlling the height, position, orientation, and size of the aerial image. In particular, Embodiment 2 will use a retail store as an example of a facility using an aerial display. In Embodiment 2, explanations that overlap with the above description will be omitted to the extent that the explanation of Embodiment 2 does not become unclear.
[0027] Figure 3 is an explanatory diagram illustrating an example in which an aerial display is used as a display device for a POS system. For example, a store is equipped with a counter 22, an aerial display 21, and an imaging device 23. The aerial display 21 is mounted on counter 22. In addition to the aerial display 21, counter 22 may also be equipped with a reader 24 for reading product codes, a card reader 25 including an input device such as a numeric keypad, etc. The imaging device 23 is used as a sensor to detect customer faces. For example, the imaging device 23 captures an area where it can photograph a person who is in a position where the aerial image of the aerial display 21 can be seen. The number of imaging devices 23 may be multiple and is not particularly limited. Note that in subsequent drawings, the reader 24, card reader 25, etc., may be omitted from the illustration.
[0028] Figure 4 is a simplified explanatory diagram of the aerial display 21. In Figure 4, for the sake of clarity, the X-axis is defined in the horizontal direction, the Y-axis in the depth direction, and the Z-axis in the height direction. The aerial display 21 comprises, for example, an optical element 212, a display 213, and a sensor 214.
[0029] In the aerial display 21, the optical element 212 allows light rays emitted by the display 213 to pass through, forming the same image on the opposite side of the display 213. In Figure 4, this image is the aerial image 211. The aerial image 211 is transparent. The sensor 214 is used to manipulate the image in the air. The sensor 214 is, for example, a motion sensor. In the following description, operations detectable by, for example, the sensor 214 will also be referred to as operations on the aerial display 21. The type of aerial display 21 is not particularly limited.
[0030] Here, the aerial display 21 may include a mechanism that can control the angle between the optical element 212 and the display 213 in order to control the position and orientation of the aerial image 211.
[0031] Figure 5 is an explanatory diagram showing an example of the connection between the control system and other devices. The control system 20 is connected to the platform 22 via the aerial display 21, the imaging device 23, and the communication network NT. Furthermore, if the height of the platform 22 is controllable, the control system 20 is connected to the platform 22 via the communication network NT.
[0032] Furthermore, the control system 20 may include a POS system, or it may be connected to the POS system via a communication network NT. For example, the POS system may use existing technology and may include, for instance, a product registration unit for registering products, a settlement unit for settling the payments for registered products, and so on.
[0033] The communication network NT may consist of multiple communication networks. For example, the communication network connecting the control system 20 and the aerial display 21, the communication network connecting the control system 20 and the imaging device 23, and the communication network connecting the control system 20 and the platform 22 may be different.
[0034] Figure 6 is a block diagram showing an example configuration of the control system 20 according to Embodiment 2. The control system 20 comprises a detection unit 201, a control unit 202, an acquisition unit 203, and an authentication unit 204.
[0035] The control system 20 is provided with an acquisition unit 203 and an authentication unit 204 added to the control system 10 according to Embodiment 1. The detection unit 201 has the functions of the detection unit 101 according to Embodiment 1 as its basic functions. The control unit 202 has the functions of the control unit 102 according to Embodiment 1 as its basic functions.
[0036] Furthermore, for example, the control system 20 includes a user database (DB) 2001 and a product database (DB) 2002. Each functional unit of the control system 20 can appropriately refer to and update various databases.
[0037] User DB2001 stores user biometric data, physical data, attribute data, and point information for each user. For example, User DB2001 stores user identification information, biometric data, physical data, and attribute data in association with each user. For example, user identification information is not particularly limited as long as it can identify the user. For example, user identification information may be a point card number. Biometric data is information about the user used for biometric authentication. Specifically, biometric data includes information such as fingerprints, iris, vein, face, voice, and ear print. Physical data is information about the user's body, such as height. For example, attribute data includes information such as age, gender, and physical characteristics. For example, point information is information indicating the value of points that can be used at the store.
[0038] Product DB2002 stores product information for each product. For example, Product DB2002 stores product identification information in association with product information. Product identification information is not particularly limited as long as it can uniquely identify the product, such as a product code. Product information includes information such as the product name, product price, and product category. Product categories may differ depending on the type of store. For example, if the store is a supermarket, product categories may be broad categories such as food, daily necessities, and pharmaceuticals, or they may be narrower categories such as vegetables, meat, and dairy products.
[0039] Next, I will explain each functional part.
[0040] As described in Embodiment 1, the detection unit 201 detects a person's face using a sensor. For example, if the sensor is the imaging device 23, the detection unit 201 detects a person's face from the image captured by the imaging device 23. Here, we will explain the case where the person is a user of the aerial display 21 and another person other than a user of the aerial display 21. When the aerial display 21 is used as a display device for a POS system, the user of the aerial display 21 is a customer who registers products and makes payments.
[0041] First, let's explain the case where the person is a user of the aerial display 21.
[0042] Figure 7 is an explanatory diagram showing an example in which the user's face is detected by the imaging device 23. The detection unit 201 detects the user's face from the image captured by the imaging device 23.
[0043] Furthermore, the detection unit 201 may detect the position of the person's face. For example, the position of the face is at least one of the following: the height of the face, the position of the eyes, or the position of the face relative to the aerial display 21. Thus, the position of the person's face may be an absolute position or a relative position.
[0044] The control unit 202 controls the aerial image 211 of the aerial display 21 to be at a predetermined height, position, orientation, and size when displaying a screen other than a specific screen from among multiple screens to be displayed on the aerial display 21. The predetermined height, position, and orientation may be determined based on the average height of a typical user. The predetermined size may be the entire display area of the display 213 included in the aerial display 21.
[0045] Here, there are various methods for controlling the height, position, orientation, and size, and are not particularly limited. First, as a method for controlling either the position or orientation of the aerial image 211, for example, the control unit 202 controls at least one of the position and orientation of the aerial image 211 by controlling the angle between the display 213 included in the aerial display 21 and the optical element 212 included in the aerial display 21.
[0046] Figure 8 is an explanatory diagram illustrating an example in which the angle between the display 213 and the optical element 212 included in the aerial display 21 is controlled. In Figure 8, the control unit 202 changes the angle between the display 213 and the optical element 212 from angle θ1 to angle θ2. As a result, the orientation and position of the aerial image 211 change. In the example in Figure 8, since angle θ2 is smaller than angle θ1, the angle between the aerial image 211 and the optical element 212 becomes smaller after the angle between the display 213 and the optical element 212 is controlled. As a result, the position and orientation of the aerial image 211 change.
[0047] Furthermore, as a method for controlling either the position or size of the aerial image 211, the control unit 202 can control at least one of the position and size of the aerial image 211 of the aerial display 21 by controlling the display 213 included in the aerial display 21. More specifically, for example, the control unit 202 controls the position and size of the aerial image 211 of the aerial display 21 by changing the area used from the display area of the display 213 included in the aerial display 21.
[0048] Figure 9 is an explanatory diagram illustrating an example of how the display of the display 213 included in the aerial display 21 is controlled. The control unit 202 changes the display from the entire display area of the display 213 included in the aerial display 21 to the display of only a portion of the display area. As a result, in Figure 9, the size of the aerial image 211 of the aerial display 21 is reduced.
[0049] Furthermore, as a method for controlling the height of the aerial image 211, for example, the control unit 202 controls the height of the aerial image 211 of the aerial display 21 by controlling the height of the stand 22 on which the aerial display 21 is installed.
[0050] Figure 10 is an explanatory diagram illustrating an example of how the height of the platform 22 is controlled. For example, the control unit 202 controls the height of the platform 22 on which the aerial display 21 is installed. This changes the height of the aerial image 211 of the aerial display 21.
[0051] Furthermore, these control methods may be used in combination.
[0052] Next, when a specific screen is displayed, the control unit 202 controls the height, position, orientation, and size of the aerial image projector 211 that displays the specific screen, based on the position of the detected person's face. For example, any method of modification may be one of the control methods described. The specific screen is not particularly limited. For example, as described in Embodiment 1, the specific screen may contain personal information.
[0053] Furthermore, a specific screen may include information about points usable at the store. Generally, for example, in a POS system, product registration involves obtaining a product code, after which the product is registered in the user's product registration list. The registration screen may then include product information such as the name and price of the product registered in the product registration list. Some users may not want others to see what they are purchasing. For this reason, a specific screen may be a registration screen that includes product information for the registered product. Also, some users may not mind others seeing them purchase certain products, but they may not want others to see them purchasing certain products. For this reason, a specific screen may be a registration screen for a specific product. The specific product is not particularly limited. For example, with some pharmaceuticals, it may be possible to infer the user's illness. Therefore, a specific screen may be a registration screen for a product in the product DB2002 whose category is pharmaceuticals.
[0054] Additionally, certain screens may be payment screens. Payment screens include screens for selecting payment methods and screens showing the payment process.
[0055] Specifically, for example, when the control unit 202 is displaying a specific screen, if it changes the size of the aerial image 211, it may change the size of the aerial image 211 displaying the specific screen to a predetermined size or less. That is, the control unit 202 may control it so that the size of the aerial image 211 is less than or equal to the size of the aerial image 211 in default mode. This makes it more difficult for people other than the user to see. However, if the aerial image 211 is too small, it may be difficult for some users to see. Therefore, the control unit 202 further controls the size of the aerial image 211 based on the user's attributes. For example, the user's attributes may be attributes represented by the user's attribute data included in the user DB 2001, or they may be estimated from the image captured by the imaging device 23. For example, the attributes may be age or age group, and are not particularly limited. For example, if the user is young, they may be able to see the aerial image 211 even if it is small. On the other hand, if the user is old, they may have difficulty seeing the aerial image 211 if it is small. Therefore, when the size of the aerial image 211 is reduced, the control unit 202 controls the size of the aerial image 211 to be changed according to the age.
[0056] Also, for example, when the control unit 202 is displaying a specific screen, it may change the height of the aerial image 211. , check Based on the position of the person's face and the field of view of the aerial display 21, the system determines the height of the aerial image 211 that is easily visible to the user from the user's face position. The control unit 202 then controls the aerial image 211 to be at the determined height. This makes the aerial image 211 easier for the user to see.
[0057] Furthermore, for example, when the control unit 202 changes the orientation of the aerial image 211 while displaying a specific screen, it determines the orientation of the aerial image 211 that is easily visible to the user, based on the position of the user's face and the field of view of the aerial display 21. The control unit 202 then controls the aerial image 211 to take on the determined orientation. This makes it easier for the user to see the aerial image 211.
[0058] Furthermore, for example, when the control unit 202 changes the position of the aerial image 211 while displaying a specific screen, it determines the orientation of the aerial image 211 that is easily visible to the user, based on the position of the detected person's face and the field of view of the aerial display 21. The control unit 202 then controls the aerial image 211 to be in the determined position. This makes it easier for the user to see the aerial image 211.
[0059] The control unit 202 may decide, or it may be predetermined, which of the height, position, orientation, or size of the aerial image 211 to change.
[0060] Furthermore, the control unit 202 displays specific information at a specific location on the aerial image 211. The specific location is, for example, a location that is difficult for anyone other than the user to see. Specifically, the specific location is, for example, the lower central position of the aerial image 211. The specific information is not particularly limited, but may be, for example, important information. For example, the specific information may be personal information or point information.
[0061] Figure 11 is an explanatory diagram illustrating an example where the user's name and point information are displayed in a specific location. The control unit 202 controls the display to show the user's name and point information in the lower center position of the aerial image 211 where a specific screen is displayed. For example, when a user stands in front of the aerial display 21, the user's name and point information can be made difficult for other people to see. Therefore, peeping can be suppressed.
[0062] Furthermore, the aerial display 21 may have a narrow field of view. For example, if the detected position of the user's face is at face height, the control unit 202 displays specific information at a position in the aerial image 211 based on the height of the person's face and the field of view of the aerial display. For example, the control unit 202 identifies a position in the aerial image 211 that is easy for the user to see, based on the height of the person's face and the field of view of the aerial display. Then, the control unit 202 displays specific information at a position that is easy for the user to see. The specific information is as described above. This ensures that the display is tailored to the user. Therefore, the effect of making it difficult for other people to peek at the display is maintained while making it easier for the user of the aerial display 21 to see the display.
[0063] Furthermore, biometric authentication may be performed. For example, the acquisition unit 203 acquires data for each user that associates the user's biometric data with physical data representing the user's height. This data is the user database 2001. The user database 2001 may be acquired from a POS system, and is not particularly limited.
[0064] Furthermore, the authentication unit 204 may perform biometric authentication. The type of biometric authentication is not particularly limited. For example, facial recognition may be used as an example. For example, in the case of facial recognition, the authentication unit 204 performs facial recognition based on the image of the user captured by the imaging device 23. For example, the position of the face may be determined by the height represented by the authenticated user's physical data included in the user DB 2001. If the position of the face is the height of the face, the height of the face can be determined from the height represented by the physical data.
[0065] Next, we will describe the case where the person detected by the detection unit 201 is someone other than the user of the aerial display 21. The detection unit 201 may detect both the user and other people other than the user.
[0066] Figure 12 is an explanatory diagram illustrating an example in which the faces of people other than the user are detected. In Figure 12, the imaging device 23 captures images of the user and other people other than the user. The detection unit 201 then detects the user and other people other than the user from the images captured by the imaging device 23.
[0067] The detection unit 201 may determine whether a person is a user or another person other than a user based on their position relative to the aerial display 21, or it may identify them by biometric means such as facial recognition. For example, if a person is another person other than the user of the aerial display 21, the position of the face will be at least one of the position of the face relative to the user and the position of the face relative to the aerial display 21.
[0068] The position of another person's face relative to the user may be such as whether the other person is taller or shorter than the user, or whether they are to the left or right behind the user. Thus, the position of a face relative to the user may be a broad category of position relative to the user. Here, left and right refer to the left and right when the user is facing in a direction in which the aerial image 211 can be seen. In Figure 12, for example, the negative direction of the X-axis is the user's left side, and the positive direction of the X-axis is the user's right side. In Figure 12, the other person is to the left of the user and is taller than the user. In Figure 12, for example, the negative direction of the Z-axis is downwards, and the positive direction of the Z-axis is upwards.
[0069] Furthermore, the position of another person's face relative to the user may be a coordinate position centered on the user. Alternatively, the position of another person's face relative to the user may be a position such as the distance in each direction from the user. Thus, the position of another person's face relative to the user may be a detailed position relative to the user.
[0070] Furthermore, the position of the face relative to the aerial display 21 may be a broad position such as being on the left or right side of the aerial image 211 of the aerial display 21, or it may be a more detailed position such as the distance in each direction from the aerial display 21.
[0071] The control unit 202 then changes at least one of the size and position of the aerial image 211 based on the position of the face of the other person detected. In this case, to prevent peeping, the control unit 202 may adjust the display of the aerial image 211 to a position and size that makes it difficult for other people to see the aerial image 211.
[0072] Here, we will explain an example of changing the size and position of the aerial image 211 by changing the display 213 included in the aerial display 21. It will be assumed that the top, bottom, left, and right directions of the display 213 included in the aerial display 21 coincide with the top, bottom, left, and right directions of the aerial image 211.
[0073] For example, if another person is taller than the user, the control unit 202 uses the lower part of the display area of the display 213 included in the aerial display 21 to display the image. This causes the aerial image 211 to be shifted downwards. For example, if another person is shorter than the user, the control unit 202 uses the upper part of the display area of the display 213 included in the aerial display 21 to display the image. This causes the aerial image 211 to be shifted upwards. Therefore, it becomes difficult for other people to see certain screens displayed as the aerial image 211.
[0074] Furthermore, for example, if another person is behind the user to the left, the control unit 202 uses the right-hand display area of the display 213 included in the aerial display 21 to display the image. This causes the aerial image 211 to shift to the right. For example, if another person is behind the user to the right, the control unit 202 uses the left-hand display area of the display 213 included in the aerial display 21 to display the image. This causes the aerial image 211 to shift to the left. Consequently, it becomes difficult for other people to see certain screens displayed as the aerial image 211.
[0075] Figure 13 is an explanatory diagram showing examples of the display position of the aerial image 211 depending on the position of another person's face. In Figure 13, for example, if another person is taller than the user and is behind and to the left of the user, the control unit 202 controls the display 213 included in the aerial display 21 to shift the aerial image 211 to the lower right.
[0076] In Figure 13, for example, if another person is taller than the user and is positioned to the right and behind the user, the control unit 202 controls the display 213 included in the aerial display 21 so that the aerial image 211 is shifted to the lower left.
[0077] In Figure 13, for example, if another person is shorter than the user and is located to the left and behind the user, the control unit 202 controls the display 213 included in the aerial display 21 so that the aerial image 211 is shifted to the lower right.
[0078] In Figure 13, for example, if another person is shorter than the user and is positioned to the right and behind the user, the control unit 202 controls the display 213 included in the aerial display 21 so that the aerial image 211 is shifted to the lower left.
[0079] Figure 14 is an explanatory diagram illustrating an example where the aerial image 211 is shifted to the lower right when another person is taller than the user and positioned to the left and behind. For example, in the default mode, each screen is displayed using the entire display area of the display 213 included in the aerial display 21. For ease of understanding, the area where the aerial image 211 is displayed in the default mode is represented by a dotted line. When the face of another person is positioned higher than the user and to the left and behind, as shown in Figure 12, the control unit 202 controls the display to show a specific screen in the lower right area of the display area of the display 213 included in the aerial display 21. As a result, the aerial image 211 shifts to the lower right.
[0080] If you want to make the aerial image 211 easier for other people to see, you can simply move the display to the opposite position.
[0081] Users may not want others to look at a specific screen, but may be willing to see other information. Therefore, the control unit 202 may determine the size and position of a specific screen in the aerial image 211 based on the position of another person's face. The control unit 202 then displays the specific screen at the determined size and position within the display area of the display 213 included in the aerial display 21, and displays predetermined information in at least a portion of the other area. In other words, either the size or position of the aerial image 211 on which the specific screen is displayed will be changed. The predetermined information is, for example, information that is acceptable for others to see. This information may include store advertisements or product advertisements. The predetermined information may also be information that warns of a person behind the user. The warning information may be an image of the person behind the user captured by the imaging device 23, or it may be a warning message such as "There is a person behind you."
[0082] Figure 15 is an explanatory diagram showing an example in which the aerial image 211 includes a payment screen and a product advertisement. If the position of another person's face is higher and to the left and behind the user's face as shown in Figure 12, the control unit 202 displays the payment screen in the lower right area of the display area of the display 213 included in the aerial display 21, and displays the chocolate advertisement in the area other than the lower right area. The payment screen is shifted to the lower right, and the chocolate advertisement is displayed in the blank space of the display area other than the area where the payment screen is displayed. As a result, even if another person looks at the aerial image 211, it is difficult for them to see the payment screen, and they can see the chocolate advertisement. At the same time, the user can see the chocolate advertisement along with the payment screen. Therefore, the remaining display area can be effectively utilized.
[0083] In the above explanation, we described an example in which the size and position of the aerial image 211 are changed by changing the display 213 included in the aerial display 21. However, as mentioned above, the method is not particularly limited as long as the position of the aerial image 211 can be changed.
[0084] For example, the control unit 202 may return to the default mode when a screen transition occurs, if the state changes from one where a person other than the user is present to one where they are absent. For example, if the registration screen is updated each time a new product is registered, the control unit 202 may return to the default mode when a new product is registered and a new registration screen is displayed, if the state changes from one where a person other than the user is present to one where they are absent. Also, to avoid distracting the user, the control unit 202 may maintain the display that was changed from the default mode even if the state changes from one where a person other than the user is present to one where they are absent.
[0085] Furthermore, if the person is someone other than the user, the control unit 202 may change the display position of specific information on a specific screen based on the position of the other person's face. For example, the control unit 202 may display specific information in the aerial image 211 in a position that is difficult for people other than the user to see.
[0086] For example, if another person is taller than the user, the control unit 202 will display specific information at a lower position on a particular screen. For example, if another person is shorter than the user, the control unit 202 will, for example , special In a fixed screen, specific information is displayed at the top. This makes it difficult for other people to see that information.
[0087] Furthermore, for example, if another person is behind the user to the left, the control unit 202 will display specific information on the right side of a particular screen. For example, if another person is behind the user to the right, the control unit 202 will display specific information on the left side of a particular screen. This makes it difficult for the other person to see the specific information.
[0088] Figure 16 is an explanatory diagram showing an example of the display position of the aerial image 211 according to the position of another person's face. In Figure 16, for example, if another person is taller than the user and is behind and to the left of the user, the control unit 202 will display specific information in the lower right position on a specific screen.
[0089] In Figure 16, for example, if another person is taller than the user and is standing to the right and behind the user, the control unit 202 will display specific information in the lower left position on a particular screen.
[0090] In Figure 16, for example, if another person is shorter than the user and is standing to the left and behind the user, the control unit 202 will display specific information in the lower right position on a particular screen.
[0091] In Figure 16, for example, if another person is shorter than the user and is positioned to the right and behind the user, the control unit 202 will display specific information in the lower left position on a particular screen.
[0092] Figure 17 is an explanatory diagram illustrating an example where the user's name and point information are displayed in the lower right corner when another person is taller than the user and positioned to the left and behind the user. When the position of another person's face is higher than the user's and positioned to the left and behind the user, as shown in Figure 12, the control unit 202 controls the display of the user's name and point information in the lower right corner on a specific screen.
[0093] In addition, the examples described above may be combined. For example, the detection unit 201 may detect both the user and other persons. The control unit 202 may, when displaying a specific screen, change at least one of the height, position, orientation, and size of the aerial image 211 that displays the specific screen, based on the position of the user's face and the position of the faces of other persons.
[0094] Furthermore, for example, in Figure 14, the point information is displayed in the lower center of the aerial image 211 of a specific screen. If a person other than the user is taller than the user and is positioned to the left and behind the user, the control unit 202 may display the point information in the lower right of the specific screen. This makes it difficult for other people to see the point information.
[0095] (flowchart) Figure 18 is a flowchart illustrating an example of the operation of the control system 20 according to Embodiment 2. Figure 18 describes an example in which, when both the user and other persons are detected, the height, position, orientation, and size of the aerial image 211 that displays a specific screen are changed when a specific screen is being displayed.
[0096] The detection unit 201 detects a person's face using a sensor (step S201). The control unit 202 displays the screen in default mode (step S202). The display of the screen in default mode is a display in which the aerial image 211 is at a predetermined height, predetermined position, predetermined orientation, and predetermined size.
[0097] For example, the control unit 202 determines whether a specific screen is being displayed (step S203). If it is determined that the specific screen is not being displayed (step S203: No), the control unit 202 returns to step S203. On the other hand, if it is determined that the specific screen is being displayed (step S203: Yes), the control unit 202 determines whether any other person besides the user has been detected (step S204). If no other person besides the user has been detected (step S204: No), the control unit 202 returns to step S204.
[0098] If another person other than the user is detected (Step S204: Yes), the control unit 202 controls the height, position, orientation, and size of the aerial image projector 211 that displays a specific screen, based on the position of the user's face and the position of the other person's face (Step S205). Then, the control system 20 terminates the process. If no other person is detected, the flowchart may be terminated as appropriate.
[0099] In Embodiment 2, if the detected person is a user of the aerial display 21, the position of the face is at least one of the following: face height, eye position, or face position relative to the aerial display 21. A specific screen can be displayed to make it easier for the user to see. Furthermore, because the aerial display 21 has a narrow field of view, if the aerial image 211 is easy for the user to see, it is highly likely that it will be difficult for other people to see the aerial image 211. Therefore, peeping can be suppressed.
[0100] Furthermore, if the detected person is a user of the aerial display 21, the position of the person's face is at face height, and the control system 20 displays specific information at a position in the aerial image based on the person's face height and the field of view of the aerial display 21. This specific information may be important information such as personal information. The aerial display 21 has a predetermined field of view. Therefore, important information can be displayed in the aerial image 211 displayed by the aerial display 21 at a position that is visible to the user but difficult for others to see.
[0101] The control system 20 displays specific information at a specific location on the aerial image 211. For example, the specific location could be the lower center of the aerial image 211. For instance, the lower center of the aerial image 211 is a location that is difficult for other people to see, regardless of whether they are standing to the right or left of the user. This helps prevent unauthorized viewing of the specific information.
[0102] Furthermore, if the detected person is someone other than the user of the aerial display 21, the position of the person's face is at least one of the positions of the person's face relative to the user and the position of the person's face relative to the aerial display 21. The control system 20 changes at least one of the size and position of the aerial image 211 based on the position of the face of the other person.
[0103] If the detected person is someone other than the user of the aerial display 21, the control system 20 displays specific information at a specific location on the screen based on the position of the other person's face.
[0104] If the detected person is someone other than the user of the aerial display 21, the control system 20 determines the size and position of a specific screen in the aerial image 211 based on the position of the other person's face. The control system 20 then displays the specific screen at the determined size and position within the display area of the display 213 included in the aerial display 21, and displays predetermined information in the other area.
[0105] The control system 20 performs biometric authentication and controls the height, position, orientation, and size of the aerial image 211 based on the user's face position corresponding to their height, as indicated by the user's physical data authenticated by biometric authentication. This allows the aerial image 211 to be displayed in a way that is easy for the user to see, without having to newly detect the user's face position, provided that biometric authentication is performed.
[0106] Furthermore, in Embodiment 2, as an example of screen display using the aerial display 21, the display of product registration and payment screens in a retail store was given as an example. As mentioned above, the facilities are not limited to retail stores, but can include a variety of places such as government offices, hospitals, hotels and other accommodation facilities, train stations and airports.
[0107] For example, if the aerial display 21 is used in a government office, it is expected that personal information such as address, income, assets, and tax amount will be entered and output. A specific screen may be a screen for entering and outputting such personal information.
[0108] Furthermore, for example, if the aerial display 21 is used in a hospital, it is expected that personal information such as address, medical history, and prescription details will be entered and output. Specific screens are those used for entering and outputting such personal information.
[0109] Furthermore, when the aerial display 21 is used in places such as accommodations, train stations, and airports, it is expected that personal information such as names and addresses will be entered and output. For example, check-in will take place in accommodations and airports. Specific screens are those used for entering and outputting such personal information.
[0110] This concludes the description of each embodiment. Each embodiment can be modified in various ways. Modifications are described below.
[0111] <Example 1> In each embodiment, the control system 20 detects the position of a person's face and, when displaying a specific screen, modifies at least one of the height, position, orientation, and size of the aerial image 211 based on the detected position of the person's face. Alternatively, for example, the control system 20 may detect a user in front of the aerial display 21 and control at least one of the height, position, orientation, and size of the display on the aerial display 21 based on the user's face position. This ensures that the aerial image 211 is displayed in a way that suits the user. Therefore, it maintains the effect of making it difficult to pry while making the display easier for the user to see. Furthermore, if the control system 20 detects another person while the user is using the aerial display 21, it may control at least one of the position and size of the display on the aerial display 21 based on the position of the other person's face.
[0112] This concludes the explanation of the modified examples. Each embodiment and its modified examples may be used in combination as appropriate.
[0113] Furthermore, in each embodiment, the control systems 10 and 20 may be configured to include each functional unit and a portion of the information.
[0114] Furthermore, each embodiment is not limited to the examples described above and can be modified in various ways. Also, the configuration of the control systems 10 and 20 in each embodiment is not particularly limited. For example, the control system 20 may be implemented by a single device, such as a single server. When each functional part of the control system 20 is implemented by a single device, for example, the single device may be called a control device, an information processing device, etc., and is not particularly limited. Alternatively, the control systems 10 and 20 in each embodiment may be implemented by different devices for each function or data. For example, each functional part may be composed of multiple servers and implemented as the control system 10 and 20. For example, the control system 10 and 20 may be implemented by a database server including each DB (Database) and a server having each functional part.
[0115] Furthermore, in each embodiment, each piece of information and each database may include a portion of the aforementioned information. Also, each piece of information and each database may include information other than the aforementioned information. Each piece of information and each database may be further divided into multiple databases or multiple pieces of information. Thus, the method of implementing each piece of information and each database is not particularly limited.
[0116] Furthermore, each screen is merely an example and is not particularly limited. Buttons, lists, checkboxes, information display fields, input fields, etc., not shown in the illustrations may be added to each screen. Also, the background color of the screen may be changed.
[0117] Furthermore, the process of generating information to be displayed on the aerial display 21 may be performed by the control unit 202. Alternatively, this process may be performed by the aerial display 21. When a POS system is used as in Embodiment 2, this process may be performed by the POS system.
[0118] (Example of computer hardware configuration) Next, we will describe an example of a hardware configuration when each of the devices described in each embodiment, such as the control systems 10 and 20 and the aerial display 21, is implemented using a computer. Figure 19 is an explanatory diagram showing an example of a computer hardware configuration. For example, some or all of each device can be implemented using any combination of computer 80 and program as shown in Figure 19.
[0119] Computer 80 includes, for example, a processor 801, a ROM (Read Only Memory) 802, a RAM (Random Access Memory) 803, and a storage device 804. Computer 80 also includes a communication interface 805 and an input / output interface 806. Each component is connected, for example, via a bus 807. The number of components is not particularly limited, and each component may be one or more.
[0120] The processor 801 controls the entire computer 80. The processor 801 may include, for example, a CPU (Central Processing Unit), a DSP (Digital Signal Processor), or a GPU (Graphics Processing Unit). The computer 80 has memory units such as ROM 802, RAM 803, and a storage device 804. The storage device 804 may include, for example, semiconductor memory such as flash memory, an HDD (Hard Disk Drive), or an SSD (Solid State Drive). For example, the storage device 804 stores OS (Operating System) programs, application programs, and programs related to each embodiment. Alternatively, ROM 802 stores application programs and programs related to each embodiment. The RAM 803 is used as the work area for the processor 801.
[0121] The processor 801 also loads programs stored in the memory device 804, ROM 802, etc. Then, the processor 801 executes each process coded in the program. The processor 801 may also download various programs via the communication network NT. Furthermore, the processor 801 functions as part or all of the computer 80. The processor 801 may also execute processes or instructions in the illustrated flowchart based on the program.
[0122] The communication interface 805 is connected to a communication network NT, such as a LAN (Local Area Network) or WAN (Wide Area Network), via a wireless or wired communication line. The communication network NT may be composed of multiple communication networks NT. This allows the computer 80 to connect to external devices and external computers 80 via the communication network NT. The communication interface 805 manages the interface between the communication network NT and the internal workings of the computer 80. Furthermore, the communication interface 805 controls the input and output of data from external devices and external computers 80.
[0123] Furthermore, the input / output interface 806 is connected to at least one of the input device, output device, and input / output device. The connection method may be wireless or wired. Examples of input devices include keyboards, mice, and microphones. Examples of output devices include display devices, lighting devices, and audio output devices. Examples of input / output devices include touch panel displays. The input device, output device, and input / output device may be built into the computer 80 or may be external.
[0124] The hardware configuration of computer 80 is an example. Computer 80 may have some of the components shown in Figure 19. Computer 80 may have components other than those shown in Figure 19. For example, computer 80 may have a drive device. The processor 801 may read programs and data stored on a recording medium attached to the drive device into RAM 803. Examples of non-temporary tangible recording media include optical discs, flexible discs, magneto-optical discs, and USB (Universal Serial Bus) memory. Also, as mentioned above, computer 80 may have input devices such as a keyboard and a mouse. Computer 80 may have output devices such as a display. Furthermore, computer 80 may have input devices, output devices, and input / output devices, respectively.
[0125] Furthermore, the computer 80 may have various sensors (not shown). The type of sensor is not particularly limited. Also, the computer 80 may be equipped with an imaging device capable of capturing images or videos.
[0126] This concludes the description of the hardware configuration of each device. Furthermore, there are various variations in how each device can be implemented. For example, each device may be implemented by any combination of different computers and programs for each component. Alternatively, the multiple components of each device may be implemented by any combination of a single computer and program.
[0127] Furthermore, some or all of the components of each device may be implemented by application-specific circuits. Alternatively, some or all of the components of each device may be implemented by general-purpose circuits, including processors such as FPGAs (Field Programmable Gate Arrays). Furthermore, some or all of the components of each device may be implemented by a combination of application-specific circuits and general-purpose circuits. These circuits may also be a single integrated circuit, or they may be divided into multiple integrated circuits. These multiple integrated circuits may be connected via a bus or the like.
[0128] Furthermore, if some or all of the components of each device are implemented by multiple computers or circuits, these computers or circuits may be centrally located or distributed.
[0129] The control methods described in each embodiment are implemented by a control system. Alternatively, for example, the control method can be implemented by a computer, such as a server or terminal device, executing a pre-prepared program.
[0130] The programs described in each embodiment are recorded on a computer-readable recording medium such as an HDD, SSD, flexible disk, optical disk, magneto-optical disk, or USB memory. The programs are then executed by being read from the recording medium by a computer. The programs may also be distributed via a communication network NT.
[0131] Each component of the control system in each embodiment described above may be implemented using dedicated hardware, such as a computer. Alternatively, each component may be implemented using software. Alternatively, each component may be implemented using a combination of hardware and software.
[0132] The present disclosure has been described above with reference to the embodiments described herein, but the present disclosure is not limited to the embodiments described above. The structure and details of each present disclosure may include embodiments that apply various modifications that can be grasped by those skilled in the art within the scope of the present disclosure. The present disclosure may include embodiments that combine or substitute the matters described herein as appropriate. For example, matters described using a particular embodiment may be applied to other embodiments to the extent that they do not cause a contradiction. For example, although multiple operations are described sequentially in the form of a flowchart, the order in which they are described does not limit the order in which the multiple operations are performed. Therefore, when implementing each embodiment, the order of the multiple operations may be changed to the extent that it does not impair the content.
[0133] Some or all of the above embodiments may also be described as follows. However, some or all of the above embodiments are not limited to the following.
[0134] (Note 1) A detection means that uses a sensor to detect a person's face, A control means for controlling the aerial image formed on a non-contact display to be at a predetermined height, predetermined position, predetermined orientation, and predetermined size when displaying a screen other than a specific screen from among multiple screens to be displayed on the non-contact display, Equipped with, The control means controls the height, position, orientation, and size of the aerial image that displays the specific screen, based on the position of the detected person's face, when the specific screen is being displayed. Control system. (Note 2) If the person is a user of the contactless display, the position of the face is at least one of the following: the height of the face, the position of the eyes on the face, and the position of the face relative to the contactless display. The control system described in Appendix 1. (Note 3) If the person is a user of the contactless display, the position of the face is at the height of the face. The control means causes specific information to be displayed at a position in the aerial image based on the height of the face and the viewing angle of the non-contact display. The control system described in Appendix 1 or 2. (Note 4) The control means causes specific information to be displayed at a specific position in the aerial image. The control system described in Appendix 1 or 2. (Note 5) If the person is someone other than the user of the contactless display, the position of the face is at least one of the position of the face relative to the user and the position of the face relative to the contactless display. A control system as described in any of the appendices 1 to 4. (Note 6) If the person is someone other than the user of the contactless display, The control means controls the modification to change at least one of the size of the aerial image and the position of the aerial image based on the position of the face of the other person. A control system as described in any of the appendices 1 to 5. (Note 7) If the person is someone other than the user of the contactless display, The control means causes specific information to be displayed at a specific position on the screen based on the position of the face of the other person. The control system described in Appendix 1. (Note 8) The control means controls the size of the aerial image to change based on the attributes of the user of the contactless display during the modification. A control system as described in any of the appendices 1 to 7. (Note 9) If the person is someone other than the user of the contactless display, The control means determines the size and position of the specific screen in the aerial image based on the position of the face of the other person, and displays the specific screen at the determined size and position within the displayable area of the non-contact display, and displays predetermined information in other areas. A control system as described in any of the appendices 1 to 8. (Note 10) The aforementioned predetermined information is information that serves as a warning about the presence of the other person. The control system described in Appendix 9. (Note 11) The aforementioned specified information is information related to store advertising or product advertising. The control system described in Appendix 9. (Note 12) The aforementioned specific screen is a screen containing the personal information of the user of the contactless display. A control system as described in any of the appendices 1 to 11. (Note 13) The aforementioned specific screen is at least one of the following: a product registration screen or a payment screen for the registered product. A control system as described in any of the appendices 1 to 11. (Note 14) The control means controls at least one of the position and orientation of the aerial image by controlling the angle between the display included in the non-contact display and the optical element included in the non-contact display. A control system as described in any of the appendices 1 to 13. (Note 15) The control means controls the display of the display included in the non-contact display to change at least one of the position and size of the aerial image. A control system as described in any of the appendices 1 to 14. (Note 16) The control means controls the height of the aerial image by controlling the height of the stand on which the non-contact display is installed. A control system as described in any of the appendices 1 to 15. (Note 17) A means for acquiring data that associates the biometric data of a user with physical data representing the user's height, An authentication means that performs biometric authentication of the user based on the biometric data of the current user of the contactless display and the acquired biometric data, Equipped with, The authentication means performs biometric authentication when the person is a user of the contactless display. The control means controls the height, position, orientation, and size of the aerial image to be changed when the specific screen is displayed, based on the position of the user's face corresponding to the height represented by the authenticated user's physical data. A control system as described in any of the appendices 1 to 16. (Note 18) Using a sensor, detect a person's face, When displaying a screen other than a specific screen from among multiple screens to be displayed on a non-contact display, the aerial image formed on the non-contact display is controlled to be at a predetermined height, predetermined position, predetermined orientation, and predetermined size. Execute the process, The control process described above controls the height, position, orientation, and size of the aerial image that displays the specific screen, based on the position of the detected person's face, when the specific screen is being displayed. Control method. (Note 19) On the computer, Using a sensor, detect a person's face, When displaying a screen other than a specific screen from among multiple screens to be displayed on a non-contact display, the aerial image formed on the non-contact display is controlled to be at a predetermined height, predetermined position, predetermined orientation, and predetermined size. Execute the process, The control process described above controls the height, position, orientation, and size of the aerial image that displays the specific screen, based on the position of the detected person's face, when the specific screen is being displayed. A tangible recording medium readable by the computer for recording a program. (Note 20) On the computer, Using a sensor, detect a person's face, When displaying a screen other than a specific screen from among multiple screens to be displayed on a non-contact display, the aerial image formed on the non-contact display is controlled to be at a predetermined height, predetermined position, predetermined orientation, and predetermined size. Execute the process, The control process described above controls the height, position, orientation, and size of the aerial image that displays the specific screen, based on the position of the detected person's face, when the specific screen is being displayed. program. [Explanation of symbols]
[0135] 10,20 Control Systems 21 Aerial Display 22 units 23 Imaging device 24 Reading device 25 Card reader 80 Computers 101,201 Detection unit 102,202 Control Unit 203 Acquisition Department 204 Certification Department 211 Aerial imaging 212 Optical elements 213 displays 214 sensors 801 Processor 802 ROM 803 RAM 804 Storage device 805 Communication Interface 806 Input / Output Interface 807 Bus 2001 User DB 2002 Product DB NT communication network
Claims
1. A detection means that uses a sensor to detect a person's face, A control means for controlling the aerial image formed on a non-contact display to be at a predetermined height, predetermined position, predetermined orientation, and predetermined size when displaying a screen other than a specific screen from among multiple screens to be displayed on the non-contact display, Equipped with, The aforementioned specific screen is a screen containing the personal information of the user of the contactless display, The control means controls, when displaying the specific screen, to change at least one of the height, position, orientation, and size of the aerial image that displays the specific screen, based on the position of the detected person's face. Control system.
2. If the person is someone other than the user, the position of the face is at least one of the position of the face relative to the user and the position of the face relative to the contactless display. The control system according to claim 1.
3. If the person in question is someone other than the user, The control means controls the modification to change at least one of the size of the aerial image and the position of the aerial image based on the position of the face of the other person. The control system according to claim 1 or 2.
4. If the person in question is someone other than the user, The control means causes specific information to be displayed at a specific position on the screen based on the position of the face of the other person. The control system according to claim 1 or 2.
5. If the person in question is someone other than the user, The control means determines the size and position of the specific screen in the aerial image based on the position of the face of the other person, and displays the specific screen at the determined size and position within the displayable area of the non-contact display, and displays predetermined information in other areas. The control system according to claim 1 or 2.
6. The aforementioned predetermined information is information that serves as a warning about the presence of the other person. The control system according to claim 5.
7. The aforementioned specified information is information related to store advertising or product advertising. The control system according to claim 5.
8. Computers Using a sensor, detect a person's face, When displaying a screen other than a specific screen from among multiple screens to be displayed on a non-contact display, the aerial image formed by the non-contact display is controlled to be at a predetermined height, predetermined position, predetermined orientation, and predetermined size. Execute the process, The aforementioned specific screen is a screen containing the personal information of the user of the contactless display, In the control process described above, when the specific screen is displayed, the control is performed to change at least one of the height, position, orientation, and size of the aerial image that displays the specific screen, based on the position of the detected person's face. Control method.
9. On the computer, Using a sensor, detect a person's face, When displaying a screen other than a specific screen from among multiple screens to be displayed on a non-contact display, the aerial image formed by the non-contact display is controlled to be at a predetermined height, predetermined position, predetermined orientation, and predetermined size. Execute the process, The aforementioned specific screen is a screen containing the personal information of the user of the contactless display, In the control process described above, when the specific screen is displayed, the control is performed to change at least one of the height, position, orientation, and size of the aerial image that displays the specific screen, based on the position of the detected person's face. program.