Aerial floating image display device

Abstract

To provide a more suitable aerial levitation image display device. [Solution] This is an aerial floating image display device in which the image processing unit performs image processing on an image generated by rendering a virtual 3D space in which character objects are placed. The rendering of the virtual 3D space is performed by capturing images using perspective projection with a virtual 3D space camera set up in the virtual 3D space. The image generated by rendering and displayed on the display unit is an image rendered by capturing the virtual 3D space in which character objects are placed, with the field of view of the virtual 3D space camera set to satisfy Lf≧Lm×Fi / Pa. This contributes to Sustainable Development Goals (SDGs) "3 Good Health and Well-being", "9 Industry, Innovation and Infrastructure", and "11 Sustainable Cities and Communities".

Claims

1. An aerial levitation image display device, Video processing unit, The aforementioned video processing unit displays the video that has been processed by the video processing unit, An optical system that generates an aerial levitation image based on the image displayed by the aforementioned display unit, Equipped with, The aforementioned video processing unit performs video processing on the video generated by rendering a virtual 3D space in which character objects are placed. The rendering of the virtual 3D space is performed by capturing images using perspective projection using a virtual 3D space camera set up within the virtual 3D space. The image generated by the rendering and displayed on the display unit is If the focal length of the lens of the virtual 3D space camera is Lf in 35mm film equivalent, the viewing distance, which is the distance from which the user of the aerial levitation image display device visually views the aerial levitation image display screen, is Lm, the diagonal length of the 35mm film is Fi, and the diagonal length of the aerial levitation image display screen is Pa, Lf≧Lm×Fi / Pa The image is rendered by setting the field of view of the virtual 3D space camera to satisfy the following conditions, and then capturing the virtual 3D space in which the character object is placed. Aerial levitation image display device.

2. An aerial levitation image display device according to claim 1, The display screen for the aerial levitation image has a rectangular display area. In the background of the character in the image generated by the rendering, at least one vertex of the rectangle on the display screen of the floating image is displayed in black, making it invisible to the user in mid-air. Aerial levitation image display device.

3. An aerial levitation image display device according to claim 1, The display screen for the aerial levitation image has a rectangular display area. In the background of the character in the image generated by the rendering, at least one side of the rectangle of the display screen for the floating image is included in the black display area, making it invisible to the user while in mid-air. Aerial levitation image display device.

4. An aerial levitation image display device, Video processing unit, The aforementioned video processing unit displays the video that has been processed by the video processing unit, An optical system that generates an aerial levitation image based on the image displayed by the aforementioned display unit, An operation detection unit that detects user operations on the display screen of the aerial levitation image, Equipped with, The aforementioned video processing unit performs video processing on the video generated by rendering a virtual 3D space in which character objects are placed. The rendering of the virtual 3D space is performed by capturing images using perspective projection using a virtual 3D space camera set up within the virtual 3D space. The image generated by the rendering and displayed on the display unit is If the focal length of the lens of the virtual 3D space camera is Lf in 35mm film equivalent terms, and the diagonal length of the display screen of the aerial floating image is Pa, Lf ≥ 15805 / Pa (Units for Lf and Pa are mm) The image is rendered by setting the field of view of the virtual 3D space camera to satisfy the following conditions, and then capturing the virtual 3D space in which the character object is placed. Aerial levitation image display device.

5. An aerial levitation image display device according to claim 4, The display screen for the aerial levitation image has a rectangular display area. In the background of the character in the image generated by the rendering, at least one vertex of the rectangle on the display screen of the floating image is displayed in black, making it invisible to the user in mid-air. Aerial levitation image display device.

6. An aerial levitation image display device according to claim 4, The display screen for the aerial levitation image has a rectangular display area. In the background of the character in the image generated by the rendering, at least one side of the rectangle of the display screen for the floating image is included in the black display area, making it invisible to the user while in mid-air. Aerial levitation image display device.

7. An aerial levitation image display device, Video processing unit, The aforementioned video processing unit displays the video that has been processed by the video processing unit, An optical system that generates an aerial levitation image based on the image displayed by the aforementioned display unit, An operation detection unit that detects user operations on the display screen of the aerial levitation image, Equipped with, The aforementioned video processing unit performs video processing on the video generated by rendering a virtual 3D space in which character objects are placed. The rendering of the virtual 3D space is performed by capturing images using perspective projection using a virtual 3D space camera set up within the virtual 3D space. The image generated by the rendering and displayed on the display unit is If the focal length of the lens of the virtual 3D space camera is Lf in 35mm film equivalent terms, and the diagonal length of the display screen of the aerial floating image is Pa, Lf ≥ 19788 / Pa (Units for Lf and Pa are mm) The image is rendered by setting the field of view of the virtual 3D space camera to satisfy the following conditions, and then capturing the virtual 3D space in which the character object is placed. Aerial levitation image display device.

8. The aerial levitation image display device according to claim 7, The display screen for the aerial levitation image has a rectangular display area. In the background of the character in the image generated by the rendering, at least one vertex of the rectangle on the display screen of the floating image is displayed in black, making it invisible to the user in mid-air. Aerial levitation image display device.

9. The aerial levitation image display device according to claim 7, The display screen for the aerial levitation image has a rectangular display area. In the background of the character in the image generated by the rendering, at least one side of the rectangle of the display screen for the floating image is included in the black display area, making it invisible to the user while in mid-air. Aerial levitation image display device.

10. It is a character display device that allows you to converse with characters, A display unit capable of displaying characters, Speakers and, Mike and, Communications Department and, Control unit and Equipped with, The communication unit is capable of communicating with a server that can perform inference on a large-scale language model, which is an artificial intelligence, and sends an instruction sentence containing natural language text information to the server and receives a response containing natural language text information from the server. The speaker outputs natural language speech using synthesized speech, based on the text information contained in the response, so that it sounds to the user as the voice of the character displayed on the display unit. Character display device.

11. A character display device according to claim 10, The display screen of the aforementioned display unit is a display screen formed from an aerial levitation image. Character display device.

12. A character display device according to claim 10, Equipped with a storage unit, The aforementioned instruction includes a setting instruction containing natural language text information, and the setting instruction allows for specifying at least one setting among the roles, names, conversational characteristics, or personalities that the character should play, based on the natural language text information. The storage unit stores and maintains in a database the conversation history between the character and the user, which is generated based on natural language text information communicated between the character display device and the server via the communication unit, in natural language. Character display device.

13. A character display device according to claim 12, After a series of conversations has concluded between the character display device and the server via the communication unit, in which natural language text information is communicated, a new conversation is initiated by sending a setting instruction statement containing natural language text information to the server again via the communication unit. In this case, the natural language text information based on the conversation history stored in the database is included in the setting instruction statement sent to the server. Character display device.

14. A character display device according to claim 13, The database in the storage unit stores natural language text information resulting from text summarization processing of the conversation history, thereby reducing the number of tokens in the natural language text information based on the conversation history included in the setting instruction statement sent to the server. Character display device.

15. A character display device according to claim 14, The text summarization process is performed on a server different from the server, or by a text summarization program that is stored in the memory of the character display device. Character display device.

16. A character display device according to claim 14, By deleting older conversation history entries from the database of the storage unit, the number of tokens in the natural language text information based on the conversation history included in the configuration instruction message sent to the server is reduced. Character display device.

17. A character display device according to claim 12, The control unit is capable of controlling the display unit to switch the character displayed on the display unit to a different character from the one currently displayed on the display unit, selected from a plurality of characters. The database held by the storage unit records, for each of the multiple characters, a setting instruction statement containing natural language text information that specifies at least one setting among the roles, names, conversational characteristics, or personalities that the character should play, and a conversation history between the character and the user generated based on natural language text information communicated between the character display device and the server via the communication unit, in association with each of the multiple characters. Character display device.

18. A character display device according to claim 17, After a series of conversations for a predetermined character are completed through the communication unit, where the character display device and the server communicate natural language text information via the communication unit, a new conversation for the predetermined character is initiated by sending a setting instruction statement containing natural language text information to the server again via the communication unit. At this time, the conversation history associated with the predetermined character is selected from the conversation histories associated with each of the multiple characters stored in the database, and natural language text information based on that conversation history is included in the setting instruction statement sent to the server. Character display device.

19. A character display device according to claim 18, When the control unit performs control to switch to a character other than the one displayed on the display unit, even after setting the character displayed on the display unit to switch to the image of the other character, and setting the synthesized voice output from the speaker to the synthesized voice corresponding to the other character, there is a state in which the setting instruction statement, which includes natural language text information based on the conversation history stored in the database associated with the other character, is not sent to the server, thereby reducing the frequency of sending the setting instruction statement to the server. Character display device.

20. A character display device according to claim 17, The display screen of the aforementioned display unit is a display screen formed from an aerial levitation image. Character display device.

21. A character display device according to claim 10, The instruction sent by the communication unit includes, in addition to the natural language text information, information specifying data from a non-natural language information source, and is sent to the server. Character display device.

22. A character display device according to claim 21, The information specifying the data of the aforementioned non-natural language information source includes location information indicating the network location of the data of the aforementioned non-natural language information source. Character display device.

23. A character display device according to claim 21, The data of the aforementioned non-natural language information source is image data, video data, or audio data. Character display device.

24. A character display device according to claim 21, Equipped with a storage unit, The storage unit stores and maintains in a database the conversation history between the character and the user, which is generated based on information regarding natural language text information and non-natural language information data communicated together with the natural language text information via the communication unit. Character display device.

25. A character display device according to claim 24, The information regarding the data of the non-natural language source included in the conversation history stored in the database includes information specifying the data of the natural language source or the data of the natural language source itself. Character display device.

26. A character display device according to claim 25, After a series of conversations has concluded between the character display device and the server via the communication unit, where the character display device and the server communicate natural language text information and information regarding the data of the non-natural language information source, a new conversation is initiated by sending a setting instruction statement containing natural language text information to the server again via the communication unit. In this case, the setting instruction statement sent to the server includes natural language text information and information regarding the data of the non-natural language information source based on the conversation history stored in the database. Character display device.

27. A character display device according to claim 26, The data of the aforementioned non-natural language information source is image data, video data, or audio data. Character display device.

28. A character display device according to claim 27, The server is a server having a multimodal large-scale language model capable of performing inference that includes information from non-natural language sources in addition to natural language text information. Character display device.

29. A character display device according to claim 21, Equipped with a storage unit, The storage unit stores and maintains in a database the conversation history between the character and the user, which is generated based on information regarding natural language text information and non-natural language information data communicated together with the natural language text information via the communication unit. The conversation history of the aforementioned database includes location information indicating the location of the data of the aforementioned non-natural language information source, The location information stored in the database is location information obtained by rewriting another location information that was previously indicated as the location of the data of the non-natural language information source before being stored as the conversation history, into location information that indicates the location within the character display device. Character display device.

Images