E-book display system and e-book display program
By generating a three-dimensional hologram of an electronic book and simulating paper book interactions, the system addresses the discomfort of two-dimensional displays, improving user comfort and immersion.
Patent Information
- Application Number
- JP2023134450
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-08-22
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2042-08-10
AI Technical Summary
Conventional electronic book display systems present a two-dimensional image, which differs significantly from paper books, leading to discomfort for users accustomed to the tactile experience of paper books.
The system generates a three-dimensional hologram of the book using a hologram generation unit and displays it on an SLM, allowing operations on the hologram to mimic paper book interactions, such as turning pages and applying physical effects like tearing or folding.
This approach reduces the operational and appearance differences between electronic and paper books, enhancing user comfort and providing a more immersive reading experience.
Smart Images

Figure 0007594062000001 
Figure 0007594062000002 
Figure 0007594062000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an electronic book display system and an electronic book display program for displaying electronic books. [Background technology]
[0002] A mobile terminal is known as a conventional electronic book display system (see, for example, Patent Document 1). The mobile terminal described in Patent Document 1 includes a main touch panel arranged on the surface of the mobile terminal and displaying an image of the page of the electronic book, a right side touch panel arranged along the right short side of the main touch panel and displaying an image of the right edge of the electronic book, a left side touch panel arranged along the left short side of the main touch panel and displaying an image of the left edge of the electronic book, a right pressure sensor extending parallel to the right short side near the right short side on the back surface of the mobile terminal, a left pressure sensor extending parallel to the left short side near the left short side on the back surface of the mobile terminal, and an acceleration sensor that measures acceleration to detect changes in posture such as tilt or movement of the mobile terminal. The mobile terminal described in Patent Document 1 can turn the pages of an e-book with the same feel as a paper book, based on input operations made by the user's right thumb detected by the right side touch panel, input operations made by the user's left thumb detected by the left side touch panel, pressure from the back side of the mobile terminal made by the user's right index finger, middle finger, ring finger, and little finger detected by the right pressure sensor, pressure from the back side of the mobile terminal made by the user's left index finger, middle finger, ring finger, and little finger detected by the left pressure sensor, and changes in posture such as the tilt and movement of the mobile terminal detected by the acceleration sensor. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2017-182167 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, in conventional electronic book display systems, the images of the books are flat, so the appearance of the books is significantly different from that of paper books, resulting in a problem that people who are familiar with paper books cannot use them comfortably.
[0005] Therefore, an object of the present invention is to provide an electronic book display system and an electronic book display program that can improve the comfort when using electronic books. [Means for solving the problem]
[0006] The e-book display system of the present invention is characterized by comprising a hologram generation unit that generates a hologram for reproducing an e-book as a three-dimensional image of a book, and a display control unit that displays the hologram generated by the hologram generation unit on an SLM.
[0007] With this configuration, the electronic book display system of the present invention reproduces an electronic book as a three-dimensional image of the book, thereby making it possible to reduce the difference in appearance between the book and a paper book, thereby improving the comfort of using the electronic book.
[0008] In the e-book display system of the present invention, the hologram is for reproducing a real image of the book, and the e-book display system includes a position detection unit that detects a spatial position of the object in the area of the real image of the book in order to detect an operation by the object on the real image of the book reproduced by the hologram, and when the position detection unit detects an operation by the object on the real image of the book, the hologram generation unit may generate the hologram that changes the real image of the book in accordance with the operation detected by the position detection unit.
[0009] With this configuration, when the position detection unit detects an operation by an object on the real image of the book, the electronic book display system of the present invention generates a hologram that changes the real image of the book in accordance with the operation detected by the position detection unit, thereby giving the user the sensation of directly manipulating the real image of the book. Therefore, the electronic book display system of the present invention can reduce the difference in operability of the book compared to paper books, and as a result, can improve the comfort of using electronic books.
[0010] In the e-book display system of the present invention, the hologram generation unit may be capable of generating the hologram in which, when the display content of the page of the book is visible from a first viewpoint relative to the SLM, at least a portion of the cover of the book that is not visible from the first viewpoint is visible from a second viewpoint relative to the SLM.
[0011] With this configuration, the e-book display system of the present invention can display a hologram on the SLM in which, when the display content of a page of a book is visible from a first viewpoint relative to the SLM, at least a portion of the cover of the book that is not visible from the first viewpoint is visible from a second viewpoint relative to the SLM, so that when a user is looking at the display content of a page of the book, the cover of the book can be shown to people other than the user.
[0012] In the e-book display system of the present invention, the hologram generation unit may be capable of generating a first hologram, which is the hologram when the book is not attached with a book cover that covers at least a portion of the front cover of the book, and may be capable of generating a second hologram, which is the hologram that differs from the first hologram in that the book is attached with the book cover.
[0013] With this configuration, the e-book display system of the present invention can generate holograms in which a book cover is not attached to the book, and can also generate holograms in which a book cover is attached to the book, so that a book cover can be attached to the book reproduced by the hologram.
[0014] In the e-book display system of the present invention, when the display content of the page of the book is visible from a first viewpoint relative to the SLM, at least a portion of the cover of the book that is not visible from the first viewpoint is visible from a second viewpoint relative to the SLM, and the second hologram may be such that the book cover covers at least a portion of the cover of the book that is not visible from the first viewpoint but is visible from the second viewpoint.
[0015] With this configuration, in the electronic book display system of the present invention, when the display content of a page of the book is visible from a first viewpoint relative to the SLM when a book cover is not attached to the book, at least a part of the book's cover that is not visible from the first viewpoint is visible from a second viewpoint relative to the SLM, and when a book cover is attached to the book, the book cover covers at least a part of the book's cover that is not visible from the first viewpoint but is visible from the second viewpoint when the book cover is not attached to the book, so that when a user is looking at the display content of the page of the book, the book cover can hide at least a part of the book's cover from people other than the user.
[0016] In the electronic book display system of the present invention, the hologram generation section may change the appearance of the book according to the amount of the electronic book that has been read.
[0017] With this configuration, the electronic book display system of the present invention changes the appearance of the book reproduced by the hologram according to the amount of the electronic book that has been read, allowing the user to easily recognize how much of the electronic book has been read.
[0018] In the electronic book display system of the present invention, when an operation to tear a page of the book is performed, the hologram generation section may generate the hologram showing the page in a torn state.
[0019] With this configuration, the e-book display system of the present invention generates a hologram of a torn page of a book when an operation to tear a page of the book is performed, thereby reducing the difference between the book's operability and appearance and a paper book, and as a result, improving the comfort of using e-books.
[0020] In the electronic book display system of the present invention, when an operation of folding a page of the book is executed, the hologram generating section may generate the hologram of the page in a folded state.
[0021] With this configuration, the e-book display system of the present invention generates a hologram of the book's folded page when an operation to fold a page of the book is performed, thereby reducing the difference between the book's operability and appearance and a paper book, and as a result, improving the comfort of using e-books.
[0022] In the electronic book display system of the present invention, the electronic book may have a property quantity set as the amount of properties of parts of the book, and the hologram generation unit may generate the hologram so that the pages of the book can be turned at a speed corresponding to the property quantity.
[0023] With this configuration, the electronic book display system of the present invention generates a hologram so that the pages of the book are turned at a speed that corresponds to the properties of the book's parts, so that the speed at which the pages of the book are turned can be made to correspond to the properties of the book's parts.
[0024] In the electronic book display system of the present invention, when an appearance of the book is changed, the hologram generation section may set the property quantity in the electronic book according to the changed appearance.
[0025] With this configuration, when the electronic book display system of the present invention changes the appearance of a book, it sets properties corresponding to the changed appearance in the electronic book, so that the speed at which the pages of the book are turned can be set to a speed corresponding to the appearance of the book.
[0026] The e-book display program of the present invention is characterized in that it causes a computer to realize a hologram generation unit that generates a hologram for reproducing an e-book as a three-dimensional image of a book, and a display control unit that displays the hologram generated by the hologram generation unit on an SLM.
[0027] With this configuration, a computer executing the electronic book display program of the present invention reproduces the electronic book as a three-dimensional image of the book, thereby reducing the difference in appearance between the book and a paper book, thereby improving the comfort of using the electronic book. Effect of the Invention
[0028] The electronic book display system and the electronic book display program of the present invention can improve the comfort when using electronic books. [Brief description of the drawings]
[0029] [Figure 1] 1 is a block diagram of an electronic book display system according to an embodiment of the present invention. [Diagram 2] 2A is a front view of the SLM shown in Fig. 1, and (b) is a rear view of the SLM shown in Fig. 1. [Diagram 3] 2(a) is a plan view of the SLM shown in Fig. 1, and (b) is a side view of the SLM shown in Fig. 1. [Figure 4] FIG. 4 is a side view of the SLM shown in FIG. 1 in an example different to the example shown in FIG. 3(b). [Diagram 5] 4 is a flowchart of the operation of the electronic book display system shown in FIG. 1 when starting to display an electronic book. [Figure 6] FIG. 6 is a diagram showing an example of a real image book generated by the operation shown in FIG. 5. [Figure 7]7(a) is a diagram showing an example of a real image book generated by the operation shown in Fig. 5, which is different from the example shown in Fig. 6. (b) is a diagram showing an example of a real image book generated by the operation shown in Fig. 5, which is different from the examples shown in Fig. 6 and Fig. 7(a). [Figure 8] 7A is a diagram showing an example of the real image book shown in FIG. 6 immediately before being opened by a user's hand, (b) is a diagram showing an example of the real image book shown in FIG. 6 in the middle of being opened by a user's hand, and (c) is a diagram showing an example of the real image book shown in FIG. 6 immediately after being opened by a user's hand. [Figure 9] (a) is a diagram showing an example of the real image book shown in Fig. 8(c) just before a page is turned over by a user's hand. (b) is a diagram showing an example of the real image book shown in Fig. 8(c) while a page is being turned over by a user's hand. (c) is a diagram showing an example of the real image book shown in Fig. 8(c) just after a page has been turned over by a user's hand. [Figure 10] (a) is a diagram showing an example of the real image book shown in FIG. 8(c) immediately before a plurality of pages are turned over by a user's hand. (b) is a diagram showing an example of the real image book shown in FIG. 8(c) while a plurality of pages are being turned over by a user's hand. (c) is a diagram showing an example of the real image book shown in FIG. 8(c) immediately after a plurality of pages have been turned over by a user's hand. [Figure 11] (a) is a diagram showing an example of the real-image book shown in Fig. 8(c) just before it is closed by a user's hand, (b) is a diagram showing an example of the real-image book shown in Fig. 8(c) in the middle of being closed by a user's hand, and (c) is a diagram showing an example of the real-image book shown in Fig. 8(c) just after it has been closed by a user's hand. [Figure 12] (a) is a diagram showing an example of the real-image book shown in FIG. 8(c) immediately before its orientation is changed by the user's hand, (b) is a diagram showing an example of the real-image book shown in FIG. 8(c) while its orientation is being changed by the user's hand, and (c) is a diagram showing an example of the real-image book shown in FIG. 8(c) immediately after its orientation is changed by the user's hand. [Figure 13](a) is a diagram showing an example of the real image book shown in FIG. 8(c) just before a page is torn by a user's hand. (b) is a diagram showing an example of the real image book shown in FIG. 8(c) while a page is being torn by a user's hand. (c) is a diagram showing an example of the real image book shown in FIG. 8(c) just after a page has been torn by a user's hand. [Figure 14] (a) is a diagram showing an example of the real image book shown in Fig. 8(c) just before the page is folded by the user's hand. (b) is a diagram showing an example of the real image book shown in Fig. 8(c) while the page is being folded by the user's hand. (c) is a diagram showing an example of the real image book shown in Fig. 8(c) just after the page has been folded by the user's hand. [Figure 15] 15(a) is a diagram showing an example of the real image book shown in FIG. 6 when observed by a user, and FIG. 15(b) is a diagram showing an example of the real image book shown in FIG. 15(a) when observed by a person other than the user. [Figure 16] 4 is a flowchart of the operation of the electronic book display system shown in FIG. 1 in a writing mode. [Figure 17] (a) is a diagram showing an example of a page of a real image book on which a writing object is arranged based on the writing data shown in Fig. 1. (b) is a diagram showing an example of a page of a real image book on which a writing object is arranged based on writing data different from the writing data shown in Fig. 1. (c) is a diagram showing an example of a page of a real image book on which a writing object is arranged based on writing data that combines the writing data shown in Fig. 1 and the writing data shown in Fig. 17(b). [Figure 18] 18(a) is a diagram showing an example of the real image book shown in FIG. 6 with a book cover attached, as viewed by a user; and FIG. 18(b) is a diagram showing an example of the real image book shown in FIG. 18(a), as viewed by a person other than the user. [Figure 19] FIG. 2 is a diagram showing an example of a number of real image books displayed on a display screen, which are reproduced by a hologram displayed on the SLM shown in FIG. 1. [Figure 20] FIG. 2 is a diagram showing an example of a bookshelf on which a number of real image books are displayed, which is reproduced by a hologram displayed on the SLM shown in FIG. 1. [Figure 21] FIG. 2 is a diagram showing an example of multiple real image books stacked together, reproduced by a hologram displayed on the SLM shown in FIG. 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0030] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0031] First, a configuration of an electronic book display system according to an embodiment of the present invention will be described.
[0032] FIG. 1 is a block diagram of an electronic book display system 10 according to the present embodiment.
[0033] As shown in FIG. 1, e-book display system 10 comprises SLM (Spatial Light Modulator) 11 that displays holograms for electronic holography that electronically realizes holography; sound output unit 12 which is an audio output device that outputs various information by sound; operation unit 13 which is an operation device such as a button into which various operations are input; position detection unit 14 which detects the spatial position of an object in the area of the real image reproduced by the hologram displayed on SLM 11 in order to detect an operation by an object such as a user's finger or hand on the real image reproduced by the hologram displayed on SLM 11; communication unit 15 which is a communication device that communicates with external devices via a network such as a LAN (Local Area Network) or the Internet, or directly by wired or wireless means without using a network; memory unit 16 which is a non-volatile memory device such as a semiconductor memory that stores various information; and control unit 17 which controls the entire e-book display system 10.
[0034] The SLM 11 can be realized by, for example, an LCD (Liquid Crystal Display), an organic EL display, or the like.
[0035] Various types of devices can be adopted as the sound output unit 12. For example, the sound output unit 12 can be realized by a speaker.
[0036] The operation unit 13 may be one in which operations are input by voice.
[0037] As long as it is possible to detect the spatial position of an object, various types of systems can be adopted for the position detection unit 14. For example, the position detection unit 14 can be realized by a sensor that detects the direction and distance of an object relative to itself by irradiating a region of a real image reproduced by a hologram displayed on the SLM 11 with laser light and detecting the light reflected by the object.
[0038] The storage unit 16 stores an electronic book display program 16a for displaying electronic books. The electronic book display program 16a may be installed in the electronic book display system 10 during the manufacturing stage of the electronic book display system 10, or may be additionally installed in the electronic book display system 10 from an external storage medium such as a USB (Universal Serial Bus) memory, or may be additionally installed in the electronic book display system 10 from a network.
[0039] The storage unit 16 can store 3D book data as 3D data of an electronic book for each electronic book, such as 3D book data 16b. In the 3D book data, the quantity of properties such as hardness, weight, etc. (hereinafter referred to as "property mass") are defined for each part, such as the part corresponding to the paper that forms the pages in a paper book. In other words, for an electronic book, the property quantities of the parts of a book (hereinafter referred to as a "real image book") reproduced as an image by a hologram displayed on the SLM 11 are set.
[0040] When 3D book data of an electronic book corresponding to a paper book is created, the 3D book data may be created with the same design as the paper book. When 3D book data of an electronic book corresponding to a paper book is created, the 3D book data may be created with a design different from that of the paper book, for example, by making the cover design of the electronic book different from that of the paper book, or by making the page change position of the text in the electronic book different from that of the paper book.
[0041] If the 3D book data includes information indicating an association between the e-book that is the target of this 3D book data and other e-books, when the e-book that is the target of this 3D book data is reproduced as a real image book, the e-book that is associated with this e-book can also be reproduced as a real image book in response to a user's instruction to the operation unit 13. If the 3D book data includes information indicating an association between a page in the e-book that is the target of this 3D book data and other e-books, when this page is reproduced as a real image, the e-book that is associated with this page can also be reproduced as a real image book in response to a user's instruction to the operation unit 13. If the 3D book data includes information indicating an association between elements such as sentences, characters, and figures in a page in the e-book that is the target of this 3D book data and other e-books, when this element is reproduced as a real image, the e-book that is associated with this element can also be reproduced as a real image book in response to a user's instruction to the operation unit 13.
[0042] When the 3D book data includes information indicating the association between the electronic book of the 3D book data and information such as images and sounds, when the electronic book of the 3D book data is reproduced as a real image book, the information associated with the electronic book can also be reproduced as a real image or output as sound by the sound output unit 12 in response to a user's instruction to the operation unit 13. When the 3D book data includes information indicating the association between a page in the electronic book of the 3D book data and information such as images and sounds, when the page is reproduced as a real image, the information associated with the page can also be reproduced as a real image or output as sound by the sound output unit 12 in response to a user's instruction to the operation unit 13. When the 3D book data includes information indicating the association between elements such as sentences, characters, figures, and other elements in a page in the electronic book of the 3D book data and information such as images and sounds, when the element is reproduced as a real image, the information associated with the element can also be reproduced as a real image or output as sound by the sound output unit 12 in response to a user's instruction to the operation unit 13.
[0043] If the 3D book data includes information indicating the association between a page in an e-book that is the target of this 3D book data and another e-book, when this page is reproduced as a real image, the e-book associated with this page can also be displayed three-dimensionally as a real image book within this page. An e-book that is displayed three-dimensionally as a real image book within an e-book that is reproduced as a real image book can also be subject to various operations for real image books, described below, such as page turning operations. If the 3D book data includes information indicating the association between a page in an e-book that is the target of this 3D book data and an image, when this page is reproduced as a real image, the image associated with this page can also be displayed as it is within this page.
[0044] The storage unit 16 can store, for each book cover, 3D cover data such as 3D cover data 16c, which is 3D data of a book cover that covers at least a part of the cover of a real image book.
[0045] The storage unit 16 can store 3D marker data, such as 3D data of marker members (hereinafter referred to as "marker members"), such as bookmarks and sticky notes, for each marker member, such as 3D marker data 16d. The marker members may be three-dimensional or planar.
[0046] The storage unit 16 can store 3D bookshelf data as 3D data of a bookshelf for each bookshelf, such as 3D bookshelf data 16e.
[0047] The storage unit 16 can store appearance change setting information 16f indicating settings related to an operation for changing the appearance of a real image book according to the amount of an electronic book read by a user (hereinafter referred to as "read amount"), and reading amount information 16g indicating the reading amount for each electronic book. The reading amount can be, for example, various things such as the number of times an electronic book is read by a user and the time. In the following, the reading amount will be described by taking the number of times an electronic book is read by a user as an example. The appearance change setting information 16f includes, for example, a setting of whether or not to change the appearance of a real image book according to the reading amount, and a setting of the type of appearance to be changed according to the reading amount. The types of appearance to be changed according to the reading amount include, for example, finger marks added to a part of the real image book such as the fore-edge, and deformation of the real image book. The deformation of the real image book includes, for example, curvature of the real image book, tearing of a page of the real image book, and folding of a page of the real image book. The hologram generating unit 17a described later can update the contents of the appearance change setting information 16f according to, for example, an instruction input to the operation unit 13.
[0048] The operation modes of the electronic book display system 10 include a normal mode in which writing is not possible in the real image book, and a writing mode in which objects such as highlighters, red underlines, figures, and handwritten characters (hereinafter referred to as "writing objects") can be written in the real image book. For example, a user may wish to read a real image book while writing on the pages of the real image book in order to improve the user's own memory of the display contents of the pages of the real image book. In addition, a user may wish to read a real image book while writing lines such as highlighters and red underlines on the pages of the real image book. The storage unit 16 can store a plurality of writing data as data for the writing mode, such as writing data 16h. The writing data is data indicating which writing object is located at which position on which page in the electronic book. The storage unit 16 can store the writing data for each electronic book. The storage unit 16 can store a plurality of writing data for the same electronic book. For example, a user may generate writing data for each purpose, such as writing data for learning and writing data for work, for the same electronic book.
[0049] The storage unit 16 can store an appearance and mass table 16i that indicates the correspondence between the appearance of the real image book and the property amount of the parts of the real image book. For example, in the appearance and mass table 16i, the weight of the parts forming the page may be set to be heavier when the appearance of the real image book is that of a stone slab than when the appearance of the real image book is that of a paper sheet.
[0050] The control unit 17 is a computer including, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory) that stores programs and various data, and a RAM (Random Access Memory) that serves as a memory used as a working area for the CPU of the control unit 17. The CPU of the control unit 17 executes the programs stored in the storage unit 16 or the ROM of the control unit 17.
[0051] By executing e-book display program 16a, control unit 17 realizes a hologram generation unit 17a that generates a hologram for reproducing an e-book as a three-dimensional image of the book, a display control unit 17b that causes SLM 11 to display the hologram generated by hologram generation unit 17a, a data combination unit 17c that combines multiple written data, a data division unit 17d that divides the written data, a property and mass change unit e that changes the property and mass set in the e-book, a text search unit 17f that performs a text search on the e-book, a book combination unit 17g that combines multiple e-books, and a book division unit 17h that divides e-books.
[0052] Fig. 2(a) is a front view of the SLM 11. Fig. 2(b) is a rear view of the SLM 11. Fig. 3(a) is a plan view of the SLM 11. Fig. 3(b) is a side view of the SLM 11.
[0053] As shown in FIGS. 2 and 3, the electronic book display system 10 includes a stand 18 that supports the SLM 11 .
[0054] The stand 18 includes a base member 18a to be placed on a floor or the like, a member 18b attached to the base member 18a and extending in the direction indicated by the arrow 10a perpendicular to the installation surface of the base member 18a, a member 18c partially housed inside the member 18b and movable in the direction indicated by the arrow 10a relative to the member 18b, a member 18d supported by the member 18c so as to be rotatable in the direction indicated by the arrow 10b about an axis of rotation extending in the direction indicated by the arrow 10a, a member 18e supported by the member 18d so as to be rotatable in the direction indicated by the arrow 10d about an axis of rotation extending in the direction indicated by the arrow 10c perpendicular to the direction indicated by the arrow 10a, and a member 18f supported by the member 18e so as to be rotatable in the direction indicated by the arrow 10f about an axis of rotation extending in the direction indicated by the arrow 10e perpendicular to both the direction indicated by the arrow 10a and the direction indicated by the arrow 10c. The member 18f is fixed to the SLM 11.
[0055] Stand 18 is capable of changing the position of SLM 11 in the direction indicated by arrow 10a by changing the position of member 18c relative to member 18b in the direction indicated by arrow 10a. Stand 18 is also capable of changing the orientation of the screen of SLM 11 by changing the angle of member 18d relative to member 18c in the rotational direction indicated by arrow 10b, the angle of member 18e relative to member 18d in the rotational direction indicated by arrow 10d, and the angle of member 18f relative to member 18e in the rotational direction indicated by arrow 10f.
[0056] FIG. 4 is a side view of an example of SLM 11 different from the example shown in FIG.
[0057] In the stand 18, the members 18d, 18e, and 18f shown in FIG. 3(b) may be replaced with members 18g and 18h shown in FIG.
[0058] Member 18g is supported by member 18c so as to be rotatable in the direction of rotation indicated by arrow 10b (see FIG. 3(a)). Member 18h is fixed to the SLM 11. Member 18h is supported by member 18g via a ball joint mechanism.
[0059] Next, the operation of the electronic book display system 10 will be described.
[0060] First, the operation of the electronic book display system 10 when starting to display an electronic book will be described.
[0061] FIG. 5 is a flowchart showing the operation of the electronic book display system 10 when starting to display an electronic book.
[0062] The user can input an instruction to display an electronic book (hereinafter referred to as a "book display instruction") to operation unit 13. The book display instruction specifies the electronic book selected by the user.
[0063] When a book display instruction is input to the operation unit 13, the hologram generating unit 17a executes the operation shown in FIG.
[0064] As shown in FIG. 5, the hologram generating unit 17a reads out the 3D book data of the electronic device specified in the book display instruction from the storage unit 16 (S101).
[0065] When the process of S101 ends, the hologram generating unit 17a generates 3D data for displaying a hologram (hereinafter referred to as "3D data for display") (S102). The hologram generating unit 17a generates 3D data for display in S102, including the 3D book data read in S101.
[0066] Hologram generating unit 17a generates a hologram for reproducing a real image based on the 3D data for display every time the 3D data for display is generated or changed. Display control unit 17b causes SLM 11 to display a hologram generated by hologram generating unit 17a every time a hologram is generated by hologram generating unit 17a. In the following, a description of generating a hologram for reproducing a real image based on the 3D data for display and causing SLM 11 to display the hologram will be omitted.
[0067] FIG. 6 is a diagram showing an example of the real image book 20 generated by the operation shown in FIG.
[0068] When hologram generating unit 17a generates the 3D data for display in S102, a hologram based on the 3D data for display is displayed on SLM 11, and the hologram displayed on SLM 11 generates, for example, a real image book 20 as shown in FIG.
[0069] As shown in FIG. 5, when the process of S102 ends, the hologram generating unit 17a increases the reading amount indicated in the reading amount information 16g by one for the electronic book corresponding to the 3D book data included in the display 3D data (S103).
[0070] When the process of S103 ends, the hologram generating unit 17a judges whether or not the appearance change setting information 16f is set to change the appearance of the real image book depending on the amount of reading (S104).
[0071] When the hologram generating unit 17a determines in S104 that the appearance change setting information 16f is set to change the appearance of the real image book according to the amount of reading, the hologram generating unit 17a changes the display 3D data so that the type of appearance set in the appearance change setting information 16f corresponds to the amount of reading indicated in the reading amount information 16g for the electronic book corresponding to the 3D book data included in the display 3D data (S105). For example, when the type of appearance set in the appearance change setting information 16f is fingerprints, the hologram generating unit 17a changes the display 3D data so that the more fingerprints are added to the real image book, the more the amount of reading. Also, when the type of appearance set in the appearance change setting information 16f is deformation of the real image book, the hologram generating unit 17a changes the display 3D data so that the more the deformation of the real image book, the more the amount of reading. Therefore, the appearance of the real image book corresponds to the amount of reading.
[0072] Fig. 7(a) is a diagram showing an example of the real image book 20 generated by the operation shown in Fig. 5, which is different from the example shown in Fig. 6. Fig. 7(b) is a diagram showing an example of the real image book 20 generated by the operation shown in Fig. 5, which is different from the examples shown in Fig. 6 and Fig. 7(a).
[0073] The example of the real image book 20 shown in Fig. 7(a) is an example in which the type of appearance set in the appearance change setting information 16f is "fingerprint." Fingerprint 21 is expressed in the real image book 20 shown in Fig. 7(a).
[0074] The example of the real image book 20 shown in Fig. 7(b) is an example in which the type of appearance set in the appearance change setting information 16f is a curved real image book. The real image book 20 shown in Fig. 7(b) is curved.
[0075] As shown in Figure 5, when the hologram generation unit 17a determines in S104 that changing the appearance of the real image book according to the amount of reading is not set in the appearance change setting information 16f, or when the processing of S105 is completed, the operation shown in Figure 5 is terminated.
[0076] The hologram generating unit 17a can change the display 3D data in response to an instruction input to the operating unit 13 in order to change at least one of the size and brightness of the real image book. For example, when the characters displayed on the real image book are small and difficult to read, the user can increase the size of the real image book to make the characters larger. Also, when the size of the real image book is too large or too small to operate the real image book, the user can improve the operability of the real image book by changing the size of the real image book.
[0077] The hologram generating unit 17a can change the 3D data for display in response to an instruction input to the operating unit 13 in order to change at least one of the font and the size of the characters displayed on the real image book.
[0078] Next, the operation of the electronic book display system 10 when an operation for a real image book is input will be described.
[0079] When the position detection unit 14 detects a user's operation on the real image book, the hologram generation unit 17a changes the display 3D data in accordance with the operation detected by the position detection unit 14. When changing the display 3D data in accordance with the operation detected by the position detection unit 14, the hologram generation unit 17a changes the display 3D data based on, for example, the magnitude and direction of the force corresponding to the operation detected by the position detection unit 14 and the physical mass included in the display 3D data. Therefore, the real image book executes an operation corresponding to the operation detected by the position detection unit 14.
[0080] Fig. 8(a) is a diagram showing an example of the real image book 20 immediately before it is opened by the user's hand 30. Fig. 8(b) is a diagram showing an example of the real image book 20 in the middle of being opened by the user's hand 30. Fig. 8(c) is a diagram showing an example of the real image book 20 immediately after it is opened by the user's hand 30.
[0081] For example, when the position detection unit 14 detects that an operation similar to the operation of opening a paper book has been input to the real image book, the hologram generation unit 17a gradually changes the display 3D data over time so that an operation similar to the operation of opening the paper book occurs in the real image book when the operation of opening the paper book is executed. Thus, for example, the real image book 20 shown in Fig. 6 is opened in response to an operation by the user's hand 30 as shown in Fig. 8.
[0082] FIG. 9(a) is a diagram showing an example of the real image book 20 immediately before a page is turned by the user's hand 30. FIG. 9(b) is a diagram showing an example of the real image book 20 in the middle of a page being turned by the user's hand 30. FIG. 9(c) is a diagram showing an example of the real image book 20 immediately after a page is turned by the user's hand 30. FIG. 10(a) is a diagram showing an example of the real image book 20 immediately before a plurality of pages are turned all at once by the user's hand 30. FIG. 10(b) is a diagram showing an example of the real image book 20 in the middle of a plurality of pages being turned all at once by the user's hand 30. FIG. 10(c) is a diagram showing an example of the real image book 20 immediately after a plurality of pages are turned all at once by the user's hand 30.
[0083] For example, when the position detection unit 14 detects that an operation similar to the operation of turning a page of a paper book has been input to the real image book, the hologram generation unit 17a gradually changes the display 3D data over time so that an operation similar to the operation of turning a page of a paper book occurs in the real image book when the operation of turning a page of the paper book is executed. Therefore, for example, the real image book 20 shown in FIG. 8(c) is turned in response to an operation by the user's hand 30 as shown in FIG. 9 or FIG. 10. The operation of turning a page may be an operation of turning one page at a time as shown in FIG. 9, or an operation of turning a plurality of pages at once as shown in FIG. 10. The hologram generation unit 17a may generate a hologram so that the page of the real image book is turned at a speed according to the material mass included in the 3D book data included in the display 3D data. For example, the hologram generation unit 17a may generate a hologram so that the heavier the parts forming the page of the real image book are, the faster the page of the real image book is turned.
[0084] Fig. 11(a) is a diagram showing an example of the real image book 20 immediately before it is closed by the user's hand 30. Fig. 11(b) is a diagram showing an example of the real image book 20 in the process of being closed by the user's hand 30. Fig. 11(c) is a diagram showing an example of the real image book 20 immediately after it is closed by the user's hand 30.
[0085] For example, when the position detection unit 14 detects that an operation similar to the operation of closing the paper book has been input to the real image book, the hologram generation unit 17a gradually changes the display 3D data over time so that an operation similar to the operation of closing the paper book occurs in the real image book when the operation of closing the paper book is executed. Therefore, for example, the real image book 20 shown in Fig. 8(c) is closed in response to an operation by the user's hand 30 as shown in Fig. 11.
[0086] Fig. 12(a) is a diagram showing an example of the real image book 20 immediately before its orientation is changed by the user's hand 30. Fig. 12(b) is a diagram showing an example of the real image book 20 in the middle of its orientation being changed by the user's hand 30. Fig. 12(c) is a diagram showing an example of the real image book 20 immediately after its orientation is changed by the user's hand 30.
[0087] For example, when the position detection unit 14 detects that an operation similar to an operation to change the orientation of a paper book has been input to the real image book, the hologram generation unit 17a gradually changes the display 3D data over time so that an operation similar to the operation of changing the orientation of the paper book occurs in the real image book when an operation to change the orientation of the paper book is executed. Therefore, for example, the orientation of the real image book 20 shown in Fig. 8(c) is changed in response to an operation by the user's hand 30 as shown in Fig. 12.
[0088] Fig. 13(a) is a diagram showing an example of the real image book 20 immediately before a page is torn by the user's hand 30. Fig. 13(b) is a diagram showing an example of the real image book 20 in the middle of a page being torn by the user's hand 30. Fig. 13(c) is a diagram showing an example of the real image book 20 immediately after a page has been torn by the user's hand 30.
[0089] For example, when the position detection unit 14 detects that an operation similar to an operation of tearing a page of a paper book has been input to the real image book, the hologram generation unit 17a gradually changes the display 3D data over time so that an operation similar to the operation of tearing a page of a paper book occurs in the real image book when the operation of tearing a page of the paper book is executed. Therefore, for example, in the real image book 20 shown in Fig. 8(c), a page is torn in response to an operation by the user's hand 30 as shown in Fig. 13. For example, the user can visually obtain a sense of accomplishment from reading by tearing a page that the user has read among the pages in the real image book.
[0090] Fig. 14(a) is a diagram showing an example of the real image book 20 immediately before a page is folded by the user's hand 30. Fig. 14(b) is a diagram showing an example of the real image book 20 in the middle of folding a page by the user's hand 30. Fig. 14(c) is a diagram showing an example of the real image book 20 immediately after a page is folded by the user's hand 30.
[0091] For example, when the position detection unit 14 detects that an operation similar to an operation of folding a page of a paper book has been input to the real image book, the hologram generation unit 17a gradually changes the display 3D data over time so that an operation similar to the operation of folding a page of a paper book occurs in the real image book when an operation of folding a page of a paper book is executed. Therefore, for example, the real image book 20 shown in FIG. 8(c) has a page folded in response to an operation by the user's hand 30 as shown in FIG. 14. For example, the user can easily find the page he or she is focusing on by making a crease on the page of the real image book that he or she is focusing on as a marker.
[0092] When changing the display 3D data, the hologram generating unit 17a may output a sound corresponding to the change in the display 3D data from the sound output unit 12. For example, when changing the display 3D data so that a real image book is opened, the hologram generating unit 17a may output a sound similar to a sound generated when a paper book is opened from the sound output unit 12 in accordance with the situation in which the real image book is opened. When changing the display 3D data so that a page of a real image book is turned, the hologram generating unit 17a may output a sound similar to a sound generated when a page of a paper book is turned from the sound output unit 12 in accordance with the situation in which the page of the real image book is turned. When changing the display 3D data so that a real image book is closed, the hologram generating unit 17a may output a sound similar to a sound generated when a paper book is closed from the sound output unit 12 in accordance with the situation in which the real image book is closed.
[0093] Fig. 15(a) is a diagram showing an example of the real image book 20 when observed by a user. Fig. 15(b) is a diagram showing an example of the real image book 20 shown in Fig. 15(a) when observed by a person other than the user.
[0094] When the display contents of the page of the real image book 20 are visible from the viewpoint of the user of the SLM 11 as shown in Fig. 15(a), the hologram generating unit 17a can generate a hologram in which, of the covers of the real image book 20, the front cover that is invisible from the viewpoint of the user can be seen from the viewpoint of a person other than the user of the SLM 11 as shown in Fig. 15(b). Therefore, when the display contents of the page of the real image book 20 are visible from the viewpoint of the user of the SLM 11 as shown in Fig. 15(a), the electronic book display system 10 can display on the SLM 11 a hologram in which, of the covers of the real image book 20, the front cover that is invisible from the viewpoint of the user can be seen from the viewpoint of a person other than the user of the SLM 11 as shown in Fig. 15(b). Although the front cover has been described, the same applies to the back cover and the spine cover. In other words, when the display contents of a page of a real image book 20 are visible from the viewpoint of a user of SLM11, the electronic book display system 10 can display a hologram on SLM11 in which at least a portion of the cover of the real image book 20 that is not visible from the viewpoint of the user is visible from the viewpoint of a person other than the user of SLM11.
[0095] Next, the operation of the electronic book display system 10 in the writing mode will be described.
[0096] When the operation mode of the electronic book display system 10 is the normal mode and a real image book is being played back, the user can input an instruction to switch the operation mode of the electronic book display system 10 from the normal mode to the writing mode (hereinafter referred to as a "writing mode transition instruction") to the operation unit 13. The writing mode transition instruction can specify writing data selected by the user from among the writing data for the current real image book stored in the storage unit 16.
[0097] FIG. 16 is a flowchart showing the operation of the electronic book display system 10 in the writing mode.
[0098] When an instruction to switch to the writing mode is input to the operation unit 13, the hologram generating unit 17a executes the operation shown in FIG.
[0099] As shown in FIG. 16, hologram generating unit 17a determines whether or not write data is specified in the write mode transition instruction input to operation unit 13 (S121).
[0100] When the hologram generating unit 17a determines in S121 that no write data is specified in the write mode transition instruction input to the operation unit 13, the hologram generating unit 17a generates new write data for the current real image book in the storage unit 16 (S122).
[0101] When hologram generating unit 17a determines in S121 that write data is specified in the write mode transition instruction input to operation unit 13, it reads out the write data specified in the write mode transition instruction from storage unit 16 (S123).
[0102] When the process of S123 is completed, the hologram generating unit 17a changes the display 3D data so as to place the writing object in the current real image book based on the writing data read in S123 (S124). Therefore, the writing object is placed in the current real image book based on the writing data read in S123.
[0103] When the process of S122 or S124 ends, the hologram generating unit 17a judges whether or not an instruction to edit the writing object for the current real image book (hereinafter referred to as an "object editing instruction") has been input to the operation unit 13 or the position detecting unit 14 (S125). Examples of editing the writing object include placing a new writing object in the real image book, changing the position of any writing object already placed in the real image book, and deleting any writing object already placed in the real image book from the real image book.
[0104] When the hologram generating unit 17a determines in S125 that an object editing instruction has been input to the operation unit 13 or the position detecting unit 14, the hologram generating unit 17a changes the display 3D data (S126) so as to change the arrangement of the writing object in the real image book in accordance with the object editing instruction input to the operation unit 13 or the position detecting unit 14. Therefore, the arrangement of the writing object in the real image book follows the object editing instruction.
[0105] When the process of S126 ends, the hologram generating unit 17a reflects the change in the arrangement of the write object with respect to the real image book, which was executed in S126, in the target write data in the storage unit 16 (S127). The target write data is the write data generated in S122 if no write data is specified in the write mode transition instruction, and is the write data specified in the write mode transition instruction if write data is specified in the write mode transition instruction.
[0106] When the hologram generation unit 17a determines in S125 that an object editing instruction has not been input to the operation unit 13 or the position detection unit 14, or when the processing of S127 is completed, it determines whether or not an instruction to transition the operating mode of the electronic book display system 10 from the writing mode to the normal mode (hereinafter referred to as a "normal mode transition instruction") has been input to the operation unit 13 (S128).
[0107] If hologram generating unit 17a determines in S128 that the instruction to transition to the normal mode has not been input to operation unit 13, it executes the process of S125.
[0108] When the hologram generating unit 17a determines in S128 that a normal mode transition instruction has been input to the operation unit 13, the hologram generating unit 17a changes the display 3D data so as to delete all writing objects from the current real image book (S129). Therefore, the real image book will have no writing objects arranged therein.
[0109] When the process of S129 ends, the hologram generating unit 17a ends the operation shown in FIG.
[0110] Next, the operation of the electronic book display system 10 when a plurality of pieces of writing data are combined will be described.
[0111] The user can input an instruction to combine multiple pieces of writing data (hereinafter referred to as a "data combining instruction") to the operation unit 13. The multiple pieces of writing data selected by the user are specified in the data combining instruction. The multiple pieces of writing data specified in the data combining instruction are writing data for the same electronic book.
[0112] When a data merging instruction is input to the operation unit 13, the data merging unit 17c reads out the multiple pieces of writing data specified in the data merging instruction from the storage unit 16. Next, the data merging unit 17c generates one piece of writing data by merging the multiple pieces of writing data read out from the storage unit 16. Then, the data merging unit 17c writes the writing data generated by the merging into the storage unit 16 as new writing data for the electronic book that is the target of the multiple pieces of writing data before the merging.
[0113] Fig. 17(a) is a diagram showing an example of a page of a real image book on which a writing object is arranged based on the writing data 16h (see Fig. 1). Fig. 17(b) is a diagram showing an example of a page of a real image book on which a writing object is arranged based on writing data different from the writing data 16h. Fig. 17(c) is a diagram showing an example of a page of a real image book on which a writing object is arranged based on writing data obtained by combining the writing data 16h and the writing data shown in Fig. 17(b).
[0114] The page shown in FIG. 17(a), the page shown in FIG. 17(b), and the page shown in FIG. 17(c) are the same page in the same real image book.
[0115] In the page shown in FIG. 17(a), a marker 41 is placed as a writing object based on writing data 16h.
[0116] In the page shown in FIG. 17(b), a red underline 42 is placed as a writing object based on writing data different from the writing data 16h.
[0117] The page shown in Fig. 17(c) is a page of a real image book in which a writing object is arranged based on writing data that combines the writing data 16h shown in Fig. 17(a) and the writing data shown in Fig. 17(b). The page shown in Fig. 17(c) includes the marker 41 shown in Fig. 17(a) at the position shown in Fig. 17(a) and the red underline 42 shown in Fig. 17(b) at the position shown in Fig. 17(b).
[0118] Next, the operation of the electronic book display system 10 when the writing data is divided will be described.
[0119] The user can input an instruction to divide the writing data (hereinafter referred to as a "data division instruction") to the operation unit 13. The data division instruction specifies the writing data selected by the user and the conditions for dividing the writing data. The conditions for division specified in the data division instruction can be any condition, such as the type of object. For example, the conditions for division specified in the data division instruction is a condition that a marker as a writing object and a red underline as a writing object are to be divided into separate writing data.
[0120] When a data division instruction is input to operation unit 13, data division unit 17d reads out the writing data specified in the data division instruction from storage unit 16. Next, data division unit 17d divides the writing data read out from storage unit 16 under the conditions specified in the data division instruction to generate multiple pieces of writing data. Then, data division unit 17d writes each of the multiple pieces of writing data generated by the division into storage unit 16 as new writing data for the electronic book that is the target of the writing data before division.
[0121] Next, the operation of the electronic book display system 10 when automatically turning the pages of a real image book will be described.
[0122] When an instruction to automatically turn the pages of a real image book (hereinafter referred to as an "automatic page-turning instruction") is input to the operation unit 13, the hologram generating unit 17a gradually changes the display 3D data over time so that an operation similar to the page-turning operation of a paper book occurs in the real image book when an operation to turn the pages of the paper book is executed. Therefore, the real image book automatically turns the pages in response to the automatic page-turning instruction input to the operation unit 13 by the user. When changing the display 3D data in response to the automatic page-turning instruction, the hologram generating unit 17a may change the display 3D data based on the property mass included in the 3D book data included in the display 3D data, for example. In other words, the hologram generating unit 17a may generate a hologram so that the pages of the real image book are turned at a speed according to the property mass included in the 3D book data included in the display 3D data. For example, the hologram generating unit 17a may generate a hologram such that the heavier the parts forming the page of the real image book are, the faster the page of the real image book is turned over.
[0123] In the automatic page-turning instruction, the user can specify the speed at which pages are automatically turned. When the speed at which pages are automatically turned is specified in the automatic page-turning instruction, the hologram generating unit 17a gradually changes the display 3D data over time when changing the display 3D data in response to the automatic page-turning instruction, so that the pages are automatically turned at the speed specified in the automatic page-turning instruction.
[0124] When the hologram generating unit 17a changes the display 3D data so that the pages of a real image book are turned, the hologram generating unit 17a may output a sound from the sound output unit 12 that is similar to the sound that is produced when the pages of a paper book are turned, in accordance with the situation in which the pages of the real image book are turned.
[0125] Next, the operation of the electronic book display system 10 when the appearance of the real image book is changed in response to an instruction from the user will be described.
[0126] When an instruction to change the appearance of the real image book (hereinafter referred to as "appearance change instruction") is input to the operation unit 13, the hologram generation unit 17a changes the display 3D data according to the appearance change instruction input to the operation unit 13. Therefore, the appearance of the real image book is changed to an appearance according to the appearance change instruction input to the operation unit 13 by the user. For example, when the appearance change instruction is an instruction to change the appearance of the real image book to a paperback-like appearance, the hologram generation unit 17a changes the display 3D data so that the appearance of the real image book becomes a paperback-like appearance. Similarly, when the appearance change instruction is an instruction to change the appearance of the real image book to, for example, a hardcover-like appearance, an appearance in which the parts forming the pages are formed of wood boards instead of paper, an appearance in which the parts forming the pages are formed of bamboo boards instead of paper, an appearance in which the parts forming the pages are formed of stone boards instead of paper, or the like, the hologram generation unit 17a changes the display 3D data so that the appearance of the real image book becomes the appearance instructed by the appearance change instruction. When the appearance change instruction is an instruction to change the appearance of the real image book to a design preferred by the user, such as a design of a specific character, the hologram generating unit 17a changes the display 3D data so that the appearance of the real image book becomes the appearance instructed by the appearance change instruction.
[0127] When changing the appearance of the real image book, the hologram generating unit 17a may change the property amount included in the 3D book data included in the display 3D data to a property amount corresponding to the changed appearance based on the appearance property amount table 16i. That is, when changing the appearance of the real image book, the hologram generating unit 17a may set the property amount corresponding to the changed appearance to the electronic book.
[0128] Next, the operation of the electronic book display system 10 in the case where the property amount of the real image book is changed in response to an instruction from the user will be described.
[0129] When an instruction to change the property quantity of the real image book is input to the operation unit 13, the property mass changing unit e changes the property mass included in the 3D book data included in the display 3D data in accordance with the instruction input to the operation unit 13.
[0130] When a page-turning operation is input to the position detection unit 14 for a real image book, the speed at which the pages turn in the real image book is related to the property mass included in the 3D book data of the real image book. Therefore, when the property mass included in the 3D book data of the real image book is changed, the speed at which the pages turn in the real image book may change when a page-turning operation is input to the position detection unit 14 for the real image book.
[0131] Next, the operation of the electronic book display system 10 when a book cover is attached to a real image book will be described.
[0132] The user can input an instruction to attach a book cover to a real image book (hereinafter referred to as a "cover attachment instruction") to the operation unit 13. The cover attachment instruction specifies 3D cover data selected by the user.
[0133] When a cover attachment instruction is input to operation unit 13, hologram generation unit 17a changes the display 3D data so that a book cover indicated by the 3D cover data specified in the cover attachment instruction input to operation unit 13 is attached to the real image book. That is, hologram generation unit 17a adds the 3D cover data to the display 3D data. Therefore, a book cover according to the cover attachment instruction input to operation unit 13 by the user is attached to the real image book.
[0134] Fig. 18(a) is a diagram showing an example of the real image book 20 with the book cover 51 attached when observed by a user. Fig. 18(b) is a diagram showing an example of the real image book 20 shown in Fig. 18(a) when observed by a person other than the user.
[0135] The hologram for reconstructing the image shown in Figure 18 differs from the hologram for reconstructing the image shown in Figure 15 in that a book cover 51 is attached to a real image book 20. The viewpoint for SLM 11 shown in Figure 15(a) is the same as the viewpoint for SLM 11 shown in Figure 18(a). The viewpoint for SLM 11 shown in Figure 15(b) is the same as the viewpoint for SLM 11 shown in Figure 18(b).
[0136] In the hologram shown in FIG. 18, a book cover 51 covers the part of the cover of real image book 20 that is not visible from the viewpoint of the user but is visible from the viewpoints of persons other than the user in the hologram shown in FIG.
[0137] When the display contents of a page of the real image book 20 are visible from the viewpoint of a user of the SLM 11 as shown in Fig. 18(a), the electronic book display system 10 can display on the SLM 11 a hologram in which a portion of the book cover 51 of the real image book 20 that covers the front cover of the real image book 20 is visible from the viewpoint of a person other than the user of the SLM 11 as shown in Fig. 18(b). Although the front cover has been described, the same is true for the back cover and the spine. In other words, when the display contents of a page of the real image book 20 are visible from the viewpoint of a user of the SLM 11, the electronic book display system 10 can display on the SLM 11 a hologram in which at least a portion of a portion of the book cover 51 of the real image book 20 that covers at least one of the front cover, back cover, and spine cover of the real image book 20 is visible from the viewpoint of a person other than the user of the SLM 11.
[0138] Next, the operation of the electronic book display system 10 when a mark member is added to a real image book in response to an instruction from a user will be described.
[0139] The user can input an instruction to add a mark member to the real image book (hereinafter referred to as a "mark member addition instruction") to the operation unit 13 or the position detection unit 14. The mark member addition instruction specifies 3D mark data selected by the user.
[0140] When a mark member addition instruction is input to the operation unit 13 or the position detection unit 14, the hologram generation unit 17a changes the display 3D data so that a mark member is added to the real image book in accordance with the mark member addition instruction input to the operation unit 13 or the position detection unit 14. That is, the hologram generation unit 17a adds 3D mark data to the display 3D data. Therefore, a mark member is added to the real image book in accordance with the mark member addition instruction input by the user to the operation unit 13 or the position detection unit 14. For example, when the real image book is an animal picture book, the user can use a three-dimensional animal mark member as a bookmark and place it between pages of the real image book that the user desires.
[0141] Next, the operation of the electronic book display system 10 in the case where a mark member is added to a real image book in accordance with the result of a text search for the real image book will be described.
[0142] The text search unit 17f can execute a text search on the real image book in response to an instruction input to the operation unit 13. Then, the hologram generation unit 17a changes the display 3D data so as to add a mark member to the real image book in response to the result of the text search. That is, the hologram generation unit 17a adds 3D mark data to the display 3D data. Therefore, a mark member according to the result of the text search is added to the real image book.
[0143] For example, when a text search is performed to search for the word "rice" in a real image book, the hologram generating unit 17a can add a marker member to a page in the real image book that includes the word "rice." Therefore, the user can easily recognize a page in the real image book that includes the word "rice."
[0144] Next, the operation of the electronic book display system 10 when ending the display of the electronic book will be described.
[0145] The user can input to operation unit 13 an instruction to end the display of the electronic book (hereinafter referred to as a “display end instruction”).
[0146] When a display end instruction is input to operation unit 13, hologram generating unit 17a deletes the 3D data for display. Therefore, the hologram displayed on SLM 11 disappears. As a result, the real image book no longer exists.
[0147] Next, the operation of the electronic book display system 10 when a plurality of electronic books are combined will be described.
[0148] A user can input an instruction to combine multiple electronic books (hereinafter referred to as a "book combining instruction") to the operation unit 13. In the book combining instruction, multiple electronic books selected by the user are specified. The multiple electronic books specified in the book combining instruction may be multiple electronic books belonging to the same series, such as volume 1, volume 2, and volume 3, or multiple electronic books not belonging to the same series.
[0149] When a book combining instruction is input to the operation unit 13, the book combining unit 17g reads out the 3D book data of the multiple electronic books specified in the book combining instruction from the storage unit 16. Next, the book combining unit 17g combines the multiple 3D book data read out from the storage unit 16 to generate one 3D book data so that the multiple electronic books specified in the book combining instruction are combined into one electronic book. Then, the book combining unit 17g writes the 3D book data generated by the combination into the storage unit 16 as new 3D book data.
[0150] Therefore, the user can start displaying one electronic book that is a combination of multiple electronic books on the electronic book display system 10, and read this electronic book as a real image book. The thickness of a real image book is expressed as the number of pages of the electronic book. Therefore, the thickness of a real image book that combines multiple electronic books is thicker than the thickness of each of the real image books before the combination.
[0151] Next, the operation of the electronic book display system 10 when an electronic book is divided will be described.
[0152] A user can input an instruction to divide an electronic book (hereinafter referred to as a "book division instruction") into operation unit 13. The book division instruction specifies the electronic book selected by the user and the division location in this electronic book. The division location specified in the book division instruction can be any location, such as a chapter break such as chapter 1, chapter 2, chapter 3, etc.
[0153] When a book division instruction is input to the operation unit 13, the book division unit 17h reads out 3D book data of the electronic book specified in the book division instruction from the storage unit 16. Next, the book division unit 17h divides the 3D book data read out from the storage unit 16 to generate multiple pieces of 3D book data so that the electronic book specified in the book division instruction is divided at the positions specified in the book division instruction into multiple electronic books. Then, the book division unit 17h writes each of the multiple pieces of 3D book data generated by the division into the storage unit 16 as new 3D book data.
[0154] Therefore, a user can, for example, cause the electronic book display system 10 to start displaying one of the multiple electronic books divided from one electronic book, and read this electronic book as a real image book. The thickness of a real image book is expressed as the number of pages of the electronic book. Therefore, the thickness of each of the multiple electronic books divided from one electronic book is thinner than the thickness of the real image book before the division.
[0155] Next, the operation of the electronic book display system 10 when multiple real image books are displayed will be described.
[0156] A user can input an instruction to display a plurality of real-image books (hereinafter referred to as a "display instruction") to the operation unit 13. In the display instruction, a plurality of electronic books selected by the user are specified. When specifying electronic books in the display instruction, any electronic book may be specified individually, or the electronic books may be specified according to attributes of the electronic books, such as electronic books that the user has read.
[0157] FIG. 19 is a diagram showing an example of real image books 61 to 66 displayed on display, which are reproduced by holograms displayed on the SLM 11. As shown in FIG.
[0158] When a display display instruction is input to the operation unit 13, the hologram generation unit 17a reads out 3D book data of the multiple electronic books specified in the display display instruction from the storage unit 16. Next, the hologram generation unit 17a generates 3D data for display including the multiple 3D book data read out from the storage unit 16 so that the multiple real image books corresponding to the multiple electronic books specified in the display display instruction are displayed. Therefore, the user can see the multiple real image books corresponding to the multiple electronic books specified in the display display instruction displayed as shown in FIG. 19, for example. For example, the user can identify the real image book that the user himself / herself wishes to read from the multiple real image books displayed by checking the covers, such as the spines, of the multiple displayed real image books.
[0159] Next, the operation of the electronic book display system 10 when displaying a bookshelf on which real image books are displayed will be described.
[0160] A user can input an instruction to display a bookshelf where real books are displayed (hereinafter referred to as a "bookshelf display instruction") to operation unit 13. At least one electronic book selected by the user and a bookshelf selected by the user are specified in the bookshelf display instruction. The electronic book specified in the bookshelf display instruction may be any electronic book individually, or may be specified according to the attributes of the electronic book, for example, electronic books that the user has read.
[0161] FIG. 20 is a diagram showing an example of a bookshelf 70 on which real image books 61 to 66 are displayed, which is reproduced by a hologram displayed on the SLM 11.
[0162] When a bookshelf display instruction is input to the operation unit 13, the hologram generating unit 17a reads out from the storage unit 16 3D book data of the electronic book specified in the bookshelf display instruction and 3D bookshelf data of the bookshelf specified in the bookshelf display instruction. Next, the hologram generating unit 17a generates 3D display data including the multiple 3D data read out from the storage unit 16 so that the real image books corresponding to the electronic books specified in the bookshelf display instruction are displayed on the bookshelf. Therefore, the user can see the real image of the bookshelf on which the real image books corresponding to the electronic books specified in the bookshelf display instruction are displayed, as shown in FIG. 20, for example. For example, the user can identify the real image book that the user himself / herself wishes to read from among the multiple real image books displayed on the bookshelf by checking the covers, such as the spine cover and the front cover, of the real image books displayed on the bookshelf.
[0163] Next, the operation of the electronic book display system 10 when a plurality of real image books are stacked and displayed will be described.
[0164] The user can input an instruction to display multiple real-image books in a stacked manner (hereinafter referred to as a "stacked display instruction") to the operation unit 13. In the stacked display instruction, multiple electronic books selected by the user are specified. When specifying electronic books in the stacked display instruction, any electronic book may be specified individually, or the electronic books may be specified according to the attributes of the electronic books, such as electronic books that the user has read.
[0165] FIG. 21 is a diagram showing an example of real image books 61 to 66 stacked up, which are reconstructed by a hologram displayed on the SLM 11. As shown in FIG.
[0166] When a stacking display instruction is input to the operation unit 13, the hologram generating unit 17a reads out from the storage unit 16 the 3D book data of the electronic books specified in the stacking display instruction. Next, the hologram generating unit 17a generates 3D data for display including the 3D book data read out from the storage unit 16 so that the real image books corresponding to the electronic books specified in the stacking display instruction are stacked. Therefore, the user can see the real image books corresponding to the electronic books specified in the stacking display instruction stacked up as shown in FIG. 21 for example. For example, the user can visually obtain a sense of accomplishment from reading by seeing the real image books that the user himself has read stacked up. In addition, the user can visually obtain a sense of accomplishment from writing on the real image books by seeing the real image books that the user himself has written on stacked up. In addition, the user can visually increase his or her expectations for future reading by seeing the real image books that the user himself or herself plans to read stacked up.
[0167] Next, the use of real books as decoration will be described.
[0168] For example, by placing SLM11 on a real shelf or on a real desk, near a location where a user wishes a real image book to be placed as decoration, the real image book reproduced by the hologram displayed on SLM11 can be used as part of the interior or exterior decoration.
[0169] As described above, the electronic book display system 10 reproduces an electronic book as a three-dimensional image of the book, for example as shown in Figures 6 to 15 and 18, so that the difference in appearance of the book from a paper book can be reduced, thereby improving the comfort of using the electronic book.
[0170] When an operation on a real image book by an object is detected by position detection unit 14, electronic book display system 10 generates a hologram that changes the real image book in accordance with the operation detected by position detection unit 14, as shown in Figs. 8 to 14, for example, and can give the user the sensation of directly operating the real image book. Therefore, electronic book display system 10 can reduce the difference in operability between a book and a paper book, and as a result, can improve the comfort of using electronic books.
[0171] As shown in FIG. 15, for example, when the display contents of a page of a real image book are visible from the viewpoint of a user of SLM11, electronic book display system 10 can display a hologram on SLM11 that allows at least a portion of the cover of the real image book that is not visible from the viewpoint of the user to be seen from the viewpoint of a person other than the user of SLM11.Therefore, when the user is looking at the display contents of a page of a real image book, the cover of the real image book can be shown to people other than the user.
[0172] Since electronic book display system 10 can generate a hologram in which a book cover is not attached to a real image book as shown in Fig. 15, for example, and can generate a hologram in which a book cover is attached to a real image book as shown in Fig. 18, for example, it is possible to attach a book cover to a real image book. Therefore, a user can, for example, excite himself by attaching a book cover of his own choice to a real image book.
[0173] In the electronic book display system 10, when the display contents of the page of the real image book are visible from the viewpoint of the user of the SLM 11, for example, when the book cover is not attached to the real image book as shown in Fig. 15, at least a part of the cover of the real image book that is invisible from the viewpoint of the user is visible from the viewpoint of a person other than the user of the SLM 11, and when the book cover is attached to the real image book as shown in Fig. 18, for example, the book cover covers at least a part of the cover of the real image book that is invisible from the viewpoint of the user and visible from the viewpoint of a person other than the user when the book cover is not attached to the real image book, so that when the user is looking at the display contents of the page of the real image book, at least a part of the cover of the real image book is hidden by the book cover from people other than the user. Therefore, by attaching a book cover to the real image book, the user can, for example, reduce the possibility that people other than the user will immediately know what book the user is reading.
[0174] The electronic book display system 10 changes the appearance of the real image book reproduced by the hologram according to the amount of electronic book read, for example as shown in FIG. 7, so that the user can easily recognize the amount of electronic book read.
[0175] When an operation to tear a page of a real image book is performed as shown in FIG. 13, the e-book display system 10 generates a hologram of the real image book with the page torn as shown in FIG. 13(c), thereby reducing the difference between the operability and appearance of the book and a paper book, and as a result, improving the comfort of using e-books.
[0176] When an operation to fold a page of a real image book is performed as shown in FIG. 14, the e-book display system 10 generates a hologram of the real image book with the page folded as shown in FIG. 14(c), thereby reducing the difference between the operability and appearance of the book and a paper book, and as a result, improving the comfort of using e-books.
[0177] The electronic book display system 10 generates a hologram so that the pages of the real image book are turned at a speed corresponding to the property quantities of the parts of the real image book, and therefore the speed at which the pages of the real image book are turned can be set to a speed corresponding to the property quantities of the parts of the real image book.
[0178] When changing the appearance of a real image book, the electronic book display system 10 sets a property quantity corresponding to the changed appearance in the electronic book, so that the speed at which the pages of the real image book are turned can be set to a speed corresponding to the appearance of the real image book.
[0179] Since the electronic book display system 10 reproduces the image of the book by a hologram displayed on the SLM 11, it is highly likely that the user will not need to focus on the screen of the SLM 11, which reduces the strain on the user's eyes compared to conventional electronic books that require the user to focus on the screen.
[0180] In this embodiment, electronic book display system 10 may receive at least some of the various instructions received by operation unit 13 from an electronic device such as a user's PC (Personal Computer) or smartphone via communication unit 15. E-book display system 10 may reproduce the operation unit as a real image by a hologram displayed on SLM 11, and receive at least some of the various instructions received by operation unit 13 by position detection unit 14 as operations for the operation unit reproduced as a real image by the hologram displayed on SLM 11.
[0181] In this embodiment, the electronic book display system 10 includes a stand 18 that supports the SLM 11. However, the electronic book display system 10 does not necessarily have to include the stand 18.
[0182] In this embodiment, electronic book display system 10 reproduces an electronic book as a real image of a book by a hologram displayed on SLM 11. However, if electronic book display system 10 is not configured to detect an operation on the image of the book reproduced by the hologram displayed on SLM 11 by position detection unit 14, it may reproduce an electronic book as a virtual image of the book by a hologram displayed on SLM 11. When an electronic book is reproduced as a virtual image of the book by a hologram displayed on SLM 11, an operation on the image of the book may be input by operation unit 13, for example. [Explanation of symbols]
[0183] 10. E-Book Display System 11 SLM 14 Position detection unit 16a E-Book Display Program 17 Control unit (computer) 17a Hologram generation unit 17b Display control section 20 Real-life books (books) 30 Hand (object) 51 Book Cover 61~66 Real Image Books (Books)
Claims
1. a hologram generating unit that generates a hologram for reproducing an electronic book as a three-dimensional image of the book; a display control unit that causes an SLM to display the hologram generated by the hologram generating unit; Equipped with An electronic book display system characterized in that the hologram generation unit is capable of generating the hologram in which, when the display content of the page of the book is visible from a first viewpoint relative to the SLM, at least a portion of the cover of the book that is not visible from the first viewpoint is visible from a second viewpoint relative to the SLM.
2. the hologram generating unit is capable of generating a first hologram, which is the hologram in which at least a part of a part of a cover of the book that is not visible from the first viewpoint is visible from the second viewpoint when a display content of a page of the book is visible from the first viewpoint, and is capable of generating a second hologram, which is the hologram that differs from the first hologram in that a book cover that covers at least a part of the cover of the book is attached to the book, 2. The electronic book display system of claim 1, wherein the second hologram is a book cover that covers at least a portion of a cover of the book that is not visible from the first viewpoint in the first hologram but is visible from the second viewpoint.
3. 3. The electronic book display system according to claim 1, wherein the hologram is for reproducing a real image of the book.
4. 2. The electronic book display system according to claim 1, wherein the hologram generating unit changes the appearance of the book according to the amount of the electronic book that has been read.
5. 2 . The electronic book display system according to claim 1 , wherein the hologram generating unit generates the hologram in a state in which the page is torn when an operation to tear a page of the book is performed.
6. 2 . The electronic book display system according to claim 1 , wherein the hologram generating unit generates the hologram of a state in which the page is folded when an operation of folding the page of the book is performed.
7. The electronic book has a property quantity set as a quantity of properties of parts of the book, the hologram generating unit generates the hologram so that the pages of the book are turned at a speed corresponding to the mass of the book; The electronic book display system according to claim 1 , further comprising a property and mass changing unit that changes the property and mass set in the electronic book in response to an instruction.
8. The electronic book has a property quantity set as a quantity of properties of parts of the book, the hologram generating unit generates the hologram so that the pages of the book are turned at a speed corresponding to the mass of the book; The electronic book display system according to claim 1, characterized in that when the appearance of the book is changed in response to an instruction so that the type of the part is changed, the hologram generation unit sets the property quantity corresponding to the changed appearance in the electronic book.
9. a hologram generating unit that generates a hologram for reproducing an electronic book as a three-dimensional image of the book; a display control unit that causes an SLM to display the hologram generated by the hologram generating unit; By implementing this on a computer, The electronic book display program is characterized in that the hologram generation unit is capable of generating the hologram in which, when the display content of the page of the book is visible from a first viewpoint relative to the SLM, at least a portion of the cover of the book that is not visible from the first viewpoint is visible from a second viewpoint relative to the SLM.
Citation Information
Patent Citations
Display device, control system, and control program
JP2013029942A
Electronic book browsing device and display control program
JP2017182167A
Mobile terminal and controlling method thereof
US20160004397A1
