Book display system

Abstract

To provide a book display system for virtually displaying a book that facilitates understanding of operation other than operation of turning a page constituting the book.SOLUTION: A book display system includes: a display unit 11 that virtually displays a page object and a spine object; a sensor unit 12 that accepts virtual operation; an input analysis unit 22 that analyzes a position and operation content of the virtual operation accepted by the sensor unit 12; and a display control unit 23 that controls, on the basis of the position and the operation content of the virtual operation analyzed by the input analysis unit 22, display on the display unit 11. The display unit 11 displays an operation object on the spine object. When the position of the virtual operation analyzed by the input analysis unit 22 overlaps the display position of the operation object and when the operation content of the virtual operation analyzed by the input analysis unit 22 is predetermined, the display control unit 23 sets the display on the display unit 11 to a predetermined state.SELECTED DRAWING: Figure 1

Description

Technical Field

[0004] , , , , , , , ,

[0005] , , , , , ,

[0001] The present invention relates to a book display system for virtually displaying books.

Background Art

[0003] In addition, a technology for virtually displaying a book on a display for browsing has also been considered (see, for example, Patent Document 2). Therefore, even in the technology for virtually displaying an object in the real space or virtual space as described above, by virtually displaying a book in the real space or virtual space, it becomes possible to browse a book that is not actually possessed in three dimensions.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] As mentioned above, when displaying books virtually in real or virtual space, the page-turning action performed by the user is detected, and the page of the book is turned accordingly. However, it is necessary to be able to detect operations other than page-turning, such as deleting the displayed book. In that case, an object for performing such operations will be displayed separately from the book.

[0006] However, when objects for operations other than turning pages are displayed separately from the book, especially if such objects are displayed in an area far from the book, there is a problem in that the objects become difficult to recognize due to their overlap with the real or virtual space displayed as the background of the book. Furthermore, when multiple books are displayed superimposed on each other, there is a problem in that it becomes difficult to understand the correspondence between the objects and the books.

[0007] The present invention has been made in view of the problems of the conventional technology described above, and aims to provide a book display system that makes operations other than turning the pages of a book easier to understand in a book display system that virtually displays a book. [Means for solving the problem]

[0008] To achieve the above objective, the present invention provides: A book display system that virtually displays books, A display means for virtually displaying page objects representing the pages that make up the book, and spine objects representing the spine that binds the pages together, An input means that accepts a specified virtual operation within the space where the page object and the spine object are displayed by the display means, An input analysis means that analyzes the position and content of the virtual operation received by the input means, The system includes a display control means that controls the display in the display means based on the position and content of the virtual operation analyzed by the input analysis means, The display means displays the book in the display means , different from each other To achieve a predetermined state multiple The operation object is displayed on the spine object, The display control means controls the display on the display means when the position of the virtual operation analyzed by the input analysis means overlaps with the display position of the operation object, and the operation content of the virtual operation analyzed by the input analysis means is predetermined. , in accordance with the operation object that overlaps with the position of the virtual operation analyzed by the input analysis means The state described above will be set to the predetermined state.

[0009] In the present invention configured as described above, the display means virtually displays page objects representing the pages that make up the book, spine objects representing the spine that binds the pages, and operation objects for setting the display of the book in the display means to a predetermined state. When the position of a virtual operation received by the input means overlaps with the display position of the operation object, and the input analysis means analyzes that the content of the virtual operation is predetermined, the display control means sets the display of the book in the display means to a predetermined state. Since the operation object is displayed on the spine object, the operation to set the display of the book in the display means to a predetermined state becomes easier to understand.

[0010] Furthermore, if the display control means determines that the position of the virtual operation analyzed by the input analysis means coincides with the display position of the page object, and the operation content of the virtual operation analyzed by the input analysis means is to move away from the spine object, the page represented by that page object will be removed from the book. Subsequently, if the operation content of the virtual operation analyzed by the input analysis means moves the page object towards the spine object of another book displayed by the display means, the page represented by that page object will be incorporated into the other book, thereby enabling page movement between multiple books.

[0011] Furthermore, if the display control means determines that the position of a virtual operation analyzed by the input analysis means coincides with the display position of the spine object, and the operation content of the virtual operation analyzed by the input analysis means moves the spine object, then the display means can move the position of the book displayed to a position corresponding to the operation content, thereby moving the display position of the book in an operation that will not be confused with the operation of turning pages. [Effects of the Invention]

[0012] According to the present invention, an operation object for setting the display of a book in a display means to a predetermined state is displayed on a spine object representing the spine that binds the pages constituting the book. When the position of a virtual operation received by the input means overlaps with the display position of the operation object, and the content of the virtual operation is predetermined, the display in the display means enters a predetermined state. Therefore, in a book display system that virtually displays a book, operations other than turning the pages that constitute the book can be made easier to understand.

[0013] Furthermore, in a system where the display control means detaches the page represented by the page object from the book if the position of the virtual operation analyzed by the input analysis means coincides with the display position of the page object, and the operation content of the virtual operation analyzed by the input analysis means moves the page object away from the spine object, and then incorporates the page represented by the page object into another book if the operation content of the virtual operation analyzed by the input analysis means moves the page object closer to the spine object of another book displayed by the display means, then it becomes possible to move pages between multiple books.

[0014] Also, when the position of the virtual operation analyzed by the input analysis means overlaps with the display position of the back cover object, and the operation content of the virtual operation analyzed by the input analysis means is to move the back cover object, in the case where the position of the book displayed by the display means is moved to a position corresponding to the operation content, it is possible to move the display position of the book by an operation that is not confused with the operation for turning pages.

Brief Description of Drawings

[0015] [Figure 1] It is a diagram showing an embodiment of the book display system of the present invention. [Figure 2] It is an external perspective view of the head-mounted display unit shown in FIG. 1. [Figure 3] It is a diagram showing an example of the data structure of the book information shown in FIG. 1. [Figure 4] It is a diagram showing an example of a virtual book displayed on the display unit of the head-mounted display unit in the book display system shown in FIG. 1. [Figure 5] It is a flowchart for explaining the overall operation of the book display system shown in FIG. 1. [Figure 6] It is a diagram for explaining the page turning process for the virtual book shown in FIG. 4 in the book display system shown in FIG. 1. [Figure 7] It is a diagram for explaining the process of deleting the virtual book shown in FIG. 4 from the state where it is displayed in the book display system shown in FIG. 1. [Figure 8] It is a diagram for explaining the reset process for the virtual book shown in FIG. 4 in the book display system shown in FIG. 1. [Figure 9] It is a diagram for explaining the process of moving the entire virtual book shown in FIG. 4 in the book display system shown in FIG. 1. [Figure 10] It is a diagram for explaining the process of moving the pages of the virtual book shown in FIG. 4 between virtual books in the book display system shown in FIG. 1. [Figure 11]This diagram illustrates the process of moving between virtual book pages in the book display system shown in Figure 1, as shown in Figure 4. [Figure 12] This figure illustrates the page copying process for the virtual book shown in Figure 4 within the book display system shown in Figure 1. [Modes for carrying out the invention]

[0016] Embodiments of the present invention will be described below with reference to the drawings.

[0017] Figure 1 is a diagram showing one embodiment of the book display system of the present invention, and Figure 2 is an external perspective view of the head-mounted display unit 10 shown in Figure 1.

[0018] As shown in Figure 1, the book display system in this configuration includes a head-mounted display unit 10, a management server 20, and a database 30.

[0019] The head-mounted display unit 10 includes a display unit 11, an input unit 12, a control unit 24, and a communication interface 13. As shown in Figure 2, a display 11a is mounted as the display unit 11, and a camera 12a and a 3D sensor 12b are mounted as the input unit 12, on the front of the frame 14 for mounting the head-mounted display unit 10 on the user's head. A control device 24a, which houses the control unit 24 and a battery (not shown), is mounted on the rear of the frame 14.

[0020] The display unit 11 serves as a display means in the present invention and virtually displays a book. That is, the display unit 11 functions as a display 11a and displays a virtual book as a hologram on the lens.

[0021] The input unit 12 is an input means in the present invention, and receives a specified virtual operation within the space where a virtual book is displayed as a hologram on the display 11a by detecting it with a camera 12a or a 3D sensor 12b. The input unit 12 is not limited to a camera 12a or a 3D sensor 12b, as long as it can detect a specified virtual operation within the space where a virtual book is displayed as a hologram on the display 11a.

[0022] The control unit 24 consists of an application program that runs on the OS of the head-mounted display unit 10, and includes an input analysis unit 22 and a display control unit 23.

[0023] The input analysis unit 22 is an input analysis means in the present invention, and analyzes the position and content of the virtual operation received by the input unit 12.

[0024] The display control unit 23 is the display control means in the present invention. Based on book information and model data received via the network 40 through the communication interface 13, the display control unit 23 generates display data for displaying a virtual book on the display unit 11 of the head-mounted display unit 10. Furthermore, based on the position and content of the virtual operation analyzed by the input analysis unit 22 and the generated display data, it controls the display of the virtual book on the display unit 11 of the head-mounted display unit 10.

[0025] The communication interface 13 connects the head-mounted display unit 10 to the management server 20 via a network 40 such as the internet or a dedicated line, and receives book information and model data transmitted from the management server 20 via the network 40.

[0026] The management server 20 is composed of, for example, a general personal computer, and has a communication interface 21 and a book information management unit 25.

[0027] The communication interface 21 connects the management server 20 and the head-mounted display unit 10 via a network 40 such as the internet or a dedicated line, and transmits book information and model data used for the virtual book displayed on the head-mounted display unit 10.

[0028] The book information management unit 25 retrieves and returns book information and model data related to requested books from the database 30.

[0029] Database 30 contains book information 31 and model data 32.

[0030] Figure 3 shows an example of the data structure of the book information 31 shown in Figure 1.

[0031] As shown in Figure 3, the book information 31 shown in Figure 1 has a data structure that includes book cover information 31a and page information 31b.

[0032] The book binding information 31a associates the book ID with the book title, the total number of pages, the paper size of the pages, the orientation of the paper, the binding direction (top, bottom, left, right), and information indicating whether it is double-sided or single-sided printing, for each virtually displayed book.

[0033] Page information 31b, for each page constituting the book indicated by book binding information 31a, associates the page format, an image path such as a URL indicating where the content displayed on that page is registered, a page model indicating what kind of page it is, the book ID of the book to which the page belongs, and the page number with the page ID. Note that the content displayed on the page does not have to be an image; it may be in any format that can be displayed in two dimensions, such as EPUB, HTML, or Markdown.

[0034] Model data 32 represents a model of a virtual book to be displayed using book information 31. For each virtual book, the display control unit 23 maps the image registered at the location specified by the image path of the book information 31 onto the model shown by model data 32, thereby generating display data for displaying the virtual book on the display unit 11 of the head-mounted display unit 10.

[0035] The operation of the book display system configured as described above will be explained below.

[0036] First, let's explain the virtual book displayed on the display unit 11 of the head-mounted display unit 10.

[0037] Figure 4 shows an example of a virtual book displayed on the display unit 11 of the head-mounted display unit 10 in the book display system shown in Figure 1.

[0038] In the book display system shown in Figure 1, the virtual book displayed on the display unit 11 of the head-mounted display unit 10 is composed of a three-dimensional virtual display of page objects 51a to 51d representing the pages that make up the virtual book, and a spine object 52 representing the spine that binds the pages represented by the page objects 51a to 51d, as shown in Figure 4. The models of these page objects 51a to 51d and the spine object 52 are shown by the model data 32 of the database 30. The display control unit 23 of the head-mounted display unit 10 maps images registered at locations specified by the image paths of the book information 31 received from the management server 20 onto the models of the page objects 51a to 51d, and maps the book title 52a of the book information 31 onto the model of the spine object 52.

[0039] Specifically, page objects 51a to 51d are mapped onto a plate-shaped model indicated by the model data 32 in the database 30, with the paper size and orientation registered in the database 30 as book information 31, and the images registered at locations specified by the image path of the book information 31. The display control unit 23 of the head-mounted display unit 10 generates page objects for the total number of pages registered in the database 30 as book information 31, based on the book information 31 and model data 32 received from the management server 20, and aligns them, for example, with a certain interval in the three axes of x, y, and z.

[0040] On the spine object 52, copy buttons 52b and 52c, a reset button 52d, and a delete button 52e are displayed as operation objects for setting the virtual book to a predetermined state. The display control unit 23 generates display data so that the spine object 52 is positioned relative to the page objects 51a to 51d in the binding direction of the pages registered as book information 31 in the database 30. In this embodiment, since the model data 32 in the database 30 indicates a cylindrical model as the model of the spine object 52, a cylindrical spine object 52 is displayed.

[0041] The copy button 52b is virtually pressed when copying the right-hand page in the diagram when the virtual book is open, and the copy button 52c is virtually pressed when copying the left-hand page in the diagram when the virtual book is open.

[0042] The reset button 52d is virtually pressed to return all page objects 51a to 51d to their initial positions, and the delete button 52e is virtually pressed to delete all objects of the virtual book displayed on the display unit 11.

[0043] The coordinates used to generate the entire book are determined based on the orientation and position of the camera 12a, which represents the user's viewpoint while wearing the head-mounted display unit 10, and are set to the position directly in front of the user. However, this does not apply if the initial position is tied to a specific object.

[0044] Next, we will explain the overall operation of this book display system.

[0045] Figure 5 is a flowchart illustrating the overall operation of the book display system shown in Figure 1.

[0046] First, when a desired book is selected from the books displayed in the book selection menu on the display unit 11 of the head-mounted display unit 10, the display control unit 23 generates display data to virtually display the selected book. Specifically, when the book selection menu is displayed on the display unit 11 of the head-mounted display unit 10, if a user wearing the head-mounted display unit 10 virtually presses, for example, the button for the name of a desired book from the books displayed in the book selection menu, the input unit 12 detects the virtual operation by the user, and the input analysis unit 22 analyzes that the detected operation is a button press and its position. Then, the display control unit 23 uses the book information 31 and model data 32 of the book name displayed at the position of the press, which are registered in the database 30 and received from the management server 20, to generate display data to virtually display the book selected by the button press. In this case, if multiple books are selected, the display control unit 23 generates display data for multiple virtual books in three-dimensional space.

[0047] The detection of virtual user operations begins in the input unit 12 of the head-mounted display unit 10, where user hand movements are detected, for example, by hand tracking using the camera 12a, and processed as manipulator input. Then, the input analysis unit 22 performs collision detection between the position of an object displayed on the display unit 11 and the position of the manipulator operation, thereby detecting user operations such as grasping an object. Note that when displaying a virtual book on a two-dimensional monitor, this can be replaced by keyboard input, a mouse, or a touch panel.

[0048] The generation of display data to virtually display a book begins with the display control unit 23 referencing the book information 31 and model data 32 of the book selected and analyzed by the input analysis unit 22 from the book information 31 and model data 32 received from the management server 20. Based on the spine object model, a spine object is generated, and then, as child objects of the spine object, page objects are generated based on the page object model for the total number of pages in the book information 31.

[0049] In this way, display data is generated, and the book selected by the user is virtually displayed on the display unit 11 of the head-mounted display unit 10 (step S1). When a book selected by the user is virtually displayed on the display unit 11 of the head-mounted display unit 10, if the user wearing the head-mounted display unit 10 virtually specifies an operation such as grasping or sliding the pages of the book virtually displayed on the display unit 11, the specified operation is first detected and accepted by the input unit 12 (step S2).

[0050] Then, the input analysis unit 22 analyzes the position and content of the virtual operation received by the input unit 12 (step S3). In this analysis of the position and content of the virtual operation, as described above, collision detection is performed between the position of the object displayed on the display unit 11 and the operation position by the manipulator, thereby analyzing which object among the objects displayed on the display unit 11 was operated on and what kind of operation was performed on it.

[0051] In the display control unit 23, if the position of the virtual operation analyzed by the input analysis unit 22 overlaps with the display position of an object displayed on the display unit 11 of the head-mounted display unit 10, and the content of the virtual operation analyzed by the input analysis unit 22 is predetermined (step S4), the display control unit 23 controls the display state of the book displayed on the display unit 11 to change according to the content of that operation (step S5), thereby changing the display of the book virtually displayed on the display unit 11 of the head-mounted display unit 10 (step S6).

[0052] The following provides specific examples to illustrate the actions described above.

[0053] (1) Page turning process Figure 6 is a diagram illustrating the page-turning process for the virtual book shown in Figure 4 within the book display system shown in Figure 1.

[0054] In the book display system shown in Figure 1, when the virtual book shown in Figure 4 is displayed on the display unit 11 of the head-mounted display unit 10, if a user wearing the head-mounted display unit 10 attempts to operate within the space where the virtual book is displayed, the user's hand is processed as a manipulator and displayed as a virtual hand 53, as shown in Figure 6.

[0055] When a user wearing the head-mounted display unit 10 performs an operation such as sliding the page object 51a, as shown in Figure 6, the input unit 12 receives the operation, and the input analysis unit 22 analyzes the position and content of the operation, recognizing the position and that the operation is a sliding operation.

[0056] Then, in the display control unit 23, when the position of the operation coincides with the display position of the page object 51a and the operation is a sliding motion, the display state of the book displayed on the display unit 11 is controlled to appear as if the pages are being turned. As a result, the book virtually displayed on the display unit 11 of the head-mounted display unit 10 changes to a state where the pages have been turned, as shown in Figure 6(b).

[0057] Furthermore, when a user wearing the head-mounted display unit 10 performs an operation such as grasping page object 51c, which is the middle of the virtual book among the overlapping page objects 51a to 51d, the position of the operation coincides with the display position of page object 51c, and because the operation is grasping page object 51c, the display state of the book displayed on the display unit 11 changes so that page objects 51a to 51c are rotated so that page object 51c is revealed. As a result, the book virtually displayed on the display unit 11 of the head-mounted display unit 10 changes so that page object 51c is revealed.

[0058] After the pages have been turned or multiple pages have been rotated in this way, the turned or rotated pages can be restored to their original state by performing an operation that returns the turned page object or the grabbed page object to its original position.

[0059] (2) Book deletion process Figure 7 is a diagram illustrating the process of deleting a virtual book shown in Figure 4 from the state where it is displayed in the book display system shown in Figure 1.

[0060] In the book display system shown in Figure 1, when the virtual book shown in Figure 4 is displayed on the display unit 11 of the head-mounted display unit 10, if a user wearing the head-mounted display unit 10 attempts to operate within the space where the virtual book is displayed, the user's hand is processed as a manipulator and displayed as a virtual hand 53, as shown in Figure 7.

[0061] When a user wearing the head-mounted display unit 10 performs an operation such as pressing the delete button 52e displayed on the spine object 52, as shown in Figure 7, the input unit 12 receives the operation, and the input analysis unit 22 analyzes the position and content of the operation, recognizing its position and that the operation is a button press.

[0062] Then, the display control unit 23 controls the virtual book displayed on the display unit 11 to be deleted when the position of the operation overlaps with the display position of the delete button 52e and the operation is to press the button, thereby deleting the book that was virtually displayed on the display unit 11 of the head-mounted display unit 10.

[0063] (3) Reset process Figure 8 is a diagram illustrating the reset process for the virtual book shown in Figure 4 within the book display system shown in Figure 1.

[0064] In the book display system shown in Figure 1, when the virtual book shown in Figure 4 is displayed on the display unit 11 of the head-mounted display unit 10, if a user wearing the head-mounted display unit 10 attempts to operate within the space where the virtual book is displayed, the user's hand is processed as a manipulator and displayed as a virtual hand 53, as shown in Figure 8(a). At this time, assume that the user wearing the head-mounted display unit 10 has already started reading the virtual book displayed on the display unit 11, and that the page objects 51a and 51b have been turned and are open, as shown in Figure 8(a).

[0065] From this state, if a user wearing the head-mounted display unit 10 performs an operation such as pressing the reset button 52d displayed on the spine object 52 of a virtual book with its pages open, as shown in Figure 8(a), the input unit 12 receives the operation, and the input analysis unit 22 analyzes the position and content of the operation, recognizing its position and that the operation is a button press.

[0066] Then, in the display control unit 23, because the position of the operation coincides with the display position of the reset button 52d, and the operation is pressing the button, the display state of the book displayed on the display unit 11 is controlled to change from a state where the page objects 51a and 51b are turned and open to a closed initial state as shown in Figure 8(b). As a result, the book virtually displayed on the display unit 11 of the head-mounted display unit 10 changes from a state where it is open as shown in Figure 8(a) to a closed initial state as shown in Figure 8(b).

[0067] In addition, a separate button may be provided, in addition to the reset button 52d, that remembers the page the user wearing the head-mounted display unit 10 last finished reading, and changes the display to open to that page when pressed.

[0068] (4) Moving the entire book Figure 9 is a diagram illustrating the process of moving the entire virtual book shown in Figure 4 within the book display system shown in Figure 1.

[0069] In the book display system shown in Figure 1, when the virtual book shown in Figure 4 is displayed on the display unit 11 of the head-mounted display unit 10, if a user wearing the head-mounted display unit 10 attempts to operate within the space where the virtual book is displayed, the user's hand is processed as a manipulator and displayed as a virtual hand 53, as shown in Figure 9.

[0070] When a user wearing the head-mounted display unit 10 performs an operation such as grasping the spine object 52 and lifting it in the direction of the arrow in Figure 9, the input unit 12 receives the operation, and the input analysis unit 22 analyzes the position and content of the operation, recognizing the position and that the operation involves grasping and moving a book.

[0071] Then, in the display control unit 23, when the position of the operation coincides with the display position of the spine object 52, and the operation involves grasping and moving the book, control is performed so that the virtual book displayed on the display unit 11 moves in the direction of the arrow in the figure, and as a result the virtual book displayed on the display unit 11 moves in the direction of the arrow in the figure.

[0072] In this way, when the display control unit 23 determines that the position of the virtual operation analyzed by the input analysis unit 22 coincides with the display position of the spine object 52, and that the operation content of the virtual operation analyzed by the input analysis unit 22 is to move the spine object 52, it moves the position of the book displayed on the display unit 11 to a position corresponding to the operation content, thereby moving the display position of the book in an operation that will not be confused with the operation of turning pages.

[0073] Furthermore, when an operation such as grabbing the spine object 52 is performed, not only is the virtual book displayed on the display unit 11 moved, but the virtual book can also be rotated by grabbing and rotating the spine object 52. Moreover, it is conceivable that the spine object 52 can be enlarged by grabbing it with both hands and spreading it open, or reduced in size by shrinking it.

[0074] (5) Processing of moving pages between multiple books Figures 10 and 11 illustrate the process of moving between virtual book pages in the book display system shown in Figure 1, as shown in Figure 4.

[0075] In the book display system shown in Figure 1, when the virtual book shown in Figure 4 is displayed on the display unit 11 of the head-mounted display unit 10, if a user wearing the head-mounted display unit 10 attempts to operate within the space where the virtual book is displayed, the user's hand is processed as a manipulator and displayed as a virtual hand 53, as shown in Figure 10(a).

[0076] A user wearing the head-mounted display unit 10 accesses the page object as shown in Figure 10. 51c When an operation is performed to slide the spine object 52 away from it, the input unit 12 receives the operation, and the input analysis unit 22 analyzes the position and content of the operation, recognizing the position and that the operation involves sliding to the right in the figure.

[0077] Then, in the display control unit 23, the position of the operation is the page object 51c The display position overlaps, and the operation is on the page object. 51c By sliding it away from the spine object 52, the display state of the book shown on the display unit 11 changes to the page object 51c The page objects are controlled to detach from the book, thereby causing the book, which is virtually displayed on the display unit 11 of the head-mounted display unit 10, to be as shown in Figure 10(b). 51c The state changes to one in which it is detached. As a result, the book displayed on the display unit 11 becomes a page object 51c The page represented by this symbol indicates that the user has left the page.

[0078] Subsequently, the user wearing the head-mounted display unit 10 detached from the book's page object. 51c When you slide it towards the spine object 52, the page object detached from the book... 51c The pages represented by this will be incorporated back into the book.

[0079] Furthermore, as shown in Figure 11(a), the user wearing the head-mounted display unit 10 can see the page objects that have been removed from the book in relation to other books that are virtually displayed on the display unit 11 of the head-mounted display unit 10. 51c When you slide it towards the spine object 152 of another book, the display control unit 23 controls the display state of the book displayed on the display unit 11, and the page object 51c The page objects are controlled to be incorporated into other books, thereby allowing other books to be virtually displayed on the display unit 11 of the head-mounted display unit 10 to be incorporated into other books, as shown in Figure 11(b). 51c The state changes to one in which the new elements are incorporated. As a result, the book displayed on the display unit 11 becomes a page object 51c The page represented by this will be incorporated.

[0080] In this way, the display control unit 23 detaches the page represented by the page object from the book if the position of the virtual operation analyzed by the input analysis unit 22 coincides with the display position of the page object, and the operation content of the virtual operation analyzed by the input analysis unit 22 is an operation that moves the page object away from the spine object. Subsequently, if the operation content of the virtual operation analyzed by the input analysis unit 22 moves the page object towards the spine object of another book displayed by the display unit 11, the display control unit 23 incorporates the page represented by the page object into the other book, thereby enabling page movement between multiple books.

[0081] As mentioned above, if pages from one book are incorporated into another book, control information from the display control unit 23 is transmitted to the management server 20 via the network 40. The book information management unit 25 of the management server 20 then updates the total number of pages and corresponding page numbers included in the book information 31 of the database 30.

[0082] (6) Page copying process Figure 12 is a diagram illustrating the page copying process for the virtual book shown in Figure 4 within the book display system shown in Figure 1.

[0083] In the book display system shown in Figure 1, when the virtual book shown in Figure 4 is displayed on the display unit 11 of the head-mounted display unit 10, if a user wearing the head-mounted display unit 10 attempts to operate within the space where the virtual book is displayed, the user's hand is processed as a manipulator and displayed as a virtual hand 53, as shown in Figure 12(a). At this time, assume that the user wearing the head-mounted display unit 10 has already started reading the virtual book displayed on the display unit 11, and that the page objects 51a and 51b have been turned and are open, as shown in Figure 12(a).

[0084] From this state, if a user wearing the head-mounted display unit 10 performs an operation such as pressing the copy button 52b displayed on the spine object 52 of a virtual book with its pages open, as shown in Figure 12(a), the input unit 12 receives the operation, and the input analysis unit 22 analyzes the position and content of the operation, recognizing its position and that the operation is a button press.

[0085] Then, in the display control unit 23, because the position of the operation overlaps with the display position of the copy button 52b, and the operation is to press the button, a new page object 251c is generated in which the page object 51c displayed on the right side of the diagram in the open state is copied, as shown in Figure 12(b). As a result, the page object 51c is copied to the book virtually displayed on the display unit 11 of the head-mounted display unit 10.

[0086] Furthermore, by moving the copied page object 251c toward the spine object 52 of another book, as shown in Figure 11, the page represented by the copied page object 251c can also be incorporated into another book.

[0087] As described above, in this embodiment, the copy buttons 52b, 52c, reset button 52d, and delete button 52e, which are operation objects for setting the virtual display of a book on the display unit 11 of the head-mounted display unit 10 to a predetermined state, are displayed on the spine object 52 which represents the spine that binds the pages that make up the book. When the position of a virtual operation received by the input unit 12 overlaps with the display position of these operation objects, and the content of that virtual operation is predetermined, the display on the display unit 11 enters a predetermined state. Thus, in a book display system that virtually displays a book, operations other than turning the pages that make up the book can be made easier to understand.

[0088] In this embodiment, the operation of the copy buttons 52b, 52c, reset button 52d, and delete button 52e, which are the operation objects, was explained using the example of pressing virtual buttons. However, the input unit 12 may be equipped with a sensor that detects the gaze of a user wearing a head-mounted display unit, and display processing corresponding to the operation object may be performed when the user looks at the operation object for a predetermined period of time or longer.

[0089] Furthermore, in this embodiment, an example was described in which an input analysis unit 22 that analyzes the position and content of a virtual operation received by the input unit 12, and a display control unit 23 that generates display data for displaying a virtual book in the display unit 11, and controls the display of the virtual book in the display unit 11 based on the position and content of the virtual operation analyzed by the input analysis unit 22 and the generated display data, are composed of application programs that run on the OS of the head-mounted display unit 10. However, the configuration may also be such that the input analysis unit 22 and the display control unit 23 are located on the management server 20 side. In that case, information indicating a virtual operation received by the input unit 12 is transmitted from the head-mounted display unit 10 to the management server 20, the position and content of the virtual operation are analyzed in the input analysis unit 22 of the management server 20, and the display control unit 23 of the management server 20 transmits a display control signal to control the display of the virtual book in the display unit 11 based on the position and content of the virtual operation analyzed by the input analysis unit 22 and the display data generated by referring to the database 30, thereby controlling the display of the virtual book in the display unit 11. [Explanation of Symbols]

[0090] 10. Head-mounted display unit 11 Display section 11a display 12 Input section 12a Camera 12b 3D sensor 13,31 Communication Interface 14 frames 20 Management Servers 22 Input Analysis Unit 23 Display Control Unit 24 Control Unit 24a Control device 25 Book Information Management Department 30 databases 31 Book Information 31a Book cover information 31b Page Information 32 Model Data Page objects 51a-51d, 151a-151c, 251c 52,152 spine objects 52a Book Title 52b, 52c, 152b, 152c Copy button 52d, 152d Reset button 52e, 152e Delete button 53 Virtual Hand

Claims

1. A book display system that virtually displays books, A display means for virtually displaying page objects representing the pages that make up the book, and spine objects representing the spine that binds the pages together, An input means that accepts a specified virtual operation within the space where the page object and the spine object are displayed by the display means, An input analysis means that analyzes the position and content of the virtual operation received by the input means, The system includes a display control means that controls the display in the display means based on the position and content of the virtual operation analyzed by the input analysis means, The display means displays a plurality of operation objects on the spine object for setting the display of the book in the display means to a predetermined state that is different from each other. A book display system in which the display control means sets the display on the display means to the predetermined state corresponding to the operation object that overlaps with the position of the virtual operation analyzed by the input analysis means, when the position of the virtual operation analyzed by the input analysis means overlaps with the display position of the operation object, and the operation content of the virtual operation analyzed by the input analysis means is predetermined.

2. In the book display system described in claim 1, A book display system comprising: a display control means which, when the position of a virtual operation analyzed by the input analysis means coincides with the display position of the page object, and the operation content of the virtual operation analyzed by the input analysis means is to move the page represented by the page object away from the spine object, detaches the page represented by the page object from the book; and then, when the operation content of the virtual operation analyzed by the input analysis means moves the page object closer to the spine object of another book displayed by the display means, incorporates the page represented by the page object into the other book.

3. In the book display system according to claim 1 or claim 2, A book display system in which the display control means moves the position of the book displayed by the display means to a position corresponding to the operation content when the position of the virtual operation analyzed by the input analysis means overlaps with the display position of the spine object, and the operation content of the virtual operation analyzed by the input analysis means moves the spine object.

Images