Information processing apparatus
The information processing device enhances the appeal of guiding users to stages by displaying 3D object information within 3D spatial information, addressing the lack of realism and engagement in existing technologies.
Patent Information
- Application Number
- JP2023168433
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-09-28
- Publication Date
- 2025-04-09
AI Technical Summary
Existing technologies for displaying 3D spatial information lack appeal in guiding users to stages, particularly in enhancing the experience for audiences and actors through advertisements and realistic visual representations.
An information processing device equipped with a reception unit and a display control unit that accepts selection of performance information and displays 3D object information related to the performance within 3D spatial information, incorporating signage information and virtual viewpoint adjustments to enhance realism.
The solution significantly improves the appeal of guiding users to stages by providing a more immersive and realistic experience through enhanced visual and spatial representations, thereby increasing the operational efficiency of stages.
Smart Images

Figure 2025058474000001_ABST
Abstract
Description
[Technical field]
[0001] An embodiment of the present invention relates to an information processing device. [Background technology]
[0002] 2. Description of the Related Art Conventionally, there is known a technique for displaying three-dimensional space information in which, for example, a stage is reproduced. [Prior art documents] [Non-patent literature]
[0003] [Non-Patent Document 1] Virtual theater information service Theatre Concierge, [online], [searched on September 15, 2023], Internet<https: / / www.tlt.co.jp / tlt / products / art / catalogue / cps / theatreconcierge.htm> Summary of the Invention [Problem to be solved by the invention]
[0004] However, the conventional technology has room for further improvement in terms of providing an information processing device with improved appeal for guiding users such as audiences and actors to a stage through advertisements, etc. The present invention has an object to provide an information processing device that can improve the appeal. [Means for solving the problem]
[0005] The information processing device according to the embodiment includes a reception unit and a display control unit. The reception unit receives a selection of performance information related to a predetermined performance on a predetermined stage displayed as three-dimensional space information. When the reception unit receives the selection of the performance information, the display control unit displays three-dimensional object information related to the predetermined performance within the three-dimensional space information. [Brief description of the drawings]
[0006] [Figure 1] FIG. 1 is a diagram illustrating an example of an overview of an information processing system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Diagram 3] FIG. 3 is a functional block diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a display of three-dimensional object information. [Diagram 5] FIG. 5 is a diagram showing an example of a display of three-dimensional object information related to a specific performance genre. [Figure 6] FIG. 6 is a sequence diagram showing an example of the flow of processing executed in the information processing system according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0007] The information processing device 1 according to the embodiment described below includes a receiving unit 33 and a display control unit 34. The receiving unit 33 receives a selection of performance information 42 related to a predetermined performance at a predetermined stage SP displayed as three-dimensional space information 41. When the receiving unit 33 receives the selection of the performance information 42, the display control unit 34 displays three-dimensional object information 43 related to the predetermined performance within the three-dimensional space information 41.
[0008] In the information processing device 1 according to the embodiment described below, the performance information 42 includes signage information in which an advertisement related to a specific performance is displayed on a three-dimensional panel in the three-dimensional space information 41.
[0009] In the information processing device 1 according to the embodiment described below, the three-dimensional object information 43 includes three-dimensional models of at least one of actors and art sets related to a given performance.
[0010] In the information processing device 1 according to the embodiment described below, the reception unit 33 receives a selection of genre information 44 related to a predetermined performance genre. When the reception unit 33 receives the selection of the genre information 44, the display control unit 34 displays three-dimensional object information 45 related to the predetermined performance genre within the three-dimensional space information 41.
[0011] In the information processing device 1 according to the embodiment described below, the receiving unit 33 receives a selection of virtual viewpoint information 46 related to the position of a virtual viewpoint in the three-dimensional space information 41. When the receiving unit 33 receives the selection of the virtual viewpoint information 46, the display control unit 34 displays the three-dimensional space information 41 and the three-dimensional object information 43 corresponding to the virtual viewpoint information 46.
[0012] Hereinafter, an information processing system according to an embodiment will be described with reference to the drawings. In the embodiments, the same components are denoted by the same reference numerals, and duplicated descriptions will be omitted.
[0013] (An example of an overview of an information processing system) 1 is a diagram showing an example of an overview of an information processing system according to an embodiment. An information processing device 1 of an information processing system S accepts a selection of performance information 42 related to a specific performance at a specific stage SP displayed as three-dimensional space information 41, and displays three-dimensional object information 43 related to the specific performance SP within the three-dimensional space information 41.
[0014] 1, the information processing system S includes an information processing device 1, an image capturing device 10, and a display device 100. A detailed configuration of the information processing system S will be described later with reference to FIG.
[0015] First, the image capturing device 10 captures a predetermined stage SP (step S1). The predetermined stage SP is not limited to the stage of a predetermined theater B, and may include, for example, the audience seats of the predetermined theater B. For example, the image capturing device 10 is a 3D (Dimension) camera that combines a LiDAR (Light Detection and Ranging) and a camera, and captures the predetermined stage SP from the position of the holder of the image capturing device 10, a lighting device hung from a baton, or a position fixed to the stage equipment such as the floor. The image capturing device 10 transmits image capturing information of the predetermined stage SP to the information processing device 1.
[0016] Next, the information processing device 1 generates three-dimensional space information 41 in which the predetermined stage SP is reproduced, for example, based on the photographing information received from the photographing device 10 (step S2). As an example, the information processing device 1 generates a three-dimensional model based on three-dimensional point cloud data of the predetermined stage SP acquired by the LiDAR, and generates the three-dimensional space information 41 by attaching a photo captured by the camera to the three-dimensional model as a texture.
[0017] Next, the information processing device 1 displays the predetermined stage SP as three-dimensional space information 41 (step S3). For example, the information processing device 1 transmits the three-dimensional space information 41 and control information for controlling the display of the display device 100 to the display device 100, and causes the display device 100 to display the predetermined stage SP as the three-dimensional space information 41. In this case, the display device 100 displays the three-dimensional space information 41 based on, for example, the received control information.
[0018] Next, the information processing device 1 accepts a selection of performance information 42 related to a predetermined performance at a predetermined stage SP displayed as the three-dimensional space information 41 (step S4). For example, the information processing device 1 accepts a selection of signage information in which an advertisement related to the predetermined performance is displayed on a three-dimensional panel in the three-dimensional space information 41, from the user of the display device 100. The information processing device 1 may accept, for example, a selection of virtual viewpoint information 46 related to the position of a virtual viewpoint in the three-dimensional space information 41, and a selection of genre information 44 related to a predetermined performance genre, from the user.
[0019] Next, when the selection of the performance information 42 is accepted, the information processing device 1 displays three-dimensional object information 43 related to the specified performance in the three-dimensional space information 41 (step S5). For example, when the selection of the performance information 42 is accepted, the information processing device 1 transmits three-dimensional object information 43 including three-dimensional models of at least one of actors and art sets related to the specified performance, and control information to the display device 100. Furthermore, the information processing device 1 causes the display device 100 to display the three-dimensional object information 43 in the three-dimensional space information 41. In this case, the display device 100 displays the three-dimensional object information 43 by arranging it on a stage in the three-dimensional space information 41 based on, for example, the received control information.
[0020] For example, when the selection of virtual viewpoint information 46 is accepted, the information processing device 1 displays the three-dimensional space information 41 and the three-dimensional object information 43 corresponding to the virtual viewpoint information 46. As an example, when the selection of virtual viewpoint information 46 in which the position of the spectator seats diagonally rearward to the left as seen from the stage is accepted, the information processing device 1 displays on the display device 100 the three-dimensional space information 41 and the three-dimensional object information 43 in a state in which the direction of the stage is viewed from the position of the spectator seats.
[0021] Furthermore, for example, when the selection of genre information 44 is accepted, the information processing device 1 displays three-dimensional object information 45 related to a predetermined performance genre within the three-dimensional space information 41. As an example, the information processing device 1 displays, within the three-dimensional space information 41, a generic three-dimensional model of an actor and a generic three-dimensional model of an art set that correspond to the predetermined performance genre.
[0022] For example, among the users of the display device 100, the audience simulates a virtual reality (VR) performance in which three-dimensional object information 43 is displayed within three-dimensional space information 41. Also, among the users, staff members such as actors simulate how their performance would be if it were to be held at a specific stage SP. This allows the users to imagine the atmosphere of an actual performance with a greater sense of realism than when advertisements such as two-dimensional performance flyers and posters are posted on a web page.
[0023] In this way, when the information processing device 1 accepts the selection of the performance information 42, the information processing device 1 displays the three-dimensional object information 43 in the three-dimensional space information 41, thereby enabling the user to imagine the atmosphere of the actual performance and supporting the guidance of the performance, thereby improving the appeal. As a result, the information processing device 1 can improve the operating rate of a predetermined stage SP.
[0024] Furthermore, by having the performance information 42 include signage information and the three-dimensional object information 43 include three-dimensional models of at least one of the actors and art sets related to a specific performance, the sense of realism and the ability to evoke images of an actual performance can be further improved, thereby further improving appeal.
[0025] In addition, when the information processing device 1 accepts the selection of genre information 44, it can change the three-dimensional object information to one corresponding to the performance genre for each performance genre by displaying three-dimensional object information 45 relating to a specified performance genre within the three-dimensional space information 41.
[0026] As a result, particularly when the user of the display device 100 is an actor or the like, the information processing device 1 can allow the user to simulate what it would be like if a performance were to be held at a specified stage SP. As one example, the information processing device 1 can allow the actor or the like to virtually check whether or not it is possible to perform at a specified stage SP by using the stage art set of another theater as is. As another example, the information processing device 1 can encourage the actor or the like to perform in a genre that they have no experience with by having the actor or the like simulate a performance in that genre. As a result, particularly an improvement in appeal to the actor or the like is realized.
[0027] Furthermore, when the selection of the virtual viewpoint information 46 is accepted, the information processing device 1 displays the three-dimensional space information 41 and the three-dimensional object information 43 corresponding to the virtual viewpoint information 46, thereby allowing the user to confirm how the appearance of these pieces of information changes according to the position of the virtual viewpoint. This allows the information processing device 1 to further improve the sense of realism and image evocation, and therefore further improve the appeal.
[0028] (An example of the configuration of an information processing system) Fig. 2 is a block diagram showing an example of a configuration of an information processing system according to an embodiment. As illustrated in Fig. 2, the information processing system S includes an information processing device 1, a plurality of image capturing devices 10, and a plurality of display devices 100. The information processing device 1, the plurality of image capturing devices 10, and the plurality of display devices 100 are communicatively connected via a predetermined network N.
[0029] In the above example, the information processing system S includes a plurality of image capturing devices 10 and a plurality of display devices 100, but may be configured to include a single image capturing device 10 and a single display device 100. In the above example, the information processing device 1 is configured separately from the display device 100, but may be configured integrally with the display device 100.
[0030] The information processing device 1 is, for example, a server device that accepts a selection of performance information 42 regarding a specific performance at a specific stage SP displayed as three-dimensional space information 41, and displays three-dimensional object information 43 regarding the specific performance within the three-dimensional space information 41.
[0031] The image capturing device 10 is a device that captures a predetermined stage SP, and is, for example, a 3D camera combined with LiDAR. The position of the image capturing device 10 is not particularly limited as long as it is a position where the predetermined stage SP can be captured, and may be, for example, the position of the person holding the image capturing device 10, or a position fixed to a stage device such as a lighting device hung from a baton or a floor surface. The image capturing device 10 transmits image capturing information of the predetermined stage SP to the information processing device 1.
[0032] The display device 100 is, for example, a user's terminal device that displays a predetermined stage SP as three-dimensional space information 41, and when the information processing device 1 accepts the selection of performance information 42, displays three-dimensional object information 43 within the three-dimensional space information 41. The display device 100 is, for example, a terminal device such as a PC (Personal Computer), a smartphone, a tablet, a digital camera, or a goggle-type VR device.
[0033] (An example of the configuration of an information processing device) 3 is a functional block diagram showing an example of the configuration of an information processing device according to an embodiment. As shown in FIG. 3, the information processing device 1 includes a communication unit 2, a control unit 3, and a storage unit 4.
[0034] The communication unit 2 is a network device for performing wireless communication processing and wired communication processing. For example, the communication unit 2 transmits and receives various information to and from the image capturing device 10 and the display device 100 via a predetermined network N.
[0035] The control unit 3 controls the information processing device 1, and includes, for example, a computer and various circuits having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, an input / output port, etc. As illustrated in FIG. 3, the control unit 3 includes an acquisition unit 31, a generation unit 32, a reception unit 33, and a display control unit 34.
[0036] The CPU of the computer functions as an acquisition unit 31, a generation unit 32, a reception unit 33, and a display control unit 34, for example, by reading and executing a program stored in the ROM.
[0037] At least one of the acquisition unit 31, generation unit 32, reception unit 33 and display control unit 34 of the control unit 3 can be configured with hardware such as an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).
[0038] The storage unit 4 stores various information, and corresponds to, for example, a RAM or a flash memory. The various information includes, for example, three-dimensional space information 41, performance information 42, three-dimensional object information 43, genre information 44, three-dimensional object information 45 related to a specific performance genre, virtual viewpoint information 46, detailed information 47, connection destination information 48, audio information 49, display information 50, and the like.
[0039] The three-dimensional space information 41 is information about a three-dimensional space in which a predetermined stage SP is reproduced, for example, a three-dimensional model in which the predetermined stage SP is reproduced.
[0040] The performance information 42 is information relating to a specific performance at a specific stage SP. The performance information 42 is, for example, a UI (User Interface) or the like that can identify that it is a specific performance at a specific stage SP. As one example, the performance information 42 includes signage information in which an advertisement related to the specific performance is displayed on a three-dimensional panel in the three-dimensional space information 41. As another example, the performance information 42 includes a list of performances displayed in a list format from which specific performances can be selected.
[0041] The advertisement for the predetermined performance is, for example, a flyer or poster for the predetermined performance. The three-dimensional panel is, for example, a panel with depth like a display that is virtually placed on a stage or the like in the three-dimensional space information 41. The predetermined performance is not particularly limited, and may be, for example, a future performance that is scheduled to be held in the near future, or a past performance.
[0042] The three-dimensional object information 43 is information on three-dimensional objects related to a specific performance that is displayed in the three-dimensional space information 41 when the selection of the performance information 42 is accepted by the accepting unit 33. For example, the three-dimensional object information 43 includes three-dimensional models of at least one of actors and art sets related to the specific performance.
[0043] The 3D model of an actor related to a specified performance may be, for example, a dedicated 3D model of an actor generated based on shooting information of an actor appearing in the specified performance, or a general-purpose 3D model of an actor in which the actor's physical features are not reproduced, with a photo of the actor pasted as texture. The 3D model of an actor related to a specified performance may be, for example, a 3D model that reproduces the costume of the actor in the specified performance. By using a 3D model of an actor that is a dedicated 3D model of an actor or a 3D model that reproduces the costume of the actor in the specified performance, the user can imagine how the actor looks from the audience seats, etc., and the appeal is further improved.
[0044] The 3D model of the art set for a given performance is not particularly limited, but may be, for example, a 3D model generated based on the shooting information of the art set used in the given performance, with texture attached. The art set is, for example, all the stage equipment required for the given performance. As an example, the art set is a background set such as a castle, a gate, or a prison, a cage between the audience seats and the stage, speakers and drums for live performances, curtains in the wings of the stage, lighting equipment such as horizontal lights, etc. For example, if the art set includes lighting equipment, the 3D model of the art set may include at least one of the position information and orientation information of the lighting equipment.
[0045] The genre information 44 is information about a predetermined performance genre. For example, the genre information 44 is a UI in which performance genres are displayed in a selectable list format within the three-dimensional space information 41. The predetermined performance genre is not particularly limited as long as it belongs to the genre of performances that can be performed at a predetermined stage SP, but for example, it can be broadly divided into orchestras and musicals, and narrowly divided into ballet and dance within musicals.
[0046] The three-dimensional object information 45 relating to a predetermined performance genre is a type of three-dimensional object information 43, or is information on three-dimensional objects relating to a predetermined performance genre that is separate and independent from the three-dimensional object information 43. The three-dimensional object information 45 relating to a predetermined performance genre is not particularly limited, but includes, for example, at least one of a generic three-dimensional model of an actor and a generic three-dimensional model of an art set according to the predetermined performance genre.
[0047] A generic 3D model of an actor according to a specific performance genre is, for example, a 3D model in which the costume corresponds to the specific performance genre, but the physical characteristics of the actor are not reproduced, etc. A generic 3D model of an art set according to a specific performance genre is, for example, a 3D model in which the list of art sets corresponds to the specific performance genre, but the details of the art sets do not correspond to the specific performance, etc.
[0048] The virtual viewpoint information 46 is information about the position of the virtual viewpoint, for example, information about the view from the position of the audience seats in the three-dimensional space information 41 toward the stage. The detailed information 47 is information about the details of a specific performance, for example, the title of the performance, the schedule, the performers, and the synopsis. The connection destination information 48 is information about the connection destination of the specific performance, for example, the URL (Uniform Resource Locator) of the site of the specific performance, and a link to an SNS (Social Networking Service). The audio information 49 is audio information about the specific performance, for example, sound effects and theme music of the specific performance. The display information 50 is information displayed in the three-dimensional space information 41, for example, a UI displayed two-dimensionally with text information added in a specific area of the three-dimensional space information 41.
[0049] Next, each function of the control unit 3 (acquisition unit 31, generation unit 32, reception unit 33, and display control unit 34) will be described. The acquisition unit 31 acquires various information. For example, the acquisition unit 31 acquires shooting information of a predetermined stage SP shot by the shooting device 10 via the communication unit 2.
[0050] The generating unit 32 generates various information. For example, the generating unit 32 generates three-dimensional space information 41 in which a predetermined stage SP is reproduced based on the shooting information acquired by the acquiring unit 31. For example, the generating unit 32 generates a three-dimensional model based on three-dimensional point cloud data of the predetermined stage SP acquired by LiDAR, and generates the three-dimensional space information 41 by attaching a photo taken by a camera to the three-dimensional model as a texture. The generating unit 32 stores the generated three-dimensional space information 41 in the storage unit 4.
[0051] Furthermore, the generating unit 32 generates various information such as the 3D object information 43. As one example, the generating unit 32 generates a 3D model based on shooting information of an actor appearing in a given performance, and generates a 3D model of the actor related to the given performance by attaching a photo of the actor as a texture. As another example, the generating unit 32 generates a 3D model based on shooting information of an art set used in the given performance, and generates a 3D model of the art set related to the given performance by attaching a photo of the art set as a texture.
[0052] In the above example, the information processing device 1 acquires shooting information by the acquisition unit 31 and generates various information such as the three-dimensional space information 41 by the generation unit 32, but the acquisition unit 31 may acquire various information generated in advance from another device. In other words, the information processing device 1 may generate various information by itself or acquire it from another device.
[0053] The reception unit 33 receives various selections. The reception unit 33 receives a selection of performance information 42 related to a predetermined performance at a predetermined stage SP displayed as three-dimensional space information 41. The reception unit 33 also receives, for example, a selection of virtual viewpoint information 46 related to the position of a virtual viewpoint within the three-dimensional space information 41.
[0054] An example of reception by the reception unit 33 will be described below using the diagram of Fig. 4 before the performance information selection reception. Fig. 4 is a diagram showing an example of the display of three-dimensional object information. A predetermined stage SP is displayed on the display device 100 as three-dimensional space information 41 by the display control unit 34, for example. The performance information 42 includes, for example, first performance information 421 related to a first performance, second performance information 422 related to a second performance, and third performance information 423 related to a third performance. These pieces of performance information are displayed by the display control unit 34 as UI signage information on three-dimensional panels arranged alongside the stage.
[0055] In this case, for example, a reception unit (not shown) of the display device 100 receives, from a user such as an audience member, a selection of first performance information 421 related to a first performance that the user wishes to view from among the performance information 42 displayed on the display device 100, by clicking, tapping, or the like. In addition, for example, the reception unit of the display device 100 similarly receives, from the user, a selection of virtual viewpoint information 46 in which the position of the audience seats diagonally rearward and to the left as viewed from the stage is set as a virtual viewpoint. The display device 100 transmits, for example, the information whose selection has been received, to the communication unit 2 of the information processing device 1.
[0056] The reception unit 33 receives, for example, the first performance information 421 and the virtual viewpoint information 46 received by the communication unit 2 as a selection of the performance information 42 and the virtual viewpoint information 46. In this manner, the reception of a selection by the reception unit 33 may include, for example, the reception of an indirect selection via the reception of a direct selection by another device.
[0057] Further, the receiving unit 33 receives, for example, a selection of genre information 44 related to a predetermined performance genre. An example of reception by the receiving unit 33 will be described below with reference to Fig. 5. Fig. 5 is a diagram showing an example of a display of three-dimensional object information related to a predetermined performance genre.
[0058] As illustrated in the diagram of Fig. 5 before selection acceptance, the acceptance unit 33 accepts, for example, via the communication unit 2, a selection of display information 50 in which "display performance image" or the like is displayed from a user of the display device 100, such as an actor. As a result, as illustrated in the diagram of Fig. 5 before genre information selection acceptance, the information displayed in the three-dimensional space information 41 by the display control unit 34 is changed from the display information 50 to genre information 44, which is a UI. Next, the acceptance unit 33 accepts, for example, via the communication unit 2, a selection of a performance genre that the user wants to perform from among the performance genres displayed in list form as genre information 44, from the user of the display device 100.
[0059] The display control unit 34 controls the display of various information. When the reception unit 33 receives the selection of performance information 42, the display control unit 34 displays three-dimensional object information 43 related to a specific performance in the three-dimensional space information 41. For example, the display control unit 34 may display the three-dimensional object information 43 in the three-dimensional space information 41 that it itself has displayed on the display device 100 or the like, or may display the three-dimensional object information 43 in the three-dimensional space information 41 that is displayed by another device.
[0060] Furthermore, for example, when the reception unit 33 accepts the selection of performance information 42, the display control unit 34 displays at least one of the detailed information 47 and the connection destination information 48 in the three-dimensional space information 41. For example, when the reception unit 33 accepts the selection of virtual viewpoint information 46, the display control unit 34 displays the three-dimensional space information 41 and the three-dimensional object information 43 corresponding to the virtual viewpoint information 46. For example, when the reception unit 33 accepts the selection of performance information 42, the display control unit 34 outputs audio information 49 related to the specified performance.
[0061] This allows the display control unit 34 to allow the user to view the detailed information 47 and the connection destination information 48, to check how the appearance of the three-dimensional space information 41 and the three-dimensional object information 43 changes depending on the position of the virtual viewpoint, and to imagine the scene in which the audio information 49 is being played. As a result, the display control unit 34 can further improve the sense of realism and the ability to evoke images of the performance, thereby further improving the appeal.
[0062] Hereinafter, an example of a display by the display control unit 34 when the selection of the first performance information 421 and the selection of the virtual viewpoint information 46, which has the position of the audience seats diagonally rear left as seen from the stage, are accepted, will be described with reference to the diagram after the performance information selection acceptance in Fig. 4. For example, the display control unit 34 causes the communication unit 2 to transmit the following various information to the display device 100. 43 3D object information including 3D models of the actors and set for the first performance Detailed information on the first performance, including title, date, cast, and synopsis47 · URL of the special website for the first performance and connection information including links to SNS48 Virtual viewpoint information 46, with the audience seating position diagonally to the left and rear as seen from the stage as a virtual viewpoint 49 audio information including sound effects and theme music from the first performance Control information for controlling the display and output of the display device 100
[0063] Next, the display control unit 34, for example, causes the display device 100 to place the above-mentioned three-dimensional object information 43, detailed information 47, and connection destination information 48 on a stage in the three-dimensional space information 41, and displays these pieces of information viewed in the direction of the stage from the position indicated by the virtual viewpoint information 46. At the same time, the display control unit 34 causes the display device 100 to play back audio information 49.
[0064] In this case, for example, a control unit (not shown) of the display device 100 arranges the three-dimensional object information 43, the detailed information 47, and the connection destination information 48 on a stage in the three-dimensional space information 41 based on the control information, and displays this information viewed in the direction of the stage from the position indicated by the virtual viewpoint information 46 on a display unit (not shown) of the display device 100. Also, for example, the control unit of the display device 100 reproduces audio information 49 from an output unit (not shown) of the display device 100 together with displaying the above-mentioned information based on the control information. In this way, the control of display and the like by the display control unit 34 may include indirect control, such as causing another device to control display or output using the control information.
[0065] Furthermore, for example, when the reception unit 33 receives a selection of genre information 44, the display control unit 34 displays three-dimensional object information 45 related to a predetermined performance genre within the three-dimensional space information 41. Hereinafter, with reference to the diagram of Fig. 5 after receiving the selection of genre information, an example of display by the display control unit 34 when the reception unit 33 receives a selection of a predetermined performance genre from among the performance genres displayed as genre information 44 will be described.
[0066] For example, when the selection of ballet is accepted, the display control unit 34 causes the display device 100 to place and display a 3D model of a generic actor in a tutu and a 3D model of a generic art set such as a castle on the stage in the 3D space information 41, instead of the performance information 42. Also, when the selection of dance is accepted, for example, the display control unit 34 causes the display device 100 to place a 3D model of a generic actor in street fashion on the stage of the 3D space information 41, and display it with lighting devices in a predetermined position and orientation.
[0067] Note that, instead of the above example, the display control unit 34 may, for example, move the position while keeping the performance information 42 displayed, and further display three-dimensional object information 45 relating to a predetermined performance genre. Furthermore, when a predetermined selection is accepted by the accepting unit 33, such as the selection of display information 50 displaying "Performance Image" in the diagram of Fig. 5 after genre information selection acceptance, the display control unit 34 may return to the state of the diagram of Fig. 5 before the selection acceptance.
[0068] (An example of processing flow) FIG. 6 is a sequence diagram showing an example of the flow of processing executed in the information processing system according to the embodiment.
[0069] First, the camera 10 captures a predetermined stage SP (step S101).
[0070] Next, the camera device 10 transmits the camera information of the predetermined stage SP to the information processing device 1 (step S102).
[0071] Next, the information processing device 1 generates three-dimensional space information 41 in which a predetermined stage SP is reproduced, based on the shooting information received from the shooting device 10 (step S103).
[0072] Next, the information processing device 1 causes the display device 100 to display the predetermined stage SP as three-dimensional space information 41 (step S104).
[0073] Next, the display device 100 accepts the selection of performance information 42 relating to a given performance at a given stage SP displayed as the three-dimensional space information 41, and transmits the selected performance information 42 to the information processing device 1 (step S105).
[0074] Next, the information processing device 1 accepts the performance information 42 received from the display device 100 as a selection of the performance information 42 related to a predetermined performance at a predetermined stage SP displayed as the three-dimensional space information 41 (step S106).
[0075] Next, when the selection of the performance information 42 is accepted, the information processing device 1 displays the three-dimensional object information 43 related to the predetermined performance within the three-dimensional space information 41 (step S107).
[0076] Although an embodiment of the present invention has been described, this embodiment is presented as an example and is not intended to limit the scope of the invention. This embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. This embodiment and its modifications are included in the scope of the invention and its equivalents described in the claims, as well as in the scope and gist of the invention. [Explanation of symbols]
[0077] 1. Information processing device 2. Communications Department 3. Control Unit 4 Storage section 10. Imaging Device 31 Acquisition Department 32 Generation part 33 Reception 34 Display control section 41 3D spatial information 42 Performance Information 43 3D object information 44 Genre Information 45 3D object information for a specific performance genre 46 Virtual viewpoint information 47 More information 48 Connection Information 49 Audio Information 50 Display information 100 display device
Claims
1. a reception unit that receives a selection of performance information related to a predetermined performance on a predetermined stage displayed as three-dimensional spatial information; a display control unit that displays three-dimensional object information related to the predetermined performance within the three-dimensional space information when the selection of the performance information is accepted by the accepting unit; 13. An information processing apparatus comprising:
2. The performance information includes signage information in which an advertisement related to the predetermined performance is displayed on a three-dimensional panel in the three-dimensional space information.
2. The information processing apparatus according to claim 1,
3. The three-dimensional object information includes three-dimensional models of at least one of actors and art sets related to the given performance.
2. The information processing apparatus according to claim 1,
4. The reception unit receives a selection of genre information related to a predetermined performance genre, The display control unit displays three-dimensional object information related to the predetermined performance genre within the three-dimensional space information when the selection of the genre information is accepted by the accepting unit.
2. The information processing apparatus according to claim 1,
5. the reception unit receives selection of virtual viewpoint information related to a position of a virtual viewpoint within the three-dimensional space information; When the selection of the virtual viewpoint information is accepted by the accepting unit, the display control unit displays the three-dimensional space information and the three-dimensional object information corresponding to the virtual viewpoint information.
5. The information processing device according to claim 1, wherein: