Display system and display method

Abstract

To allow a person who views a play or the like performed in a specific space having a predetermined area where a plurality of specific persons appear to visually recognize name information or actor name information of the characters.SOLUTION: An aspect of the present disclosure is a display system including a display device worn on a head of a user who views, from a position designated in advance, a specific space having a predetermined size in which a plurality of specific persons appear, and a server device. The server device includes a database unit that stores person information including name information or actor name information and video information of each of the plurality of specific persons and position information of each of the specific persons at each time in the specific space, and a processing unit that recognizes any specific person among the plurality of specific persons based on the viewing space video data received from the display device, the video information, and the position information, and transmits person recognition information including the position information of the recognized specific person and the name information or the actor name information of the recognized specific person to the display device.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a display system and a display method. [Background technology]

[0002] Conventionally, technologies for displaying various types of information within a user's field of view, such as smart glasses, are known. For example, Patent Document 1 describes an audience viewing support system. This audience viewing support system provides audience members viewing a play or other performance on stage with information related to the scene in real time during the performance. The audience viewing support system has audience members carry an optical device having an information display area within their field of view. When the audience members watch the play through the optical device, information related to the scene of the play is transmitted to their seats, and an image of the information is displayed in the display area of ​​the optical device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2020-521174 Summary of the Invention [Problem to be solved by the invention]

[0004] However, for example, when watching a play on stage, opera glasses are sometimes used to see the facial expressions, costumes, props, and stage equipment of the actors on stage more clearly, but even if the opera glasses are used to enlarge the actors on stage, it can still be difficult to recognize the characters. Furthermore, because novice theatergoers have little knowledge of the names of the characters and actors on stage, they may not be able to immerse themselves in the performance, which may result in them not becoming repeat customers or leading to a lack of an increase in the number of theatergoers. Even experienced theatergoers may find it difficult to identify actors who play various roles in addition to the main cast, known as the ensemble, due to the changes in makeup and other aspects of the performance. However, the theater viewing support system described in Patent Document 1 does not display the name of the actor in the viewer's line of sight.

[0005] The present disclosure has been made in consideration of the above circumstances, and aims to provide a display system and a display method that allow viewers of a play or the like that takes place in a specific space of a predetermined size in which multiple specific characters appear to see the names of the characters or the names of the actors. [Means for solving the problem]

[0006] The present disclosure has been made to solve the above-mentioned problems, and one aspect of the present disclosure is a display system including: a display device worn on the head of a user viewing a specific space having a predetermined size in which a plurality of specific people appear from a pre-specified position; and a server device connected to the display device via a communication network, wherein the display device includes a display unit visually recognized by the user; a projection unit that projects display light onto the display unit; a gaze detection unit that detects the user's gaze; an imaging unit that generates viewing space video data by capturing an image of a viewing space in the specific space corresponding to the gaze detected by the gaze detection unit; and a server device that transmits the viewing space video data captured by the imaging unit to the server device and outputs person recognition information based on the transmitted viewing space video data to the server device. and a control unit that receives the viewing space video data from the display device and displays name information or actor name information of the specific person at the position of the specific person in the viewing space indicated by the person recognition information, wherein the server device comprises a database unit that stores person information including name information or actor name information and video information for each of the multiple specific people, and position information including the position of each specific person at each time in the specific space, and a processing unit that, when the viewing space video data is received from the display device, recognizes one of the multiple specific people based on the viewing space video data, the video information, and the position information, and transmits the person recognition information including the position information of the recognized specific person and the name information or actor name information of the recognized specific person to the display device.

[0007] Another aspect of the present disclosure is a display method for a display system including a display device worn on the head of a user viewing a specific space having a predetermined size in which a plurality of specific people appear from a pre-specified position, and a server device connected to the display device via a communication network, the method including the steps of the server device storing person information including name information or actor name information and video information of each of the plurality of specific people, and position information including the position of each of the specific people at each time in the specific space, the step of the display device detecting the user's line of sight, the step of the display device capturing an image of a viewing space in the specific space corresponding to the detected line of sight to generate viewing space video data, and the step of the display device displaying the captured viewing space video data. a step of transmitting auditory space video data to the server device; a step of the server device, upon receiving the audiovisual space video data from the display device, recognizing one of the plurality of specific persons based on the audiovisual space video data, the video information, and the position information, and transmitting person recognition information including position information of the recognized specific person and name information or actor name information of the recognized specific person to the display device; a step of the display device receiving the person recognition information based on the audiovisual space video data transmitted from the server device; and a step of the display device displaying the name information or actor name information of the specific person at the position of the specific person in the audiovisual space indicated by the person recognition information. [Effects of the Invention]

[0008] According to one aspect of the present invention, viewers of a play or the like that takes place in a specific space of a predetermined size in which multiple specific characters appear can be made to see the names of the characters or the actors. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 2 is a diagram illustrating an example of a stage and an audience according to an embodiment. [Figure 2]1A and 1B are conceptual diagrams in an embodiment, in which (a) shows an example of the positional relationship between a user PA and specific persons P1 to P4 on the stage, and (b) shows an example of information displayed on the display device of the user PA. [Figure 3] 1 is a block diagram showing an example of a display system 1 according to a first embodiment. [Figure 4] FIG. 2 is a diagram for explaining the processing of a processing unit 204 in the first embodiment. [Figure 5] FIG. 2 is a block diagram showing an example of the operation of the display device 100 according to the first embodiment. [Figure 6] FIG. 10 is a block diagram illustrating an example of a server device 200A according to a second embodiment. [Figure 7] FIG. 10 is a diagram illustrating an example of dress rehearsal data according to the second embodiment. [Figure 8] FIG. 10 is a block diagram illustrating an example of a display device 100A according to a third embodiment. [Figure 9] FIG. 10 is a block diagram showing an example of a display system 1A according to a fourth embodiment. [Figure 10] FIG. 13 is a sequence diagram showing an example of an operation of the display system 1 according to the fifth embodiment. [Figure 11] FIG. 20 is a block diagram illustrating an example of a server device 200B according to a sixth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] A display system and a display method to which the present invention is applied will be described below with reference to the drawings.

[0011] FIG. 1 is a diagram showing an example of a stage and an audience according to an embodiment. The display system of the embodiment is an information processing system that allows viewers of a play or the like that is performed in a specific space of a predetermined size in which multiple specific characters appear to visually recognize the names of the characters or the names of the actors. The multiple specific characters are actors who appear on stage, and whose names or actor names, and images of their faces and appearances are registered in a database. The specific space of a predetermined size is, for example, a theater stage where a play is performed. Note that the display system 1 can be used for any type of play or stage performance, and can be used for a wide range of stages, such as opera, musical, theater, dance, and ballet. Furthermore, the display system 1 can also be used for scenes in which multiple specific people appear, such as watching sports at a stadium.

[0012] The display system of the embodiment allows users PA, PB, ..., PN, who are watching specific persons P1, ..., P9 performing on stage from pre-specified positions such as seats in row A, ..., and row N, to visually recognize the name information of the specific persons or the actor name information. To this end, the display system has the users wear a display device 100, which will be described later, and projects the name information of the specific persons or the actor name information on the display device.

[0013] Figure 2 is a conceptual diagram of an embodiment, where (a) is a diagram showing an example of the positional relationship between user PA and specific people P1 to P4 on the stage, and (b) is a diagram showing an example of information displayed on the display device of user PA. When user PA views the stage from his / her seat, for example, specific persons P1 to P4 of the specific persons on the stage are present within his / her field of view. In this case, user PA can see P1 to P4 as visual targets through the display surface of the display device. The display device displays projected images showing the names or actor names of the specific persons P1 to P3, corresponding to the positions of the specific persons P1 to P4 on the display surface, based on information received from the server device. In this way, the display system allows user PA to visually recognize the name information or actor name information of the specific persons. It should be noted that, among the specific persons P1 to P4 on the display screen, the specific person P4 is far from the user PA, so the server device may fail to recognize the name or actor name of the character. In this case, the display system does not need to display the name or actor name of the specific person P4.

[0014] (First embodiment) The display system 1 according to the first embodiment will be described below. FIG. 3 is a block diagram showing an example of a display system 1 according to the first embodiment. The display system 1 includes, for example, a display device 100 and a server device 200. The display device 100 and the server device 200 are connected, for example, via a communication network NW. The communication network NW may be, for example, a general-purpose network such as the Internet, but is not limited thereto, and may also include a private network such as local 5G or Wi-Fi (registered trademark). Furthermore, the server device 200 may be constructed for each specific space, but is not limited thereto, and may be constructed for each play, or for each group including multiple specific people.

[0015] The display device 100 is an electronic device having a display function and an information processing function, such as a head-mounted display worn on a user's head, smart glasses, or smart opera glasses held by a user. The display device 100 includes, for example, a display unit 102, a projection unit 104, a gaze detection unit 106, an imaging unit 108, and a control unit 110.

[0016] The display unit 102 has a mechanism that allows the user to view it. The display unit 102 is, for example, a display surface such as glass that is placed in front of the user's eyes when the user wears the display device 100. The projection unit 104 projects display light onto the display unit 102 . The gaze detection unit 106 detects the gaze of the user. The gaze detection unit 106 has, for example, a small camera that captures an image of the user's eyes, and detects the gaze of the user based on the image captured by the small camera. The imaging unit 108 generates viewing space video data by capturing an image of a viewing space corresponding to the line of sight detected by the line of sight detection unit 106 within the specific space. The imaging unit 108 is a camera device that captures an image in the front direction of the user while the user is wearing the display device 100. The imaging unit 108 captures an image of a viewing space that is a specific space in the front direction of the user, narrowed by the line of sight detected by the line of sight detection unit 106.

[0017] The control unit 110 is realized, for example, by a processor such as a CPU (Central Processing Unit) executing a program stored in a program memory. The control unit 110 transmits viewing space video data captured by the imaging unit 108 to the server device 200. The control unit 110 receives person recognition information based on the transmitted viewing space video data from the server device 200. The control unit 110 displays name information or actor name information of a specific person at the position of the specific person indicated by the person recognition information in the viewing space.

[0018] The server device 200 includes a communication unit 202 , a processing unit 204 , and a database unit 206 . The communication unit 202 is a communication interface circuit that performs various communication processes, and communicates with one or more display devices 100 via the communication network NW.

[0019] The database unit 206 is a storage device equipped with various storage media such as a hard disk drive and a nonvolatile memory, and an information processing device that constructs a database. The database unit 206 stores person information and location information. The person information includes name information or actor name information for each of a plurality of specific people, and video information for each of the plurality of specific people. The location information is information including the location of each specific person at each time in a specific space.

[0020] The processing unit 204 is realized, for example, by a processor such as a CPU executing a program stored in a program memory. When the processing unit 204 receives the viewing space video data from the display device 100, it recognizes one of the multiple specific people based on the viewing space video data, the video information, and the position information. The processing unit 204 transmits person recognition information to the display device 100, the person recognition information including the position of the recognized specific person and the name information or actor name information of the recognized specific person.

[0021] FIG. 4 is a diagram for explaining the processing of the processing unit 204 in the first embodiment. The database unit 206 stores position information, video information, name information, or actor name information of a specific person as storage information, and the display device 100 detects gaze information and viewing space video data as detection information. The display device 100 transmits video in the gaze direction to the server device 200 as viewing space video data. The position of a specific person in the viewing space video data can be calculated based on the user's seating position and stage position, the user's gaze direction, the angle of view of the imaging unit 108, etc. When the degree of match between the person P1 included in the viewing space video data and the video information stored in the database unit 206 is higher than a threshold, the processing unit 204 determines that the specific person P1 corresponding to the video information stored in the database unit 206 exists in the viewing space. Furthermore, when the degree of match between the position of the person P1 included in the viewing space video data and the position information stored in the database unit 206 is higher than a threshold, the processing unit 204 determines that the specific person P1 corresponding to the position information stored in the database unit 206 exists in the viewing space. The processing unit 204 transmits the position in the viewing space and name information or actor name information of the specific person P1 determined to exist in the viewing space to the display device 100 as person recognition information.

[0022] FIG. 5 is a block diagram showing an example of the operation of the display device 100 according to the first embodiment. When the display device 100 is worn by a user, the display unit 102 is placed in front of the user's eyes. When the user looks at a specific space, incident light from the specific space is received by the imaging unit 108 via the display unit 102. The imaging unit 108 then generates viewing space video data based on the incident light and outputs the data to the control unit 110. The control unit 110 also acquires gaze data indicating the gaze direction detected by the gaze detection unit 106. The control unit 110 may process video data obtained by cutting out a portion of the viewing space video data into viewing space video data. The control unit 110 transmits the viewing space video data to the server device 200.

[0023] In response to transmitting the viewing space video data, the control unit 110 receives person recognition information from the server device 200. The control unit 110 outputs display data to the projection unit 104, which displays the name information or actor name information included in the person recognition information at a position on the display unit 102 that corresponds to the position information included in the person recognition information in the specific space viewed by the user. The projection unit 104 performs projection using the display data, thereby displaying the name information or actor name information near the specific person viewed via the display unit 102.

[0024] As described above, according to the display system 1 of the first embodiment, the server device 200 stores person information including name information or actor name information and video information for each of a plurality of specific persons, and position information including the position of each of the specific persons at each time in the specific space. The display device 100 detects the user's line of sight and captures an image of the viewing space in the specific space corresponding to the detected line of sight to generate viewing space video data. The server device 200 transmits the viewing space video data to the server device 200. Upon receiving the viewing space video data from the display device 100, the server device 200 recognizes one of the multiple specific persons based on the viewing space video data, the video information, and the position information, and transmits person recognition information including the position information of the recognized person and the name information or actor name information of the recognized person to the display device 100. In this way, when the display device 100 receives the person recognition information based on the transmitted viewing space video data from the server device 200, the display device 100 can display the name information or actor name information of the specific person at the position of the specific person indicated by the person recognition information in the viewing space. As a result, display system 1 allows viewers of a play or the like that is performed in a specific space of a predetermined size and in which multiple specific characters appear to visually recognize the names of the characters or actors. As a result, display system 1 makes it easy to check the names of the characters and actors while watching a play, providing deeper understanding and enjoyment. The database unit 206 may store other information related to the play, such as detailed information about costumes and props, descriptions of characters, and descriptions of the story, in addition to the name information of specific characters or actor names. This allows the display system 1 to display other information in association with the characters specified by the server device 200. This allows the display system 1 to deepen understanding and empathy for the play.

[0025] (Second embodiment) FIG. 6 is a block diagram illustrating an example of a server device 200A according to the second embodiment. The database units 206A, 206B, ... store, for each play held in a specific space, person information including name information or actor name information and video information of each of a plurality of specific people appearing in the play, and location information including the location of each of the specific people at each time in the specific space where the play is held. Furthermore, each of the plurality of database units 206A, 206B, ... may store dress rehearsal data for each play. FIG. 7 is a diagram illustrating an example of dress rehearsal data according to the second embodiment. The dress rehearsal data is, for example, video data captured during a play rehearsal. The dress rehearsal data may include, for example, data indicating the correspondence between times t1, t2, t3, t4, ... and character information and position information. The dress rehearsal data may include, for example, data indicating the correspondence between the characters appearing in the play and their positions for each period from time t1 to t2.

[0026] The processing unit 204 selects, for each play, a database unit 206 corresponding to the play being held from among the plurality of database units 206A, 206B, etc. The processing unit 204 can transmit person recognition information to the display device 100 when the degree of match between the people and positions included in the audio-visual space video data received from the display device 100 and the people and positions included in the selected database unit 206 exceeds a threshold. In addition, the processing unit 204 can transmit person recognition information to the display device 100 when the degree of match between the period, characters, and positions during the play contained in the dress rehearsal data and the period, characters, and positions when the viewing space video data received from the display device 100 was captured exceeds a threshold value.

[0027] (Third embodiment) FIG. 8 is a block diagram showing an example of a display device 100A according to the third embodiment. The display device 100A includes a magnification mechanism 120 that magnifies a specific space to allow the user to view it. The magnification mechanism 120 is, for example, an optical mechanism that causes a magnified image to be viewed by moving a lens in response to a user's operation. The imaging unit 108 generates viewing space video data by capturing an image of the viewing space magnified by the magnification mechanism 120. The server device 200 transmits person recognition information to the display device 100A by performing the above-described processing based on the viewing space video data. The control unit 110 displays name information or actor name information of a specific person at the position of the specific person indicated by the person recognition information in the viewing space magnified by the magnification mechanism 120.

[0028] As a result, when a specific person is enlarged by operating the magnification mechanism 120, the display system 1 can display the name information and actor name information of the enlarged specific person. In particular, the view of the stage varies depending on the user's seating position in the theater; if the user is seated in a seat near the back of the theater, the entire stage can be seen, but the accuracy of person recognition tends to be low. In response to this, the display system 1 can improve the recognition accuracy by recognizing a specific person using viewing space video data captured using the magnification mechanism 120. Furthermore, the display system 1 can increase the number of pieces of name information or actor name information displayed on the display device 100 due to the improved recognition accuracy.

[0029] (Fourth embodiment) FIG. 9 is a block diagram showing an example of a display system 1A according to the fourth embodiment. The display system 1A includes a plurality of beacons 300 held by a plurality of specific persons, respectively, and a receiving terminal 302. Each of the plurality of beacons 300 outputs a beacon signal when the specific person appears in a specific space. The beacon signal is received by the receiving terminal 302. The receiving terminal 302 calculates location information based on the beacon signal, and transmits the location information to the server device 200 together with information indicating the specific person.

[0030] The server device 200 acquires position information of each of a plurality of specific persons based on signals detected from a plurality of beacons 300. The processing unit 204 compares the position information of the specific person stored in the database unit 206 with the position information of the specific person acquired from the beacon 300. For example, when the degree of coincidence between the position information of the specific person P1 stored in the database unit 206 and the position information of the specific person P1 acquired from the beacon 300 exceeds a threshold, the processing unit 204 recognizes that the specific person P1 corresponding to the position exists in the database unit 206. When the degree of coincidence does not exceed the threshold, the processing unit 204 determines that the specific person P1 does not exist at the position stored in the database unit 206. When the processing unit 204 determines the degree of match between the position of a specific person included in the viewing space video data received from the display device 100 and the position of a specific person stored in the database unit 206, it uses the position information stored in the database unit 206 whose degree of match with the position of the specific person as determined by the beacon 300 exceeds a threshold. This allows the display system 1A to improve the accuracy of recognizing a specific person.

[0031] (Fifth embodiment) FIG. 10 is a sequence diagram showing an example of the operation of the display system 1 according to the fifth embodiment. 1, the display system 1 includes a first display device 100A worn by a user viewing from a position close to the specific space (row A) and generating first viewing space video data, and a second display device 100N worn by a user viewing from a position far from the specific space (row N) and generating second viewing space video data. The display device 100A transmits the first viewing space video data to the server device 200, and the display device 100N transmits the second viewing space video data to the server device 200.

[0032] When the server device 200 receives the first viewing space video data and the second viewing space video data from the first display device 100A and the second display device 100N, it recognizes one of the multiple specific persons based on the first viewing space video data, video information, and location information. That is, when there is first viewing space video data and second viewing space video data that capture the same stage, the processing unit 204 recognizes the specific person using the first viewing space video data. The processing unit 204 transmits person recognition information including the location information of the recognized specific person and the name information or actor name information of the recognized specific person to the first display device 100A and the second display device 100N.

[0033] As a result, according to the display system 1, person recognition information including position information, name information or actor name information of a specific person recognized using viewing space video data received from the display device 100A of a user sitting close to the specific person can be transmitted to the display device 100N of a user sitting far from the specific person.

[0034] FIG. 13 is a block diagram showing an example of a server device 200B according to a sixth embodiment (sixth embodiment). FIG. 11 is a block diagram showing an example of a server device 200B according to the sixth embodiment. In the above-described embodiment, the server device 200B may output person recognition information using a machine learning model. The server device 200B includes, for example, a machine learning model 210 and a learning processing unit 212. The machine learning model 210 is a machine learning model for each play held in a specific space. The learning processing unit 212 uses the data stored in the database unit 206 to train the machine learning model 210 using person information including name information or actor name information of each of multiple specific people appearing in a play and video information, and location information including the location of each specific person at each time in the specific space where the play is held. The learning processing unit 212 inputs the video data to the machine learning model 210 and updates the processing parameters of the machine learning model 210 so that the machine learning model 210 recognizes the specific people and their locations included in the video data. The processing parameters of the machine learning model 210 are elements that determine the process of inferring the specific people and their locations based on the video data. The processing unit 204 inputs the viewing space video data received from the display device 100 into the machine learning model 210, and recognizes one of the multiple specific persons based on the information output from the machine learning model 210.

[0035] Each embodiment and variant has been described, but these are merely examples and are not intended to be limiting. For example, one aspect of the present invention may be realized by combining any of the embodiments or variants, or a part of each embodiment or a part of each variant, with one or more other embodiments or one or more other variants. [Explanation of symbols]

[0036] 1. 1A Display System 100, 100A display device 100A First display device 100N Second display device 102 Display section 104 Projection section 106 Gaze detection unit 108 Imaging unit 110 control section 120 Magnification mechanism 200, 200A, 200B server equipment 202 Communications Department 204 Processing section 206, 206A, 206B Database Section 210 Machine Learning Models 212 Learning processing unit 300 Beacons 302 Receiving terminal

Claims

1. A display system comprising: a display device worn on the head of a user who watches a specific space having a predetermined size in which a plurality of specific people appear from a pre-designated position; and a server device connected to the display device via a communication network, The display device includes: a display unit visible to a user; a projection unit that projects display light onto the display unit; a gaze detection unit that detects the gaze of a user; an imaging unit that generates viewing space video data by imaging a viewing space corresponding to the line of sight detected by the line of sight detection unit within the specific space; a control unit that transmits the viewing space video data captured by the imaging unit to the server device, receives person recognition information based on the transmitted viewing space video data from the server device, and displays name information or actor name information of a specific person at a position of the specific person indicated by the person recognition information in the viewing space, The server device a database unit that stores person information including name information or actor name information and video information of each of the plurality of specific people, and location information including the location of each of the specific people at each time in the specific space; a processing unit that, when receiving the viewing space image data from the display device, recognizes one of the plurality of specific persons based on the viewing space image data, the image information, and the position information, and transmits the person recognition information including the position information of the recognized specific person and the name information or actor name information of the recognized specific person to the display device, Display system.

2. The display system of claim 1, wherein the database unit stores, for each play held in a specific space, person information including name information or actor name information and video information for each of a plurality of specific people appearing in the play, and location information including the location of each of the specific people at each time in the specific space where the play is held.

3. the display device includes a magnification mechanism for magnifying the specific space to allow a user to visually recognize it; the imaging unit generates the viewing space video data by imaging the viewing space enlarged by the enlargement mechanism; the control unit displays name information or actor name information of the specific person at a position of the specific person indicated by the person recognition information in the viewing space enlarged by the enlargement mechanism. The display system of claim 1 .

4. a plurality of beacons held by the plurality of specific persons, The display system according to claim 1, wherein the server device acquires location information of each of the plurality of specific persons based on signals detected from the plurality of beacons, and recognizes the specific persons by comparing the location information stored in the database unit with the location information acquired from the beacons.

5. The display device includes: a first display device that is worn by a user viewing from a position close to the specific space and that generates first viewing space video data; a second display device that is worn by a user viewing from a position far from the specific space and that generates second viewing space video data; The server device when the first viewing space image data and the second viewing space image data are received from the first display device and the second display device, a specific person among the plurality of specific people is recognized based on the first viewing space image data, the image information, and the position information, and the person recognition information including the position information of the recognized specific person and the name information or actor name information of the recognized specific person is transmitted to the first display device and the second display device; The display system of claim 1 .

6. The processing unit is a machine learning model for each play held in a specific space, the machine learning model being trained using person information including name information or actor name information and video information for each of a plurality of specific people appearing in the play, and location information including the location of each of the specific people at each time in the specific space where the play is held, and inputs the viewing space video data received from the display device into the machine learning model, and recognizes any one of the plurality of specific people based on the information output from the machine learning model.

7. A display method for a display system including a display device worn on the head of a user who watches a specific space having a predetermined size in which a plurality of specific people appear from a pre-designated position, and a server device connected to the display device via a communication network, comprising: the server device stores person information including name information or actor name information and video information of each of the plurality of specific persons, and location information including the location of each of the specific persons at each time in the specific space; The display device detects a line of sight of a user; generating viewing space video data by capturing an image of a viewing space corresponding to the detected line of sight within the specific space by the display device; a step of transmitting the captured viewing space video data to the server device by the display device; a step in which, when the server device receives the viewing space image data from the display device, the server device recognizes one of the plurality of specific persons based on the viewing space image data, the image information, and the position information, and transmits person recognition information including the position information of the recognized specific person and name information or actor name information of the recognized specific person to the display device; receiving, by the display device, the person recognition information based on the transmitted viewing space video data from the server device; a step of displaying name information or actor name information of a specific person at a position of the specific person indicated by the person recognition information in the audio-visual space by the display device; including, how it is displayed.

Images