Content reproduction device and content reproduction method

The content playback device and method synchronize user vital data with character data to create a unified experience, addressing the lack of immersion in existing systems by using vital data feedback for real-time synchronization and correction, thereby enhancing engagement and immersion.

WO2024241862A1PCT designated stage expired Publication Date: 2024-11-28JVC KENWOOD CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/016922
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-19
Filing Date
2024-05-07
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

Existing content playback systems lack the ability to enhance user engagement by replicating vital data of characters in content, such as e-books and movies, and do not effectively utilize user feedback data to create a sense of unity between the viewer and the content.

Method used

A content playback device and method that includes a vital data acquisition unit, a coincidence calculation unit, and a matching degree output unit to synchronize user vital data with character vital data, allowing for real-time feedback and immersion enhancement through vibration, audio, and visual outputs.

Benefits of technology

The system provides users with a heightened sense of unity and immersion by accurately matching user vital data with character data, enhancing the overall content experience through synchronized biological feedback and data correction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024016922_28112024_PF_FP_ABST
    Figure JP2024016922_28112024_PF_FP_ABST
Patent Text Reader

Abstract

Provided are a content reproduction device and a content reproduction method with which it is possible to impart a sense of unity to a user by presenting the user with vital data of personages in content that the user is viewing. A content reproduction device according to the present disclosure comprises: a content reproduction unit that reproduces content that is information represented by at least one of an image, a sound, and character information; a vital data acquisition unit that acquires vital data of a user viewing the content; a matching degree calculation unit that calculates the degree of matching between vital data of a personage in the content being viewed and the vital data of the user viewing the content; and a matching degree output unit that outputs the calculated degree of matching.
Need to check novelty before this filing date? Find Prior Art

Description

Content playback device and content playback method

[0001] The present disclosure relates to a content playback device and a content playback method.

[0002] More and more users are enjoying content such as e-books, movies, and TV dramas. If content can be given value that allows for new experiences, it is believed that the enjoyment of the content will be amplified.

[0003] For example, Patent Document 1 listed below discloses a manga data display method that controls the page turning speed in an electronic book depending on the importance that the author of the novel or manga thinks about it.

[0004] Patent No. 6469875

[0005] However, the manga data display method described in Patent Document 1 above does not have a mechanism for playing back related data accompanying any scene in a book on any device, and it is not possible to provide feedback and utilize data related to the reader while reading.

[0006] In consideration of the above-mentioned problems, the present disclosure aims to provide a content playback device and a content playback method that can give a user a sense of unity by presenting the user with vital data of characters in the content the user is watching.

[0007] In order to solve the above-mentioned problems and achieve the objectives, the content playback device according to the present disclosure includes a content playback unit that plays content that is information expressed by at least one of images, audio, and text information, a vital data acquisition unit that acquires vital data of a user watching the content, a coincidence calculation unit that calculates the degree of coincidence between the vital data of a character in the content and the vital data of the user watching the content, and a coincidence output unit that outputs the calculated degree of coincidence.

[0008] In order to solve the above-mentioned problems and achieve the objectives, the content playback method of the present disclosure includes the steps of playing content that is information expressed by at least one of images, audio, and text information, acquiring vital data of a user watching the content, calculating the degree of match between the vital data of a character in the content and the vital data of the user watching the content, and outputting the calculated degree of match.

[0009] According to the present disclosure, it is possible to provide a content playback device and a content playback method that can give a user a sense of unity by presenting the user with vital data of the characters in the content that the user is watching.

[0010] FIG. 1 is a diagram illustrating an overview of a content playback device according to the present disclosure. FIG. 2 is a diagram illustrating a configuration example of a content playback system according to the present disclosure. FIG. 3 is a diagram illustrating a configuration example of a first embodiment of a content playback device according to the present disclosure. FIG. 4 is a diagram illustrating an example of information stored in a first content storage unit of a content playback device according to the present disclosure. FIG. 5 is a diagram illustrating an example of a configuration example of a server device according to the present disclosure. FIG. 6 is a flowchart illustrating a flow of a first embodiment of a content playback method according to the present disclosure. FIG. 7 is a diagram illustrating a configuration example of a second embodiment of a content playback device according to the present disclosure. FIG. 8 is a diagram illustrating an example of information stored in a second content storage unit of a content playback device according to the present disclosure. FIG. 9 is a flowchart illustrating a flow of a second embodiment of a content playback method according to the present disclosure. FIG. 10 is a diagram illustrating a configuration example of a third embodiment of a content playback device according to the present disclosure. FIG. 11 is a diagram illustrating a configuration example of a fourth embodiment of a content playback device according to the present disclosure. FIG. 12 is a diagram illustrating a configuration example of a fifth embodiment of a content playback device according to the present disclosure.

[0011] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. However, the present disclosure is not limited to the embodiments described below.

[0012] (Outline of Content Reproduction Device) First, an outline of a content reproduction device 100 according to the present disclosure will be described using Fig. 1. Fig. 1 is a diagram illustrating an outline of a content reproduction device according to the present disclosure. As shown in Fig. 1, the content reproduction device 100 according to the present disclosure is an information processing device that reproduces content and reproduces vital data of characters in a predetermined scene of the content.

[0013] 1 , vital data of the user U is measured by a vital sensor unit 140 worn on the head of the user U, and vital data of a character in a predetermined scene of the content is reproduced by a vital reproduction unit 170. Note that the placement of the vital sensor unit 140 is not limited to the user U's head.

[0014] It should be noted that the aspect of the content playback device 100 shown in FIG. 1 is merely an example, and the aspect of the content playback device 100 according to the present disclosure is not limited to the aspect shown in FIG.

[0015] (Configuration of Content Reproduction System) Next, the configuration of a content reproduction system 1 according to the present disclosure will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example configuration of a content reproduction system according to the present disclosure.

[0016] As shown in Fig. 2, the content reproduction system 1 includes content reproduction devices 100 (100A, 100B), a server device 200, and a network N. Note that, as shown in Fig. 2, the content reproduction system 1 may be configured by two or more content reproduction devices 100. The following briefly describes these components.

[0017] The content playback device 100 is an information processing device that plays back content. The content playback device 100 may be, for example, an information processing device such as a smartphone, a tablet terminal, a desktop PC (Personal Computer), a notebook PC, a mobile phone, or a PDA (Personal Digital Assistant). The outline of the content playback device 100 has been described above, so the description here will be limited to that extent.

[0018] The server device 200 is an information processing device that provides various types of information. The server device 200 provides content to, for example, the content playback device 100. The server device 200 may be realized by, for example, an information processing device such as a PC, a WS (Work Station), or a computer having server functions.

[0019] The network N connects the content playback device 100 and the server device 200 wirelessly or wired so that they can communicate with each other. The network N may be realized by a wireless LAN (Local Area Network) defined by IEEE802.11, a fourth generation mobile communication system (4G), a fifth generation mobile communication system (5G), or the like.

[0020] The content reproduction system 1 functions as a single system by exchanging information between the content reproduction device 100 and the server device 200 via a network N.

[0021] (Configuration of Content Playback Device) (First Embodiment of Content Playback Device) Next, a first embodiment of a content playback device 100 according to the present disclosure will be described with reference to FIG. 3. FIG. 3 is a diagram showing an example configuration of the first embodiment of a content playback device according to the present disclosure. As shown in FIG. 3, the first embodiment of the content playback device 100 according to the present disclosure includes a communication unit 110, a storage unit 120, a control unit 130, a vital sign sensor unit 140, a sound output unit 150, a display unit 160, and a vital sign playback unit 170. These components will be described in order below.

[0022] The communication unit 110 connects the inside and outside of the content playback device 100 so that they can communicate with each other, and transmits and receives information between the inside and outside of the content playback device 100. The communication unit 110 may be realized by, for example, a wireless LAN (Local Area Network) card, a Wi-Fi (registered trademark) module, a Bluetooth (registered trademark) module, an antenna, etc. The communication unit 110 may be wirelessly connected to, for example, a network N, and transmit and receive information to and from the server device 200.

[0023] The storage unit 120 is a storage device that stores various types of information. The storage unit 120 includes a main storage device and an auxiliary storage device. The main storage device may be realized by a semiconductor memory element such as a RAM (Random Access Memory), a ROM (Read Only Memory), or a flash memory. The auxiliary storage device may be realized by a hard disk, a SSD (Solid State Drive), an optical disk, or the like.

[0024] As shown in FIG. 3, the storage unit 120 includes a first content storage unit 121 .

[0025] The first content storage unit 121 stores information related to content. An example of the information stored in the first content storage unit 121 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the information stored in the first content storage unit of the content playback device according to the present disclosure.

[0026] In the example shown in FIG. 4, the first content storage unit 121 stores information relating to the items "content ID," "content," "scene ID," "scene position," and "vital data" in association with each other.

[0027] A "content ID" is an identifier that identifies content and is represented by a character string, a number, or the like. "Content" is data of content identified by a "content ID," and may be, for example, data on books, movies, dramas, concert footage, music, etc. Here, books include, but are not limited to, e-books. In other words, "content" refers to information expressed by at least one of images, audio, and text information.

[0028] A "scene ID" is an identifier for identifying a scene of the content identified by the "content ID," in other words, a scene, and is expressed by a character string, a number, or the like. A "scene position" indicates the position of the scene identified by the "scene ID" in the content identified by the "content ID," and may be expressed, for example, as a percentage of the length of the entire content. If the content is video information such as a movie or drama, the "scene position" indicates the playback time. If the content is text information such as a book, the "scene position" indicates the page number and the line number.

[0029] "Vital data" is data relating to the biological condition (also known as vital signs that indicate a person is alive, such as pulse, blood pressure, and body temperature) of a character in a scene identified by a "scene ID" of content identified by a "content ID," and the vital data playback unit 170 expresses the biological condition of the character based on this. Specifically, when the "vital data" is a pulse, the vital data includes information on the pulse rate, etc. The vital data may also include information on the number of times the vital data is played back during the corresponding scene. "Vital data" also includes information indicating that vital data is not to be played back, i.e., there is no vital data.

[0030] That is, Figure 4 shows an example in which data of content identified by content ID "CTID#1" is stored as "CT#1", the scene position of a scene identified by scene ID "SCID#1" of the content is "SCPS#1-1", and vital data for displaying the biological status of a character in the scene by vital playback unit 170 is stored as "VTDT#1-1".

[0031] In addition, the first content storage unit 121 is not limited to information relating to the items "content ID," "content," "scene ID," "scene position," and "vital data," and may store information relating to any other content.

[0032] The control unit 130 is a controller that manages and controls the content playback device 100. The control unit 130 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like executing various programs stored in the storage unit 120 using RAM as a work area. The control unit 130 may also be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0033] As shown in FIG. 3 , the control unit 130 includes a content playback unit 131, a vital data acquisition unit 132, a vital data playback instruction unit 133, a coincidence calculation unit 134, and a coincidence output unit 135. The control unit 130 realizes these functions and executes these processes by reading and executing a program (software) from the storage unit 120. Note that these components of the control unit 130 may be implemented by electronic circuits. The control unit 130 may execute these processes using a single CPU, or may include multiple CPUs that execute these processes in parallel. These components will be described below in order.

[0034] The content playback unit 131 plays content including at least one of e-books, movies, and dramas. The content playback unit 131 reads content from the first content storage unit 121 and plays the read content. For example, the content playback unit 131 may play the content by causing the sound output unit 150 to output the audio of the content and causing the display unit 160 to display the video of the content. If the content is video information, the content playback unit 131 transmits current playback time information to the vital playback instruction unit 133. If the content is an e-book, the content playback unit 131 transmits current playback page information to the vital playback instruction unit 133.

[0035] The vital data acquisition unit 132 acquires vital data of a user viewing content. In the following description, viewing content includes not only viewing video information such as movies but also reading text information such as books. The vital data acquisition unit 132 may acquire, for example, the user's electrooculography (EOG) measured by an electrooculography sensor in the vital sensor unit 140, the user's gaze direction measured by a gaze detection camera, the user's electrodermal activity state measured by an electrodermal activity sensor, a pulse wave signal measured by a pulse wave sensor, a respiratory rate calculated from the pulse wave signal, and brain waves measured by an electroencephalograph. Details of the vital sensor unit 140 will be described later.

[0036] The vital sign playback instruction unit 133 identifies a scene of the content the user is viewing and instructs the playback of vital sign data of the characters in the identified scene. For example, if the content is video information, the vital sign playback instruction unit 133 identifies the current playback time acquired from the content playback unit 131 as the scene the user is viewing. For example, if the content is an e-book, the vital sign playback instruction unit 133 identifies the scene the user is viewing by estimating the line the user is viewing based on the user's line of sight acquired from the vital sign sensor unit 140, for example, based on the current playback page number acquired from the content playback unit 131 as the page the user is viewing. The vital sign playback instruction unit 133 instructs the vital sign playback unit 170 to play back vital sign data of the characters in the identified scene. As described above, the first content storage unit 121 stores vital sign data of the characters for each scene of the content. Therefore, when the content being played back by the content playback unit 131 reaches a specified scene, the vital data playback instruction unit 133 reads out the vital data of the characters in the specified scene of the content being played back from the first content storage unit 121 and instructs the vital data playback unit 170 to play back the vital data.

[0037] 4, the information about the content corresponds to one character whose vital data is reproduced in each scene, but this is not limited to this. The information about the content may include vital data corresponding to each of multiple characters for one scene ID. For example, if the content is video information, the vital data reproduction instruction unit 133 may identify a character that the user is gazing at based on the user's line of sight obtained from the vital sensor unit 140 or the like, and may instruct the reproduction of vital data corresponding to the identified character.

[0038] Here, when the content is an e-book, in order to identify the line number of the scene the user is viewing, it is necessary to make an inference based on the user's line of sight, etc. Depending on the configuration of the vital sensor unit 140, it may be possible that the user's line of sight cannot be detected. Therefore, a "priority" column consisting of information on whether or not there is a line of sight may be added to the information about the content shown in FIG. 4, and vital data may be played back if there is information on the priority of the corresponding scene ID, even if the line of sight cannot be detected.

[0039] The vital sign playback instruction unit 133 corrects the character's vital sign data based on the degree of similarity and the user's vital sign data, and then instructs the vital sign playback unit 170 to play the corrected data. Specifically, for example, the vital sign playback instruction unit 133 instructs the playback of the character's vital sign data that has been corrected to approach the user's vital sign data based on the degree of similarity. For example, assume that the degree of similarity calculated by the degree of similarity calculation unit 134, which will be described later, is 80%. In this case, the vital sign playback instruction unit 133 instructs the playback of the character's vital sign data that has been corrected to approach the user's vital sign data by 20%. In other words, the vital sign playback instruction unit 133 corrects the 20% of the character's vital sign data that does not match the user's vital sign data to match the user's vital sign data. Specifically, the unit 133 may instruct the playback of the character's vital sign data that has been multiplied by a coefficient that corrects the character's vital sign data to approach the user's vital sign data by 20%.

[0040] The vital sign playback instruction unit 133 instructs the vital sign playback unit 170, which is a vibration device that outputs vibrations, to play back the vital sign data as vibrations. In this case, the vital sign playback unit 170 drives the vibration device to express, for example, the state of a character's heartbeat (such as the speed or slowness of the pulse, strength, etc.) through vibrations based on the vital sign data stored in the first content storage unit 121. This allows the user to experience the excitement of the character. Furthermore, the vital sign playback instruction unit 133 may drive the vibration device based on vital sign data indicating the heartbeat of a character not appearing in a scene, vital sign data that represents a plot twist in the story, or vital sign data that provides a different interpretation of a character's feelings within the same scene.

[0041] The coincidence calculation unit 134 calculates the degree of coincidence between the vital data of a character and the vital data of a user viewing the content. For example, the coincidence calculation unit 134 may calculate the degree of coincidence by normalizing the vital data of the user viewing the content acquired by the vital data acquisition unit 132 and the vital data of the character in the content and then calculating the distance between the data using a distance function such as Euclidean distance, Manhattan distance, or Chebyshev distance. The user's vital data may be subjected to preprocessing such as smoothing before normalization. The coincidence calculation unit 134 may calculate the degree of coincidence from a correlation value between the vital data of the character and the vital data of the user viewing the content. Here, the user's vital data may be acquired in advance, for example, from the vital sensor unit 140, before the content is played back and used to calculate the degree of coincidence. For example, the user's average heart rate may be acquired before the content is played back, and the vital data of the user viewing the content acquired by the vital data acquisition unit 132 may be corrected based on the average heart rate, and then the degree of coincidence may be calculated.

[0042] Furthermore, the vital sign playback instruction unit 133 may correct the user's vital sign data in a direction that is expected to bring it closer to the character's vital sign data based on the degree of similarity, and may instruct playback. Specifically, the vital sign playback instruction unit 133 may determine the direction of correction using a machine learning model. This machine learning model is configured to output, in response to input of the user's vital sign data, the character's vital sign data, and the degree of similarity, in which direction the character's vital sign data should be corrected to bring the user's vital sign data closer to the character's vital sign data. This machine learning model is trained using training data consisting of pairs of input data and correct answer data. The training data for this machine learning model may, for example, include input data indicating in advance which direction and to what extent the vital sign data for each user should be corrected, and the resulting vital sign data as correct answer data.

[0043] The coincidence output unit 135 outputs the degree of coincidence calculated by the coincidence calculation unit 134. For example, the coincidence output unit 135 may output the degree of coincidence by displaying the calculated degree of coincidence on the display unit 160. Alternatively, the coincidence output unit 135 may output the degree of coincidence by causing the sound output unit 150 to output the calculated degree of coincidence as sound. Alternatively, the coincidence output unit 135 may output the calculated degree of coincidence as data to an external device (not shown) or the like.

[0044] The vital sensor unit 140 measures the user's biometric information, in other words, vital data. The vital sensor unit 140 may be, for example, an electrooculography sensor that measures the user's electrooculography as vital data. An electrooculography sensor is a sensor that measures the potential difference occurring between the cornea side and the retina side of the eyeball. The cornea side of a human eyeball generally carries a positive charge, while the retina side carries a negative charge, resulting in a potential difference between the two. If the potential difference is measured by attaching electrodes to a specific position on the head, for example, the skin around the eyes, this potential difference changes with eye movement and blinking, and therefore, by measuring the potential difference, eye movement, i.e., the direction of gaze, can be determined.

[0045] Furthermore, the vital sensor unit 140 may be a gaze detection camera that measures the direction of the user's gaze as vital data. The gaze detection camera is a camera that captures an image of the user's eyes. The gaze detection camera may include an analysis unit that performs gaze detection by image analysis of the image data of the user's eyes. For example, the analysis unit of the gaze detection camera may detect the gaze direction from the image data of the user's eyes based on the positional relationship with a moving point (outer edge of the iris) using a characteristic part of the face or eyes (e.g., the inner corner or outer corner of the eye) as a reference.

[0046] Furthermore, the vital sensor unit 140 may be an electrodermal activity (EDA) sensor that detects the electrical activity of the skin as vital data of the user. The electrodermal activity sensor measures the electrical activity of the skin due to sweat secreted from sweat glands (e.g., eccrine glands) in the skin. Electrodermal activity is broadly classified into skin potential and skin conductance. The skin potential is divided into skin potential level and skin potential reflex. The skin potential level is the direct current component of the skin potential, and exhibits a high negative value when the user is highly aroused and a positive value when the user feels drowsy or relaxed. The skin potential reflex is the alternating current component of the skin potential, and the skin potential reflex occurs frequently when pain, touch, hearing, vision, or other stimuli are present, or when deep breathing, physical movement, mental arithmetic, or thinking.

[0047] Furthermore, the vital sensor unit 140 may be a pulse wave sensor that detects a pulse wave signal as vital data of the user. A pulse wave sensor is a sensor that captures, as a waveform, changes in the volume of blood vessels that occur as the heart pumps blood. The pulse wave sensor irradiates the living body with infrared light, red light, or light with a green wavelength around 550 nm, and measures the light reflected from the living body using a photodiode or phototransistor. Oxygenated hemoglobin is present in arterial blood, which has the property of absorbing incident light. Therefore, a pulse wave signal can be obtained by measuring the blood volume (changes in the volume of blood vessels) that changes with the heart's pulsation over time.

[0048] The vital sensor unit 140 may also be an electroencephalography (EEG) that measures brain waves as vital data of the user. The electroencephalograph places electrodes on the scalp that derive bioelectrical potentials (around 20 μV) generated by the activity of neurons in the brain, amplifies the signals received by the electrodes, and measures the bioelectrical potentials (brain waves) of neurons in the brain. For example, the electroencephalograph may be implemented as a type that reduces contact resistance between the electrodes and scalp by placing a conductive gel between the scalp and the electrodes, a type that places a sponge between the scalp and the electrodes and impregnates the sponge with an electrolyte, or a type that has an amplifier built in close proximity to the electrodes, receives electrical signals with high input impedance, and outputs with low output impedance.

[0049] The sound output unit 150 outputs sound in accordance with a control command. The sound output unit 150 may be a speaker, which converts an electrical signal into sound using a diaphragm. That is, the speaker vibrates the diaphragm at a predetermined amplitude and frequency based on a control command given by the electrical signal, thereby vibrating the air in contact with the diaphragm and outputting sound. The sound output unit 150 may, for example, output the audio of content that the content playback unit 131 displays on the display unit 160.

[0050] The display unit 160 displays various types of information to the user. For example, the display unit 160 displays video of content based on instructions from the content playback unit 131. The display unit 160 may be realized by, for example, a liquid crystal display, an organic electroluminescence (EL) display, a micro-LED (light-emitting diode) display, or the like.

[0051] The vital sign playback unit 170 plays back vital sign data of a character in a specific scene of the content being viewed by the user. The vital sign playback unit 170 may be realized, for example, by a display device, an audio output device, a vibration device, a heat source unit, a fragrance unit, or the like. The display device, like the display unit 160, is realized by an LCD display or the like and uses video to represent the biological condition indicated by the character's vital sign data. The audio output device, like the sound output unit, is a speaker and uses audio to represent the biological condition indicated by the character's vital sign data. The vibration device generates vibrations using a motor with an eccentric rotor or an actuator that utilizes the inverse piezoelectric effect of a piezoelectric element to represent the biological condition indicated by the character's vital sign data. The heat source unit includes a Peltier element or the like and generates heat using electricity to represent the character's body temperature indicated by the vital sign data. The fragrance unit emits a fragrance to represent the biological condition indicated by the character's vital sign data in a specific scene of the content using a scent.

[0052] (Configuration of Server Device) Next, the configuration of a server device according to the present disclosure will be described with reference to Fig. 5. Fig. 5 is a diagram illustrating an example configuration of a server device according to the present disclosure. As shown in Fig. 5, server device 200 according to the present disclosure includes a communication unit 210, a storage unit 220, and a control unit 230.

[0053] The communication unit 210 is realized by, for example, a network interface card (NIC), a wireless LAN card, etc. The communication unit 210 is connected to a network N by wire or wirelessly, and transmits and receives various information to and from the content playback device 100 via the network N.

[0054] The storage unit 220 is a storage device that stores various types of information. The storage unit 220 includes a main storage device and an auxiliary storage device. The main storage device may be realized by semiconductor memory elements such as RAM, ROM, flash memory, etc. The auxiliary storage device may be realized by a hard disk, SSD, optical disk, etc.

[0055] As shown in FIG. 5, the storage unit 220 includes a content storage unit 221 .

[0056] The information stored in the content storage unit 221 is the same as the information stored in the second content storage unit 122 of the content playback device 100, and therefore a description thereof will be omitted. However, the number of pieces of content stored in each of the content storage unit 221 and the second content storage unit 122 may be different.

[0057] The control unit 230 is realized by, for example, a CPU, an MPU, or the like executing various programs stored in the server device 200 using RAM as a work area. The control unit 230 may also be realized by, for example, an integrated circuit such as an ASIC or an FPGA.

[0058] As shown in FIG. 5 , the control unit 230 includes a receiving unit 231 and a providing unit 232 .

[0059] The reception unit 231 receives a content provision request. For example, the reception unit 231 may display a content reception screen on the display unit 160 of the content playback device 100, the content reception screen including an input screen for inputting the type of content desired by the user U of the content playback device 100, the name of the content, the size of the content, and the like, thereby receiving the content provision request from the user.

[0060] The providing unit 232 provides content based on the content provision request. For example, the providing unit 232 reads content that matches the content provision request from the content storage unit 221, and provides the read content to the content playback device 100 that has issued the content provision request.

[0061] (Content Playback Method) (First Embodiment of Content Playback Method) Next, a first embodiment of a content playback method according to the present disclosure will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of the first embodiment of the content playback method according to the present disclosure. The first embodiment of the content playback method according to the present disclosure will be described along the flow shown in Fig. 6.

[0062] First, the content playback device 100 plays back content (step S101). Next, the content playback device 100 acquires vital data of the user while watching the content (step S102). Next, the content playback device 100 outputs vital data of a character in a predetermined scene of the content (step S103). Next, the content playback device 100 calculates the degree of match between the vital data of the character and the vital data of the user (step S104). After the process of step S103, before the process of step S104, the content playback device 100 may wait for a certain period of time, such as one minute, to elapse before calculating the degree of match. Next, the content playback device 100 outputs the calculated degree of match (step S105).

[0063] This makes it possible to acquire vital data of a user viewing content, calculate the degree of coincidence with the vital data of a character in the content, and output the calculated degree of coincidence. Therefore, it is possible to provide a content playback method that can give a user a sense of unity by presenting the user with the vital data of the character in the content that the user is viewing.

[0064] (Configuration of Content Playback Device) (Second Embodiment of Content Playback Device) Next, a second embodiment of a content playback device 100 according to the present disclosure will be described with reference to FIG. 7. FIG. 7 is a diagram showing an example configuration of the second embodiment of a content playback device according to the present disclosure. As shown in FIG. 7, the second embodiment of the content playback device 100 according to the present disclosure includes a communication unit 110, a storage unit 120, a control unit 130, a vital sign sensor unit 140, a sound output unit 150, a display unit 160, and a vital sign playback unit 170.

[0065] The configuration of the second embodiment of the content playback device 100 is the same as that of the first embodiment of the content playback device 100, except for the storage unit 120 and the control unit 130. Therefore, the description of the configuration of the second embodiment of the content playback device 100 that is the same as that of the first embodiment of the content playback device 100 will be omitted, and only the second content storage unit 122 of the storage unit 120 and the control unit 130, which are different from those of the first embodiment of the content playback device 100, will be described.

[0066] As shown in FIG. 7, the storage unit 120 includes a second content storage unit 122 .

[0067] The second content storage unit 122 stores information related to content. An example of the information stored in the second content storage unit 122 will be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of the information stored in the second content storage unit of the content playback device according to the present disclosure.

[0068] In the example shown in Fig. 8, the second content storage unit 122 stores information relating to the items "content ID," "content," "scene ID," "scene position," "vital data," "presence or absence of branching," "post-branching content," and "degree of matching" in association with each other. Note that information other than "presence or absence of branching," "post-branching content," and "degree of matching" is the same as the information stored in the second content storage unit 122. Therefore, of the items stored in the second content storage unit 122, the items "presence or absence of branching," "post-branching content," and "degree of matching" will be described below.

[0069] "Branch presence / absence" is information indicating whether or not the content branches in a scene identified by the "scene ID" of the content, and is represented, for example, by "yes" or "no." "Post-branch content" is data on the content after branching when there is a branch in the scene identified by the "scene ID" of the content identified by the "content ID." "Matching degree" indicates the range or threshold of matching degree between the user's vital data and the vital data of the characters in the content when deciding to play the "post-branch content" as the post-branch content.

[0070] That is, Figure 8 shows an example in which the content data of content identified by content ID "CTID#1" is stored as "CT#1", the scene position of the scene identified by scene ID "SCID#1" of the content is "SCPS#1-1", vital data for displaying the biological status of the characters in the scene by the vital playback unit 170 is stored as "VTDT#1-1", the presence or absence of branching in the scene is "yes", and the post-branching content in the scene is stored as "BRCT#1-1-1" and "BRCT#1-1-2".

[0071] In addition, the second content storage unit 122 is not limited to information relating to the items "content ID," "content," "scene ID," "scene position," "vital data," "presence or absence of branching," "content after branching," and "degree of similarity," and may store information relating to any other content.

[0072] 7 , the control unit 130 includes a content playback unit 131, a vital data acquisition unit 132, a vital sign playback instruction unit 133, a coincidence calculation unit 134, and a branch destination determination unit 136. The configuration of the control unit 130 of the second embodiment of the content playback device 100 is the same as the configuration of the control unit 130 of the first embodiment of the content playback device 100, except that the coincidence output unit 135 is removed and the branch destination determination unit 136 is added. Therefore, a description of the configuration of the control unit 130 of the second embodiment of the content playback device 100 that is the same as the configuration of the control unit 130 of the first embodiment of the content playback device 100 will be omitted, and only the branch destination determination unit 136, which is a different configuration from the configuration of the control unit 130 of the first embodiment of the content playback device 100, will be described.

[0073] The branch destination determination unit 136 determines the branch destination of the content based on the calculated degree of similarity. As described above, the second content storage unit 122 of the storage unit 120 of the second embodiment of the content playback device 100 stores "degrees of similarity" associated with "post-branch content." When the content playback unit 131 reaches a scene where the content branches, the branch destination determination unit 136 refers to the degree of similarity calculated by the degree of similarity calculation unit 134 and determines the post-branch content corresponding to the degree of similarity as the branch destination of the content. After determining the branch destination of the content, the branch destination determination unit 136 instructs the content playback unit 131 to play the post-branch content.

[0074] (Content Playback Method) (Second Embodiment of Content Playback Method) Next, a second embodiment of a content playback method according to the present disclosure will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the flow of the second embodiment of the content playback method according to the present disclosure. The second embodiment of the content playback method according to the present disclosure will be described along the flow shown in Fig. 9.

[0075] First, the content playback device 100 plays back content (step S201). Next, the content playback device 100 acquires vital data of the user while watching the content (step S202). Next, the content playback device 100 outputs vital data of a character in a predetermined scene of the content (step S203). Next, the content playback device 100 calculates the degree of coincidence between the vital data of the character and the vital data of the user (step S204). Next, the content playback device 100 determines a branch destination of the content based on the degree of coincidence (step S205). Next, the content playback device 100 plays back the content at the determined branch destination (step S206).

[0076] According to this, it is possible to acquire vital data of a user viewing content, calculate the degree of match with the vital data of a character in the content, determine the branch destination of the content based on the calculated degree of match, and play the content after branching. Therefore, it is possible to provide a content playback method that can perform appropriate content branching by comparing the user's vital data with the vital data of the character.

[0077] (Configuration of Content Reproduction Device) (Third Embodiment of Content Reproduction Device) Next, a third embodiment of a content reproduction device 100 according to the present disclosure will be described with reference to FIG. 10 . FIG. 10 is a diagram showing an example configuration of the third embodiment of a content reproduction device according to the present disclosure. As shown in FIG. 10 , the third embodiment of the content reproduction device 100 according to the present disclosure includes a communication unit 110, a storage unit 120, a control unit 130, a vital sensor unit 140, a sound output unit 150, and a display unit 160.

[0078] The third embodiment of the content playback device 100 is the same as the first embodiment of the content playback device 100 except that the vital sign playback instruction unit 133 of the control unit 130 and the vital sign playback unit 170 are omitted from the first embodiment of the content playback device 100. Therefore, a description of the configuration of the third embodiment of the content playback device 100 will be omitted.

[0079] According to the third embodiment of the content playback device 100, a simple configuration can be used to acquire vital data of a user viewing content, calculate the degree of match with the vital data of a character in the content, and output the calculated degree of match. Therefore, it is possible to detect the sense of unity or immersion that the user viewing the content feels with the character in the content based on the degree of match.

[0080] (Configuration of Content Playback Device) (Fourth Embodiment of Content Playback Device) Next, a fourth embodiment of a content playback device 100 according to the present disclosure will be described with reference to FIG. 11 . FIG. 11 is a diagram showing an example configuration of the fourth embodiment of a content playback device according to the present disclosure. As shown in FIG. 11 , the fourth embodiment of the content playback device 100 according to the present disclosure includes a communication unit 110, a storage unit 120, a control unit 130, and a vital sensor unit 140.

[0081] The fourth embodiment of the content playback device 100 is the same as the first embodiment of the content playback device 100 except that, compared to the first embodiment of the content playback device 100, the first content storage unit 121 is removed from the storage unit 120, the content playback unit 131, the vital sign playback instruction unit 133, the sound output unit 150, and the display unit 160 are removed from the control unit 130, and the vital sign playback unit 170 is provided outside the content playback device 100. Therefore, of the configuration of the fourth embodiment of the content playback device 100, the description of the same configuration as the first embodiment of the content playback device 100 will be omitted, and only the description will be given of the vital sign playback unit 170, which is a different configuration from the first embodiment of the content playback device 100.

[0082] The vital sign reproduction unit 170 according to the fourth embodiment of the content reproduction device 100 is provided outside the content reproduction device 100, includes a Wi-Fi module, Bluetooth, or the like, and is connected to the communication unit 110 so as to be able to communicate wirelessly with each other. The vital sign reproduction unit 170 may be, for example, a movie theater seat that moves back and forth, left and right, or up and down in accordance with instructions from the vital sign reproduction instruction unit 133, thereby reproducing the vital sign data of a character in a predetermined scene of the content. The vital sign reproduction unit 170 may also express the vital sign data of a character using mist, fragrance, a strobe light, smoke, vibration, temperature, or the like. A plurality of vital sign reproduction units 170 according to the fourth embodiment may be connected to a single content reproduction device 100. When a plurality of vital sign reproduction units 170 are connected, the coincidence calculation unit 134 calculates, for example, the degree of coincidence between the vital sign data of each of the plurality of people wearing the vital sign reproduction unit 170 and the vital sign data of the character.

[0083] This allows vital data of a user viewing content to be acquired, and vital data of characters in a specific scene in the content to be represented by the seats in the movie theater. This increases the sense of immersion in the movie in the movie theater. Therefore, it is possible to provide a content playback device 100 that can give a user a sense of unity by presenting the user with vital data of the characters in the content they are viewing.

[0084] (Configuration of Content Reproduction Device) (Fifth Embodiment of Content Reproduction Device) Next, a fifth embodiment of a content reproduction device 100 according to the present disclosure will be described with reference to FIG. 12. FIG. 12 is a diagram showing an example configuration of the fifth embodiment of a content reproduction device according to the present disclosure. As shown in FIG. 12, the fifth embodiment of the content reproduction device 100 according to the present disclosure includes a communication unit 110, a storage unit 120, a control unit 130, a vital sensor unit 140, a sound output unit 150, and a display unit 160.

[0085] The fifth embodiment of the content playback device 100 is the same as the first embodiment of the content playback device 100 except that the content playback unit 131 and the vital sign playback instruction unit 133 are removed from the control unit 130 and the vital sign playback unit 170 is removed. Therefore, among the configurations of the fifth embodiment of the content playback device 100, a description of the same configurations as the first embodiment of the content playback device 100 will be omitted, and only the configurations that are different from the configuration of the first embodiment of the content playback device 100 will be described.

[0086] The coincidence calculation unit 134 of the content playback device 100 according to the fifth embodiment calculates the coincidence between the vital data of the characters and the vital data of the user viewing the content, as in the first embodiment of the content playback device 100. However, since the fifth embodiment of the content playback device 100 does not include the content playback unit 131, the user U does not know the vital data of the characters.

[0087] This makes it possible to acquire vital data of a user viewing content, calculate the degree of coincidence with the vital data of a character, and output the result to the outside. Therefore, it is possible to provide a content playback device 100 that can contribute to a sense of unity by outputting the result of comparing the user's vital data with the vital data of a character in the content being viewed by the user.

[0088] (Configuration and Effects) The content playback device 100 according to the present disclosure includes a content playback unit 131 that plays content that is information expressed by at least one of images, sounds, and text information, a vital data acquisition unit 132 that acquires vital data of a user watching the content, a coincidence calculation unit 134 that identifies a scene of the content that the user is watching and calculates the degree of coincidence between the vital data of characters in the content and the vital data of the user watching the content, and a coincidence output unit 135 that outputs the calculated degree of coincidence.

[0089] According to this configuration, it is possible to acquire vital data of a user viewing content, calculate the degree of coincidence with the vital data of a character in the content, and output the calculated degree of coincidence. Therefore, it is possible to provide a content playback device 100 that can give a user a sense of unity by presenting the user with the vital data of the character in the content that the user is viewing.

[0090] The content playback device 100 according to the present disclosure further includes a vital data playback instruction unit 133 that identifies a scene of the content being viewed by the user and instructs playback of vital data of the characters in the identified scene.

[0091] With this configuration, it is possible to identify a scene in the content that the user is viewing and to instruct playback of vital data of the characters in the identified scene. Therefore, it is possible to provide content playback device 100 that can give the user a sense of unity by presenting the user with vital data of the characters in the content that the user is viewing.

[0092] The vital sign playback instruction unit 133 of the content playback device 100 according to the present disclosure corrects the vital sign data of the character based on the degree of coincidence and the vital sign data of the user, and instructs playback of the vital sign data of the character.

[0093] According to this configuration, it is possible to reproduce vital data of a character that has been corrected to be closer to the vital data of the user. Therefore, it is possible to enhance a sense of unity between the user and the character, while taking into consideration the user's condition indicated by the user's vital data. Therefore, it is possible to provide a content reproduction device 100 that can give a user a sense of unity by presenting the user with vital data of the character in the content that the user is viewing.

[0094] The vital sign reproduction instruction unit 133 of the content reproduction device 100 according to the present disclosure instructs the vital sign reproduction unit 170, which is a vibration device that outputs vibration, to reproduce vital sign data as vibration.

[0095] According to this configuration, the vital data of the characters can be presented to the user by the vibration device. Therefore, the state of the character's heartbeat (such as the speed or slowness of the pulse, strength, etc.) can be appropriately expressed by vibration. Therefore, it is possible to provide a content playback device 100 that can give the user a sense of unity by presenting the user with the vital data of the characters in the content that the user is viewing.

[0096] The content playback device 100 according to the present disclosure further includes a branch destination determination unit 136 that determines a branch destination of the content based on the degree of coincidence.

[0097] According to this configuration, it is possible to determine the branch destination of the content based on the degree of coincidence and provide the branch destination content. Therefore, it is possible to provide content playback device 100 that can provide content that branches based on the degree of coincidence, while giving the user a sense of unity by presenting the user with vital data of the characters in the content that the user is viewing.

[0098] The content playback method according to the present disclosure includes the steps of playing content, which is information expressed by at least one of images, audio, and text information; acquiring vital data of a user viewing the content; calculating a degree of match between the vital data of a character in the content and the vital data of the user viewing the content; and outputting the calculated degree of match.

[0099] According to this configuration, it is possible to obtain vital data of a user viewing content, calculate the degree of coincidence with the vital data of a character in the content, and output the calculated degree of coincidence. Therefore, it is possible to provide a content playback method that can give a user a sense of unity by presenting the user with the vital data of the character in the content that the user is viewing.

[0100] Although the embodiments of the present disclosure have been described above, the embodiments are not limited to the contents of these embodiments. Furthermore, the above-described components include those that can be easily imagined by a person skilled in the art, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-described components can be combined as appropriate. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the spirit of the above-described embodiments.

[0101] The content playback device and content playback method of this embodiment can be used, for example, as a content playback device and content playback method that can give a user a sense of unity by presenting the user with vital data of the characters in the content that the user is watching.

[0102] 1 Content reproduction system 100 Content reproduction device 110 Communication unit 120 Storage unit 121 First content storage unit 122 Second content storage unit 130 Control unit 131 Content reproduction unit 132 Vital data acquisition unit 133 Vital reproduction instruction unit 134 Matching degree calculation unit 135 Matching degree output unit 136 Branch destination determination unit 140 Vital sensor unit 150 Sound output unit 160 Display unit 170 Vital reproduction unit 200 Server device 210 Communication unit 220 Storage unit 221 Content storage unit 230 Control unit 231 Reception unit 232 Provision unit N Network

Claims

1. A content playback device comprising: a content playback unit that plays content, which is information expressed by at least one of images, sounds, and text information; a vital data acquisition unit that acquires vital data of a user viewing the content; a similarity calculation unit that calculates a degree of similarity between the vital data of a character in the content and the vital data of the user viewing the content; and a similarity output unit that outputs the calculated degree of similarity.

2. The content playback device according to claim 1, further comprising: a vital data playback instruction unit that identifies a scene of the content being viewed by the user and instructs playback of vital data of the characters in the identified scene.

3. The content playback device according to claim 2, wherein the vital sign playback instruction unit corrects the character's vital sign data based on the degree of coincidence and the user's vital sign data, and instructs playback of the character's vital sign data.

4. The content playback device according to claim 2 or 3, wherein the vital sign playback instruction unit instructs a vital sign playback unit that is a vibration device that outputs vibrations to play back the vital sign data as vibrations.

5. The content playback device according to claim 1 or 2, further comprising: a branch destination determination unit that determines a branch destination of the content based on the degree of coincidence.

6. A content playback method comprising the steps of: playing content, the content being information expressed by at least one of image, audio, and text information; acquiring vital data of a user viewing the content; calculating a degree of match between vital data of characters in the content and vital data of the user viewing the content; and outputting the calculated degree of match.

Citation Information

Patent Citations

  • Transmission apparatus and reception apparatus

    JP2005150795A

  • Information acquisition system, information acquisition method, and computer program

    JP2017127002A

  • System and Method for Determining a State of a User

    US20210005224A1