Content reproducing apparatus and content reproducing method
The content playback device and method synchronize user vital data with character data to enable dynamic branching and enhanced immersion by correlating user biometrics with character states, addressing the limitations of existing playback technologies.
Patent Information
- Application Number
- JP2023082990
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-05-19
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2043-05-19
AI Technical Summary
Existing content playback methods, such as those described in Patent Document 1, do not effectively utilize user vital data to enhance the playback experience by correlating user data with character data for dynamic content branching and immersion.
A content playback device and method that captures user vital data, compares it with character data, and uses this correlation to determine content branching and reproduce relevant character vital data, enhancing the playback experience through synchronized user-character interaction.
Enables dynamic content branching and improved user immersion by aligning user vital data with character data, providing a more engaging and personalized playback experience.
Smart Images

Figure 2024166700000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to a content playback device and a content playback method. [Background technology]
[0002] More and more users are enjoying content such as e-books, movies, and TV dramas. If content can be given value that allows users to have new experiences, it is believed that the enjoyment of the content will be amplified.
[0003] For example, the following Patent Document 1 discloses a manga data display method that controls the page turning speed in an electronic book depending on the importance considered by the author of the novel or manga. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 6469875 Summary of the Invention [Problem to be solved by the invention]
[0005] However, the manga data display method described in Patent Document 1 above did not have a mechanism for playing back related data accompanying any scene in a book on any device, and it was not possible to provide feedback to the reader while they were reading and utilize related data.
[0006] In consideration of the above problems, the present disclosure aims to provide a content playback device and a content playback method that are capable of appropriate content branching by comparing a user's vital data with the vital data of characters in the content the user is watching. [Means for solving the problem]
[0007] In order to solve the above-mentioned problems and achieve the objective, the content playback device of the present disclosure includes a content playback unit that plays content, which is information expressed by at least one of images, audio, and text information, a vital data acquisition unit that acquires vital data of a user watching the content, a coincidence calculation unit that calculates the degree of coincidence between vital data of characters in the content and the vital data of the user watching the content, and a branch destination determination unit that determines a branch destination of the content based on the calculated degree of coincidence.
[0008] In order to solve the above-mentioned problems and achieve the objective, the content playback method of the present disclosure includes the steps of playing content, which is information expressed by at least one of images, audio, and text information, acquiring vital data of a user watching the content, calculating a degree of similarity between vital data of characters in the content and vital data of the user watching the content, and determining a branch destination of the content based on the calculated degree of similarity. Effect of the Invention
[0009] According to the present disclosure, it is possible to provide a content playback device and a content playback method that can appropriately branch content by comparing a user's vital data with the vital data of characters in the content the user is watching. [Brief description of the drawings]
[0010] [Figure 1] FIG. 1 is a diagram illustrating an overview of a content playback device according to the present disclosure. [Diagram 2] FIG. 2 is a diagram illustrating a configuration example of a content playback system according to the present disclosure. [Diagram 3] FIG. 3 is a diagram showing an example of the configuration of a first embodiment of a content playback device according to the present disclosure. [Figure 4]FIG. 4 is a diagram illustrating an example of information stored in the first content storage unit of the content reproduction device according to the present disclosure. [Diagram 5] FIG. 5 is a diagram illustrating a configuration example of a server device according to the present disclosure. [Figure 6] FIG. 6 is a flowchart showing the flow of a first embodiment of a content playing method according to the present disclosure. [Figure 7] FIG. 7 is a diagram showing a configuration example of a second embodiment of a content playback device according to the present disclosure. [Figure 8] FIG. 8 is a diagram illustrating an example of information stored in the second content storage unit of the content reproduction device according to the present disclosure. [Figure 9] FIG. 9 is a flowchart showing the flow of the second embodiment of the content playing method according to the present disclosure. [Figure 10] FIG. 10 is a diagram illustrating a configuration example of a third embodiment of a content playback device according to the present disclosure. [Figure 11] FIG. 11 is a diagram illustrating a configuration example of a fourth embodiment of a content playback device according to the present disclosure. [Figure 12] FIG. 12 is a diagram illustrating a configuration example of a content playback device according to the fifth embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiment described below.
[0012] (Overview of content playback device) First, an overview of a content playback device 100 according to the present disclosure will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining the overview of a content playback device according to the present disclosure. As shown in Fig. 1, the content playback device 100 according to the present disclosure is an information processing device that plays back content and plays back vital data of characters in a predetermined scene of the content.
[0013] 1, vital data of the user U is measured by a vital sensor unit 140 worn on the head of the user U, and vital data of a character in a predetermined scene of the content is reproduced by a vital reproduction unit 170. Note that the position of the vital sensor unit 140 is not limited to the user U's head.
[0014] It should be noted that the aspect of the content playback device 100 shown in FIG. 1 is merely an example, and the aspect of the content playback device 100 according to the present disclosure is not limited to the aspect shown in FIG.
[0015] (Configuration of content playback system) Next, the configuration of the content reproduction system 1 according to the present disclosure will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the content reproduction system according to the present disclosure.
[0016] As shown in Fig. 2, the content reproduction system 1 includes a content reproduction device 100 (100A, 100B), a server device 200, and a network N. Note that, as shown in Fig. 2, the content reproduction system 1 may be configured by two or more content reproduction devices 100. The following briefly describes these components.
[0017] The content playback device 100 is an information processing device that plays back content. The content playback device 100 may be, for example, an information processing device such as a smartphone, a tablet terminal, a desktop PC (Personal Computer), a notebook PC, a mobile phone, or a PDA (Personal Digital Assistant). The outline of the content playback device 100 has been described above, so the description here will be limited to this extent.
[0018] The server device 200 is an information processing device that provides various types of information. The server device 200 provides content to, for example, the content playback device 100. The server device 200 may be realized by, for example, an information processing device such as a PC, a WS (Work Station), or a computer having a server function.
[0019] The network N connects the content playback device 100 and the server device 200 wirelessly or wired so that they can communicate with each other. The network N may be realized by a wireless LAN (Local Area Network) defined in IEEE802.11, a fourth generation mobile communication system (4G), a fifth generation mobile communication system (5G), or the like.
[0020] The content reproduction system 1 functions as a single system by transmitting and receiving information between the content reproduction device 100 and the server device 200 via a network N.
[0021] (Configuration of the content playback device) (First embodiment of the content playback device) Next, a first embodiment of a content playback device 100 according to the present disclosure will be described with reference to Fig. 3. Fig. 3 is a diagram showing a configuration example of the first embodiment of a content playback device according to the present disclosure. As shown in Fig. 3, the first embodiment of the content playback device 100 according to the present disclosure includes a communication unit 110, a storage unit 120, a control unit 130, a vital sensor unit 140, a sound output unit 150, a display unit 160, and a vital playback unit 170. Below, these configurations will be described in order.
[0022] The communication unit 110 connects the inside and outside of the content playback device 100 so that they can communicate with each other, and transmits and receives information between the inside and outside of the content playback device 100. The communication unit 110 may be realized by, for example, a wireless LAN (Local Area Network) card, a Wi-Fi (registered trademark) module, a Bluetooth (registered trademark) module, an antenna, etc. The communication unit 110 may be wirelessly connected to, for example, a network N, and transmit and receive information between the communication unit 110 and the server device 200.
[0023] The storage unit 120 is a storage device that stores various types of information. The storage unit 120 includes a main storage device and an auxiliary storage device. The main storage device may be realized by a semiconductor memory element such as a random access memory (RAM), a read only memory (ROM), or a flash memory. The auxiliary storage device may be realized by a hard disk, a solid state drive (SSD), an optical disk, or the like.
[0024] As shown in FIG. 3, the storage unit 120 includes a first content storage unit 121.
[0025] The first content storage unit 121 stores information related to content. An example of information stored in the first content storage unit 121 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of information stored in the first content storage unit of the content playback device according to the present disclosure.
[0026] In the example shown in FIG. 4, the first content storage unit 121 stores information relating to the items "content ID", "content", "scene ID", "scene position", and "vital data" in association with each other.
[0027] A "content ID" is an identifier that identifies a content, and is represented by a character string or a number. A "content" is data of the content identified by a "content ID", and may be, for example, data of a book, a movie, a drama, a concert video, music, etc. Here, books include, but are not limited to, electronic books. In other words, "content" refers to information expressed by at least one of images, sounds, and text information.
[0028] A "scene ID" is an identifier that identifies a scene, or in other words, a situation, of the content identified by the "content ID," and is expressed by a character string or a number, etc. A "scene position" indicates the position of a scene identified by a "scene ID" in the content identified by the "content ID," and may be expressed, for example, as a percentage of the overall length of the content. If the content is video information such as a movie or drama, the "scene position" indicates the playback time. If the content is text information such as a book, the "scene position" indicates the page number and the number of lines.
[0029] "Vital data" is data relating to the biological condition (also called vital signs that indicate a human being is alive, such as pulse, blood pressure, and body temperature) of a character in a scene identified by a "scene ID" of content identified by a "content ID", and vital data playback unit 170 expresses the biological condition of the character based on this. Specifically, when the "vital data" is a pulse, the vital data includes information on the pulse rate, etc. The vital data may include information on the number of times the vital data is played back during the corresponding scene. "Vital data" also includes information that vital data is not played back, i.e., there is no vital data.
[0030] That is, FIG. 4 shows an example in which data of content identified by content ID "CTID#1" is stored as "CT#1", the scene position of a scene identified by scene ID "SCID#1" of the content is "SCPS#1-1", and vital data for causing the vital reproduction unit 170 to express the biological state of a character in the scene is stored as "VTDT#1-1".
[0031] In addition, the first content storage unit 121 is not limited to information relating to the items "content ID," "content," "scene ID," "scene position," and "vital data," and may store information relating to any other content.
[0032] The control unit 130 is a controller that manages and controls the content playback device 100. The control unit 130 is realized by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like executing various programs stored in the storage unit 120 using a RAM as a working area. The control unit 130 may also be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).
[0033] As shown in FIG. 3, control unit 130 includes content playback unit 131, vital data acquisition unit 132, vital playback instruction unit 133, coincidence calculation unit 134, and coincidence output unit 135. Control unit 130 realizes these functions and executes these processes by reading and executing a program (software) from storage unit 120. Note that these configurations of control unit 130 may be realized by electronic circuits. Control unit 130 may execute these processes by one CPU, or may include multiple CPUs and execute these processes in parallel by the multiple CPUs. Below, these configurations will be explained in order.
[0034] The content playback unit 131 plays back content including at least one of an e-book, a movie, and a drama. The content playback unit 131 reads out content from the first content storage unit 121 and plays back the read out content. For example, the content playback unit 131 may play back content by causing the sound output unit 150 to output the sound of the content and causing the display unit 160 to display the video of the content. If the content is video information, the content playback unit 131 transmits current playback time information to the vital playback instruction unit 133. If the content is an e-book, the content playback unit 131 transmits current playback page information to the vital playback instruction unit 133.
[0035] The vital data acquisition unit 132 acquires vital data of a user who is viewing content. In the following description, viewing content includes not only viewing video information such as a movie, but also reading text information such as a book. The vital data acquisition unit 132 may acquire, for example, as vital data, the user's electrooculography measured by the electrooculography sensor of the vital sensor unit 140, the direction of the user's gaze measured by the gaze detection camera, the user's electrodermal activity state measured by the electrodermal activity sensor, the pulse wave signal measured by the pulse wave sensor, the respiratory rate calculated from the pulse wave signal, and the brain wave measured by the electroencephalograph. Details of the vital sensor unit 140 will be described later.
[0036] The vital sign reproduction instruction unit 133 specifies a scene of the content the user is viewing, and instructs the reproduction of vital sign data of the characters in the specified scene. For example, when the content is video information, the vital sign reproduction instruction unit 133 specifies that the current playback time acquired from the content playback unit 131 is the scene the user is viewing. For example, when the content is an electronic book, the vital sign reproduction instruction unit 133 specifies that the current playback page number acquired from the content playback unit 131 is the page the user is viewing, and specifies the scene the user is viewing by estimating the line the user is viewing based on the user's line of sight acquired from the vital sign sensor unit 140, for example. The vital sign reproduction instruction unit 133 instructs the vital sign reproduction unit 170 to reproduce the vital sign data of the characters in the specified scene. As described above, the first content storage unit 121 stores vital sign data of the characters for each scene for the content. Therefore, when the content being played back by the content playback unit 131 approaches a specified scene, the vital data playback instruction unit 133 reads out the vital data of the characters in the specified scene of the content being played back from the first content storage unit 121, and instructs the vital data playback unit 170 to play back the vital data.
[0037] In the information on the content shown in Fig. 4, the vital data to be reproduced in each scene corresponds to one character, but this is not limited to this. The information on the content may include vital data corresponding to each of multiple characters for one scene ID. For example, when the content is video information, the vital reproduction instruction unit 133 may identify a character that the user is gazing at based on the user's line of sight acquired from the vital sensor unit 140 or the like, and instruct the reproduction of the vital data corresponding to the identified character.
[0038] Here, when the content is an electronic book, in order to identify the number of lines that is the scene that the user is viewing, it is necessary to make an inference from the user's line of sight, etc. Depending on the configuration of the vital sensor unit 140, there may be cases where the user's line of sight cannot be detected. Therefore, a "priority" column consisting of information on whether or not there is a line of sight may be added to the information on the content shown in Fig. 4, and vital data may be reproduced if there is information on the priority of the corresponding scene ID even if the line of sight cannot be detected.
[0039] The vital sign reproduction instruction unit 133 corrects the vital sign data of the character based on the degree of coincidence and the vital sign data of the user, and then instructs the vital sign reproduction unit 170 to reproduce the data. Specifically, for example, the vital sign reproduction instruction unit 133 instructs reproduction of the vital sign data of the character in which the vital sign data of the character is corrected in a direction approaching the vital sign data of the user based on the degree of coincidence. For example, it is assumed that the degree of coincidence calculated by the degree of coincidence calculation unit 134 described later is 80%. In this case, the vital sign reproduction instruction unit 133 instructs reproduction of the vital sign data of the character in which the vital sign data of the character is corrected in a direction approaching the vital sign data of the user by a distance of 20%. In other words, the vital sign reproduction instruction unit 133 corrects the 20% of the vital sign data of the character that does not match the vital sign data of the user so as to match the vital sign data of the user. Specifically, the vital sign reproduction instruction unit 133 may instruct reproduction of the vital sign data multiplied by a coefficient that corrects the vital sign data of the character in a direction approaching the vital sign data of the user by a distance of 20%.
[0040] The vital sign reproduction instruction unit 133 instructs the vital sign reproduction unit 170, which is a vibration device that outputs vibration, to reproduce the vital sign data as vibration. In this case, the vital sign reproduction unit 170 drives the vibration device based on the vital sign data stored in the first content storage unit 121 so as to express, for example, the state of the character's heartbeat (such as speed, strength, and weakness of the pulse) by vibration. This allows the user to experience the excitement of the character. In addition, the vital sign reproduction instruction unit 133 may drive the vibration device based on vital sign data indicating the heartbeat of a character not appearing in a scene, vital sign data expressing a hint of a story, or vital sign data in the same scene with a different interpretation of the character's feelings.
[0041] The coincidence calculation unit 134 calculates the coincidence between the vital data of the character and the vital data of the user viewing the content. For example, the coincidence calculation unit 134 may perform normalization on the vital data of the user viewing the content acquired by the vital data acquisition unit 132 and the vital data of the character in the content, and then calculate the distance between the data using a distance function such as Euclidean distance, Manhattan distance, or Chebyshev distance, to calculate the coincidence. The user's vital data may be normalized after preprocessing such as smoothing. The coincidence calculation unit 134 may calculate the coincidence from a correlation value between the vital data of the character and the vital data of the user viewing the content. Here, the vital data of the user may be acquired in advance from, for example, the vital sensor unit 140 before the content is played back, and used to calculate the coincidence. For example, the average heart rate of the user may be acquired before the content is played back, and the vital data of the user viewing the content acquired by the vital data acquisition unit 132 may be corrected based on the average heart rate, and then the coincidence is calculated.
[0042] Furthermore, the vital data reproduction instruction unit 133 may correct the vital data of the user in a direction in which it is expected to approach the vital data of the character based on the degree of coincidence, and instruct the reproduction. Specifically, the vital data reproduction instruction unit 133 may determine the direction of correction by a machine learning model. This machine learning model is configured to output in which direction the vital data of the character should be corrected in order to bring the vital data of the user and the vital data of the character closer to each other, in response to input of the vital data of the user, the vital data of the character, and the degree of coincidence. This machine learning model is trained using training data consisting of a pair of input data and correct answer data. The training data of this machine learning model is, for example, composed of input data on the direction and extent to which the vital data of each user is to be corrected in advance, and the resulting vital data as correct answer data.
[0043] The coincidence output unit 135 outputs the degree of coincidence calculated by the coincidence calculation unit 134. For example, the coincidence output unit 135 may output the degree of coincidence by causing the display unit 160 to display the calculated degree of coincidence. The coincidence output unit 135 may also output the degree of coincidence by causing the sound output unit 150 to output the calculated degree of coincidence as sound. The coincidence output unit 135 may also output the calculated degree of coincidence as data to an external device (not shown) or the like.
[0044] The vital sensor unit 140 measures the user's biometric information, in other words, vital data. The vital sensor unit 140 may be, for example, an electrooculography sensor that measures the user's electrooculography as vital data. The electrooculography sensor is a sensor that measures the potential difference occurring between the cornea side and the retina side of the eyeball. The cornea side of the human eyeball is generally positively charged and the retina side is generally negatively charged, so a potential difference occurs between the two. If an electrode is attached to a specific position on the head, for example, the skin around the eye, and the potential difference is measured, this potential difference changes depending on the movement of the eyes and blinking, so by measuring the potential difference, the movement of the eyes, i.e., the direction of the gaze, can be known.
[0045] Furthermore, the vital sensor unit 140 may be a gaze detection camera, and may measure the direction of the user's gaze as vital data. The gaze detection camera is a camera that captures the user's eyes. The gaze detection camera may include an analysis unit that performs gaze detection by image analysis of the captured image data of the user's eyes. For example, the analysis unit of the gaze detection camera may detect the gaze direction from the positional relationship with a moving point (outer edge of the iris) from the captured image data of the user's eyes, using characteristic parts of the face or eyes (for example, the inner corner or outer corner of the eye) as a reference.
[0046] Furthermore, the vital sensor unit 140 may be an electrodermal activity (EDA) sensor that detects the state of electrical activity of the skin as vital data of the user. The electrodermal activity sensor measures the state of electrical activity of the skin due to sweat secreted from sweat glands (e.g., eccrine glands) in the skin. Electrodermal activity is broadly classified into skin potential and skin conductance. Skin potential is classified into skin potential level and skin potential reflex. Skin potential level is a direct current component of skin potential, and shows a high negative value when the level of arousal is high, and shows a positive value when the user feels drowsy or is in a relaxed state. Skin potential reflex is an alternating current component of skin potential, and skin potential reflex occurs frequently when pain, touch, hearing, vision, or other stimuli occur, or when the user takes a deep breath, moves the body, or does mental arithmetic or thinks.
[0047] Furthermore, the vital sensor unit 140 may be a pulse wave sensor that detects a pulse wave signal as vital data of the user. The pulse wave sensor is a sensor that captures, as a waveform, the change in volume of blood vessels that occurs as the heart pumps blood. The pulse wave sensor irradiates the living body with infrared light, red light, or light with a green wavelength of about 550 nm, and measures the light reflected from within the living body using a photodiode or phototransistor. Oxygenated hemoglobin is present in the blood of the arteries and has the property of absorbing incident light, so that a pulse wave signal can be obtained by measuring the blood volume (change in blood vessel volume) that changes with the pulsation of the heart in a time series.
[0048] The vital sensor unit 140 may also be an electroencephalograph (EEG) that measures brain waves as vital data of the user. The electroencephalograph places electrodes that derive bioactive potentials (around 20 μV) generated by activity of nerve cells in the brain on the scalp, amplifies the signals received by the electrodes, and measures the bioactive potentials (brain waves) of nerve cells in the brain. For example, the electroencephalograph may be realized by a type that reduces the contact resistance between the electrodes and the scalp by placing a conductive gel between the scalp and the electrodes, a type that places a sponge between the scalp and the electrodes and impregnates the sponge with an electrolyte, or a type that has an amplifier built in close proximity to the electrodes, receives electrical signals with high input impedance, and outputs them with low output impedance.
[0049] The sound output unit 150 outputs sound according to a control command. The sound output unit 150 may be a speaker, and the speaker converts an electric signal into sound using a diaphragm. That is, the speaker vibrates the diaphragm with a predetermined amplitude and frequency based on a control command given by an electric signal, thereby vibrating the air in contact with the diaphragm to output sound. The sound output unit 150 may output, for example, the sound of the content that the content playback unit 131 causes to be displayed on the display unit 160.
[0050] The display unit 160 displays various information to the user. For example, the display unit 160 displays a video of the content based on an instruction from the content playback unit 131. The display unit 160 may be realized by, for example, a liquid crystal display, an organic EL (Electro Luminescence) display, a micro LED (Light Emitting Diode) display, or the like.
[0051] The vital sign reproducing unit 170 reproduces vital sign data of a character in a predetermined scene of the content being viewed by the user. The vital sign reproducing unit 170 may be realized by, for example, a display device, an audio output device, a vibration device, a heat source unit, an aroma unit, and the like. The display device is realized by a liquid crystal display or the like, like the display unit 160, and expresses the biological state indicated by the vital sign data of the character by video. The audio output device is a speaker, like the audio output unit, and expresses the biological state indicated by the vital sign data of the character by audio. The vibration device generates vibrations by a motor with an eccentric rotor or an actuator using the inverse piezoelectric effect of a piezoelectric element, and expresses the biological state indicated by the vital sign data of the character. The heat source unit is equipped with a Peltier element or the like, and generates heat by electricity to express the body temperature of the character indicated by the vital sign data. The aroma unit also expresses the biological state indicated by the vital sign data of the character in a predetermined scene of the content by smell, by discharging an aromatic agent.
[0052] (Server device configuration) Next, the configuration of the server device according to the present disclosure will be described with reference to Fig. 5. Fig. 5 is a diagram showing an example of the configuration of the server device according to the present disclosure. As shown in Fig. 5, the server device 200 according to the present disclosure includes a communication unit 210, a storage unit 220, and a control unit 230.
[0053] The communication unit 210 is realized by, for example, a network interface card (NIC), a wireless LAN card, etc. The communication unit 210 is connected to a network N by wire or wirelessly, and transmits and receives various information to and from the content reproduction device 100 via the network N.
[0054] The storage unit 220 is a storage device that stores various types of information. The storage unit 220 includes a main storage device and an auxiliary storage device. The main storage device may be realized by a semiconductor memory element such as a RAM, a ROM, or a flash memory. The auxiliary storage device may be realized by a hard disk, an SSD, an optical disk, or the like.
[0055] As shown in FIG. 5, the storage unit 220 includes a content storage unit 221.
[0056] The information stored in the content storage unit 221 is the same as the information stored in the second content storage unit 122 of the content playback device 100, and therefore a description thereof will be omitted. However, the number of contents stored in each of the content storage unit 221 and the second content storage unit 122 may be different.
[0057] The control unit 230 is realized, for example, by a CPU, an MPU, or the like executing various programs stored in the server device 200 using a RAM as a working area. The control unit 230 may also be realized, for example, by an integrated circuit such as an ASIC or an FPGA.
[0058] As shown in FIG. 5, the control unit 230 includes a receiving unit 231 and a providing unit 232.
[0059] The reception unit 231 receives a content provision request. For example, the reception unit 231 may display a content reception screen including an input screen for inputting the type of content, the name of the content, the capacity of the content, and the like, desired by the user U of the content reproduction device 100, on the display unit 160 of the content reproduction device 100, to receive the content provision request from the user.
[0060] The providing unit 232 provides content based on the content provision request. For example, the providing unit 232 reads out content that matches the content provision request from the content storage unit 221, and provides the read out content to the content playback device 100 that has issued the content provision request.
[0061] (How to play content) (First embodiment of content playback method) Next, a first embodiment of a content playback method according to the present disclosure will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of the first embodiment of the content playback method according to the present disclosure. The first embodiment of the content playback method according to the present disclosure will be described along the flow shown in Fig. 6.
[0062] First, the content playback device 100 plays back the content (step S101). Next, the content playback device 100 acquires vital data of the user when viewing the content (step S102). Next, the content playback device 100 outputs vital data of the characters in a predetermined scene of the content (step S103). Next, the content playback device 100 calculates the degree of match between the vital data of the characters and the vital data of the user (step S104). After the process of step S103, before the process of step S104, the content playback device 100 may wait for a certain period of time, such as one minute, to elapse before calculating the degree of match. Next, the content playback device 100 outputs the calculated degree of match (step S105).
[0063] According to this, it is possible to obtain vital data of a user who is viewing content, calculate the degree of coincidence with the vital data of the characters in the content, and output the calculated degree of coincidence. Therefore, it is possible to provide a content playback method that can give a user a sense of unity by presenting the user with the vital data of the characters in the content that the user is viewing.
[0064] (Configuration of the content playback device) (Second embodiment of the content playback device) Next, a second embodiment of the content playback device 100 according to the present disclosure will be described with reference to Fig. 7. Fig. 7 is a diagram showing a configuration example of the second embodiment of the content playback device according to the present disclosure. As shown in Fig. 7, the second embodiment of the content playback device 100 according to the present disclosure includes a communication unit 110, a storage unit 120, a control unit 130, a vital sensor unit 140, a sound output unit 150, a display unit 160, and a vital playback unit 170.
[0065] The configuration of the second embodiment of the content playback device 100 is the same as that of the first embodiment of the content playback device 100, except for the storage unit 120 and the control unit 130. Therefore, the description of the configuration of the second embodiment of the content playback device 100 that is the same as that of the first embodiment of the content playback device 100 will be omitted, and only the second content storage unit 122 of the storage unit 120 and the control unit 130, which are different from those of the first embodiment of the content playback device 100, will be described.
[0066] As shown in FIG. 7, the storage unit 120 includes a second content storage unit 122.
[0067] The second content storage unit 122 stores information related to content. An example of information stored in the second content storage unit 122 will be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of information stored in the second content storage unit of the content playback device according to the present disclosure.
[0068] 8, the second content storage unit 122 stores information related to the items of "content ID", "content", "scene ID", "scene position", "vital data", "presence or absence of branching", "post-branching content", and "degree of agreement" in association with each other. Note that information other than "presence or absence of branching", "post-branching content", and "degree of agreement" is the same as the information stored in the second content storage unit 122. Therefore, of the items stored in the second content storage unit 122, the items "presence or absence of branching", "post-branching content", and "degree of agreement" will be described below.
[0069] "Branch presence / absence" is information indicating whether or not the content branches in a scene identified by the "scene ID" of the content, and is represented, for example, by "yes" or "no." "Post-branch content" is data on the content after branching when there is content branching in a scene identified by the "scene ID" of the content identified by the "content ID." "Match level" indicates the range or threshold of match level between the vital data of the user and the vital data of the characters in the content when deciding to play the "post-branch content" as the post-branch content.
[0070] That is, Figure 8 shows an example in which the content data of a content identified by a content ID "CTID#1" is stored as "CT#1", the scene position of a scene identified by a scene ID "SCID#1" of the content in question is "SCPS#1-1", vital data for displaying the biological state of a character in the scene in question by vital playback unit 170 is stored as "VTDT#1-1", the presence or absence of branching in the scene in question is "yes", and the post-branching content in the scene in question is stored as "BRCT#1-1-1" and "BRCT#1-1-2".
[0071] In addition, the second content storage unit 122 is not limited to information relating to the items "content ID," "content," "scene ID," "scene position," "vital data," "presence or absence of branching," "content after branching," and "degree of similarity," and may store information relating to any other content.
[0072] As shown in Fig. 7, the control unit 130 includes a content reproduction unit 131, a vital data acquisition unit 132, a vital reproduction instruction unit 133, a coincidence calculation unit 134, and a branch destination determination unit 136. The configuration of the control unit 130 of the second embodiment of the content reproduction device 100 is the same as that of the control unit 130 of the first embodiment of the content reproduction device 100, except that the coincidence output unit 135 is removed and the branch destination determination unit 136 is added. Therefore, the description of the configuration of the control unit 130 of the second embodiment of the content reproduction device 100 that is the same as that of the control unit 130 of the first embodiment of the content reproduction device 100 will be omitted, and only the branch destination determination unit 136, which is a different configuration from that of the control unit 130 of the first embodiment of the content reproduction device 100, will be described.
[0073] The branch destination determination unit 136 determines the branch destination of the content based on the calculated degree of coincidence. As described above, the second content storage unit 122 of the storage unit 120 of the second embodiment of the content playback device 100 stores the "degree of coincidence" in association with the "post-branch content". When the content to be played back by the content playback unit 131 reaches a scene in which the content branches, the branch destination determination unit 136 refers to the degree of coincidence calculated by the degree of coincidence calculation unit 134 and determines the post-branch content corresponding to the degree of coincidence as the branch destination of the content. After determining the branch destination of the content, the branch destination determination unit 136 instructs the content playback unit 131 to play the post-branch content.
[0074] (How to play content) (Second embodiment of content playback method) Next, a second embodiment of the content reproducing method according to the present disclosure will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the flow of the second embodiment of the content reproducing method according to the present disclosure. The second embodiment of the content reproducing method according to the present disclosure will be described along the flow shown in Fig. 9.
[0075] First, the content playback device 100 plays back the content (step S201). Next, the content playback device 100 acquires vital data of the user at the time of viewing the content (step S202). Next, the content playback device 100 outputs vital data of the characters in a predetermined scene of the content (step S203). Next, the content playback device 100 calculates the degree of coincidence between the vital data of the characters and the vital data of the user (step S204). Next, the content playback device 100 determines a branch destination of the content based on the degree of coincidence (step S205). Next, the content playback device 100 plays back the content of the determined branch destination (step S206).
[0076] According to this, it is possible to obtain vital data of a user who is viewing content, calculate the degree of match with the vital data of a character in the content, determine the branch destination of the content based on the calculated degree of match, and play the content after the branch. Therefore, it is possible to provide a content playback method that can perform appropriate content branching by comparing the vital data of the user with the vital data of the character.
[0077] (Configuration of the content playback device) (Third embodiment of the content playback device) Next, a third embodiment of the content playback device 100 according to the present disclosure will be described with reference to Fig. 10. Fig. 10 is a diagram showing a configuration example of the third embodiment of the content playback device according to the present disclosure. As shown in Fig. 10, the third embodiment of the content playback device 100 according to the present disclosure includes a communication unit 110, a storage unit 120, a control unit 130, a vital sensor unit 140, a sound output unit 150, and a display unit 160.
[0078] The third embodiment of the content playback device 100 is the same as the first embodiment of the content playback device 100, except that the vital sign playback instruction unit 133 of the control unit 130 and the vital sign playback unit 170 are omitted from the first embodiment of the content playback device 100. Therefore, a description of the configuration of the third embodiment of the content playback device 100 will be omitted.
[0079] According to the third embodiment of the content playback device 100, it is possible to acquire vital data of a user who watches a content, calculate the degree of coincidence with the vital data of a character in the content, and output the calculated degree of coincidence with a simple configuration. Therefore, it is possible to detect the sense of unity and immersion of the user who watches the content with the character in the content based on the degree of coincidence.
[0080] (Configuration of the content playback device) (Fourth embodiment of the content playback device) Next, a fourth embodiment of the content playback device 100 according to the present disclosure will be described with reference to Fig. 11. Fig. 11 is a diagram showing a configuration example of the fourth embodiment of the content playback device according to the present disclosure. As shown in Fig. 11, the fourth embodiment of the content playback device 100 according to the present disclosure includes a communication unit 110, a storage unit 120, a control unit 130, and a vital sensor unit 140.
[0081] The fourth embodiment of the content playback device 100 is the same as the first embodiment of the content playback device 100, except that the first content storage unit 121 is removed from the storage unit 120, the content playback unit 131, the vital sign playback instruction unit 133, the sound output unit 150, and the display unit 160 are removed from the control unit 130, and the vital sign playback unit 170 is provided outside the content playback device 100. Therefore, among the configurations of the fourth embodiment of the content playback device 100, a description of the same configuration as the first embodiment of the content playback device 100 will be omitted, and only the vital sign playback unit 170, which is a different configuration from the first embodiment of the content playback device 100, will be described.
[0082] The vital sign reproducing unit 170 according to the fourth embodiment of the content reproducing device 100 is provided outside the content reproducing device 100, and is equipped with a Wi-Fi module, Bluetooth, etc., and is connected to the communication unit 110 so as to be able to communicate with each other wirelessly. The vital sign reproducing unit 170 may be, for example, a seat in a movie theater, and may reproduce the vital sign data of a character in a predetermined scene of the content by moving forward, backward, left, right, or up and down according to an instruction from the vital sign reproducing instruction unit 133. The vital sign reproducing unit 170 may also express the vital sign data of a character by mist, fragrance, strobe, smoke, vibration, temperature, etc. A plurality of vital sign reproducing units 170 according to the fourth embodiment may be connected to one content reproducing device 100. When a plurality of vital sign reproducing units 170 are connected, the coincidence calculation unit 134 calculates, for example, the coincidence between the vital sign data of each of the plurality of people wearing the vital sign reproducing unit 170 and the vital sign data of the character.
[0083] According to this, vital data of a user who is watching a content can be acquired, and vital data of a character in a specific scene of the content can be expressed by the seat of a movie theater. Therefore, the sense of immersion in a movie in a movie theater can be enhanced. Therefore, it is possible to provide a content playback device 100 that can give a sense of unity to a user by presenting vital data of a character in the content that the user is watching to the user.
[0084] (Configuration of the content playback device) (Fifth embodiment of the content playback device) Next, a fifth embodiment of the content playback device 100 according to the present disclosure will be described with reference to Fig. 12. Fig. 12 is a diagram showing a configuration example of the fifth embodiment of the content playback device according to the present disclosure. As shown in Fig. 12, the fifth embodiment of the content playback device 100 according to the present disclosure includes a communication unit 110, a storage unit 120, a control unit 130, a vital sensor unit 140, a sound output unit 150, and a display unit 160.
[0085] The fifth embodiment of the content playback device 100 is the same as the first embodiment of the content playback device 100, except that the content playback unit 131 and the vital sign playback instruction unit 133 are removed from the control unit 130 and the vital sign playback unit 170 is removed. Therefore, among the configurations of the fifth embodiment of the content playback device 100, the description of the same configurations as those of the first embodiment of the content playback device 100 will be omitted, and only the configurations different from the configuration of the first embodiment of the content playback device 100 will be described.
[0086] The coincidence calculation unit 134 of the content reproduction device 100 according to the fifth embodiment calculates the coincidence between the vital data of the characters and the vital data of the user viewing the content, as in the first embodiment of the content reproduction device 100. However, since the fifth embodiment of the content reproduction device 100 does not include the content reproduction unit 131, the user U does not know the vital data of the characters.
[0087] According to this, it is possible to obtain vital data of a user who is viewing content, calculate the degree of coincidence with the vital data of the characters, and output the result to the outside. Therefore, it is possible to provide a content playback device 100 that can contribute to a sense of unity by outputting a comparison result between the vital data of the user and the vital data of the characters in the content the user is viewing.
[0088] (Composition and Effects) The content playback device 100 according to the present disclosure includes a content playback unit 131 that plays content, which is information expressed by at least one of image, audio, and text information, a vital data acquisition unit 132 that acquires vital data of a user watching the content, a vital data playback instruction unit 133 that identifies a scene of the content being watched by the user and instructs playback of vital data of a character in the identified scene, a coincidence calculation unit 134 that calculates the degree of coincidence between the vital data of the character and the vital data of the user watching the content, and a coincidence output unit 135 that outputs the calculated degree of coincidence.
[0089] According to this configuration, it is possible to obtain vital data of a user who is viewing content, calculate the degree of coincidence with the vital data of the characters in the content, and output the calculated degree of coincidence. Therefore, it is possible to provide a content playback device 100 that can give a sense of unity to a user by presenting the vital data of the characters in the content that the user is viewing to the user.
[0090] The vital sign reproduction instruction unit 133 of the content reproduction device 100 according to the present disclosure corrects the vital sign data of the character based on the degree of coincidence and the vital sign data of the user, and instructs reproduction of the vital sign data of the character.
[0091] According to this configuration, it is possible to reproduce the vital data of the character that has been corrected to approach the vital data of the user. Therefore, it is possible to enhance the sense of unity between the user and the character while taking into consideration the state of the user indicated by the vital data of the user. Therefore, it is possible to provide a content reproduction device 100 that can give the user a sense of unity by presenting the vital data of the character in the content that the user is viewing to the user.
[0092] The vital sign reproduction instruction unit 133 of the content reproduction device 100 according to the present disclosure instructs the vital sign reproduction unit 170, which is a vibration device that outputs vibration, to reproduce the vital sign data as vibration.
[0093] According to this configuration, the vital data of the characters can be presented to the user by the vibration device. Therefore, the state of the character's heartbeat (speed, strength, etc.) can be appropriately expressed by vibration. Therefore, it is possible to provide a content reproduction device 100 that can give the user a sense of unity by presenting the vital data of the characters in the content that the user is viewing to the user.
[0094] The content playback device 100 according to the present disclosure further includes a branch destination determination unit 136 that determines a branch destination of the content based on the degree of coincidence calculated by the degree of coincidence calculation unit 134.
[0095] According to this configuration, the branch destination of the content can be determined based on the degree of coincidence, and the branch destination content can be provided. Therefore, it is possible to provide the content reproducing device 100 that can provide the content branched based on the degree of coincidence after giving the user a sense of unity by presenting the vital data of the characters in the content the user is viewing.
[0096] The content playback method according to the present disclosure includes the steps of playing content, which is information expressed by at least one of an image, an audio, and a textual information; acquiring vital data of a user watching the content; identifying a scene of the content being watched by the user and instructing playback of vital data of a character in the identified scene; calculating a degree of match between the vital data of the character and the vital data of the user watching the content; and outputting the calculated degree of match.
[0097] According to this configuration, it is possible to obtain vital data of a user who is viewing content, calculate the degree of coincidence with the vital data of the characters in the content, and output the calculated degree of coincidence. Therefore, it is possible to provide a content playback method that can give a user a sense of unity by presenting the user with the vital data of the characters in the content that the user is viewing.
[0098] Although the embodiment of the present invention has been described above, the embodiment is not limited to the contents of this embodiment. The above-mentioned components include those that a person skilled in the art can easily imagine, those that are substantially the same, and those that are within the so-called equivalent range. Furthermore, the above-mentioned components can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the components can be made without departing from the gist of the above-mentioned embodiment. [Explanation of symbols]
[0099] 1 Content playback system 100 Content playback device 110 Communications Department 120 Storage section 121 First content storage unit 122 Second content storage unit 130 Control section 131 Content Playback Department 132 Vital Data Acquisition Unit 133 Vital Signs Regeneration Indicator 134 Matching degree calculation unit 135 Matching output section 136 Branching Determination Unit 140 Vital Sensor Unit 150 Sound output section 160 Display section 170 Vital Regeneration Department 200 Server device 210 Communications Department 220 Storage section 221 Content storage unit 230 Control Unit 231 Reception 232 Provision Department N Network
Claims
1. a content playback unit that plays back content that is information expressed by at least one of image, sound, and text information; A vital data acquisition unit that acquires vital data of a user who is viewing the content; a matching degree calculation unit that calculates a degree of matching between vital data of a character in the content and vital data of a user viewing the content; a branch destination determination unit that determines a branch destination of the content based on the calculated degree of coincidence; A content playback device comprising:
2. and a vital data playback instruction unit that identifies a scene of the content being viewed by the user and instructs playback of vital data of a character in the identified scene. The content reproducing device according to claim 1 .
3. the vital sign reproduction instruction unit corrects the vital sign data of the character based on the degree of coincidence and the vital sign data of the user, and instructs to reproduce the vital sign data of the character as vibration. The content reproducing device according to claim 2 .
4. The vital sign reproduction instruction unit instructs a vital sign reproduction unit, which is a vibration device that outputs vibration, to reproduce the vital sign data.
4. The content reproducing device according to claim 2.
5. A step of reproducing content which is information expressed by at least one of image, sound, and text information; acquiring vital data of a user viewing the content; calculating a degree of coincidence between vital data of a character in the content and vital data of a user viewing the content; determining a branch destination of the content based on the calculated degree of coincidence; A content playback method comprising:
Citation Information
Patent Citations
Transmission apparatus and reception apparatus
JP2005150795A
Information acquisition system, information acquisition method, and computer program
JP2017127002A
System and Method for Determining a State of a User
US20210005224A1
Solenoid valve
JP1989069875A
