Display device, display method, program, recording medium, and subtitles generation method

Abstract

To provide a display device etc., capable of displaying subtitles with appropriate expressions according to, for example, properties of a viewing user.SOLUTION: A display device comprises: an acquisition part which acquires video data and subtitles data from a content; a generation part which generates a conversion table having words acquired from the subtitles data grouped by synonyms; a determination part which determines a conversion word among words included in the subtitles data on the basis of the conversion table on acquiring the subtitles data; a conversion part which converts the words of the subtitles data on the basis of the determined conversion word; and a display part which displays subtitles based upon the subtitles data over the video data.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a display device and the like.

Background Art

[0002] For example, as shown in Patent Document 1, there is known a technique for providing a subtitle display device having a method for dealing with a case where word data superimposed on a video signal includes words that are not understandable to viewers, words that are not suitable for education, and copyright information.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] One object of the present disclosure is to provide, for example, a display device or the like capable of displaying subtitles in an appropriate expression according to a user who views them.

Means for Solving the Problems

[0005] The display device of the present disclosure includes an acquisition unit that acquires video data and subtitle data from content, a generation unit that generates a conversion table in which words acquired from the subtitle data are grouped for each synonym, a determination unit that determines a conversion word based on the conversion table among the words included in the subtitle data when the subtitle data is acquired, a conversion unit that converts the words of the subtitle data based on the determined conversion word, and a display unit that superimposes and displays a subtitle based on the converted subtitle data in which the words are converted into the conversion words by the conversion unit on the video data.

[0006] The display method of the present disclosure includes an acquisition step of acquiring video data and subtitle data from content, a generation step of generating a conversion table in which words obtained from the subtitle data are grouped for each synonym, and when the subtitle data is acquired, a determination step of determining a conversion word based on the conversion table among the words included in the subtitle data, a conversion step of converting the words of the subtitle data based on the determined conversion word, and a display step of superimposing and displaying a subtitle based on the converted subtitle data in which the words are converted into the conversion words by the conversion unit on the video data.

[0007] The program of the present disclosure causes a computer to realize an acquisition function of acquiring video data and subtitle data from content, a generation function of generating a conversion table in which words obtained from the subtitle data are grouped for each synonym, a determination function of determining a conversion word based on the conversion table among the words included in the subtitle data when the subtitle data is acquired, a conversion function of converting the words of the subtitle data based on the determined conversion word, and a display function of superimposing and displaying a subtitle based on the converted subtitle data in which the words are converted into the conversion words by the conversion unit on the video data.

[0008] The subtitle generation method of the present disclosure is a subtitle generation method for generating subtitles to be displayed on a video of content, and includes an acquisition step of acquiring video data and subtitle data from content, a generation step of generating a conversion table in which words obtained from the subtitle data are grouped for each synonym, a determination step of determining a conversion word based on the conversion table among the words included in the subtitle data when the subtitle data is acquired, and a generation step of generating subtitles by converting the words of the subtitle data based on the determined conversion word.

Effects of the Invention

[0009] According to the present disclosure, for example, it is possible to display subtitles in an appropriate expression according to the user who is viewing.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Modes for Carrying Out the Invention

[0011] Generally, a display device capable of displaying content such as a program received as a broadcast wave, a video distributed on a video distribution site, or an image output by a computer or the like is known. When displaying the content, subtitles are also displayed.

[0012] At this time, when the subtitles (subtitle data, character data) contain words that the viewer cannot understand or words that are not suitable for education, it was possible to generate and display substitute strings.

[0013] However, when converting the subtitles to substitute strings, they were not always replaced with appropriate strings. For example, when the viewing user is a child, if the substitute string is for children, there has been a problem that subtitles that the child can read appropriately are not displayed.

[0014] Also, the user is familiar with the expressions of subtitles that they often see and has a need to read subtitles with such expressions, but the uniformly converted strings cannot meet such needs.

[0015] Therefore, a display device or the like that can determine and display subtitles with appropriate expressions according to the viewing user will be described with reference to the following embodiments.

[0016] It should be noted that the invention described in the claims is explained as an example in the following embodiments, and the technical scope of the present invention is not limited to the description of the following embodiments.

[0017] [1. First Embodiment] Hereinafter, the first embodiment will be described. In the first embodiment, the following will be described as an example.

[0018] As an example, words and terms displayed by the display device are obtained from the content and are subtitles (subtitle data) superimposed on the content. Note that the displayed words and terms are composed of characters or character strings. Also, the characters may be, for example, characters of character broadcasting or characters displayed on a display device such as a program guide. Also, the characters may include a character string consisting of one character or a plurality of characters. Also, the characters include characters and symbols that the display device can display, in addition to Japanese and English. Also, the characters include characters based on foreign character data included in the subtitle data described later.

[0019] [1.1 Entire Display Device] FIG. 1 is a diagram showing the entirety of a system 1 including a display device 10. The display device 10 is a device capable of displaying content. For example, in this embodiment, it is a television capable of receiving a broadcast wave and displaying a program. Also, the display device 10 may be a display capable of displaying video input from the outside. Also, the display device 10 may be, for example, a projector that projects a display screen onto a screen.

[0020] The display device 10 may have a device for acquiring information for identifying the user who is viewing. For example, the display device 10 may have, for example, a device for acquiring the voice of the viewing user, and may have a microphone 12 as a voice input device, for example. The microphone 12 may be a single microphone or a microphone array composed of a plurality of microphones.

[0021] Also, the display device 10 may have a camera 14 for acquiring an image of the viewing user. The camera 14 can photograph, for example, the environment including the user viewing the display device 10. One or a plurality of cameras 14 may be arranged.

[0022] Here, the content may be anything that can be displayed on the display device 10. For example, the content may be a program that receives, demodulates, and displays terrestrial / BS / CS broadcasts, a video selected by a user on a video distribution site, or a video input from the outside via HDMI (registered trademark), D-SUB, or the like.

[0023] Also, the display device 10 may be connectable to an external server device 20 via the network NW. The server device 20 stores, for example, a thesaurus dictionary DB described later, and can return a synonym corresponding to a word in response to a request from the display device 10.

[0024] [1.2 Hardware Configuration] The hardware configuration will be described with reference to FIG. 2.

[0025] The control unit 100 controls the entire display device 10. The control unit 100 realizes various functions by reading and executing various programs stored in a storage device (for example, the storage 112 or the ROM 120). The control unit 100 may be realized by one or more control devices / arithmetic devices (CPU (Central Processing Unit), SoC (System on a Chip)). Also, the control unit 100 may be composed of a control circuit.

[0026] The operation control unit 102 receives an operation from the user, gives an operation instruction to each functional unit, or notifies the control unit 100 of an operation signal corresponding to the received operation. For example, the operation control unit 102 may be an operation signal receiving unit from a remote control, or may be an operation switch provided on the main body of the display device 10.

[0027] Storage 112 is a non-volatile memory device capable of storing programs and data. For example, it may be composed of a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). Also, Storage 112 may be configured as an externally connectable USB memory. Further, Storage 112 may be, for example, a storage area on the cloud.

[0028] ROM 114 is a non-volatile memory capable of retaining programs and data even when the power is turned off.

[0029] RAM 116 is the main memory mainly used by the control unit 100 when executing processes. RAM 116 is a rewritable memory that temporarily holds programs read from Storage 112 or ROM 114 and data including execution results.

[0030] Note that Storage 112, ROM 114, and RAM 116 may be collectively referred to as the storage unit 110. When regarded as the storage unit 110, data appropriately stored in any of the areas of Storage 112, ROM 114, and RAM 116 can be read, and data can be appropriately stored in any of the areas.

[0031] The broadcast control unit 140 receives the broadcast wave transmitted by the broadcast station selected by the user, decodes video and characters from the broadcast wave and outputs them to the display unit 150, and decodes audio from the broadcast wave and outputs it to the audio output unit 165. The configuration of the broadcast control unit 140 will be further described later.

[0032] The display unit 150 is a display device capable of displaying the video of the received program and various information. The display unit 150 may be, for example, a device capable of displaying video such as a liquid crystal display (LCD) or an organic EL (Organic Electro Luminescence) display. Further, the display unit 150 includes an interface to which a display device can be connected. For example, it may be composed of an external display device connected via HDMI (registered trademark) (High-Definition Multimedia Interface), DVI (Digital Visual Interface), or Display Port. Further, the display unit 150 may be, for example, a projection device such as a projector.

[0033] The photographing unit 155 is a photographing device that photographs the periphery where the display device 10 is installed, and is, for example, a camera or the like. The photographing unit 155 may be composed of one or a plurality of photographing devices. The photographing unit 155 outputs the photographed image as an image signal. Further, the photographing unit 155 may output one or a plurality of images as continuous video.

[0034] The voice input unit 160 is an input device capable of inputting the sound around where the display device 10 is installed, and is, for example, a microphone or the like. Further, the voice input unit 160 may be composed of a plurality of input devices (for example, microphones). Further, the voice input unit 160 is mainly used when inputting the voice of the user who is watching, but can also input general sounds such as environmental sounds, for example.

[0035] The voice output unit 165 outputs the voice included in the content. The voice output unit 165 may be, for example, a device such as a speaker or headphones. Further, the voice output unit 165 only needs to output sound, and can output general sounds such as music and environmental sounds, for example.

[0036] The communication unit 170 is a communication interface for communicating with other devices. For example, the communication unit 170 may be a network interface connectable to a wireless LAN, or may be a network interface connectable to Ethernet (registered trademark) by wire. Further, the communication unit 170 may be, for example, a communication device connectable to a mobile communication network such as LTE / 4G / 5G / 6G.

[0037] Here, one or more of the configurations shown in FIG. 2 may be configured by an external device connected to the display device 10. For example, the audio input unit 160 may be a microphone connected by USB. Further, one or more of the configurations shown in FIG. 2 may be realized by a terminal device connected by wireless communication such as Bluetooth (registered trademark) or a terminal device connected via a network. For example, a display device, an audio input / output device, and a photographing device of a smartphone, a tablet, a smart speaker, or a wearable terminal device connected to the display device 10 may be used.

[0038] Further, the configuration of FIG. 2 only needs to include the configurations necessary in the embodiment. For example, in the first embodiment, the photographing unit 155 may not be provided.

[0039] (Broadcast control unit) A simple configuration of the broadcast control unit 140 will be described with reference to FIG. 3. For example, broadcast data of digital broadcasts such as terrestrial waves / BS / CS is acquired by the tuner unit 200. Then, the OFDM demodulation unit 210 demodulates the broadcast data by OFDM, and after error correction and the like are performed, a TS packet is output.

[0040] The separation unit 220 separates the TS packet and outputs the video packet to the video decoding unit 230 and the audio packet to the audio decoding unit 260. Further, the separation unit 220 outputs a data packet (for example, a subtitle TS packet) including information related to subtitles to the subtitle decoding unit 240.

[0041] The video decoding unit 230 decodes video data from the input video packet and outputs it to the image processing unit 250. Also, the subtitle decoding unit 240 decodes subtitle data from the input data packet and outputs it to the image processing unit 250. Here, the subtitle data is assumed to include information related to subtitles. For example, the subtitle data of the present embodiment may include subtitle management data included in subtitle PES data and data of subtitle text to be displayed.

[0042] The image processing unit 250 outputs a video with subtitle data superimposed on the video data as needed to the display unit 150.

[0043] Also, the audio decoding unit 260 decodes audio data from the input audio packet and outputs the audio to the audio output unit 165.

[0044] Note that FIG. 3 schematically illustrates a general broadcast control unit 140, and other configurations may be used. For example, the video decoding unit 230 and the audio decoding unit 260 may be the same decoding unit.

[0045] (Configuration of subtitle display) Here, the configuration in which the display device 10 displays subtitles will be conceptually described with reference to FIG. 4. FIG. 4 is a diagram for explaining mainly that the display device 10 receives content (for example, content received from a broadcast wave) and displays subtitles separated from the content. It is a configuration of each function including the configurations of FIGS. 2 and 3, and each configuration is configured by hardware or software as needed. Note that functions common to FIGS. 2 and 3 are denoted by the same reference numerals, and detailed descriptions thereof are omitted.

[0046] First, the reproduced video signal and the broadcast signal acquired by the tuner unit 200 (reproduced video signal reception unit) are output to the separation unit 220. The separation unit 220 is a video / subtitle signal separation unit and separates the video signal and the subtitle signal. Then, the separation unit 220 outputs the video signal to the video decoding unit 230. Also, the separation unit 220 outputs the subtitle signal to the subtitle decoding unit 240.

[0047] The subtitle decoding unit 240 outputs subtitle data to the subtitle data storage processing unit 242. The subtitle data storage processing unit 242 stores the subtitle data in the storage unit 110. Also, the subtitle data storage processing unit 242 may generate a conversion table described later.

[0048] Also, when displaying subtitles, the subtitle decoding unit 240 outputs subtitle data to the subtitle data comparison unit 244. Although details will be described later, the subtitle data comparison unit 244 identifies a target word, which is a word to be converted included in the subtitle data, and a converted word (converted word) by comparing with the thesaurus DB in the storage unit 110 and the conversion table.

[0049] Then, the subtitle data conversion unit 246 converts the identified target word into a converted word. The subtitle data processing unit 248 adjusts the converted character data to a predetermined font size, format, color, etc., and outputs it to the image processing unit 250.

[0050] The image processing unit 250 is an overlay processing unit, which overlays the subtitle data output from the subtitle data processing unit 248 on the video data output from the video decoding unit 230. Then, the video with the subtitle overlaid is output from the display unit 150. That is, the image processing unit 250 overlays and displays the subtitle data after conversion by the subtitle data conversion unit 246.

[0051] Here, the converted subtitle data may include not only that the words are converted, but also the subtitle data in which the target word is determined by the conversion table by the subtitle data comparison unit 244, the subtitle data conversion unit 246, etc.

[0052] Therefore, for the subtitle data after conversion, it is not necessary that all the words in the subtitle data included in the content are converted into the converted words. For example, it is sufficient that some of the words in the subtitle data included in the content are converted into the converted words. Also, for the subtitle data displayed by the image processing unit 250, when there is no corresponding converted word for a word included in the subtitle data, the subtitle data included in the content may be output as it is.

[0053] [1.3 Software Configuration] The software configuration will be described with reference to FIG. 5(a). For example, the control unit 100 realizes each function by executing a program stored in the storage unit 110 (storage 112, ROM 114, RAM 116).

[0054] The subtitle display unit 1010 displays subtitles in a predetermined display mode based on the subtitle data. The subtitle display unit 1010 determines the subtitles to be superimposed on the video based on the display timing (reference time, start time), position (coordinates), color, character size, font, decoration, language selection, display direction (vertical writing, horizontal writing), etc. of the subtitles included in the subtitle data.

[0055] As will be described later, the subtitle conversion unit 1020 converts the words included in the subtitle data into predetermined words. Note that the subtitle conversion unit 1020 includes words, phrases, word phrases, phrases, etc. as the units to be converted in addition to words. That is, a word is a certain character or character string. The detailed operation of the subtitle conversion unit 1020 will be described later.

[0056] The subtitle data storage area 1102 is an area where subtitle data is temporarily stored. For example, it is subtitle data output by decoding a subtitle signal separated from the content. The subtitle data includes one or more words. A word is composed of one or more characters. For example, the control unit 100 separates the subtitle data into elements by element analysis of the subtitle data, and stores each word in the subtitle data storage area 1102.

[0057] The conversion word DB 1104 stores conversion words. The conversion word DB is stored as the heading word of the conversion table stored in the conversion table storage area 1106 described later. For example, when a word is stored in the conversion word DB, the control unit 100 can determine that the corresponding conversion table is stored.

[0058] The conversion table storage area 1106 is an area where one or more conversion tables are stored. The conversion tables are registered, for example, grouped by synonyms. For example, Fig. 5(b) is a diagram showing an example of the configuration of the conversion table. For example, "words" are stored for each group of synonyms. Also, for each word, how many times it has been stored and the date and time of the last storage are stored.

[0059] Also, for example, when the conversion table corresponding to the synonyms is not in the conversion table storage area 1106, the control unit 100 may newly generate a conversion table.

[0060] The dictionary DB 1108 stores various dictionaries. In the present embodiment, for example, a thesaurus DB is stored. For example, the thesaurus DB stores "baka", "fool", "aho", "lazy", "slow" as synonyms respectively.

[0061] Note that the thesaurus DB may be stored in the server device 20. Also, the various information stored in the storage unit 110 described above may be stored in a storage or the like.

[0062] [1.4 Process flow] Hereinafter, the process flow in the present embodiment will be described. Note that the following processes will be described as being executed by the control unit 100, but each of the components described above may execute the processes of each step.

[0063] [1.4.1 Conversion table update process] FIG. 6 explains the conversion table update process. The conversion table update process is a process executed when the control unit 100 acquires subtitle data.

[0064] First, the control unit 100 acquires an acquired word from the subtitle data (S102). Here, the acquired word refers to one word acquired by the control unit 100 among the words included in the subtitle data.

[0065] Then, the control unit 100 determines whether the acquired word exists in the conversion word DB (S104). That is, when the acquired word exists in the conversion word DB, the word corresponding to the acquired word is already stored in the conversion table.

[0066] When the acquired word exists in the conversion word DB, the control unit 100 searches for the conversion table in which the word is included (S104; Yes → S106). Then, when the control unit 100 finds the acquired word, it updates the number of times the word corresponding to the acquired word is stored (S116). For example, the control unit 100 increments the number of times stored by +1.

[0067] In addition, the control unit 100 updates the date and time (timestamp) when the word corresponding to the acquired word was stored (S118).

[0068] In S104, when the control unit 100 determines that the acquired word does not exist in the conversion DB (S104; No), it executes the conversion table search process. The conversion table search process is a process of searching for a conversion table related to the acquired word, which will be described with reference to FIG. 7.

[0069] When there is a conversion table for the group related to the acquired word (S110; Yes), the control unit 100 adds the acquired word to the searched existing group conversion table (S112). On the other hand, when there is no related conversion table (S110; No), the control unit 100 creates a new group conversion table and adds the acquired word (S114).

[0070] Then, the control unit 100 updates the number of memorizations and the timestamp for the added word (S116, S118).

[0071] [1.4.2 Conversion Table Search Processing] FIG. 7 is a diagram showing an example of the conversion table search processing executed in S108 of FIG. 6. First, the control unit 100 determines whether the display device 10 is connected to the network (S132).

[0072] Here, when the display device 10 is connected to the network (S132; Yes), the control unit 100 searches for synonyms of the acquired word in the dictionary DB on the network (S134). Here, the dictionary DB may be a synonym DB. Here, when the display device 10 is connected to the network, it may be in a state where it can communicate with the server device 20 that provides the dictionary DB.

[0073] Also, when the display device 10 is not connected to the network (S132; No), the control unit 100 searches for synonyms in the synonym dictionary DB stored in the display device 10 for the acquired word (S136).

[0074] Thereby, the control unit 100 acquires the synonyms corresponding to the acquired word as synonym information (S138). Note that the control unit 100 may execute S136 after executing S134. Also, the control unit 100 may execute S134 after executing S136.

[0075] Then, the control unit 100 searches for the conversion table in which synonyms other than the acquired word are registered (S140). For example, the control unit 100 refers to the conversion word DB and determines whether the synonyms included in the synonym information are stored as conversion words. And when the conversion table stored as a conversion word is searched, the control unit 100 may return the result assuming that there is a conversion table related to the acquired word.

[0076] [1.4.3 Subtitle Data Conversion Processing] The process of converting subtitle data will be described with reference to FIG. 8. First, the control unit 100 acquires a target word from the subtitle data (S152).

[0077] Specifically, the control unit 100 acquires one piece of data as subtitle data. This subtitle data is, for example, subtitle data for one sentence or subtitle data to be displayed on one screen. This subtitle data is temporarily stored in the storage unit 110.

[0078] Then, the control unit 100 performs element analysis and the like on the temporarily stored subtitle data and decomposes it into word units. Then, the control unit 100 acquires words one by one from the beginning of the subtitle data.

[0079] Here, the control unit 100 determines whether the target word exists in the conversion word DB (S154). If the target word does not exist in the conversion word DB, since it is a word that does not need to be converted, the control unit 100 outputs the word as it is. Then, when all the words in the subtitle data are finished, the processing for this subtitle data is terminated (S170; Yes), and for example, the next subtitle data is acquired.

[0080] Also, when the control unit 100 has not acquired all the words in the subtitle data, it acquires the next word as the acquisition word and repeatedly executes the processing from S154 (S172 → S154).

[0081] In S154, when the target word exists in the conversion word DB (S154; Yes), the control unit 100 searches for the conversion table containing the target word (S156). Then, the control unit 100 reads the information (for example, words, etc.) contained in the searched conversion table (S158). At this time, the control unit 100 may use the target word as the conversion word.

[0082] Here, the control unit 100 determines whether the storage count of the target word is the maximum value (S160). If the storage count of the target word is the maximum value, then the target word is the conversion word as it is (S160; Yes).

[0083] When the number of times the target word is stored is not the highest among the words in its group, the control unit 100 sets the word with the highest value as the conversion word (S160; No → S162). Here, when the target word is the highest value but there are other words with the highest value, the control unit 100 may also use such a word as the conversion word. That is, the control unit 100 may use all the words with the highest value in the conversion table as the conversion words.

[0084] Here, when there is one conversion word, the control unit 100 replaces the target word with the conversion word (S164; Yes → S168). When there are multiple conversion words, the control unit 100 sets the word with the latest storage date and time among the conversion words as the conversion word (S166).

[0085] [1.5 Operation Example] An operation example will be described. FIG. 9 is a diagram for explaining the transition of the conversion table. The conversion table storage area 1106 stores the conversion table shown in FIG. 9(a). This conversion table is a conversion table in which a group of synonyms of "baka" is stored.

[0086] (1) When "baka" is obtained from the subtitle data When the control unit 100 obtains "baka" from the subtitle data, it determines that "baka" is stored in the conversion word DB. The conversion word DB stores "baka", "fool", "idiot", "slacker", and "stupid".

[0087] Then, when the control unit 100 searches the conversion table in FIG. 9(a), it updates the storage count and the timestamp. As shown in FIG. 9(b), the storage count of "baka" in the conversion table is updated from "8" to "9". Also, the final storage date and time is updated to "May 23, 2023, Tuesday 17:46".

[0088] (2) When "futu" is obtained from the subtitle data When the control unit 100 obtains "baka" from the subtitle data, it determines that "baka" is not stored in the conversion word DB. Therefore, the control unit 100 searches the thesaurus DB and obtains that "idiot" is a synonym. Then, the control unit 100 searches for FIG. 9(b) as the conversion table in which the synonym "idiot" is registered.

[0089] Since there is no "baka" in the conversion table of FIG. 9(b), the control unit 100 adds it as a new word. FIG. 9(c) shows the conversion table with "baka" added.

[0090] (3) When obtaining "shiranui" from the subtitle data When the control unit 100 obtains "shiranui" from the subtitle data, it determines that "shiranui" is not stored in the conversion word DB. Therefore, the control unit 100 searches the thesaurus DB and obtains the synonym information "mirage" and "fishing light".

[0091] However, since there is no conversion table including synonyms, the control unit 100 adds "shiranui" as a new group of conversion tables. FIG. 9(d) shows the state in which "shiranui" is added as a new conversion table. A new group of conversion tables is stored separately from the group in FIG. 9(c).

[0092] In this way, the control unit 100 can update the conversion table based on the words obtained from the subtitle data.

[0093] FIG. 10 is a diagram for explaining an embodiment of converting subtitle data and displaying subtitles. First, the control unit 100 decomposes the subtitle data "that guy is an idiot" into words (words, phrases). For example, it decomposes into "that guy", "is", "idiot", and "isn't it".

[0094] Subsequently, the control unit 100 determines whether each word needs to be converted with the respective word as the target word. For example, for the target word "idiot", the control unit 100 searches the conversion word DB to determine whether there is a conversion word.

[0095] When the control unit 100 determines that there is a conversion word based on the conversion word DB, it searches the conversion table. The control unit 100 identifies the conversion table containing "baka", and identifies the word with the highest number of memorization times among them. Here, "fool" and "stupid" with a memorization number of "11" times become the conversion words.

[0096] Here, since there are two conversion words, the control unit 100 sets the one with the newer final memorization date and time as the conversion word. In Fig. 10, since "fool" is newer, "fool" becomes the conversion word.

[0097] Therefore, the subtitle data "Aitsu wa baka da na" is converted to "Aitsu wa fool da na" and output.

[0098] Thus, according to this embodiment, it becomes possible to generate a conversion table from subtitle data acquired based on the program being viewed by the user. As a result, according to the program that the viewer often watches, among the words (character strings) included in the subtitle, the words (character strings) that are often displayed are stored in the conversion table. Also, when newly displaying a subtitle, by replacing it with a frequently displayed synonym, the words of the program that the user always watches are displayed, so that a more familiar subtitle is displayed.

[0099] That is, since the subtitle of the content being viewed is replaced based on the subtitle of the content that the user often watches, the subtitle based on the subtitle of the content that the user often watches is automatically displayed, which becomes an appropriate subtitle for the user.

[0100] [2. Second Embodiment] The second embodiment will be described. The second embodiment is an embodiment in which a conversion table is generated according to the genre of the content, in addition to the first embodiment.

[0101] [2.1 Configuration, etc.] In the second embodiment, the description of the same parts in terms of hardware and software configurations as in the first embodiment will be omitted, and the description will focus on the differences from the first embodiment.

[0102] FIG. 11 of the second embodiment replaces FIG. 5(a) of the first embodiment. Note that the same components as those in FIG. 5(a) are denoted by the same reference numerals, and the description thereof will be omitted.

[0103] The genre setting unit 1030 selects a genre for which a conversion table is to be generated from the subtitles. For example, the genre setting unit 1030 may be set as "drama", "animation", "movie", "news", "music / live", "overseas drama", "stage / theater", "sports", "net", etc. as the genre of the content (program).

[0104] Also, the genre setting unit 1030 may set a genre based on user information described later.

[0105] The user processing unit 1040 executes processes such as user registration and deletion, and stores them in the user information storage area 1110 as user information. The user information may store, for example, a user ID (e.g., "Usr01"), a user name (e.g., "younger brother"), user identification information (e.g., "001.jpg"), and a genre (e.g., "animation") as shown in FIG. 12(a).

[0106] Here, in this embodiment, a genre may be set for each user. For example, when the user viewing is "Usr01", the control unit 100 generates a conversion table for the subtitles of the "animation" content. Also, when the user is "Usr02", the control unit 100 generates a conversion table for the subtitles of all content.

[0107] The user recognition unit 1050 recognizes the user. For example, the user may be recognized using a face image included in the image captured by the imaging unit 155, or the user may be allowed to select an ID.

[0108] The program information acquisition unit 1060 acquires program information, which is information on a program that is an example of the acquired content. As shown in FIG. 12(b), the program information may include a plurality of information such as a program ID, a program name, a broadcast start time, an end time, a broadcast duration, a channel, a video quality, and electronic program information. Further, the program information may include a genre.

[0109] Also, the conversion table storage area 1106 may further store an individual conversion table as the individual conversion table storage area 1106A. In the first embodiment, it was described that the conversion table is stored grouped by synonyms. In the second embodiment, for example, an individual conversion table may be generated and stored for each genre. For example, when "animation" is selected as the genre by the control unit 100, an individual conversion table for "animation" is generated. Thereby, it becomes possible to specify words that appear in a specific genre as priority conversion words.

[0110] Note that a conversion word DB may be prepared corresponding to the individual conversion table. For example, a conversion word DB for the genre "animation" and an individual conversion table for the genre "animation" are prepared. When "animation" is selected as the genre by the control unit 100, the conversion word DB for the genre "animation" is searched before searching the individual conversion table. That is, the conversion word DB for the genre "animation" only needs to include all the conversion words included in the individual conversion table for the genre "animation".

[0111] [2.2 Process flow] [2.2.1 Genre setting process] FIG. 13 is a diagram for explaining an example of the genre setting process in the second embodiment. First, a content genre selection screen is displayed (S202). Here, when the content is selected by the user (S204; Yes), the genre of the selected content is set (S206).

[0112] [2.2.2 Conversion table update process] FIG. 14 shows the process of updating the conversion table. First, the control unit 100 receives a video signal (S212). The control unit 100 has acquired the content. At this time, the control unit 100 also acquires the genre of the acquired content. For example, when the acquired content is a program, the control unit 100 acquires program information and the genre included in the program information.

[0113] Subsequently, the control unit 100 reads the genre of the set content (S214). When the genre of the acquired content matches the genre of the content set by the user, the control unit 100 acquires words from the subtitle data. Then, based on the acquired words, the control unit 100 executes a conversion table update process (S220). Here, for the conversion table update process, for example, the control unit 100 executes the process of FIG. 6. At this time, only the subtitle data of the content genre that matches the set genre is used to acquire words (S102). That is, the control unit 100 generates a conversion table based on the content selected by the user.

[0114] [2.3 Effects] According to the present embodiment, it is possible to create a conversion table based on subtitle data displayed based on content of a genre desired by the user. For example, it is set to automatically store the subtitles of anime as content watched by children. The display device 10 stores the subtitles and generates a conversion table only when the viewer is watching anime. For example, conventionally, when the family watches a movie program, there may be a case where a child cannot understand the subtitles displayed on the display device 10. According to the present embodiment, the display device 10 temporarily stores the subtitles of the movie program and uses the conversion table for anime, so that the subtitle display becomes easier to understand and even children can enjoy watching the content.

[0115] [3. Third Embodiment] The third embodiment will be described. The third embodiment is an embodiment in which subtitles are appropriately displayed based on the content that the user has viewed in the past.

[0116] For the third embodiment, the description of the parts with the same hardware and software configurations as those of the first and second embodiments will be omitted, and the description will focus on the points different from the first and second embodiments. Note that the software configuration refers to the configuration of FIG. 11 in this embodiment.

[0117] [3.1 Flow of Processing] [3.1.1 User Registration Processing] FIG. 15 is a diagram for explaining an example of user registration processing. First, the control unit 100 captures an image of the user (S302). Further, the control unit 100 stores user information (S304). For example, the control unit 100 may store the user name, the genre desired by the user, and the like. Then, the control unit 100 secures a conversion table (individual conversion table) for each user (S306). Here, when preparing the individual conversion table for each user, the control unit 100 may also store a conversion word DB for each user. That is, the conversion words included in the individual conversion table for each user are stored in the conversion word DB for each user.

[0118] [3.1.2 Word Storage Processing] Hereinafter, the conversion table update processing will be described with reference to FIG. 16. First, the control unit 100 receives a video (S312). Then, the control unit 100 acquires information on the user who is viewing (S314). For example, the control unit 100 can recognize the user who is viewing by recognizing the face image of the viewer at this time.

[0119] When the user who is viewing is the user registered as user information (S316; Yes), the control unit 100 extracts words from the subtitle data (S318). Then, the control unit 100 determines the individual conversion table in the conversion table corresponding to the viewing user (S320), and executes the conversion table update processing (S322).

[0120] That is, when the control unit 100 executes the conversion table update process of FIG. 6, the individual conversion table is updated for the conversion word DB and the individual conversion table corresponding to the recognized user. As a result, appropriate words are added to the conversion table for each user as an individual conversion table.

[0121] [3.1.3 Subtitle display process] FIG. 17 is a diagram for explaining the process related to the display of subtitles in the present embodiment. In the subtitle display process, the subtitle data is converted as necessary with reference to the conversion table in FIG. 8, and as described in FIG. 4, the control unit 100 superimposes and displays the subtitle data on the video data. FIG. 17 is a diagram conceptually explaining the processes described in FIGS. 4 and 8.

[0122] First, the control unit 100 executes a video reception process and receives, for example, a program being broadcast as content (S332). The control unit 100 acquires information on the viewing user (S334). Here, when the viewing user and the registered user do not match, the control unit 100 executes a subtitle superimposing process of superimposing the subtitle on the video as it is based on the subtitle data included in the acquired program (S344). Then, the control unit 100 displays the video with the subtitle superimposed on the screen (S346).

[0123] Here, when the viewing user is included in the registered users, the control unit 100 acquires the target word from the subtitle data (S336; Yes→S338). Then, from the conversion table (individual conversion table) of the viewing user, the control unit 100 reads the conversion word corresponding to the target word (S340). Then, the control unit 100 converts the target word with the conversion word (S342). As a result, the control unit 100 converts the subtitle data with the user - specific conversion word according to the user and displays the subtitle.

[0124] [3.2 Operation example] An operation example will be described with reference to FIG. 18. FIG. 18(a) is a diagram for explaining an example of a user registration screen. For example, a screen showing that the conversion table is updated based on subtitles by three users is shown.

[0125] FIGS. 18(b) to 18(d) show how subtitle data is replaced when each user is watching. For example, in FIG. 18(b), Usr01 is watching and the subtitle "Go and kill that guy" is displayed. In FIG. 18(c), Usr02 is watching and the subtitle "Go and eliminate that guy" is displayed. In FIG. 18(d), Usr03 is watching and the subtitle "Go and execute that bastard" is displayed.

[0126] That is, words such as "that guy" and "that bastard" have been converted by the user, and words such as "go and kill", "go and eliminate", and "go and execute" have been converted by the user.

[0127] In this way, in this embodiment, a conversion table can be generated for each user, and subtitles can be appropriately converted into conversion words for each user.

[0128] [4. Fourth Embodiment] The fourth embodiment will be described. The fourth embodiment is an embodiment in which priorities are assigned when multiple users are watching in addition to the third embodiment.

[0129] For the fourth embodiment, the description of the parts having the same hardware and software configurations as those of the third embodiment will be omitted, and the description will focus on the differences from the third embodiment. Note that the software configuration refers to the configuration of FIG. 11 in this embodiment.

[0130] FIG. 19 is a diagram in which the user registration process in FIG. 15 is replaced. The same processes are denoted by the same reference numerals. FIG. 19 is different in that in S402, priorities are registered in the user information. The priorities may be assigned, for example, as 1, 2, 3,... from the highest, or may be assigned as A, B, C,....

[0131] FIG. 20 is a diagram replacing the caption display process of FIG. 17. The same processes are denoted by the same reference numerals.

[0132] Here, when the registered user is included in the viewing user, the control unit 100 determines whether there is one viewing user (S412). For example, if there is one viewing user here, the control unit 100 identifies the recognized user and uses the individual conversion table or the like of the user (S412; Yes → S414).

[0133] On the other hand, when there are two or more viewing users, the control unit 100 recognizes all the viewing users and identifies the viewing user with the highest priority (S412; No → S416 → S418). That is, the control unit 100 uses the individual conversion table of the user with the highest priority among the viewing users to convert the caption data.

[0134] FIG. 21 is a diagram showing an operation example of the present embodiment. FIG. 21(a) shows priorities corresponding to users. For example, if the priority of Usr01 is "1", the priority of Usr02 is "2", and the priority of Usr03 is "3", the highest priority is Usr01 with a priority of "1".

[0135] Then, for example, as shown in FIG. 21(b), when three viewing users are recognized, the highest priority is Usr01. Therefore, the control unit 100 uses the individual conversion table (conversion word DB) of Usr01 to convert and display the caption data.

[0136] [5. Modification Example] The present disclosure is not limited to the above-described embodiments, and various modifications are possible. That is, embodiments obtained by appropriately combining technical means modified within the scope not departing from the gist of the present disclosure are also included in the technical scope.

[0137] In addition, for the sake of explanation, the above-described embodiments are described separately, but they can be executed in combination within the possible range. Also, for any of the technologies described in the specification, there is an intention to obtain rights in amendments or divisional applications, etc.

[0138] Also, the programs that operate in each device in each embodiment are programs that control a CPU or the like (programs that enable a computer to function) so as to realize the functions of the above-described embodiments. And the information handled by these devices is temporarily stored in a temporary storage device (for example, RAM) during its processing, and then stored in storage devices such as various ROMs and HDDs, and read by the CPU as necessary for correction and writing.

[0139] Here, as the recording medium for storing the program, any of a semiconductor medium (for example, ROM, non-volatile memory card, etc.), an optical recording medium or magneto-optical recording medium (for example, DVD (Digital Versatile Disc), CD (Compact Disc), BD (Blu-ray (registered trademark) Disc), etc.), a magnetic recording medium (for example, magnetic tape, flexible disk, etc.) may be used.

[0140] Also, when distributing to the market, the program can be stored in a portable recording medium for distribution, or transferred to a server computer connected via a network such as the Internet. In this case, the storage device of the server device is of course also included in the present disclosure.

[0141] Also, the above-described data does not have to be stored in the device, but may be stored in an external device and appropriately called. For example, the data may be stored in a NAS (Network Attached Storage) or stored in the cloud.

[0142] Note that the scope of the present disclosure is not limited to the configurations explicitly described in the specification, and combinations of the technologies disclosed in this specification are also included in the scope. Among the present disclosure, the configuration for which a patent is sought is described in the appended claims, but it is not intended to exclude it from the technical scope for the reason that it is not described in the claims.

[0143] In addition, in the above-mentioned specification, the descriptions such as "in the case of ~" and "when ~" are explained as one example, and are not configured to be limited to the described content. Regarding configurations that are not these cases or times, those that are obvious to those skilled in the art are also disclosed and have the intention of obtaining rights.

[0144] Also, regarding the descriptions with an order for the processes and data flows described in the specification, they are not limited to the described order. For example, configurations in which a part of the process is deleted or the order is changed are also disclosed and have the intention of obtaining rights.

[0145] In addition, although the functions described in the embodiments are described as being executed by each device, they may be realized by one device or by further using an external server.

[0146] In addition, each functional block or various features of the apparatus used in the above-described embodiments can be implemented or executed by an electric circuit, for example, an integrated circuit or a plurality of integrated circuits. The electric circuit designed to execute the functions described in this specification may include a general-purpose use processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gates or transistor logic, discrete hardware components, or a combination thereof. The general-purpose use processor may be a microprocessor, or may be a conventional type processor, controller, microcontroller, or state machine. The above-described electric circuit may be composed of a digital circuit or an analog circuit. Further, when an integrated circuit technology that replaces the current integrated circuit appears due to the progress of semiconductor technology, one or more aspects of the present disclosure can also use a new integrated circuit by such technology.

Explanation of Signs

[0147] 10 Display device 100 Control unit 102 Operation control unit 110 Storage unit 112 Storage 114 ROM 116 RAM 140 Broadcast control unit 150 Display unit 155 Photographing unit 160 Voice input unit 165 Voice output unit 170 Communication unit

Claims

1. An acquisition unit that acquires video data and subtitle data from content; A generation unit that generates a conversion table in which words obtained from the subtitle data are grouped for each synonym; A determination unit that, when the subtitle data is acquired, determines a conversion word based on the conversion table among the words included in the subtitle data; A conversion unit that converts the words in the subtitle data based on the determined conversion word; A display unit that superimposes and displays a subtitle based on the converted subtitle data in which the words are converted into the conversion words by the conversion unit on the video data; A display device comprising the above.

2. The determination unit: Acquires one word from the subtitle data as a target word; Determines a group of the conversion table based on the target word; Determines one word from the conversion table as the conversion word The display device according to Claim 1.

3. When the word obtained from the subtitle data is already included in the conversion table, the generation unit updates the storage count; The determination unit determines the word with the most storage count in the conversion table as the conversion word The display device according to Claim 2.

4. The generation unit stores together the date and time when the word obtained from the subtitle data is stored in the conversion table or when the storage count is updated; When there are a plurality of words with the most storage count, the determination unit determines the word with the newer date and time when updated as the conversion word The display device according to Claim 3.

5. Further comprising a selection unit that selects the genre of the content; The generation unit generates the conversion table for each content; The display device according to Claim 1.

6. The determination unit determines a conversion table corresponding to the genre of the content acquired by the acquisition unit, and determines the conversion word based on the conversion table; The display device according to Claim 5.

7. Further comprising a recognition unit that recognizes a user who views the content; The generation unit generates the conversion table for each user; When the subtitle data is acquired, the determination unit determines the conversion word based on the conversion table corresponding to the user recognized by the recognition unit; The display device according to Claim 1.

8. When there are a plurality of users recognized by the recognition unit, the determination unit determines the conversion word based on the conversion table of the user with a higher priority; The display device according to Claim 7.

9. An acquisition step of acquiring video data and subtitle data from content; A generation step of generating a conversion table in which words obtained from the subtitle data are grouped for each synonym; A determination step of determining a conversion word based on the conversion table among the words included in the subtitle data when the subtitle data is acquired; A conversion step of converting the words in the subtitle data based on the determined conversion word; A display step of superimposing and displaying a subtitle based on the converted subtitle data in which the words are converted into the conversion words by the conversion unit on the video data; A display method including the above.

10. In a computer, An acquisition function of acquiring video data and subtitle data from content; A generation function of generating a conversion table in which words obtained from the subtitle data are grouped for each synonym; A determination function of determining a conversion word based on the conversion table among the words included in the subtitle data when the subtitle data is acquired; A conversion function of converting the words in the subtitle data based on the determined conversion word; A display function of superimposing and displaying a subtitle based on the converted subtitle data in which the words are converted into the conversion words by the conversion unit on the video data; A program for realizing the above.

11. A recording medium on which the program of Claim 10 is recorded.

12. In a subtitle generation method for generating subtitles to be displayed on a video of content, An acquisition step of acquiring video data and subtitle data from content; A generation step of generating a conversion table in which words obtained from the subtitle data are grouped for each synonym; A determination step of determining a conversion word based on the conversion table among the words included in the subtitle data when the subtitle data is acquired; A generation step of generating subtitles by converting the words in the subtitle data based on the determined conversion word; A subtitle generation method including the above.

Images