Electrical apparatus, notification method, program and recording medium
The electrical device addresses the limitation of existing technologies by extracting targets from video frames and acquiring related keywords from external sources to enhance information provision during playback.
Patent Information
- Application Number
- JP2024004759
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-16
- Publication Date
- 2025-07-29
AI Technical Summary
Existing technologies fail to provide comprehensive information about targets within video content beyond what is visually depicted in the frames, missing contextual details that may be present in sources other than the image frames.
An electrical device that includes a content receiving unit, a target extraction unit to identify objects in video frames, a related keyword acquisition unit to retrieve additional information from external sources like databases and metadata, and a notification unit to display this information alongside the video playback.
Enables the provision of detailed information about video content objects, enhancing user experience by providing contextual details beyond what is visually shown.
Smart Images

Figure 2025110742000001_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an electrical device, a notification method, a program, and a recording medium.
Background Art
[0002] Patent Document 1 discloses an image recognition apparatus that searches for a similar image similar to a recognition target image, extracts a plurality of keywords from information associated with the similar image, and specifies a keyword to be output as a recognition result from the plurality of extracted keywords.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] By the way, in video content, information regarding the target may be included in a source different from the image of the frame including the target image.
[0005] One aspect of the present disclosure aims to suitably provide information about a target included in video content.
Means for Solving the Problems
[0006] In order to solve the above problems, an electrical device according to one aspect of the present disclosure includes a content receiving unit that receives video content, a target extraction unit that extracts a target from an image of a first frame of the video content received by the content receiving unit, a related keyword acquisition unit that acquires a keyword related to the target from a source different from the image of the first frame, and a notification unit that notifies the keyword when the target is displayed.
[0007] In addition, a notification method according to an aspect of the present disclosure is a notification method in which an electrical device notifies a keyword for video content, and includes an object extraction step of extracting an object from an image of a first frame of the video content, a related keyword acquisition step of acquiring the keyword related to the object from a source different from the image of the first frame, and a notification step of notifying the keyword when the object is displayed on a predetermined display unit.
Effect of the Invention
[0008] According to an aspect of the present disclosure, information can be preferably provided for an object included in video content.
Brief Description of the Drawings
[0009]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Modes for Carrying Out the Invention
[0010] 〔Embodiment 1〕 Hereinafter, an embodiment of the present disclosure will be described in detail. FIG. 1 is a diagram showing a configuration example of an electric device according to Embodiment 1 of the present disclosure. The electric device 1A shown in FIG. 1 is a device used for playing video content such as television broadcasts and streaming content, and is, for example, a television. The electric device 1A includes a control unit 10, a storage unit 11, a display unit 12, an input interface 13, and a communication interface 14.
[0011] The control unit 10 has, for example, a CPU (Central Processing Unit), and controls each part of the electric device 1A by reading and executing a program from the storage unit 11. The storage unit 11 has a recording medium such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), and stores a program executed by the control unit 10, a related information database D1, etc., the details of which will be described later. Further, the storage unit 11 has a temporary storage medium such as a RAM (Random Access Memory) used by the control unit 10 as a workspace.
[0012] The display unit 12 is, for example, a liquid crystal display device, and displays an image under the control of the control unit 10. The input interface 13 has, for example, an interface for receiving a television broadcast from the antenna 20, an interface for receiving an operation signal from an input unit such as a remote control 30, etc. The communication interface 14 communicates with an external device 2 via the Internet or the like. The external device 2 is, for example, an online storage, a server, etc., and stores various image data.
[0013] By executing the program stored in the storage unit 11, the control unit 10 functions as a content reception unit 100, a target extraction unit 101, a first keyword acquisition unit 102, a database storage unit 103, a related keyword acquisition unit 104, and a notification unit 105.
[0014] The content receiving unit 100 receives video content. The content receiving unit 100 receives, for example, television broadcasts via the antenna 20 and the input interface 13.
[0015] The target extraction unit 101 extracts a target for notifying the user of information from an image of a predetermined frame of the video content received by the content receiving unit 100. Hereinafter, among the frames of the video content, the frame from which the target extraction unit 101 extracts a target is referred to as the first frame.
[0016] The target extraction unit 101 accepts an operation of selecting the first frame from among the frames of the video content received by the content receiving unit 100. The operation of selecting the first frame is performed, for example, using the remote control 30. Further, the target extraction unit 101 functions as a selection unit and accepts an operation of selecting a target for notifying information from the image of the first frame. The operation of selecting a target from the first frame is performed, for example, using the remote control 30. The target extraction unit 101 extracts the image of the target selected from the image of the first frame.
[0017] The first keyword acquisition unit 102 acquires a first keyword indicating the result of recognizing what the target extracted by the target extraction unit 101 is. The first keyword acquisition unit 102 is an example of a name acquisition unit. The first keyword is, for example, the name or title of the target extracted by the target extraction unit 101, and is a common noun, proper noun, etc. that represents the target.
[0018] The first keyword acquisition unit 102 searches for similar images similar to the target image extracted by the target extraction unit 101 from the external device 2, the storage unit 11, etc. The first keyword acquisition unit 102 acquires the first keyword from the searched similar images. For example, when the similar image is in the Exif format, the first keyword is acquired from the information added to the image.
[0019] The database storage unit 103 extracts relevant keywords (relevant information) related to the content of the video content received by the content reception unit 100 and stores them in the relevant information database D1. The database storage unit 103 extracts relevant keywords from, for example, at least one of the character strings included as images in the video content received by the content reception unit 100, the summary description text of the video content, and the subtitles of the video content.
[0020] The character string included as an image in the video content is, for example, a telop. The summary description text of the video content is, for example, the summary description text of the program included in the program schedule information (SI: Service Information), the text described in the summary description column of the video content, and the like. The subtitles of the video content are, for example, the subtitles of subtitle broadcasts (CC: Closed Caption), the subtitles automatically generated during the playback of the video content, and the like.
[0021] The relevant keyword acquisition unit 104 acquires relevant keywords related to the target from a source different from the image of the first frame. Here, sources different from the image of the first frame include, for example, the images of frames received by the content reception unit 100 before the first frame among the frames included in the video content (the second frame), the relevant information database D1 stored in the storage unit 11, and the like. The relevant keyword acquisition unit 104 searches the relevant information database D1 based on, for example, the first keyword acquired by the first keyword acquisition unit 102, and acquires relevant keywords related to the first keyword.
[0022] When displaying the target on the display unit 12, the notification unit 105 notifies the user of information about the target extracted by the target extraction unit 101 based on the first keyword acquired by the first keyword acquisition unit 102 and the relevant keywords acquired by the relevant keyword acquisition unit 104.
[0023] FIG. 2 is a diagram showing an example of notification by the notification unit. In FIG. 2, when the notification unit 105 displays the target of information notification on the display unit 12, it notifies by displaying the information related to the target on the display unit 12. During the period when the electric device 1A is playing video content via the display unit 12, when the user instructs the start of notification by operating the remote control 30 or the like, the control unit 10 of the electric device 1A causes the display unit 12 to display the frame image 40 for the frame being played at that timing.
[0024] The frame image 40 illustrated in FIG. 2 is an image of a frame included in a program introducing a patisserie, and is an image in which the product display shelves of the patisserie being introduced are reflected. The user operates the remote control 30 or the like to select the target 41 of information notification from the frame image 40. In the example of FIG. 2, the target 41 is the product arranged on the product display shelf.
[0025] The target extraction unit 101 extracts the image of the target 41 selected by the user from the frame image 40. In FIG. 2, the extracted image 42 of the target 41 is displayed to the right of the frame image 40 (image of the first frame). Below the frame image 40 and the image 42 of the target 41, an information column 43 is provided. In this information column 43, as information related to the target 41, information such as the name of the product that is the target 41 (BBB cake), the name of the patisserie selling the target 41 (AAA Patisserie), the price of the target 41 (CCC yen), the transportation access to the patisserie, and the URL of the patisserie's website is displayed. These information are displayed based on the first keyword acquired by the first keyword acquisition unit 102 and the related keywords acquired by the related keyword acquisition unit 104.
[0026] The user may select a plurality of targets 41 for information provision. In FIG. 2, below the image 42 of the target 41, thumbnail images 44 of images of other targets are displayed. The user can select the target for which information is to be displayed in the information column 43 from among the thumbnail images 44.
[0027] Figure 3 is a flowchart showing an example of content reproduction processing by the electrical device according to Embodiment 1 of the present disclosure. In S100, the control unit 10 of the electrical device 1A starts the reproduction of the video content received by the content reception unit 100.
[0028] In S101, the control unit 10 starts the processing of the database storage unit 103. Thereafter, during the reproduction of the video content, the control unit 10 executes the processing of the database storage unit 103 in parallel, and accumulates related keywords regarding the content of the video content being reproduced in the related information database D1. The processing of the database storage unit 103 will be described later with reference to FIG. 4.
[0029] In S102, the control unit 10 determines whether there is a request for information notification from the user. For example, when the user performs a predetermined notification start operation during the period of reproducing the video content, the control unit 10 determines that there is a request for information notification from the user (S102: YES). The predetermined notification start operation is, for example, that a predetermined button of the remote controller 30 has been pressed. When the control unit 10 determines that there is a request for information notification from the user (S102: YES), it acquires the image of the frame at that operation timing and displays the frame image 40 on the display unit 12 (S103).
[0030] (Target extraction step) Subsequently, the control unit 10 functions as a target extraction unit 101, starts accepting the selection of the target 41 by the user, waits until the target 41 is selected from the frame image 40 (S104: NO), and when the target 41 is selected from the frame image 40 (S104: YES), extracts the image 42 of the target 41 and proceeds to the processing of S105.
[0031] In S105, the control unit 10 functions as a first keyword acquisition unit 102 and acquires a first keyword for the target 41. For example, the control unit 10 searches for similar images similar to the image 42 of the target 41 from the external device 2, the storage unit 11, etc. Then, the control unit 10 acquires, as the first keyword, the name of the target 41, etc. from the similar images.
[0032] (Related keyword acquisition step) In S106, the control unit 10 functions as a related keyword acquisition unit 104, and acquires related keywords from a source such as the related information database D1 based on the first keyword acquired in S105.
[0033] (Notification step) In S107, the control unit 10 functions as a notification unit 105, and notifies information about the target based on the first keyword acquired in S105 and the related keywords acquired in S106. For example, the control unit 10 displays information related to the target 41 in the information column 43 based on the first keyword acquired in S105 and the related keywords acquired in S106.
[0034] In the subsequent S108, the control unit 10 determines whether to end the notification of information. For example, when the user performs a predetermined operation, the control unit 10 determines to end the notification of information (S108: YES) and proceeds to the process of S102. For example, when the user does not perform a predetermined operation, the control unit 10 determines not to end the notification of information (S108: NO) and continues the notification of information.
[0035] In S102, when the control unit 10 determines that there is no request for information from the user (S102: NO), it proceeds to the process of S109. In S109, the control unit 10 determines whether to end the playback of the video content. For example, when the video content being played ends or the user instructs the end of playback through a predetermined operation, the control unit 10 determines to end the playback of the video content (S109: YES) and ends the process of FIG. 3. Also, for example, when the video content being played has not ended or the user has not instructed the end of playback, the control unit 10 determines not to end the playback of the video content (S109: NO) and proceeds to the process of S102.
[0036] (Database storage unit) FIG. 4 is a flowchart showing an example of the processing of the database storage unit in the electrical equipment according to Embodiment 1 of the present disclosure. The processing shown in FIG. 4 starts at S101 in FIG. 3. In S200, the control unit 10 acquires the frame image displayed on the display unit 12 for the video content received by the content receiving unit 100.
[0037] In S201, the control unit 10 acquires the summary description text for the video content being played. For example, the control unit 10 acquires the program arrangement information for the program being broadcast. In S202, the control unit 10 acquires the subtitles of the video content being played. For example, the control unit 10 acquires the subtitles (Closed Caption) of the subtitle broadcast corresponding to the program being broadcast, the subtitles automatically generated for the program being broadcast, and the like.
[0038] In S203, the control unit 10 acquires the image information of characters from the frame image acquired in S200. For example, when a telop is displayed on the program being broadcast, the control unit 10 acquires the image of the telop. In the subsequent S204, the control unit 10 acquires character information from the character image information acquired in S203 by means of an optical character recognition technique or the like.
[0039] The processes of S201, S202, and S203 do not need to be performed in the order described in FIG. 4, and may be performed in any order or may be performed in parallel. The process of S204 may be performed after the process of S203, and may be performed after the processes of S201 and S202.
[0040] In S205, the control unit 10 applies a technique such as text mining to the summary description text of the video content acquired in S201, the subtitles acquired in S202, and the character information acquired in S204 to acquire relevant keywords. In the subsequent S206, the control unit 10 stores the relevant keywords acquired in S205 in the related information database D1.
[0041] In S207, the control unit 10 determines whether or not the playback of the video content has ended. For example, when the played video content has ended or when the user instructs the end of playback through a predetermined operation, the control unit 10 determines to end the playback of the video content (S207: YES) and ends the process of FIG. 4. For example, when the played video content has not ended or when the user has not instructed the end of playback, the control unit 10 determines not to end the playback of the video content (S207: NO), proceeds to the process of S200, and acquires an image of the next frame.
[0042] 〔Embodiment 2〕 Embodiment 2 of the present disclosure will be described below. For convenience of explanation, members having the same functions as those described in Embodiment 1 above are denoted by the same reference numerals, and the description thereof will not be repeated.
[0043] In Embodiment 2 of the present disclosure, the electrical device 1A is different from Embodiment 1 in that when the related information database D1 is updated after the information about the target 41 is notified, the related keyword is searched again from the related information database D1.
[0044] Even when information about the target 41 is provided in the video content during the period in which the information about the target 41 is being notified, the database storage unit 103 updates the related information database D1 about the target 41. In Embodiment 2, when the database storage unit 103 updates the related information database D1 during the period in which the information about the target 41 is being notified, the related keyword acquisition unit 104 re-searches for information about the target 41 from the updated related information database D1. Then, when the related keyword acquisition unit 104 re-searches for the related keyword, the notification unit 105 notifies information related to the aspect 41 based on the related keyword after the re-search when the content of the related keyword changes before and after the re-search.
[0045] FIG. 5 is a flowchart of content reproduction processing by the electric device according to Embodiment 2 of the present disclosure. As shown in FIG. 5, in the content reproduction processing in Embodiment 2, when the information is notified in S107, the process proceeds to S300.
[0046] In S300, the control unit 10 determines whether the related information database D1 has been updated as compared with the timing (for example, S106) when the related keyword was last retrieved from the related information database D1. When the related information database D1 has been updated (S300: YES), the control unit 10 re-searches the related information database D1 based on the first keyword acquired in S105 and the related keyword acquired in S106, and re-acquires the related keyword (related information) (S301). The process of S301 is an example of a related information acquisition unit. The related information acquisition unit acquires related information that is not directly related to the image, for example, based on the first keyword acquired in S105 and the related keyword acquired in S106. Related information that is not directly related to the image includes information such as traffic access to a patisserie and the URL of the patisserie's website when the image is a patisserie. Related information that is not directly related to the image can be acquired by referring to the external device 2. Note that the related information acquisition unit can acquire related information that is not directly related to the image based on the first keyword acquired in S105 or the related keyword acquired in S106. When the related keyword is re-acquired and the related keyword to be notified is updated (S302: YES), the control unit 10 re-notifies the information about the target 41 based on the first keyword, the related keyword before re-acquisition, and the related keyword (related information) after re-acquisition (S303).
[0047] When the related information database D1 has not been updated (S300: NO), or when the related keyword to be notified has not been updated as a result of re-acquiring the related keyword (S302: NO), the process proceeds to S304. In S304, the control unit 10 determines whether to end the notification of information. For example, when the user performs a predetermined operation, the control unit 10 determines to end the notification of information (S304: YES), and the process proceeds to the process of S102. For example, when the user is not performing a predetermined operation, the control unit 10 determines not to end the notification of information (S304: NO), and the process proceeds to the process of S300.
[0048] 〔Embodiment 3〕 Embodiment 3 of the present disclosure will be described below. For the sake of convenience of explanation, members having the same functions as those described in the above Embodiments 1 and 2 are denoted by the same reference numerals, and the description thereof will not be repeated.
[0049] FIG. 6 is a diagram showing a configuration example of an electric device according to Embodiment 3 of the present disclosure. The electric device 1B shown in FIG. 6 is a setup box, which is connected to a display unit 21 provided outside the electric device 1B, and causes the display unit 21 to display video content received via an antenna 20 or the like. The control unit 10 of the electric device 1B further functions as a recording unit 106. The recording unit 106 records the video content received by the content receiving unit 100.
[0050] FIG. 7 is a flowchart regarding the processing of the database storage unit in the electric device according to Embodiment 3 of the present disclosure. In Embodiment 3 of the present disclosure, when the recording unit 106 starts recording video content, the database storage unit 103 starts the processing shown in FIG. 7.
[0051] In S400, the control unit 10 acquires the frame images included in the video content received by the content reception unit 100. In S401, for the video content being recorded, its summary description text is acquired. In S402, the control unit 10 acquires the subtitles of the video content being recorded. For example, the control unit 10 acquires the subtitles (Closed Caption) of the subtitle broadcast corresponding to the program being recorded, the subtitles automatically generated for the program being recorded, and the like. In S403, the control unit 10 acquires the image information of characters from the frame images acquired in S400. In S404, the control unit 10 acquires the character information from the image information of the characters acquired in S403 by means of an optical character recognition technology or the like. In S405, the control unit 10 applies technologies such as text mining to the summary description text of the video content acquired in S401, the subtitles acquired in S402, and the character information acquired in S404 to acquire relevant keywords. In S406, the control unit 10 stores the relevant keywords acquired in S405 in the related information database D1. In S407, the control unit 10 determines whether to end the recording by the recording unit 106. For example, when the video content being recorded has ended, or when the control unit 10 receives an operation instruction from the user to end the recording, the control unit 10 determines to end the recording by the recording unit 106 (S407: YES) and ends the process of FIG. 7. For example, when the video content being recorded has not ended and the control unit 10 has not received an instruction from the user to end the recording, the control unit 10 determines not to end the recording by the recording unit 106 (S407: NO) and acquires the next frame image (S400). The processes of S401, S402, and S403 may execute at least any one of them, and it is not necessary to process them in the described order, and they may be processed in parallel.
[0052] 〔Modification Example〕 Although the electric device 1A according to the above-described Embodiments 1 and 2 is assumed to be a television, it may be a setup box having a display unit 21 provided externally as in the electric device 1B according to Embodiment 3. Further, although the electric device 1B according to the above-described Embodiment 3 is a setup box, the control unit 10 may function as a recording unit 106 that records the received video content, and it may be a television having a display unit 12. Further, the electric devices 1A and 1B according to the above-described Embodiments 1 to 3 may be other than a television and a setup box as long as they are electric devices capable of playing back the received video content. For example, the electric devices 1A and 1B according to the above-described Embodiments 1 to 3 may be a personal computer, a mobile phone, a smartphone, a tablet, a navigation device, or the like. Further, in the electric device 1A according to the above-described Embodiments 1 and 2, the control unit 10 may function as the recording unit 106.
[0053] In the electric devices 1A and 1B according to the above-described Embodiments 1 to 3, when displaying the target 41, information regarding the target 41 was notified to the user by displaying related keywords on the display unit 12 or 21. However, the method of notifying information regarding the target 41 may be a method other than displaying on the display unit 12 or 21. For example, it may be notification by voice, a pre-registered email address, information distribution to SNS, or the like.
[0054] In the electric devices 1A and 1B according to the above-described Embodiments 1 to 3, the remote controller 30 was used to select the target 41, but the input device used to select the target 41 is not limited to only the remote controller 30. For example, the target 41 may be selected using a mouse, a keyboard, a touch panel, a voice input device, or the like.
[0055] In the electrical device 1A according to the above-described Embodiment 2, when the related information database D1 is updated (S300: YES), the control unit 10, before and after the re-acquisition of the related keyword (S301), when the related keyword to be acquired changes (S302: YES), is configured to notify information based on the related keyword after the re-acquisition (S303). However, the control unit 10 may perform re-searching of the related keyword or re-notifying of information based on the related keyword when the related information database D1 is updated and information in a category predetermined by the notification unit 105 has not been notified yet. The predetermined category is, for example, when the first keyword for the target 41 is the name of an article, the name of the seller who sells the article, the price, etc. Also, when the first keyword for the target 41 is a person's name, the affiliation of the person, the contact information, etc.
[0056] In the electrical devices 1A and 1B according to the above-described Embodiments 1 to 3, the related keyword acquisition unit 104 is configured to acquire related keywords related to the first keyword from the related information database D1. However, the source from which the related keyword acquisition unit 104 acquires the related keyword may be other than the related information database D1. For example, the frames of the video content received by the content reception unit 100 may be stored in the storage unit 11, and related keywords may be acquired from the frames received by the content reception unit 100 before the first frame.
[0057] 〔Example of Realization by Software〕 The functions of the electrical device (hereinafter referred to as "device") can be realized by a program for causing a computer to function as the device, and by a program for causing a computer to function as each control block of the device (particularly each unit included in the control unit 10).
[0058] In this case, as hardware for executing the above program, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory). By executing the above program with this control device and storage device, each function described in each of the above embodiments is realized.
[0059] The above program may be recorded on one or more computer-readable recording media, rather than temporarily. This recording medium may or may not be included in the above device. In the latter case, the above program may be supplied to the above device via any wired or wireless transmission medium.
[0060] Also, part or all of the functions of the above control blocks can also be realized by a logic circuit. For example, an integrated circuit in which a logic circuit functioning as each of the above control blocks is formed is also included in the scope of the present disclosure. In addition to this, for example, it is also possible to realize the functions of the above control blocks by a quantum computer.
[0061] Also, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI may operate in the above control device, or may operate in another device (e.g., an edge computer or a cloud server, etc.).
[0062] 〔Summary〕 The electrical device according to Aspect 1 of the present disclosure includes a content receiving unit that receives video content, an object extraction unit that extracts an object from an image of a first frame of the video content received by the content receiving unit, a related keyword acquisition unit that acquires a keyword related to the object from a source different from the image of the first frame, and a notification unit that notifies the keyword when the object is displayed.
[0063] According to the above configuration, it is possible to suitably provide information about the object included in the video content.
[0064] In the electrical device according to Embodiment 2 of the present disclosure, in the above Embodiment 1, the source may be configured to include an image of a second frame received by the content receiving unit before the first frame among the frames included in the video content.
[0065] According to the above configuration, in order to obtain keywords from the image of the second frame received before the first frame, it is possible to provide the user with information with high accuracy along with the content of the video content.
[0066] The electrical device according to Embodiment 3 of the present disclosure may further include a name acquisition unit that acquires the name or title of the target in the above Embodiment 1, and the notification unit may notify the name or title of the target and the keyword when displaying the target.
[0067] According to the above configuration, it is possible to provide more information than before because the name or title of the target and the keyword are notified about the target.
[0068] The electrical device according to Embodiment 4 of the present disclosure may further include a name acquisition unit that acquires the name or title of the target and a related information acquisition unit that acquires related information related to the name or title of the target and the keyword in the above Embodiment 1, and the notification unit may notify the related information and the keyword when displaying the target.
[0069] According to the above configuration, it is possible to provide more information than before because the related information related to the name or title of the target and the keyword is acquired about the target, and the related information and the keyword are notified.
[0070] In the electrical device according to Embodiment 5 of the present disclosure, in the above Embodiments 1 to 4, the target extraction unit may include a selection unit that accepts a selection of the target from the image of the first frame.
[0071] According to the above configuration, information can be notified about the target for which the user desires information provision.
[0072] The notification method according to Aspect 6 of the present disclosure is a notification method in which an electrical device notifies a keyword for video content, and includes an object extraction step of extracting an object from an image of a first frame of the video content, a related keyword acquisition step of acquiring the keyword related to the object from a source different from the image of the first frame, and a notification step of notifying the keyword when the object is displayed on a predetermined display unit.
[0073] According to the above configuration, information provision can be suitably performed for the object included in the video content.
[0074] The electrical device according to Aspect 7 of the present disclosure includes a content reception unit that receives video content, a database storage unit that extracts related information related to the content of the video content from at least any one of a character string included as an image in the video content, a summary description text of the video content, and subtitles of the video content and stores it in a database, an object extraction unit that extracts an object that the user desires to search for from among the frame images of the video content, a first keyword acquisition unit that acquires a keyword indicating a result of recognizing what the object extracted by the object extraction unit is, a related keyword acquisition unit that acquires the related keyword related to the keyword from the database at the timing when the keyword is acquired by the first keyword acquisition unit, and a notification unit that notifies information about the object based on the keyword acquired by the first keyword acquisition unit and the related keyword acquired by the related keyword acquisition unit.
[0075] According to the above configuration, by acquiring information from a database that has accumulated data during the playback of video content, more information can be provided to the user than in the past.
[0076] In the electrical device according to aspect 8 of the present disclosure, in the above aspect 7, when the database is updated by the database storage unit during the period in which the notification unit notifies the user of information about the target, the related keyword acquisition unit re-searches for the related keyword related to the keyword from the updated database, and when the content of the related keyword changes before and after the re-search when the related keyword acquisition unit re-searches for the related keyword, the notification unit may notify information related to the target based on the related keyword after the re-search.
[0077] In video content, detailed explanations may be postponed. According to the above configuration, after presenting information to the user, when the database is updated, by acquiring information from the updated database, more accurate information can be provided to the user.
[0078] In the electrical device according to aspect 9 of the present disclosure, in the above aspect 7, the category of information to be notified about the target is predetermined, and when the database is updated when the information of the predetermined category is not included in the information related to the target presented by the notification unit to the user, the related keyword acquisition unit may re-search for the related keyword related to the keyword from the updated database.
[0079] During the period when video content is being played, the database may be updated frequently. If the information presented is updated every time the database is updated, the user may feel annoyed. According to the above configuration, when information of a specific category has already been disclosed to the user, the annoyance felt by the user can be reduced by not re-searching for related information.
[0080] The electrical device according to Embodiment 10 of the present disclosure further includes a recording unit that records the video content in Embodiment 7 above. The database storage unit may extract related keywords related to the content of the video content from at least any one of the character strings included as images in the video content, the summary description text of the video content, and the subtitles of the video content during the recording of the video content, and store them in the database.
[0081] When recording video content, by storing related keywords in the database during recording, highly accurate information can be quickly presented from the beginning of playback. In addition, by previously storing related keywords in the database during recording, the processing load on the electrical device when playing back video content can be reduced.
[0082] The program according to Embodiment 11 of the present disclosure is a program for causing a computer to function as the electrical device described in Embodiments 1 to 10 above, and causes the computer to function as the content reception unit, the target extraction unit, the related keyword acquisition unit, and the notification unit.
[0083] According to the above configuration, information can be preferably provided for the target included in the video content.
[0084] The recording medium according to Embodiment 12 of the present disclosure is a computer-readable recording medium on which the program of Embodiment 11 is recorded.
[0085] According to the above configuration, information can be preferably provided for the target included in the video content.
[0086] The electrical device according to each aspect of the present disclosure may be realized by a computer. In this case, a control program for realizing the electrical device by operating the computer as each unit (software element) included in the electrical device, and a computer-readable recording medium on which the program is recorded also fall within the scope of the present disclosure.
[0087] The present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope indicated in the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present disclosure. Furthermore, by combining the technical means disclosed in each embodiment, new technical features can be formed. For example, the present disclosure only needs to notify any of related keywords, first keywords, and related information when displaying an object.
Explanation of Reference Numerals
[0088] 1A, 1B Electrical equipment 10 Control unit 11 Storage unit 12, 21 Display unit 40 Frame image 41 Object 43 Information column 100 Content receiving unit 101 Object extraction unit 102 First keyword acquisition unit 103 Database storage unit 104 Related keyword acquisition unit 105 Notification unit 106 Recording unit
Claims
1. A content receiving unit that receives video content, An object extraction unit that extracts an object from an image of a first frame of the video content received by the content receiving unit, A related keyword acquisition unit that acquires a keyword related to the object from a source different from the image of the first frame, An electric device comprising: a notification unit that notifies the keyword when the object is displayed.
2. The electric device according to claim 1, wherein the source includes an image of a second frame received by the content receiving unit before the first frame among the frames included in the video content.
3. Further comprising a name acquisition unit that acquires the name or title of the object, The electric device according to claim 1, wherein the notification unit notifies the name or title of the object and the keyword when the object is displayed.
4. A name acquisition unit that acquires the name or title of the object, Further comprising a related information acquisition unit that acquires related information related to the name or title of the object and the keyword, The electric device according to claim 1, wherein the notification unit notifies the related information and the keyword when the object is displayed.
5. The electric device according to claim 1, wherein the object extraction unit includes a selection unit that accepts selection of the object from the image of the first frame.
6. A notification method for an electric device to notify a keyword about video content, An object extraction step of extracting an object from an image of a first frame of the video content, A related keyword acquisition step of acquiring the keyword related to the object from a source different from the image of the first frame, A notification step of notifying the keyword when the object is displayed on a predetermined display unit.
7. A program for causing a computer to function as the electric device according to claim 1, the program for causing a computer to function as the content receiving unit, the object extraction unit, the related keyword acquisition unit, and the notification unit.
8. A computer-readable recording medium recording the program according to claim 7.
Citation Information
Patent Citations
Image recognizing apparatus and image recognizing method
WO2008152805A1