Image processing program, image processing program, and image processing apparatus

Abstract

To provide an image processing program for performing new capture processing, an image processing program, and an image processing device.SOLUTION: In an image processing system, an image processing program causes a computer, which is a terminal device, to function as: a display control unit 242 which displays content on a display; a trigger detection unit 243 which detects a capture trigger for capturing a screen displayed on the display; an additional information acquisition unit 245 which acquires additional information corresponding to what is displayed on the display at a capture time corresponding to a capture trigger detection time; and an image generation unit 246 which captures the screen displayed on the display at the capture time and generates an image with additional information by adding additional information to the captured image.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an image processing program, an image processing program, and an image processing apparatus.

Background Art

[0002] Operating systems such as iOS (registered trademark) and Android (registered trademark) have a function of capturing the screen displayed on the display. However, such a capture function can only capture the displayed screen as it is.

Prior Art Documents

Non-Patent Documents

[0003]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Provided are an image processing program, an image processing program, and an image processing apparatus that perform a novel capture process.

Means for Solving the Problems

[0005] According to one aspect, there is provided an image processing program that causes a computer to function as a display control unit that displays content on a display, a trigger detection unit that detects a capture trigger for capturing a screen displayed on the display, an additional information acquisition unit that acquires additional information according to what is displayed on the display at the time of capture corresponding to the detection of the capture trigger, and an image generation unit that captures the screen displayed on the display at the time of capture and generates an image with additional information by adding the additional information to the captured image.

[0006] The computer may further function as a content reception unit that receives the content, and the display control unit may display the content received by the content reception unit on the display.

[0007] The additional information acquisition unit may acquire the additional information according to the content displayed on the display at the time of capture.

[0008] The additional information acquisition unit may acquire the additional information according to the scene of the content displayed on the display at the time of capture.

[0009] The additional information acquisition unit may acquire the additional information regarding the object included in the scene.

[0010] The computer may further function as a content information reception unit that receives content information and a content generation unit that generates the content based on the content information. The display control unit may display the content generated by the content generation unit on the display, and the additional information acquisition unit may acquire the additional information based on the content information.

[0011] The content information includes object information regarding objects appearing in the content, and the additional information acquisition unit may acquire the additional information based on the object information.

[0012] The object includes an avatar that moves in a three-dimensional virtual space, and the additional information may include information regarding the avatar and / or information regarding a performer corresponding to the avatar.

[0013] The objects appearing in the content include a plurality of avatars that move in a three-dimensional virtual space. When only some of the plurality of avatars are being displayed on the display at the time of capture, the additional information includes information regarding at least a part of the some avatars and / or information regarding a performer corresponding to at least a part of the some avatars, but may not include information regarding the other avatars among the plurality of avatars and information regarding a performer corresponding to the other avatars.

[0014] The additional information acquisition unit may identify the some avatars being displayed on the display at the time of capture based on the content information.

[0015] The additional information acquisition unit may notify the content distribution server that transmits the content information of the time of capture, and acquire the additional information based on the information received from the content distribution server in response to this notification.

[0016] The computer may further function as an image transmission unit that transmits the image with the additional information to an external device.

[0017] In response to detection of the capture trigger, the image generation unit may generate the image with the additional information, and the image transmission unit may transmit the image with the additional information to the external device.

[0018] The computer is further caused to function as a transmission trigger generation unit that generates a transmission trigger for transmitting the image with additional information to the external device in response to a user operation. The trigger detection unit detects the transmission trigger. The image generation unit captures the screen displayed on the display at the time of capture in response to the detection of the capture trigger, and adds the additional information to the captured image in response to the detection of the transmission trigger to generate the image with additional information. The image transmission unit may transmit the image with additional information to the external device in response to the detection of the transmission trigger. The external device may be a content distribution server that transmits the content information.

[0019] The external device may be a management server of the SNS application for displaying the image with additional information on the SNS application.

[0020] The computer may be further caused to function as a lights information generation unit that generates a unique lights information page for the image with additional information.

[0021] The lights information page may include information for circulating the image with additional information as a unique digital asset.

[0022] The additional information may include a URL associated with the lights information page.

[0023] The computer is further caused to function as a content information receiving unit that receives content information, and a content generation unit that generates the content based on the content information. The display control unit displays the content generated by the content generation unit on the display, and the lights information generation unit may generate the lights information based on the content information.

[0024] ​The content information includes object information regarding objects appearing in the content, and the rights information generation unit may generate the rights information based on the object information.

[0025] The object includes an avatar that acts in a three-dimensional virtual space, and the rights information may include information regarding the avatar and / or information regarding the performer corresponding to the avatar.

[0026] The additional information may include a URL associated with a web page according to what is displayed on the display at the time of the capture.

[0027] The image generation unit may generate the image with additional information by adding the additional information as metadata of the captured image.

[0028] The additional information is an additional image according to what is displayed on the display at the time of the capture, and the image generation unit may generate the image with additional information by superimposing the additional image on the captured image.

[0029] The additional image includes characters, and the image generation unit may add the characters in a color according to the captured image.

[0030] The computer may further function as a capture trigger generation unit that provides a GUI for generating the capture trigger to the user and generates the capture trigger in response to a user operation on the GUI.

[0031] According to another aspect, content is displayed on a display, a capture trigger for capturing the screen displayed on the display is detected, additional information corresponding to what is displayed on the display at the time of capture corresponding to the detection of the capture trigger is acquired, the screen displayed on the display at the time of capture is captured, and the additional information is added to the captured image to generate an image with additional information. An image processing method is provided.

[0032] According to still another aspect, there is provided an image processing apparatus including a display control unit that causes content to be displayed on a display, a trigger detection unit that detects a capture trigger for capturing the screen displayed on the display, an additional information acquisition unit that acquires additional information corresponding to what is displayed on the display at the time of capture corresponding to the detection of the capture trigger, and an image generation unit that captures the screen displayed on the display at the time of capture and adds the additional information to the captured image to generate an image with additional information.

Advantages of the Invention

[0033] New capture processing can be performed.

Brief Description of the Drawings

[0034]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6A

Figure 6B

Figure 6C

Figure 7

Figure 8

Figure 9A

Figure 9B

Figure 10

Figure 11A

Figure 11B

Figure 11C

Figure 12

Figure 13

Figure 14

Embodiments for Carrying Out the Invention

[0035] Hereinafter, the embodiments will be specifically described with reference to the drawings.

[0036] (First Embodiment) FIG. 1 is a block diagram showing the schematic configuration of an image processing system according to the first embodiment. The image processing system includes a content distribution server 1 and a terminal device 2.

[0037] The content delivery server 1 has a content transmission unit 11 that transmits content to the terminal device 2. There is no particular limitation on the content to be transmitted, and examples include movies, concerts, games, etc. The actors, filming sets, singers, costumes, characters, items, etc. that appear in these contents may be collectively referred to as objects. Further, the content transmission unit 11 may transmit information regarding additional information described later to the terminal device 2.

[0038] The terminal device 2 is used by the user and is any computer such as a smartphone, tablet terminal, personal computer, HMD (Head Mounted Display), etc. And the terminal device 2 has a display 21, an input interface 22, a storage unit 23, and a content control unit 24.

[0039] When the terminal device 2 is a smartphone or a tablet terminal, the input interface 22 may be a touch panel. And the touch panel is arranged to overlap the display 21 in a given positional relationship. Thereby, for example, when a selectable icon is displayed at a predetermined position on the display 21 and the corresponding position on the touch panel is touched, the terminal device 2 can recognize that the icon has been selected.

[0040] When the terminal device 2 is a personal computer, the input interface 22 is, for example, a mouse or a touch pad.

[0041] When the terminal device 2 is an HMD, the HMD includes the display 21. This display 21 can display a three-dimensional virtual space. And the input interface 22 is, for example a controller that operates a pointer within the space displayed on the display 21, or a button provided on the HMD.

[0042] The storage unit 23 of the terminal device 2 is composed of a RAM (Random Access Memory), a ROM (Read Only Memory), etc., and stores various programs and images with additional information described later. Note that the storage unit 23 does not necessarily have to be within the terminal device 2. For example, images with additional information, etc. may be stored in a storage device (not shown) on the cloud that is network-connected to the terminal device 2.

[0043] The content control unit 24 includes a content reception unit 241, a display control unit 242, a capture trigger generation unit 243, a trigger detection unit 244, an additional information acquisition unit 245, an image generation unit 246, and an image transmission unit 249. Some or all of the units within the content control unit 24 may be realized by a processor (not shown) of the terminal device 2 executing a predetermined content control program, may be implemented in hardware, or may be a function of the OS. It can also be said that the content control unit 24 provides a content control application to the user in cooperation with the content distribution server 1. The content reception unit 241 receives content from the content distribution server 1.

[0044] The display control unit 242 causes the received content to be displayed on the display 21. As an example, the display control unit 242 causes the content to be displayed in a content display area 91 that is part of the display 21 (see Figure 2).

[0045] Returning to Figure 1, the capture trigger generation unit 243 generates a trigger (hereinafter referred to as a "capture trigger") for capturing (acquiring a screenshot) the screen displayed on the display 21 in response to a predetermined operation using the input interface 22 by the user. More specifically, the capture trigger generation unit 243 provides a GUI (Graphical User Interface) for generating a capture trigger to the user. Then, when there is a predetermined operation from the user for this GUI, the capture trigger generation unit 243 generates a capture trigger.

[0046] For example, the capture trigger generation unit 243 causes a capture icon 92 (GUI) to be displayed in an area different from the content display area 91 on the display 21 (see FIG. 2). Then, in response to the capture icon 92 being selected using the input interface 22, the capture trigger generation unit 243 generates a capture trigger.

[0047] Returning to FIG. 1, the trigger detection unit 244 detects the capture trigger. The capture trigger may be generated by the capture trigger generation unit 243. Alternatively, the trigger detection unit 244 may detect, as the capture trigger, that a predetermined operation (for example, simultaneously pressing a plurality of buttons provided on the smartphone) for performing a capture based on the function of the OS has been performed on the input interface 22 of the terminal device 2, or that a capture based on the function of the OS of the terminal device 2 has been performed.

[0048] Further, the capture trigger may be generated without a user operation, such as when the content control unit 24 itself generates the capture trigger, and the trigger detection unit 244 may detect this. In this case, an image with additional information (described later) is generated without a user operation and is stored in the storage unit 23 in the terminal device 2 or transmitted to an external device.

[0049] The additional information acquisition unit 245 acquires additional information corresponding to what is displayed on the display 21 at the time of capture corresponding to the detection of the capture trigger. The additional information corresponding to what is displayed on the display 21 may be additional information corresponding to the content displayed on the display 21 or additional information corresponding to the screen (image) displayed on the display 21. It can also be said that. The fact that the additional information is not fixed but is corresponding to the screen displayed on the display 21 at the time of capture is one feature of this embodiment.

[0050] Note that the additional information acquisition unit 245 does not necessarily need to analyze what is displayed on the display 21 in order to acquire additional information corresponding to what is displayed on the display 21. The additional information acquisition unit 245 may also acquire the additional information corresponding to what is displayed on the display 21 from the outside. For example, the additional information acquisition unit 245 may analyze the data (such as content) included in the data received from the content distribution server 1 based on the time of capture, or may inquire of the content distribution server 1.

[0051] Here, the time of capture is typically the time when the capture trigger is generated (for example, the time when the user selects the capture icon 92), but it may also be a time slightly deviated from such a time. Alternatively, the time of capture may be a time based on the time when the capture trigger is generated. Specifically, it may be a predetermined time from the reference time, or it may be the time from the reference time until the user performs an operation to end the capture.

[0052] In addition, the additional information acquisition unit 245 may generate additional information by itself, may obtain an additional image from the outside (for example, the content distribution server 1), or may generate additional information based on the information obtained from the outside. The additional information acquisition unit 245 may select any of the pre-prepared additional information, and in any case, the additional information is expressed as "acquired". Specific examples of the additional information will be described later.

[0053] The image generation unit 246 captures the screen displayed on the display 21 at the time of capture, adds additional information to the captured image, and generates an image with additional information. Then, the image generation unit 246 stores the image with additional information in the storage unit 23. When the time of capture is a specific time, the generated image with additional information is a still image. When the time of capture is a specific time period, the generated image with additional information is a moving image. Note that the image generation unit 246 may also store the captured image itself (without additional information) in the storage unit 23.

[0054] As an example, the additional information is an image (hereinafter referred to as "additional image"), and the image generation unit 246 may capture the screen displayed on the display 21 at the time of capture and generate an image with additional information by superimposing the additional image thereon. This additional image may be a still image, a moving image, or characters. As another example, the image generation unit 246 may capture the screen displayed on the display 21 at the time of capture and generate an image with additional information by adding the additional information as metadata thereto. The additional information in this case is, for example, a URL (Uniform Resource Locator) associated with a specific web page.

[0055] The image transmission unit 249 transmits the generated image with additional information to an arbitrary external device. The transmitted image is stored in a storage device accessible from the external device. The external device may be a management server of the other application, such as an SNS (Social Networking Service) application, for displaying the image with additional information in the other application. Alternatively, the external device may be the content distribution server 1. That is, it may be the management server of the other application. Alternatively, the external device may be the content distribution server 1.

[0056] FIG. 3 is a flowchart showing an example of the processing operation of the terminal device 2 in FIG. 1. The display control unit 242 causes the content received by the content reception unit 241 to be displayed on the display 21 (step S1). During the display of the content, the user of the terminal device 2 can generate a capture trigger by selecting, for example, the capture icon 92 in FIG. 2 at an arbitrary point in time when the user desires to capture. When the capture trigger is detected by the trigger detection unit 244 (YES in step S2), the additional information acquisition unit 245 acquires additional information corresponding to the screen displayed on the display 21 at the time of capture (step S3). When the capture trigger is detected by the trigger detection unit 244 (YES in step S2), the additional information acquisition unit 245 acquires additional information corresponding to the screen displayed on the display 21 at the time of capture (step S3).

[0057] Then, the image generation unit 246 captures the screen displayed on the display 21 at the time of capture, adds additional information thereto, and generates an image with additional information (step S4). The generated image with additional information is stored in the storage unit 23 (step S5). Further, the image transmission unit 249 may transmit the image with additional information to an external device (step S6).

[0058] As described above, in this embodiment, in response to the detection of the capture trigger (step S2), without further user operations, acquisition of additional information (step S3), generation of an image with additional information (step S4), storage of the image with additional information (step S5), and transmission of the image with additional information to an external device are performed.

[0059] Hereinafter, some specific examples of additional information will be described.

[0060] The additional information can be corresponding to the content displayed on the display 21 at the time of capture (that is, which content is being displayed). More specifically, the additional information may be the name of the content displayed on the display 21 at the time of capture (hereinafter referred to as the "content name"). The content name does not necessarily have to be the formal name of the content itself, and may be its abbreviation or information that can identify the content. The generated image with additional information is, for example, an image in which the content name (and, if necessary, further copyright notices, etc.) as additional information is superimposed on the captured image.

[0061] As another example of additional information corresponding to the content, it may be a URL associated with an advertisement, promotional image, official website, etc. related to the content. In this case, an image with additional information in which the URL as additional information is superimposed on the captured image is generated. Alternatively, an image with additional information in which the URL as additional information is added as metadata of the captured image is generated. When the URL of the image with additional information with such metadata added is selected, the web page associated with that URL is acquired and displayed.

[0062] As another example of additional information according to the content, it may be information about an object in the content. The object is an actor, an avatar, a part of the avatar, a user of the avatar, a gift, etc. that appears in the content.

[0063] To generate such an image with additional information, the content distribution server 1 may send not only the content but also information indicating the content name, the above URL, information about an object in the content, etc. to the terminal device 2. Thereby, the additional information acquisition unit 245 can acquire the content name and the like. Alternatively, in response to the detection of the capture trigger, the additional information acquisition unit 245 may inquire the content distribution server 1 about the content name and the like. Specifically, the additional information acquisition unit 245 notifies the content distribution server 1 of the capture time. Then, in response to this notification, the content distribution server 1 may send information indicating the name of the content distributed to the terminal device 2 at the time of the capture to the terminal device 2.

[0064] Note that the additional information in this example is determined according to which content was being displayed at the time of capture, and does not depend on at which point in the content the capture trigger was detected. For example, the additional information when the capture trigger is detected at the beginning of the content and the additional information when the capture trigger is detected at the end of the content are the same.

[0065] In contrast, as another specific example, the additional information may vary depending on at which point in the content the capture trigger is detected.

[0066] For example, the additional information may be according to the scene (i.e., what kind of scene is being displayed) being displayed on the display 21 at the time of capture in the content.

[0067] As an example of additional information according to the scene, the additional information may relate to objects such as actors, filming sets, singers, costumes, characters and items in the game included in the scene displayed on the display 21 at the time of capture.

[0068] As an example of additional information regarding an object, the additional information may be the name of the object (hereinafter referred to as the "object name"). The object name does not necessarily have to be the official name of the object itself, and may be an abbreviation thereof or information that can identify the object.

[0069] In this case, an image with additional information in which the object name as the additional information is superimposed is generated. Then, for example, the name (object name) of the character appearing in the captured image is superimposed as additional information. In addition, the additional information may include information regarding an object other than the object name (for example, when the object is a game character, the rarity of the character), the name of the content delivery application, and the like.

[0070] As another example of additional information according to the object, it may be a URL associated with an advertisement, promotional image, official HP, HP for purchasing the object, etc. related to the object. In this case, for the captured image, an image with additional information in which the URL as the additional information is superimposed as an image is generated. Alternatively, an image with additional information in which the URL as the additional information is added as metadata of the captured image is generated. When the URL of the image with additional information with such metadata added is selected, the web page associated with that URL is acquired and displayed.

[0071] As another example of additional information according to the scene, the additional information may be according to the shooting location of the scene displayed on the display 21 at the time of capture. More specifically, the additional information may be an advertisement or the like of the shooting location or a store, tourist destination, theme park, etc. located at the shooting location.

[0072] Thus, in order to acquire additional information according to the scene, the content distribution server 1 may transmit, in addition to the content, additional information corresponding to each scene of the content to the terminal device 2. As a result, the additional information acquisition unit 245 can acquire additional information corresponding to the scene displayed at the time of capture. Alternatively, in response to the detection of the capture trigger, the additional information acquisition unit 245 may inquire of the content distribution server 1 about the additional information. Specifically, the additional information acquisition unit 245 notifies the content distribution server 1 of the time of capture. Then, in response to this notification, the content distribution server 1 may transmit to the terminal device 2 the additional information corresponding to the scene of the content that was being distributed from the content distribution server 1 to the terminal device 2 at the time of that capture.

[0073] As another specific example, the additional information may be based on the approximate time zone (beginning, middle, end, etc.) at the time of capture in the content, rather than the scene displayed on the display 21 at the time of capture in the content. Since the screen displayed on the display 21 differs depending on the time zone at the time of capture, the additional information corresponding to the time zone at the time of capture can also be said to be additional information corresponding to the screen displayed on the display 21 at the time of capture.

[0074] As a more specific example, when the content is a movie, the additional information when the capture trigger is detected at the beginning of the movie may be different from the additional information when it is detected at the end. Alternatively, when the content is a concert, different additional information may be acquired depending on which song is being displayed when the capture trigger is detected.

[0075] Thus, in the first embodiment, instead of capturing the content itself displayed on the display 21, an image with additional information obtained by adding additional information to the captured image can be generated. And the additional information can be additional information corresponding to the screen displayed on the display 21, rather than fixed information.

[0076] FIG. 4 is a block diagram showing a schematic configuration of an image processing system which is a modification of the image processing system of FIG. 1, and includes a terminal device 2'.

[0077] In response to detection of a capture trigger, the image processing system of FIG. 1 performs acquisition of additional information, generation of an image with additional information, storage of the image with additional information in the terminal device 2, and transmission of the image with additional information to an external device, without any further user operation. In contrast, the image processing system of FIG. 4 performs generation of an image with additional information, storage of the image with additional information in the terminal device 2', and transmission of the image with additional information to an external device, in response to the user generating a transmission trigger for transmitting the image after detection of the capture trigger.

[0078] Specifically, the content control unit 24 in the terminal device 2' of FIG. 4 includes a transmission trigger generation unit 24A. The transmission trigger generation unit 24A generates a transmission trigger for transmitting an image with additional information to an external device in response to a predetermined operation using the input interface 22 by the user. More specifically, the transmission trigger generation unit 24A provides a GUI for generating a transmission trigger to the user. Then, when there is a predetermined operation from the user for this GUI, the transmission trigger generation unit 24A generates a transmission trigger.

[0079] For example, as shown in FIG. 5, the transmission trigger generation unit 24A displays a transmission icon 93 (GUI) in an area different from the content display area 91 and the capture icon 92 on the display 21. Then, in response to the transmission icon 93 being selected using the input interface 22, the transmission trigger generation unit 24A generates a transmission trigger. The generated transmission trigger is detected by the trigger detection unit 244. That is, the trigger detection unit 244 performs both detection of the capture trigger and detection of the transmission trigger.

[0080] FIG. 6A is a flowchart showing an example of the processing operation of the terminal device 2' of FIG. 4. The processes common to FIG. 3 are denoted by common reference numerals, and steps S1 to S3 are common to FIG. 3.

[0081] In FIG. 3, an additional image is generated in response to a capture trigger. In contrast, in this modified example shown in FIG. 6A, in response to the detection of a capture trigger, the image generation unit 246 captures the screen displayed on the display 21 at the time of capture to obtain a capture image (step S10A, and stores it in the storage unit 23 in the terminal device 2' as necessary), and at this point, no additional information - attached image is generated.

[0082] When the trigger detection unit 244 detects a transmission trigger (YES in step S10B), the image generation unit 246 adds additional information to the capture image obtained in step S21 to generate an additional information - attached image (step S4). The generated additional information - attached image is stored in the storage unit 23 of the terminal device 2' (step S5). Also, the image transmission unit 249 transmits the additional information - attached image to an external device (step S6).

[0083] Thus, in this modified example, in response to the detection of a capture trigger (step S2), without further user operation, additional information acquisition (step S3) and capture (step S10A) are performed. Then, in response to the detection of a transmission trigger (step S10B), without further user operation, generation of an additional information - attached image (step S4), storage of the additional information - attached image in the terminal device 2' (step S5), and transmission of the additional information - attached image to an external device (step S6) are performed. In this modified example, an additional information - attached image is generated when transmitting the image to an external device.

[0084] Note that in the terminal device 2' of FIG. 4, the user may be able to select whether to perform up to the transmission of an additional information - attached image in response to the detection of a capture trigger (without detecting a transmission trigger) as shown in FIG. 3, or to perform up to capture in response to the detection of a capture trigger as shown in FIG. 6A and then perform up to the transmission of an additional information - attached image in response to the detection of a transmission trigger.

[0085] Figure 6B is a flowchart showing another example of the processing operation of the terminal device 2' in FIG. 4. As shown in the figure, in response to detecting the capture trigger generated by the capture trigger generation unit 243 (YES in step S2), acquisition of additional information (step S3), generation of an image with additional information (step S4), and storage of the image with additional information (step S5) are performed. In response to detecting the transmission trigger generated by the transmission trigger generation unit 24A (YES in step S10B), transmission of the image with additional information (step S6) may be performed.

[0086] Figure 6C is a flowchart showing another example of the processing operation of the terminal device 2' in FIG. 4. As shown in the figure, in response to detecting the capture trigger generated by the capture trigger generation unit 243 (YES in step S2), acquisition of a captured image (step S10A) is performed. In response to detecting the transmission trigger generated by the transmission trigger generation unit 24A (YES in step S10B), acquisition of additional information (step S3), generation of an image with additional information (step S4), storage of the image with additional information (step S5), and transmission of the image with additional information (step S6) may be performed.

[0087] As the processing of step S3 in this case, for example, the additional information acquisition unit 245 can transmit a request for acquiring additional information to the content distribution server 1 together with information indicating the capture time, and receive the additional information from the content distribution server 1 to acquire the additional information.

[0088] (Second Embodiment) In the above-described first embodiment, content is transmitted from the content distribution server 1, and the terminal device 2 displays this on the display 21. In the second embodiment to be described next, information necessary for content generation is transmitted from the content distribution server 1a, and based on this, the terminal device 2a generates content and displays it on the display 21 (so-called client rendering). In the following description, points common to the first embodiment may be omitted.

[0089] FIG. 7 is a block diagram showing a schematic configuration of an image processing system according to the second embodiment. The image processing system includes one or more distribution devices 3, one or more content distribution servers 1a, one or more viewer terminal devices 4, one or more gift servers 5, and a terminal device 2a.

[0090] In this embodiment, as an example, it is assumed that the content is a three-dimensional virtual space in which one or more avatars are active. Each avatar corresponds to an actual performer. And the actions and words of the performer are reflected in the actions and words of the avatar corresponding to the performer in the three-dimensional virtual space.

[0091] Specifically, the performer uses the distribution device 3 to activate the avatar corresponding to himself / herself. The distribution device 3 includes a distributor terminal device 31 (for example, a smartphone) and a sensor 32 connected thereto. The sensor 32 includes a motion sensor, a microphone (not shown), etc., and acquires the actions and words of the distributor. Then, information indicating the actions and words of the distributor (hereinafter referred to as "motion information") is transmitted from the distributor terminal device 31 to the content distribution server 1a.

[0092] In addition, avatar information is transmitted from the distributor terminal device 31 to the content distribution server 1a. The avatar information is information about the avatar or the corresponding performer. The avatar information may include identification information of the performer and the corresponding avatar, information on the appearance of the avatar, identification information of the parts of the avatar (hair style, eyes, nose, mouth, etc.), identification information of the decorations of the avatar (clothes, shoes, accessories, etc.), information indicating the movement (including direction) of each part of the avatar (head, body, etc.), information indicating the facial expression of the avatar (movement of eyes, movement of mouth, etc.), a URL associated with detailed information (profile, official HP, etc.) of the avatar (or the corresponding performer), etc. Note that since the avatar is also an example of an object appearing in the content, the avatar information can also be said to be object information.

[0093] Further, comment information may be transmitted from the distributor's terminal device 31 to the content distribution server 1a. The comment information may include comments from the distributor (i.e., the performer), the distributor's identification information, and a URL or the like associated with detailed information linked thereto. Comment information may also be transmitted from the viewer's terminal device 4 and / or the terminal device 2a, which will be described later.

[0094] Note that motion information, avatar information, and comment information may be transmitted from a plurality of distribution devices 3 to the content distribution server 1a. In this case, a plurality of avatars appear in the three-dimensional virtual space as the content.

[0095] Furthermore, the content viewer can display a gift on the content using the viewer's terminal device 4 (e.g., a smartphone). Specifically, gift information is transmitted from the viewer's terminal device 4 to the gift server 5. The gift information may include the identification information of the viewer who displays the gift, the identification information of the gift to be displayed, the identification information of the content to be displayed, and a URL or the like associated with the detailed information (profile, official website, etc.) of the viewer who displays the gift. Gift information may also be transmitted from the distribution device 3 and / or the terminal device 2a.

[0096] In the present embodiment, the content distribution server 1a has a content information transmission / reception unit 12. The content information transmission / reception unit 12 does not transmit the content itself, but transmits various types of information that can be used for content generation to the terminal device 2a. This various types of information includes avatar information and motion information received from the distribution device 3, as well as the identification information of the content, the identification information of the background of the three-dimensional virtual space, and the like.

[0097] Also, the gift server 5 has a gift information transmission / reception unit 51. The gift information transmission / reception unit 51 receives gift information from the viewer's terminal device 4 and transmits it to the terminal device 2a. The gift information can also be used for content generation.

[0098] In the present embodiment, the content distribution server 1a and the gift server 5 are assumed to be separate, but they may be integrated.

[0099] And the content control unit 24 of the terminal device 2a includes a content information receiving unit 247, a content generating unit 248, and an image transmitting unit 249.

[0100] The content information receiving unit 247 receives information (hereinafter collectively referred to as "content information") received from the content distribution server 1a and the gift server 5. If necessary, the content information is stored in the storage unit 23. The content information is stored in the storage unit 23.

[0101] The content generating unit 248 generates content based on the content information. As a specific example, the content generating unit 248 generates video content in which an avatar based on avatar information performs activities based on motion information in a three-dimensional virtual space. The three-dimensional virtual space may include comments based on comment information and gifts according to gift information. Then, the display control unit 242 causes the display 21 to display video content including comments based on the received comment information and gifts based on the received gift information.

[0102] And the additional information acquisition unit 245 of the present embodiment can acquire additional information corresponding to the screen displayed on the display 21 at the time of capture based on the content information.

[0103] Also, the additional information acquisition unit 245 notifies the content distribution server 1a of the time of capture (information for identifying the user using the terminal device 2a if necessary), and requests the distribution server for information corresponding to the screen displayed on the display 21 at the time of capture (for example, through the API (Application Programming Interface) of the content control application), and may receive information necessary for acquiring additional information. Via), and receive information necessary for acquiring additional information.

[0104] That is, a part of the information included in the above-described content information may be transmitted from the content distribution server 1a to the terminal device 2a in response to a request from the additional information acquisition unit 245. As a specific example, the content name, the identification information of the performer (or the corresponding avatar) among the avatar information, and the URL associated with the detailed information of the performer (or the corresponding avatar) may be received from the content distribution server 1a in response to a request from the additional information acquisition unit 245.

[0105] The image transmission unit 249 transmits the generated image with additional information to an arbitrary external device. The transmitted image is stored in a storage device accessible from the external device. The external device may be a management server of the other application for displaying the image with additional information in another application such as an SNS application. Alternatively, the external device may be the content distribution server 1a. Hereinafter, mainly the latter will be described.

[0106] FIG. 8 is a flowchart showing an example of the processing operation of the terminal device 2a in FIG. 7. The content generation unit 248 generates content based on the content information received by the content information reception unit 247 (step S11). Then, the display control unit 242 causes the content generated by the content generation unit 248 to be displayed on the display 21 (step S12). During the display of the content, the user of the terminal device 2a can generate a capture trigger by selecting, for example, the capture icon 92 in FIG. 2 at an arbitrary point in time when the user desires to capture.

[0107] When the capture trigger is detected by the trigger detection unit 244 (YES in step S13), the additional information acquisition unit 245 acquires additional information corresponding to the content (screen) displayed on the display 21 at the time of capture based on the content information received by the content information reception unit 247 in step S11. Alternatively, the additional information acquisition unit 245 transmits the time of capture to the content distribution server 1a to acquire the additional information corresponding to the time of capture from the distribution server 1a (step S14).

[0108] Then, the image generation unit 246 captures the screen displayed on the display 21 at the time of capture, and adds additional information thereto to generate an image with additional information (step S15). The generated image with additional information is stored in the storage unit 23 of the terminal device 2a (step S16). Also, the image transmission unit 249 transmits the image with additional information to the content distribution server 1a (step S17). Then, the image with additional information is also stored in the storage unit 13 of the content distribution server 1a.

[0109] In this way, in response to the detection of the capture trigger (step S13), without any further user operation, acquisition of additional information (step S14), generation of an image with additional information (step S15), storage of the image with additional information in the terminal device 2a (step S16), transmission of the image with additional information to the content distribution server 1a (step S17), and storage of the image with additional information in the content distribution server 1a are performed.

[0110] Hereinafter, several specific examples of additional information will be described.

[0111] The additional information may correspond to the scene of the content displayed on the display 21 at the time of capture. More specifically, the additional information may relate to objects such as the avatar or its ornaments displayed on the display 21 at the time of capture. Even more specifically, it may be the name of the avatar (or the corresponding performer, the same hereinafter) displayed on the display 21. Such additional information is acquired based on the avatar information in the content information.

[0112] In this case, for example, as shown in FIG. 9A, the image with additional information may be an image in which, with respect to the captured image, a copyright notice 61 is added at the lower part thereof, the name 62 of the avatar 60 that is displayed (appearing) at the time of capture, and a URL 63 associated with the detailed information of the avatar 60 (for example, the profile page, official page, SNS account, etc. of the avatar 60) are added as additional information. Further, such a URL may be associated as metadata of the image with additional information.

[0113] Here, when superimposing characters such as a URL as additional information on the captured image, the additional information acquisition unit 245 may add the characters in a color corresponding to the color of the image to be superimposed (for example, a complementary color to the color of the entire image) so that the characters are easy to read. The color of the image may be acquired from the content generation unit 248.

[0114] Also, when a plurality (for example, 50) of avatars appear in the content, but only a part (for example, 2 avatars) of them appear at the time of capture, the additional information may include information only about those 2 avatars and may not include information about avatars that did not appear at other times of capture. The additional information acquisition unit 245 can grasp which avatars are appearing at the time of capture based on the content information.

[0115] In this case, for example, as shown in FIG. 9B, the image with additional information may be an image in which, with respect to the captured image, a copyright notice, the names of the 2 avatars 60, 70 that are displayed (appearing) at the time of capture, and URLs associated with the detailed information of the performers corresponding to these 2 avatars 60, 70 are added as additional information 64, 71 at the lower part thereof. Further, such a URL may be associated as metadata of the image with additional information. Note that when a large number (for example, 20 out of 50) of avatars appear at the time of capture, the additional information may be only about a part (for example, 2 out of 20) of them, and in this case, the additional information does not include information about the other part (for example, the remaining 18 out of the above 20).

[0116] When a large number of avatars are appearing during capture, priority levels are assigned to each avatar, and information regarding only a predetermined number of avatars based on this priority level may be included in the additional information. Alternatively, each avatar may include a flag indicating whether or not to include information regarding the avatar in the additional information. Based on this flag, the additional information may be generated.

[0117] Also, information of a specific avatar may always be fixedly included in the additional information (i.e., even if the specific avatar is not displayed on the display 21 during capture), and in addition, information of the avatars displayed on the display 21 during capture may be included in the additional information.

[0118] When a user posts such an image with additional information to a specific application (e.g., an SNS application), the added URL is shown in a manner accessible by viewers of the application. The accessible manner includes, for example, the URL being displayed in a specific area of the image, being displayed as a hashtag, or being automatically inserted into the posting field.

[0119] When accessing the URL, various information can be referenced on a web page or the like associated with the URL. Also, information indicating that the generated image with additional information is an official image properly generated by the content delivery application can be referenced. Furthermore, by making the URL a unique URL, it becomes possible to grasp the diffusion status from the number of accesses to the URL, and thus information indicating how much the generated image with additional information has been diffused can also be referenced. Note that the unique URL may be unique for specific additional information (e.g., for each avatar or content), or may be unique for the image with additional information. According to the former, the diffusion status can be grasped in units of specific additional information such as avatars or content, and according to the latter, the diffusion status can be grasped in units of the image with additional information.

[0120] In addition, when an image with additional information is posted to a specific application, a hashtag based on the additional information may be automatically assigned. The hashtag is, for example, the content name, avatar name, related keywords, etc. Then, in the said application, the hashtag associated with the content information or additional information is displayed or automatically inserted into the posting field. And the displayed or inserted hashtag may be deleted or edited by oneself. By automatically inserting the hashtag, the hashtag is unified, the posting is effectively spread, and it becomes easier for the user to make a post.

[0121] Note that the posting to a specific application such as an SNS may be manually performed by the user of the terminal device 2, or may be automatically performed by the image transmission unit 249 in response to the detection of the capture trigger. In the former case, when the image with additional information is generated, the image transmission unit 249 may display a prompt for posting to the SNS. In the latter case, in step S17 of FIG. 11A, the image transmission unit 249 may present options for the posting destination application (such as an SNS), and the user may select a desired application as the posting destination from those options.

[0122] The additional information may be a link or advertisement related to the avatar. The link related to the avatar is, for example, the SNS account of the performer corresponding to the avatar, the distribution content information, the information of the music included in the content, the information of the object such as the decoration used by the avatar (or the HP for purchasing the object), the link to the URL associated with the official HP of the avatar, etc. These information may also be included in the content information (avatar information).

[0123] Thus, in the second embodiment, when receiving content information from the content distribution server 1a and generating content in the terminal device 2a, it is possible to generate an image with additional information in which additional information corresponding to what is displayed (the displayed content) on the display 21 is added to the captured image.

[0124] Note that the first embodiment and the second embodiment may be combined. That is, the terminal device 2a is provided with the content receiving unit 241 of FIG. 1. When content is transmitted from the content distribution server 1, the display control unit 242 of the terminal device 2a causes the content to be displayed on the display 21. When content information is transmitted from the content distribution server 1a, the content control unit 24 of the terminal device 2a generates content based on the content information, and the display control unit 242 may cause this to be displayed on the display 21.

[0125] FIG. 10 is a block diagram showing a schematic configuration of an image processing system which is a modification of the image processing system of FIG. 7.

[0126] In response to detection of a capture trigger, the image processing system of FIG. 7 performs acquisition of additional information, generation of an image with additional information, storage of the image with additional information in the terminal device 2a, and transmission of the image with additional information to the content distribution server 1a without any further user operation. In contrast, in the image processing system of FIG. 10, in response to the user generating a transmission trigger for transmitting an image after detection of the capture trigger, generation of an image with additional information, storage of the image with additional information in the terminal device 2b, and transmission of the image with additional information to the content distribution server 1a are performed.

[0127] Specifically, the content control unit 24 in the terminal device 2b of FIG. 10 has a transmission trigger generation unit 24A. The transmission trigger generation unit 24A generates a transmission trigger for transmitting an image with additional information to the content distribution server 1a (external device) in response to a predetermined operation using the input interface 22 by the user. More specifically, the transmission trigger generation unit 24A provides the user with a GUI for generating a transmission trigger. Then, when there is a predetermined operation from the user with respect to this GUI, the transmission trigger generation unit 24A generates a transmission trigger.

[0128] For example, as shown in FIG. 5, the transmission trigger generation unit 24A causes a transmission icon 93 (GUI) to be displayed in an area different from the content display area 91 and the capture icon 92 on the display 21. Then, in response to the selection of the transmission icon 93 using the input interface 22, the transmission trigger generation unit 24A generates a transmission trigger. The generated transmission trigger is detected by the trigger detection unit 244. That is, the trigger detection unit 244 performs both detection of the capture trigger and detection of the transmission trigger.

[0129] FIG. 11A is a flowchart showing an example of the processing operation of the terminal device 2b in FIG. 10. The processes common to FIG. 8 are denoted by common reference numerals, and steps S11 to S14 are common to FIG. 8.

[0130] In FIG. 8, an additional image is generated in response to a capture trigger, whereas in this modified example shown in FIG. 11A, in response to the detection of the capture trigger, the image generation unit 246 captures the screen displayed on the display 21 at the time of capture (step S21, and stores it in the storage unit 23 in the terminal device 2b as necessary), and at this point, the generation of an image with additional information is not performed.

[0131] When the trigger detection unit 244 detects a transmission trigger (YES in step S22), the image generation unit 246 adds additional information to the image captured in step S21 to generate an image with additional information (step S15). The generated image with additional information is stored in the storage unit 23 of the terminal device 2b (step S16). Also, the image transmission unit 249 transmits the image with additional information to the content distribution server 1a (step S17). Then, the image with additional information is also stored in the storage unit 13 of the content distribution server 1a.

[0132] Thus, in this modified example, in response to the detection of the capture trigger (step S13), without further user operations, additional information acquisition (step S14) and capture (step Step S21) is performed. Next, in response to the detection of a transmission trigger (step S22), without any further user operation, generation of an image with additional information (step S15), saving of the image with additional information in the terminal device 2b (step S16), transmission of the image with additional information to the content distribution server 1a (step S17), and saving of the image with additional information in the content distribution server 1a are performed. In this modified example, an image with additional information is generated when the image is transmitted to the content distribution server 1a (external device).

[0133] Note that in the terminal device 2b of FIG. 11A, the user may be able to select whether to perform up to the transmission of an image with additional information in response to the detection of a capture trigger (without performing the detection of a transmission trigger) as shown in FIG. 8, or whether to perform up to capture in response to the detection of a capture trigger as shown in FIG. 11A and then perform up to the transmission of an image with additional information in response to the detection of a transmission trigger.

[0134] FIG. 11B is a flowchart showing another example of the processing operation of the terminal device 2b in FIG. 10. As shown in the figure, in response to the detection of the capture trigger generated by the capture trigger generation unit 243 (YES in step S13), acquisition of additional information (step S14), generation of an image with additional information (step S15), and saving of the image with additional information (step S16) are performed. In response to the detection of the transmission trigger generated by the transmission trigger generation unit 24A (YES in step S22), transmission of the image with additional information (step S17) may be performed.

[0135] FIG. 11C is a flowchart showing another example of the processing operation of the terminal device 2b in FIG. 10. As shown in the figure, in response to the detection of the capture trigger generated by the capture trigger generation unit 243 (YES in step 13), acquisition of a captured image (step S21) is performed, and in response to the detection of the transmission trigger generated by the transmission trigger generation unit 24A (YES in step S22), acquisition of additional information (step S14), generation of an image with additional information (step S15), storage of the image with additional information (step S16), and transmission of the image with additional information (step S17) may be performed.

[0136] As the process of step S14 in this case, for example, the additional information acquisition unit 245 can transmit a request for acquisition of additional information to the content distribution server 1 together with information indicating the time of capture, and receive the additional information from the content distribution server 1, thereby acquiring the additional information.

[0137] (Third Embodiment) The third embodiment to be described next assumes that the generated image with additional information is distributed as a unique digital asset. Hereinafter, as a specific example, based on the standards of the marketplace such as Ethereum (ERC-721 or ERC-1155) or OpenSea and Rarible, the image with additional information is distributed as an NFT (Non-Fungible Token). A new market value can be created for the distributed content images and videos, and the distribution can be promoted.

[0138] FIG. 12 is a block diagram showing a schematic configuration of an image processing system according to the third embodiment. Hereinafter, the description common to the second embodiment is omitted, and the description will focus on the differences.

[0139] In the terminal device 2c in the image processing system shown in FIG. 12, the content control unit 24 further includes a lights information generation unit 24B. The lights information generation unit 24B generates a unique lights information page that serves as a starting point for distributing an image with additional information as an NFT (unique digital asset) in response to the detection of a capture trigger or in response to the generation of an image with additional information, based on content information as necessary. The lights information page is composed of various lights information, and at least a part of it is for distributing the image with additional information as an NFT information. And the additional information acquired by the additional information acquisition unit 245 may include at least a part of the lights information.

[0140] The lights information includes unique identification information (ID) for the generated image with additional information.

[0141] Also, the lights information may include information indicating a title. As a specific example, the title may be based on the content name or the identification information of an avatar (or the corresponding performer, the same hereinafter). Also, the title may be based on the facial expression of the avatar included in the content information, or may be based on information related to the characters or performers included in the game or video.

[0142] Also, the lights information may include information indicating the app name and the rights holder. In addition, the lights information may include a URL associated with the app and a URL associated with the rights holder. Specific examples of such URLs include a URL that can access the app that distributes the content, a URL of the rights holder's HP, and a URL of the official HP of the content subject to the rights.

[0143] In addition, the light information may include information indicating the avatar as the distributor, the avatar displayed on the display 21 at the time of capture, information indicating objects or gifts such as decorations of the avatar (specific examples include URLs for obtaining (purchasing or lottery) gifts), or may include URLs associated with these avatars, objects, or gifts. The information indicating the avatar is, for example, a profile including the name of the avatar, the URL of the official HP of the avatar, the URL of the profile page, and the official SNS account.

[0144] In addition, the light information may include various other information regarding the image with additional information. When the image with additional information is a moving image, the light information may include a thumbnail that is a part of the moving image.

[0145] In addition, the light information includes timestamps of the generation time and the publication time, and may include license information such as information on whether the image with additional information can be redistributed and the period during which it can be distributed. The light information may also include information on whether the image with additional information is paid or free, information on the number of replicable times and the number of times replicated at the current time, information on the owner of the image with additional information, a URL associated with privilege information for the purchaser, and distribution information such as information on the market when distributed as an NFT.

[0146] In addition, the light information may include any information regarding the avatar. Note that all of the information included in the light information may be automatically generated by the light information generation unit 24B, or a part of the information included may be generated based on an operation by the user who instructed the capture.

[0147] If the content is not the 3D virtual space where the avatar performs the exercise activity, the rights information may be information about any object instead of the information about the avatar described above. For example, if the content is related to a game app, the rights information may include information about the game name, save data that reproduces the scene at the time of capture, the character being displayed, its level and clothing, etc., and the status of the character may be included in the rights information.

[0148] When the rights information page is generated, it becomes possible to circulate this image with additional information in the NFT market. If the image with additional information is a moving image, only the thumbnail included in the rights information is publicly displayed on the rights information page, and the full version of the moving image may be provided only to the purchaser. The full version of the moving image may or may not have a copyright notice. This is acceptable. If the moving image includes music, its copyright can be included. Also, the rights of the music can be verified with the content ID etc., and if it cannot be resolved, a process of muting or reducing the sound quality may be added.

[0149] Also, the rights information page is associated with a URL. Figure 13 is a diagram schematically showing the rights information page. The rights information page contains rights information. Specifically, it includes a name (the poster (i.e., the owner) of the image with additional information) 81, an explanation (app name) 82, etc. Furthermore, the rights information page may include preview information 83. The preview information 83 is a preview of the screen displayed based on the rights information included in the rights information page when the rights information page is posted on another app (for example, an SNS app). Also, the rights information page may include information about the copyright owner, the quantity of images that can be circulated as NFTs, the price, etc.

[0150] When a URL associated with a lights information page is posted to another application (e.g., an SNS application), a screen based on the lights information (see FIG. 14) is displayed. This screen corresponds to the preview information 83 in FIG. 13, and part or all of the lights information is included as image information or text information. The screen illustrated in FIG. 14 includes the poster (i.e., the owner) 94 of the image with additional information, the posting date 95, the URL 96 associated with the lights information page, the title and app name 97 in the lights information, and the image 98 with additional information.

[0151] In this embodiment, an example of adding a lights information generation unit 24B to the terminal device 2a in FIG. 7 has been shown, but the lights information generation unit 24B may be added to the terminal device 2 in FIG. 1 or the terminal device 2b in FIG. 10. Also, the timing of generating the lights information may be at any time after detection of the capture trigger.

[0152] Thus, in the third embodiment, it becomes possible to distribute an image with additional information as a unique digital asset.

[0153] The image with additional information as the NFT generated here can also function as a ticket.

[0154] As an example, a privilege may be provided to the owner of such an image with additional information. As a more specific example, an experience related to the content in the lights information included in the image with additional information may be provided to the user. As an even more specific example, only a user determined to own the image with additional information can enter a specific zone in the 3D virtual space, can view a predetermined video, can participate in a predetermined event, and so on.

[0155] In addition, benefits may be provided only to users who have generated an image with additional information including rights information about a specific program or content. As its merits, it is possible to promote capture by users and expect the spread and promotion of the content. In addition, the image with additional information generated by the capture includes rights information, and since the whereabouts of the rights are clear, it is possible to spread, distribute, and promote the rights in a form that appropriately protects the rights. Furthermore, by promoting the distribution of the image with additional information as an NFT and returning a part of the consideration to the rights holder each time it is distributed, a legitimate profit can also be returned to the rights holder. Here, the "rights holder" may be the distributor of the original content or the user (image holder) who captured the image.

[0156] The programs mentioned in this specification may be distributed by being non-temporarily recorded on a computer-readable recording medium, may be distributed via a communication line such as the Internet (including wireless communication), or may be distributed in a state installed on an arbitrary terminal. It may also be implemented as a smart contract processed on the Ethereum blockchain. Good.

[0157] In each of the above-described embodiments, the additional information may be a combination of information that is fixedly added regardless of the content (screen) displayed on the display 21 at the time of capture (such as the logo of the content distribution service) and information corresponding to the content (screen) displayed on the display 21 at the time of capture. Also, as examples of information on avatars, characters, and performers, in addition to these names, catchphrases, stage names, and information on affiliated groups may be included. Also, in the case of game characters, attribute information such as rarity may be included. Furthermore, when the image to be captured contains information such as personal information that is not desirable to spread, or when there is a high possibility that it contains such information, that part may be automatically mosaicked or sealed, or a notification may be given that there is an inappropriate display in an area where comments from viewers are displayed, etc.

[0158] In addition, although each embodiment mainly described the mode in which a capture trigger is generated according to a user operation, the capture trigger may be generated by a content control unit or a content distribution server. In the latter case, the rights holder, content distributor, or service operator of the content can efficiently generate an image with additional information and actively distribute it or utilize it for advertising and promotion.

[0159] Based on the above description, those skilled in the art may be able to conceive of additional effects and various modifications of the present invention. However, the aspects of the present invention are not limited to the individual embodiments described above. Various additions, changes, and partial deletions are possible without departing from the conceptual ideas and spirit of the present invention derived from the content defined in the claims and their equivalents.

[0160] For example, what is described as one device in this specification (including what is depicted as one device in the drawings) may be implemented by a plurality of devices. Conversely, what is described as a plurality of devices in this specification (including what is depicted as a plurality of devices in the drawings) may be implemented by one device. Alternatively, some or all of the means and functions included in a certain device (for example, a server) may be included in another device (for example, a user terminal). Functions such as setting the resale right of an image to be circulated as an NFT, the right to hold an auction, the right to edit a video, and the right to translate can also be easily analogized.

[0161] Also, not all of the matters described in this specification are essential requirements. In particular, matters described in this specification but not described in the claims can be regarded as arbitrary additional matters.

[0162] It should be noted that the applicant is merely aware of the inventions disclosed in the documents in the "Prior Art Documents" column of this specification, and the present invention does not necessarily aim to solve the problems of the inventions disclosed in the documents. The problems that the present invention aims to solve should be identified by taking into consideration the entire specification. For example, if the specification states that a specific effect is achieved by a specific configuration, it can also be said that the problem that is the reverse of the specific effect is solved. However, it is not necessarily intended that such a specific configuration is an essential requirement.

[0163] Some of the inventions described in this specification address the following issues. That is, when a user arbitrarily takes a capture (screenshot) of distributed content (video, program, game, animation, etc.), the image displayed on the screen is captured as is. When a capture is taken as is, the ownership of the rights to the captured image becomes unclear. In addition, when a captured image is spread on SNS or the like, there is a risk that it may be used by a third party in a manner unintended by the rights holder, without the ownership of the rights remaining unclear.

[0164] On the other hand, if we were to uniformly restrict users' ability to capture content, it would result in unnecessarily restricting the use of content, limiting the opportunities for users to enjoy the content. Even if we prohibit capture, if the technology to disable the function that prohibits capture becomes widespread, it would essentially enable unlimited capture, and there is a risk that images will be spread and used in ways that the rights holder does not intend.

[0165] Some of the inventions described in this specification may have the following effects: By generating a captured image (image with additional information) to which additional information such as content rights information and related information is added according to the content of the captured image, it is possible to appropriately protect each right of the distributed content while encouraging viewers to use the content.

[0166] Since it is possible to promote diffusion after appropriately protecting the rights, users can obtain and enjoy the capture of the content, which also serves as advertising for the rights holders and is convenient for both parties.

[0167] The advantages of using related URLs as additional information are as follows. It becomes easy to determine whether the accessed URL is from an image with additional information spread on SNS or the like. Also, the advertising effect of the accessed destination URL can be estimated, and it is possible to grasp how other official websites, etc. have been accessed. Furthermore, it becomes easy to grasp the diffusion status of images with additional images.

[0168] As an advantage of automatically adding a hash tag based on additional information, the addition of the hash tag can promote posting and diffusion to SNS by users.

[0169] The advantages of using the content name or rights information as additional information are as follows. By adding the content name and rights information, the source of the distributed content and the rights holder can be made recognizable to users, making it easier for users to recognize that it is protected as a right. Also, an effect of suppressing the deformation and modification of images unintended by the rights holder can be expected. And of course, for the capturing users, as well as for the users who view the images with additional information spread on SNS etc., the location of the rights can be made recognizable.

[0170] The advantages of dynamically changing additional information according to the content displayed on the display at the capture trigger are as follows. The content of 1 may contain various information, but it is cumbersome to include all the information in the additional information and difficult to appeal to users. On the other hand, if the additional information is limited in advance, when a capture trigger is generated at a predetermined location in the content, it may happen that the information related to the content displayed on the display at the capture trigger is not included in the additional information (particularly prominent in the case of content with a large amount of information). By adding information related to the content, avatar, gift, etc. included in the captured image, it is possible to accurately notify the user of the right information. Also, in the case of the official HP of the avatar or the URL of the purchase page of the gift, etc., it becomes more effective promotion.

[0171] The advantages of being able to NFTize an image are as follows. By NFTizing, a new economic value in the digital content market is born in the image with additional information acquired by the user. By circulating the image or video as an NFT in the market, it is also possible to earn income for the right holder of the image, and a legitimate profit can be obtained as the right holder. Also, it is possible to earn income for the user who circulated the image as an NFT.

[0172] Append the original claims at the time of the original application. [Appendix 1] A computer, A display control unit for displaying content on a display, A trigger detection unit for detecting a capture trigger for capturing the screen displayed on the display, An additional information acquisition unit for acquiring additional information according to what is displayed on the display at the time of capture corresponding to the detection of the capture trigger, An image generation program that functions as an image generation unit that captures the screen displayed on the display at the time of capture, adds the additional information to the captured image, and generates an image with additional information. [Appendix 2] The computer is further caused to function as a content receiving unit that receives the content. The image processing program according to Supplementary Note 1, wherein the display control unit causes the content received by the content receiving unit to be displayed on the display. [Supplementary Note 3] The image processing program according to Supplementary Note 1 or 2, wherein the additional information acquisition unit acquires the additional information corresponding to the content displayed on the display at the time of the capture. [Supplementary Note 4] The image processing program according to any one of Supplementary Notes 1 to 3, wherein the additional information acquisition unit acquires the additional information corresponding to the scene of the content displayed on the display at the time of the capture. processing program. [Supplementary Note 5] The image processing program according to Supplementary Note 4, wherein the additional information acquisition unit acquires the additional information regarding the object included in the scene. [Supplementary Note 6] The computer is further caused to function as a content information receiving unit that receives content information, and a content generation unit that generates the content based on the content information. The display control unit causes the content generated by the content generation unit to be displayed on the display, The image processing program according to claim 1, wherein the additional information acquisition unit acquires the additional information based on the content information. [Supplementary Note 7] The content information includes object information regarding an object that appears in the content, The image processing program according to claim 6, wherein the additional information acquisition unit acquires the additional information based on the object information. [Supplementary Note 8] The object includes an avatar that acts in a three-dimensional virtual space, The additional information includes information about the avatar and / or information about the performer corresponding to the avatar, and is the image processing program described in Supplementary Note 7. [Supplementary Note 9] The objects appearing in the content include a plurality of avatars that act in a three-dimensional virtual space. When only some of the plurality of avatars are being displayed on the display at the time of capture, the additional information includes information about at least a part of the some of the avatars and / or information about the performer corresponding to at least a part of the some of the avatars, but does not include information about the other avatars among the plurality of avatars and information about the performer corresponding to the other avatars, and is the image processing program described in Supplementary Note 7. [Supplementary Note 10] The additional information acquisition unit grasps the some of the avatars being displayed on the display at the time of capture based on the content information, and is the image processing program described in Supplementary Note 9. [Supplementary Note 11] The additional information acquisition unit notifies the content distribution server that transmits the content information of the time of capture, and acquires the additional information based on the information received from the content distribution server in response to this notification, and is the image processing program described in any one of Supplementary Notes 6 to 10. [Supplementary Note 12] The computer further functions as an image transmission unit that transmits the image with the additional information to an external device, and is the image processing program described in any one of Supplementary Notes 6 to 11. [Supplementary Note 13] In response to detection of the capture trigger, the image generation unit generates the image with the additional information, and the image transmission unit transmits the image with the additional information to the external device, and is the image processing program described in Supplementary Note 12. [Supplementary Note 14] ​​​Further cause the computer to function as a transmission trigger generation unit that generates a transmission trigger for transmitting the image with the additional information to the external device in response to a user operation. The trigger detection unit detects the transmission trigger. The image generation unit In response to the detection of the capture trigger, captures the screen displayed on the display at the time of capture. In response to the detection of the transmission trigger, adds the additional information to the captured image to generate an image with the additional information. The image transmission unit transmits the image with the additional information to the external device in response to the detection of the transmission trigger. The image processing program according to Supplementary Note 12. [Supplementary Note 15] The external device is a content distribution server that transmits the content information. Supplementary Note The image processing program according to any one of 12 to 14. [Supplementary Note 16] The external device is a management server of the SNS application for displaying the image with the additional information on the SNS application. The image processing program according to any one of Supplementary Notes 12 to 14. gram. [Supplementary Note 17] Further cause the computer to function as a lighting information generation unit that generates a unique lighting information page for the image with the additional information. The image according to any one of Supplementary Notes 1 to 16. processing program. [Supplementary Note 18] The lighting information page includes information for circulating the image with the additional information as a unique digital asset. The image processing program according to Supplementary Note 17. [Supplementary Note 19] The additional information includes a URL associated with the lighting information page. Supplementary Note 17 or the image processing program according to 18. [Supplementary Note 20] Further cause the computer to A content information receiving unit that receives content information, function as a content generation unit that generates the content based on the content information, The display control unit causes the content generated by the content generation unit to be displayed on the display. The lighting information generation unit generates lighting information constituting the lighting information page based on the content information, the image processing program according to any one of Appendices 17 to 19 . [Appendix 21] The content information includes object information regarding an object that appears in the content. The lighting information generation unit generates the lighting information based on the object information, the image processing program according to Appendix 20. [Appendix 22] The object includes an avatar that acts in a three-dimensional virtual space. The lighting information includes information regarding the avatar and / or information regarding a performer corresponding to the avatar, the image processing program according to Appendix 21. [Appendix 23] The additional information includes a URL associated with a web page according to what is displayed on the display at the time of capture, the image processing program according to any one of Appendices 1 to 22 image processing program. [Appendix 24] The image generation unit generates an image with additional information by adding the additional information as metadata of the captured image, the image processing program according to any one of Appendices 1 to 23 described image processing program. [Appendix 25] The additional information is an additional image according to what is displayed on the display at the time of capture. The image generation unit generates an image with additional information by superimposing the additional image on the captured image, the image processing program according to any one of Appendices 1 to 23 [Appendix 26] The additional image includes characters. The image generation unit adds the characters in a color corresponding to the captured image. The image processing program according to claim 25. [Appendix 27] The computer is further caused to function as a capture trigger generation unit that provides a user with a GUI for generating the capture trigger and generates the capture trigger in response to a user operation on the GUI. The image processing according to any one of Appendices 1 to 26. program. [Appendix 28] Cause content to be displayed on a display, Detect a capture trigger for capturing the screen displayed on the display, Obtain additional information corresponding to what is displayed on the display at the time of capture corresponding to the detection of the capture trigger, Capture the screen that was displayed on the display at the time of capture, and add the additional information to the captured image to generate an image with additional information. An image processing method. [Appendix 29] A display control unit that causes content to be displayed on a display, A trigger detection unit that detects a capture trigger for capturing the screen displayed on the display, An additional information acquisition unit that obtains additional information corresponding to what is displayed on the display at the time of capture corresponding to the detection of the capture trigger, An image processing apparatus including: an image generation unit that captures the screen that was displayed on the display at the time of capture and adds the additional information to the captured image to generate an image with additional information.

Explanation of Signs

[0173] 1, 1a Content distribution server 11 Content transmission unit 12 Content information transmission / reception unit 13 Storage unit 2, 2’, 2a, 2b, 2c Terminal device 21 Display 22 Input Interface 23 Memory Unit 24 Content Control Unit 241 Content Receiver 242 Display Control Unit 243 Capture Trigger Generation Unit 244 Trigger Detection Unit 245 Additional Information Acquisition Unit 246 Image Generation Unit 247 Content Information Receiver 248 Content Generation Unit 249 Image Transmitter 24A Transmission Trigger Generation Unit 24B Lights Information Generation Unit 3 Distribution Device 31 Terminal Device for Distributor 32 Sensor 4 Terminal Device for Viewer 5 Gift Server 51 Gift Information Transceiver

Claims

1. A computer, a display control unit for causing content to be displayed on a display, a trigger detection unit for detecting a capture trigger for capturing a screen displayed on the display, an additional information acquisition unit for acquiring an additional image corresponding to the content displayed on the display at the capture time corresponding to the detection of the capture trigger, functioning as an image generation unit that captures the screen displayed on the display at the capture time and generates an image with additional information, which is a still image, by superimposing the additional image on the captured image, wherein the additional image includes lighting information, an image processing program.

2. The lighting information is unique identification information for the image with additional information, the content, an avatar or corresponding actor appearing in the content, and an object displayed on the display at the capture time, based on any one of them, the image processing program according to claim 1.

3. The computer functions as means for providing a privilege to a user who has generated an image with additional information on which an additional image including the lighting information is superimposed, the image processing program according to claim 1 or 2.

4. The image with additional information on which an additional image including the lighting information is superimposed functions as a ticket, the image processing program according to any one of claims 1 to 3.

5. A computer, a display control unit for causing content to be displayed on a display, a trigger detection unit for detecting a capture trigger for capturing a screen displayed on the display, an additional information acquisition unit for acquiring an additional image corresponding to the content displayed on the display at the capture time corresponding to the detection of the capture trigger, functioning as an image generation unit that captures the screen displayed on the display at the capture time and generates an image with additional information, which is a still image, by superimposing the additional image on the captured image, functioning as a lighting information generation unit for generating a unique lighting information page for the image with additional information, an image processing program.

6. The additional image includes a URL related to the content, the image processing program according to any one of claims 1 to 5.

7. The additional image includes a URL related to an object displayed on the display at the time of capture, and the image processing program according to any one of claims 1 to 5.

8. The object is an avatar or a gift, and the image processing program according to claim 7.

9. When the image with additional information is posted to a specific application, the URL is displayed in an accessible manner, and the image processing program according to any one of claims 6 to 8.

10. When the image with additional information is posted to a specific application, the URL is displayed as a hashtag, or the URL is inserted into the posting field, and the image processing program according to any one of claims 6 to 8.

11. The additional image corresponds to the time zone at the time of capture in the content, and the image processing program according to any one of claims 1 to 5.

12. The additional image relates to an object displayed on the display at the time of capture, and the image processing program according to any one of claims 1 to 5.

13. The additional image includes the name of the object displayed on the display at the time of capture, and the image processing program according to claim 12.

14. When the image with additional information is posted to a specific application, a hashtag associated with the additional image is displayed, and the image processing program according to any one of claims 1 to 5.

15. Display content on a display, Detect a capture trigger for capturing the screen displayed on the display, Obtain an additional image corresponding to the content displayed on the display at the capture time corresponding to the detection of the capture trigger, Capture the screen that was displayed on the display at the time of capture, and generate an image with additional information that is a still image by superimposing the additional image on the captured image, The additional image includes lighting information, and an image processing method.

16. Display content on a display, Detect a capture trigger for capturing the screen displayed on the display, Obtain an additional image corresponding to the content displayed on the display at the capture time corresponding to the detection of the capture trigger, Capture the screen displayed on the display at the time of the capture, superimpose the additional image on the captured image to generate an image with additional information that is a still image, An image processing method for generating a unique lights information page for the image with additional information.

17. A display control unit for displaying content on a display, A trigger detection unit for detecting a capture trigger for capturing the screen displayed on the display, An additional information acquisition unit for acquiring an additional image corresponding to the content displayed on the display at the capture time corresponding to the detection of the capture trigger, An image generation unit that captures the screen displayed on the display at the time of the capture, and superimposes the additional image on the captured image to generate an image with additional information that is a still image, The additional image includes lights information, an image processing apparatus.

18. A display control unit for displaying content on a display, A trigger detection unit for detecting a capture trigger for capturing the screen displayed on the display, An additional information acquisition unit for acquiring an additional image corresponding to the content displayed on the display at the capture time corresponding to the detection of the capture trigger, An image generation unit that captures the screen displayed on the display at the time of the capture, and superimposes the additional image on the captured image to generate an image with additional information that is a still image, An image processing apparatus comprising a lights information generation unit for generating a unique lights information page for the image with additional information.

Images