Information processing device, end roll generating method, and program

Abstract

To provide an information processing device or the like capable of customizing credits of a game, a movie, or the like.SOLUTION: An information processing device 1 photographs a face image of a user (player) in the middle of executing a game with a camera 17 and estimates his or her emotion based on the face image with an emotion estimation unit 21. When an estimated emotion score is a predetermined value or more, a captured image 122 in a game screen is recorded with a capture unit 22 and stored in a storage unit 12. when the game is finished, a credits generation unit 23 generates credits by using the recorded captured image 122.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing device, an end credits generating method, and a program, and more particularly to generating end credits for video content such as games and movies. [Background technology]

[0002] Traditionally, RPGs (role-playing games) have had end credits added to the end of the story, and the end credits are played when the player clears the game. The end credits include the names of the production staff along with the ending theme song and in-game scenes, allowing the player to look back on the game's story and enjoy the afterglow. However, end credits are generally standardized, and the same ones are provided to every user.

[0003] Regarding the generation of end credits for video content, for example, Patent Document 1 proposes adding commercial video content to the front credits or end credits of a content stream in a system for distributing content generated by individual users. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2006-338080 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, in order to enjoy the afterglow of the video content, it is desirable for the end credits to reproduce scenes that moved or left a strong impression on the user.

[0006] The present invention has been made in consideration of the above problems, and has an object to provide an information processing device or the like that is capable of customizing the end credits of video content such as games and movies. [Means for solving the problem]

[0007] A first invention for solving the above-mentioned problems includes a video playback means for playing video content, a capture means for saving a captured image of the video content, and an end credits generation means for generating an end credits of the video content using the captured image saved by the capture means. The video content is further provided with an emotion estimation means for estimating the emotion of a user viewing the video content and separately scoring two or more emotions other than normal (unemotional), the emotion estimation means instructs the capture means to capture the screen at the timing when any one of the scores of the emotions other than normal (unemotional) reaches a predetermined value or more, and does not instruct the capture means when the score of the emotion other than normal (unemotional) does not reach the predetermined value, and the capture means records the captured image in association with information on the emotion at that time. The present invention is an information processing device.

[0008] According to the information processing device of the first invention, a captured image that records a screen of video content such as a game, a movie, a video, etc. is stored, and the saved captured image is used to generate an end credits for the video content. This allows the end credits for games, movies, etc. to be customized, and it becomes possible to play a different end credits for each user. In addition, scenes that are memorable or moving to the user can be captured and used in the end credits. Also, captured images can be recorded according to changes in the user's emotions without the user having to perform any operations.

[0010] In the first aspect of the present invention, it is preferable to further include a photographing means for photographing a face image of the user, and the emotion estimation means estimates the emotion of the user based on the face image photographed by the photographing means. This makes it possible to estimate the emotion from the facial expression of the user.

[0012] The end credits generating means may insert a captured image acquired when the user expressed a particular emotion into the end credits. 。 A second invention provides a video content playback device that plays back video content, a capture device that saves a captured image of the video content, and a credits generation device that uses the captured image saved by the capture device to generate a credits roll for the video content, the credits generation device comprising: The captured image is randomly selected and inserted into the end credits. The information processing device is characterized by: This makes it possible to automatically generate end credits using captured images.

[0013] It is also preferable to further comprise a selection means for selecting whether or not to generate an end roll by the end roll generating means, thereby allowing the user to select whether or not to customize the end roll.

[0014] A third invention includes a video playback means for playing back video content, a capture means for saving a captured image of the video content, and an end credits generation means for generating an end credits for the video content using the captured image saved by the capture means, The apparatus further includes a photo book generating unit that generates a photo book using the captured images. 、 The photo book generating means is configured to arrange the image of the user taken by the photographing means next to the captured image. The information processing device is characterized in that This means that It can generate photo books that collect memorable or moving scenes for users, and also By arranging images of the user in the scenes of the captured images side by side, a memorable photo book can be provided.

[0015] It is also preferable to further include a photo movie generating means for generating a photo movie that combines music with the captured images. This makes it possible to generate an original photo movie that combines music such as background music or a theme song for video content with the captured images.

[0016] No. 4 The invention relates to a method for playing back video content by a computer, comprising: a step of estimating the emotion of a user viewing the video content, and separately scoring two or more emotions other than normal (neutral), and a step of not issuing a capture instruction when the score of an emotion other than normal (neutral) does not reach a predetermined value, and issuing a capture instruction to capture a screen at a time when any one of the scores of the emotions other than normal (neutral) reaches or exceeds a predetermined value; A capture image of the video content , and link it to the emotional information at that time. The end roll generating method includes the steps of: storing the captured image; and generating an end roll for the video content using the stored captured image. A fifth invention is an end roll generating method including the steps of: a computer playing video content; saving a capture image of the video content; and generating an end roll for the video content using the saved capture image, wherein in the step of generating an end roll for the video content, the acquired capture image is randomly selected and inserted into the end roll. A sixth invention is an end roll generating method characterized by including the steps of: a computer playing video content; saving a capture image of the video content; photographing and storing a user; generating an end roll for the video content using the saved capture image; and arranging an image of the user photographed in the step of photographing and storing the user alongside the capture image to generate a photo book.

[0017] No. 3 to 6 The invention Either A captured image of the screen of the video content being played is saved, and the saved captured image is used to generate the end credits of the video content. This allows the end credits of games, movies, etc. to be customized, and different end credits can be played for each user.

[0018] No. 7 The present invention provides a program for causing a computer to function as a video playback unit that plays video content, a capture unit that saves a captured image of the video content, and an end credits generation unit that uses the captured image saved by the capture unit to generate an end credits for the video content. a program for making the computer function as emotion estimation means for estimating an emotion of a user viewing the video content and separately scoring two or more emotions other than normal (neutral), the emotion estimation means instructing the capture means to capture a screen at a timing when any one of the scores of the emotions other than normal (neutral) reaches a predetermined value or more, and not issuing a capture instruction when the score of the emotion other than normal (neutral) does not reach the predetermined value, and the capture means recording the captured image in association with information on the emotion at that time. It is. An eighth invention is a program for causing a computer to function as a video playback means for playing video content, a capture means for saving a captured image of the video content, and an end roll generation means for generating an end roll for the video content using the captured image saved by the capture means, wherein the end roll generation means is a program for randomly selecting an acquired captured image and inserting it into the end roll. The ninth invention is a program for causing a computer to function as a video playback means for playing video content, a capture means for saving captured images of the video content, and an end credits generation means for generating an end credits for the video content using the captured images saved by the capture means, and further causing the computer to function as a photobook generation means for generating a photobook using the captured images, and a photographing means for photographing and storing a user, the photobook generation means arranging an image of the user photographed by the photographing means alongside the captured images.

[0019] No. 7th, 8th, 9th With the invention of each, The computer, , second, third It is possible to make the information processing device function as the information processing device of the present invention. Effect of the Invention

[0020] The present invention can provide an information processing device or the like that is capable of customizing the end credits of games, movies, and the like. [Brief description of the drawings]

[0021] [Figure 1] FIG. 1 shows an external configuration of an information processing device 1. [Diagram 2] FIG. 1 shows a hardware configuration of an information processing device 1. [Diagram 3] FIG. 1 shows a functional configuration of an information processing device 1. [Figure 4] A diagram explaining emotion estimation results and capture actions. [Diagram 5] A diagram explaining how to associate a captured image 122 with emotions. [Figure 6] FIG. 2 is a diagram showing an example of a folder structure in the storage unit 12. [Figure 7] Example of how to generate end credits [Figure 8] Example of how to generate end credits [Figure 9] Example of how to generate end credits [Figure 10] 1 is a flowchart showing a flow of processing executed by the information processing device 1. [Figure 11] Diagram showing the operation of the player and the operation flow of each part [Figure 12] FIG. 1 shows a functional configuration of an information processing apparatus 1A according to a second embodiment. [Figure 13] Diagram showing the operation of the player and the operation flow of each part [Figure 14] 1 is a flowchart showing a flow of processing executed by information processing device 1A. [Figure 15] FIG. 13 is a diagram showing a functional configuration of an information processing apparatus 1B according to a third embodiment; [Figure 16] Flowchart showing the flow of photo book generation processing [Figure 17] FIG. 13 is a diagram showing a functional configuration of an information processing device 1C according to a fourth embodiment. [Figure 18] Flowchart showing the flow of photo movie generation processing DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings.

[0023] [First embodiment] FIG. 1 is a diagram showing an external configuration of an information processing device 1 according to a first embodiment of the present invention, and FIG. 2 is a diagram showing a hardware configuration of the information processing device 1. The information processing device 1 is, for example, a device capable of reproducing video content such as a PC, a game device, a DVD / BD player, or a smartphone. In the example of FIG. 1, the information processing device 1 is configured by a PC including a main body unit 10, a display unit 14, a camera 17, an input unit 15, and the like. As shown in FIG. 2, the main body unit 10 includes a control unit 11, a storage unit 12, a communication unit 13, and an image processing unit 16. In addition, the information processing device 1 includes a peripheral device I / F unit 18 for connecting the information processing device 1 to peripheral devices. The control unit 11, the storage unit 12, the communication unit 13, the image processing unit 16, the display unit 14, the input unit 15, the camera 17, and the peripheral device I / F unit 18 are connected by a bus 19 or the like.

[0024] The control unit 11 is composed of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The CPU loads programs stored in the storage unit 12, the ROM, a recording medium, etc. into a work memory area on the RAM and executes them, and drives and controls each unit connected via a bus 19. The ROM permanently stores programs such as the computer's boot program and BIOS, data, etc. The RAM temporarily stores loaded programs and data, and also has a work area used by the control unit 11 to perform various processes. The control unit 11 functions as each means of the information processing device 1 by reading and executing the above programs.

[0025] The storage unit 12 is a storage device such as a hard disk drive, a solid state drive, or a flash memory, and stores programs executed by the control unit 11 in the processes described below, data necessary for executing the programs, an OS, etc. These programs and data are read out as necessary by the control unit 11 and transferred to the RAM, and are then read out and executed by the CPU.

[0026] The storage unit 12 stores video data 121. The video data 121 is game data (including game programs and game video data) and data of video content such as movies and videos. The video data 121 may be data recorded on a medium such as a DVD or BD, or may be data downloaded via the communication unit 13.

[0027] Furthermore, the storage unit 12 stores a capture image 122. The capture image 122 is screen recording data of the video data 121, and is an image that records the screen while the game is being played (while the video content is being played), and is acquired in a process that will be described later. Details of these data will be described later.

[0028] The communication unit 13 has a communication control device, a communication port, etc., and is a communication interface that mediates communication between the information processing device 1 and a network. The network includes a network such as a LAN (Local Area Network), a WAN (Wide Area Network), the Internet, etc., and a short-range wireless communication such as Bluetooth (registered trademark). The connection form may be either wired or wireless (Wi-Fi).

[0029] The image processing unit 16 is a GPU (Graphics Processing Unit) or the like, and is a calculation device that mainly executes processes related to image depiction and video playback of computer graphics, etc. Note that instead of the image processing unit 16, the CPU of the control unit 11 may execute processes related to image depiction and video content playback.

[0030] The display unit 14 is composed of a display such as a liquid crystal panel, and a logic circuit (such as a video adapter) for executing display processing in cooperation with the display, and displays on the display the display data input under the control of the control unit 11 and the video data generated by the image processing unit 16. The display unit 14 may be a touch panel display in which an input device such as a touch panel is integrally provided on the display screen.

[0031] The input unit 15 includes, for example, a touch panel, a keyboard, a pointing device such as a mouse, an input device such as a numeric keypad, a game controller, etc., and inputs input data to the control unit 11.

[0032] The camera 17 is a video camera using an imaging element such as a CCD image sensor or a CMOS image sensor, and obtains a user image by photographing the user. The user image is input to the control unit 11 and used to estimate the user's emotion.

[0033] The peripheral device I / F (interface) unit 18 is a port for connecting peripheral devices. The peripheral device I / F unit 18 is configured with a USB, a video signal input / output interface, etc. The connection with the peripheral devices may be wired or wireless. The bus 19 is a path that mediates the transmission of control signals, data signals, etc. between the devices.

[0034] 3 is a diagram showing a functional configuration of the information processing device 1. As shown in FIG. 3, the information processing device 1 includes a feeling estimation unit 21, a capture unit 22, and an end roll generation unit 23 in addition to the above-mentioned storage unit 12, display unit 14, image processing unit 16, and camera 17. The functions of the feeling estimation unit 21, the capture unit 22, and the end roll generation unit 23 are realized by the control unit 11 of the information processing device 1 executing processing. Programs for realizing these functions are stored in the storage unit 12 and are read and executed by the control unit 11. The above programs may be part of a game program or video content, or may be recorded on a medium together with the game program or video content and be read and executed by the control unit 11.

[0035] The emotion estimation unit 21 estimates and scores the emotion of a user (player) who is playing a game or watching video content. Specifically, the emotion estimation unit 21 acquires an image of the user captured by the camera 17 and estimates the emotion of the user by a method such as analyzing changes in facial expressions. For emotion estimation, known methods such as emotion recognition AI "Affdex" (https: / / affectiva.jp / ) and an algorithm called FVAEs (Factorized Variational Autoencoders) (https: / / neurosciencenews.com / neuroscience-terms / fvaes / ) can be used. The emotion estimation unit 21 inputs an instruction to record the capture image 122 to the capture unit 22 according to the emotion score value.

[0036] FIG. 4 is a diagram showing an example of emotion scores. The emotion estimation unit 21 analyzes the facial expression of the user, and as shown in FIG. 4, quantifies (scores) various emotions such as "normal (no emotion)", "fun", "sad", "surprise", and "anger". When the score of an emotion other than "normal (no emotion)" is equal to or greater than a predetermined value, an instruction to capture the screen at that time is issued. For example, as shown in FIG. 4(a), when the score of "normal (no emotion)" is large and the scores of other emotions do not reach a predetermined value, a capture instruction is not issued. As shown in FIG. 4(b), when the scores of emotions other than "normal (no emotion)" reach a predetermined value or greater, a capture instruction is input. In FIG. 4(b), the score of the emotion "fun" is "90%", so a capture instruction is input to the capture unit 22. The emotion estimation unit 21 inputs a capture instruction to the capture unit 22 not only when the emotion score of "fun" is large, but also when the emotion scores of other emotions such as "sad", "surprise", and "anger" are equal to or greater than a predetermined value. Alternatively, the focus may be on a specific emotion, and only when the score of the specific emotion is equal to or greater than a predetermined value, a capture instruction may be input to the capture unit 22. Although the emotions estimated by the emotion estimation unit 21 are exemplified as "normal (no emotion)", "joy", "sadness", "surprise", and "anger", various other emotions (such as "regret" and "impatience") may also be estimated.

[0037] The capture unit 22 records one or more frames (one to multiple screens) of the video content (video data 121) displayed on the display unit 14 as a still image or a video. In the first embodiment, when the emotion score other than "normal (no emotion)" in the emotion estimation unit 21 is equal to or greater than a predetermined value, a capture instruction is input to the capture unit 22. Upon receiving the capture instruction, the capture unit 22 records (screen record) the frame data displayed on the display of the display unit 14 at that time. The capture unit 22 stores the screen-recorded image (captured image 122) in the storage unit 12.

[0038] The capture unit 22 may store the captured image 122 in association with information on the emotion at that time. Fig. 5 illustrates an example of association between emotions and the captured image 122. For example, the captured image 122a is recorded in association with the emotion "fun", the captured image 122b is recorded in association with the emotion "sad", the captured image 122c is recorded in association with the emotion "surprise", and the captured image 122d is recorded in association with the emotion "anger".

[0039] FIG. 6 is a diagram showing an example of the structure of a folder for saving the captured image 122 in the storage unit 12. As shown in FIG. 6, a folder (chapter folder) is generated for each "chapter" of the game, and a folder is further generated for each type of emotion in the chapter folder. For example, in the second chapter of the game, the captured image 122a recorded when the user's score for the emotion "fun" is equal to or higher than a predetermined value is stored in the "fun" folder in the second chapter folder. By saving in such a folder structure, it is possible to identify in which chapter of the game story the captured image 122 was saved and with what emotion it was saved. Also, instead of creating a folder, the file name of each captured image 122 may indicate the "chapter" and the "type of emotion." For example, if the captured image 122 was recorded in the second chapter with a fun emotion, a character string such as "02_tanoshii" may be added to the file name and saved. Furthermore, the capture time may be recorded in the file name.

[0040] The end roll generating unit 23 generates an end roll for the video content using the captured images 122 stored by the capture unit 22. For example, as shown in Fig. 7, the end roll generating unit 23 randomly selects a captured image 122 stored and generates an end roll by inserting the image into a predetermined area of ​​a standard end roll (such as a staff roll) prepared in advance.

[0041] Also, for example, as shown in Fig. 8, the end roll generating unit 23 may select only the captured images 122 recorded when a specific emotion was expressed, and insert them into a standard end roll. Also, as shown in Fig. 9, the captured images 122 saved in the order of the story (the order in which the captured images 122 were obtained) may be inserted into a standard end roll.

[0042] It is preferable to allow the user to select whether or not to customize the end roll (generation of the end roll by the end roll generation unit 23) before the story of the video content begins. For example, on the start screen of the game, it is possible to select whether or not to customize the end roll, and if a selection is made not to customize, a normal (standard) end roll prepared in advance is used, and if a selection is made to customize, an original end roll is generated by executing the operations of the emotion estimation unit 21, capture unit 22, and end roll generation unit 23 of this embodiment.

[0043] Next, the flow of processing executed by information processing device 1 will be described with reference to a flowchart. Fig. 10 is a flowchart showing the flow of processing executed by information processing device 1, and Fig. 11 is a diagram showing the flow of operations of the player and the operations of each part. Note that the following description will be given of a case where the video content is a game, but similar processing can be applied to video content such as movies, not limited to games.

[0044] As shown in FIG. 10, when a game is started, the control unit 11 of the information processing device 1 displays a start screen of the game (step S101). The start screen is provided with a selection field (check box, selection button, etc.) for selecting whether or not to customize the end roll, a start button, etc. When the start button is operated after selecting not to customize the end roll on the start screen (step S102; No), the control unit 11 performs normal game processing and normal end roll playback (steps S103 to S105). That is, the control unit 11 performs game processing according to the game program (step S103). In the game processing, events are generated according to the player's operation, and the game story progresses while playing game video content. When the game is cleared (step S104; Yes), a normal end roll is played (step S105). The normal end roll is a standard video content that is included in advance in the game data and is prepared, and displays text information of the production staff, etc., game scenes, ending videos, etc. together with music (ending theme song, etc.). When the end credits have finished, the start screen is displayed and the process ends.

[0045] On the other hand, when customizing the end credits is selected on the start screen and the start button is operated (step S102; Yes), the control unit 11 acquires the capture image 122 while executing the game processing, and generates and plays an original end credits using the acquired capture image 122 (steps S106 to S114). That is, the control unit 11 performs the game processing according to the game program as described above (step S106). During the execution of the game processing, the control unit 11 takes an image of the player with the camera 17 and acquires face images at a predetermined time interval (step S107). The control unit 11 (feeling estimation unit 21) estimates the feeling of the player based on the face image acquired in step S107 (step S108). When the score of an emotion (such as fun, sadness, surprise, anger, etc.) other than "normal (no emotion)" is estimated to be equal to or higher than a certain value (step S109; Yes), the control unit 11 (capture unit 22) captures the display screen at that timing (step S110). The control unit 11 saves the captured image 122 in a predetermined folder in the storage unit 12 (step S111). For example, the captured image 122 is saved in a folder for the corresponding emotion in the corresponding chapter folder. The control unit 11 repeatedly executes the process of steps S106 to S111 until the game is cleared (step S112; No→step S106).

[0046] FIG. 11 shows the operation procedure of the control unit 11 while the game is in progress. In FIG. 11, time progresses from left to right. When the game is started by the player's operation, the control unit 11 progresses the game until the end while repeatedly executing game calculations according to the player's input operations. In addition, while the game is in progress, the control unit 11 acquires facial images of the player from the camera 17 at predetermined time intervals and executes emotion estimation calculations on the acquired facial images. If the emotion score acquired by the emotion estimation calculation is equal to or greater than a predetermined value, the control unit 11 performs a capture process of the game screen.

[0047] Returning to the explanation of Figure 10. In step S112, when the game is cleared (step S112; Yes), the control unit 11 (end roll generating unit 23) generates an end roll (step S113). In the end roll generating process in step S113, the control unit 11 generates an end roll using the saved captured images 122. For example, as shown in Fig. 7, the captured images 122 may be inserted randomly into a normal end roll (standard video content that is included in advance in the game data), as shown in Fig. 8, the captured images 122 to be inserted may be limited to those showing specific emotions, or as shown in Fig. 9, the captured images 122 may be inserted in the order of the story.

[0048] When the generation of the end credits is completed, the control unit 11 plays the generated end credits (step S114). When the playback of the generated end credits is finished, the start screen is displayed and the game ends.

[0049] As described above, according to the information processing device 1 of the first embodiment of the present invention, a capture image 122 of the game screen is recorded in response to a change in the user's (player's) emotions during game execution, and when the game ends, the recorded capture image 122 is used to generate an end roll. This makes it possible to play scenes that excited the user (player) or memorable scenes in the end roll. Since emotions during the game differ for each user (player), a variety of end rolls can be generated and played. Furthermore, the capture image 122 can be obtained without any operation by the user (player).

[0050] [Second embodiment] Next, an information processing device 1A according to a second embodiment of the present invention will be described with reference to Fig. 12 to Fig. 14. The hardware configuration of the information processing device 1A according to the second embodiment is similar to that of the first embodiment, but the second embodiment has a different functional configuration from the first embodiment.

[0051] Fig. 12 is a block diagram showing the functional configuration of an information processing device 1A according to the second embodiment. As shown in Fig. 12, the information processing device 1A includes a storage unit 12, a display unit 14, an image processing unit 16, an input unit 15, a capture unit 22, and an end roll generating unit 23. The difference from the first embodiment is that a capture instruction to the capture unit 22 is input from the input unit 15.

[0052] That is, as shown in Fig. 13, when a user (player) inputs a capture instruction via the input unit 15 while the game is in progress, the capture unit 22 records the display screen during game execution and saves it as a capture image 122. Unlike the first embodiment, emotion estimation and the like is not performed, and the user (player) can capture a desired scene at a desired timing. The end roll generation by the end roll generation unit 23 is the same as in the first embodiment.

[0053] Next, the flow of processing executed in the information processing apparatus 1A of the second embodiment will be described with reference to the flowcharts of FIGS.

[0054] As shown in FIG. 14, when a game is started, the control unit 11 of the information processing device 1 displays a start screen of the game (step S201). As in the first embodiment, the start screen is provided with a selection field (check box, selection button, etc.) for selecting whether or not to customize the end roll, a start button, etc. If it is selected on the start screen that the end roll is not to be customized and the start button is operated (step S202; No), the control unit 11 performs normal game processing and normal end roll playback (steps S203 to S205). The processing in steps S203 to S205 is the same as steps S103 to S105 in FIG. 10.

[0055] On the other hand, when customizing the end credits is selected on the start screen and the start button is operated (step S202; Yes), the control unit 11 acquires the capture image 122 while executing the game processing, and generates and plays an original end credits using the acquired capture image 122 (steps S206 to S212). That is, the control unit 11 performs the game processing according to the game program as described above (step S206). During the execution of the game processing, when a capture instruction operation is input from the player via the input unit 15 (step S207; Yes), the control unit 11 (capture unit 22) captures the display screen at that timing (step S208). The control unit 11 saves the capture image 122 in a predetermined folder in the storage unit 12 (step S209). For example, the capture image 122 is saved in the corresponding chapter folder. The control unit 11 repeatedly executes the processing of steps S206 to S209 until the game is cleared (step S210; No→step S206).

[0056] When the game is cleared in step S210 (step S210; Yes), the control unit 11 (end roll generating unit 23) generates an end roll (step S211). In the end roll generating process in step S211, the control unit 11 generates an end roll using the saved captured images 122. For example, as shown in Fig. 7, the control unit 11 randomly inserts the captured images 122 into a normal end roll (a fixed video content that is included in advance in the game data), or as shown in Fig. 9, the control unit 11 inserts the captured images 122 in the order of the story.

[0057] When the generation of the end credits is completed, the control unit 11 plays the generated end credits (step S212). When the playback of the generated end credits ends, the start screen is displayed and the game ends.

[0058] As described above, according to the information processing device 1A of the second embodiment of the present invention, a user (player) can instruct to capture the screen while a game is being played (while a video is being played), record a captured image 122, and generate an original end credits using the recorded captured image 122. The user (player) can capture a favorite scene by his / her own operation, and can look back on it again in the end credits.

[0059] In the first embodiment, the user's (player's) emotions are used as a trigger, and in the second embodiment, the user's (player's) operation is used as a trigger to input the capture instruction, but the present invention is not limited to this. For example, the capture instruction may be input based on the user's gestures (body movements). In this case, the camera 17 captures the user's whole body or upper body, and the control unit 11 analyzes the movements of the user's arms, head, etc., and when the movements are recognized as predetermined movements, the control unit 11 issues a capture instruction. Also, a biometric information measuring device such as a pulse measuring device, a heartbeat sensor, and a thermometer may be connected to the information processing device 1 to measure the biometric information of the user while watching video content, and when a predetermined change occurs in the measured value, the control unit 11 issues a capture instruction. Also, a voice input device (microphone, speech recognition processing unit, etc.) may be provided, and the capture instruction may be input using the user's voice as a trigger.

[0060] [Third embodiment] Next, an information processing device 1B according to a third embodiment of the present invention will be described with reference to Fig. 15 and Fig. 16. The hardware configuration of the information processing device 1B according to the third embodiment is similar to that of the first embodiment, but the third embodiment adds a photobook generation function to the information processing device 1 according to the first embodiment.

[0061] Fig. 15 is a block diagram showing a functional configuration of an information processing device 1B according to the third embodiment. As shown in Fig. 15, the information processing device 1B includes a storage unit 12, a display unit 14, an image processing unit 16, a camera 17, a feeling estimation unit 21, a capture unit 22, and an end roll generation unit 23, as well as a photo book generation unit 25 and a user image acquisition unit 26, similar to the information processing device 1 (Fig. 3) according to the first embodiment.

[0062] The photo book generating unit 25 generates a photo book using the capture images 122 stored in the storage unit 12. Unlike an end credits, the photo book is a digital photo book that does not include information about the production staff, etc. For example, the photo book is generated by arranging the capture images 122 randomly, arranging them according to the story of the game, or arranging the capture images 122 recorded when the user had a specific emotion.

[0063] The user image acquisition unit 26 acquires an image of the user (user image 123) captured by the camera 17 and stores it in the storage unit 12. For example, an image of the user at the timing when the user's emotion score reaches or exceeds a predetermined value and the capture unit 22 records a capture image 122 of the screen is acquired from the camera 17 and stored in the storage unit 12 as the user image 123.

[0064] The photo book generating unit 25 may arrange the user image 123 at that time side by side with the captured image 122. For example, a photo book can be generated in which the game screen (captured image 122) and the user's facial expression (user image 123) when the score of the emotion "fun" reaches a predetermined value or more are arranged side by side.

[0065] 16 is a flowchart showing the flow of the photobook generation process executed by the information processing device 1B of the third embodiment. When a menu is displayed by a user's instruction (step S301) and the photobook generation menu is selected (step S302; Yes), the control unit 11 (photobook generation unit 25) acquires the capture images 122 and the user images 123 from the storage unit 12 and generates a photobook (step S303). The control unit 11 may automatically randomly select and arrange the capture images 122 and the user images 123 at that time, or arrange them according to the story of the game to generate the photobook, or may accept an editing operation by the user, and the user may select and lay out the desired capture images 122 and user images 123. When the photobook is generated, the control unit 11 displays the generated photobook on the display unit 14 (step S304).

[0066] As described above, the information processing apparatus 1B of the third embodiment can also generate a photo book using the captured images 122 in addition to the end roll.

[0067] In the above description, the information processing device 1B is configured by adding a photo book creation unit 25 and a user image acquisition unit 26 to the functional configuration of the information processing device 1 of the first embodiment, but the present invention is not limited to this, and the photo book creation unit 25, camera 17, and user image acquisition unit 26 may be added to the functional configuration of the information processing device 1A of the second embodiment. That is, the information processing device 1B acquires a capture image 122 in accordance with a capture instruction from the user, and also photographs and stores a user image 123, and generates a photo book using the capture image 122 and the user image 123 when the photo book generation menu is selected by the user.

[0068] [Fourth embodiment] Next, an information processing device 1C according to a fourth embodiment of the present invention will be described with reference to Figures 17 and 18. The hardware configuration of the information processing device 1C according to the fourth embodiment is similar to that of the first embodiment, but the fourth embodiment adds a photo movie generating function to the information processing device 1 according to the first embodiment.

[0069] Fig. 17 is a block diagram showing the functional configuration of an information processing device 1C of the fourth embodiment. As shown in Fig. 17, the information processing device 1C has a configuration in which a photo movie generating section 27 is added to the functional configuration of the information processing device 1 (Fig. 3) of the first embodiment.

[0070] The photo movie generating unit 27 generates a photo movie using the captured images 122 and music data 124 stored in the storage unit 12. Unlike an end credit, a photo movie is a movie (video content) that does not include information about the production staff, etc. For example, the captured images 122 are generated by sequentially displaying them in sync with music such as the background music of a game, or by adding various effects such as enlarging, reducing, rotating, moving, and changing the color tone of the images.

[0071] 18 is a flowchart showing the flow of the photo movie generating process executed by the information processing device 1C of the fourth embodiment. When a menu is displayed by the user's instruction (step S401) and the photo movie generating menu is selected (step S402; Yes), the control unit 11 (photo movie generating unit 27) selects music from the storage unit 12 (step S403) and generates a photo movie using the selected music and the captured images 122 (step S404). The photo movie may be generated by the control unit 11 automatically selecting music or selecting the captured images 122 and arranging them randomly or according to the story of the game, or may be generated by accepting an editing operation by the user, selecting a desired music or captured images 122, and applying a desired effect process. When the photo movie is generated, the control unit 11 displays the generated photo movie on the display unit 14 (step S405).

[0072] As described above, the information processing apparatus 1C of the fourth embodiment can generate a photo movie by combining the captured images 122 with music, in addition to the end credits.

[0073] In the above description, the configuration of information processing device 1C is configured by adding a photo movie generation unit 27 to the functional configuration of information processing device 1 of the first embodiment, but the present invention is not limited to this, and the photo movie generation unit 27 may be added to the functional configuration of information processing device 1B of the second embodiment or information processing device 1C of the third embodiment.

[0074] Although the preferred embodiment of the present invention has been described above with reference to the accompanying drawings, the present invention is not limited to the above examples. It is clear that a person skilled in the art can come up with various modified or altered examples within the scope of the technical ideas disclosed in this application, and it is understood that these also naturally belong to the technical scope of the present invention. [Explanation of symbols]

[0075] 1. Information processing device 10. Main body 11....Control section 12………………Storage section 13. Communications Department 14………………Display section 15.....Input section 16....Image processing section 17………………Camera 18...............Peripheral device I / F section 19………………Bus 21………………Emotion estimation section 22...Capture section 23...End credits generator 25.....Photobook creation section 26....User image acquisition section 27...Photo movie generator

Claims

1. A video playback means for playing back video content; A capture means for storing a captured image of the video content; an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means; Equipped with The apparatus further includes an emotion estimation means for estimating an emotion of a user viewing the video content, and separately scoring two or more emotions other than normal (neutral), the emotion estimation means instructs the capture means to capture the screen at a timing when any one of the scores of emotions other than normal (neutral) becomes equal to or greater than a predetermined value, and does not instruct the capture means when the score of the emotion other than normal (neutral) does not reach the predetermined value; The information processing device is characterized in that the capture means records the captured image in association with information on the emotion at that time.

2. A photographing means for photographing a face image of the user is provided, The information processing apparatus according to claim 1 , wherein the emotion estimation means estimates the emotion of the user based on a face image captured by the imaging means.

3. 3. The information processing apparatus according to claim 1, wherein the end roll generating means inserts a captured image obtained when the user expressed a specific emotion into the end roll.

4. A video playback means for playing back video content; A capture means for storing a captured image of the video content; an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means; Equipped with The information processing device is characterized in that the end roll generating means randomly selects the acquired capture images and inserts them into the end roll.

5. 5. The information processing apparatus according to claim 1, further comprising a selection unit for selecting whether or not to generate an end roll by said end roll generating unit.

6. A video playback means for playing back video content; A capture means for storing a captured image of the video content; an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means; Equipped with A photo book generating unit generates a photo book using the captured images, A photographing means is provided for photographing a user and storing the photographed image; The information processing apparatus is characterized in that the photo book generating means arranges an image of the user taken by the photographing means alongside the capture image.

7. 7. The information processing apparatus according to claim 1, further comprising a photo movie generating unit for generating a photo movie by combining the captured images with a piece of music.

8. The computer playing video content; A step of estimating an emotion of a user watching the video content, and separately scoring two or more emotions other than normal (neutral); a step of not issuing a capture instruction when the score of an emotion other than normal (neutral) has not reached a predetermined value, and issuing a capture instruction to capture the screen at a timing when any one of the scores of the emotions other than normal (neutral) has reached or exceeded a predetermined value; A step of storing a captured image of the video content in association with information on the emotion at that time; generating an end credit for the video content using the stored captured image; 13. A method for generating end rolls, comprising:

9. The computer playing video content; storing a captured image of the video content; generating an end credit for the video content using the stored captured image; Including, The end roll generating method, wherein in the step of generating an end roll for the video content, the acquired captured images are randomly selected and inserted into the end roll.

10. The computer playing video content; storing a captured image of the video content; Photographing and storing a user; generating an end credit for the video content using the stored captured image; a step of arranging the image of the user taken in the step of photographing and storing the user alongside the captured image to generate a photo book; 13. A method for generating end rolls, comprising:

11. Computer, A video playback means for playing back video content; A capture means for saving a captured image of the video content; an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means; A program for causing the device to function as a The computer, further functioning as emotion estimation means for estimating an emotion of a user viewing the video content and separately scoring two or more emotions other than normal (neutral); the emotion estimation means instructs the capture means to capture the screen at a timing when any one of the scores of emotions other than normal (neutral) becomes equal to or greater than a predetermined value, and does not instruct the capture means when the score of the emotion other than normal (neutral) does not reach the predetermined value; The capture means is a program that records the captured image in association with information about the emotion at that time.

12. Computer, A video playback means for playing back video content; A capture means for saving a captured image of the video content; an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means; A program for causing the device to function as a The end roll generating means is a program that randomly selects the acquired captured images and inserts them into the end roll.

13. Computer, A video playback means for playing back video content; A capture means for saving a captured image of the video content; an end roll generating means for generating an end roll of the video content using the captured image stored by the capture means; A program for causing the device to function as a The computer, a photobook generating means for generating a photobook using the captured images; An imaging means for imaging and storing an image of a user; As a The photo book generating means is a program for arranging the image of the user taken by the photographing means alongside the capture image.

Images