Information processing device, information processing method, and program

The information processing device addresses the challenge of taking screenshots during gameplay by enabling batch operations with a single hardware key and delayed notifications, improving usability and reducing interruptions in gameplay.

WO2024232301A1PCT designated stage expired Publication Date: 2024-11-14SONY GROUP CORP

Patent Information

Application Number
PCT/JP2024/016494
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-10
Filing Date
2024-04-26
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

Users face difficulties in taking screenshots during gameplay due to complex operations and interruptions, leading to missed moments and interference with the gaming experience.

Method used

An information processing device that allows for batch screenshot operations with a single hardware key, such as the camera key, and delayed notifications only after a cycle of operations is completed, enabling seamless and continuous screenshot capturing without interrupting gameplay.

Benefits of technology

Enhances usability by allowing quick and continuous screenshot capture without interrupting gameplay, reducing the likelihood of missing critical moments and simplifying the process through single-key operations and optimized notification timing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024016494_14112024_PF_FP_ABST
    Figure JP2024016494_14112024_PF_FP_ABST
Patent Text Reader

Abstract

This information processing device is configured to comprise a control unit that: performs a process for storing, in response to a screenshot operation, an image displayed on a screen; performs a process to determine whether one or more screenshot operations are a collective operation; and displays a notification corresponding to the screenshot operations in response to a determination that the collective operation has ended.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing device, information processing method, and program

[0001] The present technology relates to an information processing device, an information processing method, and a program, and mainly to a screenshot function.

[0002] In recent years, users have been installing various applications on terminal devices such as personal computers and smartphones, enabling them to enjoy a wide variety of experiences. In particular, it has become common for users to save portions of virtual images, such as those from game applications, as screenshots.

[0003] Japanese Patent Application Laid-Open No. 2003-144993 discloses a technique for capturing either a screenshot image or a game video by operating a predetermined input unit while a game image is being displayed.

[0004] Japanese Patent Application Laid-Open No. 2022-106910

[0005] However, when a game application is running, it can be difficult for a user to take a screenshot while concentrating on the game screen. For example, if the screenshot operation is complicated, it is easy to miss the perfect shot. Also, when taking a screenshot, a notification is displayed indicating that the image has been saved, but this notification may appear in the screenshot taken immediately after.

[0006] Therefore, the present disclosure proposes a technique that can improve the usability of screenshots.

[0007] The information processing device according to the present technology is provided with a control unit that performs a process of storing an image displayed on a screen in response to a screenshot operation, determines whether one or more screenshot operations are a group operation, and, when it determines that the group operation has ended, displays a notification in response to the screenshot operation. The information processing device performs the storage process in response to a screenshot operation by a user, but does not necessarily perform the notification for each operation, but rather performs the notification when one or more screenshot operations as a group operation have ended.

[0008] 1 is a block diagram of an information processing device according to an embodiment of the present technology. FIG. 1 is an explanatory diagram of a screenshot operation by an extended function. FIG. 2 is an explanatory diagram of a screenshot operation by an extended function. FIG. 3 is an explanatory diagram of a notification after a screenshot operation. FIG. 4 is an explanatory diagram of a screenshot operation by a hardware key according to an embodiment. FIG. 5 is an explanatory diagram of a screenshot operation by a hardware key according to an embodiment. FIG. 6 is an explanatory diagram of a notification after a screenshot operation. FIG. 7 is an explanatory diagram of a screenshot operation and a notification according to an embodiment. FIG. 8 is an explanatory diagram of a screenshot operation and a notification according to an embodiment. FIG. 9 is an explanatory diagram of types of screenshots by a hardware key according to an embodiment. FIG. 10 is an explanatory diagram of one cycle of a screenshot operation according to an embodiment. FIG. 11 is an explanatory diagram of a notification related to a screenshot according to an embodiment. FIG. 12 is a flowchart of a processing example corresponding to a screenshot operation according to an embodiment. FIG. 13 is an explanatory diagram of setting a threshold time for one cycle according to an embodiment. FIG. 14 is an explanatory diagram of updating a threshold time for one cycle according to an embodiment. FIG. 15 is a flowchart of a threshold time setting process according to an embodiment. FIG. 16 is a flowchart of a threshold time updating process according to an embodiment. FIG. 17 is an explanatory diagram of a marking operation during video storage according to an embodiment. FIG. 18 is an explanatory diagram of a user interface related to a marking operation according to an embodiment. FIG. 19 is an explanatory diagram of a user interface related to a marking operation according to an embodiment. FIG. 19 is a flowchart of a processing example related to a marking operation according to an embodiment. 1A and 1B are explanatory diagrams of a display mode of a notification of extra-high importance according to an embodiment, a display mode of a notification of medium importance according to an embodiment, and a block diagram of a hardware configuration of an information processing apparatus according to an embodiment.

[0009] The following describes the embodiments in the following order: <1. Functional configuration> <2. Standard screenshot> <3. Screenshot as additional function> <4. Marking while video is being stored> <5. Notification functions> <6. Hardware configuration example> <7. Summary and modifications>

[0010] In this specification and drawings, substantially identical components are designated by the same reference numerals, and redundant explanations are omitted. In the following description and drawings, "application" may be abbreviated to simply "app." In this disclosure, "image" is used as a term that includes both still images and videos. Screenshots may be abbreviated as "SS."

[0011] <1. Functional Configuration> First, a functional configuration example of the information processing device 10 according to the present embodiment will be described. The information processing device 10 may be a mobile terminal such as a smartphone or tablet PC (Personal Computer) capable of executing various applications, or may be a stationary terminal installed in a user's home, office, or the like.

[0012] 1 is a block diagram showing an example of the functional configuration of an information processing device 10 according to the present embodiment. As shown in Fig. 1, the information processing device 10 according to the present embodiment includes an operation unit 110, a storage unit 120, an image capturing unit 130, a sensor unit 140, a display unit 150, an audio input unit 160, an audio output unit 170, a screen capture unit 180, and a control unit 190.

[0013] (Operation Unit 110) The operation unit 110 detects various operations by the user, such as operations on the hardware keys on the main body of the information processing device 10 and device operations for applications. The above-mentioned device operations include, for example, touch operations and inserting an earphone jack into the information processing device 10. Here, touch operations refer to various contact actions on the display unit 150, such as tapping, double tapping, swiping, and pinching. Touch operations also include actions such as bringing an object, such as a finger, close to the display unit 150. Therefore, the operation unit 110 includes, for example, a touch panel, keys, buttons, a keyboard, a mouse, and a proximity sensor. The operation unit 110 inputs the detected user operation information to the control unit 190.

[0014] (Storage unit 120) The storage unit 120 is a storage area for temporarily or permanently storing various programs and data. For example, the storage unit 120 may store programs and data for the information processing device 10 to execute various functions. As a specific example, the storage unit 120 may store programs for executing various applications, management data for managing various settings, etc. Of course, the above is merely an example, and the type of data stored in the storage unit 120 is not particularly limited. For example, a storage medium such as a memory card or an internal memory of the information processing device 10 is used as the storage unit 120.

[0015] (Photographing unit 130) The photographing unit 130 photographs, for example, the scenery around the information processing device 10 and the face of the user, based on control by the control unit 190. For this purpose, the photographing unit 130 is provided with an image sensor. A smartphone, which is an example of the information processing device 10, is provided with a front camera on the display unit 150 side for photographing the user's face, etc., and a main camera on the back side of the display unit 150 for photographing scenery, etc.

[0016] (Sensor Unit 140) The sensor unit 140 has a function of collecting information related to user behavior using various sensors. The sensor unit 140 includes, for example, an acceleration sensor, a gyro sensor, a geomagnetic sensor, a vibration sensor, a GNSS (Global Navigation Satellite System) signal receiving device, etc. The sensor unit 140 detects, for example, using the gyro sensor, that the user has held the information processing device 10 sideways, and inputs the detected information to the control unit 190.

[0017] (Display Unit 150) The display unit 150 displays various visual information based on the control of the control unit 190. The display unit 150 according to the present embodiment may display, for example, images and characters related to an application. For this purpose, the display unit 150 may include various display devices such as a liquid crystal display (LCD) device or an organic light emitting diode (OLED) display device. The display unit 150 may also superimpose and display the user interface (UI) of another application on a layer higher than the screen of the application being displayed.

[0018] (Audio Input Unit 160) The audio input unit 160 collects audio and the like uttered by the user under the control of the control unit 190. For this purpose, the audio input unit 160 includes a microphone and the like.

[0019] (Audio Output Unit 170) The audio output unit 170 outputs various types of audio. For example, the audio output unit 170 outputs audio or sound according to the status of the application based on control by the control unit 190. For this purpose, the audio output unit 170 includes a speaker and an amplifier.

[0020] (Screen Capture Unit 180 ) The screen capture unit 180 takes screenshots (SS) or videos of the screen displayed on the display unit 150 under the control of the control unit 190 , and stores them in the storage unit 120 .

[0021] (Control unit 190) The control unit 190 controls each component of the information processing device 10. The control unit 190 can also control function extensions to applications and restrict various functions. Function extensions to applications are performed by another application. To distinguish between the application that is being extended and the other application that performs the function extension, they are referred to as the "first application" and the "extension application," respectively. When performing function extension, the control unit 190 launches the first application as well as an extension application, and controls both applications simultaneously. Details of the functions of the control unit 190 will be described later.

[0022] An example of the functional configuration of the information processing device 10 has been described above, but the functional configuration described using Fig. 1 is merely an example, and the functional configuration of the information processing device 10 according to this embodiment is not limited to this example. For example, the information processing device 10 does not necessarily have to include all of the components shown in Fig. 1, and each component, such as the voice input unit 160, can be provided in a device different from the information processing device 10. The functional configuration of the information processing device 10 according to this embodiment can be flexibly modified according to specifications and operations.

[0023] The functions of each component may be performed by a computing device such as a central processing unit (CPU) reading a control program from a storage medium such as a read-only memory (ROM) or a random access memory (RAM) that stores a control program describing the processing procedures for realizing these functions, and interpreting and executing the program. Therefore, the configuration used can be changed as appropriate depending on the technical level at the time of implementing this embodiment. An example of the hardware configuration of the information processing device 10 will be described later.

[0024] 2. Standard Screenshot A description will be given of the screenshot-related functions of the information processing device 10. First, a screenshot from the extended function menu 21 will be described.

[0025] The control unit 190 of the information processing device 10 can control an extension application that provides extension functions to various first applications. The first application is, for example, a game application. However, the first application is not limited to a game application, and includes various applications that are installed on the information processing device 10 and used by a user, such as a drawing application, an editing application, a music / video application for viewing videos and music, and an application for recording audio and video.

[0026] The extension application makes it possible to easily provide extended functions to various first applications without editing source code, etc. Furthermore, even when providing the extended functions, the extension application can operate in a manner that does not interfere with user operations on the first applications or the OS (Operating System), or with the behavior of the first applications.

[0027] An example of an operation related to the menu display of an extended application will be described. Fig. 2A shows a state in which the user turns the information processing device 10 sideways, the sensor unit 140 detects this, and the control unit 190 displays the screen on the display unit 150 in landscape mode. A smartphone is used as an example of the information processing device 10, but Figs. 2A, 2B, 2C, 3A, 3B, and 3C do not show the housing or display unit 150, but only show the display content on the display unit 150.

[0028] 2A shows a state in which the control unit 190 has already started up a first application (e.g., a game application) and has caused a game screen 30 based on the first application to be displayed full-screen on the display unit 150. The game screen 30 includes various game icons 31 that are displayed as game content.

[0029] In FIG. 2A, the user is playing the first application but is not using the extension application.

[0030] The extended application may be launched by the control unit 190 upon detecting the launch of the first application, or may be launched upon detecting an arbitrary operation while the first application is running. The arbitrary operation may be, for example, a user operation detected by the operation unit 110 or the sensor unit 140, or a voice operation recognized by the voice input unit 160. The extended application may also be automatically launched together with the startup of the OS of the information processing device 10. Alternatively, the extended application may be launched by, for example, pressing an icon for the extended application displayed on the display unit 150 by a user operation. For example, in FIG. 2A , an extended function icon 20 is displayed on the game screen 30.

[0031] For example, by touching the extended function icon 20, an extended function menu 21 is displayed as shown in FIG. 2B . The user can operate each item included in this extended function menu 21. The extended function menu 21 displays various icons, including a single SS (screenshot) icon 22, a burst SS icon 23, an SS display icon 24, and a record icon 40. The record icon 40 is an icon for operating video recording. A processing example related to the operation of the record icon 40 will be described later.

[0032] The single SS icon 22 is an icon for taking a single screenshot. The burst SS icon 23 is an icon for taking multiple screenshots. When the single SS icon 22 or the burst SS icon 23 is operated, one or multiple screenshots are taken with the extended function menu 21 hidden, as shown in FIG. 2C .

[0033] Thereafter, when the process of storing the still image as a screenshot is completed, a notification dialog 28 is displayed as shown in FIG. 4. The notification dialog 28 displays, for example, a message indicating that the screenshot has been saved. This notification dialog 28 is automatically hidden after a certain period of time. Alternatively, the user can hide the notification dialog 28 by swiping the notification dialog 28.

[0034] The SS display icon 24 in the extended function menu 21 in Fig. 2B is an icon for displaying the SS standby menu 25. When the SS display icon 24 is operated, the SS standby menu 25 is displayed superimposed on the game screen 30, as shown in Fig. 3A. This SS standby menu 25 includes icons related to screenshots, such as a single SS icon 26 and a burst SS icon 27. This SS standby menu 25 is not a menu that appears temporarily on the game screen 30 like the extended function menu 21, but is a menu in which each icon is constantly arranged on the game screen 30.

[0035] When the user operates the single SS icon 26 or the burst SS icon 27, one or more screenshots are taken while the SS standby menu 25 is temporarily hidden as shown in Fig. 3B. After the image saving process is completed, the SS standby menu 25 is displayed again as shown in Fig. 3C. Note that the notification dialog 28 in Fig. 4 is displayed during the process from Fig. 3B to Fig. 3C.

[0036] As described above, an image of a first application, such as a game application, can be saved as a screenshot based on the extended application. However, screenshot operations using this extended function have the following disadvantages in terms of operability.

[0037] First, when operating the single SS icon 22 or burst SS icon 23 in Figure 2B, two steps of UI operation are required before taking a photo. That is, it is necessary to operate the extended function icon 20 to display the extended function menu 21, and then operate the single SS icon 22 or burst SS icon 23. These two-step operations require interrupting gameplay and are time-consuming.

[0038] 3A is displayed, a screenshot can be taken with one touch during the game. However, the icon for the SS standby menu 25 is always displayed on the game screen 30, which can be a hindrance to game play. It can also be confused with the game icon 31, which is the game's UI, and can lead to incorrect operation.

[0039] In either case, it takes time from the moment the user decides to take a photo until the actual shooting occurs, which means there is a risk of missing the moment you want to capture a photo, even though the scene changes every millisecond.

[0040] In addition, the next shooting operation cannot be performed until the screenshot saving process is complete. In other words, the next shooting operation cannot be performed until the single SS icon 22, 26 or the burst SS icon 23, 27 is displayed. This means that continuous shooting is not possible, and you may miss the moment you wanted to capture.

[0041] Furthermore, after shooting is complete, a notification dialog 28 like the one shown in Figure 4 is displayed for each shot. If you do not manually dismiss this dialog or wait for it to disappear over time, it will appear in the next screenshot.

[0042] Next, we will explain the screenshot operation that is standard on smartphones. Although it varies depending on the smartphone model, there are some smartphones where the screenshot operation requires pressing two hardware keys simultaneously.

[0043] 5A shows a situation in which a user is playing a game or the like while holding an information processing device 10 (smartphone) vertically. The housing of the information processing device 10 is provided with hardware keys, including a volume key 11, a power key 14, and a camera key 15. The volume key 11 is an operator for increasing or decreasing the output volume. The power key 14 is an operator for starting up the information processing device 10. The camera key 15 is an operator for operating the shutter when taking a picture with the information processing device 10. For example, pressing the volume key 11 and the power key 14 simultaneously is considered to be a screenshot operation.

[0044] In the state shown in Fig. 5A, the user is playing a game while performing touch operations on the screen with the thumb of their right hand. In this state, if the user wants to take a screenshot, the user moves the fingers of their left hand to the right side of the smartphone and simultaneously presses the volume key 11 and power key 14, as shown in Fig. 5B. Alternatively, the user can simultaneously press the volume key 11 and power key 14 using both their right and left hands, as shown in Fig. 5C.

[0045] Fig. 6A shows a situation in which a user is playing a game or the like while holding the information processing device 10 horizontally. To take a screenshot, the user rotates the fingers of their left and right hands from the back of the smartphone and simultaneously presses the volume key 11 and the power key 14, as shown in Fig. 6B. Alternatively, as shown in Fig. 6C, the user rotates the smartphone horizontally and simultaneously presses the volume key 11 and the power key 14 using both their right and left hands.

[0046] Whether holding the device vertically or horizontally, it is necessary to change the way you hold the device while playing the game, which not only makes it difficult to use but also causes the game to be interrupted to some extent. In particular, if the timing of pressing two keys simultaneously is not right, the volume adjustment UI (displayed by pressing the volume key 11) or the power menu (displayed by pressing the power key 14) will appear. Therefore, if you do not hide these, they will appear in the next screenshot. In addition, there are displays such as the volume adjustment UI that cannot be canceled, so you must wait until they disappear before taking the next screenshot.

[0047] 7 shows a notification dialog 29 that is displayed after a screenshot is taken. This notification dialog 29 displays a preview image 29a of the stored still image, a sharing icon 29b, and an editing icon 29c. This notification dialog 29 is also displayed each time a screenshot is taken, so unless you manually turn it off or wait for it to disappear over time, it will appear in the next screenshot.

[0048] The above-described standard screenshot function is primarily intended for capturing still images, allowing users to view the captured image immediately after capture and to edit or share it immediately. Therefore, even though the operability of pressing two hardware keys is low, this is not a major issue unless you are taking a screenshot of a game screen while playing a game. Conversely, the notification dialog 29 displaying a preview image of the still image and icons for sharing and editing can be useful.

[0049] On the other hand, the screenshots in the extended function menu 21 are intended for taking pictures of the screen during a game, so it is necessary to capture a moment on a constantly moving screen, to be able to return to the game immediately after taking the picture, and not to interfere with gameplay.

[0050] 3. Screenshot as Additional Function In this embodiment, an additional function is provided that allows screenshot operations, particularly during gameplay, to be performed more easily.

[0051] 8 and 9 show a screenshot operation by a user using the additional function during gameplay as an example. In this additional function, the screenshot operation is performed by operating one hardware key. Examples of hardware keys include the volume key 11, power key 14, and camera key 15 described above. As an example, the camera key 15 is assigned as the screenshot operator. It should be noted that the camera key 15 may be assigned as the screenshot operator when the additional function of this embodiment is activated. Alternatively, the user may select a setting to assign another hardware key as the screenshot operator.

[0052] The upper part of Fig. 8 shows a state in which the user is playing a game while holding the information processing device 10 horizontally. When a scene that the user wants to capture occurs during game play, the user presses the camera key 15 once with the index finger of the right hand, for example, as shown in the middle part of Fig. 8. Alternatively, the camera key 15 may be pressed multiple times in succession.

[0053] The left diagram of Fig. 9 shows a state in which the user is playing a game while holding the information processing device 10 vertically. When a scene that the user wants to capture occurs during game play, the user presses the camera key 15 once with the thumb of the right hand, for example, as shown in the center diagram of Fig. 9. Alternatively, the user may press the camera key 15 multiple times in succession.

[0054] Note that possible operation modes using hardware keys such as the camera key 15 include, for example, the operation modes shown in FIGS. 10A, 10B, and 10C. FIG. 10A shows single shooting, in which one still image is captured with one press. FIG. 10B shows continuous shooting, in which the user repeatedly captures single images in a short period of time. In other words, the information processing device 10 performs single-image capture processing in response to a single press, but as the user repeats the operation, still images are stored as continuous images. FIG. 10C shows so-called burst shooting, in which multiple images are automatically captured by, for example, pressing and holding the camera key 15. Additional functions enable, for example, such screenshot capture.

[0055] The middle section of Figure 8 and the center of Figure 9 show examples of single and continuous shots. In either case, screenshot capture is completed by simply operating the camera key 15. The camera key 15 in the illustrated example is located within easy reach of the fingers during gameplay, allowing for a smooth transition to the capture operation while playing. Depending on how the device is held, it is also possible to perform the capture operation while continuing gameplay. Furthermore, a single push operation ensures a reliable capture operation. Furthermore, because it is not a software switch, there is no need to display an icon for screenshots on the game screen 30, and it does not interfere with the game screen.

[0056] Since users hold the device in a variety of ways while playing a game, it is preferable that the user be able to select which hardware key to assign the screenshot operator to depending on how they hold the device.

[0057] Furthermore, the additional function has a feature regarding notification regarding screenshots, that is, the display of a notification dialog 28 after shooting is completed, as shown in the lower part of Fig. 8 and the right part of Fig. 9. The middle part of Fig. 8 and the center part of Fig. 9 show the cases of a single operation of the camera key 15 and multiple operations, but in the case of multiple operations, the notification dialog 28 is not displayed for each operation, but rather a single group of operations is judged, and after it is determined that the group of operations has been completed, the notification dialog 28 shown in the lower part of Fig. 8 and the right part of Fig. 9 is displayed.

[0058] In other words, when the user operates the camera key 15 multiple times in succession, the notification dialog 28 is not displayed for each operation. This prevents the notification dialog 28 from appearing in the screenshot image even if the user operates the camera key 15 repeatedly in a short period of time.

[0059] The information processing device 10 determines one cycle as a group of one operation or a series of consecutive operations, regards it as a group of operations, and displays the notification dialog 28 upon completion of the group of operations. The determination of one cycle as a group of operations will be described with reference to FIG. 11.

[0060] As an example of determining one cycle, a threshold time of N seconds is used here. The information processing device 10 treats the period from the most recent screenshot operation until the threshold time has elapsed as one cycle, and does not display the notification dialog 28 during that time. After determining that one cycle has ended, the number of shots, the number of errors, and the details of the errors are displayed together in a single notification dialog 28.

[0061] 11, the horizontal direction represents the time axis. Operation hs is the above-mentioned screenshot operation performed by a single press of the camera key 15. Display dp indicates the display of the notification dialog 28.

[0062] Cycle CY1 shows a case where a second operation hs occurs within N seconds after a first operation hs. In this case, the second operation hs is the operation before the end of one cycle. If N seconds pass without any operation after the second operation hs, the information processing device 10 determines that the group of operations as one cycle has ended and executes the display dp of the notification dialog 28.

[0063] In cycle CY2, after the first operation hs, multiple operations hs from the second onwards are performed consecutively within N seconds. Furthermore, after this continuous shooting ends, multiple operations hs are performed consecutively again within N seconds. After that, if N seconds pass without any operation, the information processing device 10 determines that this is the end of one cycle of grouped operations and executes display dp of the notification dialog 28.

[0064] Cycle CY3 shows a case where a second operation hs occurs within N seconds after a first operation hs. However, suppose that an error occurs during the second operation hs, preventing capture from continuing. For example, the still image of the screenshot cannot be stored due to storage capacity or other reasons. In such a case, the information processing device 10 immediately ends the cycle and displays the notification dialog 28.

[0065] In cycle CY4, it is assumed that N seconds have passed without any operation being performed after the first operation hs. In this case, the information processing device 10 determines that one cycle of group operations has ended with only one operation hs, and executes display dp of the notification dialog 28.

[0066] In this way, for one or more operations, one cycle is determined using the threshold time (N seconds), and the notification dialog 28 is displayed for each cycle. This prevents the notification dialog 28 from being displayed for each shot when continuous shooting is performed.

[0067] An example of the display content when the notification dialog 28 is displayed for each group of operations will be described below. Fig. 12A shows an example of the display when multiple screenshots are successfully captured in one cycle. For example, a thumbnail 42 of the first successfully captured image in one cycle is displayed, and a text message 41 such as "17 screenshots saved" is also displayed.

[0068] 12B is an example of a display that includes both resolvable errors and unexpected errors. For example, a thumbnail 42 of the first successful image in one cycle is displayed, and a text message 41 such as "20 screenshots saved" is also displayed. In addition, the text message 41 displays the number of resolvable errors and their details, as well as the number of unexpected errors and their details. The details of the errors are displayed as a message, error code, etc.

[0069] Resolvable errors include insufficient battery power, the number of folders reaching the upper limit, insufficient storage capacity of the attached storage media or internal memory, the upper limit on the number of continuous shots, high temperature, etc. If multiple resolvable errors have occurred, all of the details may be displayed, or only some of them may be displayed. For example, the above error details may be prioritized and only some of them may be displayed.

[0070] Fig. 12C is a display example when there is a resolvable error but no unexpected error. Along with a thumbnail 42 of a successful screenshot image, the capture result and the details of the resolvable error are displayed as a text message 41. Fig. 12D is a display example when there is no resolvable error but there is an unexpected error. Along with a thumbnail 42 of a successful screenshot image, the capture result and the details of the unexpected error are displayed as a text message 41.

[0071] Although not shown in the figure, if all screenshot captures have failed, the thumbnails 42 are not displayed, and the error content is displayed as a text message 41, for example.

[0072] As in the above example, after one cycle of shooting, a representative thumbnail 42, the number of screenshots that were saved, and a text message 41 indicating the details of any errors are displayed for one or more screenshots taken, thereby providing a comprehensive notification for one cycle.

[0073] Note that one cycle may involve taking one screenshot or multiple screenshots, and the display content will differ depending on the situation. Figures 13A and 13B show the case where one screenshot has been taken. The closed and open states of the notification are shown. Figures 13C and 13D show the closed and open states of the notification when multiple screenshots have been taken. This example shows the case where no errors occurred. The closed and open states are switched by operating the open / close button 43.

[0074] When one image is captured in one cycle, a share button 44, an edit button 45, and a delete button 46 are displayed. The share button 44 is a button for transitioning to a screen for sharing the screenshot image. The edit button 45 is a button for transitioning to an editing screen for the screenshot image. The delete button 46 is a button for deleting the screenshot image. These are operation icons for post-processing of the captured screenshot image.

[0075] On the other hand, if multiple images are taken in one cycle, operation icons for post-processing such as the share button 44, edit button 45, and delete button 46 are not displayed. When one image is taken, the image to be processed can be identified, making it easier to transition to post-processing. On the other hand, when multiple images are taken, it is necessary to first identify the image to be processed, and it is generally expected that the user will not interrupt the game and proceed to post-processing. Therefore, operation icons for post-processing are not displayed.

[0076] As described above, the information processing device 10 performs a screenshot capture process as an additional function for capturing a screenshot, for example, by operating the camera key 15 while a game application is running. An example of the processing performed by the control unit 190 as this additional function will be described with reference to Fig. 14. Fig. 14 shows an example of the processing performed by the control unit 190 when a program is running as an additional function.

[0077] In step S101, the control unit 190 monitors a screenshot operation. The operation in this case refers to the operation of a hardware key assigned as a screenshot operator, such as the operation of the camera key 15.

[0078] When a screenshot operation, for example, an operation of the camera key 15, is detected, the control unit 190 proceeds to step S102 and performs screenshot processing. Specifically, the image on the display screen at that time is captured and stored as a still image in the storage media or internal memory of the storage unit 120. At this time, the control unit 190 also stores history information related to the screenshot operation. This information is used for updating the threshold time, which will be described later. For example, the control unit 190 stores the date and time (year, month, day, hour, minute, and second) of the screenshot operation, identification information for the game title being played, and the like.

[0079] In step S103, the control unit 190 branches the process depending on whether an error occurred in the screenshot process. If no error occurred, the control unit 190 performs a cycle determination in step S104. For example, it determines whether N seconds have passed since the most recent screenshot operation. If N seconds have not passed, the cycle is not considered to have ended, and the control unit 190 proceeds from step S105 to step S106, where it detects whether a screenshot operation similar to that in step S101 (for example, operation of the camera key 15) has occurred.

[0080] If there is no screenshot operation, the control unit 190 returns to step S104 and continues the cycle determination. That is, the control unit 190 waits for the threshold time of N seconds in a loop of steps S104, S105, and S106.

[0081] If N seconds have passed since the first screenshot operation without a subsequent screenshot operation, the control unit 190 determines that the cycle has ended and proceeds to step S110 to perform notification processing. In this case, the notification dialog 28 is displayed in response to the capture of one screenshot. This corresponds to the case shown in cycle CY4 in FIG. 11.

[0082] Thereafter, in step S111, the control unit 190 monitors whether a predetermined display time has elapsed or whether the user has performed a display clearing operation. If the display time has elapsed, or if the user has performed a clearing operation such as swiping the notification dialog 28, the control unit 190 proceeds to step S112 and causes the notification dialog 28 to be cleared from the screen. Then, the process of FIG. 14 corresponding to one cycle is completed. Note that if the user has performed a clearing operation, the control unit 190 may include information indicating that the clearing operation has been performed in the history information regarding the group of operations for this one cycle.

[0083] If a screenshot operation is detected in step S106 before one cycle is completed, the control unit 190 proceeds to step S102 and executes screenshot processing corresponding to the operation. If no error occurs, the process again enters the loop of steps S104, S105, and S106. This is the case when multiple screenshots are taken within one cycle, as shown in cycles CY1 and CY2 in FIG. 11.

[0084] If it is determined that N seconds have passed since the most recent screenshot operation at a certain point in time, the control unit 190 determines that the cycle has ended and proceeds to step S110 to perform notification processing. In this case, the notification dialog 28 is displayed in response to the capture of multiple screenshots. The control unit 190 then proceeds through steps S111 and S112 to complete the processing of FIG. 14 corresponding to one cycle.

[0085] If it is determined in step S103 that an error has occurred within one cycle, the control unit 190 proceeds to step S120, where it executes notification processing by displaying a notification dialog 28 containing the details of the error. In other words, it does not perform the cycle determination in step S104, and immediately ends the cycle in response to the occurrence of an error.

[0086] In step S121, the control unit 190 monitors whether a predetermined display time has elapsed or whether the user has performed a display clearing operation. If the display time has elapsed or if the user has performed a clearing operation such as swiping the notification dialog 28, the control unit 190 proceeds to step S122, where the notification dialog 28 is cleared from the screen, and the process in Fig. 14 is terminated. This corresponds to the case illustrated in cycle CY3 in Fig. 11.

[0087] By the above-described processing of FIG. 14, the notification dialog 28 is displayed in response to the cycle determination as a group operation.

[0088] Next, we will explain the threshold time N seconds for determining one cycle. N seconds can be a fixed value, such as 1 second. For example, N seconds can be defined as 1 second based on the distribution trend of the time interval between shooting operations when a user test for continuous shooting is conducted.

[0089] It is also possible to automatically optimize N seconds in accordance with the behavior of each user. To this end, the control unit 190 learns the shooting interval during continuous shooting.

[0090] First, the default threshold time for users who do not use the screenshot function is optimized. For example, the optimal value of N seconds may differ for each game title. Therefore, the server device collects distribution data on the number of shots taken for each game title and determines the default threshold time (N seconds) for each game title or for each similar genre. The server device is, for example, a server device with which the information processing device 10 communicates when launching a game app. The server device collects history information on screenshot operations from multiple information processing devices 10.

[0091] FIG. 15 shows the distribution for a certain game title, with the vertical axis representing the number of times and the horizontal axis representing time (the time interval between one operation and the next). Each line represents the distribution of operations by a different user. For example, in this example, the interval between operations peaks at 0.2 seconds, and is distributed between 0.1 and 0.4 seconds. Therefore, the initial value N is set to 1.1 seconds to cover this.

[0092] By having the server device set a default N value based on this distribution, the information processing device 10 obtains the threshold time (N value) from the server device when connecting to the network at the start of the game app, and uses this in step S104 of Figure 14.

[0093] Next, for a user who has performed multiple screenshot operations, the information processing device 10 may optimize the N value to suit that user. For example, based on the distribution trend of the time intervals between screenshot operations, the time at which the distribution decreases after reaching a peak is set as the N value. Specifically, for example, if there is a time interval after the peak in which the number of operations is 0 (a time interval in which 0 operations continue for a certain period of time thereafter), that time is used as N seconds. Furthermore, if there is no such time interval in which the number of operations is 0, the time interval with the smallest number is used as N seconds. Note that a maximum time of N seconds is also defined. The maximum time may be fixed or may be defined by the user.

[0094] FIG. 16 shows an example of such optimization in response to user operations. The control unit 190 of the information processing device 10 collects history information of users who use the information processing device 10, with, for example, N seconds set as an initial value. For example, this is history information stored during the screenshot processing in step S102 of FIG. 14. Based on this history information, distribution data such as that shown by the thin line L1 in FIG. 16 is generated and analyzed. In this case, it is assumed that the distribution shown by the solid line is obtained. In this distribution, the time interval of 0.5 seconds is 0 times, and the number of times continues to be 0 thereafter. Therefore, the N value is set (updated) to 0.5 seconds.

[0095] At a later point in time, when the control unit 190 generates distribution information, it will look like the thick line L2 in Figure 16. In this case, the number of operations is observed up to about 1.3 seconds, and after 1.4 seconds, it continues to be 0 for a certain period of time. Therefore, the N value is set (updated) to 1.4 seconds.

[0096] By having the control unit 190 successively update the N value in accordance with the actual use of the user, it is possible to optimize cycle determination as a group operation for that user. It is also advisable to update this N value by analyzing trends for each game title. This is because even for the same user, different game titles have different play styles and scenes that they want to capture.

[0097] Furthermore, if there is history information indicating that a screenshot operation was performed within N seconds after the user swiped the notification dialog 28 to close it, the value of N may be revised. For example, the new value of N seconds may be calculated by adding the time from the display of the notification dialog 28 to the next screenshot operation to the N seconds at that time.

[0098] Furthermore, after updating N seconds, if the user repeats the screenshot operation M times or more and the N value obtained by learning the distribution of the number of shots becomes significantly small, the N value may be set as a new threshold time.

[0099] It is preferable that the update of the N value through learning be performed in a time period when the load on the control unit 190 (CPU) inside the information processing device 10 is low.

[0100] An example of the processing performed by the control unit 190 regarding the setting of the N value will be described with reference to Figures 17 and 18. Figure 17 shows an example of processing regarding initial value setting. In step S201, the control unit 190 starts up a game application in response to a user operation.

[0101] In step S202, the control unit 190 determines whether or not the N value has already been set for the launched game application. If it has already been set, the process in FIG. 17 ends without performing any particular process related to the N value.

[0102] If an N value has not been set for the game, the control unit 190 proceeds to step S203 and requests an initial N value from the server device. The control unit 190 then acquires the N value transmitted from the server device. In step S204, the control unit 190 sets the acquired N value as the threshold time. Thereafter, the control unit 190 performs the processing of FIG. 14, using the set N value in the cycle determination in step S104.

[0103] 18 shows the process of updating the value of N. In step S220, the control unit 190 determines whether it is time to update and analyze the value of N.

[0104] For example, the control unit 190 learns the time periods during which the information processing device 10 is used and determines, for example, time periods during which use is low and the processing load of the control unit 190 is low. Therefore, the relevant time period would be a sleeping time period in the user's life cycle. In step S220, the control unit 190 checks whether such a time period has occurred. Furthermore, the control unit 190 checks whether the N value has been set or updated previously. For example, the control unit 190 checks whether the number of screenshot operations since the last setting or update has reached a predetermined number or whether a predetermined number of days has passed. If these have passed, it determines that it is time to update the N value. Alternatively, the timing of updating may also be determined when the user has swiped the notification dialog 28 to close it a predetermined number of times or more.

[0105] If it is determined based on these conditions that the timing for analysis for updating has arrived, the control unit 190 proceeds to step S221, where it generates and analyzes distribution data as shown in Figure 16 based on the history information. Then, in step S222, the control unit 190 checks whether a new N value different from the current one has been calculated from the distribution data. If the N value obtained from the analysis data is the same number of seconds as the current N value, there is no need to update the settings, and the process of Figure 18 ends.

[0106] If the N value obtained from the analysis data is a new number of seconds different from the current N value, the control unit 190 proceeds to step S223 and compares the new N value with a preset maximum time. The maximum time is the upper limit of the N value. If the new N value is not greater than the maximum time, the control unit 190 proceeds to step S225 and updates the number of seconds as the new N value to be the subsequent N value. If the new N value is greater than the maximum time, the control unit 190 changes the new N value to the maximum time in step S224, and then proceeds to S225 and updates the number of seconds as the new N value (maximum time) to be the subsequent N value.

[0107] Through the above process, the N value is updated and optimized according to the user's screenshot operation history.

[0108] So far, we have given an example of updating the N value based on the user's screenshot operation history, but there are other examples of factors that determine whether the N value needs to be optimized. For example, the camera's line of sight may be considered.

[0109] The user's line of sight is acquired by an in-camera (a camera that captures the user) in the imaging unit 130 of the smartphone, which is the information processing device 10. The control unit 190 then determines the location of the user's line of sight (a specific position on the display) while playing a game, and whether the eyeballs move to the position of the notification dialog 28 or whether the user is not staring at it, relative to the time spent staring.

[0110] For example, if there is no eye movement at the position of the notification dialog 28 after taking a screenshot, this timing means that no notification is expected, and it can be determined that this is a time included in one cycle. If the N value has not reached that time, it can be determined that the N value should be updated. Therefore, for example, the N value may be temporarily increased.

[0111] If the player is not staring, it can be determined that the player is not concentrating on the game. In such a case, the N value may be temporarily shortened.

[0112] Also, instead of displaying the notification dialog 28, it is possible to notify the user of the fact that a screenshot has been taken audibly, visually, or tactilely without issuing a notification.

[0113] 4. Marking During Video Storage Next, marking during video storage will be described as a function of the information processing device 10 according to the embodiment. For example, during a game, a game screen can be recorded (video storage) by operating the record icon 40 in the extended function menu 21 of FIG. 2B. During this recording, the information processing device 10 is configured to be able to execute a marking process as a function for storing still images such as screenshots.

[0114] For example, during recording, one of the hardware keys is assigned as an operator for a marking operation. The operator may be any of the volume key 11, power key 14, and camera key 15, and may be the same as or different from the key assigned to the screenshot operation described above. However, it is desirable to assign the same key assigned to the screenshot operation as the marking operation key during recording. For example, if the camera key 15 is used as the screenshot operator, the camera key 15 is also used as the marking operator.

[0115] FIG. 19 shows that the game screen 30 was recorded between time t0 and time t1 during game play. During this recording (and game play), the user performs a marking operation MK at the timing when they want to store a still image. For example, they press the camera key 15. This causes a timestamp MTC to be added to the recording data file as the marking operation position. For example, the timestamp MTC is data for the hour, minute, second, and frame, starting from the start of recording. The figure shows that five marking operations were performed during recording.

[0116] By marking in this way, the user can later store the still image data of the marked portion using the UI on the editing screen as shown in Fig. 20. Therefore, the marking operation can be performed in the same way as taking a screenshot of a moving image.

[0117] 20 displays a playback image 30M of the game screen 30, as well as a sequence bar 50. The sequence bar 50 indicates the time length of the recorded data file by the length of the bar, and a pointer 52 indicates the time position of the currently displayed playback image 30M.

[0118] In addition, the positions where marking operations have been performed are displayed as markers 51 along the sequence bar 50. Each marker 51 is displayed at a position corresponding to the corresponding stored time stamp MTC, allowing the user to know the time position where the marking operation has been performed in the recording data file.

[0119] When the user performs an operation to designate a certain marker 51, a frame bar 55 is displayed. The frame bar 55 displays, for example, the frame of the current timestamp MTC of the designated marker 51 in the center, and displays the frames before and after it side by side. A selection frame border 56 shows the frame image of the current timestamp MTC. In the example shown in the figure, a frame FR100 corresponding to the designated marker 51 and frames FR99 and RF101 before and after it are displayed.

[0120] The user can fine-tune the marking position using this frame bar 55. For example, when the user swipes left or right on the frame bar 55 (in the directions of the dashed arrows D1 and D2), the frame displayed within the selection frame 56 changes to the previous or next frame in time. This allows the timestamp MTC corresponding to the marker 51 to be adjusted frame by frame.

[0121] The editing screen is provided with a storage icon 54. When the user operates the storage icon 54, still image data of the frame with the timestamp MTC of the currently selected marker 51 is stored. That is, the user can select the marker 51 on the editing screen of Fig. 20, adjust the time position with the frame bar 55 as necessary, and operate the storage icon 54 to store the still image data of that scene.

[0122] After still image data has been stored for a certain marker 51, the display mode of that marker 51 may be changed as shown in Fig. 21. For example, the color of the marker 51 may be changed, the design of the marker 51 itself may be changed, or the marker 51 may be highlighted. This allows the user to distinguish the markers 51 for which still images have been stored.

[0123] An example of the processing performed by the control unit 190 regarding the above-mentioned marking will be described with reference to Figures 22 and 23. Figure 22 shows the processing performed during moving image storage (recording).

[0124] When the user operates the record icon 40 during gameplay, the control unit 190 determines that a recording operation has been performed, and proceeds from step S301 to step S302 to start the recording process. That is, the process of storing each frame of data displayed on the screen as each frame that constitutes a moving image begins.

[0125] During recording, the control unit 190 monitors for a recording stop operation in step S303, and also monitors for a marking operation in step S304. If a marking operation is detected, the control unit 190 proceeds from step S304 to step S305, where it sets a timestamp as the marking location. In other words, it stores the timestamp MTC of the frame at the timing of the marking operation.

[0126] When the operation to end recording is detected, the control unit 190 proceeds to step S306, performs recording end processing, and ends the processing in Fig. 22. At this point, a recording data file is created, and if a marking operation has been performed, a timestamp MTC corresponding to the marking operation is stored.

[0127] Fig. 23 shows a processing example when editing is performed on an editing screen such as that shown in Fig. 20. In response to a user's operation to open the editing screen, the control unit 190 performs processing to display the editing screen in step S320. For example, the control unit 190 displays a screen such as that shown in Fig. 20. The playback image 30M in Fig. 20 may be automatically played as a moving image, or a corresponding image may be displayed in response to a user's operation to move the pointer 52.

[0128] With the editing screen displayed, the control unit 190 monitors the user's selection operation of the marker 51 in step S321. Furthermore, in step S343, the control unit 190 monitors an operation to close the editing screen. If an operation to close the editing screen is detected, the control unit 190 proceeds to step S344, and transitions from the editing screen to a normal screen (for example, the game screen 30, etc.).

[0129] When an operation to select a marker 51 is detected, the control unit 190 proceeds from step S321 to step S322, and starts displaying the frame bar 55 corresponding to the selected marker 51. That is, the frame of the current timestamp MTC of the selected marker 51 and the frames before and after it are displayed side by side. The reproduced image 30M is the image of the frame of the timestamp MTC of that marker 51.

[0130] In a state where the frame bar 55 is displayed for a certain marker 51, the control unit 190 monitors the user's operation in a loop of steps S333, S334, S335, and S336.

[0131] When it is detected that the user has performed an operation on the frame bar 55, the control unit 190 proceeds from step S333 to step S337, and controls frame movement on the frame bar 55. That is, the frame image is moved left and right to change the frame that fits into the selection frame boundary 56. In response to this, the value of the corresponding timestamp MTC is also changed.

[0132] If the user performs an operation to select another marker 51, the control unit 190 proceeds from step S334 to step S322, and causes the frame bar 55 corresponding to the newly selected marker 51 to be displayed.

[0133] If an operation to end the editing screen is detected, the control unit 190 proceeds from step S336 to step S344, and transitions to the normal screen (for example, the game screen 30, etc.).

[0134] If the control unit 190 detects that the user has operated the storage icon 54, the control unit 190 proceeds from step S335 to step S341, and performs a process of storing the current frame as still image data. That is, the control unit 190 performs a storage process for the frame currently indicated in the selection frame box 56 in the frame bar 55 (the frame with the timestamp MTC at that time).

[0135] In step S342, the control unit 190 changes the display mode of the corresponding marker 51, for example, as shown in FIG. 21, to indicate that the storage has been performed.

[0136] By the above-described process, the user can select a marking operation location after recording the game screen and store still image data of any scene.

[0137] Here, we will discuss the assignment of functions to hardware keys. The operations for starting and stopping the recording of the content screen of a game or the like as described above are not limited to operations from the extended function menu 21, for example, but the operation functions may be assigned to hardware keys.

[0138] Alternatively, recording may be performed only while a hardware key is being pressed.

[0139] It can also be applied to retroactive recording. For example, this is a process for recording from R seconds before pressing a hardware key to S seconds after pressing the hardware key. For example, a background process may be performed to constantly store the game screen 30 or the like in memory for a certain period of time, and then, in response to a user operation, a process may be performed in which video data from R seconds before to S seconds after is saved in storage. The R seconds before and S seconds after may be fixed, or may be user-configurable.

[0140] Hardware keys may also be assigned to operations such as starting and stopping live streaming, muting / unmuting audio, turning the camera on / off, and switching the streaming screen to a dummy screen and unmuting it.

[0141] 5. Notification Functions The following describes examples of processing functions for displaying various notifications, not limited to screenshots. In particular, these are functions for providing various real-world notifications when the user is immersed in a non-real world, such as playing a game.

[0142] As a case, for example, assume that the user is immersed in some task on the information processing device 10 (smartphone), such as playing a game or watching a video. Assume that while the user is immersed in a world such as VR (Virtual Reality) or AR (Augmented Reality), a notification is generated regarding an event occurring in the real world.

[0143] What is appropriate for users is to avoid interrupting their immersive experience while still receiving important notifications that interrupt their immersion. It is also desirable that they do not have to manually switch settings. Users want to be able to see only the notifications they are willing to receive even if it means interrupting their immersion, and want to be able to see other notifications after they have finished immersion. They also want to avoid notifications that completely interrupt their immersion. They also want to be able to know when a notification arrives while remaining immersed, and to be able to find out more details about the notification at a time that is convenient for them, depending on its content.

[0144] To meet such demands, it is possible to set the notification level for the user. For example, it can be set as follows.

[0145] ・Extra high importance: A notification that requires the immediate termination of the current user's immersive experience. ・High importance: A notification that does not require the current immersive experience to be terminated immediately, but requires the user to take action to make the user aware of it at an appropriate time. ・Medium importance: A notification that does not disrupt the current immersive experience, but that the user should be aware of. ・Low importance: A notification that does not disrupt the current user's immersive experience, and that should be made aware of after the immersive experience. ・No importance: A notification that the user does not want to be displayed at all times.

[0146] For example, notifications of emergency alerts such as earthquake warnings are of extremely high importance. However, the importance may differ depending on the user.

[0147] Consider, for example, an example of an earthquake or other emergency alert. [Extraordinary Importance] Suppose a user who lives on the coast of a certain region is playing a game on the information processing device 10. At that time, an emergency earthquake alert is issued for that region. The predicted seismic intensity is 6, and a tsunami warning is issued for the residential area. In such a case, the user must immediately end the game and begin evacuation, so a display or sound notification that completely interrupts the user's immersion and is absolutely noticeable is required.

[0148] [Low Importance] Suppose a user living in a certain area is playing a game and an alert is issued that does not affect that area. In this case, the importance is not high. For example, a notification will be displayed after the game ends, and the user will be able to know the content of the notification.

[0149] [Low Importance] Suppose an alarm is issued during a competition such as an offline e-sports tournament. In such a case, overall evacuation guidance by the management side is more important than individual actions. In order for the management side to guide the actions of the players, notifications are not displayed on each player's individual information processing device 10 for the competition.

[0150] As in the above example, notifications of the same content may have different levels of importance depending on the user.

[0151] The following are examples of factors that may be considered when determining the importance of a notification to a user. For example, the information processing device 10 determines the importance of a notification by comprehensively taking into account not only the importance of the notification to the user but also the context (global situation, the user's own situation, etc.). For example, the following is an example.

[0152] - The user will not be notified of content that they were interested in in the past but are no longer interested in. - The user will be notified of content that they are interested in now but were not interested in in the past. - Notifications of information with similar content will not be sent. - Notifications of communication opportunities with family and friends will not be sent for a certain period of time, but in situations where the other person may be offended or inconvenienced, the user will be notified before such a situation occurs.

[0153] The information processing device 10 may also learn the timing at which notifications were opened in the past, and issue notifications according to the learning results.

[0154] It is also conceivable that the information processing device 10 automatically determines the timing of notification based on the user's daily behavior pattern. For example, the timing and manner of notification may be controlled for each level of importance of notification, taking into consideration the following information elements:

[0155] - User behavior in each time period - Location information of the user (information processing device 10) (for example, information obtained by detecting movement speed and movement distance using GPS, and determining the connected network) - Dependency on the main task (for example, notifications for highly dependent tasks such as a voice chat app during a game are given a higher importance) - Frequency with which the user looks at the screen and operates it - Processing within the information processing device 10, such as the CPU / GPU - Movement of the user's eyeballs detected by a camera - Biometric information of the user and distance from the terminal obtained from a watch-type terminal, etc. - Times of sunrise and sunset determined from location information - Brightness of the current location obtained from an illuminance sensor - Brightness of the color of the image on the screen

[0156] There are various possible notification modes for each level of importance. For example, for notifications of extremely high importance, it is necessary to notify immediately, regardless of timing. Furthermore, as shown in FIG. 24, the notification dialog 60 should be displayed using most of the screen area. It is recommended to use at least half of the screen area. This ensures that even users immersed in a game or the like can recognize the notification.

[0157] On the other hand, when the notification level is high or medium, we want the user to be aware that a notification has arrived, without disrupting the current immersive experience. For example, areas on the display that the user is not paying attention to can be set as the display location for notifications that do not disrupt immersion. For example, areas that are not important to the immersive experience can be identified based on the following three points, and notifications can be displayed in those areas. - Areas where there are few screen drawing updates - Areas where gaze time is short based on gaze determination using the in-camera - Areas where there is little touch operation

[0158] Areas with fewer screen rendering updates are areas where information that will affect the current primary experience is less likely to be displayed. Areas with less gaze time determined by the in-camera gaze detection are areas where information that will affect the current primary experience (game, etc.) is less likely to be displayed. Areas with fewer touch operations are areas where there is less likely to be an impact on the operation of the current primary experience. For example, the area indicated by the dashed line PA on the game screen 30 in FIG. 25 is an area that falls into this category. By displaying notifications in such areas, it is possible to avoid disrupting the user's immersive experience.

[0159] It is also a good idea to use colors to make notifications more noticeable on the game screen 30. For example, the color of the image of the main experience displayed in the notification area determined by the above logic can be analyzed, and the notification can be displayed with a frame or fill of a contrasting color in terms of hue, brightness, and saturation. This makes it easier for users to notice even small notifications in a small area like the dashed line PA.

[0160] It is also a good idea to change the size and content of notifications depending on the level of the notification, for example, by changing the display format of notifications, such as just a blinking dot, an icon, or a text message.

[0161] Also, if the notification level is not of extreme importance, it may be possible to decide whether or not to output a notification depending on the situation during the game. In particular, notifications will not be output when the user does not want them to be output, and only notifications that are desired will be output when they are desired. Examples of this include the following:

[0162] ・During a game match: Do not output notifications ・In a game lobby: Only output notifications related to the current gameplay, such as voice chat notifications ・In situations where privacy is a concern: Do not output notifications ・In situations where you briefly switch from the game to another app but immediately return: Only output notifications related to the purpose of the switch, and do not output other notifications ・End of the game: Output notifications

[0163] The following are some examples of these determination methods: Determining whether a game is in a match can be done using machine learning, such as whether the game app is full screen, whether the drawing update frequency and update area are high, image analysis of the screen during the match, or whether the user's touch events into the game app are frequent.

[0164] To determine whether a game lobby is in progress, machine learning can be used to determine whether the game app is full-screen, whether the frequency and area of ​​drawing updates are low, whether there are low touch events from the user entering the game app, and other factors.

[0165] Examples of activities that may cause privacy concerns while playing a game include live streaming, recording, taking screenshots, connecting an external display (capture board), etc. These can be determined by whether a video output function other than output to the display of the information processing device 10 is running.

[0166] Additionally, whether there are other people in the same space (real or virtual) can also be used to determine whether privacy is a concern. For example, a situation where someone is looking at the screen can be determined by the number of voices picked up by the in-camera or microphone and the direction from which the voices are coming. The presence of other people nearby can also be determined by the number of voices picked up by the microphone, the direction from which the voices are coming, and the volume of the voices. The situation of being in a car can be determined from information on the weight of the seat, whether the seat belt is fastened, the car's camera, and thermography. The presence of other people in a virtual space can also be determined.

[0167] Temporary transitions from a game to another app can be determined by machine learning, based on the tendency of time spent on the screen sandwiched between the game screen and the transition between the game screen and another screen. Also, whether brainwave activity remains unchanged, for example, whether the activation state related to the game continues, is also a determining factor.

[0168] Game termination can also be determined by machine learning, which measures the time spent on screens sandwiched between transitions between game screens. Learning user play habits, such as what day of the week, what time of day, and how long a game is played, as well as learning about apps that are switched back and forth between quickly during a game, can also be used as factors for determining game termination. Changes in brain wave activity can also be used as a factor for determining game termination.

[0169] The following is an example of processing when temporarily transitioning from a game to another app or when quitting a game. For example, when a user leaves a game and is using another app, a screenshot of the game screen just before the user left or quit the game, and a comment (e.g., "Would you like to resume the game?") may be displayed on the screen. Note that either the screenshot or the comment may be displayed on the screen, or both may be displayed simultaneously. This display allows the user to recall the game situation just before quitting, and can take action such as resuming the game if necessary.

[0170] It is also possible to transfer notification settings between devices based on personal preferences. General preferences are initially reflected, and personal preferences are reflected upon logging in. For example, notification methods can be tailored to suit the user.

[0171] The information processing device 10 may also be connected to devices other than the information processing device 10, such as a console game device, a mobile game device, a PC, an AR / VR device, a watch-type device, or a car (while driving or riding in it), to comprehensively analyze the user's own tendencies and provide notifications accordingly. For cars, the notification method may differ depending on whether or not there are passengers. For example, if there are no passengers, a notification reflecting the user's own tendencies may be provided, but if there are passengers, a notification of general tendencies that do not reflect the user's own tendencies may be provided. Furthermore, if there are passengers, a notification reflecting the passengers' tendencies may be provided based on passenger-related data acquired from a server device or the like.

[0172] 6. Hardware Configuration Example An example of a hardware configuration of the information processing device 10 according to an embodiment of the present disclosure will be described. Fig. 26 is a block diagram showing an example of a hardware configuration of the information processing device 10.

[0173] The information processing device 10 includes, for example, a processor 871, a ROM 872, a RAM 873, a host bus 874, a bridge 875, an external bus 876, an interface 877, an input device 878, an output device 879, a storage 880, a drive 881, a connection port 882, and a communication device 883. Note that the hardware configuration shown here is an example, and some of the components may be omitted. Furthermore, the information processing device 10 may further include components other than those shown here.

[0174] (Processor 871) The processor 871 functions, for example, as an arithmetic processing device or control device, and controls the overall operation of each component or part of it based on various programs and data recorded in the ROM 872, RAM 873, storage 880, or removable recording medium 901.

[0175] (ROM 872, RAM 873) The ROM 872 is a means for storing programs to be read into the processor 871, data to be used for calculations, etc. The RAM 873 temporarily or permanently stores, for example, the programs to be read into the processor 871 and various parameters that change as appropriate when the programs are executed.

[0176] (Host bus 874, bridge 875, external bus 876, interface 877) The processor 871, ROM 872, and RAM 873 are connected to one another via, for example, a host bus 874 that is capable of high-speed data transmission. On the other hand, the host bus 874 is connected to, for example, an external bus 876 that has a relatively low data transmission speed via a bridge 875. Furthermore, the external bus 876 is connected to various components via an interface 877.

[0177] (Input Device 878) For example, a mouse, keyboard, touch panel, button, switch, lever, etc. are used as the input device 878. Furthermore, a remote controller (hereinafter referred to as a remote control) capable of transmitting control signals using infrared rays or other radio waves may also be used as the input device 878. The input device 878 also includes an audio input device such as a microphone.

[0178] (Output device 879) The output device 879 is a device that can notify the user of acquired information visually, audibly, and tactilely, such as a display device such as an LCD or organic EL, an audio output device such as a speaker or headphones, a printer, a mobile phone, or a facsimile.

[0179] (Storage 880) The storage 880 is a device for storing various types of data. For example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, or a magneto-optical storage device may be used as the storage 880.

[0180] (Drive 881) The drive 881 is a device that reads information recorded on a removable recording medium 901 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, or writes information to the removable recording medium 901.

[0181] (Removable recording medium 901) The removable recording medium 901 is, for example, various semiconductor storage media, DVD media, Blu-ray (registered trademark) media, HD DVD media, etc. Of course, the removable recording medium 901 may also be, for example, an IC card equipped with a contactless IC chip, or an electronic device.

[0182] (Connection Port 882) The connection port 882 is a port for connecting an external device 902, such as a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface), an RS-232C port, or an optical audio terminal.

[0183] (Externally Connected Device 902) The externally connected device 902 is, for example, a printer, a portable music player, a digital camera, a digital video camera, or an IC recorder.

[0184] (Communication device 883) The communication device 883 is a communication device for connecting to a network, such as a communication card for wired or wireless LAN, Bluetooth (registered trademark), or WUSB (Wireless USB), a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various types of communication.

[0185] The above-described configuration of the information processing device 10 can be considered to be, for example, the configuration of a smartphone or a PC on which the first application is started.

[0186] 7. Summary and Modifications The above-described embodiment provides the following advantages. The information processing device 10 according to the embodiment stores an image displayed on the screen in response to a screenshot operation. The information processing device 10 includes a control unit 190 that determines whether one or more screenshot operations constitute a cycle of consecutive operations and, upon determining that the consecutive operations have ended, displays a notification corresponding to the screenshot operation. That is, the control unit 190 determines the cycle of consecutive operations and displays the notification dialog 28 in a state where one or more screenshot operations are consecutively performed. This prevents the notification dialog 28 from appearing in the stored still image, even if the next screenshot operation is performed at a relatively short interval, making it suitable for continuous shooting. Furthermore, the user can proceed with the next screenshot operation without having to take the trouble of dismissing the notification dialog 28 by swiping or the like.

[0187] In the embodiment, the control unit 190 performs an example of screenshot operation by operating a single hardware key provided on the housing of the information processing device 10 (see FIGS. 8, 9, and 10). By assigning a hardware key as the operator for the screenshot operation, the user can perform the screenshot operation regardless of the screen state. With a software key, it takes time from the moment the user decides to take a screenshot to the actual capture, which can result in missing the desired moment as the scene moves by in milliseconds. However, with a hardware key, a screenshot can be taken instantly with a single touch. Furthermore, with a software key, the next capture operation cannot be performed until the previous screenshot saving process is completed. For example, if the single SS icon 26 cannot be pressed, continuous capture cannot be performed, and the desired moment may be missed. In contrast, with hardware key operation, there are no limitations on the screen, so continuous operations within a short period of time are possible.

[0188] In the embodiment, the control unit 190 determines that one cycle of grouped operations has ended if the next screenshot operation is not performed within a threshold time from the most recent screenshot operation (see FIGS. 11 and 14). For example, if the next screenshot operation is performed within a threshold time of N seconds, it is considered to be included in one cycle. Then, if the next screenshot operation is not performed within the threshold time, it is determined that one cycle has ended. This makes it possible to output the notification dialog 28 after the completion of multiple screenshot operations in a relatively short period of time. In other words, it is possible to prevent the notification dialog 28 from being displayed for each screenshot operation, thereby preventing the screenshot operation from being interrupted.

[0189] Note that the end of the group of operations may be determined based on other than the elapsed time since the most recent screenshot operation. For example, the number of screenshot operations may be combined, and when a predetermined maximum number is reached, the cycle may be determined to have ended even before the threshold time has elapsed. Alternatively, the determination may be based only on the number of operations. Furthermore, the end of the cycle may be determined based on the position of the user's finger relative to the information processing device 10. For example, if the camera key 15 is assigned to the screenshot operation, the end of the cycle may be determined when it is detected that the user's finger has been removed from the camera key 15.

[0190] In the embodiment, an example was given in which the control unit 190 performs processing to display a notification in response to a screenshot operation if the next screenshot operation is performed within a threshold time from the most recent screenshot operation but results in a storage processing error (see FIGS. 11 and 14). For example, even if the next screenshot operation is performed within a threshold time of N seconds, if an error occurs, the notification dialog 28 is immediately displayed. This is because even if the user performs a screenshot operation thereafter, there is a high possibility that the still image will not be properly stored.

[0191] In the embodiment, an example was given in which the control unit 190 sets (including updates) the threshold time according to the content being launched (see FIG. 17 ). The number of screenshot operations, frequency, and demand for continuous shooting vary depending on the game title, and are also likely to vary for each content title, not limited to games but also including video content and other content. Therefore, by setting the threshold time (N seconds) according to the content being launched, cycle determination can be performed in accordance with that content. The content-specific setting can be obtained, for example, from a server device with which the game is communicated when the game is launched, or by storing the threshold time for each content in advance within the information processing device 10 and reading it out.

[0192] In the embodiment, an example was given in which the control unit 190 sets (including updates) the threshold time based on the user's operation history (see FIGS. 16 and 18). Screenshot operations vary from person to person, so the default setting may not always be appropriate. Therefore, the control unit 190 analyzes distribution data on the time between captures from the user's operation history and sets or updates the threshold time (N seconds). This allows the cycle determination to be optimized to suit the user.

[0193] In the embodiment, an example has been given in which the control unit 190 performs processing related to setting (including updating) the threshold time based on the user's operation history at a timing determined based on the time period during which the user uses the information processing device 10 (see FIG. 18 ). The threshold time (N seconds) is learned and updated during a time period during which the information processing device 10 is not in use, based on which the learning and updating is performed. In other words, the learning and updating is performed during a time period during which the CPU load on the information processing device 10 is low. This prevents updating the threshold time from imposing a processing burden.

[0194] In the embodiment, an example has been given in which the control unit 190 performs processing to display, as a notification in response to a screenshot operation, information related to processing in response to one or more screenshot operations performed by a group operation (see FIGS. 12, 13, and 14). For example, in step S110 of FIG. 14, if one screenshot is taken as one cycle, the control unit 190 executes a display related to that one screenshot, and if multiple screenshots are taken as one cycle, the control unit 190 executes a display related to processing in response to the multiple screenshot operations, such as a storage process for still images. This makes it possible to present appropriate information to the user even when multiple screenshots are considered one cycle.

[0195] In the embodiment, the control unit 190 displays information about multiple screenshot operations performed by a group operation as a notification in response to a screenshot operation, and if there are errors in the storage process for some of the images, the control unit 190 displays the number of images that were successfully stored and the number of errors (see FIGS. 12 and 14). For example, if multiple images are taken as one cycle and some of the images contain errors, the control unit 190 displays the number of images that were successfully recorded and the number of errors in step S120 of FIG. 14. This allows the user to be appropriately notified of errors even if multiple images are taken as one cycle.

[0196] In the embodiment, when the control unit 190 displays information about a single screenshot operation performed by a group operation as a notification in response to a screenshot operation, the control unit 190 executes a notification that includes a display that allows transition to post-processing of the stored image. Furthermore, when the control unit 190 displays information about multiple screenshot operations performed by a group operation as a notification in response to a screenshot operation, the control unit 190 executes a notification that does not include a display that allows transition to post-processing of the stored image (see FIGS. 13 and 14 ). For example, in the case of a single shot as shown in FIGS. 13A and 13B , the share button 44, edit button 45, and delete button 46 are displayed, but in the case of multiple shots, these buttons are not displayed as shown in FIGS. 13C and 13D . In the case of multiple shots, since it is not possible to identify the target image, the display related to post-processing is not included in the notification dialog 28, thereby simplifying the notification.

[0197] In the embodiment, an example was given in which the control unit 190 performs a marking process that stores a position within a moving image in response to a specific operation during moving image storage, and a UI process that displays the marked position within the stored moving image and enables storage of an image at the specified marked position (see FIGS. 19, 20, 21, 22, and 23). For example, the control unit 190 makes a marker 51 selectable on a screen such as that shown in FIG. 20 and displays an image of the marker 51. Then, a storage icon 54 is made available for still image storage. This allows marking to be performed during moving image storage using the same operation as a normal screenshot, and ultimately the resulting still image can be stored. Furthermore, by using the same operation as for screenshotting, such as the operation of the camera key 15, the user can intuitively perform marking operations during moving image storage.

[0198] In the embodiment, an example has been given in which the control unit 190 performs UI processing to enable the user to adjust the marking position (see FIGS. 20 and 23). For example, the control unit 190 enables the user to select the marker 51 on a screen such as that shown in FIG. 20, and allows the user to adjust the marking position using the frame bar 55. This allows the user to further fine-tune the position of the marking operation while storing the moving image and store it in the same way as a screenshot.

[0199] In the embodiment, the control unit 190 performs an example process of determining the importance level of various notifications and displaying the notification content in a display mode corresponding to the importance level. For example, the control unit 190 classifies notifications into several levels, from extremely important to unimportant, and displays the notification content in a mode that changes the ease of recognition for the user depending on the importance level. This allows for an appropriate notification display that can balance the real world and the unreal world for a user immersed in a game or the like.

[0200] In the embodiment, the control unit 190 performs processing to display the content of a notification with the highest level of importance in an area that occupies the majority of the display area. For example, the control unit 190 displays a notification with an extremely high level of importance in a way that ensures that the user is aware of it, as in the notification dialog 60 in Fig. 24. This allows the user to be aware of important matters in the real world even while immersed in a game.

[0201] In the embodiment, an example has been given in which the control unit 190 performs processing to display notification contents of a certain level of importance in a non-attention area of ​​the screen. For example, for notifications that are not particularly important but that the user would like to know about, the notification contents are displayed in a non-attention area that does not interfere with the user's immersive experience, as shown in Figure 25. This makes it possible to avoid unnecessarily interrupting the user's experience of the unreal world.

[0202] In the embodiment, an example has been given in which the control unit 190 performs processing to display various notifications on the screen of game content at timing or in a display manner according to the game status. While the game is running, the control unit 190 determines whether to display notifications or not, and selects a display manner, depending on various game statuses. This allows notifications to be presented in a manner desirable for the user while the game content is running. Furthermore, the control unit 190 can also present a desirable notification to the user when the game is interrupted by performing processing to display notification content on the screen of content other than the game content, urging the user to resume the game content.

[0203] The program of the embodiment is a program that causes, for example, a CPU, a DSP, or a device including these, to execute the processes shown in Figures 14, 17, 18, 22, and 23. That is, the program of the embodiment is a program that causes the information processing device 10 to execute a process of storing an image displayed on the screen in response to a screenshot operation, and to determine whether a group operation is performed for one or more screenshot operations, and to display a notification in response to the screenshot operation in response to determining that the group operation has ended. With such a program, the information processing device 10 of the present disclosure can be easily realized using a smartphone, a PC, or the like.

[0204] Such a program can be pre-recorded on a hard disk drive (HDD) or a ROM in a microcomputer having a CPU, which serves as a built-in recording medium in a computer or other device. Alternatively, the program can be temporarily or permanently stored (recorded) on a removable recording medium such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), a Magneto Optical (MO) disc, a DVD (Digital Versatile Disc), a Blu-ray Disc (registered trademark), a magnetic disk, a semiconductor memory, or a memory card. Such removable recording media can be provided as so-called packaged software. Furthermore, such a program can be installed on a personal computer or the like from a removable recording medium, or can be downloaded from a download site via a network such as a local area network (LAN) or the Internet.

[0205] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0206] The present technology may also be configured as follows. (1) An information processing device including a control unit that performs a process of storing an image displayed on a screen in response to a screenshot operation, determines whether one or more screenshot operations are a group operation, and, in response to determining that the group operation has ended, displays a notification in response to the screenshot operation. (2) The information processing device described in (1) above, in which the control unit determines that an operation of one hardware key provided on a housing is a screenshot operation. (3) The information processing device described in (1) or (2) above, in which the control unit determines that the group operation has ended when a next screenshot operation is not performed within a threshold time from the most recent screenshot operation. (4) The information processing device described in any of (1) to (3) above, in which the control unit performs a process of displaying a notification in response to the screenshot operation when a next screenshot operation is performed within the threshold time from the most recent screenshot operation but a storage processing error occurs. (5) The information processing device described in (3) or (4) above, in which the control unit sets the threshold time in response to content to be launched. (6) The information processing device described in any of (3) to (5) above, in which the control unit sets the threshold time based on a user's operation history. (7) The information processing device according to (6) above, wherein the control unit performs processing related to settings based on the user's operation history for the threshold time at a timing determined based on a time period during which the user uses the information processing device. (8) The information processing device according to any of (1) to (7) above, wherein the control unit performs processing related to processing related to one or more screenshot operations performed by a group operation as a notification in response to the screenshot operation. (9) The information processing device according to (8) above, wherein the control unit performs processing related to the number of screenshot operations performed by a group operation as a notification in response to the screenshot operation, and when there is an error in the storage processing in part, performs processing related to the number of items that were successfully stored and the number of errors.(10) The information processing device according to (8) or (9), wherein the control unit, when displaying information about a single screenshot operation performed by a group operation as a notification in response to a screenshot operation, executes a notification including a display that allows transition to post-processing of the stored image, and when displaying information about multiple screenshot operations performed by a group operation as a notification in response to a screenshot operation, executes a notification that does not include a display that allows transition to post-processing of the stored image. (11) The information processing device according to any of (1) to (10), wherein the control unit performs a marking process that stores a position in a video in response to a specific operation while the video is being stored, and a user interface process that displays the marking position in the stored video and enables storage of an image at a specified marking position. (12) The information processing device according to (11), wherein the control unit performs the user interface process to enable adjustment of the marking position by a user operation. (13) The information processing device according to any of (1) to (10), wherein the control unit determines an importance level for various notifications and processes to display the notification content in a display mode according to the importance level. (14) The information processing device according to (13) above, wherein the control unit performs a process of displaying notification content in an area occupying more than half of the display area for notifications with the highest importance level. (15) The information processing device according to (13) or (14) above, wherein the control unit performs a process of displaying notification content in a non-focus area of ​​the screen for notifications with a certain importance level. (16) The information processing device according to any of (1) to (15) above, wherein the control unit performs a process of displaying notification content for various notifications on a screen of game content at a timing or in a display mode according to the game status. (17) The information processing device according to (16) above, wherein the control unit performs a process of displaying notification content urging the user to resume game content on a screen of content other than game content.(18) An information processing method in which an information processing device performs a process of storing an image displayed on a screen in response to a screenshot operation, and determines whether one or more screenshot operations are a group operation, and performs a process of displaying a notification in response to the screenshot operation in response to determining that the group operation has ended. (19) A program that causes an information processing device to perform a process of storing an image displayed on a screen in response to a screenshot operation, and determines whether one or more screenshot operations are a group operation, and performs a process of displaying a notification in response to the screenshot operation in response to determining that the group operation has ended.

[0207] 10 Information processing device 11 Volume key 14 Power key 15 Camera key 28 Notification dialog 30 Game screen 40 Record icon 41 Text message 42 Thumbnail 44 Share button 45 Edit button 46 Delete button 50 Sequence bar 51 Marker 52 Pointer 54 Memory icon 55 Frame bar 56 Selection frame 190 Control unit

Claims

1. An information processing device having a control unit that performs a process of storing an image displayed on a screen in response to a screenshot operation, determines whether one or more screenshot operations are a series of operations, and, upon determining that the series of operations has ended, displays a notification in response to the screenshot operation.

2. The information processing device according to claim 1, wherein the control unit regards the operation of one hardware key provided on the housing as a screenshot operation.

3. The information processing device according to claim 1, wherein the control unit determines that the group operation has ended if a next screenshot operation is not performed within a threshold time from the most recent screenshot operation.

4. The information processing device according to claim 1, wherein the control unit performs processing to display a notification corresponding to the screenshot operation when the next screenshot operation is performed within a threshold time from the most recent screenshot operation but a storage processing error occurs.

5. The information processing device according to claim 3, wherein the control unit sets the threshold time in accordance with the content to be launched.

6. The information processing device according to claim 3, wherein the control unit sets the threshold time based on a user's operation history.

7. The information processing device according to claim 6, wherein the control unit performs processing relating to the setting based on the user's operation history of the threshold time at a timing determined based on a time period during which the user uses the information processing device.

8. The information processing device according to claim 1, wherein the control unit performs processing for displaying, as a notification in response to a screenshot operation, information regarding processing in response to one or more screenshot operations performed by a group operation.

9. The information processing device according to claim 8, wherein the control unit, when displaying information regarding multiple screenshot operations performed by a batch operation as a notification in response to the screenshot operation, performs processing to display the number of items successfully stored and the number of errors if there is an error in the storage process.

10. The information processing device according to claim 8, wherein the control unit executes a notification including a display allowing transition to post-processing of the stored image when displaying information regarding a single screenshot operation performed by a group operation as a notification in response to the screenshot operation, and executes a notification not including a display allowing transition to post-processing of the stored image when displaying information regarding multiple screenshot operations performed by a group operation as a notification in response to the screenshot operation.

11. The information processing device according to claim 1, wherein the control unit performs a marking process for storing a position within a video in response to a specific operation during video storage, and a user interface process for displaying the marking position within the stored video and enabling storage of an image of the specified marking position.

12. The information processing device according to claim 11, wherein the control unit performs the user interface processing so as to enable adjustment of the marking position by a user operation.

13. The information processing device according to claim 1, wherein the control unit performs processing for determining an importance level for each type of notification and displaying the notification content in a display mode corresponding to the importance level.

14. The information processing device according to claim 13, wherein the control unit performs processing for displaying notification content with an area that occupies the majority of the display area for notifications with the highest level of importance.

15. The information processing device according to claim 13, wherein the control unit performs processing for displaying notification contents in a non-attention area of ​​the screen for notifications of a certain level of importance.

16. The information processing device according to claim 1, wherein the control unit performs processing for displaying various notifications on a game content screen at a timing or in a display format according to the game status.

17. The information processing device according to claim 16, wherein the control unit performs processing to display a notification message urging the user to resume the game content on a screen of content other than the game content.

18. An information processing method in which an information processing device performs a process of storing an image displayed on a screen in response to a screenshot operation, and also performs a process of determining whether or not a batch operation is performed for one or more screenshot operations, and, upon determining that the batch operation has ended, displays a notification in response to the screenshot operation.

19. A program that causes an information processing device to execute a process of storing an image displayed on a screen in response to a screenshot operation, and to determine whether one or more screenshot operations are a series of operations, and to display a notification in response to the screenshot operation when it is determined that the series of operations has ended.

Citation Information

Patent Citations

  • A device called "Manila marquetry"

    FR100E

  • Processing method and program

    JP2022106910A

  • Image forming apparatus, and method of acquiring operation screen

    JP2011055289A

  • Method and system for dynamic screenshot applied to mobile terminal

    US20140327831A1

  • Capture notification system, capture notification method, program, information storage medium, and information processing device

    WO2015093505A1

Cited By

  • Non-transitory computer readable medium storing program, and gaming device

    US20250269288A1