Video playback device, wearing device, video playback system, and program
The video playback device improves video information reception by arranging multiple slots for flexible playback speeds and positions, enabling efficient multitasking and flexible viewing.
Patent Information
- Application Number
- JP2024060607
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-04-04
- Publication Date
- 2025-10-17
AI Technical Summary
Existing video playback methods do not allow efficient skimming or re-reading of video content, requiring full concentration and limiting multitasking, and lack flexibility in playback speed and position selection.
A video playback device that arranges multiple video playback slots side by side, allowing for different playback speeds, positions, and formats, with audio output and text conversion, enabling flexible viewing and multitasking.
Enhances video information reception efficiency by allowing simultaneous viewing of multiple video segments at varied speeds and positions, with flexible speed control and text output, reducing time constraints.
Smart Images

Figure 2025158246000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a video playback device, a mounting device, a video playback system, and a program. [Background technology]
[0002] The spread of video is currently accelerating. Watching video is a cognitive process that is close to instinct, and is one of the ways that information is easily absorbed in information sharing and education. It is expected that the spread of various video content related to meetings, seminars, training, manuals, education, etc. will continue in the future. It is also expected that the use of generative AI will make video creation easier. Furthermore, with the spread of MR (Mixed Reality) devices that have displays in the field of vision at all times, it is highly likely that a future will come in which we live our lives watching videos. The problems with watching videos are that "you don't know the content until you start watching" and "watching requires the concentration of your eyes and ears." Currently, it is difficult to improve efficiency by skimming or rereading freely like reading, and you can only decide whether or not to watch a video after you have finished watching it. Also, while watching, your eyes and ears are monopolized, so you cannot do anything else and it puts a significant constraint on your time.
[0003] Situations where videos need to be viewed efficiently also arise when viewing videos captured by a surveillance camera, for example. In such a situation, a method for viewing videos in a surveillance camera has been disclosed that allows videos to be viewed efficiently and improves viewability when checking the videos later (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Patent No. 6446006 Summary of the Invention [Problem to be solved by the invention]
[0005] The method described in Patent Document 1 involves editing the captured video data by linking, deleting, etc., and then arranging multiple videos side by side. Therefore, it is not possible to watch unedited videos.
[0006] Therefore, an object of the present invention is to provide a video playback device, a wearable device, a video playback system, and a program that improve the efficiency with which people receive video information by improving the playback and arrangement of videos. [Means for solving the problem]
[0007] The present invention solves the above problems by the following means. A first invention is a video playback device comprising: a video playback means for arranging a plurality of video playback slots side by side and playing videos in the video playback slots; a slot designation receiving means for receiving designation of one of the plurality of video playback slots; and an audio output means for outputting the audio of the video played in the one video playback slot accepted by the slot designation receiving means to an audio output unit. A second invention is a video playback device according to the first invention, further comprising a playback position determination means for determining a plurality of playback positions for one video, and a playback frame arrangement means for arranging the video playback frames in a predetermined area according to the number of playback positions determined by the playback position determination means, wherein the video playback means plays the one video at the playback position determined by the playback position determination means in each video playback frame arranged in the order of the playback positions. A third invention is a video playback device according to the second invention, wherein the playback frame arrangement means arranges the video playback frames, the number of which is the same as the number of playback positions, in a grid pattern, and the video playback means plays the one video at the playback position determined by the playback position determination means in each video playback frame arranged in order in a spiral shape with the video playback frame located at the center of the screen as the center. A fourth invention is a video playback device according to the second or third invention, which is provided with a playback information output means for outputting information relating to the playback position of one of the videos played in each video playback frame near each video playback frame. A fifth invention is a video playback device according to any one of the second to fourth inventions, wherein the video playback means plays the video in other video playback slots, excluding the one video playback slot accepted by the slot designation accepting means, at a playback speed slower than the playback speed of the one video in the one video playback slot. A sixth invention is a video playback device according to the first invention, further comprising a playback slot arrangement means for arranging a plurality of video playback slots corresponding to different playback speeds in a predetermined area, and the video playback means plays the one video at a playback speed corresponding to the one video playback slot accepted by the slot designation acceptance means in the plurality of video playback slots. A seventh invention is a video playback device according to the sixth invention, wherein the playback slot arrangement means arranges the plurality of video playback slots in order from slowest to fastest playback speed, and when the one video playback slot accepted by the slot designation acceptance means is a video playback slot set to a playback speed slower than the playback speed currently being played, the video playback means rewinds the one video by a predetermined time and plays it in the plurality of video playback slots. An eighth invention is a video playback device according to the first invention, further comprising: a playback frame placement means for placing the video playback frames in a predetermined area according to the number of videos to be played; and a text conversion means for converting the audio of the videos into text, wherein the video playback means plays each video in each video playback frame placed by the playback frame placement means, and comprises a video text output means for outputting video text, including the text converted by the text conversion means and corresponding to the audio before and after each video being played in each video playback frame, in a position adjacent to each video playback frame. A ninth invention is a video playback device according to the eighth invention, wherein the video text output means scrolls and outputs the video text in an area for outputting the video text, which is arranged on either side of the video playback frame, in accordance with the playback of the video. A tenth invention is a video playback device according to the ninth invention, further comprising an auxiliary operation receiving means for receiving a scroll assist operation for the video text, and the video playback means plays the video in the video playback frame corresponding to the video text at a playback speed according to the scroll assist operation received by the auxiliary operation receiving means. An eleventh invention is a video playback device according to any one of the first to tenth inventions, wherein the video playback means returns to the beginning and plays the video again when the playback position of the video in the video playback frame reaches the end. A twelfth invention is a video playback device according to the first invention, further comprising a scene setting means for setting a plurality of scenes for one video, and a playback frame arrangement means for arranging a plurality of the video playback frames in a predetermined area according to the number of scenes set by the scene setting means, wherein the video playback means plays the one video for each scene set by the scene setting means in each video playback frame arranged in the order of the scenes. A thirteenth aspect of the present invention is the video playback device according to the twelfth aspect of the present invention, wherein the playback frame arranging means arranges the plurality of video playback frames so as to surround the user. A fourteenth invention is a video playback device according to the twelfth or thirteenth invention, comprising: a text conversion means for converting the audio of each scene of the video into text; and a video text output means for outputting video text, including the text converted by the text conversion means and corresponding to the audio before and after the video being played in each video playback frame, in a position adjacent to each video playback frame. A fifteenth invention is a video playback device according to any one of the twelfth to fourteenth inventions, wherein the video playback means returns to the beginning of each scene and plays it again when the playback position of one video in the video playback frame reaches the end of each scene. A 16th invention is a video playback device in any of the first to fifteenth inventions, wherein the audio output means outputs to the audio output unit the volume of the audio of the video played in the other video playback slots other than the one video playback slot accepted by the slot designation accepting means at a volume lower than the volume of the audio of the video played in the one video playback slot. A 17th invention is a video playback device, which is any of the first to sixteenth inventions, and which is provided with a playback slot change means for making the size of one of the video playback slots accepted by the slot designation accepting means larger than the size of the other video playback slots. An 18th invention is a video playback device that is any of the first to seventeenth inventions, and is further provided with a gaze detection means for detecting a user's gaze position, and the frame designation receiving means receives the video playback frame located at the gaze position detected by the gaze detection means as the one video playback frame. A 19th invention is a video playback device in any one of the first to seventeenth inventions, wherein the slot designation receiving means receives designation of the one video playback slot via an input unit. A twentieth invention is a wearing device to be worn on a user's head, comprising: a display unit; a photographing unit that photographs a front area of the screen of the display unit that is opposite the user's eyes with respect to the screen of the display unit; a scene setting means that sets multiple scenes for one video; a playback frame arrangement means that arranges multiple video playback frames corresponding to the number of scenes set by the scene setting means so as to surround the user; a video playback means that plays the one video of each scene set by the scene setting means in each video playback frame arranged by the playback frame arrangement means in the order of the scenes; a direction determination means that determines the direction of the user from an image captured by the photographing unit; a video display means that outputs each video playback frame located around the direction of the user determined by the direction determination means to the display unit; a frame designation receiving means that accepts the video playback frame in the direction determined by the direction determination means as one of the video playback frames; and an audio output means that outputs to an audio output unit the audio of the video played in the one video playback frame accepted by the frame designation receiving means. A 21st invention is a video playback system comprising: a video playback means for arranging a plurality of video playback slots side by side and playing videos in the video playback slots; a slot designation receiving means for receiving designation of one of the plurality of video playback slots; and an audio output means for outputting the audio of the video played in the one video playback slot accepted by the slot designation receiving means to an audio output device. A twenty-second invention is a program for causing a computer to function as any one of the video playback devices according to the first to nineteenth inventions. [Effects of the Invention]
[0008] According to the present invention, it is possible to provide a video playback device, a wearable device, a video playback system, and a program that improve the efficiency with which people receive video information by improving the playback and arrangement of videos. [Brief explanation of the drawings]
[0009] [Figure 1] 1 is a functional block diagram of a video playback device according to a first embodiment. [Figure 2] 4 is a flowchart showing a video playback process of the video playback device according to the first embodiment. [Figure 3] 3A and 3B are diagrams showing display examples of the video playback device according to the first embodiment. [Figure 4] 10A and 10B are diagrams showing other display examples of the video playback device according to the first embodiment. [Figure 5] FIG. 10 is a functional block diagram of a video playback device according to a second embodiment. [Figure 6] 10 is a flowchart showing a video playback process of the video playback device according to the second embodiment. [Figure 7] FIG. 10 is a diagram showing a display example of the video playback device according to the second embodiment. [Figure 8] FIG. 10 is a functional block diagram of a video playback device according to a third embodiment. [Figure 9] 11 is a flowchart showing a video playback process of the video playback device according to the third embodiment. [Figure 10]11 is a flowchart showing operation processing of the video playback device according to the third embodiment. [Figure 11] FIG. 11 is a diagram showing a display example of the video playback device according to the third embodiment. [Figure 12] FIG. 10 is a functional block diagram of a video playback device according to a fourth embodiment. [Figure 13] 10 is a flowchart showing a video playback process of the video playback device according to the fourth embodiment. [Figure 14] FIG. 11 is a diagram showing an example of a virtual space generated by a video playback device according to a fourth embodiment. [Figure 15] FIG. 10 is a diagram illustrating the overall configuration of a video playback system according to a modified embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, this is merely an example, and the technical scope of the present invention is not limited to this example.
[0011] (First embodiment) <Video playback device 1> FIG. 1 is a functional block diagram of a video playback device 1 according to the first embodiment. The video playback device 1 is a device that outputs a plurality of windows (video playback frames) for viewing videos and plays videos in each window. In the video playback device 1 of this embodiment, a single video is played in each window, and the playback position in each window is different. The video playback device 1 is, for example, a mobile terminal such as a tablet, or may alternatively be a personal computer (PC) or the like.
[0012] The video playback device 1 includes a control unit 10, a storage unit 30, a touch panel display 37 (input unit, display unit), a speaker 38 (audio output unit), and a communication interface unit 39. The control unit 10 is a central processing unit (CPU) that controls the entire video playback device 1. The control unit 10 appropriately reads and executes an operating system (OS) and application programs stored in the storage unit 30, thereby cooperating with the above-mentioned hardware and executing various functions. The control unit 10 includes a presetting unit 11 (playback position determination means), a frame placement unit 12 (playback frame placement means), a video playback unit 14 (video playback means, playback information output means), an audio output unit 16 (audio output means), a frame designation receiving unit 17 (frame designation receiving means), and a designation frame processing unit 18 (playback frame change means).
[0013] The presetting unit 11 performs presetting for the video to be played. The presetting unit 11 determines multiple playback positions for a video to be played, which is one video. The presetting unit 11 may set the playback positions to be at equal time intervals, for example, every 10 seconds from the beginning of the video to be played. For example, if a 100-minute video to be played is displayed in 100 windows, the presetting unit 11 sets the playback positions to be every minute. Furthermore, the playback positions do not have to be uniform, such as at equal time intervals, and may be aligned with scene change positions or background music change positions.
[0014] The frame placement unit 12 places windows for playing the video to be played on the playback screen (predetermined area) by the number of playback positions that have been set. The frame placement unit 12 may, for example, arrange the windows in a horizontal row. Alternatively, the frame placement unit 12 may, for example, arrange the windows in a grid pattern. The frame placement unit 12 may determine the size of each window and arrange it on the playback screen according to the area of the touch panel display 37 and the number of playback positions that have been set by the presetting unit 11.
[0015] The video playback unit 14 performs processing to play back the video to be played in each window arranged in the frame arrangement unit 12. For example, the video playback unit 14 plays the video to be played in each window arranged in the order of the playback positions, starting from each playback position determined by the preset unit 11. Alternatively, the video playback unit 14 may play the video to be played in each window arranged in the order of the playback positions, starting from the playback position determined by the preset unit 11, in a spiral fashion starting from the window located in the center of the playback screen. Furthermore, the video playback unit 14 may output information about the playback position of the video being played in each window near the window. The information about the playback position may be, for example, elapsed time or remaining time.
[0016] Furthermore, the video playback unit 14 may play the video to be played in windows other than the designated window, which will be described later, at a slower playback speed than the playback speed of the video to be played in the designated window. Furthermore, when the playback position of the video to be played in the window reaches the end, the video playback unit 14 may perform loop playback by returning to the beginning of the video to be played and playing it again, or may end the playback. When performing loop playback, an interval may be provided before playback starts from the beginning, and during that interval, nothing may be displayed in the window (for example, a black screen, etc.).
[0017] Audio output unit 16 outputs the audio of the video to be played in each window to speaker 38, thereby outputting the audio from speaker 38. Audio output unit 16 may not output audio when the video to be played in each of multiple windows is first displayed on the playback screen, and when a window is specified by frame designation receiving unit 17, output only the audio of the video to be played in that window. Alternatively, audio output unit 16 may output the audio of the video to be played in all windows when the video to be played in each of multiple windows is first displayed on the playback screen, and when a window is specified by frame designation receiving unit 17, increase the volume of the video to be played in that window and decrease the volume of the video to be played in other windows.
[0018] The frame designation receiving unit 17 receives a user's designation of one window (one video playback frame) from among multiple windows displayed on the playback screen. For example, the frame designation receiving unit 17 may receive the designation when the user touches one of the multiple windows displayed on the playback screen. Alternatively, the frame designation receiving unit 17 may receive a user designation of one of the multiple windows displayed on the playback screen that is in the user's line of sight. Here, the designation of a window using the user's line of sight can be realized, for example, by using a line of sight detection device (line of sight detection means) that detects the user's line of sight. The line of sight detection device detects the direction in which the user is looking by, for example, a corneal reflex method or a method of capturing the position of the user's pupil relative to the white of the eye.
[0019] Designation frame processing unit 18 changes the state of the designated window accepted by frame designation accepting unit 17. Designation frame processing unit 18, for example, increases the size of the window designated by frame designation accepting unit 17. Designation frame processing unit 18 may also decrease the size of windows other than the window designated by frame designation accepting unit 17, for example.
[0020] The storage unit 30 is a storage area such as a hard disk or semiconductor memory element for storing programs, data, etc. required for the control unit 10 to execute various processes. The storage unit 30 includes a program storage unit 31 and a video storage unit 33 . The program storage unit 31 is a storage area that stores various programs. The program storage unit 31 stores, for example, a video processing program 32. The video processing program 32 is a program for performing various functions executed by the control unit 10 of the video playback device 1. Although the program for performing the various functions executed by the control unit 10 of the video playback device 1 is described here as one program, for example, each function may be a separate program. The video storage unit 33 is a storage area for storing various videos, including the video to be played in each window. The videos may be used for information sharing or education, for example, and may be videos recorded from meetings or seminars, training content, video manuals, educational content, etc.
[0021] The touch panel display 37 functions as a display unit configured with a liquid crystal panel or the like, and also functions as an input unit that detects touch input by the user's finger or the like. The speaker 38 has a function of outputting sound. The speaker 38 may be built into the video playback device 1 or may be attached externally to the video playback device 1. The communication interface unit 39 is an interface for performing data communication with, for example, an external server (not shown) for downloading various moving images via a communication network (not shown). Here, a computer refers to an information processing device that includes a control unit, a storage device, etc., and the video playback device 1 is an information processing device that includes a control unit 10, a storage unit 30, etc., and is included in the concept of a computer.
[0022] <Processing Description> Next, the processing of the video playback device 1 will be described. FIG. 2 is a flowchart showing the video playback process of the video playback device 1 according to the first embodiment. 3 and 4 are diagrams showing display examples of the video playback device 1 according to the first embodiment.
[0023] First, the user selects a video to be played from a list of videos (not shown). In this way, in step S (hereinafter, "step S" will be simply referred to as "S") 11 of FIG. 2, the control unit 10 (presetting unit 11) sets the selected video as the video to be played and determines multiple playback positions for the video to be played. The presetting unit 11 may determine the number of playback positions according to, for example, the area of the touch panel display 37 or the content of the video to be played. The presetting unit 11 may also determine the number of playback positions according to the playback time (length) of the video to be played. In S12, the control unit 10 (frame arrangement unit 12) arranges windows corresponding to the determined number of playback positions on the playback screen in a predetermined manner. For example, when the determined number of playback positions is small, the control unit 10 may arrange the windows side by side on the playback screen, and when the determined number of playback positions is large, the control unit 10 may arrange the windows in a grid pattern on the playback screen.
[0024] In S13, the control unit 10 (video playback unit 14) performs video playback processing. More specifically, the control unit 10 plays the video to be played, for example, starting from the playback position determined in the processing of S11, in each window arranged in the order of playback position on the playback screen. At this time, the control unit 10 (audio output unit 16) may or may not output the audio of the video to be played at the playback position corresponding to each window. Whether or not to output the audio may be specified by the user, for example. Furthermore, the control unit 10 (video playback unit 14) outputs information regarding the playback position of the video to be played in each window near each window.
[0025] FIG. 3 shows an example of a playback screen 40 in which one-minute video to be played is arranged in six windows. The playback screen 40 includes a window area 41 and a playback position area 42 . The window area 41 has six windows, each of which displays a different playback position of the video to be played. The playback position area 42 indicates the elapsed time from the playback start position of the video to be played, which indicates the playback position of each window. 3 is output to touch panel display 37, and after one second has passed, the video being played in each window in window area 41 will be the one played one second later. Also, the times shown in playback position area 42 will each have one second added to them.
[0026] FIG. 4 shows an example of a playback screen 50 in which moving images to be played are arranged in a plurality of windows formed in a grid pattern. The playback screen 50 includes a window area 51 . Window area 51 has a total of 25 windows, 5 vertically and 5 horizontally, and each window displays a different playback position of the video to be played. Window area 51 has window 51a at the center as the initial playback position (i.e., 0 seconds), and the playback positions move backward in the direction indicated by arrows 53. Arrows 53 point outward from the center in a spiral pattern. By playing the video to be played in this arrangement, the user can check the video before and after by looking left and right, and can skip to a certain extent by looking up and down, making it possible to watch videos of various lengths, just like skipping when reading a book.
[0027] 2, control unit 10 (frame designation receiving unit 17) receives a designation of one window. The user may designate the window by operating touch panel display 37, or the designation may be detected from the direction of the user's line of sight. In S15, control unit 10 performs processing on the designated window. Specifically, control unit 10 (designation frame processing unit 18) changes the size of the designated window to be larger than the sizes of other windows, for example. Furthermore, the control unit 10 (audio output unit 16) increases the volume of the video being played in the specified window. Note that the control unit 10 (audio output unit 16) may also decrease the volume of the video being played in windows other than the specified window, or may even mute the volume. Furthermore, the control unit 10 (video playback unit 14) may play the video to be played in windows other than the designated window at a slower playback speed than the playback speed of the video to be played in the designated window.
[0028] In S16, the control unit 10 determines whether or not another window has been specified. When the control unit 10 (frame designation receiving unit 17) receives a user's designation of another window, it determines that another window has been designated. When another window has been designated (S16: YES), the control unit 10 shifts the process to S15 and performs the process shown in S15 on the designated other window. On the other hand, when another window has not been designated (S16: NO), the control unit 10 shifts the process to S17.
[0029] In S17, the control unit 10 determines whether or not to end the process. For example, if the playback screen is closed, the control unit 10 determines to end the process. Also, if loop playback is not set and playback has finished in all windows, the control unit 10 determines to end the process. If the process is to be ended (S17: YES), the control unit 10 ends this process. On the other hand, if the process is not to be ended (S17: NO), the control unit 10 moves the process to S16. Note that the closer the initial playback position of a video to be played is to the end, the sooner the playback position will reach the end. When the playback position of a video to be played in a window reaches the end, the control unit 10 (video playback unit 14) may perform loop playback by returning to the beginning of the video to be played and playing it again.
[0030] In this way, the control unit 10 displays a playback screen on the touch panel display 37, in which multiple windows are arranged so that a single video, i.e., a target video, can be played from multiple playback positions. As a result, the target video is played in each window with a time difference. Therefore, by moving the user's gaze from one window to the adjacent window, the user can view the target video, for example, Δt seconds before or after the time.
[0031] With existing technology, it was possible to skip to a frame a specified time before or after by pressing a skip (fast forward or rewind) button, but there was a problem in that pressing the skip button meant that the content of that frame was not clear until playback of that frame began. Also, with another existing technology, it was possible to immediately play a chapter you wanted to view by selecting it from a chapter list (equivalent to a table of contents in a document), but when selecting a chapter, it was difficult to determine which chapter to view. The video playback device 1 of this embodiment can solve the above problems and difficulties. That is, it is possible to grasp at a glance the video to be played at various playback positions and check the content of the video.
[0032] As described above, the video playback device 1 of this embodiment has the following advantages. (1) A plurality of playback positions for the video to be played are determined, and windows corresponding to the number of determined playback positions are arranged on the playback screen. The video to be played at the determined playback positions is played in each window arranged in the order of the playback positions. A designation of one of the plurality of windows is accepted, and the audio of the video to be played in the accepted designated window is output to speaker 38. Therefore, the user can view a plurality of windows with different playback start positions, and video playback can be realized to improve the efficiency with which people receive video information.
[0033] (2) Information about the playback position of the video being played in the window is now output near each window. Therefore, the user can view the currently played video to be played along with the playback position relationship of the currently played video to be played. (3) The playback speed of the video to be played in windows other than the specified window is now slower than the playback speed of the video to be played in the specified window. Therefore, the user can concentrate more on watching the video to be played back in the window designated by the user.
[0034] (4) When the playback position of the video being played in the window reaches the end, it returns to the beginning and plays the video again. Therefore, the user can repeatedly watch the video to be played.
[0035] (5) The size of the specified window is made larger than the size of other windows. Therefore, the display of the window specified by the user becomes larger, and the video being played back in that window can be easily viewed.
[0036] (6) The user's gaze position is detected, and the window at the detected gaze position is accepted as the specified window. This is convenient because the user can easily view the playback in the window in front of their eyes simply by directing their gaze.
[0037] (Second embodiment) In the second embodiment, a description will be given of a display of multiple windows with different playback speeds. In the following description, parts that perform the same functions as those in the first embodiment will be given the same reference numerals or will have the same reference numerals at the end, and duplicate descriptions will be omitted as appropriate.
[0038] <Video playback device 201> FIG. 5 is a functional block diagram of a video playback device 201 according to the second embodiment. In video playback device 201 of this embodiment, each window plays a single video. A different playback speed is set for each window. Video playback device 201 then plays the video in each window at the playback speed set for the window specified by the user.
[0039] The video playback device 201 includes a control unit 210, a storage unit 230, a touch panel display 37, a speaker 38, and a communication interface unit 39. The control unit 210 includes a frame placement unit 212 (playback frame placement means), a video playback unit 214 (video playback means), an audio output unit 16, a frame designation receiving unit 17, and a designation frame processing unit . The frame placement unit 212 places a plurality of windows corresponding to different playback speeds on the playback screen (predetermined area). The frame placement unit 212 arranges the plurality of windows on the playback screen, for example, in order from slow to fast playback speed.
[0040] The video playback unit 214 performs processing to play back the video to be played in each window arranged in the frame arrangement unit 212. The video playback unit 214 also plays the video to be played in multiple windows at a playback speed corresponding to the window specified by the user. Furthermore, if the specified window is a window with a playback speed set slower than the playback speed currently being played, the video playback unit 214 rewinds the video to be played by a predetermined amount and plays it in multiple windows.
[0041] The storage unit 230 includes a program storage unit 231 and a moving image storage unit 33 . The program storage unit 231 stores, for example, a video processing program 232 which is a program for carrying out various functions executed by the control unit 210 of the video playback device 201 .
[0042] <Processing Description> Next, the processing of the video playback device 201 will be described. FIG. 6 is a flowchart showing the video playback process of the video playback device 201 according to the second embodiment. FIG. 7 is a diagram showing a display example of the video playback device 201 according to the second embodiment. First, the user selects a video to be played from a video list (not shown). In response to this, in S211 of Fig. 6, the control unit 210 (frame placement unit 212) places multiple windows corresponding to different playback speeds on the playback screen.
[0043] In S212, control unit 210 (video playback unit 214) performs video playback processing. More specifically, control unit 210 (video playback unit 214) plays the video to be played in each window on the playback screen. At this time, control unit 210 (video playback unit 214) plays the video to be played in all windows uniformly, for example, at a normal playback speed (normal speed). Furthermore, control unit 210 (audio output unit 16) outputs the audio of the video to be played at the playback position corresponding to each window.
[0044] FIG. 7(A) is an example of a playback screen 60 in which the moving images to be played are arranged in windows that are played at different playback speeds. The playback screen 60 includes a window area 61 and a speed information area 62 . In this example, the window area 61 has five windows, each displaying a video to be played. At this time, the video to be played is played at the same speed in all five windows, so that the video to be played at the same position in each window is played. The speed information area 62 indicates the playback speed corresponding to each window.
[0045] 6, the control unit 210 (frame designation receiving unit 17) receives the designation of one window. For example, the control unit 210 detects the user's line of sight, thereby receiving the designation of one window that is in the line of sight. In S214, control unit 210 (video playback unit 214) determines whether the playback speed of the specified window is slower than the playback speed of the currently playing video. Control unit 210 can make this determination by comparing the playback speed of the currently playing video to be played with the playback speed corresponding to the specified window. If the playback speed of the specified window is slow (S214: YES), control unit 210 transfers the process to S215. On the other hand, if the playback speed of the specified window is not slow (S214: NO), control unit 210 transfers the process to S216.
[0046] In S215, the control unit 210 (video playback unit 214) rewinds the currently playing video to be played by a predetermined amount. This occurs when the user wants to play the currently playing video to be played back more slowly, and means that the portion that the user wants to "view slowly" has already been viewed at normal speed. Therefore, the control unit 210 rewinds the video by a predetermined amount, such as 2 seconds, and plays it back, allowing the user to view that portion slowly. In S216, control unit 210 (video playback unit 214) changes the playback speed of all windows to the playback speed corresponding to the specified window, and plays back the video to be played.
[0047] FIG. 7B is a diagram showing a state in which the line of sight 63 of the eyes Pe of the user P is on the window 61b. In this case, the video playback unit 214 plays the video to be played in all five windows at 0.75x speed corresponding to window 61b. Also, since the playback speed is slower than the normal speed before detecting the line of sight 63, the video playback unit 214 rewinds the video to be played by a predetermined amount before playing it back.
[0048] In S217, control unit 210 determines whether or not another window has been specified. When control unit 210 (frame designation receiving unit 17) receives a user's designation of another window, it determines that another window has been designated. When another window has been designated (S217: YES), control unit 210 transfers the process to S214. On the other hand, when another window has not been designated (S217: NO), control unit 210 transfers the process to S218. In S218, the control unit 210 determines whether playback of the video to be played has ended. For example, if loop playback is not performed, the control unit 210 determines that playback of the video to be played has ended when the end of the video to be played is reached. If playback of the video to be played has ended (S218: YES), the control unit 210 ends this process. On the other hand, if playback of the video to be played has not ended (S218: NO), the control unit 210 proceeds to S217.
[0049] In this way, control unit 210 displays a playback screen on touch panel display 37 in which multiple windows are arranged so that a single video to be played back is played back at a playback speed corresponding to the window. This allows the user to watch the video to be played back at a faster or slower speed by moving their line of sight to a window adjacent to a certain window.
[0050] With existing technology, it was possible to preview content at a specific playback speed by pressing a playback speed change button or selecting from a settings menu. There was also technology that allowed viewing at a specific speed (for example, double speed playback) only while pressing the screen. However, these technologies made it difficult to flexibly control the speed, and problems remained, such as missed content or having to wait. As in this embodiment, windows that are played at different speeds are provided, and when the gaze is directed at the window, the video is played at the speed set in that window, thereby improving the convenience of video playback for users and enabling video playback that improves the efficiency of video information reception.
[0051] As described above, the video playback device 201 of this embodiment has the following advantages. (1) Multiple windows corresponding to different playback speeds are placed on the playback screen, and the video to be played at the playback speed corresponding to the accepted window is played in multiple windows. This allows the playback speed of all windows to be unified at the playback speed specified by the user, and the video to be played can be played at the same speed. This control prevents the playback position in windows that are not being viewed from shifting, and prevents users from missing content when the playback speed is changed.
[0052] (2) The multiple windows are arranged in order from slow to fast playback speed, and if the received window has a playback speed set to be slower than the playback speed currently being played, the video to be played is rewound a predetermined amount of time and played in the multiple windows. Therefore, the user can change the playback speed smoothly by simply specifying the window next to the window they are currently viewing. Also, if a window with a slower playback speed is specified, the video to be played can be rewound a predetermined amount of time, allowing the user to watch the missed portion again at a slower speed.
[0053] (Third embodiment) In the third embodiment, a description will be given of a display of a plurality of windows each playing a different video. <Video playback device 301> FIG. 8 is a functional block diagram of a video playback device 301 according to this embodiment. In the video playback device 301 of this embodiment, the videos played in the windows are different from each other. The video playback device 301 converts the audio of the video played in each window into text and displays the text along with the video playback.
[0054] The video playback device 301 includes a control unit 310 , a storage unit 330 , a touch panel display 37 , a speaker 38 , and a communication interface unit 39 . The control unit 310 includes a frame placement unit 312 (playback frame placement means), a text conversion unit 313 (text conversion means), a video playback unit 314 (video playback means), a text output unit 315 (video text output means), an audio output unit 16, a frame designation receiving unit 17, a designation frame processing unit 18, and an auxiliary operation receiving unit 319 (auxiliary operation receiving means).
[0055] The frame placement unit 312 places windows on the playback screen (predetermined area) according to the number of multiple moving images to be played back. For example, the frame placement unit 312 places multiple windows side by side on the playback screen. The text conversion unit 313 converts the audio of multiple videos being played into text. The text conversion unit 313 converts the audio of the videos into text using known technology. In this case, the text conversion unit 313 may convert the audio directly into text, or may detect and delete filler sounds such as "ah" and "eh" that frequently occur in recorded video of a conference, for example. The text conversion unit 313 may also generate a summary from the converted text.
[0056] Video playback unit 314 plays each video in each window arranged by frame arrangement unit 312. Video playback unit 314 may also play the video in the window corresponding to the video text at a playback speed according to a scroll assist operation received by assist operation reception unit 319, which will be described later. Furthermore, when the playback position of the video being played in the window reaches the end, video playback unit 314 may return to the beginning and play it again. Text output unit 315 outputs, to a position near each window, video text including text corresponding to the audio before and after each video being played in each window converted by text conversion unit 313. More specifically, text output unit 315 scrolls and outputs video text in accordance with the playback of the video in areas for outputting video text arranged on either side of the window.
[0057] The assist operation receiving unit 319 receives a scrolling assist operation for the video text. The assist operation receiving unit 319 receives, as the scrolling assist operation, an operation to speed up the scrolling of the video text or an operation to slow down the scrolling, for example. The storage unit 330 includes a program storage unit 331 and a video storage unit 33 . The program storage unit 331 stores, for example, a video processing program 332 which is a program for carrying out various functions executed by the control unit 310 of the video playback device 301 .
[0058] <Processing Description> Next, the processing of the video playback device 301 will be described. FIG. 9 is a flowchart showing the video playback process of the video playback device 301 according to the third embodiment. FIG. 10 is a flowchart showing the operation process of the video playback device 301 according to the third embodiment. FIG. 11 is a diagram showing a display example of the video playback device 301 according to the third embodiment.
[0059] First, the user selects multiple videos to play from a video list (not shown). As a result, in S311 of Fig. 9, the control unit 310 (frame placement unit 312) places windows on the playback screen equal to the number of videos to be played. In S312, the control unit 310 (text conversion unit 313) converts the audio of each video to be played into text. Note that here, the audio of the video is converted into text before the video playback process, but the control unit 310 (text conversion unit 313) may convert the audio of the video into text in advance and store the text in the video storage unit 33 in association with the video.
[0060] In S313, control unit 310 (video playback unit 314) performs video playback processing. More specifically, control unit 310 (video playback unit 314) plays each video in each window on the playback screen. Control unit 310 (audio output unit 16) may or may not output the audio of each video corresponding to each window. In S314, the control unit 310 (text output unit 315) performs a text output process to output the text before and after the video being played, with a window in between.
[0061] Here, an example of the playback screen will be described. FIG. 11 is an example of a playback screen 70 in which each video is arranged in a separate window. The playback screen 70 includes a window area 71 and text areas 72 and 73 . In this example, the window area 71 has six windows, each displaying a different video. Text areas 72 and 73 are areas that display the text of the video being played. In this example, text area 72 is an area that outputs text before playback, and text area 73 is an area that outputs text after playback. Therefore, while the video is being played, the text corresponding to the video is scrolled from the bottom to the top of the screen. Each of video area 75a to video area 75f indicated by a column has a window for playing a video and text showing the content of the video.
[0062] In S315 of FIG. 9, the control unit 310 performs operation processing. Here, the operation process will be described with reference to FIG. 10, control unit 310 determines whether or not a single window has been designated. Control unit 310 (frame designation receiving unit 17) determines that a single window has been designated when it receives a user's designation of a single window. If a single window has been designated (S331: YES), control unit 310 shifts the process to S332. On the other hand, if a single window has not been designated (S331: NO), control unit 310 shifts the process to S333.
[0063] In S332, control unit 310 performs processing on the designated window. Specifically, control unit 310 (designation frame processing unit 18) changes the size of the designated window to be larger than the sizes of other windows, for example. Control unit 310 (audio output unit 16) also increases the volume of the audio of the video to be played back in the designated window. Control unit 310 (audio output unit 16) may also reduce the volume of the audio of the video to be played back in windows other than the designated window, or may even mute the audio.
[0064] In S333, the control unit 310 (assist operation receiving unit 319) determines whether or not a scrolling assist operation for the video text has been received. For example, when the user performs an operation to move the scrolling video text in the scrolling direction or an operation to move the scrolling video text in the opposite direction to the scrolling direction, the control unit 310 determines that the user has received a scrolling assist operation. If a scrolling assist operation for the video text has been received (S333: YES), the control unit 310 proceeds to S334. On the other hand, if a scrolling assist operation for the video text has not been received (S333: NO), the control unit 310 ends this process and proceeds to S316 in FIG. 9. In S334, control unit 310 (video playback unit 314) plays the video in the window corresponding to the video text at a playback speed according to the scroll assist operation accepted in S333. Thereafter, control unit 310 proceeds to S316 in FIG. 9.
[0065] 9, control unit 310 determines whether or not to end the process. For example, if the playback screen is closed, control unit 310 determines to end the process. Also, if loop playback is set to not be performed, control unit 310 determines to end the process when playback has finished in all windows. If the process is to be ended (S316: YES), control unit 310 ends this process. On the other hand, if the process is not to be ended (S316: NO), control unit 310 proceeds to S315. When the playback position of the video being played in each window reaches the end of each, control unit 310 (video playback unit 314) may loop playback by returning to the beginning of each video and playing it again.
[0066] In this way, control unit 310 causes touch panel display 37 to display a playback screen in which multiple windows corresponding to multiple videos are arranged. Furthermore, the playback screen also displays text around the windows that accompanies the video being played in the windows. This allows the user to watch multiple videos simultaneously.
[0067] With existing technology, simply playing multiple videos simultaneously would result in multiple sounds being mixed together, making it difficult to hear. It was also impossible to check the content of videos that the viewer was not looking at. In this embodiment, multiple windows are provided in which different videos can be played, and the audio of each video is displayed in text form around the video, allowing the user to check the content of the video that was not being viewed. Furthermore, by outputting the audio of the video being played in a window specified by the user, multiple videos can be viewed simultaneously, and the audio can be easily heard.
[0068] As described above, the video playback device 301 of this embodiment has the following advantages. (1) Windows corresponding to the number of videos to be played are arranged on the playback screen, the audio of the multiple videos is converted into text, each video is played in each arranged window, and video text corresponding to the audio before and after each video being played in each window is output in a position near each window. Therefore, by playing multiple videos simultaneously, users can watch multiple videos. Since the audio of the videos is converted into text and output as video text, the content of the multiple videos being played can be easily understood.
[0069] (2) In the area where the video text is output, which is placed on either side of a window, the video text scrolls as the video plays. This allows the video text to scroll as the video plays, making it easy to see where the video is currently playing. Also, by outputting the video text before and after playback in a separate window, the current video playback location can be made even easier to see.
[0070] (3) Scroll assist operations for video text are accepted, and the video is played in the window corresponding to the video text at a playback speed according to the accepted scroll assist operations. Therefore, it is convenient to be able to change the playback speed of the video you are watching by scrolling the text.
[0071] (Fourth embodiment) In the fourth embodiment, a description will be given of a display of a plurality of windows that are played back for each scene. <Video playback device 401> FIG. 12 is a functional block diagram of a video playback device 401 according to the fourth embodiment. In video playback device 401 of this embodiment, a window plays one video. Video playback device 401 plays each scene of the video played in each window. In this embodiment, the video playback device 401 will be described as, for example, a head mounted display (HMD) that the user wears on his / her head.
[0072] The video playback device 401 includes a control unit 410, a storage unit 430, a camera 436 (photographing unit), a display 437 (display unit), a speaker 38, and a communication interface unit 39. The control unit 410 includes a pre-setting unit 411 (scene setting means), a frame placement unit 412 (playback frame placement means), a text conversion unit 313, a video playback unit 414 (video playback means), a text output unit 315, an audio output unit 16, a frame designation receiving unit 417 (frame designation receiving means), a designation frame processing unit 18, and a direction determination processing unit 420 (direction determination means, video display means).
[0073] The preset unit 411 performs preset settings for the video to be played. The preset unit 411 sets multiple scenes for a video to be played, which is one video. The preset unit 411 may automatically set multiple scenes based on the configuration of the video to be played. More specifically, the preset unit 411 may set one scene at the timing of an image change or an audio interruption within a video having a predetermined length, for example. The frame placement unit 412 places a plurality of windows in a virtual space (predetermined area) according to the number of scenes set by the presetting unit 411. The frame placement unit 412 generates a virtual space in which a plurality of windows are arranged side by side so as to surround the user, for example.
[0074] The video playback unit 414 plays back the video to be played back for each scene in a window arranged in the order of the scenes. Furthermore, when the playback position of the video to be played in the window reaches the end of the scene, the video playback unit 414 performs loop playback by returning to the beginning of the scene of the video to be played and playing it again. In this case, an interval may be provided between the beginning of the scene and playback, and during that interval, nothing may be displayed in the window (for example, a black screen) or the window may be paused.
[0075] The frame designation receiving unit 417 receives a window located in the direction determined by the direction determination processing unit 420 as the designated window. The direction determination processing unit 420 determines the direction in which the user is facing based on the image captured by the camera 436. The direction determination processing unit 420 also outputs to the display 437 the determined direction in which the user is facing and each window located around the direction.
[0076] The storage unit 430 includes a program storage unit 431 and a moving image storage unit 33. The program storage unit 431 stores, for example, a video processing program 432 which is a program for carrying out various functions executed by the control unit 410 of the video playback device 401 . Camera 436 is a camera that captures images of real space. Camera 436 is provided on the outer surface opposite to the surface facing the head of a user wearing video playback device 401 on their head, for example, near positions corresponding to the left and right eyes of the user wearing video playback device 401. Display 437 is a display device such as an LCD (Liquid Crystal Display), an organic EL display, etc. Display 437 is provided on the inner surface that faces the head of a user wearing video playback device 401.
[0077] <Processing Description> Next, the processing of the video playback device 401 will be described. FIG. 13 is a flowchart showing the video playback process of the video playback device 401 according to the fourth embodiment. FIG. 14 is a diagram showing an example of a virtual space 480 generated by a video playback device 401 according to the fourth embodiment.
[0078] First, the user selects a video to be played from a video list (not shown). By doing so, in S411 of Fig. 13, the control unit 410 (presetting unit 11) sets multiple scenes for the video to be played. Note that if multiple scenes have been set in advance for the video to be played, this process is not necessary. In S412, control unit 410 (frame arrangement unit 412) arranges windows of the number of scenes set so as to surround the user, thereby generating a virtual space.
[0079] In S413, control unit 410 (video playback unit 414) performs video playback processing. More specifically, control unit 410 (video playback unit 314) plays back the images to be played back for each scene in the order of the scenes in each window set in the processing of S412. As a result, for example, the last scene and the second scene are played back in the windows on the left and right of the window playing back the first scene. Control unit 410 (audio output unit 16) may or may not output the audio of each video corresponding to each window.
[0080] In S414, control unit 410 (text output unit 315) performs text output processing to output text before and after the video being played, with a window in between. In S415, the control unit 410 (direction determination processing unit 420) determines the direction of the user from the captured image from the camera 436. In S416, the control unit 410 (direction determination processing unit 420) outputs each window located around the determined direction of the user to the display 437, and thereby video of each scene played in the determined direction of the user is output to the display 437.
[0081] Here, the virtual space to be generated and its display to the user will be described. FIG. 14 shows an example of a virtual space 480 . The virtual space 480 is a space in which a plurality of video areas 481 are arranged so as to surround the user P. The video area 481 has a window for playing each scene of the video to be played, and also has an area for displaying text before and after the scene played in the window. For example, the user P can view the next scene by turning to the right, and the previous scene by turning to the left. It should be noted that display 437 displays not only one video area 481 in front of user P, but also multiple video areas 481 including video areas 481 on the left and right of user P.
[0082] In S417 of FIG. 13, control unit 410 (frame designation receiving unit 417) accepts the window having the direction determined by the processing of S415 as the window to be designated. Then, control unit 410 performs processing on that window. Specifically, control unit 410 (designation frame processing unit 18) changes the size of the designated window to be larger than the sizes of other windows, for example. Also, control unit 410 (audio output unit 16) increases the volume of the audio of the video to be played in the designated window. Note that control unit 410 (audio output unit 16) may reduce the volume of the audio of the video to be played in windows other than the designated window, or may mute the audio.
[0083] In S418, control unit 410 determines whether or not to end the process. For example, if camera 436 is switched off, control unit 410 determines to end the process. If the process is to be ended (S418: YES), control unit 410 ends this process. On the other hand, if the process is not to be ended (S418: NO), control unit 410 moves the process to S415. When the video of each scene played in each window reaches its end, control unit 410 (video playback unit 414) loops the video back to the beginning of the scene and plays it again.
[0084] In this way, the control unit 410 arranges windows for viewing videos so as to surround the user, and assigns each scene in a video to be played back. This allows the user to skip or go back to a scene by facing in different directions and moving their line of sight to the window.
[0085] This system is primarily effective for efficiently viewing recorded conference videos. Unlike content such as movies, recorded conference videos do not have clear chapters or divisions. Therefore, it is not easy to skip, and even if there are parts that the user does not want to watch, it is impossible to determine this until the end of the viewing, and the user is required to watch the entire video. As in this embodiment, windows for viewing videos are arranged to surround the user, and scenes in the video to be played are assigned and played simultaneously, making it easy to skip scenes, etc.
[0086] As described above, the video playback device 401 of this embodiment has the following advantages. (1) Multiple scenes are set for the video to be played, and multiple windows corresponding to the number of set scenes are placed in the virtual space, and the video to be played for each scene is played in each window arranged in the order of the scenes. Therefore, the user can simultaneously watch each scene of the video.
[0087] (2) Multiple windows are arranged to surround the user. Therefore, by rotating the screen, the user can simultaneously view each scene of the video.
[0088] (3) The audio of each video scene is converted into text, and video text corresponding to the audio before and after the video being played in each converted window is output in a position near each window. Therefore, since the audio of each scene of the video to be played is converted into text and output as video text, the content of the multiple scenes being played can be made easy to understand.
[0089] (4) When the playback position of the video being played in each video playback frame reaches the end of each scene, it returns to the beginning of each scene and starts playing again. Therefore, the user can view each scene of the looped video to be played.
[0090] (5) The direction of the user is determined from the image captured by the camera 436, and the windows located around the determined direction of the user are output to the display 437. Therefore, the user can view the window facing the user and the scene of the video to be played back in that window.
[0091] (6) The direction of the user is determined from the image captured by camera 436, and the window located in the determined direction of the user is accepted as the window specified by the user. The audio of the scene of the video to be played back in the accepted window is output to speaker 38. Therefore, the user can hear the audio of the scene being played in the window directly in front of the user.
[0092] Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments. Furthermore, the effects described in the embodiments are merely a list of the most preferable effects resulting from the present invention, and the effects of the present invention are not limited to those described in the embodiments. Note that the above-described embodiments and the modified embodiments described below can be used in appropriate combinations, but detailed description thereof will be omitted.
[0093] (Variations) (1) In each embodiment, the window designation has been described using examples of a method for detecting a user's line of sight and a method for detecting a user's touch operation on a touch panel display. The window designation may be performed using either method. Furthermore, the method for detecting a user's line of sight described above is merely an example, and the present invention is not limited to this method.
[0094] (2) In each embodiment, the output sound and volume are described, but the present invention is not limited to this. It is sufficient that the sound of the window designated by the user can be heard by the user. Furthermore, as for the size of the window, other methods may be used as long as the window designated by the user is easier to see, and there is no need to change the size at all.
[0095] (3) In the first to third embodiments, the video playback device is a standalone computer, but the present invention is not limited to this. For example, the video playback device may have a system configuration including a server and multiple clients connected to the server. FIG. 15 is a diagram showing the overall configuration of a video playback system 500 according to a modified embodiment. The video playback system 500 includes a video playback server 501 and one or more user terminals 504 (audio output devices). The user terminals 504 are used by each user and serve as input / output units in the video playback system 500. The video playback server 501 and the user terminals 504 may be configured to realize various functions executed by a control unit of the video playback device. Similarly, in the fourth embodiment, for example, a system configuration may be provided that includes a server and a mounting device connected to the server.
[0096] (4) In the first to third embodiments, multiple windows are arranged on a touch panel display, but this is not limiting. As described in the fourth embodiment, multiple windows may be arranged in a virtual space. (5) In the fourth embodiment, the virtual space in which a plurality of windows are arranged may be either VR (Virtual Reality) or AR (Augmented Reality). [Explanation of symbols]
[0097] 1, 200, 300, 400 Video playback device 10, 210, 310, 410 Control unit 11, 411 Presetting section 12, 212, 312, 412 frame arrangement section 14, 214, 314, 414 Video playback section 16 Audio output section 17, 417 slot reservation reception desk 18 Designation Frame Processing Unit 30, 230, 330, 430 storage section 32, 232, 332, 432 Video processing program 33 Video storage unit 37 Touch panel display 38 Speaker 313 Text Conversion Unit 315 Text Output Unit 319 Auxiliary Operation Reception Unit 420 Direction determination processing unit 436 Camera 437 Display 500 Video Playback System 501 Video playback server 504 User terminal
Claims
1. a video playback means for arranging a plurality of video playback frames side by side and playing videos in the video playback frames; a slot designation receiving means for receiving designation of one of the plurality of video playback slots; an audio output unit configured to output to an audio output unit the audio of the video played in the one video playback frame accepted by the frame designation accepting unit; A video playback device comprising:
2. 2. The video playback device according to claim 1, a playback position determination means for determining a plurality of playback positions for one video; a playback frame arranging means for arranging the video playback frames in a predetermined area according to the number of playback positions determined by the playback position determining means; Equipped with The video playback device, wherein the video playback means plays the one video at the playback position determined by the playback position determination means in each video playback frame arranged in the order of the playback positions.
3. 3. The video playback device according to claim 2, the playback frame arranging means arranges the video playback frames in a grid pattern, the number of which corresponds to the number of playback positions; The video playback device, wherein the video playback means plays the one video at the playback position determined by the playback position determination means in each video playback frame arranged in order in a spiral shape around the video playback frame located at the center of the screen.
4. 3. The video playback device according to claim 2, a playback information output unit that outputs information about the playback position of the one video being played in each video playback frame near each video playback frame;
5. 3. The video playback device according to claim 2, The video playback means plays the video at a slower playback speed than the one video to be played in the one video playback slot, except for the one video playback slot accepted by the slot designation accepting means.
6. 2. The video playback device according to claim 1, a playback frame arranging means for arranging a plurality of the video playback frames corresponding to different playback speeds in a predetermined area; The video playback means plays the one video at a playback speed corresponding to the one video playback slot accepted by the slot designation accepting means in a plurality of the video playback slots.
7. 7. The video playback device according to claim 6, the playback slot arrangement means arranges the plurality of video playback slots in order from slow to fast playback speed, The video playback means, when the one video playback slot accepted by the slot designation accepting means is a video playback slot set to a playback speed slower than the playback speed currently being played, rewinds the one video by a predetermined time and plays it in multiple video playback slots.
8. 2. The video playback device according to claim 1, a playback frame arranging means for arranging the video playback frames in a predetermined area according to the number of the multiple videos to be played; a text conversion means for converting the audio of the plurality of videos into text; Equipped with the video playback means plays each video in each video playback slot arranged by the playback slot arrangement means; A video playback device comprising a video text output means for outputting video text near each video playback frame, the video text including the text converted by the text conversion means and corresponding to the audio before and after each video being played in each video playback frame.
9. 9. The video playback device according to claim 8, The video playback device, wherein the video text output means scrolls and outputs the video text in areas where the video text is output, arranged on either side of the video playback frame, in accordance with playback of the video.
10. 10. The video playback device according to claim 9, an auxiliary operation receiving means for receiving a scroll auxiliary operation for the video text; The video playback means plays the video in the video playback frame corresponding to the video text at a playback speed according to the scroll assist operation accepted by the assist operation accepting means.
11. 2. The video playback device according to claim 1, The video playback device is configured such that, when the playback position of the video in the video playback frame reaches the end, the video playback means returns to the beginning and plays the video again.
12. 2. The video playback device according to claim 1, a scene setting means for setting a plurality of scenes for one video; a playback frame arranging means for arranging a plurality of the video playback frames in a predetermined area in accordance with the number of scenes set by the scene setting means; Equipped with The video playback device, wherein the video playback means plays back the one video of each scene set by the scene setting means in each video playback frame arranged in the order of the scenes.
13. 13. The video playback device according to claim 12, The playback frame arranging means arranges the plurality of video playback frames so as to surround the user.
14. 13. The video playback device according to claim 12, a text conversion means for converting the audio of each scene into text; a video text output means for outputting video text, including the text converted by the text conversion means and corresponding to the audio before and after the video being played in each video playback frame, in a position adjacent to each video playback frame; A video playback device comprising:
15. 13. The video playback device according to claim 12, The video playback device, wherein when the playback position of the one video in the video playback frame reaches the end of each scene, the video playback means returns to the beginning of each scene and plays it again.
16. 2. The video playback device according to claim 1, A video playback device in which the audio output means outputs to the audio output unit the volume of the audio of the video played in the other video playback slots other than the one video playback slot accepted by the slot designation accepting means at a volume lower than the volume of the audio of the video played in the one video playback slot.
17. 2. The video playback device according to claim 1, The video playback device includes a playback frame changing means for making the size of the one video playback frame accepted by the frame designation accepting means larger than the sizes of the other video playback frames.
18. 2. The video playback device according to claim 1, A gaze detection means for detecting a gaze position of a user is provided, The frame designation receiving means receives the video playback frame at the gaze position detected by the gaze detection means as the one video playback frame.
19. 2. The video playback device according to claim 1, The frame designation receiving means receives designation of the one video playback frame via an input unit.
20. A wearable device worn on a user's head, A display unit; an imaging unit that captures an image of a front area of the screen of the display unit, the front area being on the opposite side of the user's eyes from the screen of the display unit; a scene setting means for setting a plurality of scenes for one video; a playback frame arranging means for arranging a plurality of video playback frames corresponding to the number of scenes set by the scene setting means so as to surround the user; a video playback means for playing back the one video of each scene set by the scene setting means in each video playback frame arranged by the playback frame arrangement means in the order of the scenes; a direction determination means for determining a direction of the user from an image captured by the image capturing unit; a video display means for outputting to the display unit each video playback frame located around the direction of the user determined by the direction determination means; a frame designation receiving means for receiving the video playback frame in the direction determined by the direction determining means as one of the video playback frames; an audio output unit configured to output to an audio output unit the audio of the video played in the one video playback frame accepted by the frame designation accepting unit; A mounting device comprising:
21. a video playback means for arranging a plurality of video playback frames side by side and playing videos in the video playback frames; a slot designation receiving means for receiving designation of one of the plurality of video playback slots; an audio output means for outputting, to an audio output device, the audio of the video played in the one video playback frame accepted by the frame designation accepting means; A video playback system comprising:
22. Computer, a video playback means for arranging a plurality of video playback frames side by side and playing videos in the video playback frames; a slot designation receiving means for receiving designation of one of the plurality of video playback slots; an audio output unit configured to output to an audio output unit the audio of the video played in the one video playback frame accepted by the frame designation accepting unit; A program to make it function as such.
Citation Information
Patent Citations
Bolt joint method
JP1989046006A