Electronic device, electronic device control method, and program

The electronic device enhances video playback operability by displaying frame images and time information synchronously with touch operations on the seek bar, addressing delays in existing systems to maintain responsiveness.

JP7580973B2Active Publication Date: 2024-11-12CANON KK
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2020141136
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-08-24
Publication Date
2024-11-12
Estimated Expiration
2040-08-24

AI Technical Summary

Technical Problem

Existing video playback systems face decreased operability due to delays in switching the video image and time display when changing playback positions using a seek bar, leading to reduced responsiveness to user operations.

Method used

An electronic device that includes detection and control mechanisms to immediately display a frame image and corresponding time information when the playback position is changed, using a touch operation on a seek bar, and calculates and displays time information based on the touch position, even if image display is delayed.

Benefits of technology

Improves operability by ensuring timely display of video frame images and time information during playback position changes, maintaining responsiveness to user operations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007580973000001
    Figure 0007580973000001
  • Figure 0007580973000002
    Figure 0007580973000002
  • Figure 0007580973000003
    Figure 0007580973000003
Patent Text Reader

Abstract

To improve the operability when changing the reproduction position of a moving image.SOLUTION: An electronic device includes detection means for detecting a touch operation on display means, and control means for controlling the display of a moving image, a display item indicating the reproduction position of the moving image, and time information corresponding to the reproduction position on the display means, changing the reproduction position of the moving image according to a touch position detected by the detection means, and controlling the display of a frame image of the moving image corresponding to the changed reproduction position and time information of the frame image on the display means. When the display of the frame image corresponding to the changed reproduction position and the time information corresponding to the frame image is delayed with the change in the reproduction position according to the touch operation, the control means performs a control such that the display of the frame image corresponding to the changed reproduction position and the time information of the frame image is performed after displaying time information calculated based on the touch position of the touch operation instead of the time information of the frame image corresponding to the changed reproduction position.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an electronic device, a control method for an electronic device, and a program. [Background technology]

[0002] In recent years, when playing back video using electronic devices such as personal computers, digital cameras, and smartphones, it has become possible for a user to operate a seek bar to start playing back the video from any position. As a related technique, the technique disclosed in Patent Document 1 has been proposed. In the technique disclosed in Patent Document 1, when an operation is performed to move a marker on a seek bar during video playback, a reduced preview of the media is displayed at a position corresponding to the position of the marker, and the time of the marker is also displayed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2013-529802 Summary of the Invention [Problem to be solved by the invention]

[0004] However, in the technology of Patent Document 1, when the playback position of a video is changed by a user operation on the seek bar, it may not be possible to immediately switch the display of the video image and the time of the image. This is because, when the playback position of a video is changed, a process is performed to display the video image and time, and the process of displaying the image and time does not keep up with the user's operation of the seek bar. In this case, the responsiveness to user operations is reduced, resulting in a problem of reduced operability when changing the playback position of the video.

[0005] An object of the present invention is to improve operability when changing the playback position of a video. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the electronic device of the present invention comprises a detection means for detecting a touch operation on a display means, and a control means for controlling the display of a video, a display item indicating the playback position of the video, and time information corresponding to the playback position on the display means, changing the playback position of the video in accordance with the touch position detected by the detection means, and controlling the display of a frame image of the video corresponding to the changed playback position and the time information of the frame image on the display means, wherein the control means controls the display of the frame image corresponding to the changed playback position and the time information of the frame image, after displaying time information calculated based on the touch position of the touch operation, rather than the time information of the frame image corresponding to the changed playback position, if the display of the frame image corresponding to the changed playback position and the time information of the frame image is delayed when the playback position is changed in accordance with a touch operation. Effect of the Invention

[0007] According to the present invention, it is possible to improve the operability when changing the playback position of a video. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a diagram illustrating an example of a hardware configuration of an electronic device. [Diagram 2] 1 is a flowchart (part 1) showing an example of a processing flow of the present embodiment. [Diagram 3] 13 is a flowchart (part 2) showing an example of the processing flow of the present embodiment. [Figure 4] 11 is a flowchart (part 3) showing an example of the processing flow of the present embodiment. [Diagram 5] 4 is a flowchart (part 4) showing an example of the processing flow of the present embodiment. [Figure 6] FIG. 13 is a diagram showing an example (part 1) of a screen displayed on a display. [Figure 7]FIG. 13 is a diagram showing a second example of a screen displayed on the display. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited to the configurations described in the embodiments.

[0010] FIG. 1 is a diagram showing an example of a hardware configuration of an electronic device 100 according to the present embodiment. The configuration of the electronic device 100 is not limited to the example shown in FIG. 1. As shown in FIG. 1, the electronic device 100 has an internal bus 150. A CPU 101, a memory 102, a non-volatile memory 103, an image processing unit 104, a display 105, an operation unit 106, a recording medium I / F 107, an external I / F 109, and a communication I / F 110 are connected to the internal bus 150. "I / F" stands for interface. Each unit connected to the internal bus 150 can exchange data with each other via the internal bus 150.

[0011] The CPU 101 loads a program stored in the non-volatile memory 103 into the memory 102, and executes the program loaded into the memory 102. The CPU 101 corresponds to a detection means and a control means. The CPU 101 executes the program to realize various controls of the embodiment. The memory 102 is, for example, a RAM. The non-volatile memory 103 is, for example, a ROM or a hard disk drive. In addition to the above programs, the non-volatile memory 103 may store image data, audio data, other data, and the like.

[0012] The image processing unit 104 performs various image processing on image data stored in the non-volatile memory 103 or the recording medium 108, a video signal acquired via the external I / F 109, image data acquired via the communication I / F 110, etc., under the control of the CPU 101. The image processing unit 104 corresponds to an image processing means. The image processing performed by the image processing unit 104 includes A / D conversion processing, D / A conversion processing, image data encoding processing, compression processing, decoding processing, enlargement / reduction processing (resizing processing), noise reduction processing, color conversion processing, etc. The image processing unit 104 may be realized by a dedicated circuit for performing a specific image processing. Moreover, the above image processing may be performed by the CPU 101 depending on the type of the image processing.

[0013] Display 105 displays images, GUI screens constituting a GUI (Graphical User Interface), and the like under the control of CPU 101. Display 105 corresponds to a display means. CPU 101 generates a display control signal according to a program being executed, and performs control to generate a video signal for display on display 105 and output the video signal to display 105. Display 105 displays video based on the output video signal. Electronic device 100 has an interface that outputs video to display 105, and display 105 may be an external monitor (such as a television) connected to electronic device 100.

[0014] The operation unit 106 is composed of a character information input device such as a keyboard, a pointing device such as a mouse or a touch panel, a button, a dial, a joystick, a touch sensor, a touch pad, etc. The operation unit 106 is an input device for receiving user operations. The operation unit 106 includes a touch panel 106a. The touch panel 106a is configured in a planar manner by being superimposed on the display 105, and is an input device that outputs coordinate information according to a touched position. The display 105 and the operation unit 106 may be an integrally configured touch panel display, or may be configured separately.

[0015] The recording medium I / F 107 is an interface for detachably connecting a recording medium 108 such as a memory card. The recording medium I / F 107 reads data from the connected recording medium 108 and writes data to the recording medium 108 under the control of the CPU 101. The external I / F 109 is an interface for inputting and outputting video signals, audio signals, etc., via a wired cable or wirelessly. The communication I / F 110 is an interface for transmitting and receiving various data such as files and commands to and from an external device via a network 111 such as the Internet.

[0016] A user can perform various operations on the touch panel 106a. The CPU 101 can detect operations and states on the touch panel 106a. Examples of operations and states on the touch panel 106a include touch down, touch on, touch move, touch up, and touch off. Touch down is an operation in which a finger or pen that has not been touching the touch panel 106a is newly touched on the touch panel 106a. Touch down is the start of touching the touch panel 106a. Touch on is a state in which the touch panel 106a is touched with a finger or pen. Touch move is an operation in which the finger or pen moves while touching the touch panel 106a. Touch up is an operation in which the finger or pen that has been touching the touch panel 106a is released. Touch off is a state in which the touch panel 106a is not being touched.

[0017] When CPU 101 detects touch-down, it detects touch-on. After detecting touch-down, CPU 101 usually continues to detect touch-on unless touch-up is detected. When CPU 101 detects touch-move, it is in a state where CPU 101 is detecting touch-on. Even if CPU 101 detects touch-on, it does not detect touch-move unless the touch position has moved. After CPU 101 detects that all fingers or pens that were touching have been touched up, it detects touch-off.

[0018] Information on the above operations and states, the position coordinates of the touch panel 106a touched by a finger or pen, etc. is notified to the CPU 101 via the internal bus. The CPU 101 detects what kind of operation (touch operation) was performed on the touch panel 106a based on the notified information. For touch-move, the CPU 101 can determine the moving direction of the finger or pen moving on the touch panel 106a for each vertical component and horizontal component on the touch panel 106a based on the change in the position coordinates.

[0019] When the CPU 101 detects a touch-move of a predetermined distance or more, it determines that a slide operation has been performed. An operation in which a finger is touched on the touch panel 106a, quickly moved a predetermined distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced on the touch panel 106a as if flicking. When the CPU 101 detects a touch-move of a predetermined distance or more at a predetermined speed or more and detects a touch-up, it can determine that a flick has been performed. In other words, the CPU 101 can determine that a flick has been performed following a slide operation. In addition, a touch operation in which multiple points (for example, two points) are touched simultaneously and the touch positions are brought closer to each other is called a pinch-in, and a touch operation in which the touch positions are moved away from each other is called a pinch-out. Pinch-out and pinch-in are collectively called pinch operations (or simply pinch). The touch panel 106a may be of any of various touch panel types, such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, an optical sensor type, etc. Depending on the type applied, there are types that detect a touch by contact with the touch panel, types that detect a touch by the approach of a finger or a pen to the touch panel, and the like, and any type may be applied.

[0020] The electronic device 100 in Fig. 1 may be, for example, an imaging device such as a personal computer or a digital camera. When the electronic device 100 is applied to an imaging device, the recording medium 108 is a memory card or the like, and moving images and still images recorded on the memory card can be reproduced and displayed on a display 105 (rear liquid crystal screen) of the imaging device. The electronic device 100 can also be applied to smart devices such as smartphones and tablet terminals. Furthermore, the electronic device 100 can be applied to any device that can reproduce and display moving images and still images, such as a PDA, a portable image viewer, a printer device equipped with a display, a digital photo frame, a music player, a game machine, and an electronic book reader.

[0021] Next, a process flow of the electronic device 100 of the present embodiment will be described. FIG. 2 to FIG. 5 are flowcharts showing an example of a process flow of the playback process of the electronic device 100 of the present embodiment. Each process of the following flowchart is realized by the CPU 101 executing a program. First, in S201, the CPU 101 controls displaying information included in a video and metadata of the video on the display 105. The metadata is, for example, information on a video clip. The information on the video and metadata is, for example, recorded on the recording medium 108, and the CPU 101 acquires the video and metadata of the video from the recording medium 108. In addition, when executing the process of S201, the CPU 101 initializes variables A and B, which will be described later. The variable A is information for identifying a frame corresponding to the touch position of the seek bar 304, and the variable B is information for identifying a frame during drawing processing. The information for identifying a frame is, for example, a frame number.

[0022] FIG. 6(A) is a diagram showing a first example of a screen displayed on the display 105. In FIG. 6(A), the display 105 displays an F value 302 and a time 303 of the playback position of the video superimposed on an image (image 301) of the video. In S202, the CPU 101 performs control to display a seek bar on the display 105. FIG. 6(B) is a diagram showing a second example of a screen displayed on the display 105. In the example of FIG. 6(B), in addition to the information of FIG. 6(A), a seek bar 304, a pointer 305 indicating a current position in the video, a start time 306 of the video, and an end time 307 of the video are displayed superimposed on the image 301. The start time 306 of the video corresponds to the start point position, and the end time 307 of the video corresponds to the end point position. The seek bar 304 corresponds to a display item indicating the playback position of the video. The display item may be a display form other than a seek bar as long as it can indicate the playback position of the video.

[0023] When a video is being played back, pointer 305 moves on seek bar 304 from start time 306 to end time 307. Also, pointer 305 on seek bar 304 can be moved to any position by a user operation. This makes it possible to change the playback position of the video. CPU 101 performs control to display on display 105 a screen such as that shown in the example of FIG. 6(B).

[0024] In S203, CPU 101 performs control to start video playback. In S204, CPU 101 determines whether a touchdown operation on seek bar 304 has been performed on operation unit 106. If it is determined that a touchdown operation on seek bar 304 has been performed, CPU 101 determines YES in S204 and advances the flow to S205. On the other hand, if a touchdown operation on seek bar 304 has not been performed, CPU 101 determines YES in S204 and advances the flow to "A". The processing after "A" will be described later.

[0025] At S205, CPU 101 stores in memory 102 the value of variable S indicating the playback state, whether the video is being played or paused. At S206, CPU 101 determines whether the video is being played based on the value of variable S. If the value of variable S indicates that the video is being played, CPU 101 determines YES at S206 and advances the flow to S207. At S207, CPU 101 performs control to pause the video being played. Then, CPU 101 advances the flow to S208. On the other hand, if the value of variable S indicates that the video is not being played, CPU 101 determines NO at S206 and advances the flow to S208.

[0026] In S208, CPU 101 determines whether it is possible to draw an image following the seek bar operation. The image to be drawn is a frame image of a video. If it is possible to draw an image following the seek bar operation, CPU 101 determines YES in S208 and advances the flow to "B". The processing from "B" onward will be described later. On the other hand, if it is not possible to draw an image following the seek bar operation, CPU 101 determines NO in S208 and advances the flow to S209.

[0027] The seek bar operation (touch operation on the seek bar 204) in this embodiment is an operation to change the playback position of the video. If the CPU 101 determines YES in S208, the drawing of the image (frame image) following the seek bar operation is not delayed. In other words, when the playback position of the video is changed by the seek bar operation, the drawing of the image (frame image) at the changed playback position is not delayed and is in time with the seek bar operation. However, even if the drawing of the image (frame image) at the changed playback position is delayed with respect to the seek bar operation, if the amount of delay is equal to or less than a predetermined threshold (if the amount of delay is small), the CPU 101 may determine YES in S208. This is because in this case, operability is hardly deteriorated. On the other hand, if the CPU 101 determines NO in S208, the drawing of the image (frame image) following the seek bar operation is delayed. In other words, when the playback position of the video is changed by the seek bar operation, the drawing of the image (frame image) at the changed playback position is delayed from the seek bar operation.

[0028] The CPU 101 may make the determination in S208 based on at least one of the processing speed of the image processing unit 104, the image size of the moving image, the resolution of the moving image, the communication environment of the network 111, and the transfer speed of the recording medium 108. For example, when the processing speed of the image processing unit 104 is equal to or lower than a predetermined speed, the drawing of the image at the changed playback position may be delayed from the seek bar operation, so the CPU 101 may determine NO in S208. Similarly, when the resolution of the moving image is equal to or higher than a predetermined resolution, the drawing of the image at the changed playback position may be delayed from the seek bar operation, so the CPU 101 may determine NO in S208. For example, in the case of a high-resolution moving image such as 4K or 8K, when the playback position is changed by the seek bar operation, the drawing of the image at the changed playback position is likely to be delayed from the seek bar operation. In such a case, the CPU 101 may determine NO in S208.

[0029] Furthermore, when the processing speed of image processing unit 104 is slower than a predetermined speed, the drawing of images will always be delayed. Similarly, when the size of the moving image is equal to or larger than a predetermined size, when the resolution of the moving image is equal to or larger than a predetermined resolution, when the communication load of network 111 is equal to or larger than a predetermined load, or when the transfer speed with recording medium 108 is equal to or smaller than a predetermined speed, the drawing of images will always be delayed. Therefore, depending on the various situations described above, CPU 101 may proceed to the process of S209 without making the determination of S208. In this case, the processes after "B" are not executed.

[0030] In S209, CPU 101 determines whether the timer has started counting. The timer may be a hardware timer of electronic device 100, or may be a software timer executed by CPU 101. If the timer has started counting, CPU 101 determines YES in S209 and advances the flow to S210. In S210, CPU 101 ends the timer counting. At this time, CPU 101 may reset the timer counting. If CPU 101 determines NO in S209 or has executed the process of S210, CPU 101 advances the flow to S211. In S211, CPU 101 starts the timer counting.

[0031] In S212, CPU 101 moves pointer 305 of the playback position at a ratio of the touched position to the start point and end point of seek bar 304 in the x-axis direction in response to an operation on seek bar 204. This moves the position of pointer 305 indicating the playback position displayed on display 105. Here, as shown in FIG. 6(B), seek bar 204 extends in the longitudinal direction (x-axis direction). The position of pointer 305 is represented by the x coordinate. The direction in which seek bar 204 extends may be in either direction of two orthogonal axes (x-axis and y-axis) on display 105, or may be an oblique direction.

[0032] In S213, CPU 101 calculates the number of seconds at the playback position based on the ratio of the touched position to the start point and end point in the longitudinal direction, or x-axis direction, of seek bar 304. CPU 101 can calculate the number of seconds at the playback position using the following formula (1). In the following formula (1), the total number of seconds is the sum of the number of seconds from the start x-coordinate (start position) to the end x-coordinate (end position) of seek bar 304, and indicates the duration of the video. "Number of seconds to play = (touched x coordinate - start x coordinate of seek bar) / (end x coordinate of seek bar - start x coordinate of seek bar) x total number of seconds + start time" ··· formula (1)" The number of seconds of the playback position calculated by the above formula (1) is an approximate time based on the position of the seek bar 204 operated (touched) and both ends of the seek bar 204.

[0033] In S214, the CPU 101 controls the display 105 to display the number of seconds of the playback position calculated in S213 in a first format of hours, minutes, and seconds. FIG. 7(A) is a diagram showing a third example of a screen displayed on the display 105. As shown in FIG. 7(A), a time 308 expressed in a first format of hours, minutes, and seconds is displayed superimposed on an image 301. The time 308 corresponds to the time information of a frame image corresponding to a changed playback position. This allows the time of an image of a moving image to be displayed in the first format of hours, minutes, and seconds at a touched position even when the image display cannot be switched immediately following a user operation. At this time, the CPU 101 does not update the image 301. Therefore, when an arbitrary position of the seek bar 304 is touched by a user operation, even when the image display cannot be switched immediately following the user operation, a desired position in the moving image can be searched for while maintaining responsiveness to the user operation.

[0034] In S215, the CPU 101 determines whether a touch-move operation has been performed on the operation unit 106 in the x-axis direction of the seek bar 304. If a touch-move operation has been performed, the CPU 101 determines YES in S215 and returns the flow to S209. On the other hand, if a touch-move operation has not been performed, the CPU 101 determines NO in S215 and moves the flow from "C" to S216. The processing after "C" will be described with reference to the flowchart of FIG. 3. As shown in the flowchart of FIG. 3, the flow moves from "C" to S216. In S216, the CPU 101 determines whether the timer that started counting in S211 has elapsed a predetermined time. If the timer has elapsed the predetermined time, the CPU 101 determines YES in S216 and advances the flow to S217.

[0035] In S217, CPU 101 ends the count of the timer. In S218, CPU 101 judges whether drawing of the image at the playback position has started. If drawing of the image at the playback position has not started, CPU 101 judges NO in S218 and advances the flow to S219. In S219, CPU 101 calculates the frame of the playback position by the ratio of the touched x-coordinate position to the start point and end point in the x-coordinate direction of seek bar 304, and stores the calculated value in memory 102 as the value of variable A. As described above, variable A is information that specifies the frame corresponding to the touched position of seek bar 304, and variable B is information that specifies the frame during drawing processing. In S220, CPU 101 reads the values ​​of variable A and variable B stored in memory 102, and judges whether the value of variable A and the value of variable B are the same.

[0036] If the value of variable A and the value of variable B are not the same, CPU 101 determines NO in S220 and advances the flow to S221. In S221, CPU 101 reads the value of variable A stored in memory 102, and performs control to start drawing an image at the frame position corresponding to variable A. As a result, the image at the frame position corresponding to variable A is drawn on display 105. In S222, CPU 101 reads the value of variable A stored in memory 102, sets the value of variable B to the value of variable A, and stores this in memory 102.

[0037] Then, CPU 101 advances the flow to S223. CPU 101 also advances the flow to S223 if it determines NO in S216, if it determines YES in S218, or if it determines YES in S220. CPU 101 advances the flow to S223 if it determines that the predetermined time has not elapsed in S216, thereby allowing the drawing interval of the image to be increased. As a result, since drawing processing is not performed during the touch-move operation, it is possible to suppress a decrease in responsiveness to a user operation.

[0038] Moreover, when CPU 101 judges YES in S220, it advances the flow to S223 without executing the processes of S221 and S222. The process of S218 is executed when it is judged NO in S216, that is, when a predetermined time has elapsed. When it is judged YES in S220, the value of variable A and the value of variable B are the same. Therefore, when the touch position touched on seek bar 304 remains the same for a predetermined time, it is judged YES in S220. In this case, CPU 101 can omit the process of S221, that is, the drawing process of the playback position.

[0039] In S223, CPU 101 determines whether drawing of the image is complete. If CPU 101 determines that drawing of the image is complete, it determines YES in S223 and advances the flow to S224. If CPU 101 determines that drawing of the image is not complete, it determines NO in S223 and advances the flow to S228. In S224, CPU 101 calculates the frame of the playback position based on the ratio of the touched x coordinate position to the start point and end point in the x axis direction of seek bar 304, and stores the calculated value in memory 102 as the value of variable A. In S225, CPU 101 reads the values ​​of variable A and variable B in memory 102 and determines whether the values ​​of variable A and variable B are the same. If the values ​​of variable A and variable B are not the same, CPU 101 determines NO in S225 and advances the flow to S226.

[0040] In S226, CPU 101 performs control to display the time code of the image for which drawing has been completed on display 105 in the second format of hours, minutes, seconds, and frames. The process of S226 is performed when the determination in S223 is YES. When drawing of the moving image image is completed, that is, when the moving image image is updated, CPU 101 performs control to display the time code corresponding to the updated moving image image in the second format.

[0041] FIG. 7B is a diagram showing a fourth example of a screen displayed on the display 105. When drawing is completed, the CPU 101 performs control to update the image 301 displayed on the display 105, and also performs control to display the time 309 in the second format of hours, minutes, seconds, and frames as a time code superimposed on the image 301. The time 308 in FIG. 7A and the time 309 in FIG. 7B are both time information, but the number of significant digits is different. The time 308 in FIG. 7A is time information roughly calculated based on the touch position of the touch operation on the seek bar 304. The time 308 does not include a frame. For example, in the example of FIG. 7A, the time 308, which is the time information in the first format, is "00:16:11" and does not include information indicating a frame.

[0042] On the other hand, the time 309 in FIG. 7B includes information indicating a frame of an image (frame image) corresponding to a playback position changed by a touch operation on the seek bar 304. For example, in the example of FIG. 7B, the time 309, which is the time information in the second format, is "00:16:11.03" and includes "03" as information indicating a frame. That is, the time information in the first format has a smaller number of significant digits than the time information in the second format. Therefore, by controlling the time display in the first format, which has a smaller number of significant digits represented by hours, minutes, and seconds, during a user operation, the CPU 101 can suppress a decrease in responsiveness. Then, when the drawing of an image is completed, the time code of the image that has been drawn can be displayed in the second format of hours, minutes, seconds, and frames. In S227, the CPU 101 initializes the value of the variable B and stores it in the memory 102.

[0043] As described above, when the CPU 101 judges NO in S225, it executes the process of S226. As a result, when the frame of the image where drawing is completed and the frame of the position where the touch operation (touch-on) is performed are different, the time code of the image where the touch-on position is displayed as the time 309. The image where drawing is started in S221 corresponds to the variable B stored in S222, and the image where drawing is completed corresponds to the variable A stored in S224. Therefore, when the touch position changes from the start to the completion of drawing of the image, the CPU 101 judges NO in S225. In this case, the CPU 101 displays the time code of the image where drawing is completed in S226 by superimposing it on the image 301. On the other hand, when the CPU 101 judges YES in S225, it advances the flow to S228 without executing the process of S226. In this case, the touch position is the same from the start to the completion of drawing of the image. In this case, the process of displaying the time code in S226 can be omitted.

[0044] In S228, CPU 101 determines whether operation unit 106 is in a touch-on state (touching). If it is in a touching state, CPU 101 determines YES in S228 and moves the flow from "D" to S215 in FIG. 2. On the other hand, if it is not in a touching state, CPU 101 determines NO in S228 and advances the flow to S229. In this case, the state of operation unit 106 is a touch-off state. In S229, CPU 101 calculates the frame of the playback position based on the ratio of the touched x-coordinate position to the start point and end point of the x-coordinate direction of seek bar 304, and stores the calculated value of variable A in memory 102.

[0045] In S230, CPU 101 reads out the values ​​of variables A and B stored in memory 102, and judges whether the values ​​of variables A and B are the same. If the values ​​of variables A and B are not the same, CPU 101 judges NO in S230 and advances the flow to S231. In S231, CPU 101 reads out the value of variable A stored in memory 102, and performs control to start drawing an image at the frame position of variable A. S231 is a process that is executed when the values ​​of variables A and B are not the same. In other words, the process of S231 is executed when an image is not drawn at the position of the touch-off seek bar 304.

[0046] In S232, CPU 101 reads the value of variable S stored in memory 102, and judges whether the value of variable S indicates that playback is paused. If the value of variable S indicates that playback is not paused, CPU 101 judges NO in S232, and advances the flow to S233. In S233, CPU 101 reads the value of variable A stored in memory 102, and performs control to start playback of the video from the frame position corresponding to variable A. If CPU 101 judges YES in S230, if it judges YES in S232, or if it has executed the process of S233, it moves the flow from "E" to S242. The process from S242 onwards will be described later.

[0047] Next, the process when CPU 101 judges YES in S208 of FIG. 2 will be described with reference to the flowchart of FIG. 4. CPU 101 judges whether it is possible to draw an image following the seek bar operation in S208. When CPU 101 judges YES in S208, it moves the flow from "B" to S234 of FIG. 4. In S234, CPU 101 controls the movement of pointer 305 of the playback position based on the touched position on seek bar 304. This moves the position of pointer 305 displayed superimposed on display 105. In S235, CPU 101 calculates the frame of the playback position based on the ratio of the touched x coordinate position to the start point and end point of the x coordinate direction of seek bar 304, and stores the calculated value in memory 102 as the value of variable A.

[0048] In S236, the CPU 101 reads the value of the variable A stored in the memory 102, and performs control to draw an image at a frame position corresponding to the read variable A. In S237, the CPU 101 performs control to display the time code of the image drawn in S236 on the display 105 in the format of hours, minutes, seconds, and frames. The processes of S236 and S237 are executed when the above-mentioned S208 is judged as YES, that is, when the image can be drawn following the seek bar operation. Therefore, since the image can be drawn in time with the operation of the seek bar 304 by the user, the CPU 101 performs control to display the time information in the second format of hours, minutes, seconds, and frames superimposed on the image 301 for which drawing has been completed.

[0049] In S238, the CPU 101 determines whether a touch-move operation has been performed in the x-axis direction of the seek bar 304 using the operation unit 106. If a touch-move operation has been performed in the x-axis direction, the CPU 101 determines YES in S238, returns the flow to S234, and executes the processes from S234 to S237. On the other hand, if a touch-move operation has not been performed in the x-axis direction, the CPU 101 determines NO in S238, and advances the flow to S239. In S239, the CPU 101 determines whether the state of the operation unit 106 is touch-on (touching). If it is touching, the CPU 101 determines YES in S239, and returns the flow to S238. On the other hand, if it is not touching, the CPU 101 determines NO in S239, and advances the flow to S240. In this case, the state of the operation unit 106 becomes touch-off.

[0050] In S240, CPU 101 reads the value of variable S stored in memory 102, and determines whether the read variable S indicates that playback is paused. If variable S does not indicate that playback is paused, CPU 101 determines NO in S240 and advances the flow to S241. In S241, CPU 101 reads the value of variable A stored in memory 102, and performs control to start playback of the video from the frame position (playback position) corresponding to variable A. If CPU 101 determines YES in S240 or executes the process of S241, CPU 101 moves the flow to "F". Also, if CPU 101 determines NO in S204 of FIG. 2, CPU 101 moves the flow from "A" to "F" in FIG. 4. The destination of the flow from "E" in FIG. 3 is also "F".

[0051] The process from "F" onward in FIG. 4 will be described. FIG. 5 is a flowchart showing the flow of the process from "F" onward in FIG. 4. In S242, CPU 101 reads the value of variable S stored in memory 102, and judges whether the value of variable S indicates that the process is paused. If the value of variable S indicates that the process is paused, CPU 101 judges YES in S242 and advances the flow to S243. In S243, CPU 101 judges whether the drawing of the image has not been completed. The judgment in S243 is a process for judging whether the drawing of the image at the frame position started in S221 or S231 in FIG. 3 has been completed. If the drawing of the image has not been completed, CPU 101 judges NO in S243 and advances the flow to S244. In S244, the CPU 101 calculates the frame of the playback position based on the ratio of the touched x coordinate position to the start point and end point of the x axis direction of the seek bar 304, and stores the calculated frame in the memory 102 as the value of the variable A.

[0052] In S245, CPU 101 reads out the values ​​of variables A and B stored in memory 102, and judges whether the values ​​of variables A and B are the same. If the values ​​of variables A and B are not the same, CPU 101 judges NO in S245 and advances the flow to S246. In S246, CPU 101 displays the time code of the image for which drawing has been completed in a second format of hours, minutes, seconds, and frames, superimposed on image 301. In S247, CPU 101 initializes the value of variable B and stores it in memory 102. If CPU 101 judges NO in S242, judges YES in S243, judges YES in S245, or executes the process of S247, the flow advances to S248.

[0053] In S248, CPU 101 determines whether or not an operation to press a play button has been performed on operation unit 106. The play button is a button for playing a moving image, and may be a button on the screen displayed on display 105, or may be a button member provided on electronic device 100. If an operation to press the play button has been performed, CPU 101 determines YES in S248 and advances the flow to S249. In S249, CPU 101 determines whether or not a moving image is being played based on the value of variable S. If a moving image is being played, CPU 101 determines YES in S249 and advances the flow to S250. In S250, CPU 101 performs control to pause the moving image being played. At this time, CPU 101 changes the value of variable S. On the other hand, if a moving image is not being played, CPU 101 determines NO in S249 and advances the flow to S251. In S251, the CPU 101 reads the value of the variable A in the memory 102, and performs control to start playing back the video from the frame position corresponding to the variable A.

[0054] If CPU 101 determines NO in S248, executes the process of S250, or executes the process of S251, it advances the flow to S252. In S252, CPU 101 determines whether a predetermined ending operation has been performed on operation unit 106. If the predetermined ending operation has been performed, CPU 101 determines YES in S252 and ends the playback process of this embodiment. At this time, CPU 101 may perform control to hide the playback screen displayed on display 105. On the other hand, if the predetermined ending operation has not been performed, CPU 101 determines NO in S252 and moves the flow from "G" to S204 in FIG. 2.

[0055] As described above, the electronic device 100 of the present embodiment displays time information calculated based on the touch position of the touch operation when an operation is performed to change the playback position of the video by operating the seek bar, even if the drawing of the video image is delayed. After that, the electronic device 100 displays the video image at the playback position changed by the seek bar operation and the time code corresponding to that image. This makes it possible to display the time information of the video image corresponding to the seek bar operation even if the drawing of the video image does not arrive in time for the seek bar operation, thereby improving operability when the playback position of the video is changed.

[0056] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-mentioned embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. The present invention can also be realized by supplying a program that realizes one or more functions of the above-mentioned embodiments to a system or device via a network or a recording medium, and having one or more processors of a computer in the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions. [Explanation of symbols]

[0057] 100 Electronic equipment 101 CPU 104 Image processing section 105 Display 106 Operation section 106a Touch Panel 301 images 304 Seekbar 305 Pointer 308 Time 309 Time

Claims

1. A detection means for detecting a touch operation on a display means; a control means for controlling the display means to display a video, a display item indicating a playback position of the video, and time information corresponding to the playback position, and for controlling the display means to change the playback position of the video in accordance with the touch position detected by the detection means, and for controlling the display means to display a frame image of the video corresponding to the changed playback position and the time information of the frame image, The electronic device is characterized in that, when the playback position is changed in response to a touch operation, if the display of the frame image corresponding to the changed playback position and the time information corresponding to the frame image is delayed, the control means controls the display of the frame image corresponding to the changed playback position and the time information of the frame image, after displaying time information calculated based on the touch position of the touch operation, rather than the time information of the frame image corresponding to the changed playback position.

2. the control means displays a seek bar as a display item indicating the playback position; The electronic device according to claim 1, characterized in that when the playback position is changed in response to the touch operation, if the display of the frame image corresponding to the changed playback position and the time information corresponding to the frame image is delayed, the control means performs control to calculate and display time information based on the touch position of the touch operation, the start and end positions of the seek bar, and the start and end times of the video.

3. The electronic device according to claim 1 or 2, characterized in that the control means makes the number of significant digits of the time information when displaying the time information calculated based on the touch position of the touch operation smaller than the number of significant digits of the time information when displaying the time information of the frame image corresponding to the playback position changed by the touch operation.

4. The electronic device according to claim 3, characterized in that the control means performs control to display time information calculated based on the touch position of the touch operation detected by the detection means in a first format of hours, minutes, and seconds, and to display time information of a frame image corresponding to a playback position changed by the touch operation in a second format of hours, minutes, seconds, and frames.

5. The electronic device according to claim 4, characterized in that the control means performs control to display the time information in the second format when the display of the frame image corresponding to the changed playback position and the time information corresponding to the frame image is delayed and when the touch position changes between the start and completion of drawing of the frame image.

6. 6. The electronic device according to claim 4, wherein the control means performs control to display the time information in the second format when the frame image is updated.

7. The electronic device described in any one of claims 2 to 6, characterized in that the control means controls so as not to draw the frame image at the playback position in the video when the display of the frame image corresponding to the changed playback position and the time information corresponding to the frame image is delayed and when the touch position detected by the detection means remains the same for a predetermined period of time.

8. The electronic device described in any one of claims 1 to 7, characterized in that the control means determines whether to delay the display of the frame image corresponding to the changed playback position and the time information corresponding to the frame image, based on at least one of the processing speed of an image processing means that performs image processing of the frame image, the size of the frame image, the resolution of the frame image, the communication environment of the network, and the transfer speed of the recording medium.

9. A method for controlling an electronic device having a detection unit that detects a touch operation on a display unit, comprising: a step of controlling the display means to display a video, a display item indicating a playback position of the video, and time information corresponding to the playback position, changing the playback position of the video in accordance with the touch position detected by the detection means, and controlling the display means to display a frame image of the video corresponding to the changed playback position and the time information of the frame image, A control method for an electronic device, characterized in that when the playback position is changed in response to a touch operation, if the display of a frame image corresponding to the changed playback position and the time information corresponding to the frame image is delayed, the method controls the display of the frame image corresponding to the changed playback position and the time information of the frame image, after displaying time information calculated based on the touch position of the touch operation, rather than the time information of the frame image corresponding to the changed playback position.

10. A program for causing a computer to execute each of the means of the electronic device according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Image transmission method, image transmission device, and image transmission program

    JP2012119945A

  • Content Gestures

    JP2013529802A

  • Display control device

    JP2016143233A

  • Information processing device, control method thereof and program

    JP2017117435A

  • Signal processor, signal processing method, program, and electronic apparatus

    JP2018036841A