Video playing method and device, equipment, medium and program product

Abstract

The invention discloses a video playing method, which is applied to head-mounted equipment, the head-mounted equipment is provided with a first image acquisition device, and the method comprises the following steps: in response to a video playing instruction, controlling the first image acquisition device to perform image acquisition to obtain image information; acquiring video information corresponding to the image information; and playing the video information. In this way, links such as image acquisition, video searching and playing are seamlessly integrated in the head-mounted device, a user does not need to manually execute multiple steps of operation such as shooting, uploading, selecting and playing, and therefore operation fluency and use convenience can be remarkably improved. Besides, as the head-mounted device is usually worn on the head of the user and can be naturally aligned with the target object which the sight line of the user reaches, the head-mounted device can be utilized to automatically acquire the image information in the visual field of the user and automatically trigger the video retrieval and playing operation based on the image information, so that the smooth interaction experience that what you see is what you get is realized.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of wearable devices, and specifically discloses a video playing method, device, equipment, medium and program product. BACKGROUND

[0002] At present, if a user wants to obtain video content related to a target object, the user usually needs to use a smartphone or other handheld terminal to capture the target object to obtain an image, then upload the image to a video retrieval system, match a corresponding video segment based on the image content, and manually play the related video from the returned retrieval result. It can be seen that the current image-based video retrieval process has obvious problems of operation fragmentation and low efficiency. SUMMARY

[0003] In view of this, the embodiments of the present application provide a video playing method, device, equipment, medium and program product, to solve the problem of operation fragmentation and low efficiency in the image-based video retrieval process in the related art.

[0004] In a first aspect, the embodiments of the present application provide a video playing method applied to a head-mounted device, wherein the head-mounted device is provided with a first image acquisition device, and the method comprises: in response to a video playing instruction, controlling the first image acquisition device to acquire an image, and obtaining image information; acquiring video information corresponding to the image information; playing the video information.

[0005] In the above implementation manner, by seamlessly integrating the image acquisition, video searching and playing and other links in the head-mounted device, the user does not need to manually perform multiple-step operations such as capturing, uploading, selecting and playing, so that the operation fluency and use convenience can be significantly improved.

[0006] In addition, since the head-mounted device is usually worn on the head of the user, it can be naturally aligned with the target object within the user's line of sight, so that the image information in the user's field of view can be automatically acquired by using the head-mounted device, and the video retrieval and playing operations can be automatically triggered based on the image information, so that a seamless interactive experience of seeing is believing can be realized.

[0007] In a second aspect, the embodiments of the present application provide a video playing device applied to a head-mounted device, wherein the head-mounted device is provided with a first image acquisition device, and the device comprises: a control module configured to, in response to a video playing instruction, control the first image acquisition device to acquire an image, and obtain image information; an acquisition module configured to acquire video information corresponding to the image information; The playing module is configured to play the video information.

[0008] In a third aspect, an embodiment of the present application provides a head-mounted device, comprising a processor and a memory, the memory storing computer executable instructions capable of being executed by the processor, and the processor executes the computer executable instructions to implement the video playing method in the first aspect.

[0009] In a fourth aspect, an embodiment of the present application provides a storage medium, the storage medium storing computer executable instructions, and the computer executable instructions enable the processor to implement the video playing method when the computer executable instructions are invoked and executed by the processor.

[0010] In a fifth aspect, an embodiment of the present application provides a computer program product, the computer program product comprising a computer program, and the computer program enables the video playing method when the computer program is executed by the processor. BRIEF DESCRIPTION OF DRAWINGS In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments of the present application. It should be understood that the following drawings only show some embodiments of the present application, and therefore should not be regarded as a limitation to the scope, and for those skilled in the art, other related drawings can also be obtained without creative labor on the basis of these drawings.

[0011] Figure 1 The flowchart of the video playing method provided by the embodiments of the present application is shown in the figure. Figure 2 The structural diagram of the video playing device provided by the embodiments of the present application is shown in the figure. Figure 3 The structural diagram of the head-mounted device provided by the embodiments of the present application is shown in the figure. DETAILED DESCRIPTION

[0012] The technical solutions of the embodiments of the present application will be described below in combination with the drawings in the embodiments of the present application.

[0013] Embodiment one The head-mounted device provided by the embodiments of the present application comprises a first image acquisition module, a second image acquisition module, a display module and a communication module.

[0014] The photosensitive direction of the first image acquisition module is towards the front of the head-mounted device, and is configured to acquire image data of the external environment.

[0015] The photosensitive direction of the second image acquisition module is towards the wearer of the head-mounted device, and is configured to acquire facial image information of the wearer, so as to obtain the line-of-sight direction of the wearer according to the facial image information.

[0016] Combination Figure 1 The flowchart shown illustrates a video playback method. This application provides a video playback method applied to a head-mounted device, which may include the following steps: Step S101: In response to the video playback command, control the first image acquisition device to acquire images and obtain image information.

[0017] In this embodiment, when the head-mounted device receives a video playback command, it can control the first image acquisition module to acquire images and obtain image information.

[0018] In one optional implementation of this application, a second image acquisition device can be controlled to acquire images of the wearer's face using the head-mounted device, obtaining facial image information of the wearer; based on the facial image information, the wearer's gaze direction is determined, and the first image acquisition device is controlled to move towards the wearer's gaze direction to acquire images. This allows the first image acquisition device to follow the wearer's gaze direction to acquire images, thereby achieving a smooth, WYSIWYG interactive experience.

[0019] In some embodiments, facial image information can be input into a preset gaze direction determination model to obtain the wearer's gaze direction.

[0020] In this embodiment, the head-mounted device may be equipped with a button for triggering video playback commands. Correspondingly, when this button is triggered, the head-mounted device controls the first image acquisition device to acquire images. Thus, one-button image acquisition can be achieved through the head-mounted device.

[0021] Step S102: Obtain the video information corresponding to the image information.

[0022] In this embodiment, the video information may consist only of a video stream. Alternatively, the video information may include both a video stream and an audio stream. Correspondingly, when the video information consists only of a video stream, playing the video information means displaying the video information using a display interface. When the video information includes both a video stream and an audio stream, playing the video information means displaying the video stream using a display interface and playing the audio stream using a preset speaker module.

[0023] In this embodiment, the head-mounted device can be equipped with an AI model. After acquiring image information, the AI ​​model can determine whether video information corresponding to the image information exists. If the AI ​​model determines that video information corresponding to the image information exists, the video information can be obtained from the video source device or the cloud. If the AI ​​model determines that video information corresponding to the image information does not exist, interpolation processing can be performed on multiple acquired images in the image information to obtain the video information corresponding to the image information.

[0024] For example, the head-mounted device can establish a communication link with the video source device, such as through one or more of Wi-Fi, ultra-wideband, and cellular networks. Correspondingly, the head-mounted device can send a video information acquisition request, including image information, to the video source device via the wireless communication link. It can also receive video information fed back by the video source device through the wireless communication link, thereby obtaining the video information.

[0025] In one optional implementation of this application, the image information can be an image obtained by capturing images of objects in the environment where the head-mounted device is located. Correspondingly, a video information acquisition request can be sent to the cloud, the video information acquisition request including image information; and video information can be received from the cloud based on the video information acquisition request. In this way, the user does not need to upload image information, but the head-mounted device automatically acquires video information, thereby realizing automatic acquisition of video information, reducing user operations, and improving the user's experience.

[0026] In another optional implementation of this application, the image information can also represent an image acquired by capturing an image displayed on an external display device in the environment where the head-mounted device is located. The external display device can be an electronic device with a display interface, such as a smartphone, laptop, or television. The image displayed on the external display device can be a video frame in a video stream; for example, the external display device can play video content such as movies, TV series, or short videos. Correspondingly, each frame displayed by the external display device is a corresponding video frame output in chronological order within the video stream.

[0027] The video source device and the external display device can be the same device or they can be separate devices.

[0028] In this embodiment, the head-mounted device may have no connection to an external display device, meaning there is no wired or wireless communication connection between them. In this case, the head-mounted device can send a video information acquisition request, including image information, to a preset cloud and / or video source device. It then receives video information from the cloud based on the video information acquisition request.

[0029] In another optional embodiment, the head-mounted device can be wirelessly or wiredly connected to an external display device to acquire video information from the external display device. The image information represents an image acquired by capturing an image displayed on the external display device in the environment where the head-mounted device is located. This indicates that the external display device must contain video information corresponding to the image information; therefore, a video information acquisition request can be sent to the external display device to obtain the video information corresponding to the image information. In this embodiment, the external display device and the video source device can be the same device.

[0030] In this embodiment, the head-mounted device can communicate with an external display device and then send a video information retrieval request to the external display device. If no video information is received from the external display device based on the video information retrieval request within a preset time period, a video information retrieval request can be sent to the cloud and / or a video source device. Since the external display device is located in the external environment of the head-mounted device, the speed of retrieving video information from the external display device is usually significantly faster than the speed of retrieving video information from the cloud and / or the video source device. Therefore, in this embodiment, a video information retrieval request is sent to the external display device first to obtain video information more quickly. Only when no video information is received from the external display device based on the video information retrieval request within the preset time period is a video information retrieval request sent to the cloud and / or the video source device. In this way, the cloud and / or the video source device can be used as a backup data source, thereby improving the reliability of the head-mounted device in successfully obtaining video information.

[0031] In one optional implementation of this embodiment, the cloud, the video source device, and / or the external display device can all obtain the original video information corresponding to the image information upon receiving a video information acquisition request, and then feed the original video information back to the head-mounted device.

[0032] In another optional implementation of this embodiment, upon receiving a video information acquisition request, the cloud, video source device, and / or external display device can acquire the original video information corresponding to the image information; determine the video frame position of the image information in the original video information; use the video frame corresponding to the video frame position in the original video information as the starting frame of the video information; and use the last frame in the original video information as the ending frame of the video information. Finally, the video information is fed back to the head-mounted device. In this way, only video information with the image information as the starting frame can be fed back, reducing the amount of data transmission and enabling the head-mounted device to acquire video information more quickly. Furthermore, when the head-mounted device plays the video information, it can start video playback from the image seen by the wearer, thereby ensuring that the video playback content follows the wearer's perception and effectively eliminating invalid replays.

[0033] Step S103: Play video information.

[0034] In one optional implementation of this application, video information can be played directly.

[0035] In another optional implementation of this application embodiment, video frames of the image information within the video information can be obtained; a playback start frame can be determined based on the video frames of the image information within the video information, and the video information can be played sequentially in chronological order using the playback start frame as the playback starting point. Thus, when the head-mounted device obtains video information, the playback start point of the video information is dynamically determined based on the image information seen by the wearer, enabling the playback content of the head-mounted device to follow the wearer's real-time visual experience and effectively eliminating invalid replays.

[0036] In this embodiment of the application, the image information may include at least one captured image. Correspondingly, the starting frame for playback can be determined based on one or more captured images in the image information.

[0037] In one optional implementation of this embodiment, regardless of whether the image information represents an image acquired from an image displayed on an external display device, or an image acquired from an object in the environment where the head-mounted device is located, the head-mounted device can directly use a video frame from the acquired image in the video information as the playback start frame. The video information is then played sequentially from this start frame. This allows video playback to begin from the image seen by the wearer, ensuring that the video content follows the wearer's perception and effectively eliminating unnecessary replays.

[0038] In another optional implementation of this embodiment, when the head-mounted device has not yet played the video information and the image information represents the image obtained by capturing the image displayed on the external display device, the head-mounted device can obtain the acquisition time point of the image information and the acquisition time point of the video information; obtain the time position of the video frame of the image information in the video information; delay the time position by using the time difference between the acquisition time point and the acquisition time point to obtain the playback time point; and determine the video frame corresponding to the playback time point as the playback start frame.

[0039] Since video information originates from external display devices, video source devices, or the cloud, end-to-end time delays are unavoidable due to factors such as network transmission and encoding / decoding processing. During this delay, the external display device continues to play video content. If the acquired image information is played directly, the playback content may lag behind the wearer's current visual experience, causing the wearer to watch repeatedly. This embodiment utilizes the time difference between image acquisition time and video acquisition time to perform delay correction on the playback start position, thus ensuring that the content played by the head-mounted device remains synchronized with the image actually seen by the wearer through the external display device.

[0040] The video frame containing image information within video information can be obtained in the following way: determine the position of the video frame containing the image information within the video information; and identify the video frame in the video information that corresponds to the position of the video frame as the video frame containing the image information within the video information.

[0041] Optionally, determining the video frame position of the image information within the video information includes: inputting the image information and video information into a preset position determination model to obtain the byte offset of the image information within the video information. This allows for accurate determination of the video frame position of the image information within the video information.

[0042] In some embodiments, the location determination model can be deployed in a head-mounted device or in the cloud. Correspondingly, when the location determination model is deployed in the cloud, upon receiving a video information acquisition request, the cloud, after acquiring the video information based on the request, can determine the position of the image information within the video frame of the video information using the location determination model. Correspondingly, when the cloud feeds back the video information to the head-mounted device, it can also simultaneously feed back the position of the image information within the video frame of the video information.

[0043] In this embodiment, during the playback of video information by the head-mounted device, and when the image information represents an image obtained by capturing images displayed on an external display device, the head-mounted device can control the first image acquisition device to capture images of the images displayed on the external display device at preset time intervals to obtain image information. If the image information acquired by the head-mounted device is inconsistent with the currently playing video frame, the head-mounted device can use the video frame in the video information as the starting point, delaying it by a preset number of frames to obtain a revised playback starting frame. This revised playback starting frame is then used as the new playback starting point, and the video information is played sequentially in chronological order. This ensures that the video information played by the smart glasses device and the specific video played by the external display device can be continuously and synchronously played.

[0044] In this embodiment, if only one video message corresponds to the image information, the video message can be played directly. If multiple video messages correspond to the image information, each video message can be displayed at different positions on the display interface of the head-mounted device. The wearer's gaze direction is obtained; video messages opposite to the gaze direction are played. Thus, video message selection can be achieved without any user intervention, improving user experience.

[0045] The video playback method provided in this application integrates image acquisition, video search and playback into a head-mounted device, eliminating the need for users to manually perform multiple steps such as shooting, uploading, selecting and playing, thereby significantly improving the smoothness of operation and ease of use.

[0046] In addition, since head-mounted devices are usually worn on the user's head, they can be naturally aligned with the target object in the user's line of sight. Therefore, the head-mounted device can be used to automatically acquire image information in the user's field of vision and automatically trigger video retrieval and playback operations based on the image information, thereby achieving a smooth interactive experience of what you see is what you get.

[0047] Example 2 This application uses a head-mounted device as an example of smart glasses to further illustrate the aforementioned video playback method.

[0048] The smart glasses device may include a wireless communication module, a first image acquisition module, a second image acquisition module, a processor, a memory, and a video recognition module. The first image acquisition module may include a camera device. When the head-mounted device receives a video playback command, it can control the first image acquisition module to acquire images and obtain image information. The image information can be obtained by capturing images of video content played on an external display device, such as movies, TV series, short videos, etc. This played video content can be played in various scenarios, such as public places like shopping malls, cafes, squares, roads, and cinemas, as well as at home, etc. There are no restrictions on the playback location. The external display device can be a television, an outdoor large-screen device, a tablet video player, or an electronic screen, etc.

[0049] Smart glasses can communicate with external display devices via a wireless communication module. Alternatively, smart glasses can connect to external display devices without a wired or wireless connection.

[0050] In some embodiments, an AI model, namely a location determination model, may be deployed in the video recognition module.

[0051] When smart glasses acquire image information, they can use an AI model to determine if corresponding video information exists. If the AI ​​model determines that corresponding video information exists, the smart glasses can retrieve the video information from the cloud or a video source device and play it on the smart glasses' display interface. Alternatively, the smart glasses can display only the video frames from the video information where the image information is located. Or, the smart glasses can retrieve the target image from the video source device and / or the cloud and play it on the smart glasses' display interface.

[0052] The video source device can be a smartphone, tablet, laptop, or various smart devices. There are no restrictions.

[0053] When smart glasses receive video information, they can use the AI ​​model in the video recognition module to detect the image and video information, and obtain the file offset or byte offset of the image information in the video information. Both file offset and byte offset represent the position of the image information in the video frame within the video information.

[0054] In some embodiments, the AI ​​model can be set in an external display device, the cloud, or a video source device. When the external display device, the cloud, or the video source device receives image information, it can determine the file offset or byte offset of the video frame in the video information.

[0055] In some embodiments, the offset can be floating-point, meaning the position of the image information within the video information can be a floating-point number rather than an integer. Video frames in the video information can be interpolated based on the offset or position to obtain the video frames to be played, ensuring precise synchronization between the image / video played by the external display device and the video frames played by the head-mounted device.

[0056] In some embodiments, users can issue video playback commands to the smart glasses device using voice commands, button input, or other methods. For example, when a user sees an image / video they like or are interested in playing on another external display device (such as a monitor, television, etc.), they can control the smart glasses device using voice commands, button input, or other methods to achieve the video playback method described above. In this way, the video content playing on an external display device can be seamlessly transferred to the user's personal field of vision for private and immersive viewing, significantly improving the convenience of content access, the naturalness of interaction, and the overall user experience.

[0057] In this application, the first image acquisition device faces outward relative to the wearer of the smart glasses device and is used to acquire images of the external environment.

[0058] Wireless communication modules may include, but are not limited to, Wi-Fi, cellular communication, UWB, and Bluetooth.

[0059] In some embodiments, the smart glasses device may further include a second image acquisition device and an eye-tracking module. The second image acquisition device faces inward relative to the wearer of the smart glasses, and the second image acquisition module is used to acquire facial image information or eye image information of the wearer of the smart glasses device. The eye-tracking module is used to track the wearer's eyes based on the image information acquired by the second image acquisition module, thereby determining the wearer's gaze direction.

[0060] Correspondingly, the smart glasses device can control the first image acquisition device to face the direction of the wearer's line of sight to acquire images.

[0061] When multiple video feeds are available, the smart glasses device will play the video feed that corresponds to the wearer's line of sight. It will not play all video feeds, as this might not reflect the user's true intention and could simply be a distraction.

[0062] In some embodiments, the image information may be obtained by the first image acquisition device from images / videos played on external display devices such as televisions and electronic screens. Correspondingly, the smart glasses device can obtain the corresponding video information from external display devices, video source devices, or the cloud through a wireless communication module.

[0063] In some embodiments, the image information may be obtained by a first image acquisition device capturing images of objects such as buildings, displays, merchandise, natural landscapes, or items in the environment where the smart glasses device is located. The smart glasses device can obtain video information corresponding to the image information from the cloud and / or a video source device via a wireless communication module. For example, if a user sees a building, a display item, or an item, and may want to see related audio and video, the user can send a video playback command to the smart glasses device.

[0064] In some embodiments, the display interface of the smart glasses device can be transparent, so that the wearer can see not only the content displayed on the display device, but also objects in the real world.

[0065] In some embodiments, the smart glasses device can acquire the time delay between the acquisition time of image information and the acquisition time of video information. The starting frame for video playback is determined based on this time delay. This achieves synchronization between the specific video seen by the smart glasses wearer on an external display device and the video information played on the smart glasses device's display interface, improving the viewing experience for the smart glasses wearer.

[0066] Smart glasses devices may also include a speaker module for playing audio from video information.

[0067] Since external display devices and smart glasses are different devices, and often do not have wired or wireless communication connections, the actual clock frequency of different devices often deviates from the nominal frequency, for example, within 100ppm, 50ppm, 20ppm, 10ppm, 2ppm, etc.

[0068] Therefore, in order to ensure that the video information played by the smart glasses device can be continuously synchronized with the specific video played by the external display device, it is necessary to continuously or periodically process the time points of the image information collected by the smart glasses device to obtain the time delay between the two.

[0069] In some embodiments, the smart glasses device can be a pair of smart glasses. However, it can also be a component within a pair of smart glasses.

[0070] Example 3 Based on the same inventive concept, this application provides a video playback device 200, applied to a head-mounted device, combined with... Figure 2 The diagram shows the structure of a video playback device, which may include a control module 201, an acquisition module 202, and a playback module 203.

[0071] The control module 201 is used to control the first image acquisition device to acquire images and obtain image information in response to a video playback command. The acquisition module 202 is used to acquire the video information corresponding to the image information, and the playback module 203 is used to play the video information.

[0072] In one feasible embodiment of this application, the image information represents the image obtained by image acquisition of the image displayed on the external display device; the acquisition module 203 can be specifically used to send a video information acquisition request to a preset video source device and / or a preset cloud, the video information acquisition request including image information; and to receive video information fed back by the video source device and / or the cloud based on the video information acquisition request; the video information includes image information.

[0073] In this embodiment, the playback module 203 is specifically used to acquire video frames of image information in video information; determine the playback start frame based on the video frames of image information in video information; and play video information sequentially in chronological order, using the playback start frame as the playback starting point.

[0074] In one feasible implementation of this application, the playback module 203 is specifically used to take the video frame of the image information in the video information as the starting point, and the video frame of the preset number of frames as the playback start frame.

[0075] In one feasible implementation of this application, the playback module 203 specifically acquires the acquisition time point of the image information and the acquisition time point of the video information; acquires the time position of the video frame in the video information; delays the time position by using the time difference between the acquired time point and the time point to obtain the playback time point; and determines the video frame corresponding to the playback time point as the playback video frame.

[0076] In this embodiment, the playback module 203 is specifically used to determine the video frame position of the image information in the video information; and to determine the video frame in the video information corresponding to the video frame position as the video frame of the image information in the video information.

[0077] In this embodiment, the playback module 203 is specifically used to input image information and video information into a preset position determination model to obtain the byte offset of the image information in the video information.

[0078] In one feasible embodiment of this application, the image information represents the image obtained by capturing images of objects in the environment where the head-mounted device is located; the acquisition module 202 is specifically used to send a video information acquisition request to a preset cloud, the video information acquisition request including image information; and to receive video information fed back by the cloud based on the video information acquisition request; the video information includes image information.

[0079] In one feasible embodiment of this application, there are multiple video information corresponding to the image information, and the playback module 203 is specifically used to display each video information at different positions on the display interface of the head-mounted device; obtain the gaze direction of the wearer of the head-mounted device; and play the video information opposite to the gaze direction.

[0080] In this embodiment, the control module 201 is specifically used to obtain the gaze direction of the wearer of the head-mounted device; and to control the first image acquisition device to perform image acquisition in the gaze direction.

[0081] It should be understood that, for the sake of brevity, some of the content described in Embodiment 1 will not be repeated in this embodiment.

[0082] Example 4: Based on the same inventive concept, this embodiment provides a head-mounted device, see [link to relevant documentation]. Figure 3 As shown, it includes a processor 301, a memory 302, a first image acquisition device, and a display screen, etc. Among them: The processor 301 is used to execute one or more programs stored in the memory 302 to control the first image acquisition device to acquire images, obtain image information, and use the image information to implement the above-mentioned video playback method.

[0083] It is understandable that processor 301 can be a processor core or processor chip, or other circuitry capable of program configuration and execution. Memory 302 can be RAM (Random Access Memory), ROM (Read-Only Memory), flash memory, etc., but this is not a limitation.

[0084] It's understandable. Figure 3 The structure shown is for illustrative purposes only; the head-mounted device may also include components that are more advanced than those shown. Figure 3 The more or fewer components shown, or having the same Figure 3 Different configurations are shown. For example, it may also have an internal communication bus for communication between the processor 301 and the memory 302; or it may have an external communication interface, such as a USB (Universal Serial Bus) interface, a CAN (Controller Area Network) bus interface, etc.; or it may have an information display component such as a display screen, but this is not a limitation.

[0085] In this embodiment, a head-mounted device refers to a wearable device worn on a user's head. The head-mounted device may further include a first image acquisition device, a display module, an eye-tracking module, and a wireless communication module. Head-mounted devices include, but are not limited to, VR (Virtual Reality) headsets, AR (Augmented Reality) glasses, MR (Mixed Reality) head-mounted devices, smart glasses, and head-mounted recorders.

[0086] Based on the same inventive concept, this embodiment also provides a computer-readable storage medium, such as a floppy disk, optical disk, hard disk, flash memory, USB flash drive, SD (Secure Digital Memory Card), MMC (Multimedia Card), etc., in which one or more programs implementing the above steps are stored. These one or more programs can be executed by one or more processors to implement the above video playback method. Further details will not be elaborated here.

[0087] Based on the same inventive concept, this embodiment also provides a computer program product, which includes a computer program that, when executed by a processor, implements the video playback method described above.

[0088] In this embodiment, the computer program product may be a program package or an installation package.

[0089] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. The apparatus embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Additionally, the displayed or discussed mutual couplings, direct couplings, or communication connections may be through some communication interfaces; indirect couplings or communication connections between devices or units may be electrical, mechanical, or other forms.

[0090] Furthermore, the units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0091] Furthermore, the functional modules in the various embodiments of this application can be integrated together to form an independent part, or each module can exist independently, or two or more modules can be integrated to form an independent part.

[0092] In this document, relational terms such as first and second are used only to distinguish one entity or operation from another entity or operation, without necessarily requiring or implying any such actual relationship or order between these entities or operations.

[0093] In this article, "multiple" refers to two or more.

[0094] The above description is merely an embodiment of this application and is not intended to limit the scope of protection of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A video playback method, characterized in that, Applied to a head-mounted device, the head-mounted device being equipped with a first image acquisition device, the method includes: In response to a video playback command, the first image acquisition device is controlled to acquire images and obtain image information. Obtain the video information corresponding to the image information; Play the video information.

2. The method according to claim 1, characterized in that, The image information represents the image obtained by acquiring an image displayed on an external display device. Obtaining the video information corresponding to the image information includes: Send a video information acquisition request to a preset video source device and / or a preset cloud, wherein the video information acquisition request includes the image information; The system receives video information from the video source device and / or the cloud based on the video information acquisition request; the video information includes the image information.

3. The method according to claim 1, characterized in that, Playing the video information includes: Obtain the video frames of the video information containing the image information; Based on the image information, the playback start frame is determined in the video frame of the video information, and the video information is played sequentially in chronological order, using the playback start frame as the playback starting point.

4. The method according to claim 3, characterized in that, Determining the playback start frame based on the video frames in the video information according to the image information includes: The video frame in the video information containing the image information is taken as the starting frame, and the video frames following the preset number of frames are taken as the playback start frame.

5. The method according to claim 3, characterized in that, Obtaining the image information from the video frames in the video information includes: Determine the position of the image information within the video information in the video information; The video frame corresponding to the position of the video frame in the video information is determined as the video frame of the image information in the video information.

6. The method according to claim 5, characterized in that, Determining the position of the image information in the video information as a video frame includes: The image information and the video information are input into a preset position determination model to obtain the byte offset of the image information in the video information.

7. The method according to claim 1, characterized in that, The image information represents the image obtained by capturing images of objects in the environment where the head-mounted device is located; Obtaining the video information corresponding to the image information includes: Send a video information acquisition request to a preset cloud, wherein the video information acquisition request includes the image information; The system receives video information from the cloud based on the video information acquisition request; the video information includes the image information.

8. The method according to any one of claims 1 to 7, characterized in that, There are multiple video information corresponding to the image information, and playing the video information includes: The video information is displayed at different locations on the display interface of the head-mounted device; Obtain the gaze direction of the wearer of the head-mounted device; Play video information that is opposite to the direction of the line of sight.

9. The method according to any one of claims 1 to 7, characterized in that, Controlling the first image acquisition device to acquire images and obtain image information includes: Obtain the gaze direction of the wearer of the head-mounted device; The first image acquisition device is controlled to move towards the line of sight to acquire images.

10. A video playback device, characterized in that, Applied to a head-mounted device, the head-mounted device being equipped with a first image acquisition device, the device comprising: The control module is used to control the first image acquisition device to acquire images and obtain image information in response to video playback commands; The acquisition module is used to acquire the video information corresponding to the image information; The playback module is used to play the video information.

11. A head-mounted device, characterized in that, The device includes a processor and a memory, the memory storing computer-executable instructions that can be executed by the processor, the processor executing the computer-executable instructions to implement the video playback method according to any one of claims 1 to 9.

12. A storage medium, characterized in that, The storage medium stores computer-executable instructions, which, when invoked and executed by a processor, cause the processor to implement the video playback method according to any one of claims 1 to 9.

13. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the video playback method according to any one of claims 1 to 9.

Images