Video playing method and device
By collecting information on the user's facial orientation and movement, the VR video playback perspective can be adjusted directly through facial and body movements, solving the problem of insufficient interactivity in existing VR technologies and enhancing the user's immersion and experience.
Patent Information
- Application Number
- CN202111303353.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-05
- Publication Date
- 2026-02-06
- Estimated Expiration
- 2041-11-05
AI Technical Summary
In existing VR technologies, the way users adjust the video playback perspective lacks interactivity, resulting in reduced user immersion and a poor user experience.
By collecting information about the user's facial orientation and movement, the playback angle of the video can be adjusted directly by changing the facial orientation and body movement, achieving operation without a mouse or touch screen.
It enhances the interactivity and immersion of users when adjusting the video playback perspective, thereby improving the user experience.
Smart Images

Figure CN116095405B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the field of virtual reality technology, and in particular to a video playing method and device. BACKGROUND
[0002] Virtual reality (VR) technology is a technology that can construct a panoramic video by collecting data from the real world. With the progress of VR technology, the panoramic video that can be constructed by VR technology is increasingly close to reality, and VR technology is widely used in daily life. Users can adjust the playing angle of a VR video to watch different areas of the VR video. For example, in the field of real estate sales and real estate decoration, a panoramic video of a house can be constructed by using VR technology, so that users can realize online house viewing through the panoramic video of the house, and users can watch different rooms of the house by adjusting the playing angle of the panoramic video of the house.
[0003] However, in the existing VR technology, the way in which users adjust the playing angle of a video lacks interactivity, resulting in reduced user immersion and poor user experience. SUMMARY
[0004] The present application provides a video playing method and device, which can improve the interactivity when a user adjusts the playing angle of a video. To achieve the above-mentioned purpose, the present application adopts the following technical solutions:
[0005] In a first aspect, the present application provides a video playing method, which comprises: first collecting target information, and then adjusting the playing angle of a video according to the target information. The target information includes user facial orientation information and user movement information, the user facial orientation information is used to represent the direction in which the user's face is oriented, and the user movement information is used to represent the direction in which the user moves.
[0006] In the video playing method provided by the present application, when a user adjusts the playing angle of a video, the user does not need to manipulate a mouse or touch a screen, but can directly change the facial orientation and move the body, so that the playing angle of the video is adjusted according to the user's actions. Therefore, the interactivity when a user adjusts the playing angle of a video is improved, the user's immersion when watching a video is increased, and the user experience is improved.
[0007] In a possible implementation manner, the above-mentioned adjusting the playing angle of a video according to the target information can include: adjusting the orientation of the playing angle according to the user facial orientation information; and adjusting the position of the playing angle according to the user movement information.
[0008] In the video playing method provided by the present application, when adjusting the playing angle of the video, the user can not only change the face orientation to adjust the orientation of the playing angle, but also move to adjust the position of the playing angle. For example, when the user wants to move the orientation of the playing angle of the video upward, the user can adjust the orientation of the playing angle of the video upward by lifting the head. For another example, when the user wants to move the position of the playing angle of the video forward, the user can adjust the position of the playing angle of the video forward by moving forward.
[0009] In a possible implementation, the adjusting the orientation of the playing angle according to the user face orientation information comprises: determining an orientation adjusting direction of the playing angle according to the user face orientation information; and adjusting the orientation of the playing angle according to the orientation adjusting direction and a preset orientation adjusting amount.
[0010] For example, the direction of the user face orientation is downward, and the preset orientation adjusting amount is 30 degrees. The video playing device first determines the orientation adjusting direction of the playing angle to be downward according to the user face orientation information, and then adjusts the orientation of the playing angle downward by 30 degrees.
[0011] Optionally, the user face orientation information can also be used to represent the angle of the user face orientation.
[0012] In another possible implementation, the adjusting the orientation of the playing angle according to the user face orientation information can comprise: determining adjusting information according to the user face orientation information; and adjusting the orientation of the playing angle according to the adjusting information. The adjusting information is used to represent the direction of the adjusted orientation of the playing angle and the angle of the orientation of the playing angle.
[0013] Optionally, the direction of the adjusted orientation of the playing angle can be the same as the direction of the user face orientation.
[0014] Optionally, the angle of the adjusted orientation of the playing angle can be the same as the angle of the user face orientation.
[0015] For example, the user face orientation is upward by 45 degrees, and the current orientation of the playing angle is downward by 30 degrees. The video playing device first determines the adjusted orientation of the playing angle to be upward by 45 degrees according to the user face orientation information, and then adjusts the orientation of the playing angle upward by 75 degrees to adjust the orientation of the playing angle from downward by 30 degrees to upward by 45 degrees. It can be seen that the adjusted orientation of the playing angle (direction and angle) is the same as the user face orientation.
[0016] It can be understood that when a user watches a video played by an electronic device, the face direction of the user is usually directly to the screen of the electronic device. After the user changes the face direction, the face direction of the user can no longer be directly to the screen of the electronic device. Therefore, the user can not continue to watch the video played by the electronic device after changing the face direction.
[0017] To this end, the user can adjust the orientation of the playing view angle in a manner of changing the face direction and returning to the original face direction. That is, the user can first change the face direction and then return to the original face direction (hereinafter referred to as a returning process). During the process of changing the face direction, the video playing device can generate user face direction information according to the face direction of the user, and then adjust the orientation of the playing view angle according to the information. During the returning process, the video playing device does not generate user face direction information according to the face direction of the user, and does not adjust the orientation of the playing view angle.
[0018] In a possible implementation, adjusting the position of the playing view angle according to the user movement information comprises: determining a position adjustment direction of the playing view angle according to the user movement information; and adjusting the position of the playing view angle according to the position adjustment direction and a preset position adjustment amount.
[0019] For example, the user moves forward, and the preset movement adjustment amount is N. The video playing device first determines that the position adjustment direction of the playing view angle is forward according to the user movement information, and then adjusts the position of the playing view angle by N forward.
[0020] Optionally, the user movement information further represents a distance of the movement of the user.
[0021] In another possible implementation, adjusting the position of the playing view angle according to the user movement information comprises: determining a position adjustment direction and a position adjustment distance of the playing view angle according to the user movement information; and adjusting the position of the playing view angle according to the position adjustment direction and the position adjustment distance.
[0022] Optionally, there can be a conversion relationship between the position adjustment distance and the user movement distance, which can be: position adjustment distance = user movement distance * (second distance / first distance). Wherein, the first distance is the vertical distance between the user and the boundary of the first target region in the user movement direction, the second distance is the vertical distance between the position of the playing view angle and the boundary of the second target region in the user movement direction, the second region is a two-dimensional plane region corresponding to the video, * is a multiplication sign, and / is a division sign. For example, the user movement distance is 30, the first distance is 100, and the second distance is 200, and then the position adjustment distance is 30 * (200 / 100) = 60.
[0023] Exemplarily, taking the user moving M1 backward as an example. The video playing device first determines, according to the user movement information, that the position adjustment direction of the playing perspective is to be adjusted backward by a distance M2, and then adjusts the position of the playing perspective backward by M2.
[0024] wherein M2=M1*(a / b), a is the first distance, i.e. the vertical distance between the user and the first region boundary at the rear, and b is the second distance, i.e. the vertical distance between the position of the playing perspective and the second region boundary at the rear.
[0025] It can be understood that if the user adjusts the orientation of the playing perspective by changing the face orientation and returning to the normal, the second distance corresponding to the same user movement direction before and after adjusting the orientation of the playing perspective can change. Therefore, the user can change the orientation of the playing perspective by changing the face orientation and returning to the normal after moving to the boundary of the first region so as to watch other positions of the video.
[0026] In a possible manner, the collecting target information can include: collecting the target information by a collecting unit, the collecting unit including at least one of an image collecting unit, a sound collecting unit or an infrared collecting unit.
[0027] In another possible implementation manner, the collecting target information can include: receiving collecting information sent by a collecting device, the collecting information including the target information.
[0028] In a second aspect, the present application further provides a video playing device, which includes a processing unit, the processing unit being configured to: collect target information, the target information including user face orientation information and user movement information, the user face orientation information being used to represent the direction of the user face orientation, and the user movement information being used to represent the direction of the user movement; and adjust the playing perspective of the video according to the target information.
[0029] In a possible implementation manner, the processing unit is specifically configured to: adjust the orientation of the playing perspective according to the user face orientation information; and adjust the position of the playing perspective according to the user movement information.
[0030] In a possible implementation manner, the processing unit is specifically configured to: determine the orientation adjustment direction of the playing perspective according to the user face orientation information; and adjust the orientation of the playing perspective according to the orientation adjustment direction and a preset orientation adjustment amount.
[0031] Optionally, the user face orientation information can also be used to represent the angle of the user face orientation.
[0032] In another possible implementation manner, the processing unit is specifically configured to: determine adjustment information according to the user face orientation information, the adjustment information being used to represent a direction of an adjusted orientation of the play view and an angle of the adjusted orientation of the play view; and adjust the orientation of the play view according to the adjustment information.
[0033] Optionally, the direction of the adjusted orientation of the play view and the direction of the user face orientation can be the same.
[0034] Optionally, the angle of the adjusted orientation of the play view and the angle of the user face orientation can be the same.
[0035] In a possible implementation manner, the processing unit is specifically configured to: determine a position adjustment direction of the play view according to the user movement information; and adjust the position of the play view according to the position adjustment direction and a preset position adjustment amount.
[0036] Optionally, the user movement information is also used to represent a distance of user movement.
[0037] In another possible implementation manner, the processing unit is specifically configured to: determine a position adjustment direction and a position adjustment distance of the play view according to the user movement information; and adjust the position of the play view according to the position adjustment direction and the position adjustment distance.
[0038] Optionally, there can be a conversion relationship between the position adjustment distance and the user movement distance, and the conversion relationship can be: position adjustment distance = user movement distance * (second distance / first distance).
[0039] In a possible implementation manner, the processing unit is specifically configured to: acquire the target information by an acquisition unit, the acquisition unit including at least one of an image acquisition unit, a sound acquisition unit or an infrared acquisition unit.
[0040] In another possible implementation manner, the processing unit is specifically configured to: receive acquisition information sent by an acquisition device, the acquisition information including the target information.
[0041] In a third aspect, the present application further provides a video playing device, which includes: at least one processor, when the at least one processor executes program code or instructions, the method in the first aspect or any possible implementation manner thereof is implemented.
[0042] Optionally, the video playing device can further include at least one memory, the at least one memory being used to store the program code or instructions.
[0043] In a fourth aspect, the present application provides a chip, comprising: an input interface, an output interface, and at least one processor. Optionally, the chip further comprises a memory. The at least one processor is configured to execute code in the memory, and when the at least one processor executes the code, the chip implements the method in the first aspect or any possible implementation manner thereof.
[0044] Optionally, the chip can be an integrated circuit.
[0045] In a fifth aspect, the present application provides an electronic device, comprising the video playing apparatus or the chip.
[0046] Optionally, the electronic device can be a smart screen.
[0047] In a sixth aspect, the present application provides a computer readable storage medium for storing a computer program, the computer program comprising instructions for implementing the method in the first aspect or any possible implementation manner thereof.
[0048] In a seventh aspect, the present application provides a computer program product comprising instructions which, when executed on a computer, cause the computer to carry out the method in the first aspect or any possible implementation manner thereof.
[0049] The video playing apparatus, the electronic device, the computer storage medium, the computer program product and the chip provided by the embodiments have the beneficial effects of the video playing method provided above, and thus the beneficial effects of the video playing method provided above are referred to here, and will not be described again. BRIEF DESCRIPTION OF DRAWINGS
[0050] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can also be obtained without creative labor.
[0051] Figure 1 FIG. 1 is a structural schematic diagram of an electronic device provided by an embodiment of the present application;
[0052] Figure 2 FIG. 2 is a software structural schematic diagram of an electronic device provided by an embodiment of the present application;
[0053] Figure 3 FIG. 3 is a user interface schematic diagram of an electronic device provided by an embodiment of the present application;
[0054] Figure 4 FIG. 4 is another user interface schematic diagram of an electronic device provided by an embodiment of the present application;
[0055] Figure 5 Another user interface diagram of an electronic device according to an embodiment of the present invention is provided;
[0056] Figure 6 A diagram of a viewer activity area according to an embodiment of the present invention is provided;
[0057] Figure 7 A diagram of generating a second area according to an embodiment of the present invention is provided;
[0058] Figure 8 A mapping diagram of a first area and a second area according to an embodiment of the present invention is provided;
[0059] Figure 9 Another mapping diagram of a first area and a second area according to an embodiment of the present invention is provided;
[0060] Figure 10 Another mapping diagram of a first area and a second area according to an embodiment of the present invention is provided;
[0061] Figure 11 Another mapping diagram of a first area and a second area according to an embodiment of the present invention is provided;
[0062] Figure 12 A flow diagram of a video playing method according to an embodiment of the present invention is provided;
[0063] Figure 13 A structural diagram of an apparatus according to an embodiment of the present invention is provided;
[0064] Figure 14 Another structural diagram of an apparatus according to an embodiment of the present invention is provided;
[0065] Figure 15 A structural diagram of a chip according to an embodiment of the present invention is provided. DETAILED DESCRIPTION
[0066] The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are only some of the embodiments of the present invention, but not all the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present invention.
[0067] The term "and / or" in this document merely describes an association relationship of associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the three cases of A alone, A and B together, and B alone.
[0068] The terms "first" and "second" and the like in the description of the present application and in the accompanying drawings are used to distinguish different objects or different processing of the same object, rather than to describe a specific order of the objects.
[0069] In addition, the terms "comprising" and "having" and any variations thereof mentioned in the description of the present application are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but can optionally include other steps or units not listed, or can optionally include other steps or units inherent to the process, method, product or device.
[0070] It should be noted that in the description of the embodiments of the present application, the words "exemplarily" or "for example" are used to represent as an example, illustration or description. Any embodiment or design scheme described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, the words "exemplarily" or "for example" are intended to present the relevant concept in a specific manner.
[0071] In the description of the present application, unless otherwise specified, "a plurality of" means two or more.
[0072] In daily life, a user can watch different areas of a VR video by adjusting a play view angle of the VR video. For example, in the field of real estate sales and real estate decoration, a panoramic video of a house can be constructed by using VR technology, so that a user can realize online house viewing by using the panoramic video of the house, and the user can watch different rooms of the house by adjusting a play view angle of the panoramic video of the house.
[0073] However, in the existing VR technology, the user adjusts the play view angle of the video mainly by operating a mouse or a touch screen, and these ways of adjusting the play view angle of the video lack interactivity, thereby reducing the user's immersion and resulting in poor user experience.
[0074] Therefore, the embodiments of the present application provide a video playing method, which can improve the interactivity when a user adjusts a play view angle of a video.
[0075] The video playing method provided by the embodiments of the present application can be applied to electronic devices with a video (panoramic video) playing function, such as a smart screen, a mobile phone, a tablet computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and the like. The embodiments of the present application do not make any limitation on the specific type of the electronic device.
[0076] Exemplarily, Figure 1 is a structural schematic diagram of an electronic device 100 provided by an embodiment of the present application. The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0077] It can be understood that the structure illustrated by the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than illustrated, or combine certain components, or split certain components, or different component arrangements. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.
[0078] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices, or can be integrated in one or more processors.
[0079] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of instruction fetching and instruction execution.
[0080] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0081] The I2C interface is a bidirectional synchronous serial bus, and the processor 110 can be coupled to the touch sensor 180K through the I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 100. The MIPI interface can be used to connect the processor 110 and peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display screen serial interface (DSI), etc. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to realize the shooting function of the electronic device 100. The processor 110 and the display screen 194 communicate through the DSI interface to realize the display function of the electronic device 100.
[0082] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a limitation on the structure of the electronic device 100. In other embodiments of the present application, the electronic device 100 can also use different interface connection methods or combinations of multiple interface connection methods in the above embodiments.
[0083] The charging management module 140 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. The power management module 141 is configured to connect the battery 142 and the charging management module 140. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.
[0084] The electronic device 100 implements a display function through a GPU, the display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is configured to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information.
[0085] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diode (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.
[0086] The electronic device 100 can implement a photographing function through an ISP, the camera 193, a touch sensor, a video codec, a GPU, a display screen 194, and an application processor.
[0087] The ISP is configured to process data fed back by the camera 193. For example, when taking a photo, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also optimize algorithms for image noise, brightness, and skin color. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be disposed in the camera 193.
[0088] The camera 193 is configured to capture still images or videos. An object projects an optical image through a lens to a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into a standard image signal in RGB, YUV, or the like format. It should be understood that, in the description of the embodiments of the present application, the image in RGB format is taken as an example for illustration, and the embodiments of the present application do not limit the image format. In some embodiments, the electronic device 100 can include one or N cameras 193, where N is a positive integer greater than 1.
[0089] The digital signal processor is configured to process digital signals, in addition to processing digital image signals, and can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is configured to perform Fourier transform on the frequency point energy, and the like.
[0090] The video codec is configured to compress or decompress digital videos. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, and the like.
[0091] The external memory interface 120 can be configured to connect an external memory card, such as a Micro SD card, to extend the storage capacity of the electronic device 100. The internal memory 121 can be configured to store computer executable program codes, including instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. The internal memory 121 can include a program storage area and a data storage area.
[0092] The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, and the like. For example, music playing, recording, and the like.
[0093] The pressure sensor 180A is configured to sense a pressure signal and convert the pressure signal into an electrical signal. The gyro sensor 180B is configured to determine a motion posture of the electronic device 100. The barometric sensor 180C is configured to measure a barometric pressure. The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can detect opening and closing of a flip cover using the magnetic sensor 180D. The acceleration sensor 180E is configured to detect an acceleration of the electronic device 100 in each direction (typically, three axes). The distance sensor 180F is configured to measure a distance. The electronic device 100 can measure a distance using infrared or laser. In some embodiments, the electronic device 100 can measure a distance using the distance sensor 180F to achieve fast focus when capturing a scene. The proximity sensor 180G can include, for example, a light emitting diode (LED) and a photo detector, such as a photodiode. The ambient light sensor 180L is configured to sense an ambient light brightness. The electronic device 100 can adaptively adjust a display screen 194 brightness according to the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust white balance when capturing an image. The fingerprint sensor 180H is configured to capture a fingerprint. The electronic device 100 can use the captured fingerprint characteristics to implement fingerprint unlocking, access application locking, fingerprint image capturing, fingerprint call answering, and the like. The temperature sensor 180J is configured to detect a temperature. The touch sensor 180K, also referred to as a "touch panel," can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 can form a touch screen, also referred to as a "touch panel." The touch sensor 180K is configured to detect a touch operation applied thereto or in the vicinity thereof. The bone conduction sensor 180M can obtain a vibration signal. The audio module 170 can obtain a voice signal based on the vibration signal of a bone conduction vibration block obtained by the bone conduction sensor 180M, and implement a voice function.
[0094] The keys 190 include a power key, a volume key, and the like. The keys 190 can be mechanical keys. Alternatively, the keys 190 can be touch keys. The electronic device 100 can receive a key input and generate a key signal input related to user settings and function control of the electronic device 100. The motor 191 can generate a vibration prompt. The motor 191 can be used for incoming call vibration prompting and touch vibration feedback. For example, a touch operation applied to different applications (e.g., image capturing, audio playing, and the like) can correspond to different vibration feedback effects. A touch operation applied to different regions of the display screen 194 can also correspond to different vibration feedback effects. The indicator 192 can be an indicator light configured to indicate a charging state, a power change, and the like, and can also be used to indicate a message, a missed call, a notification, and the like. The SIM card interface 195 is configured to connect a SIM card.
[0095] The software system of the electronic device 100 can employ a layered architecture, an event-driven architecture, a microkernel architecture, a microservices architecture, or a cloud architecture. Embodiments of the present disclosure exemplarily illustrate the software structure of the electronic device 100 by taking a layered architecture operating system as an example.
[0096] Figure 2 is a software structure block diagram of the electronic device 100 of an embodiment of the present disclosure. The layered architecture divides the software into several layers, each of which has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom, the application layer, the application framework layer, the operating system runtime and system library, and the kernel layer.
[0097] The application layer can include a series of application packages. As shown in Figure 2 , the application packages can include camera, photo album, music, settings, and other applications.
[0098] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer. The application framework layer includes some pre-defined functions. As shown in Figure 2 , the application framework layer can include a window manager, a content provider, a view system, a resource manager, a notification manager, and the like.
[0099] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, and take screenshots, etc.
[0100] The content provider is used to store and obtain data, and make the data accessible to the applications. The data can include videos, images, audios, dialed and received calls, browsing history and bookmarks, phone books, and the like.
[0101] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and the like. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.
[0102] The resource manager provides various resources for the applications, such as localized strings, icons, pictures, layout files, video files, and the like.
[0103] The notification manager enables an application to display notification information in a status bar, which can be used to convey a message of an informing type, and the notification information displayed in the status bar can automatically disappear after a short stay, for example, a message prompt informing a user of the completion of a download, etc. The notification manager can also be a notification appearing in the form of a graph or a scroll bar text in the top status bar of the system, for example, a notification of an application running in the background, and can also be a notification appearing in the form of a dialog window on the screen. For example, the notification manager can display text information in the status bar, or can also issue a prompt sound, for example, a vibration of the electronic device, a flashing of an indicator light, etc.
[0104] The runtime includes a core library and a virtual machine. The runtime is responsible for scheduling and management of the operating system. The core library includes two parts: one part is a function function required to be called by the java language, and the other part is the core library of the operating system.
[0105] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and the application framework layer into binary files. The virtual machine is used to perform the management of the object life cycle, the stack management, the thread management, the security and exception management, and the garbage collection, etc.
[0106] The system library can include a plurality of functional modules. For example: a surface manager, media libraries, a three-dimensional graphics processing library (for example: an open graphics library (OpenGL) embedded system (ES)), a 2D graphics engine (for example: a scene graph library (SGL)), etc.
[0107] The surface manager is used to manage the display subsystem, and provides a plurality of applications with the fusion of 2D and 3D layers.
[0108] The media library supports a plurality of commonly used audio, video format playback and recording, and static image files, etc. The media library can support a plurality of audio and video coding formats, for example: moving pictures experts group (MPEG) 4, H.264, MP3, advanced audio coding (AAC), adaptibve multi rate (AMR), joint photographic experts group (JPG), portable network graphics (PNG), etc.
[0109] The three-dimensional graphics processing library is used to implement three-dimensional graphics drawing, image rendering, composition, and layer processing, etc. The 2D graphics engine is a drawing engine for 2D drawing.
[0110] The kernel layer is a layer between hardware and software. The kernel layer can include hardware driver modules such as display drivers, camera drivers, sensor drivers, etc., and the application framework layer can call the hardware driver modules of the kernel layer.
[0111] For ease of understanding, the following embodiments of the present application will take an electronic device with the structure shown in FIGS. 1 and 2 as an example to introduce the video playing method provided by the embodiments of the present application. Figure 1 and Figure 2 The video playing method provided by the embodiments of the present application is introduced by taking an electronic device with the structure shown in FIGS. 1 and 2 as an example.
[0112] The technical solutions involved in the following embodiments can be implemented in the electronic device 100 with the hardware architecture and the software architecture described above.
[0113] The technical solutions provided by the embodiments of the present application are described in detail by taking the electronic device 100 as a smart screen and in combination with the accompanying drawings.
[0114] Figure 3 is a graphical user interface (GUI) schematic diagram provided by the embodiments of the present application, Figure 3 The screen display system of the smart screen shows the interface content currently output, which is the main interface of the smart screen. The interface content shows multiple application programs (Apps), such as VR, clock, calendar, gallery, memo, etc. It can be understood that the interface content can also include more application programs, which are not limited by the embodiments of the present application.
[0115] The user can instruct the smart screen to start the VR application by touching a specific control on the screen of the smart screen, pressing a specific physical button or button combination, inputting voice, air gesture, etc. In response to receiving the instruction of the user to start the VR application, the smart screen starts the VR application.
[0116] For example, the user can click the "VR" application icon on the main interface by operating the remote controller of the smart screen to instruct the smart screen to start the VR application.
[0117] For another example, the user can instruct the smart screen to start the VR application and display the VR application interface by voice instruction (such as "open the VR application").
[0118] The user can play various videos through the VR application interface. The above-mentioned videos include but are not limited to VR videos, panoramic videos, VR panoramic videos, VR real scene videos, or 3D panoramic videos.
[0119] As shown in Figure 4 , the VR application is a VR house viewing application, and the user can instruct the smart screen to play a 3D panoramic video of a house through the application to view the interior of the house. It can be understood that the VR application can also be other VR applications, and the user can also play other videos through the VR application, such as videos of scenic spots, videos of shopping malls, or other videos.
[0120] The specific method of generating the above video can be processed by any method that can be thought of by those skilled in the art, and the embodiments of the present application do not make specific limitations thereto. For example, the video is generated by collecting real scene images through a panoramic camera.
[0121] As shown in Figure 5 , the user can also instruct the smart screen to play a preview navigation map (also referred to as a VR panoramic video navigation map) of the video, and the user can determine the position and orientation of the current play view within the entire video through the preview navigation map. The preview navigation map is a plan view for indicating the position and orientation of the current play view within the entire video.
[0122] As shown in Figure 6 , when the user wants to adjust the play view of the video, the user can indicate the play view of the VR application video by moving in the viewer activity area (hereinafter referred to as the first area). The first area can be an area defined in front of an electronic device (such as a smart screen) to limit the user's viewing of the video, which is usually a rectangular area where the user's position and the user's face orientation can be clearly captured by the collection device (such as a camera). The user's position in the first area is referred to as the viewer position.
[0123] Optionally, the initial position of the play view can be the center of the second area. The initial orientation of the play view can be forward. The second area is a two-dimensional planar area corresponding to the video.
[0124] Optionally, as shown in Figure 7 , the second area can be generated according to the maximum length and maximum width of the graph corresponding to the video. Wherein, Figure 7 The left side is the graph corresponding to the video, Figure 7 The right side is the second area.
[0125] As shown in Figure 8As shown, in the first area, the user is watching a video of the house through the smart screen in front of them. When the user wants to move the playback viewpoint of the video forward, the user can move forward M1 in the first area. The smart screen obtains the user's movement information (i.e., information used to characterize the user's movement direction and distance) through a collection device (such as a camera) and measures the distance between the user and the boundary of the first area in front (hereinafter referred to as the first distance) as a. Then, the smart screen obtains the distance between the current viewpoint position and the boundary of the second area in front (hereinafter referred to as the second distance) as b. After that, the smart screen first determines the position adjustment direction of the playback viewpoint to be forward based on the user's movement information, and then determines the position adjustment distance of the playback viewpoint as M1*(a / b) = M2 based on the user's movement information, the first distance and the second distance. Finally, the playback viewpoint of the video is moved forward M2.
[0126] For example, such as Figure 9 As shown, in the first area, a user is watching a video of their home through a smart screen in front of them. When the user wants to move the video playback angle 90 degrees to the left, they can rotate their face 90 degrees to the left in the first area. The smart screen obtains the user's facial orientation information (i.e., information representing the direction and angle of the user's face) through a data acquisition device. Then, the smart screen first determines the direction of the playback angle adjustment to the left based on the user's facial orientation information, then determines the angle of the playback angle adjustment to 90 degrees based on the user's facial orientation information, and finally adjusts the video playback angle 90 degrees to the left. Figure 9 As can be seen, before the adjustment, the playback view was facing the left side of the second area. After adjusting the playback view to the left by 90 degrees, the playback view is now facing the front of the second area.
[0127] Understandably, users can also adjust the viewing angle of the video by turning their face up or down (i.e., looking up or down).
[0128] For example, such as Figure 10 As shown, in the first area, the user is watching a video of the house through the smart screen in front of them. When the user wants to move the video playback viewpoint backward, the user can move backward by M3 in the first area. The smart screen obtains the user's movement information through the acquisition device and measures the distance between the user and the boundary of the first area behind them as 'a'. Then, the smart screen obtains the distance between the current viewpoint position and the boundary of the second area behind them as 'b'. After that, the smart screen first determines the direction of the playback viewpoint adjustment to be backward based on the user's movement information, and then determines the playback viewpoint adjustment distance as M3*(a / b) = M4 based on the user's movement information, the first distance, and the second distance. Finally, the playback viewpoint position of the video is moved backward by M4.
[0129] For example, such asFigure 11 As shown in FIG. 1, a user is watching a video of a house through the smart screen in front of the first region, when the user wants to move the playing perspective position of the video to the right, the user can move M5 to the right in the first region, the smart screen obtains the user movement information through the acquisition device and measures the distance between the user and the right boundary of the first region as a, then the smart screen obtains the distance between the current perspective position and the right boundary of the second region as b, then the smart screen first determines that the adjustment direction of the playing perspective position is to the right according to the user movement information, then determines the adjustment distance of the playing perspective position as M5*(a / b)=M6 according to the user movement information, the first distance and the second distance, and finally moves the playing perspective position of the video backward by M6.
[0130] The specific method of collecting the user face orientation information, collecting the user movement information and measuring the distance can be any method that can be thought of by those skilled in the art, and the embodiments of the present application do not make specific limitations thereon. For example, the user face orientation information and the user movement information can be collected by infrared detection, wearable sensors, indoor positioning, etc.
[0131] The smart screen can also simulate events (such as touch gesture events, voice events, etc.) to adjust the playing perspective of the video according to the user face orientation information and the user movement information.
[0132] Exemplarily, the VR application supports left swipe, right swipe, up swipe, down swipe, double-click touch gesture events to adjust the playing perspective of the video. Among them, the left swipe touch gesture event corresponds to adjusting the orientation of the playing perspective to the right, the right swipe touch gesture event corresponds to adjusting the orientation of the playing perspective to the left, the up swipe touch gesture event corresponds to adjusting the orientation of the playing perspective downward, the down swipe touch gesture event corresponds to adjusting the orientation of the playing perspective upward, and the double-click touch gesture event corresponds to adjusting the position of the playing perspective forward. When the user watches the video through the VR application, the smart screen can collect and simulate the above-mentioned touch gesture events to adjust the playing perspective of the video according to the user face orientation information and the user movement information. For example, the user face orientation information collected by the smart screen indicates that the direction of the user's face orientation is upward (i.e. lifting the head), then the smart screen can simulate the down swipe touch gesture event according to the information, thereby adjusting the orientation of the playing perspective upward. For another example, the user movement information collected by the smart screen indicates that the direction of the user's movement is forward, then the smart screen can simulate the double-click touch gesture event according to the information, thereby adjusting the position of the playing perspective forward.
[0133] The video playing method provided by the embodiments of the present application will be described in detail below with reference to the accompanying drawings.
[0134] As shown in FIG. 1, the embodiments of the present application provide a video playing method, which comprises: Figure 12 As shown in FIG. 1, the embodiments of the present application provide a video playing method, which comprises:
[0135] S1201, the video playing apparatus collects target information.
[0136] The target information includes user face orientation information and user movement information, the user face orientation information is used to represent a direction of the user face orientation, and the user movement information is used to represent a direction of the user movement.
[0137] In a possible manner, the video playing apparatus can collect the target information through a collecting unit, and the collecting unit includes at least one of an image collecting unit, a sound collecting unit, or an infrared collecting unit.
[0138] In another possible implementation manner, the video playing apparatus can receive collecting information sent by a collecting apparatus. The collecting information includes the target information.
[0139] Optionally, the user face orientation information can also be used to represent an angle of the user face orientation.
[0140] Optionally, the user movement information can also be used to represent a distance of the user movement.
[0141] S1202, the video playing apparatus adjusts a playing perspective of a video according to the target information.
[0142] In a possible implementation manner, the video playing apparatus can first adjust a direction of the playing perspective according to the user face orientation information, and then adjust a position of the playing perspective according to the user movement information.
[0143] In a possible implementation manner, the adjusting the direction of the playing perspective according to the user face orientation information includes: determining a direction adjustment direction of the playing perspective according to the user face orientation information; and adjusting the direction of the playing perspective according to the direction adjustment direction and a preset direction adjustment amount.
[0144] For example, the direction of the user face orientation is downward, and the preset direction adjustment amount is 30 degrees. The video playing apparatus first determines the direction adjustment direction of the playing perspective as downward according to the user face orientation information, and then adjusts the direction of the playing perspective by 30 degrees downward.
[0145] In another possible implementation manner, the adjusting the direction of the playing perspective according to the user face orientation information can include: determining adjustment information according to the user face orientation information; and adjusting the direction of the playing perspective according to the adjustment information. The adjustment information is used to represent a direction of the adjusted direction of the playing perspective and an angle of the adjusted direction of the playing perspective.
[0146] Optionally, the direction of the adjusted direction of the playing perspective can be the same as the direction of the user face orientation.
[0147] Optionally, the angle of the adjusted direction of the playing perspective can be the same as the angle of the user face orientation.
[0148] For example, taking the case that the user's face orientation is 45 degrees upward and the current viewing angle orientation is 30 degrees downward. The video playing device first determines the adjusted viewing angle orientation to be 45 degrees upward according to the user's face orientation information, and then adjusts the viewing angle orientation upward by 75 degrees to adjust the viewing angle orientation from 30 degrees downward to 45 degrees upward. It can be seen that the adjusted viewing angle orientation (direction and angle) is the same as the user's face orientation.
[0149] It can be understood that when the user watches the video played by the electronic device, the user's face orientation is usually directly facing the screen of the electronic device. After the user changes the face orientation, the user's face orientation can no longer be directly facing the screen of the electronic device. Therefore, the situation that the user cannot continue to watch the video played by the electronic device after changing the face orientation can occur.
[0150] To this end, the user can adjust the viewing angle orientation in the manner of changing the face orientation and returning to the original face orientation. That is, the user can first change the face orientation, and then return to the original face orientation (hereinafter referred to as the returning process). During the process of changing the face orientation, the video playing device can generate the user's face orientation information according to the user's face orientation, and then adjust the viewing angle orientation according to the information. During the returning process, the video playing device does not generate the user's face orientation information according to the user's face orientation, and does not adjust the viewing angle orientation.
[0151] In a possible implementation, the above-mentioned adjusting the position of the viewing angle according to the user movement information comprises: determining the position adjustment direction of the viewing angle according to the user movement information; and adjusting the position of the viewing angle according to the position adjustment direction and a preset position adjustment amount.
[0152] For example, taking the case that the user moves forward and the preset movement adjustment amount is N. The video playing device first determines the position adjustment direction of the viewing angle to be forward according to the user movement information, and then adjusts the position of the viewing angle forward by N.
[0153] In another possible implementation, the adjusting the position of the viewing angle according to the user movement information comprises: determining the position adjustment direction of the viewing angle and the position adjustment distance of the viewing angle according to the user movement information; and adjusting the position of the viewing angle according to the position adjustment direction and the position adjustment distance.
[0154] Optionally, there can be a conversion relationship between the position adjustment distance and the user movement distance, which can be: position adjustment distance = user movement distance * (second distance / first distance). Wherein, the first distance is the vertical distance between the user and the first target region boundary in the user movement direction, the second distance is the vertical distance between the position of the play view and the second target region boundary in the user movement direction, the second region is a two-dimensional plane region corresponding to the video, * is multiplication, and / is division. For example, the user movement distance is 30, the first distance is 100, and the second distance is 200, and then the position adjustment distance is 30 * (200 / 100) = 60.
[0155] Exemplarily, taking the user moving backward by M1 as an example. The video playing device first determines the position adjustment direction of the play view to be backward adjustment distance M2 according to the user movement information, and then adjusts the position of the play view backward by M2.
[0156] Wherein, M2 = M1 * (a / b), a is the first distance, i.e., the vertical distance between the user and the first region boundary behind, and b is the second distance, i.e., the vertical distance between the position of the play view and the second region boundary behind.
[0157] It can be understood that if the user adjusts the orientation of the play view by changing the facial orientation and returning to the normal, the second distance corresponding to the same user movement direction before and after adjusting the orientation of the play view can change. Therefore, the user can change the orientation of the play view by changing the facial orientation and returning to the normal after moving to the boundary of the first region so as to watch other positions of the video.
[0158] For example, Figure 9 In the case where the user's facial orientation is not rotated 90 degrees to the left, the user's face and the play view are both forward, and if the user moves backward, the second distance used in calculating the position movement distance of the play view is the vertical distance between the position of the play view and the second region boundary behind. After the user's facial orientation is rotated 90 degrees to the left and returned to the normal, the user's face is forward but the play view is right, and if the user moves backward, the second distance used in calculating the position movement distance of the play view is no longer the vertical distance between the position of the play view and the second region boundary behind, but the vertical distance between the position of the play view and the second region boundary to the left.
[0159] It can be seen that in the video playing method provided by the application, the user can directly change the facial orientation and move the body to adjust the play view of the video according to the user's action without manipulating the mouse or touch screen, thereby improving the interaction when the user adjusts the play view of the video, increasing the immersion when the user watches the video, and improving the user experience.
[0160] The embodiment of the present application further provides a video playing device, which comprises a processing unit, and the processing unit is used for: collecting target information, wherein the target information comprises user face orientation information and user movement information, the user face orientation information is used for representing a direction of user face orientation, and the user movement information is used for representing a direction of user movement; and adjusting a playing perspective of a video according to the target information.
[0161] In a possible implementation, the processing unit is specifically used for: adjusting the direction of the playing perspective according to the user face orientation information; and adjusting the position of the playing perspective according to the user movement information.
[0162] In a possible implementation, the processing unit is specifically used for: determining a direction adjustment direction of the direction of the playing perspective according to the user face orientation information; and adjusting the direction of the playing perspective according to the direction adjustment direction and a preset direction adjustment amount.
[0163] Optionally, the user face orientation information can also be used for representing an angle of user face orientation.
[0164] In another possible implementation, the processing unit is specifically used for: determining adjustment information according to the user face orientation information, wherein the adjustment information is used for representing a direction of the direction of the adjusted playing perspective and an angle of the direction of the playing perspective; and adjusting the direction of the playing perspective according to the adjustment information.
[0165] Optionally, the direction of the direction of the adjusted playing perspective can be the same as the direction of the user face orientation.
[0166] Optionally, the angle of the direction of the adjusted playing perspective can be the same as the angle of the user face orientation.
[0167] In a possible implementation, the processing unit is specifically used for: determining a position adjustment direction of the position of the playing perspective according to the user movement information; and adjusting the position of the playing perspective according to the position adjustment direction and a preset position adjustment amount.
[0168] Optionally, the user movement information can also be used for representing a distance of user movement.
[0169] In another possible implementation, the processing unit is specifically used for: determining a position adjustment direction and a position adjustment distance of the position of the playing perspective according to the user movement information; and adjusting the position of the playing perspective according to the position adjustment direction and the position adjustment distance.
[0170] Optionally, a conversion relationship can exist between the position adjustment distance and the distance of user movement, and the conversion relationship can be: position adjustment distance = distance of user movement * (second distance / first distance).
[0171] In a possible implementation, the processing unit is specifically configured to: collect the target information by a collecting unit, the collecting unit comprising at least one of an image collecting unit, a sound collecting unit or an infrared collecting unit.
[0172] In another possible implementation, the processing unit is specifically configured to: receive the collected information sent by the collecting device, the collected information comprising the target information.
[0173] The following will be described in combination with Figure 13 and Figure 14 introduce an electronic device for executing the video playing method.
[0174] It can be understood that, in order to implement the above functions, the electronic device comprises hardware and / or software modules corresponding to the functions. The algorithm steps of each example described in combination with the embodiments disclosed herein can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is implemented in hardware or computer software driven hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered beyond the scope of the present application.
[0175] The embodiments of the present application can divide the functional modules of the electronic device according to the above method examples, for example, each functional module can be divided corresponding to each function, or two or more functions can be integrated in one processing module. The integrated module can be realized in the form of hardware. It should be noted that the division of modules in the present embodiment is illustrative, and is only a logical functional division. When actually implemented, there can be another division manner.
[0176] In the case of dividing each functional module corresponding to each function, Figure 13 a possible composition schematic diagram of the electronic device involved in the above embodiments is shown, as Figure 13 shown, the device 1300 can include a transceiver unit 1301 and a processing unit 1302, the processing unit 1302 can implement the method performed by the electronic device in the above method embodiments, and / or other processes for the technology described herein.
[0177] It should be noted that all related contents of each step involved in the above method embodiments can be cited to the functional description of the corresponding functional module, which will not be described here.
[0178] When using integrated units, device 1300 may include a processing unit, a storage unit, and a communication unit. The processing unit can be used to control and manage the operation of device 1300, for example, to support device 1300 in executing the steps performed by the aforementioned units. The storage unit can be used to support device 1300 in executing stored program code and / or data. The communication unit can be used to support communication between device 1300 and other devices.
[0179] The processing unit can be a processor or a controller. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this invention. The processor can also be a combination of functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage unit can be a memory. The communication unit can specifically be a radio frequency circuit, a Bluetooth chip, a wireless fidelity (Wi-Fi) chip, or a device that interacts with other electronic devices.
[0180] In one possible implementation, the electronic device involved in the embodiments of the present invention can be a device having Figure 14 The apparatus 1400 shown includes a processor 1401 and a transceiver 1402. Figure 13 The functions implemented by the transceiver unit 1301 and the processing unit 1302 can be implemented by the processor 1401.
[0181] Optionally, the device 1400 may also include a memory 1403, and the processor 1401 and the memory 1403 communicate with each other through an internal connection path. Figure 13 The relevant functions implemented by the storage unit in the memory can be implemented by the memory 1403.
[0182] This invention also provides a computer storage medium storing computer instructions. When these computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the video playback method described in the above embodiments.
[0183] This invention also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the video playback method described in the above embodiments.
[0184] The embodiment of the present application further provides an electronic device, which can be a chip, an integrated circuit, an assembly or a module. Specifically, the device can include a processor and a memory for storing instructions, or the device includes at least one processor for obtaining instructions from an external memory. When the device is running, the processor can execute the instructions to enable the chip to perform the video playing method in the above method embodiments.
[0185] Figure 15 A structural diagram of a chip 1500 is shown. The chip 1500 includes one or more processors 1501 and interface circuit 1502. Optionally, the chip 1500 can further include a bus 1503.
[0186] The processor 1501 can be an integrated circuit chip with a processing capability of signals. In the implementation process, the steps of the above video playing method can be completed by integrated logic circuits of hardware in the processor 1501 or instructions in the form of software.
[0187] Optionally, the processor 1501 can be a general processor, a digital signal processing (DSP) processor, an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component. The disclosed methods and steps in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor.
[0188] The interface circuit 1502 can be used for sending or receiving data, instructions or information. The processor 1501 can process the data, instructions or other information received by the interface circuit 1502, and can send the processed information out through the interface circuit 1502.
[0189] Optionally, the chip further includes a memory, which can include a read-only memory and a random access memory, and provides operation instructions and data for the processor. Part of the memory can further include a non-volatile random access memory (NVRAM).
[0190] Optionally, the memory stores executable software modules or data structures, and the processor can perform corresponding operations by calling operation instructions stored in the memory (the operation instructions can be stored in an operating system).
[0191] Optionally, the chip can be used in the electronic device or the DOP related to the embodiments of the present application. Optionally, the interface circuit 1502 can be used to output the execution result of the processor 1501. The video playing method provided by one or more embodiments of the present application can refer to the foregoing embodiments, which will not be described here.
[0192] It should be noted that the functions of the processor 1501 and the interface circuit 1502 can be realized by hardware design, software design or a combination of hardware and software, which will not be limited here.
[0193] The electronic device, the computer storage medium, the computer program product or the chip provided by the embodiments of the present application are used to execute the corresponding method provided above, and thus the beneficial effects achieved thereby can refer to the beneficial effects of the corresponding method provided above, which will not be described here.
[0194] The embodiments of the present application further provide a terminal device, which comprises the electronic device described above. Optionally, the terminal device is a vehicle or a smart robot, etc.
[0195] It should be understood that, in various embodiments of the present application, the size of the sequence number of the processes described above does not mean the order of execution, and the execution order of the processes should be determined according to their functions and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0196] Those skilled in the art can realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.
[0197] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the system, device and unit described above can refer to the corresponding processes in the foregoing method embodiments, which will not be described here.
[0198] In several embodiments provided by the present application, it should be understood that the disclosed system, device and method can be implemented in other manners. For example, the described device embodiments are merely schematic. The units as divided can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electrical, mechanical or other forms.
[0199] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, i.e., they can be located in one place, or distributed on multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
[0200] In addition, the functional units in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically, or two or more units can be integrated into one unit.
[0201] If the above functions are realized in the form of software function units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the part of the prior art that contributes to the technical solutions or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), magnetic disk or optical disk, and various media that can store program codes.
[0202] The first application in the embodiments of the present application is an application related to audio content. Alternatively, the first application can also be extended to an application related to video content or an application related to audio and video content.
[0203] The above is merely a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A video playing method, characterized in that, The method comprises: collecting target information, the target information comprising user face orientation information and user movement information, the user face orientation information being used to represent a direction of user face orientation, and the user movement information being used to represent a user movement direction; adjusting a playing perspective of a video according to the target information; the adjusting of the playing perspective of the video according to the target information comprises: adjusting an orientation of the playing perspective according to the user face orientation information; adjusting a position of the playing perspective according to the user movement information; the user movement information is also used to represent a user movement distance, and the adjusting of the position of the playing perspective according to the user movement information comprises: determining a position adjustment direction of the playing perspective and a position adjustment distance of the playing perspective according to the user movement information; adjusting the position of the playing perspective according to the position adjustment direction and the position adjustment distance; wherein a conversion relationship exists between the position adjustment distance and the user movement distance, and the conversion relationship is: position adjustment distance = user movement distance × (second distance / first distance); wherein the first distance is a vertical distance between the user and a first region boundary in the user movement direction, the second distance is a vertical distance between the position of the playing perspective and a second region boundary in the user movement direction, the first region is a viewer active region, and the second region is a two-dimensional plane region corresponding to the video.
2. The method of claim 1, wherein, the adjusting of the orientation of the playing perspective according to the user face orientation information comprises: determining an orientation adjustment direction of the playing perspective according to the user face orientation information; adjusting the orientation of the playing perspective according to the orientation adjustment direction and a preset orientation adjustment amount.
3. The method of claim 1, wherein, the face orientation information is also used to represent an angle of user face orientation, and the adjusting of the orientation of the playing perspective according to the user face orientation information comprises: determining adjustment information according to the user face orientation information, the adjustment information being used to represent a direction of an adjusted orientation of the playing perspective and an angle of the orientation of the playing perspective; adjusting the orientation of the playing perspective according to the adjustment information.
4. The method according to any one of claims 1 to 3, characterized in that, the adjusting of the position of the playing perspective according to the user movement information further comprises: determining a position adjustment direction of the playing perspective according to the user movement information; adjusting the position of the playing perspective according to the position adjustment direction and a preset position adjustment amount.
5. The method according to any one of claims 1 to 4, characterized in that, the collecting of the target information comprises: collecting the target information by a collection unit, the collection unit comprising at least one of an image collection unit, a sound collection unit or an infrared collection unit.
6. The method according to any one of claims 1 to 4, characterized in that, the collecting of the target information comprises: receiving collection information sent by a collection device, the collection information comprising the target information.
7. A video playback device, comprising: a processing unit is comprised, and the processing unit is used to: collect target information, the target information comprising user face orientation information and user movement information, the user face orientation information being used to represent a direction of user face orientation, and the user movement information being used to represent a user movement direction; adjust a playing perspective of a video according to the target information; the processing unit is specifically used to: adjust the orientation of the play perspective according to the user face orientation information; adjust the position of the play perspective according to the user movement information; the user movement information is also used to represent a user movement distance, and the processing unit is specifically configured to: determine a position adjustment direction and a position adjustment distance of the play perspective according to the user movement information; adjust the position of the play perspective according to the position adjustment direction and the position adjustment distance; wherein there is a conversion relationship between the position adjustment distance and the user movement distance, and the conversion relationship is: position adjustment distance = user movement distance × (second distance / first distance); wherein the first distance is a vertical distance between the user and a first region boundary in a user movement direction; the second distance is a vertical distance between the position of the play perspective and a second region boundary in the user movement direction; and the first region is a viewer active region, and the second region is a two-dimensional plane region corresponding to the video.
8. The apparatus of claim 7, wherein, the processing unit is specifically configured to: determine an orientation adjustment direction of the play perspective according to the user face orientation information; adjust the orientation of the play perspective according to the orientation adjustment direction and a preset orientation adjustment amount.
9. The apparatus of claim 7, wherein, the face orientation information is also used to represent an angle of the user face orientation, and the processing unit is specifically configured to: determine adjustment information according to the user face orientation information, the adjustment information being used to represent a direction of the adjusted orientation of the play perspective and an angle of the orientation of the play perspective; adjust the orientation of the play perspective according to the adjustment information.
10. The apparatus of any one of claims 7 to 9, wherein, the processing unit is specifically configured to: determine a position adjustment direction of the play perspective according to the user movement information; adjust the position of the play perspective according to the position adjustment direction and a preset position adjustment amount.
11. The apparatus of any one of claims 7 to 10, wherein, the processing unit is specifically configured to: acquire the target information through an acquisition unit, the acquisition unit including at least one of an image acquisition unit, a sound acquisition unit, or an infrared acquisition unit.
12. The apparatus of any one of claims 7-10, wherein, the processing unit is specifically configured to: receive acquisition information sent by an acquisition device, the acquisition information including the target information. 13.A chip device, comprising a memory and a processor, the memory being coupled with the processor, the memory storing a code, and the processor being configured to execute the code, when the code is executed, implementing the method in any one of claims 1 to 6.
14. A computer readable storage medium for storing a computer program, characterized in that, The computer program includes instructions for implementing the method in any one of claims 1 to 6.
15. A computer program product, comprising instructions therein, wherein the computer program product is characterised in that, When the instructions are run on a computer or a processor, the computer or the processor implements the method in any one of claims 1 to 6.
16. An electronic device, comprising: The video playing device includes any one of claims 7 to 12.
17. The electronic device of claim 16, wherein, The electronic device is a smart screen. The electronic device is a smart screen.
Citation Information
Patent Citations
View adjusting method and device for panoramic video
CN106412424A
Virtual tourism method, client, server, system and image acquisition device
CN110673734A