Image processing method and device and terminal equipment

Abstract

The present application is applicable to the technical field of image processing, and provides an image processing method, the image processing method is applied to a terminal device, the terminal device can acquire a panoramic spherical image, the image processing method comprises: acquiring human body orientation data, the human body orientation data being data for representing human body orientation; determining a target area in the panoramic spherical image according to the human body orientation data; and outputting the image picture corresponding to the target area, namely, the terminal equipment can accurately output the image picture expected to be seen by the user.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to an image processing method, apparatus and terminal device. Background Art

[0002] Currently, panoramic images / videos are increasingly used in various fields, such as entertainment, tourism, and medical treatment. However, there are still some defects in the use of panoramic images / videos.

[0003] For example, when a terminal device displays a panoramic image / video, although the panoramic image / video is shot based on a 360° shooting angle, a general terminal device can only present a flat image within a small viewing angle range. Currently, the terminal device cannot accurately output the image that the user expects to see. Summary of the invention

[0004] The embodiments of the present application provide an image processing method, apparatus and terminal device, which can solve the problem that the current terminal device cannot accurately output the image screen that the user expects to see.

[0005] In a first aspect, the present application provides an image processing method, which is applied to a terminal device, and the terminal device is capable of acquiring a panoramic spherical image. The image processing method comprises: acquiring human body orientation data, wherein the human body orientation data is data used to represent the orientation of a human body; determining a target area in the panoramic spherical image according to the human body orientation data; and outputting an image screen corresponding to the target area.

[0006] In a possible implementation of the first aspect, determining the target area in the panoramic spherical image according to the human body orientation data includes: determining an orientation adjustment range according to the human body orientation data; determining a target orientation of a virtual camera in a horizontal plane direction according to the orientation adjustment range, the virtual camera being a virtual camera set by the terminal device at the center of a sphere corresponding to the panoramic spherical image; and determining the target area in the panoramic spherical image according to the target orientation.

[0007] In a possible implementation of the first aspect, before determining the target orientation of the virtual camera in the horizontal plane direction according to the orientation adjustment range, it includes: acquiring human hand motion data, wherein the human hand motion data is used to represent the movement of the hand in the human body; correspondingly, determining the target orientation of the virtual camera in the horizontal plane direction according to the orientation adjustment range includes: determining the target orientation of the virtual camera in the horizontal plane direction according to the human hand motion data and the orientation adjustment range.

[0008] In a possible implementation of the first aspect, the human hand motion data includes hand recognition data, and the hand recognition data is used to indicate whether the moving hand in the human body is the left hand or the right hand. Correspondingly, determining the target orientation of the virtual camera in the horizontal plane direction based on the human hand motion data and the orientation adjustment range includes: determining the target rotation direction based on the hand recognition data; determining the target orientation of the virtual camera in the horizontal plane direction based on the determined target rotation direction and the orientation adjustment range.

[0009] In a possible implementation of the first aspect, the human hand motion data includes hand recognition data. Correspondingly, determining the target orientation of the virtual camera in the horizontal plane direction based on the human hand motion data and the orientation adjustment range includes: determining the orientation adjustment speed based on the hand recognition data; determining the target orientation of the virtual camera in the horizontal plane direction based on the orientation adjustment speed and the orientation adjustment range.

[0010] In a possible implementation of the first aspect, determining the direction adjustment speed according to the hand recognition data includes: determining a target rotation direction according to the hand recognition data, wherein determining the target rotation direction according to the hand recognition data includes: if the hand recognition data specifically indicates that the hand moving in the human body is the left hand, then determining the target rotation direction as a counterclockwise rotation direction; or, if the hand recognition data is specifically used to indicate that the hand moving in the human body is the right hand, then determining the target rotation direction as a clockwise rotation direction; determining the direction adjustment speed according to the determined target rotation direction and a specified relationship, wherein the specified relationship is v(a)=ke fsig。a , wherein v(a) is used to represent the orientation adjustment speed, k is a preset coefficient, a is used to represent the angle between the current orientation of the virtual camera in the horizontal plane and the human body orientation represented by the human body orientation data, and if the determined target rotation direction is counterclockwise, fsig is equal to 1; if the determined target rotation direction is clockwise, fsig is equal to -1.

[0011] In a second aspect, an embodiment of the present application provides an image processing device, which is applied to a terminal device, and the terminal device is capable of acquiring a panoramic spherical image. The image processing device includes: a first data acquisition unit, used to acquire human body orientation data, and the human body orientation data is data used to represent the orientation of a human body; an area determination unit, used to determine a target area in the panoramic spherical image according to the human body orientation data; and an output unit, used to output an image screen corresponding to the target area.

[0012] In a possible implementation of the second aspect, when the area determination unit executes the determination of the target area in the panoramic spherical image according to the human body orientation data, it is specifically used to: determine an orientation adjustment range according to the human body orientation data; determine a target orientation of a virtual camera in a horizontal plane direction according to the orientation adjustment range, wherein the virtual camera is a virtual camera set by the terminal device at the center of a sphere corresponding to the panoramic spherical image; and determine the target area in the panoramic spherical image according to the target orientation.

[0013] In a third aspect, an embodiment of the present application provides a terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the methods described in the first aspect when executing the computer program.

[0014] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of the first aspects above is implemented.

[0015] In an embodiment of the present application, the terminal device is able to obtain human body orientation data, and then determine a target area in a panoramic spherical image based on the human body orientation data, and output an image corresponding to the target area. Since the human body orientation data is data used to represent the human body orientation, the user can control the orientation of his or her own body to influence the terminal device to determine the target area in the panoramic spherical image, thereby enabling the terminal device to accurately output the image that the user expects to see. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the specific implementation methods of the present application or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0017] Figure 1 is a flowchart of an image processing method provided by an embodiment of the present application;

[0018] Figure 2 This is provided by an embodiment of the present application: "When fsig is equal to 1, v(a) = ke fsig。a "Image of";

[0019] Figure 3 This is provided by an embodiment of the present application: "When fsig is equal to -1, v(a) = ke fsig。a "Image of";

[0020] Figure 4 is a schematic diagram of an image processing device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0021] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0022] It should be noted that the terms "comprises" and "has" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product or equipment comprising a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to these processes, methods, products or equipment.

[0023] It should be noted that the terms "first", "second", etc. in the specification and claims of this article and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of this article described here can be implemented in an order other than those illustrated or described here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, device, product or equipment that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or equipment.

[0024] It should be noted that when an element is referred to as being "fixed to" or "disposed on" another element, it may be directly on the other element or there may be an intermediate element. When an element is considered to be "connected to" another element, it may be directly connected to the other element or there may be an intermediate element at the same time.

[0025] In this article, the term "and / or" is only a description of the association relationship between related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the related objects before and after are in an "or" relationship.

[0026] Embodiment 1

[0027] Figure 1A flow chart of an image processing method provided by an embodiment of the present application is shown, and the image processing method is applied to a terminal device, and the terminal device can obtain a panoramic spherical image. As an example but not a limitation, the terminal device is a panoramic camera or a mobile phone, and a display screen may be provided on the terminal device. The image processing method includes: step S101, step S102, and step S103. The details are as follows:

[0028] Step S101: Acquire human body orientation data, where the human body orientation data is data used to represent human body orientation.

[0029] As an example but not limitation, a human body image is obtained, where the human body image is an image obtained by photographing a human body, and human body orientation data is determined through the human body image, where the human body orientation is: a direction parallel to the median sagittal plane of the (user) body and pointing to the front of the human body; or, human body orientation data input by a user is obtained.

[0030] Step S102: determining a target area in the panoramic spherical image according to the human body orientation data.

[0031] As an example but not a limitation, the panoramic spherical image is a result of mapping an image captured by a fisheye lens of a panoramic camera onto a specified spherical model.

[0032] For example, when the terminal device is a panoramic camera, before executing step S102, the panoramic camera includes: photographing the surrounding environment through the panoramic camera's own fisheye lens to obtain a panoramic spherical image; when the terminal device is a mobile phone, before executing step S102, the mobile phone includes: obtaining the panoramic spherical image sent by the panoramic camera.

[0033] Specifically, the step S102 may include: determining a target orientation of the virtual camera in a horizontal plane direction according to the human body orientation data, and determining a target area in the panoramic spherical image according to the target orientation.

[0034] The virtual camera is a virtual camera set by the terminal device at the center of the sphere corresponding to the panoramic spherical image, that is, a virtual camera is set at the center of the sphere of the specified spherical model, and the virtual camera is used to determine the target area, that is, to determine the image screen (content) required to be output by the terminal device. Specifically, the target orientation of the virtual camera in the horizontal plane direction is determined according to the human body orientation data, and the target area in the panoramic spherical image determined according to the target orientation may include: forming a field of view according to the target orientation and a preset field of view angle, the field of view intersects with the panoramic spherical image, and the intersecting area is the target area in the panoramic spherical image.

[0035] Optionally, the step S102 includes: determining the human body orientation represented by the human body orientation data as a target orientation of the virtual camera in a horizontal plane direction, and determining a target area in the panoramic spherical image according to the target orientation.

[0036] Optionally, step S102 includes: determining an orientation adjustment range according to the human body orientation data; determining a target orientation of the virtual camera in a horizontal plane direction according to the orientation adjustment range, and determining a target area in the panoramic spherical image according to the target orientation. That is, in the present application, the target orientation of the virtual camera can be limited within the orientation adjustment range, thereby effectively improving the orientation adjustment efficiency.

[0037] As an example but not limitation, the human body orientation represented by the human body orientation data is the middle value of the orientation adjustment range, the upper limit A1 of the orientation adjustment range differs from the middle value A2 by a specified angle A0, and the middle value A2 differs from the lower limit A3 of the orientation adjustment range by a specified angle A0, and A0 is greater than 0, that is, the following relationship is satisfied: A1=A2+A0; A3=A2-A0.

[0038] Specifically, the following example can be given: the terminal device establishes a plane rectangular coordinate system, which takes the midpoint between the optical centers of the two fisheye lenses of the panoramic camera as the origin, and determines the human body orientation represented by the human body orientation data as the positive direction of the first axis of the plane rectangular coordinate system, the second axis of the plane rectangular coordinate system is perpendicular to the first axis, and the positive direction of the second axis is the direction extending to the right side of the first axis, and the plane formed by the first axis and the second axis is parallel to the horizontal plane. In the plane rectangular coordinate system, assuming that the positive direction of the second axis corresponds to 0 degrees, the human body orientation represented by the human body orientation data can be determined as 90 degrees, that is, the angle between the human body orientation and the positive direction of the second axis is 90 degrees, and correspondingly, the middle value of the orientation adjustment range is equal to 90 degrees. Assuming that the specified angle is 90 degrees, the upper limit A1 of the orientation adjustment range is equal to 180 degrees, and the lower limit A3 of the orientation adjustment range is equal to 0 degrees, that is, the orientation adjustment range is [0, 180] degrees.

[0039] Optionally, before determining the target orientation of the virtual camera in the horizontal plane according to the orientation adjustment range, it includes: obtaining human hand motion data, the human hand motion data is used to represent the situation of the moving hand in the human body; correspondingly, determining the target orientation of the virtual camera in the horizontal plane according to the orientation adjustment range includes: determining the target orientation of the virtual camera in the horizontal plane according to the human hand motion data and the orientation adjustment range. That is, in this application, the user can adjust the orientation of the virtual camera through the motion control of the human hand.

[0040] As an example but not limitation, the human hand motion data may include at least one of the following data: hand motion duration, hand recognition data, and hand motion distance, wherein the hand motion time is the length of time of the hand movement in the human body, the hand recognition data is used to indicate whether the hand moving in the human body is the left hand or the right hand, and the hand motion distance is used to indicate the distance of the hand movement in the human body.

[0041] In some embodiments, the obtaining of human hand motion data includes: if a specified human motion is detected, obtaining the human hand motion data, that is, the specified human motion can trigger the terminal device to adjust the direction of the virtual camera.

[0042] As an example but not limitation, the specified human body motion may be any of the following: raising a foot, raising an arm, or extending a finger.

[0043] Optionally, the human hand motion data includes the hand motion duration, and correspondingly, determining the target orientation of the virtual camera in the horizontal plane direction according to the orientation adjustment range includes: adjusting the orientation of the virtual camera in the horizontal plane direction within the orientation adjustment range according to the hand motion duration to obtain an adjustment result, and the adjustment result is the target orientation of the virtual camera in the horizontal plane direction. In this way, the orientation adjustment efficiency (the efficiency of adjusting the orientation of the virtual camera) can be flexibly controlled.

[0044] Optionally, the human hand motion data includes hand recognition data, and correspondingly, determining the target orientation of the virtual camera in the horizontal plane direction according to the human hand motion data and the orientation adjustment range includes: determining the target rotation direction according to the hand recognition data, and determining the target orientation of the virtual camera in the horizontal plane direction according to the determined target rotation direction and the orientation adjustment range. That is, in this embodiment, the terminal device can determine the rotation direction according to the hand recognition data, thereby improving the efficiency of orientation adjustment.

[0045] The target rotation direction is the direction in which the virtual camera is to be rotated, and the rotation of the virtual camera can change the orientation of the virtual camera. The target rotation direction can be a clockwise rotation direction or a counterclockwise rotation direction.

[0046] As an example but not limitation, if the hand recognition data is specifically used to indicate that the hand moving in the human body is identified as the left hand, the target rotation direction is determined to be a counterclockwise rotation direction; if the hand recognition data is specifically used to indicate that the hand moving in the human body is identified as the right hand, the target rotation direction is determined to be a clockwise rotation direction.

[0047] In some embodiments, the human hand motion data includes hand recognition data, and correspondingly, determining the target orientation of the virtual camera in the horizontal plane direction according to the human hand motion data and the orientation adjustment range includes: determining the orientation adjustment speed according to the hand recognition data; determining the target orientation of the virtual camera in the horizontal plane direction according to the orientation adjustment speed and the orientation adjustment range. That is, in this embodiment, the terminal device can determine the orientation adjustment speed according to the hand recognition data, thereby improving the orientation adjustment efficiency.

[0048] The orientation adjustment speed is the speed of adjusting the orientation of the virtual camera.

[0049] As an example but not limitation, the orientation adjustment speed is determined based on the hand recognition data; the orientation of the virtual camera in the horizontal plane is adjusted within the orientation adjustment range based on the orientation adjustment speed, and when it is detected that the hand corresponding to the hand recognition data stops moving, the adjustment is stopped, thereby obtaining an adjustment result, which is the target orientation of the virtual camera in the horizontal plane.

[0050] In some embodiments, determining the direction adjustment speed according to the hand recognition data includes: determining the target rotation direction according to the hand recognition data, wherein determining the target rotation direction according to the hand recognition data includes: if the hand recognition data specifically indicates that the hand moving in the human body is the left hand, then the target rotation direction is determined to be a counterclockwise rotation direction; or, if the hand recognition data is specifically used to indicate that the hand moving in the human body is the right hand, then the target rotation direction is determined to be a clockwise rotation direction; determining the direction adjustment speed according to the determined target rotation direction and a specified relationship, wherein the specified relationship is v(a)=ke fsig。a , wherein v(a) is used to represent the orientation adjustment speed, k is a preset coefficient, a is used to represent the angle between the orientation of the current virtual camera in the horizontal plane and the human body orientation represented by the human body orientation data, and if the determined target rotation direction is counterclockwise, fsig is equal to 1; if the determined target rotation direction is clockwise, fsig is equal to -1.

[0051] As an example but not limitation, k may be equal to π / 10 (rad / s). When the orientation of the current virtual camera in the horizontal plane direction is to the left of the human body orientation represented by the human body orientation data, a is a negative number, and when the orientation of the current virtual camera in the horizontal plane direction is to the right of the human body orientation represented by the human body orientation data, a is a positive number. a is used to represent the angle between the orientation of the current virtual camera in the horizontal plane direction and the human body orientation represented by the human body orientation data, that is, a can be used to represent the angle between the orientation of the current virtual camera in the horizontal plane direction and the direction corresponding to the middle value of the orientation adjustment range.

[0052] In this embodiment, if the target rotation direction is determined to be a counterclockwise rotation direction, the relationship between v(a) and a can be as follows: Figure 2 As shown, Figure 2 The content is "When fsig is equal to 1, v(a) = ke fsig。a ", it can be seen that when the determined target rotation direction is determined to be a counterclockwise rotation direction, it means that the image screen that the user wants the terminal device to output corresponds to the environment on the left side of the user / the environment close to the left side of the user. When the current virtual camera's orientation in the horizontal plane direction is relatively far from the target orientation, the orientation adjustment speed is relatively fast, thereby improving the orientation adjustment efficiency; as the virtual camera gradually rotates counterclockwise, the current virtual camera's orientation in the horizontal plane direction is closer and closer to the target orientation. In this case, the orientation adjustment speed will become slower, thereby being able to accurately achieve the orientation adjustment of the virtual camera.

[0053] If the target rotation direction is determined to be clockwise, the relationship between v(a) and a can be as follows: Figure 3 As shown, Figure 3 The content is "When fsig is equal to -1, v(a) = ke fsig。a ", it can be seen that when the determined target rotation direction is determined to be a clockwise rotation direction, it means that the image screen that the user wants the terminal device to output corresponds to the environment on the right side of the user / the environment close to the right side of the user. When the current virtual camera's orientation in the horizontal plane direction is relatively far from the target orientation, the orientation adjustment speed is relatively fast, thereby improving the orientation adjustment efficiency; as the virtual camera gradually rotates clockwise, the current virtual camera's orientation in the horizontal plane direction is closer and closer to the target orientation. In this case, the orientation adjustment speed will become slower, thereby being able to accurately achieve the orientation adjustment of the virtual camera.

[0054] Step S103: outputting the image frame corresponding to the target area.

[0055] The image frame corresponding to the target area is a planar image processed based on the target area.

[0056] As an example but not limitation, step S103 may specifically include: controlling the display screen of the terminal device to display the image corresponding to the target area, and the image corresponding to the target area can be used for image preview, video generation, live broadcast and other functions of the panoramic camera.

[0057] In an embodiment of the present application, the terminal device is able to obtain human body orientation data, and then determine a target area in a panoramic spherical image based on the human body orientation data, and output an image corresponding to the target area. Since the human body orientation data is data used to represent the human body orientation, the user can control the orientation of his or her own body to influence the terminal device to determine the target area in the panoramic spherical image, thereby enabling the terminal device to accurately output the image that the user expects to see.

[0058] Embodiment 2

[0059] Corresponding to the image processing method described in the above embodiment, an embodiment of the present application provides an image processing device, which is applied to a terminal device, and the terminal device can acquire a panoramic spherical image. Figure 4 A schematic diagram of an image processing device provided in an embodiment of the present application is shown. The image processing device comprises: a first data acquisition unit 401 , a region determination unit 402 , and an output unit 403 .

[0060] The first data acquisition unit 401 is used to acquire human body orientation data, where the human body orientation data is data used to represent the orientation of a human body.

[0061] The area determination unit 402 is configured to determine a target area in the panoramic spherical image according to the human body orientation data.

[0062] Optionally, when the area determination unit 402 executes the process of determining the target area in the panoramic spherical image according to the human body orientation data, it is specifically used to: determine an orientation adjustment range according to the human body orientation data; determine a target orientation of a virtual camera in a horizontal plane direction according to the orientation adjustment range, the virtual camera being a virtual camera set by the terminal device at the center of a sphere corresponding to the panoramic spherical image; and determine the target area in the panoramic spherical image according to the target orientation.

[0063] Optionally, the image processing device further includes: a second data acquisition unit.

[0064] The second data acquisition unit is used to: before the region determination unit 402 performs the determination of the target orientation of the virtual camera in the horizontal direction according to the orientation adjustment range, obtain human hand motion data, the human hand motion data is used to represent the situation of the moving hand in the human body; correspondingly, when the region determination unit 402 performs the determination of the target orientation of the virtual camera in the horizontal direction according to the orientation adjustment range, it is specifically used to determine the target orientation of the virtual camera in the horizontal direction according to the human hand motion data and the orientation adjustment range. That is, in this application, the user can adjust the orientation of the virtual camera through the motion control of the human hand.

[0065] The output unit 403 is used to output the image frame corresponding to the target area.

[0066] It should be noted that for technical details not fully described in this embodiment, reference may be made to the image processing methods provided in the various embodiments in the above-mentioned embodiment 1.

[0067] Embodiment 3

[0068] The terminal device in this embodiment includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor, and when the processor executes the computer program, the steps in any of the above-mentioned image processing method embodiments are implemented. When the processor executes the computer program, the steps in the above-mentioned image processing method embodiments are implemented, for example Figure 1 Alternatively, when the processor executes the computer program, the functions of each unit in the above-mentioned device embodiments are implemented, for example, Figure 4 Functions of the units 401 to 403 are shown. The terminal device is capable of acquiring a panoramic spherical image.

[0069] Those skilled in the art will understand that this embodiment is merely an example of a terminal device and does not constitute a limitation on the terminal device. The terminal device may include more or fewer components than shown in the figure, or a combination of certain components, or different components, for example, it may also include input and output devices, network access devices, etc.

[0070] The processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0071] In some embodiments, the memory may be an internal storage unit of the terminal device, such as a hard disk or memory of the terminal device. In other embodiments, the memory may also be an external storage device of the terminal device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the terminal device. Further, the memory may also include both an internal storage unit of the terminal device and an external storage device. The memory is used to store an operating system, an application program, a boot loader (BootLoader), data and other programs, such as the program code of the computer program, etc. The memory may also be used to temporarily store data that has been output or is to be output.

[0072] It should be noted that the information interaction, execution process, etc. between the above-mentioned devices / units are based on the same concept as the method embodiment of the present application. Their specific functions and technical effects can be found in the method embodiment part and will not be repeated here.

[0073] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.

[0074] An embodiment of the present application further provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in the above-mentioned method embodiments can be implemented.

[0075] An embodiment of the present application provides a computer program product. When the computer program product runs on a terminal device, the terminal device can implement the steps in the above-mentioned method embodiments when executing the computer program product.

[0076] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying the computer program code to the terminal device, a recording medium, a computer memory, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), an electric carrier signal, a telecommunication signal and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0077] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0078] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0079] In the embodiments provided in the present application, it should be understood that the disclosed devices / network equipment and methods can be implemented in other ways. For example, the device / network equipment embodiments described above are merely schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0080] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0081] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. An image processing method, characterized in that: The image processing method is applied to a terminal device, the terminal device is capable of acquiring a panoramic spherical image, and the image processing method comprises: Acquire human body orientation data, where the human body orientation data is data used to indicate the orientation of a human body; Determine a target area in the panoramic spherical image according to the human body orientation data; Output the image picture corresponding to the target area.

2. The image processing method according to claim 1, characterized in that: The step of determining the target area in the panoramic spherical image according to the human body orientation data comprises: determining an orientation adjustment range according to the human body orientation data; Determining a target orientation of a virtual camera in a horizontal direction according to the orientation adjustment range, the virtual camera being a virtual camera set by the terminal device at the center of a sphere corresponding to the panoramic spherical image; A target area in the panoramic spherical image is determined according to the target orientation.

3. The image processing method according to claim 2, characterized in that: Before determining the target orientation of the virtual camera in the horizontal direction according to the orientation adjustment range, the method includes: Acquire human hand motion data, where the human hand motion data is used to represent the condition of a moving hand in a human body; Correspondingly, determining the target orientation of the virtual camera in the horizontal direction according to the orientation adjustment range includes: The target orientation of the virtual camera in the horizontal plane direction is determined according to the human hand motion data and the orientation adjustment range.

4. The image processing method according to claim 3, characterized in that: The human hand motion data includes hand recognition data, and the hand recognition data is used to indicate whether the moving hand in the human body is the left hand or the right hand. Correspondingly, determining the target orientation of the virtual camera in the horizontal plane direction according to the human hand motion data and the orientation adjustment range includes: determining a target rotation direction according to the hand recognition data; The target orientation of the virtual camera in the horizontal plane direction is determined according to the determined target rotation direction and the orientation adjustment range.

5. The image processing method according to claim 3, characterized in that: The human hand motion data includes hand recognition data. Correspondingly, determining the target orientation of the virtual camera in the horizontal direction according to the human hand motion data and the orientation adjustment range includes: determining a direction adjustment speed according to the hand recognition data; The target orientation of the virtual camera in the horizontal plane direction is determined according to the orientation adjustment speed and the orientation adjustment range.

6. The image processing method according to claim 5, characterized in that: The determining the direction adjustment speed according to the hand recognition data includes: Determining a target rotation direction according to the hand recognition data, wherein determining the target rotation direction according to the hand recognition data includes: if the hand recognition data specifically indicates that the hand moving in the human body is the left hand, determining the target rotation direction as a counterclockwise rotation direction; or, if the hand recognition data specifically indicates that the hand moving in the human body is the right hand, determining the target rotation direction as a clockwise rotation direction; The direction adjustment speed is determined according to the determined target rotation direction and a specified relational expression, wherein the specified relational expression is: Among them, v(a) is used to represent the orientation adjustment speed, k is a preset coefficient, a is used to represent the angle between the current orientation of the virtual camera in the horizontal plane and the human body orientation represented by the human body orientation data, and if the determined target rotation direction is counterclockwise, fsig is equal to 1; if the determined target rotation direction is clockwise, fsig is equal to -1.

7. An image processing device, characterized in that: The image processing device is applied to a terminal device, the terminal device can acquire a panoramic spherical image, and the image processing device includes: A first data acquisition unit, used to acquire human body orientation data, wherein the human body orientation data is data used to represent the orientation of a human body; A region determination unit, configured to determine a target region in the panoramic spherical image according to the human body orientation data; The output unit is used to output the image corresponding to the target area.

8. The image processing device according to claim 7, characterized in that: When the area determination unit executes the determination of the target area in the panoramic spherical image according to the human body orientation data, it is specifically used to: determine the orientation adjustment range according to the human body orientation data; determine the target orientation of the virtual camera in the horizontal plane direction according to the orientation adjustment range, and the virtual camera is a virtual camera set by the terminal device at the center of the sphere corresponding to the panoramic spherical image; determine the target area in the panoramic spherical image according to the target orientation.

9. A terminal device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 6 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images