Image processing, display method, device, equipment and computer storage medium

Abstract

An image processing and display method, device, equipment and computer storage medium. The method comprises: if the mode information indicates a first mode, transmitting a first image of a first resolution to a display component (12) at a first frequency, the first image being composed of a plurality of sub-images of a second resolution (202); if the mode information indicates a second mode, transmitting a second image of a first resolution to the display component (12) at a third frequency, the n second images being used to form a frame of image (203) of the display component (12). The method provides two types of display modes. In one mode, a first image composed of a plurality of sub-images is transmitted to the display component (12), so that the display component (12) can display the sub-images at a faster frequency. In another mode, a frame of image is transmitted to the display component (12) in multiple times, so that the display mode has high flexibility.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to an image processing, display method, device, equipment and computer storage medium. Background Art

[0002] A display device is a device capable of displaying images, which may include a processing component and a display component.

[0003] In an image display method, a processing component in a display device processes an image of a predetermined resolution and transmits the image of the resolution to a display component, which displays the image. When the performance of the processing component (which may include the ability to process and transmit images) is strong, the frequency at which the processing component transmits images to the display component will be faster, and thus the frame rate at which the display component displays images (the frame rate may be the frequency at which the display component displays multiple images) will be higher. When the performance of the processing component is weak, the frequency at which the processing component transmits images to the display component will be slower, and thus the frame rate at which the display component displays images will be lower.

[0004] However, in the above-mentioned image display method, the frame rate of the displayed image is only determined by the performance of the processing component, and the flexibility is low. Summary of the invention

[0005] The embodiments of the present application provide an image display processing, method, device, equipment and computer storage medium. The technical solution is as follows:

[0006] According to one aspect of the present application, there is provided an image display method for a processing component, the method comprising:

[0007] Get mode information;

[0008] If the mode information indicates the first mode, transmitting a first image of a first resolution to the display component at a first frequency, wherein the first image is formed by splicing a plurality of sub-images of a second resolution;

[0009] If the mode information indicates the second mode, the second image of the first resolution is transmitted to the display component at a third frequency, and n second images are used to form a frame of image of the display component, where n≥2.

[0010] Optionally, if the mode information indicates the first mode, transmitting a first image with a first resolution to a display component at a first frequency includes:

[0011] If the mode information indicates the first mode, acquiring a plurality of sub-images with the second resolution;

[0012] The multiple sub-images are stitched into a first image with the first resolution.

[0013] Optionally, if the mode information indicates the second mode, transmitting the second image with the first resolution to the display component at a third frequency includes:

[0014] If the mode information indicates the second mode, acquiring a third image with a third resolution;

[0015] Cropping the third image into n second images with the first resolution;

[0016] The second image of the first resolution is transmitted to the display component at the third frequency.

[0017] Optionally, transmitting the first image with the first resolution to the display component at the first frequency includes:

[0018] generating a first image of the first resolution having a first mode identifier;

[0019] A first image having the first resolution and the first mode identifier is transmitted to the display component.

[0020] Optionally, transmitting the second image with the first resolution to the display component at a third frequency includes:

[0021] generating a second image of the first resolution having a second mode identifier;

[0022] A second image having the first resolution and the second mode identifier is transmitted to the display component.

[0023] Optionally, for a processing component in a virtual reality device, the acquiring mode information includes:

[0024] Get the user's head posture information;

[0025] determining a rotation speed of the head based on the posture information;

[0026] When the rotation speed is greater than a threshold, determining that the mode information is used to indicate the first mode;

[0027] When the rotation speed is less than or equal to the threshold, the mode information is determined to indicate the second mode.

[0028] On the other hand, there is provided an image display method for a display component, the method comprising:

[0029] receiving an image at a first resolution;

[0030] Acquire a mode identifier, where the mode identifier is used to indicate whether the mode is in the first mode or the second mode;

[0031] If in the first mode, split the image as a first image into a plurality of sub-images with a second resolution and display them at a second frequency;

[0032] If in the second mode, receiving n-1 images with the first resolution, where n≥2;

[0033] The received n images of the first resolution are stitched into one frame of image for display.

[0034] Optionally, the acquiring mode identifier includes:

[0035] The mode identifier in the image is obtained.

[0036] Optionally, if in the first mode, splitting the image as a first image into a plurality of sub-images with a second resolution and displaying them at a second frequency includes:

[0037] If in the first mode, cropping the image with the first resolution into a plurality of sub-images with a second resolution;

[0038] The sub-image of the second resolution is stretched into an image of a third resolution and displayed at a second frequency.

[0039] Optionally, after displaying the received n images of the first resolution as n second images in one frame, the method further includes:

[0040] A third image with a third resolution is displayed at a fourth frequency, wherein the third image is composed of n second images, the fourth frequency is less than the second frequency, and the third resolution is greater than the first resolution.

[0041] In another aspect, a display device is provided, the display device comprising: a processing component and a display component;

[0042] The processing component is used to obtain mode information;

[0043] The processing component is used for transmitting a first image of a first resolution to the display component at a first frequency if the mode information indicates a first mode, wherein the first image is formed by splicing a plurality of sub-images of a second resolution;

[0044] The display component is used to display a plurality of second sub-images in the first image at a second frequency, wherein the second frequency is greater than the first frequency;

[0045] The processing component is used for transmitting the second image of the first resolution to the display component at a third frequency if the mode information indicates the second mode;

[0046] The display component is used for splicing the n second images into one frame of image for display after receiving n second images, where n≥2.

[0047] In another aspect, an image processing device is provided for processing a component, the image processing device comprising:

[0048] An acquisition module, used to obtain mode information;

[0049] A first transmission module, configured to transmit a first image of a first resolution to a display component at a first frequency if the mode information indicates a first mode, wherein the first image is formed by splicing a plurality of sub-images of a second resolution;

[0050] A second transmission module is used to transmit a second image of the first resolution to the display component at a third frequency if the mode information indicates a second mode, and n second images are used to constitute a frame of image of the display component, where n≥2.

[0051] In another aspect, an image display device is provided for displaying a component, the image display device comprising:

[0052] A first receiving module, configured to receive an image with a first resolution;

[0053] A determination module, used for acquiring a mode identifier, where the mode identifier is used for indicating whether the mode is in the first mode or the second mode;

[0054] A first display module, configured to, if in the first mode, split the image as a first image into a plurality of sub-images with a second resolution and display them at a second frequency;

[0055] A second receiving module, configured to receive n-1 images of the first resolution if in the second mode, where n≥2;

[0056] The second display module is used to splice the received n images with the first resolution into one frame of image for display.

[0057] On the other hand, an image display device is provided, comprising a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set are loaded and executed by the processor to implement the image display method as described above.

[0058] On the other hand, a computer storage medium is provided, in which at least one instruction, at least one program, code set or instruction set is stored, and the at least one instruction, the at least one program, the code set or instruction set is loaded and executed by a processor to implement the image display method as described above.

[0059] According to another aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the above-mentioned various optional implementations. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0061] Figure 1 is a structural schematic diagram of a display device provided in an embodiment of the present application;

[0062] Figure 2 is a flow chart of an image display method shown in an embodiment of the present application;

[0063] Figure 3 is a flow chart of another image display method shown in an embodiment of the present application;

[0064] Figure 4 is a flow chart of another image display method shown in an embodiment of the present application;

[0065] Figure 5 yes Figure 4 A schematic diagram of a process flow of a first mode in the embodiment shown;

[0066] Figure 6 yes Figure 4 A schematic diagram of a flow chart of a second mode in the embodiment shown;

[0067] Figure 7 yes Figure 4 A schematic diagram of a system flow in the embodiment shown;

[0068] Figure 8 is a structural block diagram of an image processing device provided in an embodiment of the present application;

[0069] Fig. 9It is a structural block diagram of another image display device provided in an embodiment of the present application.

[0070] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0071] In order to make the objectives, technical solutions and advantages of the present application clearer, the implementation methods of the present application will be further described in detail below with reference to the accompanying drawings.

[0072] A display device is a device that has image processing and image display functions, such as Figure 1 , which is a schematic diagram of the structure of a display device provided in an embodiment of the present application. The display device 10 includes a processing component 11 and a display component 12.

[0073] The processing component 11 may include a graphics processing unit (GPU) 111 and a data processor (such as a central processing unit (CPU)) 112. The data processor 112 may receive external data (such as image information) and control the graphics processor 111, and the graphics processor 112 may render and process the image and transmit the image to the display component 12.

[0074] The processing component 11 may be an image processing host.

[0075] The display component 12 may include an image processing integrated circuit (IC) 121 and a display screen 122. The image processing integrated circuit 121 may receive an image transmitted by the graphics processor 111, and transmit the processed image to the display screen 122 for display.

[0076] At present, due to software and other reasons, the resolution of the image output by the image processor 111 is difficult to change. In addition, the processing capability of the processing component 11 for images is limited. Therefore, the resolution of the image output by the image processor 111 to the display component 12 is negatively correlated with the number of images that can be output per unit time. That is, the larger the resolution of the output image, the smaller the number of images output per unit time (the frequency of the processing component transmitting images to the display component will also be correspondingly smaller). Conversely, the smaller the resolution of the output image, the larger the number of images output per unit time (the frequency of the processing component transmitting images to the display component will also be correspondingly higher).

[0077] From the above content, it can be seen that the higher the resolution of the image displayed by the display component, the lower the frequency of displaying the image (this frequency can be called frame rate) will be, and the lower the resolution of the image displayed by the display component, the higher the frequency of displaying the image will be. In addition, since the resolution of the image output by the image processor 111 is difficult to change after leaving the factory, this will cause the resolution and frame rate of the image displayed by the display component 12 to be difficult to adapt to various situations and have low flexibility.

[0078] For example, when the picture is a fast-changing scene (such as a moving scene), if the frame rate of the picture displayed on the display screen is low, such as less than 30 frames, the human eye may feel obvious jerks. When the picture is a relatively static scene, if the resolution of the picture displayed on the display screen is low, the human eye may feel that the picture is relatively blurry. Therefore, when the display device leaves the factory, whether the resolution output by the processing component is a higher resolution to achieve a fine picture of a static scene, or the resolution output by the processing component is a lower resolution to achieve a smooth picture of a dynamic scene, it is difficult to meet the requirements in different situations.

[0079] An embodiment of the present application provides an image processing and display method, which divides or splices images to achieve two display modes: "high frame rate, low resolution" and "high resolution, low frame rate" to meet the needs of different scenarios, thereby greatly improving the display effect and user experience of the display device.

[0080] Figure 2 is a flowchart of an image processing method shown in an embodiment of the present application. In this embodiment, the image processing method is applied to Figure 1 The image processing method may include the following steps:

[0081] Step 201: Obtain mode information.

[0082] Step 202: If the mode information indicates the first mode, transmit a first image with a first resolution to a display component at a first frequency, where the first image is formed by splicing a plurality of sub-images with a second resolution.

[0083] Step 203: If the mode information indicates the second mode, transmit a second image of the first resolution to the display component at a third frequency, and the n second images are used to form a frame of image of the display component.

[0084] Among them, n≥2.

[0085] In summary, the image processing method provided in the embodiment of the present application provides two types of display modes. In one mode, a first image composed of multiple sub-images can be transmitted to the display component so that the display component can display these sub-images at a faster frequency. In the other mode, a frame of image can be sent to the display component in multiple times, so that the display component can display a higher-resolution image at a lower frequency. The display methods are richer and more flexible, which solves the problem of low flexibility of the methods of the related art and achieves the effect of improving the flexibility of the method.

[0086] Figure 3 is a flowchart of another image display method shown in an embodiment of the present application. In this embodiment, the image display method is applied to Figure 1 The image display method may include the following steps:

[0087] Step 301: Receive an image with a first resolution.

[0088] Step 302: Obtain a mode identifier, where the mode identifier is used to indicate whether the device is in the first mode or the second mode.

[0089] Step 303: If in the first mode, split the image as a first image into a plurality of sub-images with a second resolution, and display them at a second frequency.

[0090] Step 304: If in the second mode, receive n-1 images of the first resolution.

[0091] Step 305: stitch the received n images with the first resolution into one frame of image for display.

[0092] Where n≥2

[0093] In summary, the image display method provided in the embodiment of the present application provides two types of display modes. In one mode, a first image composed of multiple sub-images can be transmitted to the display component so that the display component can display these sub-images at a faster frequency. In the other mode, a frame of image can be sent to the display component in multiple times, so that the display component can display a higher-resolution image at a lower frequency. The display methods are richer and more flexible, which solves the problem of low flexibility of the methods in the related art and achieves the effect of improving the flexibility of the image display method.

[0094] Figure 4 is a flowchart of another image display method shown in an embodiment of the present application. In this embodiment, the image display method is applied to Figure 1 The image display method may include the following steps:

[0095] Step 401: The processing component obtains mode information.

[0096] The method provided in the embodiment of the present application can be applied to a virtual reality (VR) device. Figure 1 The display device shown may be part or all of the virtual reality device.

[0097] The virtual reality device may include a processing component and a wearable display, which may include a helmet display or a glasses display, etc. The wearable display may be Figure 1 The display component 12 in the illustrated implementation environment.

[0098] The wearable display may include sensors such as a velocity sensor, an acceleration sensor, and an angular velocity sensor to collect the posture information of the user's head and adjust the image accordingly.

[0099] Optionally, step 401 may include the following sub-steps:

[0100] 1) Obtain the user's head posture information.

[0101] The posture information of the user's head can be collected by the sensor in the display component and transmitted to the processing component.

[0102] The posture information may include various information such as movement information of the user's head.

[0103] 2) Determine the rotation speed of the head based on the posture information.

[0104] The processing component can determine the rotation speed of the user's head based on the posture information, and the rotation speed may include an angular velocity along a certain axis (such as an x-axis perpendicular to the ground).

[0105] 3) When the rotation speed is greater than the threshold, the mode information is determined to indicate the first mode.

[0106] When the rotation speed of the user's head is greater than a threshold, it indicates that the user's head is rotating rapidly. Correspondingly, the picture displayed by the display component will also be in a rapidly changing dynamic scene. At this time, the mode information can be determined to indicate the first mode, which can be a "high frame rate mode".

[0107] The threshold can be determined based on the image processing capability of the processing component and the physical resolution of the display component (the physical resolution is an inherent parameter of the display screen of the display component, which may refer to the maximum number of pixels that can be displayed on the display screen). For example, the stronger the image processing capability of the processing component, the larger the threshold can be, and the larger the physical resolution of the display component, the smaller the threshold can be.

[0108] 4) When the rotation speed is less than or equal to the threshold, the mode information is determined to indicate the second mode.

[0109] When the rotation speed of the user's head is less than or equal to the threshold, it indicates that the user's head is not rotating quickly. Correspondingly, the picture displayed by the display component will also be in a slower and more gentle static scene. At this time, it can be determined that the mode information is used to indicate the second mode, which can be a "high-resolution mode".

[0110] Step 402 : If the mode information indicates the first mode, the processing component transmits a first image of a first resolution to the display component at a first frequency. Execute step 404 .

[0111] The first image is composed of a plurality of sub-images of a second resolution. The first resolution may be a resolution of an image output by a preset processing component. The first frequency may be a frequency determined according to the image processing capability of the processing component. The stronger the image processing capability of the processing component, the higher the first frequency will be, and the weaker the image processing capability of the processing component, the lower the first frequency will be. The first resolution is smaller than the physical resolution of the display screen of the display component, so that in the subsequent second mode, a plurality of second images of the first resolution can constitute a frame of image for display.

[0112] Optionally, step 402 may include:

[0113] 1) If the mode information indicates the first mode, the processing component acquires a plurality of sub-images of the second resolution.

[0114] When in the first mode, the processing component may generate and render a plurality of sub-images at a second resolution.

[0115] The data processor in the processing component can receive or generate image information and transmit the image information to the graphics processor, the image information is used to indicate information of the image to be displayed, and the graphics processor can process the image to be displayed in different ways based on different modes. For example, in the first mode, the processing component can generate multiple sub-images of the second resolution.

[0116] 2) The processing component stitches the multiple sub-images into a first image of a first resolution.

[0117] The second resolution is smaller than the first resolution, and the processing component may stitch a plurality of sub-images of the second resolution into a first image of the first resolution.

[0118] Exemplarily, the second resolution is 540×540, and the number of sub-images is 4, then the first resolution can be 540×2160, that is, 4 sub-images are spliced ​​in the column direction. Of course, the first resolution can also be 1080×1080, and the embodiment of the present application is not limited to this.

[0119] In this way, the processing component can continuously generate the first image and transmit the first image to the display component at the first frequency.

[0120] Optionally, step 402 may further include the following two sub-steps:

[0121] 1) The processing component generates a first image with a first resolution and a first mode identifier.

[0122] The processing component may set a first mode indicator in the first image.

[0123] When the first image is a rectangle, one or more pixels at the four corners of the image will not be displayed when the subsequent display component displays the image, so the processing component can set the first mode flag through the pixels at the corners of the first image.

[0124] Optionally, the processing component represents the first mode identifier by the color of a pixel located in a corner or a graph composed of multiple pixels. Exemplarily, the processing component may set the first pixel in the upper left corner of the first image to a white pixel, and use the white pixel as the first mode identifier. Alternatively, multiple pixels in the upper left corner of the first image may form a graph 1, and use the graph 1 as the first mode identifier.

[0125] 2) The processing component transmits a first image with a first resolution and a first mode identifier to the display component.

[0126] Step 403: If the mode information indicates the second mode, the processing component transmits the second image of the first resolution to the display component at the third frequency. Execute step 404.

[0127] The second image may be a part of a frame of image displayed on the display screen of the display component, and a plurality of second images may constitute a frame of image displayed on the display screen. That is, the first resolution may be one nth of the physical resolution of the display screen, and n second images of the first resolution may constitute a frame of image displayed on the display screen.

[0128] The third resolution may be a preset resolution of an image output by the processing component. The third frequency may be a frequency determined according to the image processing capability of the processing component. The stronger the image processing capability of the processing component, the higher the third frequency will be, and the weaker the image processing capability of the processing component, the lower the third frequency will be.

[0129] Optionally, the first frequency and the third frequency are equal, so that the frequency can be set to the maximum frequency that the image processing capability of the processing component can bear, so as to fully utilize the image processing capability of the processing component.

[0130] Optionally, step 403 may include the following three sub-steps:

[0131] 1) If the mode information indicates the second mode, the processing component acquires a third image with a third resolution.

[0132] In the second mode, the processing component may generate and render a third image of a third resolution based on the received image information or the locally generated image information.

[0133] 2) The processing component crops the third image into n second images of the first resolution.

[0134] The processing component may crop the third image with a larger resolution into n second images with a first resolution.

[0135] 3) The processing component transmits the second image of the first resolution to the display component at a third frequency.

[0136] After acquiring n second images with the first resolution, the processing component may transmit the n second images to the display component at a third frequency.

[0137] Optionally, step 403 may further include the following two sub-steps:

[0138] 1) generating a second image with a first resolution and a second mode identifier;

[0139] The processing component may set a second mode indicator in the second image.

[0140] When the first image is a rectangle, one or more pixels at the four corners of the image will not be displayed when the subsequent display component displays it, so the processing component can represent the second mode identifier through the pixels at the four corners of the first image.

[0141] Optionally, the processing component represents the first mode identifier by the color of the pixels at the four corners or a graph composed of multiple pixels. Exemplarily, the processing component may set the first pixel in the upper left corner of the first image to a black pixel, and use the black pixel as the second mode identifier. Alternatively, multiple pixels in the upper left corner of the first image may form a graph 2, and use the graph 2 as the second mode identifier.

[0142] 2) Transmitting a second image of the first resolution with a second mode identifier to the display component.

[0143] Step 404: The display component receives an image with a first resolution.

[0144] In both types of modes, the display component receives images with the first resolution.

[0145] Step 405: The display component obtains a mode identifier in the image.

[0146] After receiving the image of the first resolution, the image processing IC in the display component can obtain the mode identifier in the image, and determine whether the mode identifier is the first mode identifier or the second mode identifier.

[0147] Step 406: If the mode identifier is the first mode identifier, the display component is determined to be in the first mode. Execute step 408.

[0148] The image processing IC in the display component may determine that the display component is in the first mode when the mode identifier of the received image is the first mode identifier.

[0149] Step 407: If the mode identifier is the second mode identifier, the display component is determined to be in the second mode. Execute step 409.

[0150] The image processing IC in the display component may determine that the display component is in the second mode when the mode identifier of the received image is the second mode identifier.

[0151] Step 408: The display component splits the received image as a first image into a plurality of sub-images with a second resolution, and displays the sub-images at a second frequency.

[0152] In the first mode, the image processing IC in the display component can take the received image as the first image, split the first image into multiple sub-images of the second resolution, and display them at the second frequency. The image processing IC can split the sub-images in a manner corresponding to the arrangement of the sub-images when the processing component generates the first image in step 402. Exemplarily, the first resolution is 540×2160, the number of sub-images is 4, and the second resolution is 540×540. The image processing IC can split the first image into 4 sub-images with a resolution of 540×540, and input these sub-images into the display screen for display at the second frequency.

[0153] Since each first image received by the display component can be split into multiple sub-images and displayed in multiple frames, the second frequency will be greater than the first frequency of the image output by the display component. In this way, the second frequency can be higher, and the frame rate of the image displayed on the display screen will also be higher, for example, it can be greater than or equal to 60 frames, such as 90 frames, 120 frames, 144 frames or 240 frames.

[0154] It should be noted that, since the physical resolution of the display screen is greater than the sub-image of the second resolution, the image processing IC in the display component can first stretch (scaling up) the resolution of the sub-image to be consistent with the physical resolution of the display screen before sending the sub-image of the second resolution to the display screen for display, so as to achieve a better display effect.

[0155] Steps 402, 404, 405 and 408 show the display mode of the first mode, for example, Figure 5 As shown, it is a display schematic diagram of the first mode provided by an embodiment of the present application. Wherein, the physical resolution of the display screen 122 is 2160×2160, then the processing component 11 renders and processes the image with a resolution of 2160×2160 to be displayed at a resolution of 540×540 (it should be noted that the image with a resolution of 2160×2160 to be displayed may not actually exist in the processing component, and the image with a resolution of 540×540 is directly obtained), and 4 images with a resolution of 540×540 (A1, A2, A3 and A4) are obtained, and then these 4 images with a resolution of 540×540 are combined into a first image with a resolution of 540×2160, and the first image is sent to the display component 12, and the image processing IC in the display component 12 stretches each sub-image in the first image to a resolution of 2160×2160 and displays it at a higher second frequency in the display screen 122, thereby realizing a high frame rate display mode.

[0156] The phenomenon of reduced visual sensitivity of the human eye accompanying rapid scanning is called saccadic inhibition. Due to the existence of saccadic inhibition, the human eye is relatively insensitive to the resolution of the image in dynamic scenes, but is more sensitive to the frame rate of the image display. Therefore, at this time, the image can be displayed with a lower resolution and a higher frame rate to improve the user experience.

[0157] Step 409: The display component receives n-1 images of the first resolution.

[0158] Where n≥2. In the second mode, since each second image of the first resolution is a portion (one-nth) of a frame of image displayed on the display screen, the image processing IC in the display component can continue to receive n-1 images of the first resolution, where n≥2.

[0159] Step 410: The display component stitches the received n images with the first resolution into one frame of image for display.

[0160] After receiving n second images of the first resolution, the image processing IC in the display component has completed the reception of one frame of image, and at this time, the n second images can be transmitted to the display screen for display in one frame. During transmission, the image processing IC can transmit the n second images to the display screen one by one for display, or transmit the image formed by splicing the n second images as a whole to the display screen for display.

[0161] Step 411: The display component displays a third image of a third resolution at a fourth frequency.

[0162] That is, in the second mode, the display component can subsequently continue to display the third image of the third resolution at the fourth frequency.

[0163] Among them, the third image is composed of n second images. Since the display component will only display one frame of image every time it receives n second images sent by the processing component at the first frequency, the fourth frequency is smaller than the first frequency, and thus the fourth frequency is also smaller than the second frequency.

[0164] Correspondingly, since each third image is composed of n first-resolution second images, the third resolution will also be greater than the first resolution. Optionally, the third resolution is the sum of n first resolutions. Exemplarily, the first resolution is 540×2160, n is 4, and the third resolution is 2160×2160, which can be equal to the physical resolution of the display screen.

[0165] In the embodiment of the present application, steps 403, 404, 405, 407, 409, 410, and 411 provide a display method of the second mode, for example, Figure 6 As shown, it is a display schematic diagram of the second mode provided by an embodiment of the present application. Wherein, the physical resolution of the display screen 122 is 2160×2160, then the processing component 11 splits the image with a resolution of 2160×2160 to be displayed into 4 images (A1, A2, A3 and A4) with a resolution of 540×2160, and sends these 4 images to the display component 12 at a third frequency, and the image processing IC in the display component 12 can merge these 4 images with a resolution of 540×2160 and restore them to an image with a resolution of 2160×2160 after receiving each of the 4 images with a resolution of 540×2160, and display them on the display screen 122, thereby realizing a high-resolution display mode.

[0166] In a relatively static scene, the human eye is more sensitive to the resolution of the image, but is less sensitive to the frame rate of the image display. Therefore, at this time, the image can be displayed with a higher resolution and a lower frame rate to improve the user experience.

[0167] In summary, the image display method provided in the embodiment of the present application provides two types of display modes. In one mode, a first image composed of multiple sub-images can be transmitted to the display component so that the display component can display these sub-images at a faster frequency. In the other mode, a frame of image can be sent to the display component in multiple times, so that the display component can display a higher-resolution image at a lower frequency. The display methods are richer and more flexible, which solves the problem of low flexibility of the methods in the related art and achieves the effect of improving the flexibility of the image display method.

[0168] In the embodiment of the present application, the display mode to be adopted is determined by whether the head of the person is rotating rapidly. The system flow chart of this method can be as follows: Figure 7 As shown, the sensor of the hardware part can obtain the posture information of the user's head. After the posture information is transmitted to the software part, the software part can determine whether the head is rotating rapidly based on the posture information through data processing. When the head rotates rapidly, it enters the first mode, and when the head does not rotate rapidly, it enters the second mode, and performs image processing (the image processing process can refer to the above embodiment and will not be repeated here), obtains the image to be output, and outputs the image to be output to the display screen of the hardware part for display.

[0169] Through this display method, if the angular velocity of the user's head on a certain axis (such as the x-axis perpendicular to the ground) gradually increases (the head is in a state of starting to rotate) and is greater than a threshold, the first mode can be entered for display; when the angular velocity of the user's head is greater than the threshold and continues to increase to a certain angular velocity and maintains it (the head is in a state of rotating at this time), the first mode can be maintained for display; when the angular velocity of the user's head decreases and is less than the threshold (the head is in a state of stopping rotating at this time), it can be switched to the second mode for display.

[0170] Figure 1 It is a structural block diagram of a display device provided in an embodiment of the present application. The display device 10 includes: a processing component 11 and a display component 12.

[0171] The processing component 11 is used to obtain mode information.

[0172] The processing component 11 is used for transmitting a first image with a first resolution to the display component 12 at a first frequency if the mode information indicates a first mode, wherein the first image is formed by splicing a plurality of sub-images with a second resolution.

[0173] The display component 12 is used to display a plurality of second sub-images in the first image at a second frequency, where the second frequency is greater than the first frequency.

[0174] The processing component 11 is configured to transmit a second image of the first resolution to the display component at a third frequency if the mode information indicates the second mode.

[0175] The display component 12 is used for displaying the n second images as one frame of image after receiving the n second images, where n≥2.

[0176] To summarize, the image display device provided in the embodiment of the present application provides two types of display modes. In one mode, a first image composed of multiple sub-images can be transmitted to a display component so that the display component can display these sub-images at a faster frequency. In the other mode, a frame of image can be sent to the display component in multiple times. In this way, the display component can display a higher-resolution image at a lower frequency. The display methods are richer and more flexible, which solves the problem of low flexibility of the methods of the related art and achieves the effect of improving the flexibility of the image display method.

[0177] Figure 8 is a structural block diagram of an image processing device provided in an embodiment of the present application. The image processing device can be combined with Figure 1 The image processing device 800 includes:

[0178] The acquisition module 810 is used to acquire mode information.

[0179] The first transmission module 820 is configured to transmit a first image of a first resolution to the display component at a first frequency if the mode information indicates a first mode, wherein the first image is formed by splicing a plurality of sub-images of a second resolution.

[0180] The second transmission module 830 is used to transmit a second image of the first resolution to the display component at a third frequency if the mode information indicates the second mode, and n second images are used to form a frame of image of the display component, where n≥2.

[0181] To summarize, the image processing device provided in the embodiment of the present application provides two types of display modes. In one mode, a first image composed of multiple sub-images can be transmitted to the display component so that the display component can display these sub-images at a faster frequency. In the other mode, a frame of image can be sent to the display component in multiple times. In this way, the display component can display a higher-resolution image at a lower frequency. The display methods are richer and more flexible, which solves the problem of low flexibility of the methods of the related art and achieves the effect of improving the flexibility of the image display method.

[0182] Optionally, the first transmission module is used to:

[0183] If the mode information indicates the first mode, acquiring a plurality of sub-images with a second resolution;

[0184] The multiple sub-images are stitched into a first image with a first resolution.

[0185] Optionally, the second transmission module is used to:

[0186] If the mode information indicates the second mode, acquiring a third image with a third resolution;

[0187] Cropping the third image into n second images of the first resolution;

[0188] A second image with a first resolution is transmitted to the display component at a third frequency.

[0189] Optionally, the first frequency and the third frequency are equal.

[0190] Optionally, the first transmission module is used to:

[0191] generating a first image having a first resolution and a first mode identifier;

[0192] A first image having a first resolution and a first mode identifier is transmitted to the display component.

[0193] Optionally, the first mode identifier is located at a corner of the first image.

[0194] Optionally, the second transmission module is used to:

[0195] generating a second image of the first resolution having a second mode identification;

[0196] A second image having a first resolution and a second mode identifier is transmitted to the display component.

[0197] Optionally, the second mode identifier is located at a corner of the second image.

[0198] Optionally, the image processing device is used in a processing component of a virtual reality device, wherein the acquisition module is used to:

[0199] Get the user's head posture information;

[0200] determining a rotation speed of the head based on the posture information;

[0201] When the rotation speed is greater than a threshold, determining the mode information is used to indicate the first mode;

[0202] When the rotation speed is less than or equal to the threshold, the mode information is determined to indicate the second mode.

[0203] Fig. 9 is a structural block diagram of an image display device provided in an embodiment of the present application. The image display device can be combined with Figure 1The image display device 900 includes:

[0204] The first receiving module 910 is configured to receive an image with a first resolution.

[0205] The determination module 920 is used to obtain a mode identifier, where the mode identifier is used to indicate whether the device is in the first mode or the second mode.

[0206] The first display module 930 is configured to, if in the first mode, split the image as a first image into a plurality of sub-images with a second resolution and display them at a second frequency.

[0207] The second receiving module 940 is configured to receive n-1 images of the first resolution if in the second mode, where n≥2.

[0208] The second display module 950 is used to splice the received n images with the first resolution into one frame of image for display.

[0209] In summary, the image display device provided in the embodiment of the present application provides two types of display modes. In one mode, a first image composed of multiple sub-images can be transmitted to the display component so that the display component can display these sub-images at a faster frequency. In the other mode, a frame of image can be sent to the display component in multiple times, so that the display component can display a higher-resolution image at a lower frequency. The display methods are richer and more flexible, which solves the problem of low flexibility of the methods of the related art and achieves the effect of improving the flexibility of the image display method.

[0210] Optionally, the image display device further includes:

[0211] An identification acquisition module, used to acquire a pattern identification in an image;

[0212] A first determination module, configured to determine that the mode is in the first mode if the mode identifier is the first mode identifier;

[0213] The second determining module is used to determine that the system is in the second mode if the mode identifier is the second mode identifier.

[0214] Optionally, the image display device further includes:

[0215] The third display module is used to display a third image with a third resolution at a fourth frequency, the third image is composed of n second images, the fourth frequency is smaller than the second frequency, and the third resolution is larger than the first resolution.

[0216] According to another aspect of the present application, an image display device is also provided, which includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by the processor to implement the image display method as described above.

[0217] According to another aspect of the present application, a computer storage medium is provided, in which at least one instruction, at least one program, code set or instruction set is stored, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by a processor to implement the image display method as described above.

[0218] According to another aspect of the present application, a computer program product or a computer program is provided, the computer program product or the computer program comprising computer instructions, the computer instructions being stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the methods provided in the above-mentioned various optional implementations.

[0219] In the present application, the terms "first", "second", "third" and "fourth" are used for descriptive purposes only and should not be understood as indicating or implying relative importance. The term "plurality" refers to two or more than two, unless otherwise clearly defined.

[0220] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0221] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0222] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0223] The above description is only an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. An image processing method, characterized in that: For processing a component, the method comprises: Get mode information; If the mode information indicates the first mode, transmitting a first image of a first resolution to the display component at a first frequency, wherein the first image is formed by splicing a plurality of sub-images of a second resolution; If the mode information indicates the second mode, the second image of the first resolution is transmitted to the display component at a third frequency, and n second images are used to form a frame of image of the display component, where n≥2.

2. The method according to claim 1, characterized in that If the mode information indicates the first mode, transmitting a first image with a first resolution to the display component at a first frequency includes: If the mode information indicates the first mode, acquiring a plurality of sub-images with the second resolution; The multiple sub-images are stitched into a first image with the first resolution.

3. The method according to claim 1, characterized in that If the mode information indicates the second mode, transmitting the second image of the first resolution to the display component at a third frequency includes: If the mode information indicates the second mode, acquiring a third image with a third resolution; Cropping the third image into n second images with the first resolution; The second image of the first resolution is transmitted to the display component at the third frequency.

4. The method according to claim 1, characterized in that: The step of transmitting a first image with a first resolution to a display component at a first frequency includes: generating a first image of the first resolution having a first mode identifier; A first image having the first resolution and the first mode identifier is transmitted to the display component.

5. The method according to claim 1, characterized in that The transmitting the second image with the first resolution to the display component at a third frequency includes: generating a second image of the first resolution having a second mode identifier; A second image having the first resolution and the second mode identifier is transmitted to the display component.

6. The method according to any one of claims 1 to 5, characterized in that: For a processing component in a virtual reality device, the acquisition mode information includes: Get the user's head posture information; determining a rotation speed of the head based on the posture information; When the rotation speed is greater than a threshold, determining that the mode information is used to indicate the first mode; When the rotation speed is less than or equal to the threshold, the mode information is determined to indicate the second mode.

7. An image display method, characterized in that: For displaying a component, the method comprises: receiving an image at a first resolution; Acquire a mode identifier, where the mode identifier is used to indicate whether the mode is in the first mode or the second mode; If in the first mode, split the image as a first image into a plurality of sub-images with a second resolution and display them at a second frequency; If in the second mode, receiving n-1 images with the first resolution, where n≥2; The received n images of the first resolution are stitched into one frame of image for display.

8. The method according to claim 7, characterized in that The acquisition mode identifier includes: The mode identifier in the image is obtained.

9. The method according to claim 7, characterized in that: If in the first mode, splitting the image as a first image into a plurality of sub-images with a second resolution and displaying them at a second frequency comprises: If in the first mode, cropping the image with the first resolution into a plurality of sub-images with a second resolution; The sub-image of the second resolution is stretched into an image of a third resolution and displayed at a second frequency.

10. The method according to claim 7, characterized in that After displaying the received n images of the first resolution as n second images in one frame, the method further includes: A third image with a third resolution is displayed at a fourth frequency, wherein the third image is composed of n second images, the fourth frequency is less than the second frequency, and the third resolution is greater than the first resolution.

11. A display device, characterized in that: The display device comprises: a processing component and a display component; The processing component is used to obtain mode information; The processing component is used for transmitting a first image of a first resolution to the display component at a first frequency if the mode information indicates a first mode, wherein the first image is formed by splicing a plurality of sub-images of a second resolution; The display component is used to display a plurality of second sub-images in the first image at a second frequency, wherein the second frequency is greater than the first frequency; The processing component is used for transmitting the second image of the first resolution to the display component at a third frequency if the mode information indicates the second mode; The display component is used for splicing the n second images into one frame of image for display after receiving n second images, where n≥2.

12. An image processing device, characterized in that: For processing components, the image processing device comprises: An acquisition module, used to obtain mode information; A first transmission module, configured to transmit a first image of a first resolution to a display component at a first frequency if the mode information indicates a first mode, wherein the first image is formed by splicing a plurality of sub-images of a second resolution; A second transmission module is used to transmit a second image of the first resolution to the display component at a third frequency if the mode information indicates a second mode, and n second images are used to constitute a frame of image of the display component, where n≥2.

13. An image display device, characterized in that: For display components, the image display device comprises: A first receiving module, configured to receive an image with a first resolution; A determination module, used for acquiring a mode identifier, where the mode identifier is used for indicating whether the mode is in the first mode or the second mode; A first display module, configured to, if in the first mode, split the image as a first image into a plurality of sub-images with a second resolution and display them at a second frequency; A second receiving module, configured to receive n-1 images of the first resolution if in the second mode, where n≥2; The second display module is used to splice the received n images with the first resolution into one frame of image for display.

14. An image display device, characterized in that: The image display device includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the image processing method as described in any one of claims 1 to 6 or the image display method as described in any one of claims 7 to 10.

15. A computer storage medium, characterized in that The computer storage medium stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the image processing method as described in any one of claims 1 to 6 or the image display method as described in any one of claims 7 to 10.

Images