Display effect optimization method, system and device, electronic equipment and storage medium

Abstract

The invention provides a display effect optimization method, system and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a binding request of a first terminal, determining a second terminal according to the binding request, and building a corresponding relation between the first terminal and the second terminal; obtaining display parameters of the second terminal; wherein the display parameter is obtained after the second terminal is measured through detection equipment; in response to the acquired image data transmitted by the first terminal, converting the image data under the condition of the display parameter to obtain a target image; and in response to a display request of the second terminal, transmitting the target image to the second terminal for display.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a display effect optimization method, system, device, electronic device and storage medium. Background Art

[0002] Naked-eye 3D (three dimensional) technology simulates the stereoscopic vision principle of the human eye, allowing viewers to experience three-dimensional images without wearing any auxiliary equipment, such as displaying three-dimensional images through three-dimensional display products such as 3D photo frames.

[0003] However, current stereoscopic display products generally have slight process errors in the production of hardware devices. These errors will eventually lead to uneven 3D display effects, affecting product performance and user experience. Summary of the invention

[0004] In view of this, the present application proposes a display effect optimization method, system, device, electronic device and storage medium to solve or partially solve the above-mentioned problems.

[0005] Based on the above objectives, in a first aspect, the present application provides a method for optimizing display effects, comprising:

[0006] Obtaining a binding request of a first terminal, determining a second terminal according to the binding request, and establishing a corresponding relationship between the first terminal and the second terminal;

[0007] Acquire display parameters of the second terminal; wherein the display parameters are obtained by the second terminal after being measured by a detection device;

[0008] In response to acquiring the image data transmitted by the first terminal, converting the image data based on the display parameter to obtain a target image;

[0009] In response to a display request from the second terminal, the target image is transmitted to the second terminal for display.

[0010] In some exemplary embodiments, determining the second terminal according to the binding request includes:

[0011] Acquire the coding information included in the binding request; wherein the coding information is obtained by the first terminal by scanning the coding image of the second terminal;

[0012] The encoding information is parsed to determine the corresponding second terminal.

[0013] In some exemplary embodiments, the acquiring the display parameter of the second terminal includes:

[0014] In response to the corresponding relationship being established, a notification message including the corresponding relationship is sent to the second terminal, so that after receiving the notification message, the second terminal stores the notification message and transmits the display parameter.

[0015] In some exemplary embodiments, converting the image data based on the display parameter to obtain a target image includes:

[0016] Determining the number of viewpoints and resolution required for the target image;

[0017] Acquire at least one viewpoint image on the image data according to the number of viewpoints and the resolution;

[0018] Determining first three primary color components of the at least one viewpoint image;

[0019] The target image is generated by filling the first three primary color components into the second three primary color components of each pixel of the target image using a 3D conversion algorithm based on the display parameters.

[0020] In some exemplary embodiments, acquiring at least one viewpoint image on the image data comprises:

[0021] The vertical resolution and the horizontal resolution of the viewpoint image to be generated are determined according to the number of viewpoints and the resolution, and each viewpoint is sampled to generate the at least one viewpoint image.

[0022] In some exemplary embodiments, after obtaining the target image, the method further includes:

[0023] Determine a storage space corresponding to the first terminal, and store the target image in the storage space;

[0024] or

[0025] The target image is transmitted to the second terminal, and the target image is saved through the second terminal.

[0026] Based on the same concept, in a second aspect, the present application also provides a display effect optimization system, including: a first terminal, a second terminal and a server, wherein the server is used to execute the display effect optimization method described in the first aspect above.

[0027] In some exemplary embodiments, the second terminal is further configured to:

[0028] In response to the initial startup, establishing a communication connection with a recording device; wherein the recording device is connected to the detection device;

[0029] Acquire and display a detection image, so that the detection device detects the second terminal by detecting the detection image and generates display parameters;

[0030] The display parameters are obtained through the input device.

[0031] In some exemplary embodiments, the second terminal is connected to the input device by direct connection.

[0032] In some exemplary embodiments, the second terminal is further configured to:

[0033] In response to obtaining the direct connection request of the input device, determining whether the current process is a display parameter detection process;

[0034] The response is then a display parameter detection process, and the direct connection request is automatically authorized.

[0035] In some exemplary embodiments, the first terminal is further configured to:

[0036] capturing the coded image of the second terminal to generate coded information;

[0037] In response to performing a binding operation, the encoded information is written into a binding request, and the binding request is transmitted to the server.

[0038] Based on the same concept, in a third aspect, the present application also provides a display effect optimization device, including:

[0039] A first module is configured to obtain a binding request of a first terminal, determine a second terminal according to the binding request, and establish a corresponding relationship between the first terminal and the second terminal;

[0040] A second module is used to obtain display parameters of the second terminal; wherein the display parameters are obtained by the second terminal after being measured by a detection device;

[0041] A third module is configured to, in response to acquiring the image data transmitted by the first terminal, convert the image data based on the display parameter to obtain a target image;

[0042] The fourth module is used to transmit the target image to the second terminal for display in response to the display request of the second terminal.

[0043] Based on the same concept, in a fourth aspect, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method described in the first aspect above is implemented.

[0044] Based on the same concept, in the fifth aspect, the present application also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to implement the method described in the first aspect above.

[0045] From the above description, it can be seen that the present application provides a display effect optimization method, system, device, electronic device and storage medium, the method comprising: obtaining a binding request from a first terminal, determining a second terminal according to the binding request, and establishing a corresponding relationship between the first terminal and the second terminal; obtaining display parameters of the second terminal; wherein the display parameters are obtained by the second terminal after measurement by a detection device; in response to obtaining the image data transmitted by the first terminal, converting the image data based on the display parameters to obtain a target image; in response to the display request of the second terminal, transmitting the target image to the second terminal for display. The present application establishes a corresponding relationship by binding a first terminal for user operation with a second terminal for display, and then can obtain the display parameters corresponding to the second terminal, so that after the first terminal transmits the image to be displayed on the second terminal, the image can be converted in a targeted manner according to the display parameters, so that the generated target image is more suitable for the second terminal. In this way, for different second terminals, even if there are process errors, the differences will be reflected through display parameters. Then, when performing image conversion, targeted adjustments can be made through display parameters to obtain a target image that is more in line with the corresponding second terminal. Ultimately, the display effects of different second terminals can achieve the set effects, thereby improving product yield and user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the related technologies, the drawings required for use in the embodiments or the related technical descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0047] Figure 1 A schematic diagram of an exemplary system 100 provided for an embodiment of the present application.

[0048] Figure 2 A schematic diagram of a flow chart of display parameter detection performed by the second terminal 104 provided in an embodiment of the present application.

[0049] Figure 3 A schematic diagram of a direct connection between the second terminal 104 and the input device provided in an embodiment of the present application.

[0050] Figure 4A flowchart of an exemplary method 400 provided in an embodiment of the present application.

[0051] Figure 5 A schematic diagram of the process of image conversion performed by the server 106 provided in an embodiment of the present application.

[0052] Figure 6 A schematic diagram of the structure of an exemplary device 600 provided in an embodiment of the present application.

[0053] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0054] In order to make the purpose, technical solutions and advantages of this specification more clear, this specification is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.

[0055] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present application should be understood by people with ordinary skills in the field to which the present application belongs. The "first", "second" and similar words used in the embodiments of the present application do not represent any order, quantity or importance, but are only used to distinguish different components. "Including" or "comprising" and similar words mean that the elements, objects or method steps appearing before the word cover the elements, objects or method steps listed after the word and their equivalents, without excluding other elements, objects or method steps. "Connect" or "connected" and similar words are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0056] As described in the background technology section, with the rapid development of 3D (three dimensional) technology, naked-eye stereoscopic display technology is a very eye-catching cutting-edge technology direction today. Through naked-eye stereoscopic display devices, viewers can directly watch stereoscopic images like stereoscopic movies without wearing 3D glasses, which will become the most promising direction for flat-panel displays. In the future, there will be more and more liquid crystal stereoscopic displays with 2D (2-dimensional) / 3D conversion, and they will replace ordinary liquid crystal displays in most market spaces. In some examples, the 3D grating film of the 3D stereoscopic display product is attached to the 3D display screen. The external grating film is required to form a one-to-one correspondence with the pixel to facilitate the left eye pixel to enter the left eye and the right eye pixel to enter the right eye to form a 3D display effect. At this time, due to the high difficulty of bonding, there is a slight offset, forming an offset, which is the 3D grating film bonding offset.

[0057] In some examples, in order to correct the above-mentioned offset, the information of the 3D grating film being attached to the mobile device can be obtained first; then a preset test pattern is loaded; then it is determined whether the attachment is correct, if not, step ① is entered; if yes, step ② is entered; ① the user's touch sensing is obtained, and the angle and coordinate offset of the test pattern are changed so that the test pattern can gradually be seen as horizontal stripes, and then the judgment of the previous step is repeated; ② the angle and coordinate offset of the test pattern are obtained, and stored as configuration parameters; finally, the configuration parameters are called to rearrange the 3D image and display the corrected 3D image.

[0058] However, during the implementation of the above correction method, it was found that: since the above solution solves the problem by improving the accuracy of the fit between the factory 3D grating and the screen, the solution is to determine whether the fit is accurate by user touch fine-tuning. However, this method has the disadvantage of an uncertain number of continued adjustments due to judgment errors when solving the accuracy problem, which will greatly affect the product's factory progress and the construction period.

[0059] In view of this, in some embodiments of the present application, a display effect optimization system 100 is provided.

[0060] Figure 1 The schematic diagram of the structure of an exemplary system 100 provided in an embodiment of the present application is shown. The system 100 may include a first terminal 102, a second terminal 104, and a server 106. A medium (e.g., a network) providing a communication link may be included between the first terminal 102, the second terminal 104, and the server 106. The network may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0061] Various applications (APPs) or software may be installed on the first terminal 102, such as live broadcast applications or software, image processing applications or software, video applications or software, video conferencing applications or software, reading applications or software, social applications or software, payment applications or software, web browsers and instant messaging tools, etc. These applications may be used to upload images, display content, etc.

[0062] The second terminal 104 may display specific images. In some scenarios, the second terminal 104 may display 3D images.

[0063] It should be noted that the first terminal 102 and the second terminal 104 here can be hardware or software. When the first terminal 102 or the second terminal 104 is hardware, it can be various electronic devices with a display screen, including but not limited to smart phones, tablet computers, e-book readers, MP3 players, laptops, and desktop computers (PCs), etc.; afterwards, in some scenarios, the first terminal 102 can also be various electronic devices without a display screen but with data transmission functions, including but not limited to screenless computers, specific databases, screenless early childhood education machines, etc. When the first terminal 102 or the second terminal 104 is software, it can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, used to provide distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0064] The server 106 may be a server that provides various services, such as a background server that supports various applications or web browsers displayed on the first terminal 102 and the second terminal 104, or when the first terminal 102 needs the second terminal 104 to display a target image, the server 106 may be used for transmission services, and the server 106 may be used for image processing, display effect optimization and other services. In some scenarios, the server 106 may be configured with multiple servers according to different docking terminals or different services provided, such as a first server corresponding to the first terminal 102, a second server corresponding to the second terminal 104, a processing / generation server for image processing optimization, a database server for corresponding data storage, etc. It can be understood that in the case where the server 106 can realize the above multiple more specific server-related functions, only one comprehensive server 106 may be configured in the system 100.

[0065] Similarly, the server 106 and the aforementioned more specific servers can also be hardware or software. When they are hardware, they can be implemented as a distributed server cluster consisting of multiple servers, or as a single server. When they are software, they can be implemented as multiple software or software modules (for example, for providing distributed services), or as a single software or software module. No specific limitation is made here.

[0066] The user 108 may operate the first terminal 102 and / or the second terminal 104 , and may also use the first terminal 102 and / or the second terminal 104 to perform appropriate operations on the server 106 .

[0067] It should be understood that Figure 1The number of the first terminal 102, the second terminal 104, the server 106 and the user 108 in the embodiment is only illustrative. According to the implementation requirements, there may be any number of the first terminal 102, the second terminal 104, the server 106 and the user 108.

[0068] In some embodiments, when the user 108 wants to display a certain image through the second terminal 104, here and in the following embodiments, the 3D effect image display of a certain image is used as an example for explanation. The user 108 displays an initial image on the first terminal 102, such as a 2D image, which is represented by image A. The user 108 wants to display a 3D effect image of image A on the second terminal 104, and image B is used to represent the 3D effect image corresponding to image A. The user 108 can first operate on the first terminal 102 to determine from the server 106 or the first terminal 102 whether the first terminal 102 has established a corresponding binding relationship with the second terminal 104.

[0069] If a binding relationship is established, image A can be directly transmitted to the server 106, and the server 106 can convert and generate image B according to the data of the corresponding second terminal 104. Image B can then be stored in the server, and when the second terminal 104 needs to display image B, it can be transmitted to the second terminal 104 for display. Of course, it can also be directly stored in the second terminal 104 and directly displayed when the second terminal 104 needs to display image B.

[0070] If the binding relationship is not established, the user 108 can operate the first terminal 102 to scan the coded image of the second terminal 104 to determine the identity information of the second terminal 104, and then use the identity information for binding. Here, the coded image of the second terminal 104 can be set on the second terminal 104 itself, such as a bar code or a two-dimensional code attached, sprayed or etched on the surface of the second terminal 104; it can also be a bar code or a two-dimensional code directly displayed by the second terminal 104, or the user causes the second terminal 104 to display it through operation. The coded image can correspond to the unique production number, registration number, network address (such as wifi mac address) of the second terminal 104. After the user 108 captures the coded image through the first terminal 102, the corresponding coded information can be generated. For example, the coded image can be parsed to parse the aforementioned production number, registration number, network address, etc. as the coded information. After that, the first terminal 102 and the second terminal 104 can be bound at the first terminal 104 or the server 106 by responding to the binding operation. The binding operation may be triggered automatically, for example, the binding operation is automatically triggered after the encoding information is generated, or may be triggered by an operation. Meanwhile, in the scenario of binding through the server 106, the encoding information may be written into the binding request, and the binding request may be transmitted to the server 106 to perform binding through the server 106. That is, in some embodiments, the first terminal 102 is further used to: capture the encoding image of the second terminal 104 to generate encoding information; in response to performing the binding operation, write the encoding information into the binding request, and transmit the binding request to the server 106.

[0071] After that, after the binding relationship is determined, the server 106 can obtain image A, retrieve the display parameters corresponding to the second terminal 104, and then perform 3D image conversion on image A based on the display parameters to obtain image B. The display parameters are the display parameters measured by the second terminal 104 after the production is completed and the 3D grating film is applied. These display parameters can reflect the slight errors of the second terminal 104 in the production process. In a more specific scenario, the display parameters here may include the aforementioned 3D grating film fitting offset, and may also include the number of 3D grating film lines, the inclination angle of the 3D grating film, etc. Among them, the number of 3D grating film lines: refers to the number of grating pitches contained in each inch. 1 inch = 2.54 centimeters. Number of lines = per inch / grating pitch. 3D grating film inclination angle: refers to the preset lamination angle of the 3D grating film when it is attached to the screen at the factory, which allows the device to display the best 3D effect. Due to errors in actual operation, this angle deviates from the preset lamination angle. This actual lamination angle is the 3D grating film inclination angle. Then, the above key display parameters are collected through the second terminal 104 and sent to the server 106 for one-to-one binding between the first terminal 102 and the second terminal 104. The cloud conversion platform of the server 106 completes the correction of the 3D conversion algorithm, and then further sends the converted image to the second terminal 104 to display a high-quality three-dimensional effect.

[0072] Furthermore, the display parameters of the second terminal 104 may be directly transmitted to the server 106 after the display parameters are measured; or they may be first stored in the second terminal 104 and then transmitted to the server 106 when the binding between the first terminal 102 and the second terminal 104 is completed. Figure 1 As shown, data can be detected and entered with the help of an input device and a detection device 110, wherein the input device and the detection device 110 can be two independent devices or a comprehensive device that simultaneously realizes the measurement and entry of display parameters. In one embodiment, the input device and the detection device 110 can use a PC device or a laptop computer as an input device, and a targeted image detection device connected thereto by wire or wirelessly is a detection device. In a more specific scenario, the second terminal 104 can obtain display parameters with the help of the input device and the detection device 110 when setting at the factory; or it can obtain display parameters with the help of the input device and the detection device 110 when performing maintenance operations on the second terminal 104, and overwrite the previous display parameters. When performing the detection, the inclination angle, deflection angle, number of lines, etc. can be detected with the help of professional detection equipment, and the results are transmitted to the input device, and then transmitted to the second terminal 104 using the input device.

[0073] Specifically, take the factory settings as an example, Figure 2As shown, in the specific detection process, the second terminal 104 is first powered on; then it is determined whether there are display parameters, if not, screen correction test, inclination test, line number test, offset test, etc. are respectively performed, and after obtaining the display parameters, another judgment is performed; if there are display parameters, the corresponding display function can be executed, such as function home page display, binding the first terminal 102, uploading display parameters to the server, etc. In the specific detection process, the second terminal 104 can display a preset detection image according to the specific test content, and the detection device can perform a certain test detection by detecting the corresponding detection image, thereby generating the corresponding display parameters. That is, in some embodiments, the second terminal 104 is also used to: establish a communication connection with the input device in response to the initial startup; wherein the input device is connected to the detection device; obtain and display the detection image, so that the detection device detects the second terminal by detecting the detection image and generates display parameters; obtain the display parameters through the input device.

[0074] Further, after the input device and the detection device 110 obtain a certain display parameter, the second terminal 104 can be connected to the input device and the detection device 110 by direct connection, such as by Wifi direct connection or transmission line direct connection. Figure 3 As shown, the basic process of establishing a connection for Wifi Direct can be: (1) Device A turns on the WiFi function and enables the WiFi Direct function. (2) Device B also turns on the WiFi function and enables the WiFi Direct function. (3) Device A searches for nearby devices and finds device B. (4) Device A sends a connection request to device B. (5) Device B accepts the connection request and establishes a direct connection. (6) After the connection is established, device A and device B can transmit data to each other. That is, in some embodiments, the second terminal 104 is connected to the input device via a direct connection.

[0075] Furthermore, for Wifi direct connection, general devices need to be manually authorized, which will obviously affect the efficiency of display parameter detection, transmission, etc. In some embodiments, WiFi direct connection can be completed by automatic authorization. After determining that it is a display parameter detection process, automatic authorization of WiFi direct connection can be performed. That is, in some embodiments, the second terminal 104 is also used to: in response to obtaining the direct connection request of the input device, determine whether it is currently a display parameter detection process; in response to the display parameter detection process, automatically authorize the direct connection request.

[0076] In a more specific scenario, in order to enable the second terminal 104 to perform detection without manual operation, after the second terminal 104 starts the test interface, the WiFi direct connection function is turned on, and the automatic WiFi direct connection authorization module is started. The input device (such as a laptop computer, etc.) also turns on the WiFi direct connection function. The input device searches for the second terminal 104. The operator selects the second terminal 104 to transmit data on the input device and applies to connect to the second terminal 104. The second terminal 104 receives the WiFi direct connection request from the input device. Since the second terminal 104 runs the background automatic authorization service, it automatically agrees to the WiFi terminal's direct connection request. Specifically, the input device runs a wifi direct connection message sending module, sends a request, and automatically adds a photo frame correction test prefix before the request device name, so as to indicate that the current direct connection request is for display parameter detection. The automatic authorization module of the second terminal 104 will detect the wifi direct connection request prompt of the input device popped up by the android system. The automatic authorization module will obtain the view composition of the top-level pop-up window on the screen, obtain all TextView text components and Button button components therein, and detect whether the text of the Textview component contains the "photo frame correction test" text prefix. If not (indicating that it is not a display parameter detection), it will traverse all Button components and verify the pop-up window text, and automatically click the "Cancel" and "Disagree" fields in turn to reject the connection request; otherwise, it will automatically click the "OK", "Agree" and "Authorize" fields in turn. After waiting for 5 seconds, the Socket communication between the two ends will be established to transmit parameters. The android wifi direct connection automatic authorization service can customize the system's AccessibilityService barrier-free service, and set the second terminal 104 as the system-level highest authority application, automatically have barrier-free permissions, monitor various screen interface changes such as screen pop-up interface switching, and detect the field controls that need to be processed in real time.

[0077] Finally, after obtaining the image B, the server 106 may directly transmit it to the second terminal 104 for storage or display; or the image B may be first stored in the server 106 and then transmitted to the second terminal 104 when the second terminal 104 needs it.

[0078] In some embodiments, for the server 106 in the display effect optimization system 100, Figure 4 As shown, a display effect optimization method can be specifically executed to complete the corresponding tasks to be completed by the above-mentioned server 106. Figure 4 4 shows a flow chart of an exemplary method 400 provided in an embodiment of the present disclosure. Optionally, the method 400 can be used to optimize the display effect of the second terminal 104. The method 400 can be Figure 1 The server 106 is implemented.

[0079] like Figure 4 As shown, the method 400 may further include the following steps.

[0080] Step 402: Obtain a binding request of a first terminal, determine a second terminal according to the binding request, and establish a corresponding relationship between the first terminal and the second terminal.

[0081] In this step, the binding request is the request information that the first terminal 102 wishes to bind itself with a second terminal 104. As can be seen from the above-mentioned embodiment, after the server 106 obtains the request of the first terminal 102, the server 106 can first determine the attribute information of the first terminal 102 according to the request. Whether it is to establish a binding between hardware and hardware, or a binding between software and software, or between software and hardware, the server 106 can use the request to obtain the corresponding information of the first terminal 102, and the information can uniquely point to a first terminal 102. After that, the binding request also carries the information of the second terminal 104 to which the binding needs to be established, and the information can also uniquely point to a second terminal 104. After the server 106 obtains the corresponding information of the first terminal 102 and the second terminal 104 according to the binding request, it can establish a corresponding relationship between the two and complete the binding.

[0082] In some embodiments, the information of the second terminal 104 carried in the binding request may be set by the first terminal 102 itself, for example, the first terminal 102 will be fixedly connected to a second terminal 104, and the corresponding information may be set in advance. It may also be input by the user 108, for example, the user 108 actively inputs information related to the second terminal 104 through the first terminal 102. It may also be obtained by actively acquiring the information of the second terminal 104 through the first terminal 102. Specifically, when binding, the second terminal 104 may display a coded image such as a code or a QR code that records its own coded information, and the first terminal 102 may acquire the coded image by scanning or the like. Afterwards, the first terminal 102 may generate a corresponding binding request based on the coded information carried in the coded image, and the server 106 may acquire the coded information therein after receiving the binding request, and then parse the coded information to finally determine the corresponding second terminal 104. That is, in some embodiments, determining the second terminal according to the binding request includes: obtaining coding information contained in the binding request; wherein the coding information is obtained by the first terminal by scanning the coded image of the second terminal; parsing the coding information to determine the corresponding second terminal.

[0083] Step 404, obtaining display parameters of the second terminal; wherein the display parameters are obtained by the second terminal after being measured by a detection device.

[0084] In this step, after the corresponding relationship between the second terminal 104 and the first terminal 102 is established, the server 106 can obtain the display parameters of the second terminal 104. Of course, the display parameters can also be stored in the server 106 by the second terminal 104 before, and the server 106 only retrieves the data; or the server 106 obtains the display parameters from the second terminal 104.

[0085] In some embodiments, in order to improve the use efficiency of the server 106 and save a certain amount of storage space, the display parameters of the second terminal 104 can be obtained after the corresponding relationship is determined. Specifically, after determining the corresponding relationship, the server 106 can generate a notification message and broadcast the message to the corresponding second terminal 104. After receiving the notification message, the second terminal 104 can determine its corresponding first terminal 102 according to the notification message, and can respond to the notification message and return the corresponding display parameters. That is, in some embodiments, the acquisition of the display parameters of the second terminal includes: in response to the establishment of the corresponding relationship, sending a notification message containing the corresponding relationship to the second terminal, so that after the second terminal receives the notification message, the notification message is stored and the display parameters are transmitted.

[0086] Step 406: In response to acquiring the image data transmitted by the first terminal, convert the image data based on the display parameter to obtain a target image.

[0087] In this step, after the corresponding relationship is established and the display parameters of the second terminal 104 are obtained, the image data uploaded by the first terminal 102 can be waited for. In some embodiments, the image data can be a 2D image or video. After the first terminal 102 transmits the image data, the server 106 can convert the image data to obtain a target image based on the display parameters. In some embodiments, the target image can be a 3D image or video.

[0088] In some embodiments, a method for synthesizing a 3D image by using a conversion algorithm for a 2D image may be as follows: first, according to the number of viewpoints N required for synthesizing a 3D stereoscopic image, tot And the resolution V*H, for N tot The vertical resolution of each viewpoint image is sampled as V / v, and the horizontal resolution is sampled as H / h. tot ≥2, v*h=N tot , and v is the closest to Afterwards, the sampled N tot The RGB components of the three viewpoint images are filled into the RGB components of the stereo image to obtain the required stereo image, that is, the target image.

[0089] Among them, in the first step, the reason why v is closest to The integer value of is based on the universality of the synthesis algorithm on the one hand, and on the other hand to make the values ​​of v and h close to each other so that the synthesized stereo image has the best visual effect. tot If the original horizontal resolution of the viewpoint image is greater than H / h, horizontal downsampling is required, otherwise horizontal upsampling is required; if N tot If the original vertical resolution of the viewpoint image is greater than V / v, vertical downsampling is performed, otherwise vertical upsampling is performed. In the second step, the following steps may be included: 1) According to the corresponding optical formula, the number x of RGB sub-pixels on the LCD display screen covered by the prism grating in the horizontal direction is calculated. Among them, the RGB sub-pixels on the LCD display screen are calculated to be N tot The RGB components of the viewpoint image are the RBG components of the stereo image. 2) According to the corresponding formula, N is calculated. tot 3) According to the mapping table, N tot The RGB components of each viewpoint are filled into the RGB components of the stereo image.

[0090] For each v lines of RGB components of a stereo image, use N tot That is, the RGB components of the first to vth rows of the stereoscopic image are filled with N tot The first row of RGB components of the viewpoint image corresponds to the RGB components of the v+1 to 2v rows of the stereo image. tot For the RGB components in each row of the stereo image, each 3h RGB component is represented by N tot Each RGB component of the viewpoint image is filled until all RGB components of the stereo image are filled by N tot That is, the RGB components of the 1st to 3hth RGB components of a row of a stereoscopic image are filled with N tot The same row of the stereo image has 3h+1 to 6h RGB components corresponding to N tot The second RGB component corresponding to the viewpoint image is filled in, and so on, until all RGB components of the stereo image are filled in by N tot The RGB components of the viewpoint images are filled.

[0091] The 2D to 3D conversion service implemented by this method is deployed on the server 106 through a high-performance GPU. The image data uploaded by the first terminal 102 is filled with 2D material (image data) into 3D material (target image) according to the display data such as the number of grating lines, grating inclination and offset bound to the second terminal 104, and then pushed to the designated second terminal 104 through the server 106. The second terminal 104 downloads the target image and can play it after the download is completed.

[0092] That is, in some embodiments, the conversion of the image data based on the display parameters to obtain the target image includes: determining the number of viewpoints and the resolution required for the target image; acquiring at least one viewpoint image on the image data according to the number of viewpoints and the resolution; determining the first three primary color components of the at least one viewpoint image; using a 3D conversion algorithm, based on the display parameters, filling the first three primary color components into the second three primary color components of each pixel of the target image, thereby generating the target image. The first three primary color components are the RGB components of the viewpoint image, and the second three primary color components are the RGB components of the target image. At the same time, in some embodiments, acquiring at least one viewpoint image on the image data includes: determining the vertical resolution and horizontal resolution of the viewpoint image to be generated according to the number of viewpoints and the resolution, thereby sampling each viewpoint to generate the at least one viewpoint image.

[0093] Afterwards, in some embodiments, after the target image is generated, the server 106 may directly transmit it to the second terminal 104 and store it on the second terminal 104; or it may be first stored in the server 106, and when the second terminal 104 generates a display request for the corresponding image, the target image is retrieved from the database and transmitted to the second terminal 104. Of course, the display request may be generated simultaneously after the first terminal 102 transmits the image data, or may be generated independently by the second terminal 104. That is, in some embodiments, after obtaining the target image, the method further includes: determining a storage space corresponding to the first terminal, storing the target image in the storage space; or transmitting the target image to the second terminal, and saving the target image through the second terminal.

[0094] Step 408: In response to the display request of the second terminal, transmit the target image to the second terminal for display.

[0095] In this step, in one embodiment, when the second terminal 104 needs to display the target image, it will send a display request to the server 106. After receiving the display request, the server can transmit the target image to the second terminal 104, and finally display, store, reprocess and output it through the second terminal 104.

[0096] In a more specific scenario, for the system 100, the first terminal 102, the second terminal 104 and the server 106 can be further subdivided into multiple modules.

[0097] Specifically, first, the first terminal 102 may include a login module, and adopt the corresponding login method of the first terminal 102 to determine its corresponding ID, thereby establishing a corresponding account and binding the first terminal 102. The code scanning module, the first terminal 102 can be set with a code scanning function, and the QR code generated by the MAC address is displayed on the setting interface of the second terminal 104. Through scanning by the code scanning module, the first terminal 102 obtains the QR code of the second terminal 104 to be bound, and calls the account device binding interface of the server 106. The http request parameters include the display parameters of the second terminal 104, which facilitates the server 106 to perform different 3D material conversion for each device.

[0098] Secondly, the second terminal 104 may include a factory correction setting module. When the second terminal 104 is powered on for the first time, the second terminal 104 will enter the three-step test interface of the 3D screen parameters. The first step is the tilt test, which displays the tilt auxiliary test picture; the second step is the deflection test, which displays the deflection auxiliary test picture; the third step is the line number test, which displays the line number auxiliary test picture. After the factory tester uses optical instruments and other detection equipment to test the tilt, deflection, and line number, they enter the input device, and directly transmit the display parameters to the second terminal 104 through the input device wifi direct connection transmission module. After the second terminal 104 receives and stores the data, it automatically ends the test interface and enters the normal business interface of the second terminal 104. When the second terminal 104 is restarted again in the future, since the second terminal 104 has stored the display parameters, the second terminal 104 will no longer enter the three-step test interface, and directly enter the normal business software interface of the second terminal 104. The second terminal 104 business function module, the device binding interface can be opened through the second terminal 104 setting interface, and the interface displays a QR code generated by the device's own WiFi MAC address. The user can use the first terminal 102 to use the code scanning binding function to scan the QR code of the second terminal 104. The first terminal 102 will input its own ID and the second terminal 104 into the server 106 to bind the account and the device. After the server 106 records the corresponding relationship, it will send a binding notification message to the second terminal 104. The second terminal 104 will upload the device information to the server 106. The device information includes the display parameters of the factory test, etc. IOT module (transmission module), the IOT module is used to transmit MQTT instruction messages with the server 106. For example, if the server 106 wants to send the download address of the converted target image to the second terminal 104, it can be sent to the second terminal 104 through the IOT module. The IOT module is a long connection communication method implemented by the standard MQTT protocol, with good stability and high immediacy.

[0099] Finally, the server 106 may include a material storage module, and the user 108 may select pictures and videos in the user 108 mobile phone or temporarily taken through the material (image data) sending function of the first terminal 102, and upload them. The server 106 receives the uploaded material, and according to the display parameters uploaded when the account and device were previously bound, calls the 2D to 3D algorithm for the uploaded 2D material, and then further adjusts the 3D material through the 3D effect correction algorithm to obtain the target image, and finally uploads it to the corresponding storage service database for storage. The specific process of the 2D to 3D module may be the same or similar to that described in the aforementioned embodiment, and will not be repeated here. IOT module (transmission module), this module communicates with the IOT module of the second terminal 104, and communicates with the second terminal 104 in real-time messages through the long connection communication implemented by the standard mqtt protocol.

[0100] In a more specific scenario, the flow chart of the specific process of the server 106 performing display effect optimization is as follows: Figure 5 As shown, after the server 106 receives the instruction to send the material from the first terminal 102 (i.e., to transmit the image data), the server 106 queries the corresponding relationship between the first terminal 102 and the second terminal 104, such as the binding relationship between the userID of the first terminal 102 and the MAC address of the second terminal 104. Then the corresponding display parameters of the second terminal 104 are queried. If there are, the 2D to 3D conversion algorithm can be called, and the display parameters can be input into the algorithm as constraints to generate the target image; if there are no display parameters, it means that the second terminal 104 is not suitable for the corresponding optimization, and then the 2D to 3D conversion algorithm can be directly used for conversion to generate the target image. Finally, it is determined whether the target image is successfully generated. If so, the resource download address of the generated target image can be pushed to the second terminal 104 for the second terminal 104 to download and display.

[0101] It can be seen from the above examples that the display effect optimization system and method provided by the embodiments of the present disclosure. By binding the first terminal used for user operation with the second terminal used for display, a corresponding relationship is established, and then the display parameters corresponding to the second terminal can be obtained, so that after the first terminal transmits the image to be displayed on the second terminal, the image can be converted according to the display parameters, so that the generated target image is more suitable for the second terminal. In this way, for different second terminals, even if there are process errors, the difference will be reflected through the display parameters, and then when performing image conversion, the display parameters can be adjusted in a targeted manner to obtain a target image that is more in line with the corresponding second terminal, and finally the display effects of different second terminals reach the set effect, improving product yield and user experience.

[0102] It should be noted that the method of the embodiment of the present application can be performed by a single device, such as a computer or server. The method of the embodiment of the present application can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present application, and the multiple devices will interact with each other to complete the described method.

[0103] It should be noted that the above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0104] Based on the same concept, corresponding to any of the above-mentioned embodiment methods 400, the present application also provides a display effect optimization device 600.

[0105] refer to Figure 6 , the display effect optimization device 600 comprises:

[0106] The first module 610 is configured to obtain a binding request of a first terminal, determine a second terminal according to the binding request, and establish a corresponding relationship between the first terminal and the second terminal.

[0107] The second module 620 is used to obtain display parameters of the second terminal; wherein the display parameters are obtained by the second terminal after being measured by a detection device.

[0108] The third module 630 is configured to, in response to acquiring the image data transmitted by the first terminal, convert the image data based on the display parameters to obtain a target image.

[0109] The fourth module 640 is configured to transmit the target image to the second terminal for display in response to a display request from the second terminal.

[0110] In some exemplary embodiments, the first module 610 is further configured to:

[0111] Acquire the coding information included in the binding request; wherein the coding information is obtained by the first terminal by scanning the coding image of the second terminal;

[0112] The encoding information is parsed to determine the corresponding second terminal.

[0113] In some exemplary embodiments, the second module 620 is further configured to:

[0114] In response to the corresponding relationship being established, a notification message including the corresponding relationship is sent to the second terminal, so that after receiving the notification message, the second terminal stores the notification message and transmits the display parameter.

[0115] In some exemplary embodiments, the third module 630 is further configured to:

[0116] Determining the number of viewpoints and resolution required for the target image;

[0117] Acquire at least one viewpoint image on the image data according to the number of viewpoints and the resolution;

[0118] Determining first three primary color components of the at least one viewpoint image;

[0119] The target image is generated by filling the first three primary color components into the second three primary color components of each pixel of the target image using a 3D conversion algorithm based on the display parameters.

[0120] In some exemplary embodiments, the third module 630 is further configured to:

[0121] The vertical resolution and the horizontal resolution of the viewpoint image to be generated are determined according to the number of viewpoints and the resolution, and each viewpoint is sampled to generate the at least one viewpoint image.

[0122] In some exemplary embodiments, the third module 630 is further configured to:

[0123] Determine a storage space corresponding to the first terminal, and store the target image in the storage space;

[0124] or

[0125] The target image is transmitted to the second terminal, and the target image is saved through the second terminal.

[0126] For the convenience of description, the above devices are described in terms of functions divided into various modules. Of course, when implementing the embodiments of the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0127] The device of the above embodiment is used to implement the corresponding display effect optimization method 400 in the above embodiment, and has the beneficial effects of the corresponding method 400 embodiment, which will not be described in detail here.

[0128] Based on the same concept, corresponding to the method 400 of any of the above embodiments, the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the display effect optimization method as described in any of the above embodiments is implemented.

[0129] Figure 7A more specific schematic diagram of the hardware structure of an electronic device provided in this embodiment is shown, and the device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. The processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are connected to each other through the bus 1050 in the device.

[0130] The processor 1010 can be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0131] The memory 1020 may be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented by software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.

[0132] The input / output interface 1030 is used to connect the input / output module to realize information input and output. The input / output module can be configured in the device as a component (not shown in the figure), or it can be externally connected to the device to provide corresponding functions. The input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0133] The communication interface 1040 is used to connect a communication module (not shown) to realize communication interaction between the device and other devices. The communication module can realize communication through a wired mode (such as USB, network cable, etc.) or a wireless mode (such as mobile network, WIFI, Bluetooth, etc.).

[0134] The bus 1050 includes a path that transmits information between the various components of the device (eg, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).

[0135] It should be noted that, although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040 and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, it can be understood by those skilled in the art that the above device may also only include the components necessary for implementing the embodiments of the present specification, and does not necessarily include all the components shown in the figure.

[0136] The electronic device of the above embodiment is used to implement the corresponding display effect optimization method 400 in any of the above embodiments, and has the beneficial effects of the corresponding method 400 embodiment, which will not be described in detail here.

[0137] Based on the same concept, corresponding to any of the above-mentioned embodiment methods 400, the present application also provides a non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable the computer to execute the display effect optimization method 400 described in any of the above embodiments.

[0138] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be achieved by any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, tape disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device.

[0139] The computer instructions stored in the storage medium of the above embodiment are used to enable the computer to execute the display effect optimization method 400 described in any of the above embodiments, and have the beneficial effects of the corresponding method 400 embodiment, which will not be repeated here.

[0140] Based on the same concept, corresponding to any of the above-mentioned embodiments and methods 400, the present application also provides a computer program product, which includes computer program instructions. In some embodiments, the computer program instructions can be executed by one or more processors of a computer so that the computer and / or the processor execute the display effect optimization method 400. Corresponding to the execution subject corresponding to each step in each embodiment of the display effect optimization method 400, the processor that executes the corresponding step can belong to the corresponding execution subject.

[0141] The computer program product of the above embodiment is used to enable the computer and / or the processor to execute the display effect optimization method 400 described in any of the above embodiments, and has the beneficial effects of the corresponding method 400 embodiment, which will not be repeated here.

[0142] Those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present application (including the claims) is limited to these examples. In line with the concept of the present application, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of the different aspects of the embodiments of the present application as described above, which are not provided in detail for the sake of simplicity.

[0143] In addition, to simplify the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the known power supply / ground connection with the integrated circuit (IC) chip and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform to be implemented in the embodiments of the present application (that is, these details should be fully within the scope of understanding of those skilled in the art). In the case of elaborating specific details (e.g., circuits) to describe exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or when these specific details are changed. Therefore, these descriptions should be considered to be illustrative rather than restrictive.

[0144] Although the present application has been described in conjunction with specific embodiments of the present application, many replacements, modifications and variations of these embodiments will be apparent to those skilled in the art from the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may use the embodiments discussed.

[0145] The embodiments of the present application are intended to cover all such substitutions, modifications and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present application should be included in the scope of protection of the present application.

Claims

1. A display effect optimization method, characterized in that: include: Obtaining a binding request of a first terminal, determining a second terminal according to the binding request, and establishing a corresponding relationship between the first terminal and the second terminal; Acquire display parameters of the second terminal; wherein the display parameters are obtained by the second terminal after being measured by a detection device; In response to acquiring the image data transmitted by the first terminal, converting the image data based on the display parameter to obtain a target image; In response to a display request from the second terminal, the target image is transmitted to the second terminal for display.

2. The method according to claim 1, characterized in that The determining the second terminal according to the binding request includes: Acquire the coding information included in the binding request; wherein the coding information is obtained by the first terminal by scanning the coding image of the second terminal; The encoding information is parsed to determine the corresponding second terminal.

3. The method according to claim 2, characterized in that The acquiring the display parameter of the second terminal includes: In response to the corresponding relationship being established, a notification message including the corresponding relationship is sent to the second terminal, so that after receiving the notification message, the second terminal stores the notification message and transmits the display parameter.

4. The method according to claim 1, characterized in that: The step of converting the image data based on the display parameter to obtain a target image includes: Determining the number of viewpoints and resolution required for the target image; Acquire at least one viewpoint image on the image data according to the number of viewpoints and the resolution; Determining first three primary color components of the at least one viewpoint image; The target image is generated by filling the first three primary color components into the second three primary color components of each pixel of the target image using a 3D conversion algorithm based on the display parameters.

5. The method according to claim 1, characterized in that The acquiring at least one viewpoint image on the image data comprises: The vertical resolution and the horizontal resolution of the viewpoint image to be generated are determined according to the number of viewpoints and the resolution, and each viewpoint is sampled to generate the at least one viewpoint image.

6. The method according to claim 1, characterized in that After obtaining the target image, the method further includes: Determine a storage space corresponding to the first terminal, and store the target image in the storage space; or The target image is transmitted to the second terminal, and the target image is saved through the second terminal.

7. A display effect optimization system, characterized in that: include: A first terminal, a second terminal and a server, wherein the server is used to execute the display effect optimization method described in any one of claims 1 to 6.

8. The system according to claim 7, characterized in that The second terminal is further used for: In response to the initial startup, establishing a communication connection with a recording device; wherein the recording device is connected to the detection device; Acquire and display a detection image, so that the detection device detects the second terminal by detecting the detection image and generates display parameters; The display parameters are obtained through the input device.

9. The system according to claim 8, characterized in that The second terminal is connected to the input device in a direct connection manner.

10. The system according to claim 9, characterized in that The second terminal is further used for: In response to obtaining the direct connection request of the input device, determining whether the current process is a display parameter detection process; The response is then a display parameter detection process, and the direct connection request is automatically authorized.

11. The system according to claim 7, characterized in that The first terminal is further used for: capturing the coded image of the second terminal to generate coded information; In response to performing a binding operation, the encoded information is written into a binding request, and the binding request is transmitted to the server.

12. A display effect optimization device, characterized in that: include: A first module is configured to obtain a binding request of a first terminal, determine a second terminal according to the binding request, and establish a corresponding relationship between the first terminal and the second terminal; A second module is used to obtain display parameters of the second terminal; wherein the display parameters are obtained by the second terminal after being measured by a detection device; A third module is configured to, in response to acquiring the image data transmitted by the first terminal, convert the image data based on the display parameter to obtain a target image; The fourth module is used to transmit the target image to the second terminal for display in response to the display request of the second terminal.

13. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the method according to any one of claims 1 to 6 is implemented.

14. A non-transitory computer-readable storage medium, characterized in that: The non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to implement the method according to any one of claims 1 to 6.

Images