Interactive multi-screen display system and method based on optical fiber recombination

Abstract

The invention discloses an interactive multi-screen display system and method based on optical fiber recombination, and the method comprises the steps: measuring the forward background illuminance of each optical fiber port in real time through a photoelectric sensor, synchronizing the forward background illuminance with the real-time measurement data of the light-emitting brightness of the optical fiber ports, and generating a corresponding relation table between the background illuminance and the port brightness; and calculating the real-time contrast of each optical fiber port, and performing curve fitting on the contrast change in a set time period. And grading the contrast fluctuation curve according to a set threshold value, determining priority partitions of optical fiber ports with different contrast ratios, and generating a port mapping recombination table. And according to the port mapping recombination table, controlling the FPGA to adjust the corresponding LED driving current and the PWM duty ratio according to the priority partition, and adjusting the light-emitting brightness and the color temperature of the optical fiber port. And when the adjusted emergent light brightness and color temperature of the optical fiber port do not meet the preset contrast requirement, adjusting the detail density and line width of a display picture of the optical fiber port with the contrast lower than a set contrast threshold value in picture generation logic.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of optical fiber reorganization, and more particularly relates to an interactive multi-screen display system and method based on optical fiber reorganization. BACKGROUND

[0002] With the development of economy and modern science and technology, the demand for communication services is increasing rapidly, and optical fibers are constantly evolving and have been widely used in large shopping malls, airports, museums and other places.

[0003] Currently, large shopping malls, airports and museums have skylights or full glass curtain walls during the day, and optical fiber devices are usually arranged in strong backlight areas. However, the end face of the optical fiber is quasi-Lambertian light emission, and the background illuminance under backlight conditions is much higher than the port exit luminance, so the visual effect of "light emitting point being swallowed by white background" is more likely to occur locally; with the change of the solar elevation angle, the contrast curve fluctuates significantly within a day, and the same dynamic effect will present completely different clarity in the afternoon and evening.

[0004] Therefore, it is necessary to provide a dynamic interactive optical fiber reorganization display system, which can control the change of the mapping relationship between the FPGA chip and each LED unit when the picture needs to realize moving, deformation, rotation, splitting, multi-screen partition switching, local highlight, real-time interactive response and other effects, and realize dynamic interactive optical fiber reorganization. SUMMARY

[0005] In order to solve the problems in the prior art, the present application aims to solve the above-mentioned defects, and further provides an interactive multi-screen display system and method based on optical fiber reorganization.

[0006] The present application adopts the following technical solutions.

[0007] The present application discloses an interactive multi-screen display system based on optical fiber reorganization, which comprises: A photoelectric sensor is arranged at each optical fiber port position for real-time measurement of the background illuminance of the optical fiber port, and is synchronized with the optical fiber port light emission brightness to generate a corresponding relationship between the background illuminance and the port brightness; A contrast calculation and curve fitting unit is used to calculate the real-time contrast of each optical fiber port according to the corresponding relationship between the background illuminance and the port brightness, and to perform curve fitting on the contrast change within a set time period; A grade division and mapping reorganization unit is used to divide the contrast fluctuation curve according to a set threshold, and to perform priority partitioning of each optical fiber port based on the divided grades, while generating a port mapping reorganization table corresponding to each priority partition; A dynamic compensation unit is configured to control the FPGA to adjust the driving current and PWM duty cycle of the corresponding LED according to the priority partition of the port mapping reorganization table, so as to adjust the light brightness and color temperature of the fiber port. A backlight adjustment unit is configured to adjust the detail density and line width of the display picture of the fiber port with a contrast ratio lower than a set contrast ratio threshold in the picture generation logic.

[0008] The second aspect of the present application discloses an interactive multi-screen display method based on fiber reorganization, which is implemented by the interactive multi-screen display system based on fiber reorganization of the first aspect. The method comprises: A photoelectric sensor is used to measure the background illumination of each fiber port in real time, and the real-time measurement data of the light brightness of the fiber port is processed synchronously to generate a corresponding relationship table of the background illumination and the port brightness. Based on the corresponding relationship table of the background illumination and the port brightness, the real-time contrast ratio of each fiber port is calculated, and the contrast ratio change in a set time period is curve-fitted to obtain a contrast ratio fluctuation curve. The contrast ratio fluctuation curve is divided into levels according to a set threshold to determine the priority partition of the fiber port with different contrast ratios, and a port mapping reorganization table is generated based on the priority partition. According to the port mapping reorganization table, the FPGA is controlled to adjust the driving current and PWM duty cycle of the corresponding LED according to the priority partition, so as to adjust the light brightness and color temperature of the fiber port. When the adjusted light brightness and color temperature of the fiber port do not meet the preset contrast ratio requirement, the detail density and line width of the display picture of the fiber port with a contrast ratio lower than a set contrast ratio threshold are adjusted in the picture generation logic.

[0009] Further, the background illumination of each fiber port is measured in real time by a photoelectric sensor, and the real-time measurement data of the light brightness of the fiber port is processed synchronously to generate a corresponding relationship table of the background illumination and the port brightness, which comprises: A photoelectric sensor is arranged at the position of each fiber port, and the light sources of all LED ports are turned off to call the photoelectric sensor to measure the background illumination of each fiber port. The LED light sources corresponding to each fiber port are turned on to call the photoelectric sensor to measure the light brightness of each fiber port, and the background illumination and light brightness of each fiber port are matched according to the port number by a synchronous acquisition controller to generate a corresponding relationship table of the background illumination and the port brightness.

[0010] Further, the real-time contrast ratio of each fiber port is calculated based on the corresponding relationship table of the background illumination and the port brightness, and the contrast ratio change in a set time period is curve-fitted to obtain a contrast ratio fluctuation curve, which comprises: timestamp alignment is performed on the correspondence table of the background illuminance and the port brightness, and missing value filling is performed on the correspondence table by linear interpolation to obtain an aligned sample sequence; The contrast of each optical fiber port at each time point in the aligned sample sequence is calculated, and in a sliding window unit, a robust standardization score is calculated according to the median and absolute median difference of the contrast in the sliding window, and quantile clipping is performed to obtain a cleaned contrast sequence; The cleaned contrast sequence is smoothed by a first-order exponential, and a harmonic model is established in the set time period, and the model parameters are estimated by least squares to construct the contrast fluctuation curve.

[0011] Further, the contrast fluctuation curve is divided into different priority partitions according to the set threshold to determine the priority partition of different contrast optical fiber ports, and a port mapping reorganization table is generated based on the priority partition, including: In a given prediction time and future evaluation window, the minimum prediction contrast in the future evaluation window is selected, and the minimum prediction contrast is normalized with the current contrast to output the risk score of each optical fiber port; Based on the risk score of each optical fiber port, all optical fiber ports are divided into different priority partitions according to the set threshold, and the optical fiber ports in each priority partition are marked and spatially smoothed according to the corresponding partition to obtain a partition label set; According to the partition label set, determine the content fragments under different labels and the weight coefficients corresponding to each content fragment to calculate the adaptation utility of each content fragment mapped to the optical fiber port, and combine the capacity constraint of the optical fiber port and the content fragment size constraint to construct the port mapping reorganization table.

[0012] Further, according to the port mapping reorganization table, the driving current and PWM duty cycle of the corresponding LED are controlled by the FPGA according to the priority partition to adjust the light output brightness and color temperature of the optical fiber port, including: When the contrast at any time on the contrast fluctuation curve is lower than the lower limit of the target contrast, the light output brightness of the corresponding optical fiber port is adjusted to output the target light output brightness; The driving current and PWM duty cycle of the corresponding LED are adjusted by the first-order brightness model to output the target duty cycle and target driving current, and the color temperature is adjusted according to the backlight intensity to obtain the target color temperature.

[0013] Further, according to the port mapping reorganization table, the driving current and PWM duty cycle of the corresponding LED are controlled by the FPGA according to the priority partition to adjust the light output brightness and color temperature of the optical fiber port, including: The target color temperature is normalized in a preset linear interval to obtain an interpolation factor, and a white balance gain coefficient is calibrated according to the interpolation factor to output a channel gain vector. The issued instruction is smoothed by a first-order low-pass filter, and the FPGA is controlled to adjust the driving current and PWM duty cycle of the corresponding LED according to the priority partitioning of the port mapping reorganization table in response to the smoothed issued instruction, so as to adjust the light output brightness and color temperature of the fiber port.

[0014] Further, when the adjusted light output brightness and color temperature of the fiber port do not meet the preset contrast requirement, the detail density and line width of the display picture of the fiber port with a contrast lower than a set contrast threshold are adjusted in picture generation logic, including: When the adjusted light output brightness and color temperature of the fiber port do not meet the preset contrast requirement, the contrast residual of the fiber port is calculated based on the target contrast lower limit and the current contrast of the port, and the contrast residual is linearly mapped to obtain a compression ratio coefficient. The line width amplification ratio coefficient is calculated according to the compression ratio coefficient, so as to down-sample the pixel block mapped to the fiber port in picture generation logic, and perform inflation operation on the contour line after edge detection, to generate an adjusted picture data frame and a port update mapping table.

[0015] The third aspect of the present application discloses a terminal, comprising a processor and a storage medium. The storage medium is used to store instructions. The processor is used to operate according to the instructions to perform the steps of the method of the second aspect.

[0016] The fourth aspect of the present application discloses a computer readable storage medium, which stores a computer program, and the program is executed by a processor to realize the steps of the method of the second aspect.

[0017] The present application has the following advantages compared with the prior art: (1) The present application measures the background illuminance of the port in real time by arranging a photoelectric sensor at each fiber port position, and simultaneously records the real-time measurement data of the fiber port light output brightness to generate a background illuminance-port brightness correspondence table, thereby providing real-time light environment data basis for subsequent backlight compensation strategy.

[0018] (2) According to the corresponding relationship between the background illumination of each optical fiber port and the port brightness, the real-time contrast of each port is calculated, the change in a day is curve-fitted to obtain a dynamic fluctuation curve of the contrast, and the change characteristics of the port contrast at different time periods and different solar elevation angles can be accurately identified. Meanwhile, the contrast curve is divided into grades according to the set threshold, so that the low-contrast port is classified into the priority compensation area, the high-contrast port is classified into the maintenance area, and a new port mapping reorganization table is generated, so that the key picture details are preferentially distributed to the ports in the priority compensation area, the mapping relationship between the LED and the optical fiber port is adjusted at the logical level, and the important content is distributed on the port with better optical conditions as much as possible.

[0019] (3) Based on the priority area port list, the driving current and the PWM duty cycle of the corresponding LED are adjusted by controlling the FPGA to improve the light brightness of the optical fiber port, and the color temperature is adjusted synchronously, so that the light output obtains higher visual sensitivity under the backlight condition, the recognition degree of the light output of the port under the backlight environment is improved at the physical level, and the white background swallowing effect is reduced. Subsequently, when the compensation is still insufficient to meet the contrast requirement, the detail density and line width of the picture displayed by the low-contrast port can be reduced in the picture generation logic, part of the details is sacrificed under the backlight limit condition, the visibility of the picture main structure is obtained, and the recognizability of the dynamic effect is ensured. BRIEF DESCRIPTION OF DRAWINGS

[0020] Figure 1 It is a flowchart of the interactive multi-screen display method based on optical fiber reorganization of the present application; Figure 2 It is a hardware structure schematic diagram of the interactive multi-screen display system based on optical fiber reorganization in the specific embodiment of the present application; Figure 3 It is a position relationship schematic diagram of the LED unit, the condensing lens assembly and the optical fiber in the specific embodiment of the present application; Figure 4A It is a whole architecture schematic diagram of the interactive multi-screen display system based on optical fiber reorganization in the specific embodiment of the present application; Figure 4B It is a light compensation algorithm module framework schematic diagram of the interactive multi-screen display system based on optical fiber reorganization of the present application; Figure 5 It is a logic flow schematic diagram of the main controller executing the interactive function in the specific embodiment of the present application. DETAILED DESCRIPTION

[0021] The present application will be further described below in conjunction with the drawings. The following embodiments are only used to more clearly illustrate the technical solutions of the present application, and cannot be used to limit the protection scope of the present application.

[0022] As Figure 1As shown, in one embodiment, an interactive multi-screen display method based on fiber reorganization includes the following steps: Step S110, the background illumination of each fiber port is measured in real time by the photoelectric sensor, and the real-time measurement data of the light brightness of the fiber port is processed synchronously to generate a corresponding relationship table of the background illumination and the port brightness.

[0023] In some embodiments, the interactive multi-screen display method based on fiber reorganization provided by the present application specifically includes the following steps in step S110: Step S111, a photoelectric sensor is arranged at each fiber port position, and the light source of all LED ports is turned off to call the photoelectric sensor to measure the background illumination of each fiber port.

[0024] Step S112, turn on the LED light source corresponding to each fiber port to call the photoelectric sensor to measure the light brightness of each fiber port, and match the background illumination and light brightness of each fiber port according to the port number through the synchronous acquisition controller to generate a corresponding relationship table of the background illumination and the port brightness.

[0025] In a specific embodiment, the interactive multi-screen display method based on fiber reorganization provided by the present application is realized through an interactive multi-screen display system based on fiber reorganization, as shown in Figure 2 As shown, the system includes a plurality of independent light emitting modules; each light emitting module includes: LED unit, condenser lens 104, optical fiber 106; FPGA chip 107 is used to control all light emitting modules.

[0026] Among them, the LED unit includes: LED circuit board 101 and LED lamp beads 102; the LED circuit board is connected with the FPGA chip, so as to receive the multi-channel video signal and display through the LED lamp beads; the condenser lens 104 and the optical fiber 106 are respectively fixedly arranged through the first fixing device 103 and the second fixing device 105.

[0027] Referring to Figure 3As shown, the condenser lens is used to improve the coupling efficiency of the LED unit and the optical fiber, so that the light emitted by the LED lamp bead can be transmitted by one end of the optical fiber and presented at the other end (i.e. the "optical fiber port" in the technical solution below). More specifically, the condenser lens is designed as an optical conical lens, and the optical fiber can be a plastic optical fiber or other light-guiding columnar body, such as an acrylic rod, a glass rod, etc.; the input end of the condenser lens has a diameter larger than the light-emitting surface of the LED lamp bead, and the output end has a diameter larger than the diameter of the plastic optical fiber; the plastic optical fiber is reorganized into a plurality of plastic optical fiber matrix grating screens through length changes; the plastic optical fiber matrix grating screen can have various irregular surfaces, and the main installation method is ceiling installation; the optical fiber has a diameter of 0.5-3 mm; the optical fiber adopts a straightened optical fiber natural drooping mode, and the length of the optical fiber is generally not more than 5 meters; the LED unit uses a chip-on-film LED; the corresponding LED matrix screen of the reorganized plastic optical fiber matrix grating screen is split by the controller to realize the transmission of video signals; due to the light attenuation of the plastic optical fiber and the chromatic aberration of the optical fiber with different lengths, light calculation and compensation are required, and various sensors are used to realize interactive control, thereby realizing an interactive multi-screen superimposed display effect, which is mainly used in exhibition halls, exhibitions, and indoor large-scale interactive scenes.

[0028] In combination Figure 4A and Figure 5 As shown, in the present embodiment, the light signal emitted by the LED matrix screen composed of N x M pixel units is converted into POF through the conical lens array of the optical coupling layer and sent to the optical fiber reorganization network containing a length mapping matrix, and color difference compensation data is sent to the light compensation algorithm module at the same time. The light compensation algorithm module corrects the contrast attenuation difference, and after correction, the data of the optical fiber after correction of the attenuation difference is sent to the irregular optical fiber display terminal composed of K independent screens for correction of optical fiber display. In addition, the LED matrix screen simultaneously sends control signals to the main controller by executing infrared-positioning touch points or acoustic control, and the main controller triggers the sensor to determine whether the control signal type at this time is infrared type or acoustic wave type corresponding to the acoustic control. If the control signal is of infrared type, the infrared signal positioning touch point is located, and the touch point is mapped to the LED matrix coordinate, and the controller then performs light splitting output; if the control signal is of acoustic wave type, the corresponding voice instruction of the current acoustic wave is analyzed, and the corresponding brightness or color adjustment is performed after analysis.

[0029] However, since the LED matrix screen is flat, assuming the final display screen (i.e., the heterogeneous fiber optic display terminal) is an irregular shape, existing physical initial reorganization methods are typically limited to the shape of the plastic fiber optic matrix grid screen (i.e., the heterogeneous fiber optic display terminal), and their purpose is to maintain uniform visual density on the final irregular surface. Dynamic interactive reorganization refers to the logical reorganization of the fibers. For example, when the image needs to achieve special effects such as movement, deformation, rotation, splitting, multi-screen partition switching, local highlighting, and real-time interactive response, the mapping relationship between the FPGA chip and each LED unit needs to be changed.

[0030] like Figure 4B As shown, in this embodiment, the optical compensation algorithm module of the interactive multi-screen display system based on optical fiber recombination includes: The photoelectric sensor is set at each optical fiber port position to measure the background illumination in the forward direction of the optical fiber port in real time and synchronize it with the brightness of the light output from the optical fiber port to generate a corresponding relationship between the background illumination and the port brightness.

[0031] The contrast calculation and curve fitting unit is used to calculate the real-time contrast of each optical fiber port according to the corresponding relationship between the background illumination and the port brightness, and to perform curve fitting on the contrast change within a set time period.

[0032] The grading and mapping reorganization unit is used to grade the contrast fluctuation curve according to the set threshold, and to prioritize each optical fiber port based on the grade after the grade, and to generate a port mapping reorganization table corresponding to each priority partition.

[0033] The dynamic compensation unit is used to control the FPGA to adjust the driving current and PWM duty cycle of the corresponding LED according to the priority partition based on the port mapping reorganization table, so as to adjust the light brightness and color temperature of the optical fiber port.

[0034] The backlight adjustment unit is used to adjust the detail density and line width of the optical fiber port display image whose contrast is lower than the set contrast threshold in the image generation logic.

[0035] In this embodiment, steps 1 to 5 are included: Step 1: Collect the basic brightness and background illumination of the optical fiber port.

[0036] At each fiber optic port, a photoelectric sensor is placed to measure the background illumination in the forward direction of the port in real time. At the same time, the real-time measurement data of the light output brightness of the fiber optic port is called. The above two data are recorded synchronously to generate a corresponding relationship table between background illumination and port brightness, providing a real-time light environment data foundation for subsequent backlight compensation strategies. The following sub-steps are included: Sub-step 1.1: Layout and numbering of photoelectric sensors.

[0037] Specifically, photoelectric sensors are installed in front of each fiber port, ensuring that the angle between the sensor optical axis and the fiber port light axis is not greater than 2°. The photoelectric sensor adopts a photoelectric detector + optical filter structure, the filter bandwidth is 400-700 nm, which is used to match the LED spectrum, and the photoelectric sensor is connected to the data acquisition module (DAQ) through a shielded wire, and the DAQ is connected to the control unit (FPGA / industrial computer).

[0038] Sub-step 1.2, background illumination measurement.

[0039] Specifically, all LED port light sources are turned off, the output voltage of the photoelectric sensor is read, and the output voltage is converted using the sensor calibration coefficient to obtain the corresponding background illumination.

[0040] Sub-step 1.3, port light brightness measurement.

[0041] Specifically, the corresponding LED unit of the fiber port is turned on to enter the rated working state, the output voltage of the corresponding photoelectric sensor at this time is read, and the output voltage is converted again using the sensor calibration coefficient to obtain the corresponding light brightness.

[0042] Sub-step 1.4, background illumination and light brightness data synchronization.

[0043] Specifically, the sampling time of the background illumination and the port light brightness is ensured to be no more than 50 ms by the synchronous acquisition controller, the two sets of data are matched according to the port number, and the corresponding relationship between the two sets of data is generated, and finally the corresponding relationship table of the background illumination and the port light brightness of all fiber ports is obtained.

[0044] Step S120, based on the corresponding relationship table of the background illumination and the port brightness, the real-time contrast of each fiber port is calculated, and the contrast change in the set time period is curve fitted to obtain the contrast fluctuation curve.

[0045] In some embodiments, the present application provides an interactive multi-screen display method based on fiber reorganization, and step S120 specifically includes the following steps: Step S121, time stamp alignment of the corresponding relationship table of the background illumination and the port brightness, and missing value filling of the corresponding relationship table by linear interpolation method to obtain an aligned sample sequence.

[0046] Step S122, calculating the contrast of each fiber port at each time point in the aligned sample sequence, and performing quantile clipping on the robust standardized score calculated according to the median and absolute median difference of the contrast in the sliding window in units of sliding window to obtain a cleaned contrast sequence.

[0047] Step S123, smooth the contrast sequence after cleaning by first-order exponential, and establish a harmonic model with a set time period, combine the least square estimation model parameters, and construct the contrast fluctuation curve.

[0048] In a specific embodiment, the present application provides an interactive multi-screen display method based on fiber recombination, step 2, port contrast calculation and dynamic fluctuation curve generation. According to the background illumination and port brightness output by step 1, the real-time contrast of each port is calculated, and the curve fitting of the change within a day is carried out to obtain the dynamic fluctuation curve of the contrast, which accurately identifies the change characteristics of the port contrast under different time periods and different solar elevation angles, and provides the basis for compensation range and priority judgment. Including the following sub-steps: Substep 2.1, time alignment and sequence construction.

[0049] Specifically, the unified clock (NTP synchronization or GPS time service) is used to align the sampling time stamps of each channel, and the missing samples are filled to a fixed sampling interval (such as 100ms-1s) by linear interpolation, while the samples exceeding the sampling interval and the saturated samples are removed, and finally the aligned sample sequence is obtained.

[0050] Substep 2.2, instantaneous contrast calculation.

[0051] Specifically, the contrast of the fiber port at each time point in the aligned sample sequence is calculated (Michelson type is adopted, and a numerical stability term is added), and the expression is: ; In the formula, , , are the background illumination, light output brightness and contrast of the i-th port at the k-th time stamp , respectively, with the unit of cd / m 2 ; is a stability constant, which is used to avoid too small denominator, and the value range is 0.1-5.0 (cd / m 2 ), which is set according to the sensor noise floor.

[0052] Substep 2.3, robust denoising and outlier removal.

[0053] Specifically, in the sliding window unit (such as 5-30s), the median and absolute median deviation of the port contrast in the window are calculated, and then the robust standardized score is calculated and quantile clipping is done, and the expression is: ; ; In the formula, is the absolute median deviation, is the median of the port contrast, is the robust normalized score, if , If the value range is 2-4, the corresponding sampling point will be regarded as an outlier and replaced with the neighborhood median, and finally the cleaned contrast sequence will be obtained.

[0054] Sub-step 2.4, time smoothing and trend extraction.

[0055] Specifically, the first-order exponential is used to perform online smoothing on the cleaned contrast sequence, and the expression is: ; Where, is the smoothing coefficient, ranging from 0.05 to 0.3; is the port contrast after cleaning; is the smoothed contrast, and Initialized to the mean contrast value of the first window.

[0056] Sub-step 2.5: daily cycle fitting and dynamic fluctuation curve generation.

[0057] Specifically, considering that sunlight has significant periodicity, a harmonic model is established with a daily period of D = 86400 seconds, and the model parameters are estimated using least squares to finally generate the contrast fluctuation curve , the expression is: ; Where, is the daily average contrast baseline, is the daily fluctuation amplitude; The phase is used to reflect the time when the peak occurs (for example, backlight is strongest in the afternoon). A second harmonic term can be added to improve the fit. The output also records the residual statistics and the peak and valley time points for subsequent time-based control of compensation strategies.

[0058] Step S130 , classifying the contrast fluctuation curve according to a set threshold value to determine priority partitions of optical fiber ports with different contrasts, and generating a port mapping reorganization table based on the priority partitions.

[0059] In some embodiments, the interactive multi-screen display method based on optical fiber recombination provided by the present invention, step S130 specifically includes the following steps: Step S131 : within a given prediction time and future evaluation window, selecting the minimum prediction contrast within the future evaluation window, and normalizing the minimum prediction contrast with the current contrast to output the risk score of each optical fiber port.

[0060] Step S132: Based on the risk score of each fiber port, all fiber ports are divided into different priority zones according to a set threshold, and the fiber ports in each priority zone are marked and spatially smoothed to obtain a zone label set.

[0061] Step S133 , determining content segments under different tags and weight coefficients corresponding to each content segment based on the partition tag set, so as to calculate the adaptation utility of mapping each content segment to the fiber port, and constructing a port mapping reorganization table in combination with the capacity constraint of the fiber port and the content segment size constraint.

[0062] In a specific embodiment, the present invention provides an interactive multi-screen display method based on optical fiber reorganization, in step 3, port priority partitioning and mapping reorganization table generation. The contrast curve of step 2 is divided into levels according to the set threshold, low-contrast ports are divided into priority compensation areas, and high-contrast ports are divided into maintenance areas. A new port mapping reorganization table is generated so that key picture details are preferentially allocated to ports in the priority compensation area. Step 3 adjusts the mapping relationship between LED units and optical fiber ports at the logical level so that important content is distributed as much as possible on ports with better optical conditions. It includes the following sub-steps: Sub-step 3.1, contrast risk quantification and normalization.

[0063] Specifically, based on the contrast fluctuation curve obtained in step 2 , within a given test moment and future evaluation window (e.g., 10-30 minutes), take the predicted minimum contrast within the window and the current contrast and normalize them with the stability constant. The expression is: ; ; ; Where, is the current normalized contrast of port i, is the normalized value of the contrast fluctuation amplitude within the evaluation window W; is the risk score, are the global minimum and maximum contrast in the historical runs, respectively; 、 is the weight coefficient, and the sum of the two is equal to 1.

[0064] Sub-step 3.2: threshold classification and initial partitioning.

[0065] Specifically, based on the risk score obtained in sub-step 3.1, the fiber port is divided into three zones by quantiles or set thresholds, namely priority compensation zone ( ), Observation Area ( ) and the maintenance zone ( ), and finally mark the port contrasts in each partition according to the partition type to construct the initial partition label set. Take the 50% percentile or empirical threshold of the risk score, Take the 80%-90% percentile or empirical threshold of the risk score.

[0066] Sub-step 3.3: spatial consistency smoothing and cluster merging.

[0067] Specifically, based on the constructed initial partition label set and the spatial coordinates of the fiber ports, an adjacency matrix is ​​constructed to measure the spatial neighbor influence. If the distance between two ports is less than the set distance, the two ports are determined to be adjacent ports and assigned a value of 1, otherwise a value of 0 is assigned. Afterwards, the values ​​assigned to the two ports are combined with the risk scores of the ports for neighborhood averaging to obtain the corresponding spatial smoothing score. , the expression is: ; Where, Assign the value of port i and j, which can be 0 or 1; use spatial smoothing to score Re-execute sub-step 3.2 to perform threshold classification, and at the same time, merge the isolated single-point priority compensation area into the nearest similar cluster or downgrade it to the observation area.

[0068] Sub-step 3.4: Modeling content importance and port adaptation utility.

[0069] Specifically, based on the spatially smoothed partition label set, the content segments under each partition label and their corresponding importance are determined, and the utility of mapping to the fiber port is calculated for each content segment to construct a utility matrix, which is expressed as: ; Where, Slice the content The utility mapped to port i; is the importance of the content, ranging from 0 to 1; is the weighting coefficient of the priority compensation area, ranging from 0.2 to 1.0; is the indicator function; is the basic fidelity factor, ranging from 0.2-0.8.

[0070] Sub-step 3.5: Mapping reorganization optimization and generation of reorganization table.

[0071] Specifically, based on the utility matrix obtained in sub-step 3.4, combined with the port capacity constraint and the content segment size constraint, the total utility is maximized under the capacity and size constraints, and an extension of the Hungarian algorithm or a heuristic greedy algorithm can be used to construct a lookup table of LED pixel index→fiber port index, and finally generate a mapping reorganization table and an FPGA lookup table.

[0072] In step S140, the driving current and PWM duty cycle of the corresponding LED are controlled according to the port mapping reorganization table and priority partitioning to adjust the light output brightness and color temperature of the fiber port.

[0073] In some embodiments, the interactive multi-screen display method based on fiber reorganization provided by the present application specifically comprises the following steps in step S140: In step S141, when the contrast at any time on the contrast fluctuation curve is lower than the target contrast lower limit, the light output brightness of the corresponding fiber port is adjusted to output the target light output brightness.

[0074] In step S142, the driving current and PWM duty cycle of the corresponding LED are adjusted through a first-order brightness model to output the target duty cycle and target driving current, and the color temperature is adjusted according to the backlight intensity to obtain the target color temperature.

[0075] In some embodiments, the interactive multi-screen display method based on fiber reorganization provided by the present application specifically further comprises the following steps in step S140: In step S143, the target color temperature is normalized in a preset linear interval to obtain an interpolation factor, and the white balance gain coefficient is calibrated according to the interpolation factor to output a channel gain vector.

[0076] In step S144, the issued instruction is smoothed through a first-order low-pass filter, and the FPGA is controlled to adjust the driving current and PWM duty cycle of the corresponding LED according to the smoothed issued instruction and the port mapping reorganization table according to the priority partitioning to adjust the light output brightness and color temperature of the fiber port.

[0077] In a specific embodiment, the interactive multi-screen display method based on fiber reorganization provided by the present application, step 4, brightness and color temperature dynamic compensation control. Based on the priority zone port list of step 3, the driving current and PWM duty cycle of the corresponding LED unit are adjusted to improve the light output brightness, and the color temperature is adjusted synchronously to obtain higher visual sensitivity of the light output under the backlight condition. Step 4 improves the recognition of the port light output under the backlight environment at the physical level, and reduces the white background swallowing effect. Including the following sub-steps: Sub-step 4.1, target contrast backstepping port target brightness.

[0078] Specifically, when the contrast value on the port contrast curve is less than the target contrast lower limit (range 0.15-0.35), the corresponding port needs to improve the light brightness, and the target light brightness can be deduced from the contrast definition , the expression is: ; In the formula, is the current background illumination of the i-th port, if the contrast value on the port contrast curve is greater than or equal to the target contrast lower limit , then .

[0079] Sub-step 4.2, luminance-drive parameter solving (drive current and duty cycle coordination).

[0080] Specifically, a first-order luminance model (obtained through factory calibration) is used, and the expression is: ; In the formula, is the overall light efficiency of the i-th port (unit: cd / m 2 ·mA -1 ·duty cycle -1 ), including optical coupling and optical fiber loss; is the constant current drive current (mA); is the PWM duty cycle (range: 0-1).

[0081] The PWM duty cycle is preferentially adjusted downward without increasing the drive current, and the expression is: ; In the formula, is the nominal drive current; is the upper limit of the duty cycle, is the target duty cycle.

[0082] If , then increase the drive current under the fixed: ; If it is still insufficient after reaching the upper limit, mark the port as "limit compensation" and leave it for subsequent detailed density and line width adjustment.

[0083] Sub-step 4.3, color temperature improvement and channel gain solving (white balance interpolation).

[0084] Specifically, the target related color temperature is adjusted according to the backlight intensity: ;

[0085] In the formula, is the target color temperature, for the base color temperature (e.g., 5000-6000K), and a color temperature up-regulation coefficient (every 1000cd / m 2 up to 600K, as the lower and upper limits of the color temperature.

[0086] Then, the target color temperature is normalized in a linear interval to obtain a corresponding interpolation factor, and the interpolation factor is used to interpolate between the two-point calibration gains (3000K and 6500K) obtained by combining the factory spectrum and the two-point calibration gains calibrated according to the human eye visual weighting to finally output a channel gain vector.

[0087] Sub-step 4.4, instruction shaping and rate limiting (to avoid flicker and jitter).

[0088] Specifically, the issued instruction of the previous period is obtained, and a first-order low-pass rate limiting is used to smooth the issued instruction according to the target duty cycle, the target driving current and the channel gain vector obtained in the foregoing, to obtain a smoothed issued instruction. The PWM carrier frequency is forced to be not less than 2Hz, and the gray scale update is synchronized with the video frame (e.g., 60Hz), to avoid large step jumps of the issued instruction and eliminate visible flicker at the same time.

[0089] Sub-step 4.5, FPGA mapping driving link issuing and linkage verification.

[0090] Specifically, in the FPGA, the address mapping of “pixel→port” is first completed by using LUT, and then the smoothed issued instruction of each port is written into the corresponding register queue, the PWM generator outputs the corresponding duty cycle, the constant current driving chip sets the channel current, and the RGB channel is scaled according to the smoothed channel gain. If the port temperature or the total power consumption approaches the upper limit, the power is automatically reduced, and those that do not meet the standard are added to the “limit compensation” list for subsequent detail density and line width adjustment.

[0091] Step S150, when the light output brightness and color temperature of the adjusted fiber port do not meet the preset contrast requirement, adjusting the detail density and line width of the display picture of the fiber port with a contrast lower than the set contrast threshold in the picture generation logic.

[0092] In some embodiments, the interactive multi-screen display method based on fiber recombination provided by the present application specifically comprises the following steps: Step S151, when the light output brightness and color temperature of the adjusted fiber port do not meet the preset contrast requirement, calculating the contrast residual of the fiber port based on the target contrast lower limit and the current contrast of the port, and performing linear mapping on the contrast residual to obtain a compression ratio coefficient.

[0093] Step S152, according to the compression ratio coefficient, the line width amplification coefficient is calculated, to reduce the sampling in the picture generation logic to the pixel block mapped to the fiber port, and after edge detection, the contour line is expanded, and the adjusted picture data frame and the port update mapping table are generated.

[0094] In a specific embodiment, the present application provides an interactive multi-screen display method based on fiber reorganization, step 5, detail density and line width adjustment under backlight limit condition. When step 4 compensation is still insufficient to meet the contrast requirement, the detail density and line width of the picture displayed by the low contrast port are reduced in the picture generation logic, so that the visual recognition rate of the port under strong backlight is improved. Step 5 sacrifices part of the details under the condition of limit backlight, in exchange for the visibility of the main structure of the picture, to ensure the distinguishability of dynamic special effects, including the following sub-steps: Sub-step 5.1, limit backlight port screening and residual error calculation.

[0095] Specifically, the contrast residual error is calculated for each limit compensation port, and the contrast residual error is the difference between the target contrast lower limit and the actual contrast after step 4 compensation.

[0096] Sub-step 5.2, detail density compression and compression coefficient calculation.

[0097] Specifically, according to the contrast residual error Linear mapping compression ratio, get detail compression coefficient , the expression is: ;

[0098] In the formula, is the density compression sensitivity coefficient, ranging from 0.5 to 1.0; The smaller, the less details; 、 is the lower limit and upper limit of the allowed compression ratio range.

[0099] Sub-step 5.3, line width amplification coefficient calculation.

[0100] Specifically, according to the detail compression coefficient Reverse calculation of line width amplification ratio, get line width amplification coefficient , the expression is: ; In the formula, is the line width amplification sensitivity coefficient, ranging from 0.5 to 1.5; The larger, the thicker the edge and key structure line.

[0101] Sub-step 5.4, picture generation logic adjustment and port mapping update.

[0102] Specifically, in the picture generation logic, the pixel block mapped to the fiber port is down-sampled, the sampling ratio is ; after edge detection, the contour line is dilated, the magnification is ; finally, a new frame is generated, the compressed pixel block is re-bound to the corresponding fiber port in combination with the aforementioned mapping reorganization table, the updated port mapping table and the adjusted picture data frame are obtained.

[0103] Sub-step 5.5, dynamic verification and load shedding closed loop.

[0104] Specifically, according to the updated port mapping table and the adjusted picture data frame obtained in sub-step 5.4, the outlet brightness and background illumination of the fiber port are collected in real time, and then the adjusted actual contrast is calculated, if the calculated contrast is greater than or equal to the target contrast, it is marked as meeting the standard, otherwise it is added to the "limit compensation" list, and the details density and line width adjustment are continued to be executed, and the maximum amplitude of the load shedding parameter is reserved for the next cycle iteration.

[0105] The applicant of the present application has made a detailed description and explanation of the embodiments of the present application in combination with the drawings of the specification, but those skilled in the art should understand that the above embodiments are only preferred embodiments of the present application, and the detailed description is only to help the reader better understand the spirit of the present application, and is not a limitation on the protection scope of the present application, on the contrary, any improvement or modification based on the spirit of the present application should fall within the protection scope of the present application.

Claims

1. An interactive multi-screen display method based on optical fiber recombination, characterized in that: The method comprises: The background illumination in the forward direction of each optical fiber port is measured in real time by a photoelectric sensor, and is synchronously processed with the real-time measurement data of the optical fiber port light brightness to generate a corresponding relationship table between the background illumination and the port brightness; Based on the corresponding relationship table between background illumination and port brightness, the real-time contrast of each optical fiber port is calculated, and the contrast change within a set time period is curve fitted to obtain a contrast fluctuation curve; Classifying the contrast fluctuation curve according to a set threshold value to determine priority partitions of optical fiber ports with different contrast ratios, and generating a port mapping reorganization table based on the priority partitions; According to the port mapping reorganization table, the FPGA is controlled according to the priority partition to adjust the driving current and PWM duty cycle of the corresponding LED to adjust the light output brightness and color temperature of the optical fiber port; When the adjusted light output brightness and color temperature of the optical fiber port do not meet the preset contrast requirement, the detail density and line width of the display image of the optical fiber port with a contrast lower than the set contrast threshold are adjusted in the image generation logic.

2. The interactive multi-screen display method based on optical fiber recombination according to claim 1, characterized in that: The photoelectric sensor measures the background illumination in the forward direction of each optical fiber port in real time, and synchronizes the measurement data with the real-time measurement data of the brightness of the light emitted from the optical fiber port to generate a corresponding relationship table between the background illumination and the port brightness, including: A photoelectric sensor is set at each optical fiber port position, and the light sources of all LED ports are turned off to call the photoelectric sensor to measure the background illumination in the forward direction of each optical fiber port; Turn on the LED light source corresponding to each fiber optic port to call the photoelectric sensor to measure the light output brightness of each fiber optic port, and match the background illumination and light output brightness of each fiber optic port according to the port number through the synchronous acquisition controller to generate a corresponding relationship table between background illumination and port brightness.

3. The interactive multi-screen display method based on optical fiber recombination according to claim 2, characterized in that: The method of calculating the real-time contrast of each optical fiber port based on the corresponding relationship table between the background illumination and the port brightness, and performing curve fitting on the contrast change within a set time period to obtain a contrast fluctuation curve includes: Performing timestamp alignment on the correspondence table between the background illumination and the port brightness, and filling missing values ​​in the correspondence table by linear interpolation to obtain an aligned sample sequence; Calculate the contrast of each fiber port at each time point in the aligned sample sequence, and calculate the robust normalized score based on the median and absolute median difference of the contrast within the sliding window in units of sliding windows, and perform quantile clipping to obtain a cleaned contrast sequence; The cleaned contrast sequence is smoothed by first-order exponential processing, and a harmonic model is established in the set time period. The contrast fluctuation curve is constructed by combining the least squares estimation model parameters.

4. The interactive multi-screen display method based on optical fiber recombination according to claim 1, characterized in that: The step of classifying the contrast fluctuation curve according to a set threshold value to determine priority partitions of optical fiber ports with different contrast ratios, and generating a port mapping reorganization table based on the priority partitions, comprises: At a given prediction moment and in a future evaluation window, selecting the minimum predicted contrast within the future evaluation window, and normalizing the minimum predicted contrast with the current contrast to output a risk score for each fiber port; Based on the risk score of each fiber port, all fiber ports are divided into different priority zones according to the set threshold. The fiber ports in each priority zone are marked and spatially smoothed to obtain a zone label set. The content segments under different labels and the weight coefficients corresponding to the content segments are determined according to the partition label set to calculate the adaptation utility of mapping each content segment to the optical fiber port, and the port mapping reorganization table is constructed in combination with the capacity constraint of the optical fiber port and the content segment size constraint.

5. The interactive multi-screen display method based on optical fiber recombination according to claim 1, characterized in that: The control of the FPGA to adjust the driving current and PWM duty cycle of the corresponding LED according to the priority partition according to the port mapping reorganization table to adjust the light output brightness and color temperature of the optical fiber port includes: When the contrast at any moment on the contrast fluctuation curve is lower than the target contrast lower limit, the light output brightness of the corresponding optical fiber port is adjusted to output the target light output brightness; The driving current and PWM duty cycle of the corresponding LED are adjusted through the first-order brightness model to output the target duty cycle and target driving current, and the color temperature is adjusted according to the backlight intensity to obtain the target color temperature.

6. The interactive multi-screen display method based on optical fiber recombination according to claim 5, characterized in that: The method further includes controlling the FPGA to adjust the driving current and PWM duty cycle of the corresponding LED according to the priority partition based on the port mapping reorganization table to adjust the light output brightness and color temperature of the optical fiber port. Normalizing the target color temperature within a preset linear interval to obtain an interpolation factor, and calibrating the white balance gain coefficient according to the interpolation factor to output a channel gain vector; The issued instructions are smoothed by a first-order low-pass filter, and the FPGA is controlled to adjust the driving current and PWM duty cycle of the corresponding LED in response to the smoothed issued instructions according to the priority partition according to the port mapping reorganization table to adjust the light output brightness and color temperature of the optical fiber port.

7. The interactive multi-screen display method based on optical fiber recombination according to claim 5, characterized in that: When the adjusted light output brightness and color temperature of the optical fiber port do not meet the preset contrast requirement, adjusting the detail density and line width of the display image of the optical fiber port having a contrast lower than the set contrast threshold in the image generation logic includes: When the adjusted light output brightness and color temperature of the optical fiber port do not meet the preset contrast requirement, the contrast residual of the optical fiber port is calculated based on the target contrast lower limit and the current contrast of the port, and the contrast residual is linearly mapped to obtain a compression ratio coefficient; The line width magnification coefficient is calculated according to the compression coefficient to downsample the pixel blocks mapped to the optical fiber port in the picture generation logic, and the contour lines are expanded after edge detection to generate the adjusted picture data frame and the port update mapping table.

8. An interactive multi-screen display system based on optical fiber recombination, characterized in that: For implementing the interactive multi-screen display method based on optical fiber recombination according to any one of claims 1 to 7, the system comprises: Photoelectric sensors are installed at each optical fiber port to measure the background illumination in the forward direction of the optical fiber port in real time and synchronize it with the brightness of the light coming out of the optical fiber port to generate a corresponding relationship between the background illumination and the port brightness. A contrast calculation and curve fitting unit, configured to calculate the real-time contrast of each optical fiber port based on the corresponding relationship between the background illumination and the port brightness, and perform curve fitting on the contrast change within a set time period; A grading and mapping reorganization unit is used to grade the contrast fluctuation curve according to a set threshold, and to prioritize each optical fiber port based on the grade after the grade, and to generate a port mapping reorganization table corresponding to each priority partition; A dynamic compensation unit, configured to control the FPGA to adjust the drive current and PWM duty cycle of the corresponding LED according to the priority partition based on the port mapping reorganization table, so as to adjust the brightness and color temperature of the light output from the optical fiber port; A backlight adjustment unit, used to adjust the detail density and line width of the display image of the optical fiber port whose contrast is lower than the set contrast threshold in the image generation logic; The main controller is used to receive control signals and determine the type of control signals. If it is an infrared type control signal, the touch point is located based on the infrared signal and mapped to the LED matrix coordinates. The controller then performs light splitting output. If it is a sound wave type control signal, the voice command corresponding to the current sound wave is analyzed, and the corresponding brightness or color adjustment is performed after analysis.

9. A terminal comprising a processor and a storage medium; characterized in that: The storage medium is used to store instructions; The processor is configured to operate according to the instructions to execute the steps of the method according to any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images