Method for Detecting Failures in a Spherical Display and Apparatus for Performing the Same

Abstract

The present invention relates to a method for detecting faults in a spherical display and an apparatus for performing such a method. The method for detecting faults in a spherical display may include: a fault detection unit of a spherical display fault control device detecting a fault that has occurred in a spherical display based on signals from a plurality of domains and generating fault detection information; a fault response control unit of a spherical display fault control device generating fault control information based on the fault detection information; and an output control unit of a spherical display fault control device controlling the output of an internal display and an external display based on the fault control information.

Description

Technology Field

[0001] The present invention relates to a method for detecting faults in a spherical display and an apparatus for performing such a method. More specifically, it relates to a method for detecting faults in a spherical LED display in real time and an apparatus for performing such a method. Background Technology

[0002] Recently, large spherical LED displays are being utilized in performance venues, exhibition halls, and theme parks to play various immersive content. These spherical displays often include not only external display panels installed on the outer surface but also internal display panels for providing content for in-viewing.

[0003] However, since spherical displays consist of multiple LED tiles and curved structures, localized errors, such as failure of a specific panel or damage to LED elements, lead to a degradation in overall image quality. Furthermore, external displays are affected by external environmental factors such as sunlight, rain, fog, and ambient light, while internal displays require consideration of internal environmental characteristics such as the viewer's viewing angle and internal illumination. Despite this, there is currently a lack of technology capable of integrally performing environment-based control and fault-based control for both external and internal displays.

[0004] Accordingly, there is a need for technology capable of detecting failures in spherical LED displays in real time, performing output control when a failure occurs, and automatically adjusting image quality by considering the environmental conditions of internal and external displays. The problem to be solved

[0005] The present invention aims to solve all of the aforementioned problems.

[0006] In addition, the present invention improves device reliability by detecting failures in spherical LED displays in real time, increases maintenance efficiency by automatically detecting failures in LED elements and panels, and minimizes visual discrepancies and prevents interruption of performances or exhibitions by maintaining overall screen quality through automatic correction or content bypass output in the event of a failure.

[0007] In addition, the present invention can control customized output according to external and internal display environments, ensure environment-adaptive image quality, and maintain high visual quality through real-time control based on environment and fault data. means of solving the problem

[0008] A representative configuration of the present invention for achieving the above objective is as follows.

[0009] According to one embodiment of the present invention, a fault detection method for a spherical display fault control device may include the step of a fault detection unit of the spherical display fault control device detecting a fault that has occurred in the spherical display based on signals of a plurality of domains and generating fault detection information; the step of a fault response control unit of the spherical display fault control device generating fault control information based on the fault detection information; and the step of an output control unit of the spherical display fault control device controlling the output of an internal display and an external display based on the fault control information.

[0010] Meanwhile, the method for detecting faults in a spherical display further includes the step of the external environment analysis unit of the spherical display fault control device receiving and analyzing external environment information for fault control and output control of the spherical display to generate external environment analysis information, wherein the fault detection information may include external environment analysis information.

[0011] Additionally, the method for detecting faults in a spherical display further includes the step of the internal environment analysis unit of the spherical display fault control device receiving and analyzing internal environment information for fault control and output control of the spherical display to generate internal environment analysis information, wherein the fault detection information may include internal environment analysis information.

[0012] According to another embodiment of the present invention, a spherical display fault control device for performing spherical display fault detection may include a fault detection unit implemented to detect a fault occurring in a spherical display based on signals of a plurality of domains and generate fault detection information, a fault response control unit implemented to generate fault control information based on the fault detection information, and an output control unit implemented to control the output of an internal display and an external display based on the fault control information.

[0013] Meanwhile, the above-described spherical display fault control device further includes an external environment analysis unit implemented to receive and analyze external environment information for fault control and output control of the spherical display to generate external environment analysis information, wherein the fault detection information may include external environment analysis information.

[0014] In addition, the spherical display fault control device further includes an internal environment analysis unit implemented to receive and analyze internal environment information for fault control and output control of the spherical display to generate internal environment analysis information, wherein the fault detection information may include internal environment analysis information. Effects of the invention

[0015] According to the present invention, device reliability is improved by detecting failures in spherical LED displays in real time, maintenance efficiency is increased by automatically detecting failures in LED elements and panels, and overall screen quality is maintained through automatic correction or content bypass output when a failure occurs, thereby minimizing visual discrepancies and preventing interruption of performances or exhibitions.

[0016] In addition, according to the present invention, customized output can be controlled according to the external display and internal display environment, environment-adaptive image quality can be secured, and high visual quality can be maintained through real-time control based on environment and fault data. Brief explanation of the drawing

[0017] FIG. 1 is a conceptual diagram showing a spherical display failure control device according to one embodiment of the present invention. FIG. 2 is a conceptual diagram showing the operation of a fault detection unit according to an embodiment of the present invention. FIG. 3 is a conceptual diagram showing the operation of a fault response control unit according to an embodiment of the present invention. FIG. 4 is a conceptual diagram showing the operation of an external environment analysis unit according to an embodiment of the present invention. FIG. 5 is a conceptual diagram showing the operation of an internal environment analysis unit according to an embodiment of the present invention. FIG. 6 is a conceptual diagram showing a spherical display implemented through 360-degree image mapping according to an embodiment of the present invention. Specific details for implementing the invention

[0018] The following detailed description of the invention refers to the accompanying drawings, which illustrate specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that various embodiments of the invention are different but need not be mutually exclusive. For example, specific shapes, structures, and characteristics described herein may be modified from one embodiment to another without departing from the spirit and scope of the invention. It should also be understood that the location or arrangement of individual components within each embodiment may be modified without departing from the spirit and scope of the invention. Accordingly, the following detailed description is not meant to be limiting, and the scope of the invention should be understood to encompass the scope claimed by the claims and all equivalents thereof. Similar reference numerals in the drawings indicate identical or similar components across various aspects.

[0019] Hereinafter, in order to enable a person skilled in the art to easily practice the present invention, various preferred embodiments of the present invention will be described in detail with reference to the attached drawings.

[0021] FIG. 1 is a conceptual diagram showing a spherical display failure control device according to one embodiment of the present invention.

[0022] Figure 1 discloses a spherical display failure control device for identifying and controlling a failure that occurs in a spherical display.

[0023] Referring to FIG. 1, the spherical display fault control device may include a fault detection unit (110), a fault response control unit (120), an external environment analysis unit (130), an internal environment analysis unit (140), an output control unit (150), and a processor (160).

[0024] The fault detection unit (110) can be implemented to detect a fault occurring in the spherical display and generate fault detection information. The fault detection unit (110) can generate fault detection information by detecting whether there is an abnormality in the current / voltage value of an LED element or panel unit, analyzing whether there is a frame omission or tick error by comparing the input signal and the output signal, and detecting an abnormality based on the brightness / color temperature deviation compared to a normal panel. Additionally, the fault detection unit (110) can generate fault detection information by performing physical fault prediction through a thermal sensor / vibration sensor.

[0025] The fault response control unit (120) may be implemented to generate fault control information for controlling output on a spherical display according to fault detection information generated by the fault detection unit. For example, the fault response control unit (120) may be implemented to generate fault control information for performing at least one of the following fault responses depending on the type of fault when a fault is detected. The fault response may include automatically correcting the area around the fault panel to minimize visual differences, averaging or blending the area to create a natural connection, bypassing output that reconstructs content excluding the fault area, and switching to a minimum brightness or inactive state if the fault is severe.

[0026] The external environment analysis unit (130) can be implemented to receive and analyze external environment information for fault control and output control of the spherical display. To acquire external environment information, sunlight, weather conditions (rain, snow, fog), ambient brightness, reflection / refraction information, etc., can be measured in real time based on an environment sensor or camera. Based on the external environment information, the external environment analysis unit (130) can control the brightness, color, noise suppression, HDR mapping, etc. of the external display, perform fault determination, and generate external environment analysis information for output control.

[0027] The internal environment analysis unit (140) may be implemented to receive and analyze internal environment information for fault control and output control of the spherical display. The internal environment information may include an internal illuminance sensor, a viewer location and eye tracking sensor, internal sound and illuminance interaction information, and optimal viewing angle analysis information for each content viewing zone. Based on the internal environment information of the internal environment analysis unit (140), the brightness, color, noise suppression, HDR mapping, etc. of the internal display may be controlled, fault determination may be performed, and internal environment analysis information may be generated to perform output control.

[0028] The output control unit (150) can perform independent output control for each of the external display and the internal display. Depending on the situation, the output control unit (150) can configure the external display and the internal display as interconnected content or separate them into completely different content, and can optimize screen quality in real time by reflecting fault information and environmental information.

[0029] The processor (170) can be implemented to control the operation of the fault detection unit (110), the fault response control unit (120), the external environment analysis unit (130), the internal environment analysis unit (140), and the output control unit (150).

[0030] The components according to the embodiments of the present invention may be implemented based on hardware (e.g., a computer server), and the operation of the components described above may be performed on the hardware (e.g., a computer server). Although referred to as components for convenience of explanation, the operations of the components may perform an automated process that did not exist before using computer program code based on hardware components such as a CPU (central processing unit), a GPU (graphic processing unit), and memory.

[0031] More specifically, the operation process of the components performed in the present invention is performed based on the control unit and arithmetic logic unit (ALU) of a processing unit such as a CPU. The operation process of the components can be performed through fetch, decode, and execute performed on hardware such as a CPU.

[0032] In addition, various memory structures (registers, cache memory, main memory, auxiliary memory) may be used for the operation of the operation process of the components according to the embodiment of the present invention, and computer program code using various memory hierarchies may be used for the efficiency of the operation process of the components.

[0033] By performing this computer program code-based automation through hardware, previously unknown processes are automated. Compared to non-automated procedures, this improves device reliability by detecting failures in older LED displays in real time, increases maintenance efficiency by automatically detecting LED element and panel failures, and minimizes visual dissonance and prevents interruptions in performances or exhibitions by maintaining overall screen quality through automatic correction or content rerouting in the event of a failure. Furthermore, the present invention enables control of customized output according to external and internal display environments, ensures environment-adaptive image quality, and maintains high visual quality through real-time control based on environmental and failure data.

[0035] FIG. 2 is a conceptual diagram showing the operation of a fault detection unit according to an embodiment of the present invention.

[0036] In FIG. 2, a fault detection unit is disclosed that detects a fault occurring in a spherical display based on signals from a plurality of domains.

[0037] Referring to FIG. 2, the fault detection unit may have a multi-signal-based fault detection structure (210). The fault detection unit may be configured to determine a fault by combining multiple different data domains rather than a single reference. The multiple data domains may include an electrical signal domain, an image output domain, an optical domain, and a physical sensor domain.

[0038] The electrical signal domain is a domain for electrical signal data. In the electrical signal domain, information regarding the current value (I), voltage value (V), and deviation rate relative to the reference profile (delta I / Iref, delta V / Vref) of an LED element or panel unit can be obtained.

[0039] The image output domain may be a domain for data extracted by comparing pixel data of an input frame and an output frame. In the image output domain, information regarding frame drops, frame ticks, and periodic blinking may be obtained.

[0040] The optical domain may be a domain for optical information. The optical domain may include information regarding average brightness per panel, color coordinates (e.g., CIE xy), color temperature, etc., and information analyzing relative deviations compared to adjacent panels may be obtained.

[0041] The physical sensor domain may be a domain for information that can be obtained based on physical sensors. In the physical sensor domain, information regarding local temperature rise patterns based on thermal sensors, detection of structural anomalies based on vibration sensors, etc., can be obtained.

[0043] In addition, the fault detection unit can perform fault location normalization (220) based on a spherical coordinate system. The fault detection unit can map the position of each panel or LED element to a spherical coordinate system by reflecting the physical characteristics of the spherical display.

[0044] Each fault event can be normalized to a spherical coordinate system and mapped to a panel ID and a spherical region index. The fault detection unit can determine the fault by applying different thresholds to high-latitude and low-latitude regions, taking into account differences in distortion characteristics by latitude and longitude.

[0045] More specifically, since geometric distortion occurs near poles and pixel density is non-uniform, the fault detection threshold must be relaxed to reduce false positives. Additionally, the fault detection unit can define distortion correction weights by reflecting the difference in spherical surface area across latitude ranges. Due to the spherical geometric characteristics, the area decreases at higher latitudes compared to the same angle range; therefore, even with the same number of pixels at higher latitudes, the actual area may appear relatively smaller, and brightness / color deviations may appear exaggerated. Consequently, the fault detection threshold can be corrected by taking these factors into account.

[0046] In addition, the fault detection unit can calculate the effective pixel density for each latitude range and set distortion correction weights based on this. Effective pixel density refers to the number of pixels actually projected within the viewer's field of view. In spherical displays or distortion-corrected environments, distortion correction based on effective pixel density can be performed because not all pixels contribute equally to the visual experience. Since pixel density relatively increases or becomes non-uniform in high-latitude regions, the distortion correction weight is set to increase compared to low-latitude regions. In cases of non-uniform pixel density, noise sensitivity becomes relatively higher, and fault detection criteria may be relaxed.

[0047] Additionally, the fault detection unit can perform a time accumulation-based fault determination logic (230). The fault detection unit can determine the fault based on a time accumulation pattern rather than a one-time event.

[0048] The fault detection unit can classify fault states such as temporary abnormalities, intermittent faults, and permanent faults based on whether continuous faults occur for more than N frames at the same location, the frequency of fault occurrence within a certain time window, and the duration of the fault.

[0049] The fault detection unit can divide a spherical display into multiple spherical regions and perform a time-accumulation-based fault determination logic that independently accumulates and manages fault events for each spherical region. Spherical regions are defined to have different areas and visual contributions depending on latitude and longitude, and even if a fault occurs within the same frame, faults belonging to different spherical regions can be managed as independent accumulation states. When accumulating fault events over time, the fault detection unit can apply different time accumulation weights depending on the latitude of the spherical region where the fault occurred. Specifically, the accumulation contribution of the fault event can be significantly reflected in low-latitude regions, and the accumulation contribution per unit frame can be set to decrease as it moves toward high-latitude regions. Additionally, as a fault occurring in a specific spherical region accumulates over time, the fault detection unit can evaluate the effect of fault accumulation by spreading it to adjacent regions in the spherical coordinate system. In this case, adjacent regions are defined considering latitude and longitude distances and spherical curvature, and the accumulation fault contribution in adjacent regions is reduced by a distance-based attenuation function. Considering that the same physical fault may appear at different screen locations depending on the rotation of content or viewpoint movement of the spherical display, the fault detection unit can perform normalization based on a spherical coordinate system that reflects the display rotation state when determining time-accumulated faults. Additionally, the fault detection unit predefines a visual stability threshold for each spherical region, and this threshold can be set by reflecting the effective pixel density, field of view overlap frequency, and viewer gaze dwell time of the corresponding spherical region. A fault is definitively determined only when the time-accumulated fault contribution exceeds the aforementioned visual stability threshold for each spherical region.

[0050] In addition, the fault detection unit can perform automatic fault type classification (240). The fault detection unit automatically classifies the fault type based on the detected abnormal data. For example, the fault types may include LED element defects, panel unit defects, signal transmission errors, power system abnormalities, and performance degradation based on aging. The classification result can be used as metadata transmitted to the fault response control unit.

[0051] The fault detection unit can generate fault detection information, which is information about a fault that occurred in a spherical display based on signals from multiple domains through the processing procedure described above, and the fault detection information can be transmitted to the fault response control unit.

[0052] Fault detection information may include fault type, fault location, fault area, and adjacent panel status. The fault detection information may include not only information generated by the fault detection unit, but also external environment analysis information generated by the external environment analysis unit and internal environment analysis information generated by the internal environment analysis unit.

[0054] FIG. 3 is a conceptual diagram showing the operation of a fault response control unit according to an embodiment of the present invention.

[0055] In FIG. 3, the operation of a fault response control unit that receives fault detection information and performs fault response control based on the fault detection information is initiated.

[0056] Referring to FIG. 3, the fault response control unit can receive fault detection information.

[0057] Fault detection information may include fault type, fault location, fault area, information on the status of adjacent panels, external environment analysis information, and internal environment analysis information.

[0058] The fault response control unit can perform fault response based on spatial weighting-based automatic correction (310). If the fault area is partial, the fault response control unit performs correction by applying spatial weighting. Brightness and color can be interpolated using adjacent panel pixel information by applying a distance-based weighting function centered on the fault panel. Additionally, latitude-based interpolation coefficients can be applied differentially by considering spherical curvature.

[0059] The fault response control unit can generate fault control information to control the output based on fault detection information.

[0060] The fault response control unit can generate fault control information to perform content reconstruction-based bypass output (320). The fault response control unit can generate fault control information to reconstruct the content structure itself when the fault area is larger than a certain threshold area. The fault response control unit can generate fault control information to perform fault response by reconstructing the content when necessary, such as by masking the fault area to relocate the content to a visually less perceptible area or by redistributing the roles of the content between internal and external displays. That is, the fault response control unit can generate fault control information to perform fault response through content level control rather than simple pixel correction when necessary.

[0061] The fault response control unit can generate fault control information to perform response and control (330) for stepwise deterioration. The fault response control unit can change the output control intensity stepwise according to the fault severity. In the case of a first fault severity, brightness and color fine correction can be performed, in the case of a second fault severity, blending and content movement can be performed, and in the case of a third fault severity, minimum brightness or deactivation can be performed.

[0062] Additionally, the fault response control unit can perform a fault history-based learning-type response parameter update (340). The fault response control unit can store past fault history and gradually update the correction parameters by analyzing the fault recurrence cycle, the duration of the correction effect, and the viewer perception sensitivity.

[0064] FIG. 4 is a conceptual diagram showing the operation of an external environment analysis unit according to an embodiment of the present invention.

[0065] FIG. 4 discloses a method for generating external environment analysis information for controlling a spherical display by analyzing external environment information in an external environment analysis unit.

[0066] The external environment analysis unit can perform multiple external environment sensing and data normalization.

[0067] The external environment analysis unit can collect multiple different external environment information in real time to control the external output of a spherical display. The external environment information may include data on sunlight intensity, ambient illuminance, and solar elevation angle collected based on light sensors; data on rain, snow, fog, and humidity obtained based on weather sensors or external API integration; and data on reflected light generation areas, backlight patterns, and surface diffuse reflection distribution obtained based on cameras. The collected external environment information can be normalized into an environment vector through time synchronization, unit standardization, noise filtering, etc.

[0068] In addition, the external environment analysis unit can perform environmental impact modeling based on spherical orientation. The external environment analysis unit can calculate how much and in which areas of the spherical display the external environment affects. The external environment analysis unit can calculate the direct light area in the spherical coordinate system based on the position of the sun. Furthermore, the external environment analysis unit can predict areas with potential visibility degradation based on reflection / refraction information.

[0069] The external environment analysis unit can generate external environment analysis information by applying different environmental impact weights based on differences in curvature by latitude. Environmental impact weights can be set to relatively larger values ​​as the degree of environmental impact increases.

[0070] More specifically, to apply different environmental impact weights, spherical directionality-based environmental impact modeling may be performed in the present invention. The external environment analysis unit may perform spherical directionality-based environmental impact modeling by dividing the spherical display into multiple spherical regions in a spherical coordinate system and calculating the environmental impact degree for each spherical region based on the directionality and incident angle of the external environment. The environmental impact degree is calculated by comprehensively reflecting the incident direction, incident angle, and curvature characteristics of the region in which the external environment reaches a specific spherical region. The environmental impact degree is calculated based on the relationship between the direction vector of the external environmental factor reaching a specific spherical region of the spherical display and the surface normal vector of that spherical region, and is calculated by reflecting the incident direction, incident angle, and curvature characteristics according to the latitude of the spherical region of the external environmental factor in stages. Specifically, the external environment analysis unit can convert the incident direction of the external environmental factor into a vector in the spherical coordinate system and calculate a basic environmental impact degree based on the angle between that vector and the surface normal vector of each spherical region. At this time, the basic environmental impact degree may be set to increase as the incident angle is closer to the normal direction of the spherical region. In addition, the external environment analysis unit can calculate the final environmental impact by applying a curvature correction coefficient defined according to the latitude of the corresponding spherical area to the basic environmental impact, and the curvature correction coefficient can be set to consider the degree to which the environmental impact is dispersed to adjacent areas by reflecting the characteristics of a spherical display in which the rate of change of the surface normal increases with increasing latitude.

[0071] In addition, in the present invention, a direct light influence area based on the sun's position can be calculated to apply different environmental influence weights. The external environment analysis unit receives information on the sun's azimuth and elevation angles and can determine the spherical area to which direct light reaches by projecting the sun's ray vector onto a spherical coordinate system. At this time, the direct light influence is calculated based on the dot product between the sun's ray and the normal vector of the corresponding spherical area, and is set so that the direct light influence increases as the angle of incidence approaches verticality, and the environmental influence can be set so that the relatively higher this direct light influence is, the relatively higher the environmental influence.

[0072] In the present invention, prediction of visibility degradation areas based on reflection and refraction can be performed to apply different environmental impact weights. Additionally, the external environment analysis unit estimates possible reflection or refraction paths in a specific spherical area using display surface material information and location information of surrounding structures. If the reflection or refraction path overlaps with the viewer's line of sight, the corresponding spherical area is classified as a visibility degradation area, and the degree of environmental impact can be set relatively higher as the visibility degradation area increases.

[0073] In addition, environmental impact weights based on curvature differences by latitude may be calculated. Considering that spherical curvature and the rate of change of surface direction vary with latitude due to the geometric characteristics of spherical displays, the external environment analysis unit may apply different environmental impact weights to latitude intervals within the spherical coordinate system. Specifically, in low-latitude regions, the change in surface normals between adjacent pixels for the same incident ray is gradual, so external environmental impacts are locally concentrated; conversely, in high-latitude regions, the rate of change of surface normals is relatively large, so the same environmental factor is perceived as being dispersed across adjacent areas; thus, the environmental impact weights may be set to decrease to reflect this characteristic.

[0074] The external environment analysis unit can generate environmental analysis information by classifying external environmental conditions into multiple states through an external environment grade calculation logic. For example, external environmental conditions can be classified into normal environment, strong direct sunlight environment, environment with dominant diffuse reflection, low visibility environment (fog / rain), etc. Each of the multiple environmental conditions is mapped to ranges such as brightness correction coefficients, color contrast enhancement coefficients, and HDR mapping intensity, so that the output of the spherical display can be controlled according to the environmental condition.

[0075] Additionally, the external environment analysis unit may separately determine output control parameters for external displays as external environment analysis information based on environmental grades and location-specific impact levels. The output control parameters for external displays may include parameters for brightness amplification / attenuation by region, color saturation and white point adjustment, noise suppression and contrast enhancement, and HDR tone map curve selection or correction.

[0077] FIG. 5 is a conceptual diagram showing the operation of an internal environment analysis unit according to an embodiment of the present invention.

[0078] FIG. 5 discloses a method for generating internal environment analysis information for controlling a spherical display by analyzing internal environment information in an internal environment analysis unit.

[0079] Referring to FIG. 5, the internal environment analysis unit can perform viewer-based internal environment sensing. The internal environment analysis unit uses a viewer-centered sensing structure to precisely analyze the internal viewing environment. Information regarding the illuminance distribution by space is obtained as internal environment information through an internal illuminance sensor, and information regarding the viewer's location and viewer's gaze information can be obtained as internal environment information based on a viewer detection sensor (indoor camera, LiDAR / ToF sensor).

[0080] The internal environment analysis unit can generate internal environment analysis information by performing viewing zone segmentation and visual impact modeling. The internal environment analysis unit can divide the internal space into multiple viewing zones. The internal environment analysis unit can calculate the average viewing angle, viewing distance, and dwell time for each viewing zone. The internal environment analysis unit can predict distortion sensitivity by considering the curvature of the spherical display and model differences in brightness and color perception.

[0081] The internal environment analysis unit can determine content weights based on viewer reactions as internal environment analysis information. The internal environment analysis unit can calculate content output weights by analyzing viewer reaction data.

[0082] The internal environment analysis unit determines content output weights by considering the frequency of eye focus, eye retention time, and overlapping areas of multiple viewers, and based on this, can generate internal environment analysis information to enhance visual concealment of fault areas by emphasizing attention areas and performing visual mitigation on non-attention areas.

[0083] The internal environment analysis unit can generate internal environment analysis information by performing spherical coordinate normalization of viewer response data. The internal environment analysis unit collects information on the viewer's gaze direction, head direction, or position, and can normalize this into a gaze intersection area on the spherical coordinate system of the spherical display. The gaze intersection area may be the point where the gaze vector meets the surface of the spherical display. More specifically, the viewer's gaze vector can be calculated in terms of eye position and gaze direction, and the intersection point between the viewer's gaze vector and the spherical display can be determined. The intersection point is converted into spherical coordinates, and the gaze intersection area can be determined by mapping the point to the spherical region to which the coordinates belong. Each viewer's gaze is mapped to one or more spherical regions on the spherical coordinate system, and gaze events mapped to the same spherical region are managed cumulatively. The internal environment analysis unit can accumulate the time of viewer response indicators. The internal environment analysis unit can calculate viewer response indicators by spherical region using a time accumulation method, and the viewer response indicators may include gaze concentration frequency, gaze retention time, and the degree of gaze overlap among multiple viewers. Specifically, the gaze concentration frequency is calculated as the number of gaze events that enter the corresponding spherical area within a certain time window, the gaze retention time is calculated by accumulating the duration of each gaze event, and the gaze overlap can be calculated as the ratio of the gazes of multiple viewers overlapping within the same time interval.

[0084] The internal environment analysis unit can determine internal environment analysis information by performing response correction based on viewing zone characteristics. The internal environment analysis unit can apply distance correction coefficients and viewing angle correction coefficients to viewer response indicators by considering the average viewing distance and average viewing angle for each viewing zone. Accordingly, even for the same gaze event, response correction based on viewing zone characteristics can be performed so that the response contribution increases when the distance between the viewer and the display is short or the viewing angle is large.

[0085] In addition, the internal environment analysis unit can generate internal environment analysis information by reflecting spherical curvature and distortion sensitivity. Considering the curvature characteristics and distortion sensitivity of the spherical display according to latitude, the internal environment analysis unit can adjust the weight of the viewer response index to increase in low-latitude regions sensitive to distortion and to relax the weight in high-latitude regions less sensitive to distortion.

[0086] In addition, the internal environment analysis unit can generate internal environment analysis information by performing content output weight calculation and normalization. The internal environment analysis unit can calculate content output weights per spherical area by combining viewer response indicators, viewing zone correction coefficients, and curvature-based correction coefficients, and the content output weights are normalized over the entire spherical area and converted into relative emphasis or relaxation ratios.

[0087] In addition, the internal environment analysis unit can generate weights for the purpose of concealing failures using internal environment analysis information. The calculated content output weights are linked with failure detection information and, when a failure area overlaps with the viewer's attention area, can be utilized to reduce visual perception of the failure area by increasing emphasis on non-failure areas around that area or by reducing visual contrast or high-frequency components for the failure area itself.

[0088] The internal environment analysis unit can generate internal environment grades and output control parameters as internal environment analysis information. The internal environment analysis unit classifies the internal environment into high-density viewing environments, single-viewer focused environments, low-light immersive environments, mobile viewing environments, etc., and determines output control parameters to set brightness distribution, color temperature, contrast, and HDR intensity differently according to each environment grade.

[0089] According to an embodiment of the present invention, the external environment analysis unit and the internal environment analysis unit may operate independently of each other but may operate to mutually refer to the following information.

[0090] More specifically, if a very bright area appears on the external display, that light may enter the interior and cause glare for the internal viewer. If the brightness of a specific area of ​​the external spherical display increases due to sunlight, that light may be transmitted or reflected inward, causing glare for the internal viewer.

[0091] Therefore, contrast can be mitigated by relatively reducing the brightness of the corresponding area on the internal display and lowering the color temperature, taking into account the luminance of the area on the external display. Alternatively, output control in a specific area corresponding to the internal display can be performed by considering the brightness of the image output from a specific area on the external display, in a manner that protects only the area where the viewer's gaze is directed.

[0092] Additionally, if the external environment deteriorates, the immersion of content output on the internal display may be enhanced. If the external display is difficult to see due to reasons such as rain, fog, or strong backlighting, it may encourage greater focus on the internal display. For example, if external video visibility is reduced due to fog or rain, the effectiveness of external content may be relatively low. In such cases, output control can be performed by increasing the brightness and contrast of the internal screen on the internal display, and adjustments to the content output area can be made by repositioning key content toward the internal side.

[0093] Additionally, if a failure occurs in only one of the external or internal displays, content can be supplemented on the other undamaged display. If a part of the external display fails, the internal display can compensate for the loss. If a specific panel of the external display fails and a portion of the video is distorted, it is determined that the quality of the external screen has deteriorated; in this case, the internal display can play scenes that cannot be shown externally and reconstruct the story flow to center on the interior, thereby naturally shifting the viewer's gaze inward.

[0095] FIG. 6 is a conceptual diagram showing a spherical display implemented through 360-degree image mapping according to an embodiment of the present invention.

[0096] Referring to FIG. 6, a 360-degree image mapped and output through a spherical display device is disclosed as an example.

[0097] Through the aforementioned mapping algorithm, a naturally mapped image can be provided to the user on a spherical display.

[0098] A spherical display according to an embodiment of the present invention can provide a continuous experience in which a story that begins on the street is completed inside by transmitting connectivity between the outside and the inside. As a detail of the exterior wall media facade, the exterior wall is composed of a pitch of approximately 2023 m² and can function as a 360° media canvas that wraps around the city sky.

[0099] The exterior media facade can serve as a digital canvas that simultaneously reflects the city's identity and the emotions of its citizens, rather than being a simple visual device. More specifically, the interior is a fully immersive theater consisting of 890㎡ of 4mm pitch ultra-high-resolution LEDs, where the ceiling and walls are connected as one, allowing the audience to experience a sense of space as if they are standing at the center of the immersive media.

[0101] The device described above may be implemented as a hardware component, a software component, and / or a combination of a hardware component and a software component. For example, the device and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. In addition, other processing configurations, such as parallel processors, are also possible.

[0102] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or instruct the processing unit independently or collectively. Software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and may be stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

[0103] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may continuously store a program executable by a computer, or temporarily store it for execution or download. Additionally, the medium may be various recording or storage means in the form of a single or several hardware combined, and may not be limited to a medium directly connected to a computer system but may exist distributed over a network. Examples of media may include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and media configured to store program instructions, including ROM, RAM, and flash memory. Additionally, other examples of media may include recording or storage media managed by app stores that distribute applications or sites and servers that supply or distribute various other software.

[0104] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, suitable results can be achieved even if the described techniques are performed in a different order than described, and / or the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0105] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below.

Claims

Claim 1 A method for detecting faults in a spherical display comprises: a fault detection unit of a spherical display fault control device detecting a fault that has occurred in a spherical display based on signals from a plurality of domains and generating fault detection information; a fault response control unit of the spherical display fault control device generating fault control information based on the fault detection information; and an output control unit of the spherical display fault control device controlling the output of an internal display and an external display based on the fault control information. Claim 2 The method according to claim 1, wherein the external environment analysis unit of the spherical display fault control device receives and analyzes external environment information for fault control and output control of the spherical display to generate external environment analysis information, wherein the external environment analysis unit further includes the step of measuring sunlight, weather conditions, ambient brightness, and reflection / refraction information in real time based on an environment sensor or camera to acquire the external environment information, controlling the brightness, color, noise suppression, and HDR mapping of the external display based on the external environment information, performing fault determination, and generating the external environment analysis information for output control. Claim 3 In paragraph 2, the internal environment analysis unit of the spherical display fault control device receives and analyzes internal environment information for fault control and output control of the spherical display to generate internal environment analysis information, wherein the internal environment information includes an internal illuminance sensor, a viewer position and eye tracking sensor, internal sound and illuminance interaction information, and optimal viewing angle analysis information for each content viewing zone, and further comprises the step of controlling the brightness, color, noise suppression, and HDR mapping of the internal display based on the internal environment information, performing fault determination, and generating the internal environment analysis information for output control. Claim 4 A spherical display fault control device for performing spherical display fault detection comprises: a fault detection unit implemented to detect a fault occurring in a spherical display based on signals of multiple domains and generate fault detection information; a fault response control unit implemented to generate fault control information based on the fault detection information; and an output control unit implemented to control the output of an internal display and an external display based on the fault control information. Claim 5 In claim 4, the spherical display fault control device further comprises an external environment analysis unit that, when receiving and analyzing external environment information for fault control and output control of the spherical display to generate external environment analysis information, measures sunlight, weather conditions, ambient brightness, and reflection / refraction information in real time based on an environment sensor or camera to acquire the external environment information, controls the brightness, color, noise suppression, and HDR mapping of the external display based on the external environment information, performs fault determination, and generates the external environment analysis information for output control. Claim 6 In claim 5, the spherical display fault control device further comprises an internal environment analysis unit that, when receiving and analyzing internal environment information for fault control and output control of the spherical display to generate internal environment analysis information, receives said internal environment information including an internal illuminance sensor, a viewer position and eye tracking sensor, internal sound and illuminance interaction information, and optimal viewing angle analysis information for each content viewing zone, controls the brightness, color, noise suppression, and HDR mapping of said internal display based on said internal environment information, performs fault determination, and generates said internal environment analysis information for output control.

Images