Method for Controlling Inner and Outer Displays of a Spherical Display and Apparatus for Implementing the Same

Abstract

The present invention relates to a method for controlling an internal display and an external display in a spherical display, and to an apparatus for performing such a method. The method for controlling an internal display and an external display in a spherical display comprises the steps of: a spherical display structure information collection unit of an internal-external interlocking output control device collecting internal display structure information and external display structure information; a content analysis unit of an internal-external interlocking output control device performing analysis on content to be output to the internal display and the external display to extract content characteristic information; and a display synchronization setting unit of an internal-external interlocking output control device setting synchronization criteria for images output from the internal display and the external display based on the content characteristic information.

Description

Technology Field

[0001] The present invention relates to a method for controlling an internal display and an external display in a spherical display and an apparatus for performing such a method. More specifically, the invention relates to a method for controlling an internal display and an external display in a spherical display and an apparatus for performing such a method for performing synchronization, mapping, image processing based on structural differences, and output control between an internal display and an external display of a spherical display device. Background Technology

[0002] Recently, display technologies for realizing realistic content and immersive media environments have been rapidly advancing, and in particular, non-planar display devices such as spherical LED displays and hemisphere displays are being widely utilized in commercial facilities, exhibition halls, and theme parks.

[0003] However, in spherical display devices, the external display positioned on the outer surface and the internal display positioned within the interior space have different curvatures, orientations, and viewing angle characteristics; therefore, it is difficult to satisfy connectivity or distinctiveness between displays when the same video content is simply divided and output. Furthermore, because the internal and external displays possess different structural geometries, calibration and synchronization for image mapping are essential.

[0004] Conventionally, methods primarily used involved driving each display independently or outputting the same image by simply stretching or distorting it, which resulted in problems that reduced realism and immersion. The problem to be solved

[0005] The present invention aims to solve all of the aforementioned problems.

[0006] In addition, the present invention aims to provide image mapping and output technology that ensures synchronization between an internal display and an external display of a spherical display device, and takes into account the curvature, viewing structure, and installation position differences between the internal display and the external display.

[0007] In addition, the present invention aims to provide a technology capable of automatically or semi-automatically configuring an output strategy optimized for each display according to the type of content and video type, and thereby effectively implementing the continuity or visual differentiation of immersive content using spherical display devices. means of solving the problem

[0008] A representative configuration of the present invention for achieving the above objective is as follows.

[0009] According to one embodiment of the present invention, a method for controlling an internal display and an external display in a spherical display comprises the steps of: a spherical display structure information collection unit of an internal-external interlocking output control device collecting internal display structure information and external display structure information; a content analysis unit of the internal-external interlocking output control device performing an analysis on content to be output to the internal display and the external display to extract content characteristic information; and a display synchronization setting unit of the internal-external interlocking output control device setting a synchronization standard for images output from the internal display and the external display based on the content characteristic information.

[0010] Meanwhile, the method for controlling an internal display and an external display in a spherical display may further include the step of a geometric correction and mapping unit of the internal-external interlocking output control device mapping content to the internal display and the external display based on the synchronization criteria, and the step of a connection strategy setting unit of the internal-external interlocking output control device setting a connection strategy for the internal display and the external display.

[0011] Additionally, the above content characteristic information includes information regarding content categories and content output objects, and the above synchronization criteria may include synchronization time criteria settings, synchronization area criteria, and synchronization object criteria.

[0012] According to one embodiment of the present invention, an internal-external interlocking output control device for controlling an internal display and an external display in a spherical display may include a spherical display structure information collection unit implemented to collect internal display structure information and external display structure information, a content analysis unit implemented to extract content characteristic information by performing analysis on content to be output to the internal display and the external display, and a display synchronization setting unit implemented to set synchronization criteria for images output from the internal display and the external display based on the content characteristic information.

[0013] Meanwhile, it may further include a geometric correction and mapping unit implemented to map content to the internal display and the external display based on the above synchronization criteria, and a connection strategy setting unit implemented to set a connection strategy for the internal display and the external display.

[0014] Additionally, the above content characteristic information includes information regarding content categories and content output objects, and the above synchronization criteria may include synchronization time criteria settings, synchronization area criteria, and synchronization object criteria. Effects of the invention

[0015] According to the present invention, complete synchronization between an internal display and an external display and natural, immersive content can be realized, and distortion and inconsistency phenomena can be minimized through precise mapping output that takes into account structural differences in the displays.

[0016] In addition, according to the present invention, depending on the nature of the content, visual presentation can be either connected or separated between an internal display and an external display, significantly increasing the utilization of spherical displays compared to existing technologies, and enabling the provision of high-quality immersive content in the fields of exhibition, promotion, and entertainment. Brief explanation of the drawing

[0017] FIG. 1 is a conceptual diagram showing an internal-external interlocking output control device for performing output control of an internal display and an external display in a spherical display device according to an embodiment of the present invention. FIG. 2 is a conceptual diagram showing the operation of a content analysis unit according to an embodiment of the present invention. FIG. 3 is a conceptual diagram showing the operation of a display synchronization setting unit according to an embodiment of the present invention. FIG. 4 is a conceptual diagram showing the operation of a geometric correction and mapping unit according to an embodiment of the present invention. FIG. 5 is a conceptual diagram showing the operation of a connection strategy setting unit according to an embodiment of the present invention. FIG. 6 is a conceptual diagram showing a spherical display implemented through 360-degree image mapping according to an embodiment of the present invention. Specific details for implementing the invention

[0018] The following detailed description of the invention refers to the accompanying drawings, which illustrate specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It should be understood that various embodiments of the invention are different but need not be mutually exclusive. For example, specific shapes, structures, and characteristics described herein may be modified from one embodiment to another without departing from the spirit and scope of the invention. It should also be understood that the location or arrangement of individual components within each embodiment may be modified without departing from the spirit and scope of the invention. Accordingly, the following detailed description is not meant to be limiting, and the scope of the invention should be understood to encompass the scope claimed by the claims and all equivalents thereof. Similar reference numerals in the drawings indicate identical or similar components across various aspects.

[0019] Hereinafter, in order to enable a person skilled in the art to easily practice the present invention, various preferred embodiments of the present invention will be described in detail with reference to the attached drawings.

[0020] Hereinafter, the term "spherical display" used in the embodiments of the present invention may be interpreted to include displays of various shapes having curvature, even if they are not spherical.

[0021] In addition, the term "360-degree image" can be interpreted to mean an image output on a spherical display, and includes images output on displays of various shapes that have some curvature, even if they are not 360 degrees.

[0022] In addition, for the sake of convenience of explanation, it is assumed that the spherical display emits light based on LEDs; however, various modules that can be utilized as displays other than LEDs may be used, and such embodiments may also be included within the scope of the present invention.

[0024] FIG. 1 is a conceptual diagram showing an internal-external interlocking output control device for performing output control of an internal display and an external display in a spherical display device according to an embodiment of the present invention.

[0025] FIG. 1 discloses a method for providing content to a viewer inside and outside a spherical display through output control of an internal display and an external display.

[0026] The internal and external interlocking output control device may include a spherical display structure information collection unit (110), a content analysis unit (120), a display synchronization setting unit (130), a geometric correction and mapping unit (140), a connection strategy setting unit (150), an output unit (160), and a processor (170).

[0027] The spherical display structure information collection unit (110) can be implemented to collect external display structure information and internal display structure information.

[0028] External display structure information is information about an external display located outside the spherical display, and may include information such as the arrangement of LED modules of the external display, spacing between LEDs, radius of the sphere, curvature, radius, panel arrangement, and viewing angle information.

[0029] Internal display structure information is information about an internal display located inside a spherical display, and may include information such as the arrangement of LED modules of the internal display, spacing between LEDs, radius of the sphere, curvature, radius, panel arrangement, and viewing angle information.

[0030] The content analysis unit (120) can extract content characteristic information by performing analysis on content to be output to an internal display and an external display. The content analysis unit (120) can extract content characteristic information through analysis of content categories and content output objects. Content categories can be classified into 360° images, panoramic images, equirectangular mapping images, and whether they are real-life or CG images, and content output objects can be classified based on objects included in the content, such as people, shapes, and animals. The content characteristic information can be used to perform synchronization, correction, and mapping when outputting content to the external display and the internal display.

[0031] The display synchronization setting unit (130) can be implemented to set synchronization standards for images output from an internal display and an external display.

[0032] The display synchronization setting unit (130) determines whether synchronization is necessary for the video output from the internal display and the external display based on content characteristic information, and if it is determined that synchronization is necessary, it can set synchronization criteria for synchronization. The display synchronization setting unit (130) can set synchronization time criteria, synchronization area criteria, synchronization object criteria, etc., as synchronization criteria for the video output from the internal display and the external display.

[0033] The synchronization time reference setting may be a time synchronization standard regarding the timing for performing synchronization between the internal and external displays. Considering the characteristics of the content, the synchronization time reference may be a standard for determining at which time interval during the content output time the video displayed on the internal and external displays should be synchronized.

[0034] The synchronization area criteria can be a standard for determining which image regions require synchronization in the video output from the internal and external displays. For example, the area requiring synchronization by default may be the region where the internal and external displays connect, specifically the area containing objects where visual segmentation could occur if synchronization is not performed. By making a separate judgment regarding these synchronization areas, synchronization is performed only on the necessary regions through the setting of correction, matching, and connection strategies, thereby enabling faster video processing.

[0035] The synchronization object criterion may be a standard for objects within the synchronization area that require synchronization with higher connectivity. For example, if an object named "whale" is output across both an internal and an external display, this object is set as a synchronization object. Since synchronization is performed only on synchronization objects through calibration, matching, and connection strategy settings, the video processing can be executed more quickly.

[0036] The geometric correction and mapping unit (140) can be implemented to enhance visual connectivity through correction and mapping of synchronization areas and synchronization objects. The geometric correction and mapping unit (140) can perform warping or inversion mapping for each synchronization area and synchronization object as needed. Additionally, the geometric correction and mapping unit (140) can perform mapping between the LED pixels of the internal display and the original image and the external display by considering content characteristics, such that the external display performs projection mapping on the external surface of the sphere and the internal display performs inversion projection mapping on the internal surface of the sphere.

[0037] The connection strategy setting unit (150) can be implemented to set a connection strategy for an internal display and an external display. For example, depending on the characteristics of the content, a connection mapping can be applied so that the images of the internal display and the external display appear continuous, or a differentiation mapping strategy can be applied to configure completely different images.

[0038] The output unit (160) can be implemented to output the final image, which has been mapped and corrected, to an internal and external display, respectively.

[0039] The processor (170) can be implemented to control the operation of the spherical display structure information collection unit (110), content analysis unit (120), display synchronization setting unit (130), geometric correction and mapping unit (140), connection strategy setting unit (150), and output unit (160).

[0040] The components according to the embodiments of the present invention may be implemented based on hardware (e.g., a computer server), and the operation of the components described above may be performed on the hardware (e.g., a computer server). Although referred to as components for convenience of explanation, the operations of the components may perform an automated process that did not exist before using computer program code based on hardware components such as a CPU (central processing unit), a GPU (graphic processing unit), and memory.

[0041] More specifically, the operation process of the components performed in the present invention is performed based on the control unit and arithmetic logic unit (ALU) of a processing unit such as a CPU. The operation process of the components can be performed through fetch, decode, and execute performed on hardware such as a CPU.

[0042] In addition, various memory structures (registers, cache memory, main memory, auxiliary memory) may be used for the operation of the operation process of the components according to the embodiment of the present invention, and computer program code using various memory hierarchies may be used for the efficiency of the operation process of the components.

[0043] By executing this computer program code-based automation through hardware, previously unknown processes are automated. Compared to non-automated procedures, this enables complete synchronization between internal and external displays and the realization of natural and highly immersive content. Furthermore, distortion and inconsistencies can be minimized through precise mapping output that accounts for structural differences in displays. Additionally, depending on the nature of the content, visual presentations can be configured either connected or separated between displays. This significantly increases the utilization of spherical displays compared to existing technologies and allows for the provision of high-quality, realistic content in the exhibition, promotion, and entertainment sectors.

[0045] FIG. 2 is a conceptual diagram showing the operation of a content analysis unit according to an embodiment of the present invention.

[0046] FIG. 2 discloses a method for receiving content to be output to an internal display and an external display from a content analysis unit and generating content characteristic information necessary for output control.

[0047] Referring to FIG. 2, the content analysis unit can perform a content format analysis step (step S210).

[0048] The content analysis unit can perform content format analysis by analyzing the metadata or video format of the input content. Content format analysis may be a procedure for analyzing content formats such as whether it is a 360° omnidirectional video, whether it is an equirectangular mapping video, whether it is a panoramic video, whether it is a standard flat video, and whether it is a real-world video or a computer graphics video. The results of the content format analysis may be used for synchronization, correction, mapping, etc.

[0049] The content analysis unit can perform a content spatial structure analysis step (step S220).

[0050] The content analysis unit can analyze video frames to extract the spatial structure of the content. The spatial structure of the content may include information regarding the location coordinates of key objects, the size and direction of movement of objects, the relative distance relationships between objects, the central axis or line of sight center area of ​​the video, etc. In this case, object recognition can be performed through a deep learning-based object recognition model or a rule-based video analysis algorithm.

[0051] More specifically, a spherical reference content coordinate system can be generated during the content spatial structure analysis stage. The content analysis unit can convert the original coordinate system of the input image (e.g., 2D planar coordinates or equirectangular coordinates) into a spherical display reference 3D spherical coordinate system. The spherical display reference 3D spherical coordinate system can be a latitude-longitude coordinate system or a radius-fixed spherical coordinate system, and can be defined as an integrated reference coordinate system applicable to both internal and external displays. This enables analysis linked to the display structure rather than planar image analysis.

[0052] Furthermore, in the content spatial structure analysis stage, the spherical spatial attributes of an object can be extracted to determine the content spatial structure. The spherical spatial attributes of an object may refer to its position on the spherical display representation rather than a simple object location. The content analysis unit can extract spatial structure parameters for objects within the content to determine their spherical spatial attributes. These spatial structure parameters may include the object center coordinates, the spherical area range occupied by the object, the object's movement vector between frames, and the normal vector of the object's movement direction; the object recognition result can be stored as a result re-projected into spherical coordinates. In other words, rather than simply the "object location," the position on the spherical display surface is directly calculated, making it possible to determine the degree of surface occupancy on the sphere.

[0053] Additionally, during the content spatial structure analysis stage, calculations regarding relative positions relative to display boundaries may be performed. The content analysis unit can define the internal display area and the external display area separately in a spherical coordinate system and determine information regarding the relative position relative to display boundaries for each object. The relative position relative to boundaries may be information regarding the object's location relative to the boundaries of the internal and external displays. Information regarding the relative position relative to display boundaries may include the minimum angular distance between the object and the display boundary, the probability of the object passing through the boundary area, and information regarding the boundary approach speed according to frame progression. Through this method, the proximity of an object to the boundary can be calculated as an angle-based numerical value, enabling content analysis to be performed using continuous numerical data rather than simple rules. The minimum angular distance between the object and the display boundary is a value expressed in degrees indicating how close an object is located in the direction of the display boundary; it may represent the minimum angular difference between the center direction vector of the content object and the display boundary direction vector when viewed from an observation reference point (e.g., the center of the display or the viewer's viewpoint).

[0054] In addition, spatial structure metadata may be generated during the content spatial structure analysis stage. Spatial structure metadata may include information such as spherical coordinate information per object, movement direction and velocity information per object, and display boundary adjacency information, and this spatial structure metadata can subsequently be used as input data for synchronization, correction, and connection strategies.

[0055] The content analysis unit can perform the step of calculating the importance of the display linkage (step S230).

[0056] The content analysis unit can quantify the degree to which objects or areas within the content require connection between the internal and external displays. For example, objects passing through the boundary area between the internal and external displays may be assigned a relatively high connection importance, while objects remaining within a single display may be assigned a low connection importance. This connection importance can change based on the movement of objects within the content over time. These analysis results can be used to determine whether synchronization is necessary and to select synchronization objects.

[0057] The Content Analysis Department can quantitatively calculate the display linkage importance for each object or area based on the results of the content spatial structure analysis during the display linkage importance calculation stage. The Content Analysis Department may define multiple evaluation indicators for calculating importance. The evaluation indicators may include a boundary adjacency index, a boundary traversability index, and an object visual importance index.

[0058] The boundary proximity index quantifies whether an object is adjacent to the boundary between an internal and external display. It can be used to determine proximity based on the angular distance between the object center and the boundaries of the internal and external displays. A smaller value for the boundary proximity index may indicate an increased need for linkage.

[0059] The boundary passing probability index quantifies the probability that an object passes through the boundary between the internal and external displays, and the boundary passing probability index can be determined by calculating the probability of passing through the boundary within a certain frame based on the object's movement vector and velocity.

[0060] The object visual importance index is a value regarding the visual importance an object occupies in an image, and it can be determined by considering the object size, object screen occupancy, and whether the object's gaze center area is included.

[0061] The content analysis department can calculate the display linkage importance score for each object by applying weights to the boundary proximity index, the boundary traversability index, and the object visual importance index, respectively.

[0062] The content analysis unit can classify display-linked importance scores based on thresholds. Based on the calculated importance scores, the content analysis unit can classify objects as follows.

[0063] A first object group is set as a synchronization object with a display linkage importance of at least a first threshold, a second object group is a target for selective correction with an importance of at least a second threshold and less than a first threshold, and a third object group can be set as an object capable of independent output with an importance less than a second threshold.

[0064] Through this processing, the correction target can be reduced, synchronization operations minimized, and real-time processing performance improved.

[0065] In addition, the content analysis unit can generate a display linkage importance map at the object or area level during the display linkage importance calculation stage. The importance map is created in the form of a spherical coordinate-based heatmap and can be referenced by both internal and external displays. The importance map can be utilized as common input data in synchronization settings, geometric correction and mapping, and connection strategy settings.

[0067] FIG. 3 is a conceptual diagram showing the operation of a display synchronization setting unit according to an embodiment of the present invention.

[0068] In Fig. 3, the display synchronization setting unit can set a synchronization strategy between internal and external displays based on content characteristic information generated by the content analysis unit.

[0069] Referring to FIG. 3, the display synchronization setting unit can perform a step of determining the necessity of synchronization (step S310).

[0070] The display synchronization setting unit may determine to perform synchronization if at least one of the synchronization requirements is satisfied.

[0071] Synchronization requirements may include first to third synchronization requirements. The first synchronization requirement may be when identical or consecutive content is output to an internal display and an external display. The second synchronization requirement may be when an object within the content moves through the display boundary. The third synchronization requirement may be when an object of critical connectivity is detected.

[0072] The display synchronization setting unit can perform a synchronization standard generation step (step S320).

[0073] The synchronization criteria creation stage may include a synchronization time criteria setting stage, a synchronization area criteria setting stage, and a synchronization object criteria setting stage.

[0074] The synchronization time reference setting step allows you to configure synchronization at a specific frame or frame interval based on the frame timelines of the internal and external displays.

[0075] More specifically, a reference frame may be selected to set the synchronization time standard. At least one of the object movement start frame or the object display boundary approach frame extracted by the content analysis unit may be set as the reference frame. Subsequently, an allowable time error range may be set. An allowable frame error between internal and external displays may be set. Subsequently, a synchronization frame interval may be defined. By defining the synchronization interval as one that includes multiple frames before and after the reference frame rather than a single frame, stable synchronization can be maintained even in the event of frame loss or output delay.

[0076] In the synchronization area standard setting step, an area with a high probability of visual disconnection can be set as the synchronization area based on the boundary area where the internal and external displays are visually connected.

[0077] A boundary reference space may be defined to establish a synchronization area standard. The boundary reference space may be defined as a boundary angle area on a spherical coordinate system where internal and external displays are adjacent or visually connected. The boundary angle area may be an area defined by quantifying the boundary where the internal display area and the external display area are visually connected or transitioned on the spherical display into an angle coordinate range.

[0078] Subsequently, boundary proximity is calculated to establish a synchronization area standard, and it can be determined whether an object or image area is located within a certain angular distance from the boundary standard area. Angular distance is an angular distance measured along the surface of a spherical display, indicating whether an object or image area is sufficiently close to the inner or outer display boundary. In a spherical display, the difference in viewing direction (angle) has a more direct impact on visual continuity than actual distance (m) or the number of screen pixels. Therefore, the present invention allows for a determination to be performed based on angular distance.

[0079] Next, the risk of visual discontinuity can be calculated to establish the synchronization area criteria. The risk of visual discontinuity refers to the risk that a viewer will perceive a visual disconnection and can be determined based on object movement speed, object size, and boundary approach angle.

[0080] Through the above procedure, a synchronization area can be determined by considering boundary proximity and visual disconnection risk in the boundary reference space.

[0081] The synchronization object criteria setting step allows the content analysis unit to set objects assigned high connection importance as separate synchronization objects.

[0082] To set synchronization object criteria, display linkage importance scores for each object are entered, and objects with importance scores above a set threshold can be designated as synchronization objects. Subsequently, synchronization object criteria can be set by creating object-unit synchronization parameters. Object-unit synchronization parameters may include object center coordinates, object occupancy areas, and expected boundary crossing times.

[0083] The display synchronization setting unit can perform the step of applying an optional synchronization strategy (step S330).

[0084] By performing precise synchronization only on the synchronization area and synchronization objects rather than the entire image, it is possible to reduce computational load while ensuring visual naturalness.

[0086] FIG. 4 is a conceptual diagram showing the operation of a geometric correction and mapping unit according to an embodiment of the present invention.

[0087] In Fig. 4, the geometric correction and mapping unit can generate a coordinate correspondence relationship between the image and the display based on display structure information and synchronization setting information.

[0088] Referring to FIG. 4, the geometric correction and mapping unit can perform a display coordinate system generation step (step S410).

[0089] In the display coordinate system generation step, the display coordinate system for the external display can be established based on the sphere's outer surface reference coordinate system, and the display coordinate system for the internal display can be established based on the sphere's inner surface reference coordinate system. Each coordinate system can be generated by reflecting the display's radius, curvature, and LED module array information.

[0090] The geometric correction and mapping unit may perform a step of determining the projection mapping method (step S420).

[0091] The geometric correction and mapping unit can select different projection methods depending on the content characteristics and display position. For example, forward projection mapping based on an external viewpoint is performed on an external display, and inversion projection mapping based on an internal viewpoint can be performed on an internal display.

[0092] The geometric correction and mapping unit can perform distortion correction and inversion processing steps (step S430).

[0093] In the distortion correction and inversion processing step, non-linear distortion correction (Warping) and left-right / up-down inversion mapping can be optionally performed on the synchronization area or synchronization object. This allows the same object to be consistently represented between internal and external displays in terms of shape, size, and direction of movement.

[0094] In the distortion correction and inversion processing step, for a synchronization area or synchronization object, the degree of shape distortion and mismatch in movement direction caused by differences in surface normal directions and projection coordinate systems between the internal and external displays are numerically determined, and if the degree of shape distortion exceeds a threshold value, non-linear distortion correction can be performed. The degree of shape distortion can be determined by considering the aspect ratio of the original object and the aspect ratio of the projected object.

[0095] By selectively performing left-right or up-down inversion mapping when the signs of the movement direction or viewing direction are different, the same object can be consistently represented between internal and external displays in terms of shape, size, and movement direction.

[0096] By analyzing the relationship between the object movement vector and the display surface normal vector, left-right inversion can be performed if the movement direction relative to the external display and the movement direction relative to the internal display have different signs.

[0097] By determining the vertical mismatch based on the viewing angle, the viewer's viewing direction vector (View Vector) and the object's vertical direction vector are compared, and if the top of the object is located at the top of the viewer's viewing angle on the external display and the top of the same object is recognized as the bottom on the internal display, vertical inversion mapping can be performed.

[0098] The geometric correction and mapping unit can perform a step of generating a pixel-unit mapping table (step S440).

[0099] In the pixel-unit mapping table generation step, a pixel-unit mapping table, which is a correspondence table between original image coordinates and internal / external LED pixel coordinates, can be generated, and this pixel-unit mapping table can be generated in real-time or by pre-calculation.

[0101] FIG. 5 is a conceptual diagram showing the operation of a connection strategy setting unit according to an embodiment of the present invention.

[0102] In FIG. 5, a method is disclosed for a connection strategy setting unit to set a relationship definition policy between internal and external displays based on content analysis results and user settings.

[0103] Referring to FIG. 5, the connection strategy setting unit selectively applies a connection-type mapping strategy (510), a differentiation-type mapping strategy (520), and a mixed-type strategy (530) as shown below, and changes the strategy according to the strategy switching condition (540), thereby enabling flexible direction according to the content operation scenario.

[0104] The connected mapping strategy (510) is a strategy configured so that the internal display and the external display are perceived as one continuous space. The connected mapping strategy (510) is a strategy configured to naturally connect without boundary interruption when moving objects, and can be used in educational, exhibition, and storytelling content.

[0105] The differentiated mapping strategy (520) is a strategy of applying different content or presentations to the internal display and the external display. Immersive and narrative content may be displayed on the internal display, while promotional and visual attention content may be displayed on the external display.

[0106] The mixed-type strategy (530) basically applies the differential mapping strategy (520), but switches to the connected mapping strategy (510) when a specific object or event occurs.

[0107] In the connection strategy setting section, strategy switching conditions (540) can be set to perform time-based switching, event-based switching, object-based switching, etc. Time-based switching is a strategy switching according to the flow of time, event-based switching is a strategy switching based on events on the content or events other than display output, and object-based switching is a strategy switching based on objects output from the content. By considering these strategy switching conditions, flexible direction can be achieved according to the content operation scenario.

[0108] The linked mapping strategy may be used when at least one of the following linked mapping strategy conditions is satisfied. The linked mapping strategy conditions may be used when there are objects or regions where the display linkage importance is above a threshold value, when the object movement path is analyzed to pass through the internal and external display boundaries, or when the content spatial structure analysis results determine that the content is designed as a single continuous space. When the linked mapping strategy is applied, the same coordinate system or a transformed continuous coordinate system is used between the internal and external displays, object IDs are shared, object position and velocity continuity is maintained in the boundary area, and geometric correction and inversion processing may be forcibly enabled.

[0109] A differential mapping strategy may be used when at least one of the following differential mapping strategy conditions is satisfied. The differential mapping strategy conditions may include cases where the viewer's viewpoint is different between internal and external displays or the purpose of the content is different, cases where only objects with a linkage importance below a threshold exist, and cases where an independent performance mode is selected in the user settings.

[0110] When a differential mapping strategy is set, internal and external displays use different content tracks or rendering pipelines, object IDs, movement information, and state information are not shared between displays, and object movement linkage can be disabled even in boundary areas.

[0112] FIG. 6 is a conceptual diagram showing a spherical display implemented through 360-degree image mapping according to an embodiment of the present invention.

[0113] Referring to FIG. 6, a 360-degree image mapped and output through a spherical display device is disclosed as an example.

[0114] Through the aforementioned mapping algorithm, a naturally mapped image can be provided to the user on a spherical display.

[0115] A spherical display according to an embodiment of the present invention can provide a continuous experience in which a story that begins on the street is completed inside by transmitting connectivity between the outside and the inside. As a detail of the exterior wall media facade, the exterior wall is composed of a pitch of approximately 2023 m² and can function as a 360° media canvas that wraps around the city sky.

[0116] The exterior media facade can serve as a digital canvas that simultaneously reflects the city's identity and the emotions of its citizens, rather than being a simple visual device. More specifically, the interior is a fully immersive theater consisting of 890㎡ of 4mm pitch ultra-high-resolution LEDs, where the ceiling and walls are connected as one, allowing the audience to experience a sense of space as if they are standing at the center of the immersive media.

[0118] The device described above may be implemented as a hardware component, a software component, and / or a combination of a hardware component and a software component. For example, the device and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit may execute an operating system (OS) and one or more software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. In addition, other processing configurations, such as parallel processors, are also possible.

[0119] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or instruct the processing unit independently or collectively. Software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and may be stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

[0120] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may continuously store a program executable by a computer, or temporarily store it for execution or download. Additionally, the medium may be various recording or storage means in the form of a single or several hardware combined, and may not be limited to a medium directly connected to a computer system but may exist distributed over a network. Examples of media may include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and media configured to store program instructions, including ROM, RAM, and flash memory. Additionally, other examples of media may include recording or storage media managed by app stores that distribute applications or sites and servers that supply or distribute various other software.

[0121] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, suitable results can be achieved even if the described techniques are performed in a different order than described, and / or the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.

[0122] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims set forth below.

Claims

Claim 1 A process in which a spherical display structure information collection unit collects internal display structure information and external display structure information; a process in which a content analysis unit performs analysis on content to be output to the internal display and external display to extract content characteristic information; a process in which a display synchronization setting unit sets synchronization criteria for images output from the internal display and the external display based on the content characteristic information; a process in which a geometric correction and mapping unit maps content to the internal display and the external display based on the synchronization criteria; The connection strategy setting unit sets a connection strategy for the internal display and the external display, and includes a process of applying a connection-type mapping so that the images of the internal display and the external display appear continuous depending on the characteristics of the content, or applying a differential mapping strategy to configure completely different images; the connection strategy setting unit applies a connection-type mapping strategy configured so that the internal display and the external display are recognized as a single continuous space; using the connection-type mapping strategy, provides educational, exhibition, and storytelling content so that it naturally continues without boundary interruption when an object moves; applies a differential mapping strategy that applies different content or direction to the internal display and the external display; using the differential mapping strategy, outputs immersive and narrative content on the internal display and outputs promotional and visual attention content on the external display; basically applies the differential mapping strategy but applies a hybrid strategy that switches to the connection-type mapping strategy when a specific object or event occurs; applies strategy switching conditions that perform time-based switching, event-based switching, and object-based switching; uses the time-based switching to switch strategies according to the flow of time; and uses the event-based switching to events on the content or Switch strategies based on events other than display output, andA method for controlling an internal display and an external display in a spherical display, characterized by switching strategies based on objects output from content using the object-based switching described above, selectively applying the connection-type mapping strategy, the differentiation-type mapping strategy, and the hybrid strategy, changing strategies according to the strategy switching conditions, and performing direction according to a content operation scenario; using the connection-type mapping strategy when there is an object or area where the display linkage importance is greater than or equal to a threshold value, when an analysis shows that the object movement path passes through the boundary between the internal display and the external display, or when the content spatial structure analysis result determines that the content is designed as a single continuous space; and applying the connection-type mapping strategy to use the same coordinate system or a transformed continuous coordinate system between the internal display and the external display, sharing object IDs, maintaining object position and velocity continuity in the boundary area, and activating geometric correction and inversion processing. Claim 2 A method for controlling an internal display and an external display in a spherical display, wherein, in claim 1, the geometric correction and mapping unit performs warping or inversion mapping for each synchronization area and synchronization object when necessary to enhance visual connectivity by utilizing correction and mapping for the synchronization area and synchronization object. Claim 3 A method for controlling an internal display and an external display in a spherical display, characterized in that, in paragraph 2, the content characteristic information includes information regarding a content category and a content output object, and the synchronization criteria include a synchronization time criterion setting, a synchronization area criterion, and a synchronization object criterion. Claim 4 A spherical display structure information collection unit that collects internal display structure information and external display structure information; a content analysis unit that performs analysis on content to be output to the internal display and external display to extract content characteristic information; a display synchronization setting unit that sets synchronization criteria for images output from the internal display and the external display based on the content characteristic information; and a geometric correction and mapping unit that maps content to the internal display and the external display based on the synchronization criteria. The system includes a connection strategy setting unit that sets a connection strategy for the internal display and the external display, and applies a connection-type mapping to make the images on the internal display and the external display appear continuous or applies a differentiation-type mapping strategy to configure completely different images depending on the characteristics of the content; the connection strategy setting unit applies a connection-type mapping strategy configured to make the internal display and the external display perceived as a single continuous space, provides educational, exhibition, and storytelling content so that it naturally continues without boundary interruption when an object moves using the connection-type mapping strategy, applies a differentiation-type mapping strategy to apply different content or direction to the internal display and the external display, outputs immersive and narrative content on the internal display and outputs promotional and visual attention content on the external display using the differentiation-type mapping strategy, basically applies the differentiation-type mapping strategy but applies a hybrid strategy that switches to the connection-type mapping strategy when a specific object or event occurs, applies strategy switching conditions that perform time-based switching, event-based switching, and object-based switching, uses the time-based switching to switch strategies according to the flow of time, and uses the event-based switching to events on the content or displays Switch strategies based on events other than output, andAn internal / external linked output control device characterized by switching strategies based on objects output from content using the object-based switching described above, selectively applying the connection-type mapping strategy, the differentiation-type mapping strategy, and the mixed-type strategy, changing strategies according to the strategy switching conditions, and performing direction according to the content operation scenario; using the connection-type mapping strategy when there is an object or area where the display linkage importance is above a threshold, when the object movement path is analyzed to pass through the boundary between the internal display and the external display, or when the content spatial structure analysis result determines that the content is designed as a single continuous space; and applying the connection-type mapping strategy to use the same coordinate system or a transformed continuous coordinate system between the internal display and the external display, sharing object IDs, maintaining object position and velocity continuity in the boundary area, and activating geometric correction and inversion processing. Claim 5 An internal / external interlocking output control device according to claim 4, wherein the geometric correction and mapping unit performs warping or inversion mapping for each synchronization area and synchronization object when necessary to enhance visual connectivity by utilizing correction and mapping for synchronization areas and synchronization objects. Claim 6 An internal / external interlocking output control device according to claim 5, wherein the content characteristic information includes information regarding content categories and content output objects, and the synchronization criteria include synchronization time criteria, synchronization area criteria, and synchronization object criteria.

Images