Method for provideing cloud streaming service using message broadcast to pop-up browser and apparatus using the same

Abstract

A method for providing a cloud streaming service using message broadcasting to pop-up browsers and an apparatus for providing the same are disclosed. According to the present invention, a cloud streaming server registers all pop-up browsers to a broadcast channel, generates a message including a message ID, broadcasts the message to all pop-up browsers, and performs processing corresponding to the message in at least one of all pop-up browsers based on message filtering using the message ID.

Description

Technology Field

[0001] The present invention relates to a technology for providing a cloud streaming service using message broadcasting to a pop-up browser, and more specifically, to a cloud streaming technology that solves the problem of message processing for multiple pop-up browsers by delivering messages in a broadcast manner while preventing message processing delays. Background Technology

[0002] The rapid development of the Internet has resulted in a dramatic improvement in individual communication speeds. This improvement in communication speeds provides an environment where users can access computers located in remote areas to download or upload large amounts of data, or use remote computers as if they were locally logged in by using remote computer control programs. Furthermore, as a wide variety of applications are developed for mobile communication terminals such as smartphones, many virtualization technologies are being proposed to run applications requiring high performance on relatively low-performance user terminals.

[0003] Cloud streaming technology is a solution that runs applications or services requiring high-spec system resources on a cloud streaming server and delivers only the rendered results to a user terminal. Therefore, even on low-spec terminals, high-spec videos can be played or 3D games can be played.

[0004] Meanwhile, to use a popup browser in a web application operating based on cloud streaming, a method is used to call the popup browser using another browser. In this case, if multiple popup browsers are called, conflicts may occur or priorities may change unintentionally as the browsers attempt to process commands against each other. Therefore, commands are sorted according to the screen's priority and used to operate sequentially.

[0005] However, some commands take a long time to process, and delays occur because the next popup browser must wait while the command is being processed. This causes a problem of processing speed delay in cloud streaming UIs that use all messages together.

[0006] In addition, special measures were required to deliver messages to all popup browsers or to issue commands only to browsers that met specific conditions. Prior art literature

[0007] Korean Published Patent No. 10-2019-0021141, published March 5, 2019 (Title: Electronic device for controlling a multi-window and method of operation thereof) The problem to be solved

[0008] The objective of the present invention is to resolve message processing for multiple popup browsers in a cloud streaming UI while simultaneously preventing message processing speed delays.

[0009] In addition, the objective of the present invention is to effectively control multiple popup browsers by performing broadcast-style message delivery from a cloud streaming server to a popup browser.

[0010] In addition, the objective of the present invention is to efficiently manage message communication between popup browsers or messages that a popup browser must process, or to control them according to specific situations. means of solving the problem

[0011] A method for providing a cloud streaming service using message broadcasting to a pop-up browser according to the present invention for achieving the above-mentioned purpose comprises the steps of: a cloud streaming server registering all pop-up browsers to a broadcast channel; generating a message including a message ID; and broadcasting the message to all pop-up browsers, and performing processing corresponding to the message in at least one of all pop-up browsers based on message filtering using the message ID.

[0012] At this time, all popup browsers can pre-register message IDs corresponding to the required messages.

[0013] At this time, message filtering can compare whether the message ID registered in each of the above-mentioned popup browsers matches the message ID included in the message.

[0014] At this time, if the registered message ID and the message ID included in the message match, all popup browsers can refer to the message and perform processing corresponding to one of providing a return value to the main browser, transmitting the application execution screen to the GPU, KEY processing, and command processing.

[0015] At this time, all popup browsers may not process the message if the registered message ID and the message ID included in the message do not match.

[0016] Additionally, the cloud streaming server according to the present invention includes a processor that registers all pop-up browsers to a broadcast channel, generates a message including a message ID, and broadcasts the message to all pop-up browsers; and a memory that stores the message ID, and performs processing corresponding to the message in at least one of all pop-up browsers based on message filtering using the message ID.

[0017] At this time, all popup browsers can pre-register message IDs corresponding to the required messages.

[0018] At this time, message filtering can compare whether the message ID registered in each of the above-mentioned popup browsers matches the message ID included in the message.

[0019] At this time, if the registered message ID and the message ID included in the message match, all popup browsers can refer to the message and perform processing corresponding to one of providing a return value to the main browser, transmitting the application execution screen to the GPU, KEY processing, and command processing.

[0020] At this time, all popup browsers may not process the message if the registered message ID and the message ID included in the message do not match. Effects of the invention

[0021] According to the present invention, message processing of multiple pop-up browsers in a cloud streaming UI can be resolved while simultaneously preventing message processing speed delays.

[0022] In addition, the present invention can effectively control multiple popup browsers by performing broadcast-style message delivery from a cloud streaming server to a popup browser.

[0023] In addition, the present invention can efficiently manage message communication between popup browsers or messages that a popup browser needs to process, or control them according to specific situations. Brief explanation of the drawing

[0024] FIG. 1 is a block diagram showing a cloud streaming service system according to an embodiment of the present invention. FIG. 2 is an operation flowchart illustrating a method for providing a cloud streaming service using message broadcast to a pop-up browser according to an embodiment of the present invention. FIG. 3 is a diagram showing an example of a cloud streaming service provision process according to the present invention. FIG. 4 is an operation flowchart illustrating in detail the message filtering process among the cloud streaming service provision methods according to the present invention. FIG. 5 is a diagram illustrating in detail the process of providing a cloud streaming service using message broadcast to a pop-up browser according to the present invention. FIG. 6 is a block diagram showing a cloud streaming server according to an embodiment of the present invention. Specific details for implementing the invention

[0025] The present invention will be described in detail below with reference to the accompanying drawings. Hereinafter, repetitive descriptions and detailed descriptions of known functions and configurations that may unnecessarily obscure the essence of the invention are omitted. Embodiments of the present invention are provided to more fully explain the invention to those with average knowledge in the art. Accordingly, the shapes and sizes of elements in the drawings may be exaggerated for clearer explanation.

[0026] Throughout the specification, when a part is described as "comprising" a certain component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0027] The present invention is capable of various modifications and may have various embodiments; therefore, specific embodiments are illustrated in the drawings and described in detail. The effects and features of the present invention, and the methods for achieving them, will become clear by referring to the embodiments described below in detail together with the drawings. Hereinafter, repetitive descriptions and detailed descriptions of known functions and configurations that may unnecessarily obscure the essence of the present invention are omitted. The embodiments of the present invention are provided to more completely explain the invention to those with average knowledge in the art. Accordingly, the shapes and sizes of elements in the drawings may be exaggerated for clearer explanation.

[0028] However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various forms by selectively combining all or part of each embodiment. In the following embodiments, terms such as "first," "second," etc., are used not in a limiting sense but for the purpose of distinguishing one component from another. Furthermore, singular expressions include plural expressions unless the context clearly indicates otherwise. Additionally, terms such as "include" or "have" mean that the features or components described in the specification exist, and do not preclude the possibility of adding one or more other features or components.

[0029] Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. However, detailed descriptions of known functions or configurations that may obscure the essence of the present invention in the following description and accompanying drawings are omitted. Additionally, it should be noted that identical components throughout the drawings are indicated by the same reference numerals whenever possible. The embodiments of the present invention are provided to more fully explain the invention to those with average knowledge in the art. Accordingly, the shapes and sizes of elements in the drawings may be exaggerated for clearer explanation.

[0030] The terms and words used in the specification and claims described below should not be interpreted as being limited to their ordinary or dictionary meanings. Instead, based on the principle that the inventor may appropriately define the concepts of terms to best describe their invention, they must be interpreted in a meaning and concept consistent with the technical spirit of the invention. Accordingly, the embodiments described in this specification and the configurations illustrated in the drawings are merely one preferred embodiment of the invention and do not represent the entire technical spirit of the invention; therefore, it should be understood that various equivalents and modifications capable of replacing them may exist at the time of filing this application. Furthermore, terms such as "first," "second," etc., are used to describe various components and are used solely for the purpose of distinguishing one component from another, not to limit said components.

[0031] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings. When describing with reference to the drawings, identical or corresponding components are given the same reference numerals, and redundant descriptions thereof will be omitted.

[0032] FIG. 1 is a block diagram showing a cloud streaming service system according to an embodiment of the present invention.

[0033] Referring to FIG. 1, a cloud streaming service system according to one embodiment of the present invention includes a cloud streaming server (110), user terminals (120-1 to 120-N) and a network (130).

[0034] Cloud streaming services or cloud computing services are services that allow users to store content in cloud storage on the internet rather than in local storage, and to access and use the content from the cloud storage anytime and anywhere using an internet-enabled device.

[0035] The cloud streaming server (110) can encode images using a still image compression technique. For example, the still image compression technique may include techniques such as PNG (Portable Network Graphics), Paletted PNG (Portable Network Graphics), and JPEG (Joint Photography Experts Group).

[0036] Additionally, the cloud streaming server (110) may include a cloud streaming engine for processing cloud streaming services requested from user terminals (120-1 to 120-N).

[0037] At this time, the cloud streaming server (110) can create a predefined number of browsers at the time the cloud streaming engine is executed, and the browsers can download and execute HTML, CSS, JavaScript, etc. and render them on the screen.

[0038] In this case, HTML (Hyper Text Markup Language) provides the main framework of the web page, CSS (Cascading Style Sheets) manages design elements such as colors and fonts, and JavaScript, as a cross-platform, object-oriented scripting language, can handle the functionality of the web page.

[0039] The cloud streaming server (110) registers all pop-up browsers to the broadcast channel.

[0040] Additionally, the cloud streaming server (110) generates a message containing a message ID.

[0041] Additionally, the cloud streaming server (110) broadcasts the message to all of the above-mentioned popup browsers.

[0042] At this time, based on message filtering using a message ID, processing corresponding to the message can be performed in at least one of the popup browsers among all the popup browsers.

[0043] At this time, all popup browsers can pre-register message IDs corresponding to the required messages.

[0044] At this time, message filtering can compare whether the message ID registered in each of the popup browsers matches the message ID included in the message.

[0045] At this time, if the registered message ID matches the message ID included in the message, all popup browsers can refer to the message and perform processing corresponding to one of providing a return value to the main browser, sending the application execution screen to the GPU, KEY processing, and command processing.

[0046] At this time, all popup browsers may not process the message if the registered message ID does not match the message ID included in the message.

[0047] At this time, the cloud streaming server (110) can provide cloud streaming services to the user's terminal (120-1 to 120-N) by performing streaming procedures corresponding to capture, encoding, and sending. At this time, the streaming pipeline procedure corresponding to capture, encoding, and sending may be viewed as including rendering, and consisting of rendering, capture, encoding, and sending.

[0048] A user terminal (120-1 to 120-N) can request a cloud streaming service from a cloud streaming server (110) and receive an execution screen corresponding to the request from the cloud streaming server (110) and provide it to the user. Therefore, the user can feel as if a video or application corresponding to the requested service is running on the user terminal (120-1 to 120-N).

[0049] At this time, the user terminals (120-1 to 120-N) may each correspond to a device connected to a communication network and capable of communicating with a cloud streaming server (110). For example, the user terminals (120-1 to 120-N) may correspond to various terminals such as all information and communication devices, multimedia terminals, wired terminals, fixed terminals, mobile communication terminals, and IP (Internet Protocol) terminals. Additionally, the user terminals (120-1 to 120-N) may be mobile terminals having various mobile communication specifications, such as mobile phones, mobile phones, PMP (Portable Multimedia Played), MID (Mobile Internet Device), smartphones, desktops, tablet PCs, notebooks, netbooks, personal digital assistants (PDA), smart TVs, and information and communication devices.

[0050] Additionally, the user terminal (120-1 to 120-N) can receive various information, such as numeric and character information, and transmit signals input related to setting various functions and controlling the functions of the user terminal (120-1 to 120-N) to the control unit through the input unit. Furthermore, the input unit of the user terminal (120-1 to 120-N) may be configured to include at least one of a keypad and a touchpad that generates input signals according to the user's touch or operation. In this case, the input unit of the user terminal (120-1 to 120-N) may be configured in the form of a single touch panel (or touch screen) together with the display unit of the user terminal (120-1 to 120-N) to perform input and display functions simultaneously. Additionally, the input unit of the user terminal (120-1 to 120-N) may utilize all forms of input means that may be developed in the future, in addition to input devices such as keyboards, keypads, mice, and joysticks.

[0051] In addition, the display unit of the user terminal (120-1 to 120-N) can display information regarding a series of operation states and operation results that occur during the performance of functions of the user terminal (120-1 to 120-N). In addition, the display unit of the user terminal (120-1 to 120-N) can display the menu of the user terminal (120-1 to 120-N) and user data entered by the user. Here, the display unit of the user terminal (120-1 to 120-N) may be composed of a Liquid Crystal Display (LCD), a Thin Film Transistor LCD (TFT-LCD), a Light Emitting Diode (LED), an Organic LED (OLED), an Active Matrix OLED (AMOLED), a Retina Display, a Flexible Display, and a 3D Display. At this time, if the display unit of the user terminal (120-1 to 120-N) is configured in the form of a touchscreen, the display unit of the user terminal (120-1 to 120-N) can perform some or all of the functions of the input unit of the user terminal (120-1 to 120-N).

[0052] Additionally, the storage unit of the user terminal (120-1 to 120-N) is a device for storing data, and includes a main memory and an auxiliary memory, and can store application programs necessary for the functional operation of the user terminal (120-1 to 120-N). The storage unit of the user terminal (120-1 to 120-N) may largely include a program area and a data area. Here, when the user terminal (120-1 to 120-N) activates each function in response to a user's request, it executes the corresponding application programs under the control of the control unit to provide each function.

[0053] Additionally, the communication unit of the user terminal (120-1 to 120-N) can perform the function of transmitting and receiving data through a network with the cloud streaming server (110). Here, the communication unit of the user terminal (120-1 to 120-N) may include an RF transmitting means for up-converting and amplifying the frequency of a transmitted signal, and an RF receiving means for low-noise amplification and down-converting the frequency of a received signal. Such a communication unit of the user terminal (120-1 to 120-N) may include a wireless communication module. The wireless communication module is configured to transmit and receive data according to a wireless communication method, and when the user terminal (120-1 to 120-N) uses wireless communication, it can transmit and receive data to and from the cloud streaming server (110) using any one of a wireless network communication module, a wireless LAN communication module, and a wireless fan communication module. That is, the user terminal (120-1 to 120-N) connects to the network using a wireless communication module and can transmit and receive data with the cloud streaming server (110) through the network.

[0054] Additionally, the control unit of the user terminal (120-1 to 120-N) may be an operating system (OS) and a process device that drives each component. For example, the control unit may control the entire process of connecting to the cloud streaming server (110). At this time, when the user terminal (120-1 to 120-N) connects to the cloud streaming server (110), the control unit may control the entire process of executing content such as video or an application according to the user's request, and may control the transmission of a service usage request to the cloud streaming server (110) simultaneously with the execution. At this time, the control unit may also control the transmission of information of the user terminal (120-1 to 120-N) required for user authentication.

[0055] The network (130) provides a channel for transmitting data between a cloud streaming server (110) and user terminals (120-1 to 120-N), and is a concept that encompasses both existing networks and networks that may be developed in the future. For example, the network (130) may be a wired / wireless local area network that provides communication of various information devices within a limited area, a mobile communication network that provides communication between mobile bodies and between a mobile body and the outside of a mobile body, a satellite communication network that provides communication between earth stations using satellites, or any one of wired / wireless communication networks, or a combination of two or more. Meanwhile, the transmission method standard of the network is not limited to existing transmission method standards and may include all transmission method standards to be developed in the future.

[0056] Through such a system, message processing for multiple popup browsers in a cloud streaming UI can be resolved while simultaneously preventing delays in message processing speed.

[0057] In addition, multiple popup browsers can be effectively controlled by performing broadcast-style message delivery from a cloud streaming server to popup browsers.

[0058] In addition, message communication between popup browsers or messages that popup browsers need to process can be efficiently managed or controlled according to specific situations.

[0059] FIG. 2 is an operation flowchart illustrating a method for providing a cloud streaming service using message broadcast to a pop-up browser according to an embodiment of the present invention.

[0060] Referring to FIG. 2, a method for providing a cloud streaming service using message broadcast to a pop-up browser according to an embodiment of the present invention involves a cloud streaming server registering all pop-up browsers to a broadcast channel (S210).

[0061] In other words, all popup browsers can register to a broadcast channel to receive messages, rather than registering through a cloud streaming server.

[0062] In addition, a method for providing a cloud streaming service using a message broadcast to a popup browser according to an embodiment of the present invention includes a cloud streaming server generating a message including a message ID (S220).

[0063] For example, when a message occurs in a web application, the cloud streaming server can generate a message for broadcasting by including the message ID of the generated message.

[0064] In addition, a method for providing a cloud streaming service using message broadcast to a pop-up browser according to an embodiment of the present invention includes a cloud streaming server broadcasting a message to all of the pop-up browsers (S230).

[0065] In other words, according to the present invention, message processing speed can be improved by transmitting commands to all popup browsers via a broadcast method, rather than by registering them when creating a popup browser in a web application.

[0066] At this time, based on message filtering using a message ID, processing corresponding to the message can be performed in at least one of the popup browsers among all the popup browsers.

[0067] At this time, all popup browsers can pre-register message IDs corresponding to the required messages.

[0068] For example, messages may include messages that all popup browsers must process, messages that only specific popup browsers must process, and messages that are not processed but require confirmation of receipt. Therefore, all popup browsers can perform a message ID registration process to filter the messages they need to process.

[0069] At this time, message filtering can compare whether the message ID registered in each of the above-mentioned popup browsers matches the message ID included in the message.

[0070] At this time, if the registered message ID matches the message ID included in the message, all popup browsers can refer to the message and perform processing corresponding to one of providing a return value to the main browser, sending the application execution screen to the GPU, KEY processing, and command processing.

[0071] For example, assuming that message A is received by popup browser 1, message filtering can be performed in popup browser 1 based on the message ID of message A. If the message ID of message A exists among the message IDs registered in popup browser 1, message A can be processed.

[0072] At this time, message processing can be handled by determining whether to send the screen to the GPU, return the value to the main browser to which the popup browser belongs, or process a KEY or command through a separate processing module.

[0073] For example, among popup browsers operating via a broadcast channel, if a specific web application is launched, user control may be required by refreshing the screen or sending a notification to the main browser.

[0074] At this time, all popup browsers may not process the message if the registered message ID does not match the message ID included in the message.

[0075] For example, assuming that message A is received by popup browser 2, message filtering can be performed in popup browser 2 based on the message ID of message A. If the message ID of message A does not exist among the message IDs registered in popup browser 2, popup browser 2 may not process message A.

[0076] In this case, the cloud streaming server can provide cloud streaming services to the user's terminal by performing streaming procedures corresponding to capture, encoding, and sending. Here, the streaming pipeline procedure corresponding to capture, encoding, and sending may also include rendering, and can be viewed as consisting of rendering, capture, encoding, and sending.

[0077] In this case, the user terminal requests a cloud streaming service from the cloud streaming server and receives the execution screen corresponding to the request from the cloud streaming server, which can then provide it to the user. Therefore, the user can feel as if a video or application corresponding to the requested service is running on the user terminal.

[0078] In this case, the user terminal may correspond to a device that is connected to a communication network and capable of communicating with a cloud streaming server. For example, the user terminal may correspond to various terminals such as all information and communication devices, multimedia terminals, wired terminals, fixed terminals, mobile communication terminals, and IP (Internet Protocol) terminals. Additionally, the user terminal may be a mobile terminal with various mobile communication specifications, such as a mobile phone, mobile phone, PMP (Portable Multimedia Played), MID (Mobile Internet Device), smartphone, desktop, tablet PC, notebook, netbook, personal digital assistant (PDA), smart TV, and information and communication device.

[0079] In addition, the user terminal can receive various information, such as numeric and character information, and transmit signals input related to setting various functions and controlling the functions of the user terminal to the control unit through the input unit. Furthermore, the input unit of the user terminal may be configured to include at least one of a keypad and a touchpad that generates input signals based on the user's touch or operation. In this case, the input unit of the user terminal may be configured in the form of a single touch panel (or touch screen) together with the display unit of the user terminal to perform input and display functions simultaneously. Additionally, the input unit of the user terminal may utilize all forms of input means that may be developed in the future, in addition to input devices such as keyboards, keypads, mice, and joysticks.

[0080] In addition, the display unit of the user terminal can display information regarding a series of operating states and operating results that occur during the performance of functions of the user terminal. In addition, the display unit of the user terminal can display the menu of the user terminal and user data entered by the user. Here, the display unit of the user terminal may be composed of a Liquid Crystal Display (LCD), a Thin Film Transistor LCD (TFT-LCD), a Light Emitting Diode (LED), an Organic Light Emitting Diode (OLED), an Active Matrix OLED (AMOLED), a Retina Display, a Flexible Display, and a 3D Display. In this case, if the display unit of the user terminal is configured in the form of a touchscreen, the display unit of the user terminal may perform some or all of the functions of the input unit of the user terminal.

[0081] In addition, the storage unit of the user terminal is a device for storing data, includes a main memory and an auxiliary memory, and can store application programs necessary for the functional operation of the user terminal. Such a storage unit of the user terminal may largely include a program area and a data area. Here, when the user terminal activates each function in response to a user's request, it executes the corresponding application programs under the control of the control unit to provide each function.

[0082] Additionally, the communication unit of the user terminal can perform the function of transmitting and receiving data to and from a cloud streaming server via a network. Here, the communication unit of the user terminal may include an RF transmitting means for up-converting and amplifying the frequency of a transmitted signal, and an RF receiving means for low-noise amplification and down-converting the frequency of a received signal. Such a communication unit of the user terminal may include a wireless communication module. Furthermore, the wireless communication module is configured to transmit and receive data according to a wireless communication method, and when the user terminal uses wireless communication, it can transmit and receive data to and from the cloud streaming server using any one of a wireless network communication module, a wireless LAN communication module, and a wireless PAN communication module. That is, the user terminal connects to a network using a wireless communication module and can transmit and receive data to and from the cloud streaming server via the network.

[0083] In addition, the control unit of the user terminal can be an operating system (OS) and a process device that drives each component. For example, the control unit can control the entire process of connecting to a cloud streaming server. In this case, when the user terminal connects to the cloud streaming server, it can control the entire process of executing content, such as videos, or applications according to the user's request, and can control the transmission of a service usage request to the cloud streaming server simultaneously with execution. At this time, it can also control the transmission of user terminal information required for user authentication.

[0084] By providing a cloud streaming service using message broadcasting to such pop-up browsers, it is possible to resolve message processing for multiple pop-up browsers in the cloud streaming UI while simultaneously preventing delays in message processing speed.

[0085] In addition, multiple popup browsers can be effectively controlled by performing broadcast-style message delivery from a cloud streaming server to popup browsers.

[0086] In addition, message communication between popup browsers or messages that popup browsers need to process can be efficiently managed or controlled according to specific situations.

[0087] FIG. 3 is a diagram showing an example of a cloud streaming service provision process according to the present invention.

[0088] Referring to FIG. 3, the cloud streaming service provision process according to the present invention can first register all pop-up browsers to a broadcast channel (320).

[0089] That is, all popup browsers can be registered to a broadcast channel (320) rather than registering through a cloud streaming server (310) to receive messages.

[0090] After this, the cloud streaming server (310) can generate a message containing a message ID.

[0091] For example, when a message occurs in a web application, the cloud streaming server (310) can create a message for broadcasting by including the message ID of the generated message.

[0092] After this, the cloud streaming server (310) can broadcast the message to all popup browsers registered in the broadcast channel (320).

[0093] In other words, message processing speed can be improved by transmitting commands to all popup browsers (1 to N) via a broadcast method, rather than by registering them when creating a popup browser in a web application.

[0094] At this time, based on message filtering using a message ID, processing corresponding to the above message can be performed in at least one of all popup browsers.

[0095] At this time, all popup browsers can pre-register message IDs corresponding to the required messages.

[0096] For example, messages may include messages that all popup browsers must process, messages that only specific popup browsers must process, and messages that are not processed but require confirmation of receipt. Therefore, all popup browsers can perform a message ID registration process to filter the messages they need to process.

[0097] At this time, message filtering can compare whether the message ID registered in each of the above-mentioned popup browsers matches the message ID included in the message.

[0098] At this time, if the registered message ID matches the message ID included in the message, all popup browsers can refer to the message and perform processing corresponding to one of providing a return value to the main browser, sending the application execution screen to the GPU, KEY processing, and command processing.

[0099] For example, assuming that message A is received by popup browser 1 (321), message filtering can be performed in popup browser 1 (321) based on the message ID of message A. If the message ID of message A exists among the message IDs registered in popup browser 1 (321), message A can be processed.

[0100] At this time, message processing can be handled by determining whether to send the screen to the GPU, return a value to the main browser to which the popup browser belongs, or process a KEY or command through a separate processing module called a message handler.

[0101] For example, when a specific web application is displayed among the popup browsers operating through the broadcast channel (320), user control may be required by refreshing the screen or giving a notification to the main browser.

[0102] In this case, all popup browsers may not process the message if the registered message ID does not match the message ID included in the message.

[0103] For example, assuming that message A is received by popup browser 2, message filtering can be performed in popup browser 2 based on the message ID of message A. If the message ID of message A does not exist among the message IDs registered in popup browser 2, popup browser 2 may not process message A.

[0104] Through this process, messages that popup browsers must process due to message communication between popup browsers or the characteristics of cloud streaming UI can be efficiently managed, and control can be tailored to specific situations. Additionally, delays caused by message processing can be effectively resolved.

[0105] Through this method, message processing for multiple popup browsers in a cloud streaming UI can be resolved while simultaneously preventing delays in message processing speed.

[0106] In addition, multiple popup browsers can be effectively controlled by performing broadcast-style message delivery from a cloud streaming server to popup browsers.

[0107] In addition, message communication between popup browsers or messages that popup browsers need to process can be efficiently managed or controlled according to specific situations.

[0108] FIG. 4 is an operation flowchart illustrating in detail the message filtering process among the cloud streaming service provision methods according to the present invention.

[0109] Referring to FIG. 4, the message filtering process of the cloud streaming service provision method according to the present invention first allows all popup browsers to pre-register message IDs corresponding to the required messages (S410).

[0110] After this, when a broadcasting message is received from the cloud streaming server (S420), all popup browsers can determine whether the registered message ID and the message ID included in the message match (S425).

[0111] If, as a result of the judgment in step (S425), the registered message ID matches the message ID included in the message, the process corresponding to one of providing a return value to the main browser, transmitting the application execution screen to the GPU, KEY processing, and command processing can be performed by referring to the message (S430).

[0112] For example, assuming that message A is received by popup browser 1, message filtering can be performed in popup browser 1 based on the message ID of message A. If the message ID of message A exists among the message IDs registered in popup browser 1, message A can be processed.

[0113] At this time, message processing can be handled by determining whether to send the screen to the GPU, return the value to the main browser to which the popup browser belongs, or process a KEY or command through a separate processing module.

[0114] For example, among popup browsers operating via a broadcast channel, if a specific web application is launched, user control may be required by refreshing the screen or sending a notification to the main browser.

[0115] Additionally, if the result of the judgment in step (S425) indicates that the registered message ID and the message ID included in the message do not match, the received message may not be processed (S440).

[0116] For example, assuming that message A is received by popup browser 2, message filtering can be performed in popup browser 2 based on the message ID of message A. If the message ID of message A does not exist among the message IDs registered in popup browser 2, popup browser 2 may not process message A.

[0117] Through this process, message processing for multiple popup browsers in a cloud streaming UI can be resolved while simultaneously preventing delays in message processing speed.

[0118] In addition, multiple popup browsers can be effectively controlled by performing broadcast-style message delivery from a cloud streaming server to popup browsers.

[0119] In addition, message communication between popup browsers or messages that popup browsers need to process can be efficiently managed or controlled according to specific situations.

[0120] FIG. 5 is a diagram illustrating in detail the process of providing a cloud streaming service using message broadcast to a pop-up browser according to the present invention.

[0121] Referring to FIG. 5, the process of providing a cloud streaming service using message broadcast to a pop-up browser according to the present invention first allows a cloud streaming server (510) to register all pop-up browsers to a broadcast channel (520) (S502).

[0122] That is, all popup browsers can be registered to a broadcast channel (520) rather than registering through a cloud streaming server (510) to receive messages.

[0123] After this, the cloud streaming server (510) can generate a message containing a message ID (S504).

[0124] For example, when a message occurs in a web application, the cloud streaming server (510) can create a message for broadcasting by including the message ID of the generated message.

[0125] After this, the cloud streaming server (510) can broadcast the message to all pop-up browsers (S506).

[0126] In other words, message processing speed can be improved by delivering commands to all popup browsers via a broadcast method, rather than by registering them when creating a popup browser in a web application.

[0127] At this time, all popup browsers can perform message filtering using the message ID (S508).

[0128] At this time, message filtering can compare whether the message ID registered in each of the popup browsers matches the message ID included in the message.

[0129] If it is assumed that the message ID of the message matches the ID registered only in Popup Browser 1, then the message may be processed only in Popup Browser 1 (S510), and the message may not be processed in the other Popup Browsers (S512, S514).

[0130] At this time, the popup browser 1 can refer to the message and perform processing corresponding to any one of providing a return value to the main browser, sending the application execution screen to the GPU, KEY processing, and command processing.

[0131] For example, as shown in FIG. 5, the screen may be transmitted to the GPU (S516) to update the application execution screen (S518).

[0132] At this time, the cloud streaming server (510) can provide cloud streaming services to the user's terminal by performing streaming procedures corresponding to capture, encoding, and sending. At this time, the streaming pipeline procedure corresponding to capture, encoding, and sending may be viewed as including rendering, capturing, encoding, and sending.

[0133] In this case, the user terminal requests a cloud streaming service from the cloud streaming server and receives the execution screen corresponding to the request from the cloud streaming server, which can then provide it to the user. Therefore, the user can feel as if a video or application corresponding to the requested service is running on the user terminal.

[0134] In this case, the user terminal may correspond to a device that is connected to a communication network and capable of communicating with a cloud streaming server. For example, the user terminal may correspond to various terminals such as all information and communication devices, multimedia terminals, wired terminals, fixed terminals, mobile communication terminals, and IP (Internet Protocol) terminals. Additionally, the user terminal may be a mobile terminal with various mobile communication specifications, such as a mobile phone, mobile phone, PMP (Portable Multimedia Played), MID (Mobile Internet Device), smartphone, desktop, tablet PC, notebook, netbook, personal digital assistant (PDA), smart TV, and information and communication device.

[0135] In addition, the user terminal can receive various information, such as numeric and character information, and transmit signals input related to setting various functions and controlling the functions of the user terminal to the control unit through the input unit. Furthermore, the input unit of the user terminal may be configured to include at least one of a keypad and a touchpad that generates input signals based on the user's touch or operation. In this case, the input unit of the user terminal may be configured in the form of a single touch panel (or touch screen) together with the display unit of the user terminal to perform input and display functions simultaneously. Additionally, the input unit of the user terminal may utilize all forms of input means that may be developed in the future, in addition to input devices such as keyboards, keypads, mice, and joysticks.

[0136] In addition, the display unit of the user terminal can display information regarding a series of operating states and operating results that occur during the performance of functions of the user terminal. In addition, the display unit of the user terminal can display the menu of the user terminal and user data entered by the user. Here, the display unit of the user terminal may be composed of a Liquid Crystal Display (LCD), a Thin Film Transistor LCD (TFT-LCD), a Light Emitting Diode (LED), an Organic Light Emitting Diode (OLED), an Active Matrix OLED (AMOLED), a Retina Display, a Flexible Display, and a 3D Display. In this case, if the display unit of the user terminal is configured in the form of a touchscreen, the display unit of the user terminal may perform some or all of the functions of the input unit of the user terminal.

[0137] In addition, the storage unit of the user terminal is a device for storing data, includes a main memory and an auxiliary memory, and can store application programs necessary for the functional operation of the user terminal. Such a storage unit of the user terminal may largely include a program area and a data area. Here, when the user terminal activates each function in response to a user's request, it executes the corresponding application programs under the control of the control unit to provide each function.

[0138] Additionally, the communication unit of the user terminal can perform the function of transmitting and receiving data to and from a cloud streaming server via a network. Here, the communication unit of the user terminal may include an RF transmitting means for up-converting and amplifying the frequency of a transmitted signal, and an RF receiving means for low-noise amplification and down-converting the frequency of a received signal. Such a communication unit of the user terminal may include a wireless communication module. Furthermore, the wireless communication module is configured to transmit and receive data according to a wireless communication method, and when the user terminal uses wireless communication, it can transmit and receive data to and from the cloud streaming server using any one of a wireless network communication module, a wireless LAN communication module, and a wireless PAN communication module. That is, the user terminal connects to a network using a wireless communication module and can transmit and receive data to and from the cloud streaming server via the network.

[0139] In addition, the control unit of the user terminal can be an operating system (OS) and a process device that drives each component. For example, the control unit can control the entire process of connecting to a cloud streaming server. In this case, when the user terminal connects to the cloud streaming server, it can control the entire process of executing content, such as videos, or applications according to the user's request, and can control the transmission of a service usage request to the cloud streaming server simultaneously with execution. At this time, it can also control the transmission of user terminal information required for user authentication.

[0140] By providing a cloud streaming service using message broadcasting to such pop-up browsers, it is possible to resolve message processing for multiple pop-up browsers in the cloud streaming UI while simultaneously preventing delays in message processing speed.

[0141] In addition, multiple popup browsers can be effectively controlled by performing broadcast-style message delivery from a cloud streaming server to popup browsers.

[0142] In addition, message communication between popup browsers or messages that popup browsers need to process can be efficiently managed or controlled according to specific situations.

[0143] FIG. 6 is a block diagram showing a cloud streaming server according to an embodiment of the present invention.

[0144] Referring to FIG. 6, a cloud streaming server according to one embodiment of the present invention includes a communication unit (610), a processor (620), and a memory (630).

[0145] The communication unit (610) plays the role of transmitting and receiving information related to a number of user terminals through a communication network such as the network shown in FIG. 1. In particular, the communication unit (610) according to an embodiment of the present invention receives a request for a cloud streaming service from a user terminal and can provide a data packet corresponding to the cloud streaming service requested by the user terminal to the user terminal.

[0146] For example, a network is a concept that encompasses both existing networks and networks that may be developed in the future, serving as a channel for transmitting data between a cloud streaming server and a user terminal. For instance, a network may consist of a wired or wireless local area network providing communication for various information devices within a limited area, a mobile communication network providing communication between mobile entities and between a mobile entity and the outside world, a satellite communication network providing communication between earth stations using satellites, or any one of wired or wireless communication networks, or a combination of two or more. Meanwhile, the transmission method standards of a network are not limited to existing transmission method standards but may include all transmission method standards to be developed in the future.

[0147] The processor (620) registers all popup browsers to the broadcast channel.

[0148] In other words, all popup browsers can register to a broadcast channel to receive messages, rather than registering through a cloud streaming server.

[0149] Additionally, the processor (620) generates a message containing a message ID.

[0150] For example, when a message occurs in a web application, the cloud streaming server can generate a message for broadcasting by including the message ID of the generated message.

[0151] Additionally, the processor (620) broadcasts the message to all of the aforementioned popup browsers.

[0152] In other words, according to the present invention, message processing speed can be improved by transmitting commands to all popup browsers via a broadcast method, rather than by registering them when creating a popup browser in a web application.

[0153] At this time, based on message filtering using a message ID, processing corresponding to the message can be performed in at least one of the popup browsers among all the popup browsers.

[0154] At this time, all popup browsers can pre-register message IDs corresponding to the required messages.

[0155] For example, messages may include messages that all popup browsers must process, messages that only specific popup browsers must process, and messages that are not processed but require confirmation of receipt. Therefore, all popup browsers can perform a message ID registration process to filter the messages they need to process.

[0156] At this time, message filtering can compare whether the message ID registered in each of the above-mentioned popup browsers matches the message ID included in the message.

[0157] At this time, if the registered message ID matches the message ID included in the message, all popup browsers can refer to the message and perform processing corresponding to one of providing a return value to the main browser, sending the application execution screen to the GPU, KEY processing, and command processing.

[0158] For example, assuming that message A is received by popup browser 1, message filtering can be performed in popup browser 1 based on the message ID of message A. If the message ID of message A exists among the message IDs registered in popup browser 1, message A can be processed.

[0159] At this time, message processing can be handled by determining whether to send the screen to the GPU, return the value to the main browser to which the popup browser belongs, or process a KEY or command through a separate processing module.

[0160] For example, among popup browsers operating via a broadcast channel, if a specific web application is launched, user control may be required by refreshing the screen or sending a notification to the main browser.

[0161] At this time, all popup browsers may not process the message if the registered message ID does not match the message ID included in the message.

[0162] For example, assuming that message A is received by popup browser 2, message filtering can be performed in popup browser 2 based on the message ID of message A. If the message ID of message A does not exist among the message IDs registered in popup browser 2, popup browser 2 may not process message A.

[0163] In this case, the cloud streaming server can provide cloud streaming services to the user's terminal by performing streaming procedures corresponding to capture, encoding, and sending. Here, the streaming pipeline procedure corresponding to capture, encoding, and sending may also include rendering, and can be viewed as consisting of rendering, capture, encoding, and sending.

[0164] In this case, the user terminal requests a cloud streaming service from the cloud streaming server and receives the execution screen corresponding to the request from the cloud streaming server, which can then provide it to the user. Therefore, the user can feel as if a video or application corresponding to the requested service is running on the user terminal.

[0165] In this case, the user terminal may correspond to a device that is connected to a communication network and capable of communicating with a cloud streaming server. For example, the user terminal may correspond to various terminals such as all information and communication devices, multimedia terminals, wired terminals, fixed terminals, mobile communication terminals, and IP (Internet Protocol) terminals. Additionally, the user terminal may be a mobile terminal with various mobile communication specifications, such as a mobile phone, mobile phone, PMP (Portable Multimedia Played), MID (Mobile Internet Device), smartphone, desktop, tablet PC, notebook, netbook, personal digital assistant (PDA), smart TV, and information and communication device.

[0166] In addition, the user terminal can receive various information, such as numeric and character information, and transmit signals input related to setting various functions and controlling the functions of the user terminal to the control unit through the input unit. Furthermore, the input unit of the user terminal may be configured to include at least one of a keypad and a touchpad that generates input signals based on the user's touch or operation. In this case, the input unit of the user terminal may be configured in the form of a single touch panel (or touch screen) together with the display unit of the user terminal to perform input and display functions simultaneously. Additionally, the input unit of the user terminal may utilize all forms of input means that may be developed in the future, in addition to input devices such as keyboards, keypads, mice, and joysticks.

[0167] In addition, the display unit of the user terminal can display information regarding a series of operating states and operating results that occur during the performance of functions of the user terminal. In addition, the display unit of the user terminal can display the menu of the user terminal and user data entered by the user. Here, the display unit of the user terminal may be composed of a Liquid Crystal Display (LCD), a Thin Film Transistor LCD (TFT-LCD), a Light Emitting Diode (LED), an Organic Light Emitting Diode (OLED), an Active Matrix OLED (AMOLED), a Retina Display, a Flexible Display, and a 3D Display. In this case, if the display unit of the user terminal is configured in the form of a touchscreen, the display unit of the user terminal may perform some or all of the functions of the input unit of the user terminal.

[0168] In addition, the storage unit of the user terminal is a device for storing data, includes a main memory and an auxiliary memory, and can store application programs necessary for the functional operation of the user terminal. Such a storage unit of the user terminal may largely include a program area and a data area. Here, when the user terminal activates each function in response to a user's request, it executes the corresponding application programs under the control of the control unit to provide each function.

[0169] Additionally, the communication unit of the user terminal can perform the function of transmitting and receiving data to and from a cloud streaming server via a network. Here, the communication unit of the user terminal may include an RF transmitting means for up-converting and amplifying the frequency of a transmitted signal, and an RF receiving means for low-noise amplification and down-converting the frequency of a received signal. Such a communication unit of the user terminal may include a wireless communication module. Furthermore, the wireless communication module is configured to transmit and receive data according to a wireless communication method, and when the user terminal uses wireless communication, it can transmit and receive data to and from the cloud streaming server using any one of a wireless network communication module, a wireless LAN communication module, and a wireless PAN communication module. That is, the user terminal connects to a network using a wireless communication module and can transmit and receive data to and from the cloud streaming server via the network.

[0170] In addition, the control unit of the user terminal can be an operating system (OS) and a process device that drives each component. For example, the control unit can control the entire process of connecting to a cloud streaming server. In this case, when the user terminal connects to the cloud streaming server, it can control the entire process of executing content, such as videos, or applications according to the user's request, and can control the transmission of a service usage request to the cloud streaming server simultaneously with execution. At this time, it can also control the transmission of user terminal information required for user authentication.

[0171] Memory (630) stores the message ID.

[0172] Additionally, the memory (630) can support a function for providing a cloud streaming service using message broadcast to a popup browser. In this case, the memory can operate as a separate large-capacity storage and may include a control function for performing the operation.

[0173] In addition, the cloud streaming server configured as described above can be implemented with one or more servers.

[0174] Meanwhile, the cloud streaming server is equipped with memory and can store information within the device. In one embodiment, the memory is a computer-readable medium. In one embodiment, the memory may be a volatile memory unit, and in another embodiment, the memory may be a non-volatile memory unit. In one embodiment, the storage device is a computer-readable medium. In various different embodiments, the storage device may include, for example, a hard disk device, an optical disk device, or any other mass storage device.

[0175] By providing a cloud streaming service using message broadcasting to popup browsers via such a cloud streaming server, it is possible to resolve message processing for multiple popup browsers in the cloud streaming UI while simultaneously preventing delays in message processing speed.

[0176] In addition, multiple popup browsers can be effectively controlled by performing broadcast-style message delivery from a cloud streaming server to popup browsers.

[0177] In addition, message communication between popup browsers or messages that popup browsers need to process can be efficiently managed or controlled according to specific situations.

[0178] Embodiments of the functional operations and subjects described herein may be implemented as digital electronic circuits, or as computer software, firmware, or hardware comprising structures and structural equivalents disclosed herein, or as a combination of one or more of these. Embodiments of the subjects described herein may be implemented as one or more computer program products, that is, as one or more modules relating to computer program instructions encoded on a tangible program storage medium for controlling the operation of a processing system or for execution by such operation.

[0179] A computer-readable medium may be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of a material that affects a machine-readable radio wave signal, or a combination of one or more of these.

[0180] In this specification, the terms "system" or "device" encompass all apparatuses, devices, and machines for processing data, including, for example, programmable processors, computers, or multiple processors or computers. A processing system may, in addition to hardware, include code that forms an execution environment for a computer program upon request, such as, for example, code constituting processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of these.

[0181] A computer program (also known as a program, software, software application, script, or code) may be written in any form of a programming language, including compiled or interpreted languages, or a priori or procedural languages, and may be deployed in any form, including a standalone program, a module, a component, a subroutine, or other unit suitable for use in a computer environment. A computer program does not necessarily correspond to a file in a file system. A program may be stored in a single file provided to the requested program, in multiple interacting files (e.g., a file storing one or more modules, subprograms, or parts of code), or in a part of a file containing other programs or data (e.g., one or more scripts stored within a markup language document). A computer program may be deployed to be executed on multiple computers or a single computer located at a single site or distributed across multiple sites and interconnected by a communication network.

[0182] Meanwhile, computer-readable media suitable for storing computer program instructions and data may include all forms of non-volatile memory, media, and memory devices, such as semiconductor memory devices like EPROM, EEPROM, and flash memory devices, magnetic disks like internal hard disks or external disks, magneto-optical disks, and CD-ROM and DVD-ROM disks. Processors and memory may be supplemented by or integrated with special-purpose logic circuits.

[0183] An embodiment of the subject described herein may be implemented in a computing system comprising, for example, a backend component such as a data server, for example, a middleware component such as an application server, for example, a frontend component such as a user computer having a web browser or a graphical user interface through which a user can interact with the embodiment of the subject described herein, or any combination of one or more such backend, middleware, or frontend components. Components of the system may be interconnected by any form or medium of digital data communication, such as a communication network.

[0184] Although this specification contains details of a number of specific embodiments, they should not be understood as limiting the scope of any invention or claimables, but rather as descriptions of features that may be specific to a particular embodiment of a particular invention. Likewise, specific features described in this specification in the context of individual embodiments may be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments individually or in any appropriate sub-combination. Furthermore, while features may operate in a specific combination and be described as initially claimed, one or more features from the claimed combination may be excluded from the combination in some cases, and the claimed combination may be changed to a sub-combination or a variation of the sub-combination.

[0185] Furthermore, although operations are described in the drawings in a specific order in this specification, it should not be understood that such operations must be performed in that specific or sequential order depicted to obtain a desirable result, or that all depicted operations must be performed. In certain cases, multitasking and parallel processing may be advantageous. Additionally, the separation of the various system components of the embodiments described above should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together into a single software product or packaged into multiple software products.

[0186] As such, this specification is not intended to limit the invention to the specific terms presented. Accordingly, although the invention has been described in detail with reference to the examples described above, those skilled in the art may make modifications, changes, and variations to these examples without departing from the scope of the invention. The scope of the invention is defined by the claims set forth below rather than by the detailed description above, and all modifications or variations derived from the meaning and scope of the claims and equivalents thereof should be interpreted as being included within the scope of the invention.

[0187] As described above, the method for providing a cloud streaming service using message broadcasting to a pop-up browser and the apparatus for providing the same according to the present invention are not limited to the configurations and methods of the embodiments described above; rather, all or part of each embodiment may be selectively combined to allow for various modifications to be made to the embodiments. Industrial applicability

[0188] According to the present invention, a cloud streaming server registers all popup browsers to a broadcast channel, generates a message including a message ID, broadcasts the message to all popup browsers, and performs processing corresponding to the message in at least one of the popup browsers based on message filtering using the message ID. In addition, messages that need to be processed by a popup browser can be efficiently managed due to message communication between popup browsers or the characteristics of the cloud streaming UI. Explanation of the symbols

[0189] 110, 310, 510: Cloud Streaming Servers 120-1~120-N: User terminal 130: Network 320, 520: Broadcast channels 321: Popup Browser 610: Communications Department 620: Processor 630: Memory

Claims

Claim 1 A method for providing a cloud streaming service, comprising the steps of: a cloud streaming server registering all pop-up browsers to a broadcast channel; generating a message including a message ID; and broadcasting the message to all pop-up browsers, wherein the cloud streaming server performs processing corresponding to the message in at least one of all pop-up browsers based on message filtering using the message ID. Claim 2 A method for providing a cloud streaming service according to claim 1, characterized in that all popup browsers each pre-register a message ID corresponding to a required message. Claim 3 A method for providing a cloud streaming service according to claim 2, wherein the message filtering compares whether a message ID registered in each of the popup browsers matches a message ID included in the message. Claim 4 A method for providing a cloud streaming service according to claim 3, wherein, when the registered message ID and the message ID included in the message match, all popup browsers refer to the message and perform processing corresponding to any one of providing a return value to the main browser, transmitting an application execution screen to the GPU, KEY processing, and command processing. Claim 5 A method for providing a cloud streaming service according to claim 3, characterized in that all popup browsers do not process the message if the registered message ID and the message ID included in the message do not match. Claim 6 A cloud streaming server characterized by including: a processor that registers all popup browsers to a broadcast channel, generates a message including a message ID, and broadcasts the message to all popup browsers; and a memory that stores the message ID, and performs processing corresponding to the message in at least one of all popup browsers based on message filtering using the message ID. Claim 7 A cloud streaming server according to claim 6, characterized in that all popup browsers each pre-register a message ID corresponding to a required message. Claim 8 A cloud streaming server according to claim 7, wherein the message filtering compares whether a message ID registered in each of the popup browsers matches a message ID included in the message. Claim 9 A cloud streaming server according to claim 8, characterized in that, when the registered message ID and the message ID included in the message match, all popup browsers refer to the message and perform processing corresponding to any one of providing a return value to the main browser, transmitting an application execution screen to the GPU, KEY processing, and command processing. Claim 10 A cloud streaming server according to claim 8, characterized in that all popup browsers do not process the message if the registered message ID and the message ID included in the message do not match.

Images