Electronic device for providing screen for monitoring solar power generation system and control method thereof

Abstract

A control method of an electronic device for providing a screen for monitoring a solar power generation system according to one aspect comprises the steps of: outputting a screen on which at least one graphic element visualizing at least one solar module of the solar power generation system is arranged; obtaining a user input for adjusting the magnification of the screen; sensing a position where the user input is generated and a manipulation degree; determining a first graphic element from among the at least one graphic element on the basis of the position and the manipulation degree and determining a display level of information related to the solar module; and outputting the first graphic element and the information of the solar module corresponding to the first graphic element according to the display level.

Description

Electronic device providing a screen for monitoring a solar power generation system and a control method thereof

[0001] The present disclosure relates to an electronic device providing a screen for monitoring a solar power generation system and a control method thereof.

[0002] With the recent rise in interest in eco-friendly energy technologies, the installation of solar power generation systems, which utilize solar energy to generate electricity, is on the rise. Solar power systems generate electricity by collecting solar energy through solar panels. This electricity is then fed into the home power grid for household use or stored in batteries for later use. Solar power generation systems are gaining popularity due to their environmental friendliness and potential long-term savings on electricity bills.

[0003] As technology for solar power generation systems develops, monitoring their operation and managing them are increasingly recognized as crucial skills. There is a pressing need to develop technology that visually displays the module layout on a layout diagram that corresponds to its actual layout.

[0004] The present invention provides an electronic device providing a screen for monitoring a solar power generation system and a method for controlling the same.

[0005] In addition, the present invention provides an electronic device and a control method thereof that can adjust the magnification of the screen and change the display level of monitoring information by obtaining user input.

[0006] In addition, the present invention provides a computer-readable recording medium containing a program for executing the above method on a computer. The technical problems to be solved are not limited to the technical problems described above, and other technical problems may exist.

[0007] A method for controlling an electronic device providing a screen for monitoring a solar power generation system according to one aspect of the present disclosure may be provided, comprising: outputting a screen on which at least one graphic element visualizing at least one solar power module of the solar power generation system is arranged; obtaining a user input for adjusting a magnification of the screen; detecting a location and a degree of manipulation at which the user input occurs; determining a first graphic element from among the at least one graphic element based on the location and the degree of manipulation, and determining a display level of information related to the solar module; and outputting the first graphic element and the information on the solar module corresponding to the first graphic element based on the display level.

[0008] An electronic device providing a screen for monitoring a solar power generation system according to another aspect of the present disclosure comprises: at least one memory; at least one processor; an input / output interface; and a display; wherein the processor controls the display to output a screen on which at least one graphic element visualizing at least one solar power module of the solar power generation system is arranged, obtains a user input for adjusting a magnification of the screen, detects a location and a degree of manipulation at which the user input occurs, determines a first graphic element from among the at least one graphic element based on the location and the degree of manipulation, determines a display level of information related to the solar module, and controls the display to output the first graphic element and the information on the solar module corresponding to the first graphic element based on the display level.

[0009] A computer-readable recording medium according to another aspect of the present disclosure includes a recording medium having recorded thereon a program for executing the above-described method on a computer.

[0010] FIG. 1 is a schematic diagram illustrating an example of an electronic device that provides a screen for monitoring a solar power generation system according to one embodiment.

[0011] FIG. 2 is a flowchart illustrating an example of a control method of an electronic device that provides a screen for monitoring a solar power generation system according to one embodiment.

[0012] FIG. 3 is a drawing illustrating an example of a method for outputting information of a solar module and a graphic element visualizing a solar module according to one embodiment.

[0013] FIG. 4 is a drawing for explaining an example of a method for outputting information of a solar module and a graphic element visualizing a solar module according to another embodiment.

[0014] FIG. 5 is a drawing illustrating an example of a method for outputting information of a solar module and a graphic element visualizing a solar module according to another embodiment.

[0015] A method for controlling an electronic device providing a screen for monitoring a solar power generation system according to one aspect of the present disclosure may be provided, comprising: outputting a screen on which at least one graphic element visualizing at least one solar power module of the solar power generation system is arranged; obtaining a user input for adjusting a magnification of the screen; detecting a location and a degree of manipulation at which the user input occurs; determining a first graphic element from among the at least one graphic element based on the location and the degree of manipulation, and determining a display level of information related to the solar module; and outputting the first graphic element and the information on the solar module corresponding to the first graphic element based on the display level.

[0016] An electronic device providing a screen for monitoring a solar power generation system according to another aspect of the present disclosure comprises: at least one memory; at least one processor; an input / output interface; and a display; wherein the processor controls the display to output a screen on which at least one graphic element visualizing at least one solar power module of the solar power generation system is arranged, obtains a user input for adjusting a magnification of the screen, detects a location and a degree of manipulation at which the user input occurs, determines a first graphic element from among the at least one graphic element based on the location and the degree of manipulation, determines a display level of information related to the solar module, and controls the display to output the first graphic element and the information on the solar module corresponding to the first graphic element based on the display level.

[0017] The terms used in the examples are selected from widely used, current terms, as much as possible. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, the applicant may arbitrarily select terms, in which case their meanings will be described in detail in the relevant description. Therefore, the terms used in the specification should be defined based on their intended meaning and the overall content of the specification, rather than simply their names.

[0018] When a part of the specification is said to "include" a component, this does not exclude other components, but rather implies the inclusion of other components, unless otherwise specifically stated. Furthermore, terms such as "unit" and "module" used throughout the specification refer to a unit that processes at least one function or operation, which may be implemented in hardware, software, or a combination of hardware and software.

[0019] Additionally, terms including ordinal numbers, such as "first" or "second," used in the specification may be used to describe various components, but the components should not be limited by the terms. The terms may be used to distinguish one component from another.

[0020] According to one embodiment, a "solar power generation system" may refer to a system including a plurality of solar modules, a plurality of inverters, and a hub server. The plurality of solar modules may be connected to strings to form a solar panel. The MLPE (Module Level Power Electronics) attached to the solar panel may transmit real-time monitoring data, including the amount of power generated, temperature, and defect information of each solar module, as well as unique information of the MLPE, to the inverter. At this time, the unique information of the MLPE transmitted to the inverter may include the serial number of the module.

[0021] A solar power generation system according to one embodiment of the present invention may refer to a power generation system that converts solar energy into electrical energy. The solar power generation system may include a plurality of photovoltaic (PV) modules, and each solar module may include a microinverter that converts the generated energy.

[0022] A solar module is a module that generates electricity using the photovoltaic effect, and multiple solar modules can be interconnected to form a solar module array. The solar module array may be formed by connecting multiple solar modules in series or parallel. In addition, the solar module array may include at least one solar module string. In one embodiment, when multiple solar modules are connected in series, the multiple solar modules can form a single solar module array through one solar module string. In another embodiment, when multiple solar modules are connected in parallel, the multiple solar modules can form a single solar module array through the multiple solar module strings.

[0023] A solar power generation system may include a plurality of solar module arrays, and the solar module array may include at least one solar module string comprising a plurality of solar modules. Accordingly, each of the plurality of solar modules needs to be managed individually.

[0024] In one embodiment, a “user” may be an installer of a solar power generation system, an owner of a solar power generation system, a manager of a solar power generation system, etc., and may refer to any user of an electronic device that provides a display for monitoring a solar power generation system.

[0025] Below, embodiments are described in detail with reference to the attached drawings. However, the embodiments may be implemented in various different forms and are not limited to the examples described herein.

[0026] FIG. 1 is a schematic diagram illustrating an example of an electronic device that provides a screen for monitoring a solar power generation system according to one embodiment.

[0027] The device (100) illustrated in FIG. 1 only shows components related to the present embodiments, and it is obvious to those skilled in the art that other general components may be included in addition to the components illustrated in FIG. 1.

[0028] For example, the device (100) may be implemented as various types of devices, such as a notebook PC, a desktop PC, a laptop, a tablet computer, a mobile device including a smart phone, a server device, an embedded device, etc. As a specific example, the device (100) may correspond to a smart phone, a tablet device, an AR (Augmented Reality) device, an IoT (Internet of Things) device, etc. that performs voice recognition, image recognition, image classification, etc. using artificial intelligence, but is not limited thereto.

[0029] The processor (110) controls the overall operation of the device (200). For example, the processor (110) can control the memory (120), communication unit (not shown), input / output interface (130), display (140), etc., by executing programs stored in the memory (120).

[0030] For example, the processor (110) may control the display (140) to output a screen on which at least one graphic element visualizing at least one solar module of a solar power generation system is arranged. In addition, the processor (110) may obtain a user input for adjusting the magnification of the screen, and detect the location and degree of manipulation at which the user input occurs. Based on the location and the degree of manipulation, the processor (110) may determine a first graphic element from among the at least one graphic element, and determine a display level of information related to the solar module. Depending on the display level, the processor (110) may control the display (140) to output the first graphic element and information on the solar module corresponding to the first graphic element.

[0031] According to one embodiment, a screen on which at least one graphic element is arranged is a virtual layout corresponding to the actual layout of the solar modules, and a user can monitor information related to the solar modules in real time using the layout. The information related to the solar modules may include at least one of the following: arrangement information of the solar modules, serial number, accumulated power generation, real-time monitoring data values, error information, and inverter information connected to the solar modules.

[0032] Here, the array information may include the module's array name, tilt value, azimuth, and orientation value (Landscape / Portrait). The accumulated power generation may include daily, monthly, weekly, and annual accumulated power generation. The real-time monitoring data may include the voltage, current, power generation, temperature, defects, etc. of each of the multiple solar modules. The real-time monitoring data may be data updated at a predetermined time interval.

[0033] According to one embodiment, user input may be input through an input / output interface (130). The input / output interface (130) may include any type of device through which user intent may be input, such as a physical keyboard, a virtual keyboard, a mouse, or a trackpad. The display (140) may be any type of device for displaying visual information, such as a mobile device screen including a computer monitor, a flat panel display, a liquid crystal display (LCD), a light emitting diode display, a plasma panel, or a touch screen display. In this case, if the display (140) is a touch screen display, the display (140) may also function as the input / output interface (130).

[0034] According to an embodiment of the present invention, a user input refers to all input actions of a user inputted for controlling a zoom function such as screen enlargement or reduction. For example, the user input refers to a user input made in a preset input method for zooming in or zooming out. For example, the user input according to an embodiment of the present invention may include a long press event inputted for activating a zoom mode, a move event inputted in a preset direction for zooming in or out in a zoom mode, a double tap event inputted for returning to the default size while zoomed in or out in a zoom mode, a double tap event inputted for toggling the screen enlargement and reduction, etc., which is to reflect effects such as preview and magnifying glass functions in real time while a specific mode is being performed.

[0035] According to one embodiment, the device (100) has a touch screen display and can support a zoom function as accurately and continuously as desired by the user, centered on a desired location, using an input means such as a finger or a stylus. Meanwhile, according to an embodiment of the present invention, it is of course possible to activate the zoom mode using a specific function key separately provided for the zoom function. A request for the zoom mode can be activated by a long press input that occurs in a specific area of ​​the touch screen. And, zoom in or zoom out can be performed centered on the location where the long press occurs, or centered on a location newly designated by the user after the zoom mode is activated. Accordingly, the device (100) can support the zoom function as accurately and continuously as desired by the user, centered on a desired location. Meanwhile, according to an embodiment of the present invention, it is of course possible to activate the zoom mode using a specific function key separately provided for the zoom function.

[0036] According to one embodiment, the device (100) may provide information related to a solar module corresponding to a layout area displayed on an enlarged screen in more detail than the information on the screen before enlargement. For example, the number of items of information related to the solar module displayed on the screen may be greater on the enlarged screen. Alternatively, the device (100) may display information of the same item in more detail on the screen before enlargement. For example, on the screen before enlargement, a graphic element corresponding to a solar module in which an error has occurred may be displayed in a different color than a graphic element corresponding to a normal solar module, and when a user enlarges the graphic element of the module in which an error has occurred, a specific error code of the solar module in which the error has occurred may be further displayed on the graphic element.

[0037] According to one embodiment, the "display level" may be preset to display information related to the solar module differently depending on the screen magnification as described above. The display level may divide the range of screen magnifications that can be implemented in the device (100) into predetermined sections, and set the items and display method (color, numerical value, etc.) of information related to the solar module to be displayed on the display (140) for each section.

[0038] The processor (110) may be implemented using at least one of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, and other electrical units for performing functions.

[0039] The memory (120) may include any non-transitory computer-readable recording medium. As an example, the memory (120) may include a non-permanent mass storage device such as a random access memory (RAM), a read only memory (ROM), a disk drive, a solid state drive (SSD), a flash memory, etc. As another example, the non-permanent mass storage device such as a ROM, an SSD, a flash memory, a disk drive, etc. may be a separate permanent storage device distinct from the memory. In addition, the memory (120) may store an operating system (OS) and at least one program code (e.g., code for the processor (110) to perform an operation to be described later with reference to FIGS. 2 to 5).

[0040] These software components may be loaded from a computer-readable recording medium separate from the memory (120). This separate computer-readable recording medium may be a recording medium that can be directly connected to the device (200), and may include, for example, a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc.

[0041] Alternatively, the software components may be loaded into the memory (120) via a communication unit that is not a computer-readable recording medium. For example, at least one program may be loaded into the memory (120) based on a computer program (e.g., a computer program for the processor (110) to perform the operations described below with reference to FIGS. 2 to 5) that is installed by files provided by developers or a file distribution system that distributes installation files for applications via the communication unit.

[0042] Hereinafter, with reference to FIGS. 2 to 5, an example of a method for controlling an electronic device that provides a screen for monitoring a solar power generation system by operating a device (100) of the present invention will be described. The method for controlling an electronic device that provides a screen for monitoring a solar power generation system of FIGS. 2 to 5 is composed of steps that are processed in time series in the device (100) or processor (110) illustrated in FIG. 1. Therefore, even if the content is omitted below, the content described above with respect to the device (100) or processor (110) illustrated in FIG. 1 can also be applied to the methods of FIGS. 2 to 5.

[0043] FIG. 2 is a flowchart illustrating an example of a control method of an electronic device that provides a screen for monitoring a solar power generation system according to one embodiment.

[0044] Referring to FIG. 2, in step 210, the processor (110) controls the display (140) to output a screen on which at least one graphic element visualizing at least one solar module of the solar power generation system is arranged.

[0045] In one embodiment, the screen on which at least one graphic element is arranged may be a virtual layout corresponding to the actual layout of the solar modules. That is, the virtual layout may identically reflect the positional relationship between a plurality of individual solar modules included in the solar power generation system and the layout of the entire module array. In another embodiment, the virtual layout may further include a direction mark or direction identifier indicating direction information, and may visualize the direction information of the actual solar modules.

[0046] At step 220, the processor (110) obtains user input for adjusting the magnification of the screen.

[0047] User input may be input through an input / output interface (130) such as a keyboard or mouse or a touchscreen display, and may include all user input actions input for controlling zoom functions such as screen zoom in or screen zoom out. According to another embodiment, (may include).

[0048] At step 230, the processor (110) detects the location and degree of manipulation at which the user input occurred.

[0049] In one embodiment, the processor (110) may detect the start and end positions of the user input, and calculate the distance between the start and end positions. After the processor (110) activates the zoom mode, the processor (110) may detect the start and end positions of the user's finger, stylus, or mouse cursor performing the zoom in / zoom out operation, and calculate the distance between the start and end positions. In another embodiment, the processor (110) may detect the start position of the user input, and count the duration of the user input.

[0050] According to another embodiment, a user can enlarge the screen of a device (100) equipped with a touch screen using a multi-touch method. The multi-touch method enlarges or reduces the screen depending on the change in the distance between the points touched by the user's two fingers. That is, when the user spreads his or her two fingers apart to increase the distance between the two touch points, the screen is enlarged, and when the user brings his or her two fingers closer together to decrease the distance between the two touch points, the screen is reduced. In this case, the processor (110) can detect the start position where the touch of the two fingers began and the end position where the touch ended, and calculate the distance between the start position and the end position, respectively.

[0051] In step 240, the processor (110) determines a first graphic element from among at least one graphic element based on the location and manipulation level, and determines the display level of information related to the solar module. That is, the processor (110) can determine the first graphic element to be displayed on the screen after zooming in / out based on the location where the user input started and the extent (distance / time) for which the user input continued.

[0052] According to one embodiment, information related to the solar module may include at least one of the arrangement information of the solar module, serial number, accumulated power generation, real-time monitoring data value, error information, and inverter information connected to the solar module. According to one embodiment, the display level may be preset to display information related to the solar module differently depending on the magnification of the screen. The display level may divide the range of screen magnifications that can be implemented in the device (100) into predetermined sections, and set the items and display method (color or number, etc.) of information related to the solar module to be displayed on the display (140) for each section.

[0053] In step 250, the processor (110) controls the display (140) to output information on the first graphic element and the solar module corresponding to the first graphic element, depending on the display level.

[0054] According to one embodiment, the processor (110) may control the display (140) to output information by overlaying it with text or color in an area where the first graphic element is output. Here, the information means information on each individual solar module corresponding to the first graphic element.

[0055] In another embodiment, the processor (110) may control the display (140) to output additional information related to the entire solar power generation system in an area where the first graphic element is not output. For example, the information related to the entire solar power generation system may include the cumulative power generation values ​​of all modules.

[0056] Additionally, the processor (110) may control the display (140) to output a second graphic element indicating a magnification ratio on one side of the screen. Here, the information refers to information about each individual solar module corresponding to the first graphic element displayed after zooming in / out. Examples of screens output on the display according to the embodiment are described in detail below in FIGS. 3 to 5 .

[0057] FIG. 3 is a drawing illustrating an example of a method for outputting information of a solar module and a graphic element visualizing a solar module according to one embodiment.

[0058] Referring to FIG. 3, a device (100) according to an embodiment of the present invention can output a layout diagram including first graphic elements (312, 313, 314, 315, 316) visualizing individual solar modules of a solar power generation system on a display (140). The layout diagram may reflect the positional relationship between solar modules of an actual solar power generation system and the layout of the module array. The screen (310) outputting the entire area of ​​the layout diagram may output the serial number of each solar module. In addition, information related to the solar modules may be expressed in color.

[0059] For example, the device (100) may display normal modules and modules with errors in different colors, and may also display different colors depending on the severity of the error. Alternatively, the device (100) may display different colors depending on the numerical range of power generation. The embodiment of displaying information related to solar modules using colors is not limited to the described examples, and various forms of displaying information about other solar modules may be realized.

[0060] The device (100) can obtain a user input for enlarging the screen (310), and, based on the position and manipulation degree at which the user input is obtained, determine the first graphic elements (322, 323, 324, 325) to be output on the enlarged screen (320). The processor (110) can determine the items and display method of information related to solar modules to be output on the enlarged screen (320) based on the magnification and preset display level of the enlarged screen (320). For example, the device (100) can provide daily cumulative power generation and module voltage values, which are information that cannot be confirmed on the screen (310) with a magnification of 1, on the enlarged screen (320).

[0061] Here, the daily accumulated power generation and module voltage values ​​may be real-time monitoring data values ​​of each individual solar module corresponding to the first graphic elements (322, 323, 324, 325) output on the enlarged screen (320). The processor (110) may control the display (140) to output information of the solar modules corresponding to the first graphic elements (322, 323, 324, 325) by overlaying them in the form of text or color in each area where a plurality of first graphic elements are output.

[0062] The device (100) can obtain a user input for enlarging the screen on an enlarged screen (320), and determine a first graphic element (332) to be output on the enlarged screen (330) based on the magnification of the current screen, the position of the user input, and the degree of manipulation. The processor (110) can determine the items and display method of information related to solar modules to be output on the enlarged screen (330) based on the magnification of the enlarged screen (320) and a preset display level. For example, the device (100) can further display monthly cumulative power generation, real-time power generation, module temperature value, and inverter serial number, which are information that could not be confirmed on the previous screen (320).

[0063] The device (100) can obtain a user input for reducing the screen (310, 320, 330), and, based on the position and degree of manipulation at which the user input is obtained, determine the first graphic element to be output on the reduced screen, the items of information related to the solar module, and the display method.

[0064] Although not shown in FIG. 3, the device (100) may output an image schematically illustrating the entire solar power generation system rather than individual solar modules when the screen is reduced below a predetermined threshold magnification.

[0065] FIG. 4 is a drawing for explaining an example of a method for outputting information of a solar module and a graphic element visualizing a solar module according to another embodiment.

[0066] Referring to FIG. 4, the device (100) according to an embodiment of the present invention can further output a second graphic element (417, 427, 437) indicating a magnification on one end of the screen (410, 420, 430). In FIG. 4, the magnification is expressed in the form of ×1, ×2.6, ×4.7, but it is obvious that the magnification can also be expressed in the form of 100%, 260%, 470%.

[0067] FIG. 5 is a drawing illustrating an example of a method for outputting information of a solar module and a graphic element visualizing a solar module according to another embodiment.

[0068] Referring to FIG. 5, a user can adjust the angle of a layout by inputting an operation for adjusting the angle of a screen (510, 520) on which at least one graphic element is placed. The device (100) according to an embodiment of the present invention can further output graphic elements (511, 521) indicating angle information of the layout.

[0069] Unless the steps constituting the method according to the present invention are explicitly described in an order or contrary to the order, the steps may be performed in any suitable order. The present invention is not necessarily limited to the order in which the steps are described. The use of all examples or exemplary terms (e.g., etc.) in the present invention is merely for the purpose of describing the present invention in more detail, and the scope of the present invention is not limited by the examples or exemplary terms.

[0070] Meanwhile, the above-described method can be written as a program that can be executed on a computer, and can be implemented in a general-purpose digital computer that runs the program using a computer-readable recording medium. In addition, the structure of the data used in the above-described method can be recorded on a computer-readable recording medium through various means. The computer-readable recording medium includes storage media such as magnetic storage media (e.g., ROM, RAM, USB, floppy disk, hard disk, etc.), optical reading media (e.g., CD-ROM, DVD, etc.).

[0071] Those skilled in the art will appreciate that the present invention can be implemented in modified forms without departing from the essential characteristics of the above-described description. Therefore, the disclosed methods should be considered illustrative rather than restrictive, and the scope of the rights is set forth in the claims, not the foregoing description, and should be interpreted to include all differences within the scope equivalent thereto.

Claims

1. A method for controlling an electronic device that provides a screen for monitoring a solar power generation system, A step of outputting a screen on which at least one graphic element visualizing at least one solar module of the solar power generation system is arranged; A step of obtaining user input for adjusting the magnification of the above screen; A step of detecting the location and degree of manipulation at which the user input occurred; A step of determining a first graphic element among the at least one graphic element based on the position and the degree of manipulation, and determining a display level of information related to the solar module; and A method comprising the step of outputting the first graphic element and the information of the solar module corresponding to the first graphic element, according to the display level.

2. In paragraph 1, The above detection step is, A step of detecting the start and end positions of the user input; and A method comprising: calculating a distance between the start position and the end position.

3. In paragraph 1, Information related to the above solar modules, A method comprising at least one of the array information of the solar module, serial number, accumulated power generation, real-time monitoring data value, error information, and inverter information connected to the solar module.

4. In paragraph 1, The above outputting step is: A step of outputting the information by overlaying it with text or color in the area where the first graphic element is output; and A method comprising the step of outputting a second graphic element representing the magnification on one side of the screen.

5. In paragraph 1, The above user input is, A method comprising an operation of enlarging, reducing or adjusting the angle of a screen on which at least one graphic element is placed.

6. A computer-readable recording medium recording a program for executing the method of paragraph 1 on a computer.

7. In an electronic device providing a screen for monitoring a solar power generation system, At least one memory; At least one processor; Input / output interface; and including a display; The above processor, Controlling the display so that a screen is outputted on which at least one graphic element visualizing at least one solar module of the solar power generation system is arranged; Obtain user input to adjust the magnification of the above screen, Detecting the location and degree of manipulation where the above user input occurred, Based on the above location and the degree of manipulation, a first graphic element is determined from among the at least one graphic element, and a display level of information related to the solar module is determined, A device that controls the display so that the first graphic element and the information of the solar module corresponding to the first graphic element are output according to the above display level.

8. In paragraph 7, The above processor, Detect the start and end positions of the above user input, A device for calculating the distance between the above start position and the above end position.

9. In paragraph 7, Information related to the above solar modules, A device comprising at least one of the array information of the solar module, serial number, accumulated power generation, real-time monitoring data value, error information, and inverter information connected to the solar module.

10. In paragraph 7, The above processor, Control the display so that the information is output as text or color overlayed in the area where the first graphic element is displayed; A device that controls the display so that a second graphic element representing the magnification is output on one side of the screen.

11. In paragraph 7, The above user input is, A device comprising an operation for enlarging, reducing or adjusting the angle of a screen on which at least one graphic element is placed.

Images