Method and apparatus for providing information,and non-transitory computer readable recording medium for performing the method

TWI945690BActive Publication Date: 2026-11-11COUPANG CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
TW114103776
Authority / Receiving Office
TW · TW
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-12-21
Filing Date
2021-02-18
Publication Date
2026-11-11
Estimated Expiration
2041-02-17

AI Technical Summary

Technical Problem

Existing methods for verifying codes in information processing devices are prone to software operation errors and require additional software installation, which can change the device's structure or memory.

Method used

An electronic device that verifies codes by transmitting user input to a reference server and a development server, comparing response sets, and determining code correctness based on the comparison, without altering the device's structure or installing separate software.

Benefits of technology

The method effectively prevents errors by verifying codes in a test environment, ensuring the code is correct before deployment, thus preventing unexpected issues when providing services to users.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure TWG2TB001920442_001
    Figure TWG2TB001920442_001
  • Figure TWG2TB001920442_002
    Figure TWG2TB001920442_002
  • Figure TWG2TB001920442_003
    Figure TWG2TB001920442_003
Patent Text Reader

Abstract

According to the present invention, an information provision method is disclosed, comprising: acquiring a request information set in an electronic device; transmitting a subset of request information corresponding to at least a portion of the request information set to a reference server; transmitting the subset of request information to a development server; receiving from the reference server a first response set containing responses to one of the subset of request information; receiving from the development server a second response set containing responses to one of the subset of request information; and providing comparison information between the first response set and the second response set.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to an electronic device and a method for verifying a code. More specifically, the present invention relates to an electronic device that samples a user input, transmits the sampled user input to a server that executes different versions of the code, and provides information on a comparison of result values, thereby verifying a code, and to a method thereof. Prior Art

[0002] With the development of electronic technology, services using electronic technology have entered our daily lives. A server that provides a service to a user may need to change a code (e.g., a program described in machine language and interpreted by a central processing unit (CPU) for execution) for its operation for reasons such as fixing a bug or providing an additional function.

[0003] Conventionally, in an information processing device (such as a server, a personal computer, or a mobile communication device), it has been necessary to execute a verified code on the device. In other words, it is necessary to prevent a code that has been inadvertently changed by a third party or a code that may cause an unexpected error from being stored in a memory and executed on the device.

[0004] In the related art, for this necessity, a method of adding verification software in an information processing device and verifying the code using verification information given to the code before execution, or a method of adding demodulation software in an information processing device and demodulating an encoded code before execution to verify the code has generally been practiced.

[0005] However, in the related art, since the code is verified by software, there may be a possibility of a software operation error and a limitation of having to add separate software in the information processing device.

[0006] Therefore, a method and a device for verifying a code without changing the structure of a processor or a memory of an information processing device or installing separate software are desired. Summary of the Invention

[0007] [Technical Objectives] One aspect provides an electronic device that verifies a code in a test environment and pre-determines whether the code is incorrect, thereby preventing an error from occurring when using the code to provide a service to a user, and a method thereof.

[0008] The technical objectives to be achieved through the exemplary embodiments are not limited to the technical objectives described above, and other technical tasks can be inferred from the following exemplary embodiments. [Technical Solution]

[0009] According to one aspect, a method for providing information in an electronic device is provided. The method includes: obtaining a set of requested information, transmitting a subset of the requested information corresponding to at least a part of the set of requested information to a reference server, transmitting the subset of the requested information to a development server, receiving a first response set including a response to the subset of the requested information from the reference server, receiving a second response set including a response to the subset of the requested information from the development server, and providing comparison information between the first response set and the second response set.

[0010] The set of requested information can be obtained based on user information input to a service server corresponding to the reference server.

[0011] The development server can have a structure corresponding to a structure of the reference server. Code of the development server for generating the response to the subset of the requested information can be associated with code of the reference server. The code of the development server can be changed based on a user input.

[0012] The providing of the comparison information can include providing information about a comparison between the first response set and the second response set for each of one or more application programming interfaces (APIs) associated with processing of the subset of the requested information.

[0013] When obtaining the set of requested information on a time basis, the providing of the comparison information can include outputting time information about a comparison result between the first response set and the second response set.

[0014] The method can further include outputting statistical information associated with the development server and the reference server.

[0015] The statistical information can include performance information associated with generating a response to the subset of the requested information by at least one of the reference server and the development server.

[0016] The performance information may include performance information of an application installed in at least one of the reference server and the development server. The performance information of the application may include at least one of a memory usage and a latency associated with the generation of the response.

[0017] The statistical information may be output for each of one or more APIs associated with the processing of the request information subset.

[0018] The method may further include determining whether the code of the development server is abnormal based on a comparison result between the first response set and the second response set.

[0019] The method may further include, when determining that the code of the development server is normal, deploying the code of the development server to a service server corresponding to the reference server.

[0020] The electronic device may include at least one sub-device. The providing of the comparison information may be performed by the at least one sub-device.

[0021] According to another aspect, there is also provided an electronic device for providing information, the electronic device including a transceiver, a memory including instructions, and a processor, wherein the processor is connected to the memory to obtain a set of request information, transmit a subset of the request information corresponding to at least a part of the set of request information to a reference server, transmit the subset of the request information to a development server, receive a first response set including a response to the subset of the request information from the reference server, receive a second response set including a response to the subset of the request information from the development server, and provide comparison information between the first response set and the second response set.

[0022] Details of the exemplary embodiments are included in the detailed description and the drawings. [Effect]

[0023] According to the present invention, an electronic device and a method for verifying a code can verify a code in a test environment and pre-determine whether the code is incorrect, thereby preventing an error from occurring when using the code to provide a service to a user.

[0024] The effects are not limited to the foregoing effects, and those skilled in the art will clearly understand other effects not mentioned from the description of the scope of the patent application for the invention. Brief Description of the Drawings

[0025] FIG. 1 is a block diagram of an information providing system according to an exemplary embodiment.

[0026] FIG. 2 is a flowchart of a method for providing information in an information providing system according to an exemplary embodiment.

[0027] FIG. 3A is a diagram illustrating an example of statistical information provided by an electronic device according to an exemplary embodiment.

[0028] FIG. 3B is a diagram illustrating an example of statistical information provided by an electronic device according to an exemplary embodiment.

[0029] FIG. 4 is a diagram illustrating comparison information provided by an electronic device according to an exemplary embodiment.

[0030] FIG. 5 is a flowchart of an information providing method of an electronic device according to an exemplary embodiment.

[0031] FIG. 6 is a diagram illustrating an example of a configuration of an electronic device for verifying a code according to an exemplary embodiment. Embodiments

[0032] When considering the functions obtained according to the present invention, the terms used in the embodiments are selected from the general terms widely used at present as much as possible. However, based on the intentions, habits, the emergence of new technologies, or the like of those skilled in the art, these terms may be replaced by other terms. Also, in a specific case, terms arbitrarily selected by the applicant of the present invention may be used. In this case, the meanings of these terms may be described in the corresponding description part of the present invention. Therefore, it should be noted that the terms used herein should be interpreted based on their practical meanings and the entire content of this specification, rather than simply based on the names of the terms.

[0033] Throughout the specification, when an element is referred to as "including" another element, the element should not be construed as excluding other elements, as long as there is no special conflict description, and the element may include at least one other element. In addition, the terms "unit" and "module" may (for example) refer to a component that performs at least one function or operation, and may be implemented in hardware or software, or may be implemented by a combination of hardware and software.

[0034] The expression "at least one of A, B, and C" may include the following meanings: A alone; B alone; C alone; A and B together; A and C together; B and C together; and all three A, B, and C together.

[0035] In the present invention, a "terminal" can be implemented as a computer or a portable terminal capable of accessing a server or another terminal through a network. Here, the computer may include, for example, a laptop computer, a desktop computer, and a notebook computer equipped with a web browser. The portable terminal can be a wireless communication device that ensures portability and mobility, and includes any type of handheld wireless communication device (for example, a tablet PC, a smart phone, a communication-based terminal (such as International Mobile Telecommunications (IMT), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (W-CDMA), and Long Term Evolution (LTE))).

[0036] In the following description, exemplary embodiments of the present invention will be described in detail with reference to the drawings, so that those skilled in the art can easily implement the present invention. The present invention can be embodied in many different forms and the present invention is not limited to the embodiments described herein.

[0037] Hereinafter, exemplary embodiments of the present invention will be described with reference to the drawings.

[0038] When describing the exemplary embodiments, descriptions of technical content that is well-known in the art to which the present invention pertains and is not directly relevant to this specification will be omitted. This is to more clearly convey without obscuring the subject matter of this specification by omitting unnecessary descriptions.

[0039] For the same reason, in the accompanying drawings, some components are enlarged, omitted, or schematically illustrated. Additionally, the sizes of the components do not fully reflect the actual sizes. The same or corresponding components in each drawing are given the same reference numerals.

[0040] The advantages and features of the present invention and the methods for achieving them will become apparent from the following exemplary embodiments, which will be described in more detail with reference to the accompanying drawings. However, it should be noted that the present invention is not limited to the following exemplary embodiments and can be implemented in various forms. Therefore, the exemplary embodiments are provided only to disclose the present invention and to enable those skilled in the art to know the category of the present invention. In the drawings, the embodiments of the present invention are not limited to the specific examples provided herein and are enlarged for clarity. Throughout the specification, the same reference numerals or the same reference indicators represent the same components.

[0041] At this point, it should be understood that each block of the flowchart illustration and combinations of the flowchart illustrations can be executed by computer program instructions. Since these computer program instructions can be installed on a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing facilities, the instructions executed by the processor of the computer or other programmable data processing facilities can form a means for performing the functions described in (several) flowchart blocks. These computer program instructions can be stored in a computer-usable or computer-readable memory, and they can be directed to a computer or other programmable data processing facility to implement the functionality in a specific manner. Therefore, the computer-usable or computer-readable memory. The instructions stored therein can also produce an article of manufacture containing instruction means for performing the functions described in (several) flowchart blocks. The computer program instructions can also be installed on a computer or other programmable data processing facility, such that a series of operation steps can be executed on the computer or other programmable data processing facility to form a computer-implemented procedure for forming a computer or other programmable data. The instructions for executing the processing facility can also provide steps for performing the functions described in (several) flowchart blocks.

[0042] In addition, each block can represent a part of a module, segment, or code containing one or more executable instructions for performing a (several) specified logical function. It should also be noted that in some alternative embodiments, the functions mentioned in the blocks may not occur in sequence. For example, depending on the corresponding functions, two blocks shown in sequence may actually be executed substantially simultaneously, or the blocks may sometimes be executed in the reverse order.

[0043] FIG. 1 is a block diagram showing an information providing system according to an exemplary embodiment.

[0044] According to various exemplary embodiments, an information providing system 100 may include an electronic device 110, a reference server 120, and a development server 130. In some embodiments, the information providing system 100 may further include a network (not shown) that supports information transmission and reception performed between the electronic device 110, the reference server 120, and the development server 130.

[0045] Each of the electronic device 110, the reference server 120, and the development server 130 may include a memory and a processor. In addition, each of the electronic device 110, the reference server 120, and the development server 130 may refer to a component that performs at least one function or operation, and may be implemented by hardware or software or a combination of hardware and software.

[0046] According to an exemplary embodiment, the electronic device 110, the reference server 120, and the development server 130 may include computer software or a plurality of computer systems implemented as a web server and may provide various information by configuring the information into a web page. For example, at least some of the electronic device 110, the reference server 120, and the development server 130 may refer to computer software and a computer system connected to a sub-device that communicates with another web server through a computer network (such as an intranet or the Internet) to receive a request to execute a task, execute the task, and provide a result of the task. Additionally, the electronic device 110, the reference server 120, and the development server 130 may be understood to include a broad concept of a series of application programs operating on a web server and various databases built therein. For example, at least some of the electronic device 110, the reference server 120, and the development server 130 may be implemented using a web server program provided in various ways based on an operating system (such as DOS, Windows, Linux, UNIX, Mac OS, or the like).

[0047] To provide information, the electronic device 110 acquires a set of request information, transmits a subset of request information corresponding to at least a part of the set of request information to the reference server 120, transmits the subset of request information to the development server 130, receives a first response set including a response to the subset of request information from the reference server 120, and receives a second response set including a response to the subset of request information from the development server 130. A network may be used for communication between the electronic device 110 and the reference server 120 and for communication between the electronic device 110 and the development server 130. Additionally, in the exemplary embodiment, the electronic device 110 may generate comparison information based on the information received from the reference server 120 and the information received from the development server 130. Further, the electronic device 110 may receive information associated with an execution state of a response in the development server 130 for information based on the subset of request information received from the development server 130 and provide the received information.

[0048] According to an exemplary embodiment, the electronic device 110 may include a status server. Specifically, the electronic device 110 may instantaneously track a communication status of another device connected to the electronic device 110 and use the communication status to provide information about the electronic device 110. For example, the electronic device 110 may obtain performance information including a latency related to data transmission and reception. The latency may include at least one of a time period required to generate a response in each server and a time period for transmitting corresponding information over a network. Additionally, in the exemplary embodiment, the performance information may include information associated with resources used by another device to generate a response to the requested information. For example, information such as a memory usage and a central processing unit (CPU) usage may also be included in the performance information. Based on the performance information, it is possible to monitor a situation in which one of the codes operates in a corresponding server with increased efficiency. Also, in the exemplary embodiment, the performance information may include performance information of an application installed in another electronic device. For example, the application may generate response information based on the requested information. Thus, a reference related to the performance used by the application to generate the response information may be included in the performance information.

[0049] A method for providing information by the electronic device 110 will be described in more detail with reference to FIGS. 2 to 5.

[0050] The reference server 120 receives a subset of the requested information from the electronic device 110, generates a response to the subset of the requested information (hereinafter referred to as a "first response set"), and transmits the generated first response set to the electronic device 110. The reference server 120 is a server corresponding to a service server that practically provides a service to a user, and may be a server having a structure corresponding to that of the service server. The code for generating a response to the subset of the requested information in the reference server 120 may correspond to the code for generating a response to the subset of the requested information in the service server.

[0051] The development server 130 receives a subset of the requested information from the electronic device 110, generates a response to the subset of the requested information (hereinafter referred to as a "second response set"), and transmits the generated second response set to the electronic device 110. The development server 130 is a server corresponding to a service server that practically provides a service to a user, and may be a server having a structure corresponding to that of the service server. That is, the development server 130 and the reference server 120 may have corresponding structures to each other.

[0052] Code for generating a response to one of the subsets of request information in the development server 130 may be a code associated with the code for generating a response to the subset of request information in the service server. The code of the development server 130 may be changed based on a user input.

[0053] The reference server 120 may use the code used in the service server, and the development server 130 may use a changed code. Through this, the second response set may correspond to a response in a case where the changed code is used, and the first response set may correspond to a response in a case where an existing code is used. In this example, it may be determined whether the changed code is incorrect by comparing the first response set with the second response set. Meanwhile, in an exemplary embodiment, the reference server 120 may also be implemented as at least some of at least one server used in an actual service.

[0054] For simplicity, the following description is based on a case where the development server 130 uses a changed code. However, embodiments of the present invention are not limited to the case where the development server 130 uses a changed code. In some embodiments, the development server 130 may use the same code as the reference server 120. For example, if the reference server 120 and the development server 130 use the same code, it may be verified whether the structures of the reference server 120 and the development server 130 correspond to each other.

[0055] The network may be used to connect the electronic device 110 to the reference server 120, connect the electronic device 110 to the development server 130, or connect the electronic device 110 to an external device (e.g., a query server, a service server, etc.). For example, the network may provide a connection path such that the reference server 120, the development server 130, or the external device is connected to the electronic device 110 to transmit packet data to the electronic device 110 or receive packet data from the electronic device 110.

[0056] Operations related to an information providing method according to one of the exemplary embodiments may be implemented by a single entity device or may be implemented by a plurality of entity devices organically combined. For example, some components included in the information providing system 100 may be implemented as one entity device, and other components included in the information providing system 100 may be implemented as another entity device. For example, one entity device may be implemented as a part of the electronic device 110, and another entity device may be implemented as a part of the reference server 120 or a part of the development server 130 or a part of an external device. In some cases, the components included in the information providing system 100 may be distributed and configured in different entity devices. The distributed components may be organically combined to perform the functions and operations of the information providing system 100. For example, the electronic device 110 of the present invention includes at least one sub-device. Some operations described as being performed by the electronic device 110 may be performed by a first sub-device, and some other operations may be performed by a second sub-device. For example, an operation of providing comparison information of a first response set and a second response set may be performed by a sub-device included in the electronic device 110.

[0057] FIG. 2 is a flowchart of a method of providing information in an information providing system 100 according to an exemplary embodiment.

[0058] Referring to FIG. 2, a query receiving server 220 obtains a request information set in operation 201 and transmits the obtained request information set to the electronic device 110 in operation 202. The query receiving server 220 may include a server that transmits the received information to another device. For example, the query receiving server 220 may use a distributed messaging system to transmit the received information to another node. The distributed messaging system may be (for example) Apache Kafka.

[0059] The query receiving server 220 may obtain the request information set from a service server that practically provides a service to a user. The request information set may be information obtained based on user information input to the service server. The request information set may be a set of various information input by the user receiving the service. For example, the request information set may include request information transmitted to a backend server based on user input input to a frontend server.

[0060] In some embodiments, the electronic device 110 may directly receive the request information set from the service server instead of through the query receiving server 220 or the query receiving server 220 may be implemented as a part of the electronic device 110.

[0061] The electronic device 110 may obtain a subset of request information based on the received set of request information. The subset of request information may correspond to at least a part of the set of request information. For example, the subset of request information may be generated by sampling a plurality of pieces of user information included in the set of request information at a predetermined ratio. Meanwhile, a sampling ratio may vary based on a setting of the electronic device 110. In addition, the number of subsets of request information obtained per unit time may also vary based on the setting of the electronic device 110. By adjusting the sampling ratio or the number of subsets of request information sampled per unit time, a load test of the development server 130 can be easily performed.

[0062] In operation 203, the electronic device 110 may transmit the subset of request information to the reference server 120. In operation 204, the electronic device 110 may transmit the subset of request information to the development server 130. In operation 205, the reference server 120 may generate a first set of responses including a response to the received subset of request information. In operation 207, the reference server 120 may transmit the generated first set of responses to the electronic device 110. In operation 206, the development server 130 may generate a second set of responses including a response to the received subset of request information. In operation 208, the development server 130 may transmit the generated second set of responses to the electronic device 110.

[0063] The electronic device 110 may compare the received first set of responses and the second set of responses in operation 209 and provide comparison information in operation 210. Specifically, the electronic device 110 may compare a plurality of responses included in the first set of responses with a plurality of responses included in the second set of responses and compare specific parts of the responses of the corresponding codes, thereby verifying whether the same responses are received or different responses are received. In an exemplary embodiment, through the setting of the electronic device 110, the parts to be compared among the responses of the specific codes can be set. In addition, a user interface (UI) for identifying a different part through a comparison between two responses may also be provided. Moreover, the electronic device 110 may provide information about the ratio of the responses having different outputs among the entire responses. An example related to a comparison result will be described in more detail with reference to FIG. 4.

[0064] According to an exemplary embodiment, the electronic device 110 may compare the first set of responses and the second set of responses for each of one or more application programming interfaces (APIs) associated with the processing of the subset of request information. In this case, the electronic device 110 may provide information about a comparison between the first set of responses and the second set of responses separately for each of the one or more APIs.

[0065] A manager may determine whether a changed code used by a development server 130 is incorrect based on comparison information provided by an electronic device 110. Specifically, the manager may determine the degree to which a plurality of responses included in a first response set match a plurality of responses included in a second response set. When an unexpected non-matching response is found (e.g., when it does not correspond to the non-matching expected during the code change), the manager may determine that the changed code is incorrect and correct the changed code. When the electronic device 110 provides a comparison between the first response set and the second response set separately for each of one or more APIs, the manager can quickly identify an API where a non-matching response occurs and thus can easily find an incorrect portion of the changed code.

[0066] When an unexpected non-matching response is not found, the manager may deploy the code used by the development server 130 to a service server corresponding to the reference server 120.

[0067] According to an exemplary embodiment, when a request information set is acquired on a time basis, the electronic device 110 may provide time information associated with a comparison result between a first response set and a second response set. For example, the electronic device 110 may provide a comparison result between the first response set and the second response set in the form of a graph using a time series as one axis.

[0068] An example of the electronic device 110 that provides comparison information between the first response set and the second response set is described in more detail with reference to FIG. 4.

[0069] The electronic device 110 may further provide statistical information associated with the reference server 120 and the development server 130. At least a part of the statistical information provided by the electronic device 110 may correspond to the comparison information between the first response set and the second response set. The statistical information provided by the electronic device 110 may include the number of user inputs included in a request information subset. Additionally, the statistical information provided by the electronic device 110 may include performance information of the electronic device 110. For example, the statistical information may include a latency associated with at least some of the acquisition of the request information, the transmission of the request information subset, and the reception of the first response set and the second response set.

[0070] According to an exemplary embodiment, the electronic device 110 may provide statistical information for each of one or more APIs associated with the processing of a request information subset. For example, the electronic device 110 may provide, for each of one or more APIs, the number of user inputs included in the request information subset and the total number of user inputs included in the request information subset.

[0071] According to an exemplary embodiment, the electronic device 110 may provide time information and statistical information. For example, the electronic device 110 may provide the number of user inputs or performance information (e.g., latency) included in the request information subset to the user in the form of a chart having a time series as one of the axes.

[0072] An example of the electronic device 110 that provides statistical information associated with the reference server 120 and the development server 130 will be described in more detail with reference to FIGS. 3A and 3B.

[0073] According to an exemplary embodiment, the electronic device 110 may determine whether there is an error in the code of the development server 130 based on a comparison result between a first response set and a second response set. In this case, the electronic device 110 may determine whether there is an error in the code based on a pre-set condition. For example, as a comparison result between the first response set and the second response set, when a mismatch response occurrence rate exceeds a predetermined threshold ratio, the electronic device 110 may determine that there is an error in the code of the development server 130. In this example, when determining whether there is an error in the code of the development server 130, a mismatch response corresponding to a result expected when the code used in the development server 130 is changed may be regarded as not a mismatch response. For example, when the code used in the development server 130 is a code that is changed to output an altered result of a specific API, the corresponding APU may be excluded when determining the mismatch response occurrence rate.

[0074] According to an exemplary embodiment, the electronic device 110 may deploy the code used by the development server 130 to the service server corresponding to the reference server 120. In this case, the electronic device 110 may autonomously determine whether there is an error in the code, or the manager may determine whether there is an error in the code and input a determination result to the electronic device 110.

[0075] FIGS. 3A and 3B are diagrams illustrating examples of statistical information provided by an electronic device according to an exemplary embodiment.

[0076] Referring to FIGS. 3A and 3B, the electronic device 110 may provide statistical information associated with the reference server 120 and the development server 130. The statistical information provided by the electronic device 110 may include the number of user inputs 310 included in a request information subset and performance information 320 to 370. At least a portion of the performance information 320 to 370 may be associated with an operation of the electronic device 110, and at least another portion may be associated with generating a response to the request information subset by at least one of the reference server 120 and the development server 130. For example, the performance information 320 to 370 included in the statistical information may include at least one information indicating the performance of at least one of the electronic device 110, the reference server 120, and the development server 130 regarding the extraction of the request information, the transmission of the request information subset, and the reception of a first response set and a second response set.

[0077] The performance information 320 to 370 may include performance information of an application installed in at least one of the reference server 120 and the development server 130. The performance information of an application may include at least one of memory usage and latency associated with generating at least a portion of the plurality of responses included in the first response set and the plurality of responses included in the second response set. According to an exemplary embodiment, the performance information of the application may include CPU performance-related information 330, memory performance-related information 340, system load information 350 of the electronic device 110, available disk capacity information 360, and information 370 associated with the data throughput per unit time of a network. In this case, the CPU performance-related information 330 may include: "CPU: user", which is the CPU usage time in a user area; "CPU: iowait", which is the CPU time used for temporarily holding a CPU task due to other communications; "CPU: system", which is the CPU usage time in a system area; and "CPU: idle", which is the proportion of an idle state where the CPU is not used. In addition, the memory performance-related information may include: "Memory: used" and "Memory: used percentage", which are information associated with memory usage; "Memory: cache", which is cache area information associated with a memory; and "Memory: buffer", which is buffer information associated with the memory.

[0078] Statistical information can be displayed in the form of a chart having a time series as a horizontal axis. At least a portion of the statistical information can be displayed separately for each of one or more APIs. By displaying the statistical information in chronological order, the manager can determine whether an error has occurred at a predetermined time point related to an input and an output of the information. For example, when the number of user inputs is significantly small or when the latency is too long at a predetermined time point, the manager can determine that the information transmitted and received at that time point has low reliability. Also, when the number of user inputs is significantly small, or when the latency is too long at a time point close to a current time point, the manager can attempt to solve the problem by finding a cause of the problem.

[0079] At least a portion of the statistical information can be displayed in the form of a comparison between information associated with the reference server 120 and information associated with the development server 130. For example, the CPU performance related information 330 can be displayed in the form of a comparison result between the CPU performance of the reference server 120 and the CPU performance of the development server 130, which can be applied similarly or identically to the memory performance related information 340, the system load information 350, the available disk capacity information 360, and the information 370 associated with the data throughput per unit time of the network. Also, a latency 320 shown in the diagram corresponds to the latency information of each API of the electronic device 110. In some cases, the latency 320 can correspond to information displayed by comparing the latencies associated with the responses of the reference server 120 and the development server 130.

[0080] By displaying statistical information comparing information associated with the reference server 120 and information associated with the development server 130, the manager can determine whether the modified code used by the development server 130 is incorrect. For example, as a result of identifying the performance information 320 to 370, when the overall performance of the development server 130 is less than that of the reference server 120 by a predetermined percentage or more, the manager can determine that the modified code used by the development server 130 is incorrect. In this case, the manager can attempt to solve the performance degradation by finding a cause of the degradation.

[0081] FIG. 4 is a diagram illustrating comparison information provided by an electronic device according to an exemplary embodiment.

[0082] Referring to FIG. 4, the electronic device 110 may provide comparison information 410 of a first response set and a second response set. The comparison information 410 may be displayed in the form of a chart having a time series as a horizontal axis. The comparison information 410 may be displayed separately for each of one or more APIs. By displaying the comparison information 410 in chronological order, a manager can identify how many mismatched responses are received at which time point.

[0083] The comparison information 410 provided by the electronic device 110 may include a number 411 of successfully collected responses associated with a plurality of responses included in the first response set and a plurality of responses included in the second response set. In this case, when a specific response included in the first response set and a response included in the second response set and corresponding to the specific response included in the first response set are successfully received, the number 411 of successfully collected responses may be counted up to one. For example, when the first response set includes 300 responses, the second response set includes 300 responses, and the responses included in the first response set exactly correspond to the responses included in the second response set, the number 411 of successfully collected responses may be 300.

[0084] In addition, the comparison information 410 provided by the electronic device 110 may include a number 412 of matching responses and a number 413 of mismatching responses regarding a plurality of responses included in the first response set and a plurality of responses included in the second response set. When an unexpected mismatching response is found, the manager may determine a changed code error and correct the changed code.

[0085] According to an exemplary embodiment, the comparison information 410 provided by the electronic device 110 may further include, for example, a number 416 of uncollected responses, a number 414 of failures attributable to unstable communication when transmitting information to the reference server 120 and receiving information from the reference server 120, and a number 415 of failures that occur when transmitting information to the development server 130 and receiving information from the development server 130.

[0086] According to an exemplary embodiment, the electronic device 110 may provide log information 420. The log information 420 may be information recorded when an event that satisfies a predetermined condition occurs. For example, the log information 420 may include an information log collected at a predetermined time interval and an error log collected when an error occurs. The log information 420 may be information generated in the electronic device 110 or information received from the reference server 120 or the development server 130. The error log may be related to an operation error of the electronic device 110 or an operation error of the reference server 120 or the development server 130.

[0087] According to an exemplary embodiment, the electronic device 110 may further provide information 430 such as a mismatch response rate 431, a number 432 of one of the sub-devices currently being driven among the sub-devices included in the electronic device 110, a number 433 of one of the sub-devices being activated among the sub-devices included in the electronic device 110, and an information transmission and reception count 434. A sub-device is a device included in the electronic device 110 and may be a device that performs an operation of providing comparison information between a first response set and a second response set. A currently driven sub-device may correspond to a device that immediately provides comparison information. An activated sub-device may correspond to a device capable of providing comparison information (i.e., may include a currently driven sub-device). The information transmission and reception count 434 may correspond to how many times the extraction of a requested information set, the transmission of a requested information subset, or the reception of a first response set and a second response set is performed per unit time. At the same time, in the exemplary embodiment, the electronic device 110 may adjust the number of driven sub-devices based on a setting.

[0088] Although not shown, according to an exemplary embodiment, the electronic device 110 may provide information on the number of mismatch responses for each of one or more APIs associated with the processing of a requested information subset. Also, when a mismatch response is generated, according to an exemplary embodiment, the electronic device 110 may provide path information corresponding to the mismatch response.

[0089] In addition, although not shown, according to an exemplary embodiment, the electronic device 110 may provide various information, including (for example) the use of a heap area of a memory, the use of a non-heap area of a memory, the running time of a background thread running for memory management, the number of requests according to an http response, the number of threads, and an average value of latency.

[0090] The use of the heap area of the memory may be associated with whether a memory leak occurs. Specifically, if the use of the heap area is not maintained and increases straight up over time, it may be predicted that a memory leak occurs.

[0091] The running time of the background thread for memory management operation may include a garbage collector.

[0092] FIG. 5 is a flowchart illustrating an operation of a method for providing information of an electronic device according to an exemplary embodiment.

[0093] Referring to FIG. 5, an electronic device 110 according to an exemplary embodiment obtains a request information set in operation 510 and transmits a request information subset corresponding to at least a part of the request information set to a reference server 120 and a development server 130 in operation 520. In operation 530, the electronic device 110 receives a first response set including a response to the request information subset from the reference server 120 and receives a second response set including a response to the request information subset from the development server 130.

[0094] In response to receiving the first response set and the second response set, in operation 540, the electronic device 110 compares the first response set with the second response set and provides comparison information.

[0095] FIG. 6 is a diagram illustrating a configuration of an electronic device for verifying a piece of code according to an exemplary embodiment.

[0096] Referring to FIG. 6, the electronic device 110 includes a transceiver 610, a processor 620, and a memory 630. Through the transceiver 610, the electronic device 110 can be connected to the reference server 120, the development server 130, and an external device (e.g., a personal computer) to perform data exchange.

[0097] The processor 620 may include one or more devices described with reference to FIGS. 1 to 5 or perform at least one of the methods described with reference to FIGS. 1 to 5. The memory 630 may store information for performing at least one of the methods described with reference to FIGS. 1 to 5 (including the request information set, the request information subset, the first response set, the second response set, the statistical information, and the comparison information described above). The memory 630 may be a volatile memory or a non-volatile memory.

[0098] The processor 620 may execute a program and control the electronic device 110 to provide information. A piece of code executed by the processor 620 may be stored in the memory 630.

[0099] In addition, the electronic device 110 of the exemplary embodiment may further include an interface for providing information to a manager.

[0100] This specification and the drawings have been described with reference to exemplary embodiments of the present invention. Although specific terms are used, they are used only in a general sense to simply explain the technical content of the present invention and to assist in understanding the present invention, and are not intended to limit the scope of the specification. Those skilled in the art will understand that other modifications based on the technical spirit of the present invention can also be implemented in addition to the embodiments disclosed herein.

[0101] The electronic device or terminal according to the above embodiment may include a processor, a memory for storing and executing program data, a permanent storage device (such as a disk drive), a communication port for communicating with an external device, and a user interface device (such as a touch panel, a key, and a button). The method implemented by a software module or algorithm can be stored in a computer-readable recording medium as computer-readable code or program commands executable by a processor. Here, the computer-readable recording medium may be a magnetic storage medium (for example, a read-only memory (ROM), a random access memory (RAM), a floppy disk, or a hard disk) or an optical reading medium (for example, a CD-ROM or a digital versatile disc (DVD)). The computer-readable recording medium can be dispersed to computer systems connected by a network, so that the computer-readable code can be stored and executed in a dispersed manner. The medium can be read by a computer, stored in a memory, and executed by a processor.

[0102] This embodiment can be represented by functional blocks and various processing steps. These functional blocks can be implemented by various numbers of hardware and / or software configurations that execute specific functions. For example, this embodiment can adopt a direct circuit configuration (such as a memory, a processor, a logic circuit, and a lookup table) that can execute various functions by controlling one or more microprocessors or other control devices. Similar to components that can be implemented by software programming or software components, this embodiment can be implemented by a programming or scripting language (such as C, C++, Java, and assembly language) that includes various algorithms implemented by a combination of data structures, procedures, routines, or other programming configurations. The functional aspects can be implemented by algorithms executed by one or more processors. Additionally, for example, this embodiment can adopt related technologies of electronic environment setting, signal processing, and / or data processing. The terms "mechanism", "component", "member", and "configuration" can be widely used and are not limited to mechanical and physical components. These terms can include (for example) the meaning of a series of software routines associated with a processor.

[0103] The above embodiments are only examples, and other embodiments can be implemented within the scope of the following patent application scope of the invention.

[0104] 100: Information providing system 110: Electronic device 120: Reference server 130: Development server 201: Operation 202: Operation 203: Operation 204: Operation 205: Operation 206: Operation 207: Operation 208: Operation 209: Operation 210: Operation 220: Query receiving server 310: User input 320: Performance information / Delay 330: Performance information / Central Processing Unit (CPU) performance related information 340: Performance information / Memory performance related information 350: Performance information / System load information 360: Performance information / Available disk capacity information 370: Performance information / Information 410: Comparison information 411: Number 412: Number 413: Number 414: Number 415: Number 416: Number 420: Log information 430: Information 431: Mismatch response occurrence rate 432: Number 433: Number 434: Information transmission and reception count 510: Operation 520: Operation 530: Operation 540: Operation 610: Transceiver 620: Processor 630: Memory

Claims

1. A method for providing information in an electronic device, the method comprising: Obtain a request information set; Transmit a subset of request information corresponding to at least one part of the request information set to a reference server; The request information subset is transmitted to a development server; a first response set, including responses to the request information subset, is received from the reference server, wherein a first code causes the reference server to generate the first response set, and wherein the first code corresponds to a code used by a service server to provide services to a user; a second response set, including responses to the request information subset, is received from the development server, wherein a second code causes the development server to generate the second response set, and wherein the second code is generated by modifying the first code; performance information of the reference server related to the generation of the first response set and performance information of the development server related to the generation of the second response set are obtained; and a manager interface is provided, the interface including comparison information for comparing the performance information of the reference server and the performance information of the development server.

2. The method of request item 1, wherein the request information set is obtained based on the user information input to the service server.

3. The method of request item 1, wherein the development server has a structure corresponding to a structure of the reference server, the second code is associated with the first code, and the second code is changed based on a user input.

4. As in request item 1, wherein the provision of the interface includes: Information obtained by each of one or more application programming interfaces (APIs) associated with the processing of the subset of request information, comparing the performance information of the reference server with the performance information of the development server.

5. The method of request item 1, wherein when the request information set is obtained on a time basis, the provision of the interface includes outputting time information regarding a comparison result between the first response set and the second response set.

6. The method of claim 1, wherein the performance information of the reference server includes performance information of an application installed on the reference server, and the performance information of the application includes at least one of memory usage and a delay related to the generation of the first response set.

7. The method of claim 1, wherein the performance information of the development server includes performance information of an application installed on the development server; and the performance information of the application includes at least one of memory usage and a delay related to the generation of the second response set.

8. The method of claim 1, further comprising: When the code of the development server is determined to be normal, the code of the development server is deployed to the service server.

9. The method of claim 1, wherein the electronic device includes at least one sub-device, and the provision of the interface is performed by the at least one sub-device.

10. A non-transitory computer-readable recording medium comprising a computer program for performing one of the methods as claimed in claim 1.

11. An electronic device for providing information, the electronic device comprising: One transceiver; A memory including instructions; and a processor connected to the memory to: acquire a request information set; transmit a subset of request information corresponding to at least a portion of the request information set to a reference server; transmit the subset of request information to a development server; receive from the reference server a first response set including responses to a subset of the request information set, wherein a first code causes the reference server to generate the first response set, and wherein the first code corresponds to a code used by a service server to provide services to a user; receive from the development server a second response set including responses to a subset of the request information set, wherein a second code causes the development server to generate the second response set, and wherein the second code is generated by modifying the first code; acquire performance information of the reference server related to the generation of the first response set and performance information of the development server related to the generation of the second response set; and provide a manager interface including comparison information for comparing the performance information of the reference server and the performance information of the development server.

Citation Information

Patent Citations

  • A data processing apparatus and method for controlling performance of speculative vector operations

    TW201514850A

  • Shadow testing services

    US8001422B1

  • Shadow test replay service

    US9672137B1