System performance determination method, device, terminal and storage medium
By obtaining and comparing the performance data of the same batch of users in the first system version and the second system version, the problem of inaccurate performance determination after system upgrade is solved, and the accuracy of system performance determination is improved.
Patent Information
- Application Number
- CN202010984730.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-09-18
- Publication Date
- 2024-12-10
- Estimated Expiration
- 2040-09-18
AI Technical Summary
It is difficult for the prior art to accurately determine whether the system performance is optimized after the system is upgraded, resulting in inaccurate determination of system performance.
By acquiring the first batch of users using the first system version and the first batch of users using the second system version, determining the system performance of the second system version based on their performance data, reducing the system performance directly based on the second batch of users directly based on the second batch of users using the second system version. The user determines the system performance situation, thereby improving the accuracy of system performance determination.
It improves the accuracy of system performance determination, ensures accurate comparison of performance data before and after system upgrade, and reduces the inaccuracy of system performance determination.
Smart Images

Figure CN112181791B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of communication technology, and specifically, relates to a system performance determination method, device, terminal and storage medium. Background Art
[0002] As time goes by, users will upgrade the system. In order to make the system run more efficiently, the system can be upgraded, for example, the system parameter settings can be adjusted. With the development of science and technology, the system upgrade cycle is getting shorter and shorter. When the system is upgraded, users can upgrade the system based on the upgrade reminder information of the terminal, and can also regularly check whether there is an upgraded version of the system. If so, the system can be upgraded. Summary of the invention
[0003] The embodiment of the present application provides a system performance determination method, device, terminal and storage medium, which can improve the accuracy of system performance determination. This technical solution includes:
[0004] In a first aspect, an embodiment of the present application provides a method for determining system performance, the method comprising:
[0005] Obtain a first batch of users using a first system version and a second batch of users using a second system version, wherein the second system version is a system version after the first system version is upgraded;
[0006] Acquire the first batch of users who are in the same batch as the first batch of users and the second batch of users;
[0007] Based on the first cohort of users, system performance of the second system version is determined.
[0008] In a second aspect, an embodiment of the present application provides a system performance determination device, the device comprising:
[0009] A user acquisition unit, used to acquire a first batch of users using a first system version and a second batch of users using a second system version, wherein the second system version is a system version after the first system version is upgraded;
[0010] A user batch acquisition unit, used for acquiring first users of the first batch of users and the second batch of users;
[0011] A performance determination unit is used to determine the system performance of the second system version based on the first batch of users.
[0012] In a third aspect, an embodiment of the present application provides a system, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the methods described in the first aspect when executing the computer program.
[0013] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, which implements any of the methods described above when executed by a processor.
[0014] In a fifth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps described in the first aspect of the embodiment of the present application. The computer program product may be a software installation package.
[0015] An embodiment of the present application provides a method for determining system performance. By acquiring a first batch of users using a first system version and a second batch of users using a second system version, the system performance of the second system version can be determined based on the first batch of users and the first batch of users of the second batch of users. Therefore, the system performance of the first batch of users in the first system version and the first batch of users in the second system version can be compared to determine the system performance of the second system version, thereby reducing the situation where the system performance of the second system version is directly determined based on the second batch of users, thereby improving the accuracy of obtaining and determining system performance data, and further improving the accuracy of determining system performance. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0017] Figure 1 A schematic diagram showing an application scenario of a method or device for determining system performance applied to an embodiment of the present application;
[0018] Figure 2 A schematic diagram showing a flow chart of a method for determining system performance according to an embodiment of the present application;
[0019] Figure 3 An example schematic diagram showing a terminal interface according to an embodiment of the present application;
[0020] Figure 4 A schematic diagram showing a flow chart of a method for determining system performance according to an embodiment of the present application;
[0021] Figure 5 A schematic diagram showing a flow chart of a method for determining system performance according to an embodiment of the present application;
[0022] Figure 6A schematic diagram showing a flow chart of a user acquisition method according to an embodiment of the present application;
[0023] Figure 7 A schematic diagram showing a flow chart of a method for determining system performance according to an embodiment of the present application;
[0024] Figure 8 A schematic diagram showing a flow chart of a method for determining system performance according to an embodiment of the present application;
[0025] Fig. 9 A schematic diagram showing a flow chart of a method for determining system performance according to an embodiment of the present application;
[0026] Fig.10 A schematic diagram showing the upgrade time points of the system version of an embodiment of the present application;
[0027] Fig.11 A schematic diagram showing the structure of a system performance determination device according to an embodiment of the present application;
[0028] Fig.12 A schematic diagram showing the structure of a terminal according to an embodiment of the present application is shown. DETAILED DESCRIPTION
[0029] In order to enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of them. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0030] With the development of science and technology, the upgrade of terminal systems aims to improve the user experience. When the terminal system is upgraded, the data of the upgraded system version can be obtained to determine the performance of the upgraded system. For example, the Exception Analysis Platform (EAP) can perform application exception analysis on the terminals that have been used.
[0031] According to some embodiments, Figure 1 A schematic diagram of an application scenario of a system performance determination method or a system performance determination device applied to an embodiment of the present application is shown. Figure 1As shown, in order to make the system run more efficiently, the system can be upgraded, but it is impossible to determine whether the upgraded system is an optimization operation of the previous system version. Therefore, when determining the system performance, the system performance determination device can obtain the performance data of the current system version of all user terminals of a model through the server, and based on the performance data, the system performance of the current system version can be determined. However, determining the system performance based on only one system version can only determine the system performance of the system version, and cannot determine whether the system performance of the current system version is optimized or deteriorated when upgrading from the previous system version to the current system version. Therefore, determining the system performance based only on the current system version is inaccurate.
[0032] It is easy to understand that the users using the terminal include light-load users and heavy-load users. Light-load users refer to users who use the terminal less frequently or use smaller applications, and heavy-load users refer to users who use the terminal frequently or use applications with high power consumption. For the battery life in system performance, the battery life of light-load users is longer, and the battery life of heavy-load users is shorter. When determining the battery life of the current version, all users of the current system version can be obtained first, and the battery life of each user can be obtained. When the battery life of each user is obtained, the sum of the battery life of all users of the current system version can be obtained. Based on the number of all users of the current system version, the average battery life of all users of the current system version can be calculated, and based on the average battery life, the system performance of the current system version can be determined. However, only based on the average battery life of all users of the current system version, it is impossible to determine the change of the battery life before and after the system upgrade, so that the determination of the system performance is inaccurate. A method for determining system performance in an embodiment of the present application can improve the accuracy of determining system performance.
[0033] The following will be combined with the attached Figure 2 -Attached Fig.10 , the system performance determination method provided by the embodiment of the present application is described in detail. The execution subject of the embodiment of the present application includes but is not limited to a terminal, a server or a system performance determination device. Figure 2 -Attached Fig.10 The execution subject of the illustrated embodiment may be, for example, a system performance determination device.
[0034] See also Figure 2 , which is a flow chart of a method for determining system performance according to an embodiment of the present application. Figure 2 As shown, the method in the embodiment of the present application may include the following steps S101 to S103.
[0035] S101, obtaining a first batch of users using a first system version and a second batch of users using a second system version, wherein the second system version is a system version after the first system version is upgraded.
[0036] According to some embodiments, the first system version refers to a certain system version in the system version, and does not specifically refer to a certain fixed version, but the first system version does not refer to the last system version in the system version. For example, when the system version includes version A, version S, version D, version F, and version G, the first system version may be version A, for example, and the first system version may also be version F, for example.
[0037] It is easy to understand that the second system version refers to a certain system version in the system version, and does not specifically refer to a fixed version, but the second system version does not refer to the first system version in the system version, and the second system version is the system version after the first system version is upgraded. For example, when the system version includes version A, version S, version D, version F, and version G, the second system version can be, for example, version S, and the first system version can also be, for example, version G.
[0038] Optionally, the first batch of users refers to users using the first system version, and does not specifically refer to a certain group of fixed users. For example, when the first system version changes, the first batch of users will also change accordingly. The second batch of users refers to users using the second system version, and does not specifically refer to a certain group of fixed users. For example, when the second system version changes, the second batch of users will also change accordingly. The first batch of users includes at least one user, and the second batch of users includes at least one user.
[0039] According to some embodiments, when all of the first batch of users using the first system version upgrade the system version to the second system version, and the second system version has no incremental users, the first batch of users may be the same as the second batch of users. When not all of the first batch of users using the first system version upgrade the system version to the second system version, and the second system version has no incremental users, the second batch of users may be some of the first batch of users. When not all of the first batch of users using the first system version upgrade the system version to the second system version, and the second system version has incremental users, the second batch of users may include users that are not in the first batch of users, that is, the second batch of users includes incremental users and some of the first batch of users.
[0040] According to some embodiments, before the system performance determination device obtains the first batch of users using the first system version and the second batch of users using the second system version, the system performance determination device may, for example, receive a system performance determination instruction, which includes but is not limited to a voice determination instruction, a text determination instruction, a click determination instruction, and the like. When the system performance determination device receives the system performance determination instruction, the system performance determination device may obtain the first batch of users using the first system version and the second batch of users using the second system version. The first batch of users obtained by the system performance determination device may, for example, be a1 user, a2 user, a3 user, a4 user, a5 user, a6 user, a7 user, a8 user, a9 user, a10 user, a11 user, a12 user, a13 user, a14 user, a15 user, a16 user, a17 user, a18 user, a19 user, and a20 user. The second batch of users acquired by the system performance determination device may be, for example, user a21, user a22, user a23, user a24, user a25, user a26, user a27, user a28, user a29, user a10, user a11, user a12, user a13, user a14, user a15, user a16, user a17, user a18, user a19, and user a20.
[0041] It is easy to understand that the system performance determination device can obtain the first batch of users using the first system version and the second batch of users using the second system version when detecting a system upgrade, that is, the system is upgraded from a first system version to a second system version.
[0042] S102, obtaining the first batch of users and the first batch of users in the same batch.
[0043] According to some embodiments, the first batch of users refers to users who have used both the first system version and the second system version. The first batch of users does not specifically refer to a certain group of fixed users. For example, when the first system version or the second system version changes, the first batch of users will also change accordingly.
[0044] It is easy to understand that when the system performance determination device obtains the first batch of users using the first system version and the second batch of users using the second system version, the system performance determination device can obtain the first batch of users of the first and second batches of users based on the first and second batches of users. For example, the first batch of users obtained by the system performance determination device can be user a1, user a2, user a3, user a4, user a5, user a6, user a7, user a8, user a9, user a10, user a11, user a12, user a13, user a14, user a15, user a16, user a17, user a18, user a19, user a20. The second batch of users acquired by the system performance determination device may be, for example, user a21, user a22, user a23, user a24, user a25, user a26, user a27, user a28, user a29, user a10, user a11, user a12, user a13, user a14, user a15, user a16, user a17, user a18, user a19, user a20. The first batch of users and the first batch of users acquired by the system performance determination device may be, for example, user a10, user a11, user a12, user a13, user a14, user a15, user a16, user a17, user a18, user a19, user a20.
[0045] S103: Determine the system performance of the second system version based on the first batch of users.
[0046] According to some embodiments, when the system performance determination device obtains the first batch of users and the first batch of users, the system performance determination device can obtain the system performance data of the first batch of users under the first system version and the system performance data of the first batch of users under the second system version. Based on the system performance data, the system performance determination device can determine the system performance of the second system version. The system performance includes but is not limited to the battery life, system failure frequency, system self-start times, etc.
[0047] It is easy to understand that the first batch of users acquired by the system performance determination device may be, for example, user a10, user a11, user a12, user a13, user a14, user a15, user a16, user a17, user a18, user a19, and user a20. The system performance determination device may obtain the average system failure frequency of the first batch of users under the first system version and the average system failure frequency of the first batch of users under the second system version. Based on the average system failure frequency, the system performance determination device may determine the system performance of the second system version. The average system failure frequency of the first batch of users under the first system version acquired by the system performance determination device may be, for example, 1 time / week and the average system failure frequency of the first batch of users under the second system version may be 1 time / month. Therefore, the system performance determination device may determine that the system performance of the second system version has been optimized.
[0048] Optionally, when the system performance determination device determines that the system performance of the second system version is better than the system performance of the first system version, the system performance determination device can send a prompt message to the second group of users, so that the second group of users can clearly know the system performance status of the current system version. At this time, the example interface diagram of the terminal of the second system user can be as follows: Figure 3 shown.
[0049] An embodiment of the present application provides a method for determining system performance. The system performance of the second system version can be determined based on the first batch of users using the first system version and the first batch of users using the second system version. The system performance of the second system version can be determined based on the performance data of the first batch of users before and after the system version upgrade. That is, the system performance of the first batch of users in the first system version and the system performance of the first batch of users in the second system version can be compared to determine the system performance of the second system version. This reduces the situation where the system performance of the second system version is directly determined based on the second batch of users, reduces the inaccuracy of system performance determination, improves the accuracy of obtaining and determining system performance data, and further improves the accuracy of system performance determination.
[0050] See also Figure 4 , which is a flow chart of a method for determining system performance according to an embodiment of the present application. Figure 4 As shown, the method of the embodiment of the present application may include the following steps S201-S204.
[0051] S201, obtaining a first batch of users using a first system version and a second batch of users using a second system version, wherein the second system version is an upgraded version of the first system version.
[0052] The specific process is as described above and will not be repeated here.
[0053] According to some embodiments, see Figure 5 , which is a flow chart of a method for determining system performance according to an embodiment of the present application. Figure 5 As shown, the method of the embodiment of the present application may include the following steps S301-S302 when obtaining the second batch of users using the second system version. S301, upgrading the first system version of the system to obtain the second system version of the system; S302, when the number of changes in users using the second system version within a preset time period is less than a preset change number threshold, obtaining the second batch of users using the second system version.
[0054] It is easy to understand that when the system performance determination device determines that the current system version is the first system version, the system performance determination device can obtain the first batch of users of the first system version within the first preset time length. Within the first preset time length, the number of changes in the first batch of users is less than the preset change number threshold. When the system performance determination device detects that the user sends an upgrade instruction for the current system version, the system performance determination device can upgrade the current system version to obtain the second system version, that is, the system performance determination device can upgrade the first system version of the system to obtain the second system version of the system. When the system performance determination device can upgrade the current system version, the current system version can be upgraded using Over the air (OTA) technology. The system performance determination device can obtain a second batch of users of the second system version within a second preset time length based on the second system version.
[0055] Optionally, when acquiring the second batch of users, the system performance determination device may detect whether the number of changes in users using the second system version within a preset time period is less than a preset change number threshold. When the number of changes in users using the second system version within a preset time period is less than a preset change number threshold, the system performance determination device may acquire the second batch of users using the second system version. For example, when the system performance determination device detects that the number of changes in users using the second system version within one day is less than a preset change number threshold, the system performance determination device may acquire the second batch of users. For example, when it is detected that the number of changes in users using the second system version within three consecutive days is less than a preset change number threshold, the system performance determination device may acquire the second batch of users. The system performance determination device detects the number of changes in users using the second system version, and may acquire the second batch of users when the number of changes in users using the second system version is small, thereby improving the accuracy of acquiring the same batch of users.
[0056] According to some embodiments, Figure 6 A schematic diagram showing the flow of the user acquisition method of an embodiment of the present application is shown. Figure 6As shown, the first preset duration determined by the system performance determination device may be, for example, 2019.04.19-2019.04.26, the second preset duration may be, for example, 2019.05.04-2019.05.06, and the third preset duration may be, for example, 2019.04.27-2019.05.03. The system performance determination device may obtain the first batch of users within 2019.04.19-2019.04.26 and the second batch of users within 2019.05.04-2019.05.06.
[0057] S202: Determine the first batch of users of the system based on the first batch of users and the second batch of users.
[0058] The specific process is as described above and will not be repeated here.
[0059] According to some embodiments, see Figure 7 , which is a flow chart of a method for determining system performance according to an embodiment of the present application. Figure 7 As shown, the method of the embodiment of the present application is based on the first batch of users and the second batch of users, and determining the first batch of users of the system can include the following steps S401-S403. S401, obtaining the first terminal identification numbers corresponding to the first batch of users and the second terminal identification numbers corresponding to the second batch of users; S402, obtaining the terminal identification number intersection of the first terminal identification number and the second terminal identification number; S403, determining the user corresponding to at least one terminal identification number in the terminal identification number intersection as the first batch of users.
[0060] It is easy to understand that the terminal identification number (International Mobile Equipment Identity, IMEI) is the abbreviation of the International Mobile Equipment Identity Code, which is the international mobile equipment identification code. The terminal identification number can be an "electronic serial number" consisting of 15 digits. The terminal identification number corresponds to the terminal one by one, that is, one terminal corresponds to one terminal identification number, and the terminal identification number is unique.
[0061] Optionally, when the system performance determination device determines the first batch of users of the system based on the first batch of users and the second batch of users, the system performance determination device may obtain the first terminal identification numbers corresponding to the first batch of users and the second terminal identification numbers corresponding to the second batch of users. When the system performance determination device obtains the first terminal identification numbers corresponding to the first batch of users and the second terminal identification numbers corresponding to the second batch of users, the system performance determination device may use an intersection algorithm to obtain the terminal identification number intersection of the first terminal identification number and the second terminal identification number. The system performance determination device may determine the user corresponding to at least one terminal identification number in the terminal identification number intersection as the first batch of users.
[0062] According to some embodiments, at least one terminal identification number in the intersection of the terminal identification numbers is 254655125421546, 512468924445518, 512468924445519, and 512468924445517. The system performance determination device may determine the Q1 user corresponding to 254655125421546, the Q2 user corresponding to 512468924445518, the Q3 user corresponding to 512468924445519, and the Q4 user corresponding to 512468924445517 as the first batch of users.
[0063] According to some embodiments, see Figure 8 , which is a flow chart of a method for determining system performance according to an embodiment of the present application. Figure 8 As shown, the method of the embodiment of the present application is based on the first batch of users and the second batch of users, and determining the first batch of users of the system can include the following steps S501-S502. S501, obtaining the first upgrade time point of the first system version and the second upgrade time point of the second system version; S502, when the time interval between the first upgrade time point and the second upgrade time point is less than the preset time interval, determining the first batch of users of the system based on the first batch of users and the second batch of users.
[0064] It is easy to understand that due to the time limit for storing data on the server, when the system performance determination device determines the first batch of users of the system based on the first batch of users and the second batch of users, the system performance determination device can obtain the first upgrade time point of the first system version and the second upgrade time point of the second system version. When the system performance determination device obtains the first upgrade time point of the first system version and the second upgrade time point of the second system version, the system performance determination device can detect whether the time interval between the first upgrade time point and the second upgrade time point is less than the preset time interval. The preset time interval is less than or equal to the time for storing data on the server. When the system performance determination device determines that the time interval between the first upgrade time point and the second upgrade time point is less than the preset time interval, the system performance determination device can determine the first batch of users of the system based on the first batch of users and the second batch of users, which can improve the accuracy of obtaining the first batch of users, and thus improve the accuracy of system performance determination.
[0065] Optionally, the preset time interval may be, for example, 50 days, and the first upgrade time point of the first system version acquired by the system performance determination device may be, for example, 2020.01.02 and the second upgrade time point of the second system version may be, for example, 2020.02.05. When the system performance determination device determines that the time interval of 33 days between the first upgrade time point 2020.01.02 and the second upgrade time point 2020.02.05 is less than the preset time interval of 50 days, the system performance determination device may determine the first batch of users of the system based on the first batch of users and the second batch of users.
[0066] According to some embodiments, see Fig. 9 , which is a flow chart of a method for determining system performance according to an embodiment of the present application. Fig. 9 As shown, the method of the embodiment of the present application may also include the following steps S601-S606. S601, obtain the first upgrade time point of the first system version and the second upgrade time point of the second system version; S602, when the time interval between the first upgrade time point and the second upgrade time point is greater than the preset time interval, obtain the third batch of users of the third system version, wherein the third system version is a system version after the first system version and before the second system version, and the time interval between the third upgrade time point and the second upgrade time point of the third system version is less than the preset time interval; S603, detect whether the third batch of users has incremental users; S604, when it is detected that the third batch of users has no incremental users, determine the second batch of users of the system based on the second batch of users and the third batch of users; S605, when it is detected that the third batch of users has incremental users, determine the incremental users as the second batch of users; S606, based on the second batch of users, determine the system performance of the second system version.
[0067] It is easy to understand that when the system performance determination device obtains the first upgrade time point of the first system version and the second upgrade time point of the second system version, the system performance determination device can detect whether the time interval between the first upgrade time point and the second upgrade time point is less than the preset time interval. When the system performance determination device determines that the time interval between the first upgrade time point and the second upgrade time point is greater than the preset time interval, the system performance determination device can obtain the third batch of users of the third system version. Among them, the third upgrade time point and the second upgrade time point of the third system version are less than the preset time interval. The third system version is a system version after the first system version and before the second system version. For example, the third system version can be the system version after the first system version is upgraded, and the second system version can be the system version after the third system version is upgraded. For example, the system version after the first system version is upgraded can also be the fourth system version, the third system version can be the system version after the fourth system version is upgraded, and the second system version can be the system version after the third system version is upgraded.
[0068] Optionally, when the system performance determination device obtains the third batch of users of the third system version, the system performance determination device can detect whether there are incremental users in the third batch of users. When the system performance determination device detects that there are no incremental users in the third batch of users, the second batch of users of the system is determined based on the second batch of users and the third batch of users. When the system performance determination device detects that there are incremental users in the third batch of users, the incremental users are determined as the second batch of users. The system performance determination device can determine the system performance of the second system version based on the second batch of users. The system performance determination device can determine the system performance of the second system version based on the third batch of users and the second batch of users, thereby reducing the inaccuracy of determining the system performance of the second system version directly based on the second batch of users, and improving the accuracy of the system performance determination.
[0069] Optionally, the preset time interval may be, for example, 50 days. Fig.10 A schematic diagram showing the upgrade time point of the system version of an embodiment of the present application. Fig.10 As shown, the first upgrade time point of the first system version acquired by the system performance determination device may be, for example, 2020.01.02, the second upgrade time point of the second system version may be, for example, 2020.04.05, and the third upgrade time point of the third system version may be, for example, 2020.02.28. When the system performance determination device determines that the time interval between the first upgrade time point 2020.01.02 and the second upgrade time point 2020.04.05 is greater than the preset time interval of 50 days, the system performance determination device may acquire the third batch of users.
[0070] According to some embodiments, when the system performance determination device detects that there are no incremental users in the third batch of users, the third batch of users may be part or all of the users in the first batch of users. The system performance determination device may determine the second batch of users of the system based on the second batch of users and the third batch of users. When the system performance determination device detects that there are incremental users in the third batch of users, the third batch of users may be, for example, all users and incremental users in the first batch of users. The system performance determination device may determine the second batch of users of the system based on the second batch of users and the third batch of users, that is, the system performance determination device may determine the second batch of users of the system based on the second batch of users, the first batch of users, and the incremental users.
[0071] S203, obtaining a first battery life corresponding to the first batch of users in the first system version and a second battery life corresponding to the first batch of users in the second system version.
[0072] According to some embodiments, when the system performance determination device determines the first batch of users of the system based on the first batch of users and the second batch of users, the system performance determination device can obtain the first battery life corresponding to the first batch of users in the first system version and the second battery life corresponding to the first batch of users in the second system version.
[0073] It is easy to understand that the first batch of users can be, for example, W1 users, W2 users, W3 users, W4 users, W5 users, W6 users, W7 users, and W8 users. The first battery life corresponding to the first batch of users in the first system version obtained by the system performance determination device can be, for example, 5.3 hours, 5.2 hours, 5.0 hours, 5.9 hours, 5.2 hours, 5.4 hours, 5.6 hours, and 5.1 hours, respectively. The second battery life corresponding to the first batch of users in the second system version obtained by the system performance determination device can be, for example, 6.3 hours, 6.2 hours, 6.0 hours, 6.9 hours, 6.2 hours, 6.4 hours, 6.6 hours, and 6.1 hours, respectively.
[0074] S204: Determine the system performance of the second system version based on the first battery life and the second battery life.
[0075] According to some embodiments, when the system performance determination device obtains the first battery life and the second battery life, the system performance determination device can determine the system performance of the second system version based on the first battery life and the second battery life, that is, the system performance determination device can determine the battery life capability of the second system version.
[0076] It is easy to understand that the first battery life corresponding to the first batch of users in the first system version obtained by the system performance determination device can be, for example, 5.3 hours, 5.2 hours, 5.0 hours, 5.9 hours, 5.2 hours, 5.4 hours, 5.6 hours and 5.1 hours respectively. The second battery life corresponding to the first batch of users in the second system version obtained by the system performance determination device can be, for example, 6.3 hours, 6.2 hours, 6.0 hours, 6.9 hours, 6.2 hours, 6.4 hours, 6.6 hours and 6.1 hours respectively. The system performance determination device can use a mean algorithm to obtain the first average battery life corresponding to the first batch of users and the second average battery life corresponding to the second batch of users. When the system performance determination device determines that the second average battery life is greater than the first average battery life, the system performance determination device can determine that the system performance of the second system version is good.
[0077] Optionally, after the system performance determination device determines the system performance of the second system version, a corresponding level may be set for the system performance of the second system version. For example, when the system performance determination device determines that the system performance of the second system version is better than the system performance of the first system version, the performance level of the system performance of the first system version may be set to level D, and the performance level of the system performance of the second system version may be set to level C.
[0078] The embodiment of the present application provides a method for determining system performance. By acquiring the first batch of users using the first system version and the first batch of users using the second system version, the system performance of the second system version can be determined based on the first battery life corresponding to the first batch of users in the first system version and the second battery life corresponding to the first batch of users in the second system version, thereby reducing the inaccuracy of directly determining the system performance of the second system version based on the second battery life of the second batch of users, and improving the accuracy of determining the system battery life. In addition, since the terminal identification number is unique, acquiring the first batch of users based on the terminal identification number can improve the accuracy of acquiring the first batch of users, thereby improving the accuracy of determining the system performance.
[0079] The following will be combined with the attached Fig.11 , the system performance determination device provided in the embodiment of the present application is introduced in detail. It should be noted that the attached Fig.11 The system performance determination device shown is used to execute the present application Figure 2-Figure 10 For the convenience of explanation, only the part related to the embodiment of the present application is shown. For the specific technical details not disclosed, please refer to the present application. Figure 2-Figure 10 The embodiment shown.
[0080] See also Fig.11 , which shows a schematic diagram of the structure of the system performance determination device of an embodiment of the present application. The system performance determination device 1100 can be implemented as all or part of the user terminal through software, hardware or a combination of both. According to some embodiments, the system performance determination device 1100 includes a user acquisition unit 1101, a same batch user acquisition unit 1102 and a performance determination unit 1103, which are specifically used to:
[0081] The user acquisition unit 1101 is used to acquire a first batch of users using a first system version and a second batch of users using a second system version, wherein the second system version is a system version after the first system version is upgraded;
[0082] A same batch user acquisition unit 1102, used for acquiring first batch users and first batch users of the second batch of users;
[0083] The performance determination unit 1103 is used to determine the system performance of the second system version based on the first batch of users.
[0084] According to some embodiments, the performance determination unit 1103 is configured to determine the system performance of the second system version based on the first batch of users, specifically to:
[0085] Get the first battery life corresponding to the first batch of users in the first system version and the second battery life corresponding to the first batch of users in the second system version;
[0086] Based on the first battery life and the second battery life, system performance of the second system version is determined.
[0087] According to some embodiments, the same batch user acquisition unit 1102 is used to determine the first same batch users of the system based on the first batch users and the second batch users, specifically to:
[0088] Obtain first terminal identification numbers corresponding to the first batch of users and second terminal identification numbers corresponding to the second batch of users;
[0089] Obtain a terminal identification number intersection of the first terminal identification number and the second terminal identification number;
[0090] A user corresponding to at least one terminal identification number in the intersection of the terminal identification numbers is determined as the first same batch of users.
[0091] According to some embodiments, the user acquisition unit 1101 is used to acquire the second batch of users using the second system version, specifically to:
[0092] Upgrading the first system version of the system to obtain the second system version of the system;
[0093] When the number of changes in users using the second system version within the preset time period is less than a preset change number threshold, a second batch of users using the second system version is obtained.
[0094] According to some embodiments, the same batch user acquisition unit 1102 is used to determine the first same batch users of the system based on the first batch users and the second batch users, specifically to:
[0095] Obtain a first upgrade time point of the first system version and a second upgrade time point of the second system version;
[0096] When the time interval between the first upgrade time point and the second upgrade time point is less than the preset time interval, first same-batch users of the system are determined based on the first batch of users and the second batch of users.
[0097] According to some embodiments, the same batch user acquisition unit 1102 is used to acquire the first upgrade time of the first system version and the second upgrade time of the second system version, and is further specifically used to:
[0098] When the time interval between the first upgrade time point and the second upgrade time point is greater than the preset time interval, obtaining a third batch of users of the third system version, wherein the third system version is a system version after the first system version and before the second system version, and the time interval between the third upgrade time point and the second upgrade time point of the third system version is less than the preset time interval;
[0099] When it is detected that there are no incremental users in the third batch of users, determining the second batch of users of the system based on the second batch of users and the third batch of users;
[0100] The performance determination unit 1103 is used to determine the system performance of the second system version, specifically to:
[0101] Based on the second cohort of users, system performance of the second system version is determined.
[0102] According to some embodiments, the same batch user acquisition unit 1102 is used to acquire the third batch of users of the third system version when the time interval between the first upgrade time point and the second upgrade time point is greater than the preset time interval, and is further specifically used to:
[0103] When it is detected that there are incremental users in the third batch of users, the second batch of users is determined based on the first batch of users, the incremental users and the second batch of users.
[0104] An embodiment of the present application provides a system performance determination device, wherein a user acquisition unit acquires a first batch of users using a first system version and a second batch of users using a second system version, wherein the second system version is a system version after the first system version is upgraded, and a same-batch user acquisition unit acquires a first same-batch user of the first batch of users and the second batch of users, and a performance determination unit determines the system performance of the second system version based on the first same-batch users. Therefore, the system performance of the second system version can be determined based on the performance data of the first same-batch users before and after the system version upgrade, thereby reducing the situation in which the system performance of the second system version is directly determined based on the second batch of users, reducing the inaccuracy of system performance determination, and improving the accuracy of obtaining and determining system performance data, thereby improving the accuracy of system performance determination.
[0105] See also Fig.12 , is a schematic diagram of the structure of a terminal provided in an embodiment of the present application. Fig.12 As shown, the terminal 1200 may include: at least one processor 1201 , at least one network interface 1204 , a user interface 1203 , a memory 1205 , and at least one communication bus 1202 .
[0106] The communication bus 1202 is used to realize the connection and communication between these components.
[0107] The user interface 1203 may include a display screen (Display) and a GPS, and the optional user interface 1203 may also include a standard wired interface and a wireless interface.
[0108] The network interface 1204 may optionally include a standard wired interface or a wireless interface (such as a WI-FI interface).
[0109] Among them, the processor 1201 may include one or more processing cores. The processor 1201 uses various interfaces and lines to connect various parts in the entire terminal 1200, and executes various functions and processes data of the terminal 1200 by running or executing instructions, programs, code sets or instruction sets stored in the memory 1205, and calling data stored in the memory 1205. Optionally, the processor 1201 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 1201 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed on the display screen; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 1201, and it can be implemented separately through a chip.
[0110] Among them, the memory 1205 may include a random access memory (Random Access Memory, RAM) and may also include a read-only memory (Read-Only Memory). Optionally, the memory 1205 includes a non-transitory computer-readable storage medium. The memory 1205 can be used to store instructions, programs, codes, code sets or instruction sets. The memory 1205 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc.; the data storage area may store data involved in the above-mentioned various method embodiments, etc. The memory 1205 may also be optionally at least one storage device located away from the aforementioned processor 1201. As Fig.12 As shown, the memory 1205 as a computer storage medium may include an operating system, a network communication module, a user interface module, and an application program for determining system performance.
[0111] exist Fig.12 In the terminal 1200 shown, the user interface 1203 is mainly used to provide an input interface for the user and obtain data input by the user; and the processor 1201 can be used to call the application program determined by the system performance stored in the memory 1205, and specifically perform the following operations:
[0112] Obtain a first batch of users using a first system version and a second batch of users using a second system version, wherein the second system version is a system version after the first system version is upgraded;
[0113] Get the first batch of users and the first batch of users in the same batch;
[0114] Based on the first cohort of users, system performance of the second system version is determined.
[0115] According to some embodiments, when the processor 1201 is used to determine the system performance of the second system version based on the first batch of users, it is specifically used to perform the following steps:
[0116] Get the first battery life corresponding to the first batch of users in the first system version and the second battery life corresponding to the first batch of users in the second system version;
[0117] Based on the first battery life and the second battery life, system performance of the second system version is determined.
[0118] According to some embodiments, when the processor 1201 is used to determine the first batch of users of the system based on the first batch of users and the second batch of users, it is specifically used to perform the following steps:
[0119] Obtain first terminal identification numbers corresponding to the first batch of users and second terminal identification numbers corresponding to the second batch of users;
[0120] Obtain a terminal identification number intersection of the first terminal identification number and the second terminal identification number;
[0121] A user corresponding to at least one terminal identification number in the intersection of the terminal identification numbers is determined as the first same batch of users.
[0122] According to some embodiments, when the processor 1201 is used to execute acquiring a second batch of users using the second system version, it is specifically used to execute the following steps:
[0123] Upgrading the first system version of the system to obtain the second system version of the system;
[0124] When the number of changes in users using the second system version within the preset time period is less than a preset change number threshold, a second batch of users using the second system version is obtained.
[0125] According to some embodiments, when the processor 1201 is used to determine the first batch of users of the system based on the first batch of users and the second batch of users, it is specifically used to perform the following steps:
[0126] Obtain a first upgrade time point of the first system version and a second upgrade time point of the second system version;
[0127] When the time interval between the first upgrade time point and the second upgrade time point is less than the preset time interval, first same-batch users of the system are determined based on the first batch of users and the second batch of users.
[0128] According to some embodiments, after the processor 1201 is used to obtain the first upgrade time of the first system version and the second upgrade time of the second system version, it is further specifically used to perform the following steps:
[0129] When the time interval between the first upgrade time point and the second upgrade time point is greater than the preset time interval, obtaining a third batch of users of the third system version, wherein the third system version is a system version after the first system version and before the second system version, and the time interval between the third upgrade time point and the second upgrade time point of the third system version is less than the preset time interval;
[0130] When it is detected that there are no incremental users in the third batch of users, determining the second batch of users of the system based on the second batch of users and the third batch of users;
[0131] The processor 1201 is used to determine the system performance of the second system version, and is specifically used to perform the following steps:
[0132] Based on the second cohort of users, system performance of the second system version is determined.
[0133] According to some embodiments, the processor 1201 is used to execute, when the time interval between the first upgrade time point and the second upgrade time point is greater than the preset time interval, after obtaining the third batch of users of the third system version, specifically to execute the following steps:
[0134] When it is detected that there are incremental users in the third batch of users, the second batch of users is determined based on the first batch of users, the incremental users and the second batch of users.
[0135] An embodiment of the present application provides a terminal, which can determine the system performance of a second system version based on a first batch of users using a first system version and a first batch of users using a second system version, and can determine the system performance of the second system version based on the performance data of the first batch of users before and after the system version upgrade, thereby reducing the situation where the system performance of the second system version is directly determined based on the second batch of users, reducing the inaccuracy of determining the system performance, and can improve the accuracy of obtaining and determining the system performance data, thereby improving the accuracy of determining the system performance.
[0136] The present application also provides a computer-readable storage medium on which a computer program is stored, and when the program is executed by a processor, the steps of the above method are implemented. The computer-readable storage medium may include, but is not limited to, any type of disk, including a floppy disk, an optical disk, a DVD, a CD-ROM, a micro drive, and a magneto-optical disk, a ROM, a RAM, an EPROM, an EEPROM, a DRAM, a VRAM, a flash memory device, a magnetic card or an optical card, a nanosystem (including a molecular memory IC), or any type of medium or device suitable for storing instructions and / or data.
[0137] An embodiment of the present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any system performance determination method recorded in the above method embodiments.
[0138] Those skilled in the art can clearly understand that the technical solution of the present application can be implemented with the help of software and / or hardware. The "unit" and "module" in this specification refer to software and / or hardware that can independently complete or cooperate with other components to complete specific functions, where the hardware can be, for example, a field programmable gate array (FPGA), an integrated circuit (IC), etc.
[0139] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.
[0140] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0141] In the several embodiments provided in the present application, it should be understood that the disclosed devices can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some service interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.
[0142] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0143] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0144] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory, including a number of instructions to enable a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned memory includes: U disk, read-only memory (ROM), random access memory (RAM), mobile hard disk, disk or optical disk and other media that can store program code.
[0145] A person skilled in the art may understand that all or part of the steps in the various methods of the above embodiments may be completed by entering a program to instruct the relevant hardware. The program may be stored in a computer-readable memory, and the memory may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0146] The above is only an exemplary embodiment of the present disclosure, and the scope of the present disclosure cannot be limited thereto. That is, any equivalent changes and modifications made according to the teachings of the present disclosure are still within the scope of the present disclosure. After considering the specification and practicing the disclosure here, those skilled in the art will easily think of other embodiments of the present disclosure. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary technical means in the technical field not recorded in the present disclosure. The description and examples are only regarded as exemplary, and the scope and spirit of the present disclosure are defined by the claims.
Claims
1. A method for determining system performance, characterized in that: The method comprises: Obtain a first batch of users using a first system version and a second batch of users using a second system version, wherein the second system version is a system version after the first system version is upgraded; Obtain a first upgrade time point of the first system version and a second upgrade time point of the second system version; When the time interval between the first upgrade time point and the second upgrade time point is less than a preset time interval, determining first same-batch users of the system based on the first batch of users and the second batch of users, and the preset time interval is less than or equal to the time for storing data; Based on the first cohort of users, system performance of the second system version is determined.
2. The method according to claim 1, characterized in that The determining the system performance of the second system version based on the first same batch of users includes: Obtain a first battery life corresponding to the first batch of users in the first system version and a second battery life corresponding to the first batch of users in the second system version; Based on the first battery life and the second battery life, determine the system performance of the second system version.
3. The method according to claim 1, characterized in that The determining of first batch of users of the system based on the first batch of users and the second batch of users includes: Obtaining first terminal identification numbers corresponding to the first batch of users and second terminal identification numbers corresponding to the second batch of users; Obtaining a terminal identification number intersection of the first terminal identification number and the second terminal identification number; A user corresponding to at least one terminal identification number in the intersection of the terminal identification numbers is determined as the first same batch of users.
4. The method according to claim 1, characterized in that: The step of obtaining a second group of users using the second system version includes: Upgrading the first system version of the system to obtain the second system version of the system; When the number of changes in users using the second system version within a preset time period is less than a preset change number threshold, the second batch of users using the second system version is obtained.
5. The method according to claim 1, characterized in that After obtaining the first upgrade time point of the first system version and the second upgrade time point of the second system version, the method further includes: When the time interval between the first upgrade time point and the second upgrade time point is greater than a preset time interval, obtaining a third batch of users of a third system version, wherein the third system version is a system version after the first system version and before the second system version, and the time interval between a third upgrade time point of the third system version and the second upgrade time point is less than the preset time interval; When it is detected that the third batch of users has no incremental users, determining a second batch of users of the system based on the second batch of users and the third batch of users; The determining of the system performance of the second system version includes: Based on the second batch of users, system performance of the second system version is determined.
6. The method according to claim 5, characterized in that After acquiring the third batch of users of the third system version when the time interval between the first upgrade time point and the second upgrade time point is greater than a preset time interval, the method further includes: When it is detected that the third batch of users has the incremental user, the second batch of users is determined based on the first batch of users, the incremental user and the second batch of users.
7. A system performance determination device, characterized in that: The device comprises: A user acquisition unit, used to acquire a first batch of users using a first system version and a second batch of users using a second system version, wherein the second system version is a system version after the first system version is upgraded; a same-batch user acquisition unit, configured to acquire a first upgrade time point of the first system version and a second upgrade time point of the second system version; and determine first same-batch users of the system based on the first batch of users and the second batch of users when the time interval between the first upgrade time point and the second upgrade time point is less than a preset time interval, and the preset time interval is less than or equal to a time for storing data; A performance determination unit is used to determine the system performance of the second system version based on the first batch of users.
8. A terminal comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When a processor executes the computer program, the method according to any one of claims 1 to 6 is implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.
Citation Information
Patent Citations
Methods and Systems for Testing Versions of Applications
US20180121322A1
