Control experiment management method, device, equipment and medium

Abstract

The invention provides a control experiment management method and device, equipment and a medium, and the method comprises the steps: creating a control experiment, and determining an experiment period and a management mode of the control experiment, the management mode comprising that the experiment is out of line after expiration; and if it is monitored that the experiment deadline expires and the management mode is that the experiment expires and is not offline, continuing to keep the experiment until an experiment completion instruction is received. By adopting the dynamic period management, on one hand, the flexibility and the stability of experiment management are improved; on the other hand, elastic management of the experiment life cycle is achieved, the problem that the experiment is automatically offline due to the end of the validity period is solved, data inaccuracy and data loss caused by experiment interruption are avoided, experiment continuity and data integrity are ensured, manual intervention is reduced, and experiment management efficiency and reliability are improved.

Description

Technical Field

[0001] The present application belongs to the field of experimental management technology, and in particular, relates to a management method, device, equipment and medium for a control experiment. Background Art

[0002] AB experiment is a commonly used experimental method. It evaluates the impact of a certain variable by randomly assigning users to different experimental groups and comparing the performance of different experimental groups. In actual applications, the experiment leader will set an experimental duration or experimental validity period for each experiment to ensure that the experiment is completed within the scheduled time.

[0003] In related technologies, if the experimental effect is not obvious or does not meet expectations, the experimental time limit should be extended. At this time, the experiment leader is often required to intervene in a timely manner. However, due to the negligence or omission of the experiment leader to forget to manually extend the experiment time limit, the experiment will automatically go offline when it expires, and the experimental project cannot be completed in time, resulting in experimental interruption or data loss, which is not conducive to accurate, reliable and complete implementation of experimental management. Summary of the invention

[0004] In view of the above-mentioned shortcomings of the prior art, the purpose of the present application is to provide a management method, device, equipment and medium for a control experiment, so as to solve the problem that the management of the control experiment in the prior art cannot accurately, reliably and completely perform experimental management.

[0005] To achieve the above-mentioned purpose and other related purposes, the first aspect of the present application provides a method for managing a control experiment, including: creating a control experiment, determining the experimental period and management mode of the control experiment, the management mode including not going offline when the experiment expires; if it is monitored that the experimental period has expired, and the management mode is that the experiment does not go offline when it expires, then continuing the experiment until a command to complete the experiment is received.

[0006] In some embodiments of the first aspect, the control experiment management method further includes: if it is monitored that the experiment period has expired and the management mode is to shut down the experiment upon expiration, then saving the experimental data of the control experiment and shutting down the control experiment.

[0007] In some embodiments of the first aspect, the management method of the control experiment also includes: if it is monitored that the experiment period is about to expire and the management mode is to go offline upon expiration of the experiment, an expiration reminder instruction is sent, and whether to extend the experiment period is determined in response to feedback information of the expiration reminder instruction; the expiration is when the experiment period is less than a preset time limit.

[0008] In some embodiments of the first aspect, if the feedback information of the expiration prompt instruction is none, analyze the current experimental data according to the preset experimental indicators; if the current experimental data meets the preset experimental indicators, determine that the experimental result reaches the expected effect and do not extend the experimental period; if the current experimental data does not meet the preset experimental indicators, determine that the experimental result does not reach the expected effect, and generate a first duration to extend the experimental period, where the first duration is the working duration predicted by the time evaluation model for the current control experiment to reach the preset experimental indicators.

[0009] In some embodiments of the first aspect, after determining the experimental period and management mode of the control experiment, it further includes: determining the person in charge of the control experiment; if it is monitored that the working status of the person in charge of the experiment is about to leave the company, transfer the management authority of the person in charge of the experiment to the target object, and send a handover message to notify the target object and the subscribed objects; the target object is one of the subscribed objects, and the management authority includes configuring the subscribed objects, the management mode, and the experimental period.

[0010] In some embodiments of the first aspect, if it is monitored that the working status of the person in charge of the experiment is about to leave the company, trigger an experiment handover process, determine the target object to be handed over according to the position level of the subscribed object and the position matching of the person in charge of the experiment; send a handover instruction to the target object, and in response to the confirmation receipt instruction of the target object, transfer the management authority of the current person in charge of the experiment to the target object, and generate a handover log according to the work record of the person in charge of the experiment.

[0011] In some embodiments of the first aspect, the method for determining the experiment completion instruction includes at least one of the following: in response to the experiment data verification of the person in charge of the experiment, if the experiment data verification passes, generate the experiment completion instruction; or, obtain the preset experimental indicators of the control experiment, if it is monitored that the current experimental data of the control experiment meets the preset experimental indicators, determine that the experimental result reaches the expected effect, and generate the experiment completion instruction; or, obtain the preset experimental indicators of the control experiment, if it is monitored that the current experimental data of the control experiment meets the preset experimental indicators, determine that the experimental result reaches the expected effect, generate an experiment completion notice to prompt the person in charge of the experiment to trigger, so as to generate the experiment completion instruction.

[0012] The second aspect of the present application provides a control experiment management device, including: an experiment creation module, configured to create a control experiment, determine the experimental period and management mode of the control experiment, where the management mode includes that the experiment does not go offline after expiration; a first management module, configured to continue to maintain the experiment until an experiment completion instruction is received if it is monitored that the experimental period has expired and the management mode is that the experiment does not go offline after expiration.

[0013] The third aspect of the present application provides a control experiment management device, including: one or more processing devices; a memory for storing one or more programs; when the one or more programs are executed by the one or more processing devices, the one or more processing devices implement the above control experiment management method.

[0014] The fourth aspect of the present application provides a computer-readable storage medium, on which a computer program is stored, and the computer program is used to make the computer execute the above control experiment management method.

[0015] As described above, a technical solution of the control experiment management method, device, equipment and medium of the present application has the following beneficial effects:

[0016] By configuring the management mode of the control experiment not to go offline when it expires, after the experiment expires, the experiment can continue to be maintained until an experiment completion instruction is received. By adopting this dynamic cycle management, on the one hand, the flexibility and stability of experiment management are improved; on the other hand, the elastic management of the experiment life cycle is realized, the problem that the experiment automatically goes offline due to the end of the validity period is solved, the inaccuracy and loss of data caused by the interruption of the experiment are avoided, the continuity of the experiment and the integrity of the data are ensured, the manual intervention is reduced, and the efficiency and reliability of experiment management are improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It shows a flowchart of a control experiment management method provided by the present application;

[0018] Figure 2 It shows a complete flowchart of a control experiment management method provided by the present application;

[0019] Figure 3 It shows a first implementation flowchart of a control experiment management method provided by the present application;

[0020] Figure 4 It shows a second implementation flowchart of a control experiment management method provided by the present application;

[0021] Figure 5 It shows a third implementation flowchart of a control experiment management method provided by the present application;

[0022] Figure 6 It shows a fourth implementation flowchart of a control experiment management method provided by the present application;

[0023] Figure 7 It shows a structural block diagram of a control experiment management device provided by the present application;

[0024] Figure 8 Shown is a schematic structural diagram of an electronic device suitable for implementing the embodiments of the present application provided by this application. Specific embodiments

[0025] The following uses specific specific examples to illustrate the implementation manners of the present application. Those skilled in the art can easily understand other advantages and effects of the present application from the content disclosed in this specification. The present application can also be implemented or applied through other different specific implementation manners. Various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that, without conflict, the following embodiments and the features in the embodiments can be combined with each other.

[0026] It should be noted that the diagrams provided in the following embodiments only schematically illustrate the basic concept of the present application. Therefore, only the components related to the present application are shown in the diagrams, rather than being drawn according to the number, shape, and size of the components in actual implementation. The type, quantity, and proportion of each component in actual implementation can be arbitrarily changed, and the component layout type may also be more complex.

[0027] In the related art, because the experimental effect does not reach the expected effect or the effect is not obvious, the experiment needs to extend the experimental duration or validity period. And the person in charge of the experiment may omit or forget to modify the validity period of the experiment during this process, resulting in the experiment automatically going offline after the validity period ends, and subsequent traffic cannot enter the experiment. In this way, not only does the experimental result not meet the expectation, but it may also cause online problems.

[0028] Based on the above situation, the embodiments of the present application provide a management method for a control experiment, which can be applied to a terminal, can also be applied to a server, or can also be software running on a terminal or a server. In some embodiments, the terminal can be an electronic device such as a smart phone, a tablet computer, a vehicle terminal, a laptop computer, or a desktop computer; the server can be configured as an independent physical server, can also be configured as a server cluster or a distributed system composed of multiple physical servers, or can also be configured as a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, and big data and artificial intelligence platforms; the software can be an application program for the management of the control experiment, etc., but is not limited to the above forms.

[0029] For example, taking the case where the management method of the control experiment is executed by a terminal as an example, the terminal can create a control experiment, determine the experimental period and management mode of the control experiment, and the management mode includes that the experiment does not go offline when it expires; if it is monitored that the experimental period expires and the management mode is that the experiment does not go offline when it expires, the experiment continues to be maintained until an experiment completion instruction is received.

[0030] The present application will be described in detail below through specific embodiments. Please refer to Figure 2 as shown in Figure 2 the flowchart of the management method for the control experiment provided by the embodiment of the present application, which includes the following steps:

[0031] Step S110, create a control experiment, determine the experiment period and management mode of the control experiment, and the management mode includes that the experiment does not go offline when it expires;

[0032] Among them, a control experiment refers to setting two or more groups in an experiment, where at least one group is used as a control group, which does not receive experimental treatment or receives standard treatment, while other groups receive experimental treatment. By comparing the differences between the experimental group and the control group, the impact of the experimental treatment on the experimental results is evaluated. This method can effectively control the interference factors in the experiment and improve the accuracy and reliability of the experimental results.

[0033] By configuring the experiment period and management mode, for example, multiple control experiments can be run, each experiment using different periods and management modes to compare their effects; or, an intelligent algorithm can be introduced to predict the experiment completion time, and the experiment period can be dynamically adjusted according to the prediction results, while maintaining the flexibility of "not going offline when it expires", but adding an automatic reminder mechanism for manual evaluation at key nodes; where the management mode of "not going offline when the experiment expires" means that after the experiment is started, unless there are special instructions, the experiment will continue even if the preset experiment period is reached and will not be automatically terminated.

[0034] It should be noted that the control experiment can be other experiments, such as AB experiments, blind selection experiments, etc., which will not be elaborated here.

[0035] Step S120, if it is monitored that the experiment period has expired and the management mode is that the experiment does not go offline when it expires, then continue to maintain the experiment until an experiment completion instruction is received.

[0036] Among them, based on preset rules and real-time monitoring data, the continuity of the experiment is maintained through an automated decision-making logic until a clear end signal, that is, an experiment completion instruction, is obtained, avoiding the interruption of an experiment that may be generating important data due to time limitations.

[0037] Exemplarily, if the experiment completion instruction is not received, the experiment will always remain online, avoiding the interruption or loss of experimental data and ensuring the complete completion of the experiment.

[0038] Through the above method, the continuity and integrity of the experiment are ensured, avoiding the risk of missing important data due to time limitations; at the same time, through the flexible time limit mechanism of not going offline when the experiment expires, it is ensured that the experiment can end at an appropriate time, meeting the scientific research needs and effectively managing resources.

[0039] Optionally, in some embodiments, the method for managing a control experiment further includes: if it is monitored that the experiment period has expired and the management mode is to go offline upon experiment expiration, save the experimental data of the control experiment and take the control experiment offline.

[0040] Exemplarily, detect the experiment period regularly (such as every day or every hour), compare the current time with the experiment period to determine whether the experiment has expired; when it is detected that the experiment period has expired and the management mode is to go offline upon experiment expiration; export relevant data such as the experimental settings, results, and logs of the control experiment to a specified storage location to ensure the integrity and accuracy of the data, and guarantee the long-term preservation and traceability of the experimental data; through status management and service management, ensure that the control experiment can be safely and orderly taken offline after expiration, avoiding unnecessary occupation of system resources.

[0041] In this embodiment, through the automated monitoring and processing process, the workload of management is reduced, and the efficiency and accuracy of experiment management are improved; flexible management mode selection and data preservation strategies are provided to meet the requirements of different experimental scenarios, ensuring the long-term preservation and traceability of experimental data; expired experiments are taken offline in a timely manner, avoiding unnecessary occupation of system resources, and improving resource utilization.

[0042] Optionally, in some embodiments, the method for managing a control experiment further includes: if it is monitored that the experiment period is about to expire and the management mode is to go offline upon experiment expiration, send an expiration reminder instruction, and determine whether to extend the experiment period in response to the feedback information of the expiration reminder instruction; being about to expire means that the time to the experiment period is less than a preset time limit.

[0043] Exemplarily, use a notification service or message queue to send the expiration reminder instruction to a specified recipient; for example, when it is monitored that the experiment period is about to expire and the management mode is "go offline upon experiment expiration", an expiration reminder instruction is automatically generated and sent to the person in charge of the experimental project by means of email, text message, instant messaging, etc. Through logical judgment or a rule engine, corresponding processing decisions are made according to the feedback information input by the user, and it is decided whether to extend the experiment period according to the actual situation. For example, according to the received feedback information, determine whether the user decides to extend the experiment period; if the user decides to extend, update the deadline information of the experimental project; if the user decides not to extend, execute the subsequent offline processing process.

[0044] In the above manner, upcoming expired experimental projects are discovered in advance through regular scanning and users are reminded; users are allowed to dynamically adjust the management mode according to experimental needs, improving the flexibility and adaptability of experiment management; ensuring that experimental projects can be launched, proceed, or go offline on time, avoiding resource waste and occupation, and improving resource utilization and efficiency.

[0045] Optionally, in some embodiments, if the feedback information of the expiration prompt instruction is none, analyze the current experimental data according to the preset experimental indicators; if the current experimental data meets the preset experimental indicators, determine that the experimental result reaches the expected effect and do not extend the experimental period; if the current experimental data does not meet the preset experimental indicators, determine that the experimental result does not reach the expected effect, generate a first duration to extend the experimental period, and the first duration is the working duration predicted by the time evaluation model for the current control experiment to reach the preset experimental indicators.

[0046] Exemplarily, if no feedback information is received within the preset time period, determine that the feedback information of the expiration prompt instruction is none. Read the current experimental data and compare it with the preset experimental indicators, which are determined by the experimental items of the control experiment. For example, according to the analysis result, judge whether the current experimental data reaches or exceeds the preset experimental indicators. By comparing the evaluation result of the experimental data with the preset indicators, determine whether the experimental result reaches the expected effect. If the current experimental data meets the preset experimental indicators, determine that the experimental result reaches the expected effect and do not extend the experimental period; if the current experimental data does not meet the preset experimental indicators, determine that the experimental result does not reach the expected effect and generate a first duration to extend the experimental period; among them, the first duration is predicted by the time evaluation model, which can adopt a time series model or a regression model. The time series model can be ARIMA (Autoregressive Integrated Moving Average Model), LSTM (Long Short-Term Memory Network), etc., and the regression model can be linear regression, ridge regression, lasso regression, etc.

[0047] Through the above method, through the automated judgment and processing mechanism, the time cost of manual intervention and decision-making is reduced; the experimental period and parameters are flexibly adjusted according to the experimental results and preset indicators, improving the experimental efficiency; by accurately evaluating the experimental data and comparing with the preset indicators, it is possible to accurately judge whether the experimental result reaches the expected effect.

[0048] In some embodiments, refer to Figure 2 , which is a complete flowchart of a control experiment management method provided by this application. After determining the experimental period and management mode of the control experiment, it further includes:

[0049] Determine the person in charge of the control experiment. For example, relevant information such as the name and position of the person in charge of the experiment can be obtained in advance through the configuration information;

[0050] Step S130, if it is monitored that the working status of the person in charge of the experiment is about to leave, transfer the management authority of the person in charge of the experiment to the target object, and send a handover information notification to the target object and the subscribed objects; the target object is one of the subscribed objects, and the management authority includes configuring the subscribed objects, the management mode, and the experimental period.

[0051] Exemplarily, the working status of the person in charge of the real-time monitoring experiment is comprehensively judged, including but not limited to login frequency, working hours, project participation, etc. For example, it can also be judged through the departure notice of the human resources department. Through permission management operations, the smooth transfer of management permissions is achieved to ensure the continuity and stability of the experiment. For example, according to preset rules or manual designation, a suitable target object is selected from the subscription objects, and the management permissions of the person in charge of the experiment (including configuring subscription objects, management modes, and experiment periods, etc.) are transferred to the target object. Of course, an intelligent recommendation algorithm can also be used to automatically recommend the most suitable replacement candidate based on factors such as the historical performance and skill matching degree of the target object. In this way, the timely and accurate transfer of experiment management permissions is ensured, and the interruption of the experiment due to personnel changes is avoided. Through the information notification mechanism, relevant personnel can be ensured to timely understand the situation of the experiment handover. For example, handover information is generated, including the current situation of the experiment, important matters, and tasks to be done, etc. The handover information is sent to the target object and subscription objects (including the person in charge of the experiment and other relevant personnel) through emails, text messages, instant messaging, etc., to ensure that relevant personnel can timely understand the detailed situation of the experiment handover and promote the smooth transition of the experiment.

[0052] Through the above methods, through the automated monitoring and notification mechanism, the manual intervention and communication costs are reduced; the continuity and stability of the experiment are ensured, and the interruption of the experiment caused by personnel changes is avoided; through the public disclosure of information notification and handover information, the transparency and traceability of the experiment are improved; in this way, the target object and handover process can be flexibly adjusted according to different situations to meet the diverse needs of experiment management.

[0053] Optionally, in some embodiments, if it is monitored that the working status of the person in charge of the experiment is about to leave, the experiment handover process is triggered. According to the job level of the subscription object matching that of the person in charge of the experiment, the target object to be handed over is determined; a handover instruction is sent to the target object. In response to the confirmation receipt instruction of the target object, the management permissions of the current person in charge of the experiment are transferred to the target object, and a handover log is generated based on the work record of the person in charge of the experiment.

[0054] Exemplarily, when it is determined that the person in charge of the experiment is about to leave, the experiment handover process is automatically triggered, and a series of preset operations and notifications are initiated, ensuring the timeliness and accuracy of the handover work. At the same time, the experiment handover process is initiated at the correct time and conditions to avoid delays or misoperations. Through comparative analysis, the target object that best matches the position of the person in charge of the experiment is identified to ensure the continuity and stability of the experiment management after the handover. For example, factors such as the position level, professional skills, and work experience of the subscribed object are matched with the position of the person in charge of the experiment, and the most suitable target object to be handed over is selected from the subscribed objects by using an intelligent matching algorithm or manual judgment method. In this way, it is ensured that the experiment management after the handover is undertaken by the target object with the corresponding capabilities and experience, maintaining the stability and continuity of the experimental project.

[0055] Through the automated notification mechanism, it is possible to ensure that the handover instructions are conveyed to the target object in a timely and accurate manner. Handover instructions are generated, for example, including but not limited to the specific content of the handover, time requirements, precautions, etc. The handover instructions are sent to the target object via email, instant messaging tools, or other communication methods to ensure that the handover instructions can be conveyed to the target object in a timely and accurate manner. Through the permission management operation, the smooth transfer of management permissions can be achieved to ensure the seamless connection of the experiment management after the handover. After receiving the handover instructions, the target object confirms the receipt and issues a confirmation receipt instruction. In response to this instruction, the management permissions of the current person in charge of the experiment are automatically transferred to the target object to ensure that the management permissions can be transferred to the target object in a timely and accurate manner, avoiding permission gaps or conflicts during the handover process. Through data integration and analysis, a comprehensive and accurate handover log can be automatically generated. For example, based on information such as the work records of the person in charge of the experiment, handover instructions, and the target object's confirmation of receipt, a handover log is automatically generated. The handover log details key information such as the process, time, participants, and handover content of the handover, ensuring that the handover process has detailed records for auditing and traceability, and improving the transparency and traceability of the handover work.

[0056] By the above means, using automated monitoring, notification, permission transfer, and handover log generation mechanisms, the manual intervention and communication costs are reduced; the continuity and stability of the experiment management are ensured, avoiding experiment interruptions or delays caused by personnel changes; and through detailed handover logs and records, the transparency and traceability of the handover work are improved.

[0057] Optionally, in some embodiments, the method for determining the experiment completion instruction includes at least one of the following:

[0058] The first method is to respond to the experiment data verification by the person in charge of the experiment. If the experiment data verification passes, an experiment completion instruction is generated; the experiment completion instruction is determined by manually judging whether the current experiment is completed. Or

[0059] In the second method, obtain the preset experimental indicators of the control experiment. If it is monitored that the current experimental data of the control experiment meet the preset experimental indicators, it is determined that the experimental result reaches the expected effect, and an experiment completion instruction is generated. Automatically detect whether the current experimental data reaches the expected effect through an intelligent algorithm, determine the experiment completion instruction, and through a systematic and process-based management method, effectively prevent misoperations, ensure the standardization of the experimental process, and improve the reliability of experimental data and the accuracy of experimental results. Or

[0060] In the third method, obtain the preset experimental indicators of the control experiment. If it is monitored that the current experimental data of the control experiment meet the preset experimental indicators, it is determined that the experimental result reaches the expected effect, and an experiment completion notice is generated to prompt the experiment responsible person to trigger it in order to generate an experiment completion instruction.

[0061] Exemplarily, in the third method, after it is determined that the experimental result reaches the expected effect, an experiment completion notice is generated to prompt the experiment responsible person. Finally, it is still manually triggered to generate an experiment completion instruction. In this way, it not only combines automated data verification and real-time monitoring, but also has a manual confirmation link, which not only improves efficiency, but also ensures the accuracy and flexibility of decision-making.

[0062] In some embodiments, when using the management method of the control experiment of the present application to execute the experiment without going offline when it expires, it includes:

[0063] 1) When creating an experiment, the experiment responsible person sets the validity period of the experiment, that is, the start time and end time of the experiment, that is, the experimental period.

[0064] 2) The experiment responsible person can select either the single option of "not going offline when it expires" or "going offline when it expires", that is, the management mode of the experiment.

[0065] 3) Before the end of the experimental validity period, detect the experimental status.

[0066] 4) If the experimental validity period ends and the option of "not going offline when it expires" is selected, the experiment remains online and does not change the experimental status until the experiment responsible person manually takes the experiment offline.

[0067] 5) A few days before the approaching experimental validity period, automatically notify the subscribers of the experiment every day to remind them that the experiment is about to expire and whether they need to renew. If the subscriber determines that there is no need to renew, there is no need to continue the notification; if the experiment selects the option of "going offline when it expires" and the subscriber has not determined that there is no need to renew, a phone call notification will be given for strong reminder a few hours before the experiment expires. The specific reminder strategy can be formulated according to user needs.

[0068] 6) During the process of the experiment, the experiment responsible person can modify the validity period or offline setting of the experiment at any time.

[0069] Please refer to Figure 3, which is the first implementation flowchart of a control experiment management method provided by this application, is described in detail as follows:

[0070] Experiment creation: The experiment leader creates a new experiment in the system (i.e., the experiment management system) and sets the validity period of the experiment to 30 days.

[0071] Option setting: When creating the experiment, the experiment leader selects the "not taken offline upon expiration" option.

[0072] Status detection: During the experiment, the status of the experiment is detected regularly.

[0073] Processing at the end of the validity period: Before the end of the experiment's validity period, it is detected that the validity period of the experiment is about to end. However, due to the selection of the "not taken offline upon expiration" option, the experiment remains online.

[0074] Notifying subscribers: A few days before the end of the experiment's validity period, the subscribers of the experiment are automatically notified every day to remind them that the experiment is about to expire. If the subscribers confirm that they do not need to renew, the reminder will no longer be sent.

[0075] Experiment management: The experiment leader decides whether to extend the validity period of the experiment or take the experiment offline manually according to the progress of the experiment.

[0076] Please refer to Figure 4 , which is the second implementation flowchart of a control experiment management method provided by this application, is described in detail as follows:

[0077] Experiment creation: The experiment leader creates a new experiment in the system and sets the validity period of the experiment to 15 days.

[0078] Option setting: When creating the experiment, the experiment leader does not select the "not taken offline upon expiration" option.

[0079] Status detection: During the experiment, the status of the experiment is detected regularly.

[0080] Processing at the end of the validity period: Before the end of the experiment's validity period, it is detected that the validity period of the experiment is about to end. Since the "not taken offline upon expiration" option is not selected, the experiment is automatically taken offline after the expiration of the validity period.

[0081] Viewing experiment results: The experiment leader can view the experiment results after the experiment is taken offline and recreate the experiment as needed.

[0082] Optionally, the control experiment management method is used for automated experiment handover and permission management, including:

[0083] 1) When creating an experiment, the experiment creator sets the experiment leader.

[0084] 2) Before leaving the company, the person in charge of the experiment can proactively transfer the experiment, select the recipient of the experiment, and after the transfer, the experiment permissions will be automatically transferred.

[0085] 3) Monitor the status of the person in charge of the experiment. When it is detected that the person in charge of the experiment has left the company, the experiment transfer process will be automatically triggered.

[0086] 4) Automatically determine the new person in charge of the experiment and transfer the permissions to ensure the continuity of the experiment.

[0087] 5) After the transfer of the person in charge of the experiment is completed, automatically notify the new person in charge of the experiment and relevant subscribers to remind them of the experiment transfer situation.

[0088] Please refer to Figure 5 , which is the third implementation flowchart of a control experiment management method provided by this application, and is described in detail as follows:

[0089] Experiment creation: The experiment creator creates a new experiment in the system and sets the person in charge of the experiment.

[0090] Proactive transfer: Before leaving the company, the person in charge of the experiment proactively transfers the experiment, selects the recipient of the experiment. After the recipient agrees, the experiment permissions will be automatically transferred, and the recipient becomes the new person in charge of the experiment.

[0091] Notify subscribers: After the experiment transfer is completed, automatically notify the new person in charge of the experiment and relevant subscribers to remind them of the experiment transfer situation.

[0092] The person in charge of the experiment can modify the subscribers and permission settings of the experiment at any time during the experiment process.

[0093] Please refer to Figure 6 , which is the fourth implementation flowchart of a control experiment management method provided by this application, and is described in detail as follows:

[0094] Experiment creation: The experiment creator creates a new experiment in the system and sets the person in charge of the experiment.

[0095] Status monitoring: Monitor the status of the person in charge of the experiment. When it is detected that the person in charge of the experiment has left the company, the experiment transfer process will be automatically triggered.

[0096] Automatic transfer: Automatically determine the new person in charge of the experiment and transfer the permissions to ensure the continuity of the experiment.

[0097] Notify subscribers: After the experiment transfer is completed, automatically notify the new person in charge of the experiment and relevant subscribers to remind them of the experiment transfer situation.

[0098] Experiment management: The person in charge of the experiment can modify the subscribers and permission settings of the experiment at any time during the experiment process.

[0099] By the above method, the management method of the control experiment of the present application has the following technical effects:

[0100] First, it avoids the problem that the experiment is automatically taken offline due to the expiration of the validity period, reduces the online problems caused by the experiment being taken offline, improves the stability and reliability of the system, and ensures the integrity and accuracy of the experimental results.

[0101] Second, it improves the flexibility of experiment management. The experiment responsible person can adjust the validity period of the experiment at any time according to actual needs, provides an early notice function, and reduces the risk that the experiment responsible person misses modifying the validity period.

[0102] Third, after the experiment responsible person leaves the company, the experiment handover and permission transfer are automatically carried out to ensure the continuity of the experiment and the integrity of the data. Through the automated experiment handover mechanism, it avoids experiment interruption and data loss, improves the effectiveness of the experiment and the decision-making efficiency of the enterprise. By automatically determining and conducting permission handover, it ensures the orderliness and security of permission management, reduces human errors; reduces the complexity of offline communication and administrator intervention, improves the automation degree and efficiency of experiment management; for the specific needs of AB experiments, it provides a more specialized and adaptable solution to ensure the high efficiency and reliability of experiment management.

[0103] Please refer to Figure 7 , which is a structural block diagram of a control experiment management device 700 provided by the present application, including:

[0104] An experiment creation module 710, which is used to create a control experiment, determine the experimental period and management mode of the control experiment, and the management mode includes that the experiment does not go offline when it expires;

[0105] A first management module 720, which is used to continue to keep the experiment until an experiment completion instruction is received if it is monitored that the experimental period expires and the management mode is that the experiment does not go offline when it expires.

[0106] In some embodiments, the control experiment management device 700 further includes: a second management module 730, which is used to save the experimental data of the control experiment and take the control experiment offline if it is monitored that the experimental period expires and the management mode is that the experiment goes offline when it expires.

[0107] In some embodiments, the control experiment management device 700 further includes: a third management module 740, which is used to send an expiration reminder instruction if it is monitored that the experimental period is about to expire and the management mode is that the experiment goes offline when it expires, and determine whether to extend the experimental period in response to the feedback information of the expiration reminder instruction; being about to expire means that the distance from the experimental period is less than a preset time limit.

[0108] In some embodiments, the control experiment management device 700 further includes: a handover management module 750, configured to transfer the management authority of the experiment person in charge to a target object and send a handover message to notify the target object and the subscribed objects if it is detected that the working status of the experiment person in charge is about to leave; the target object is one of the subscribed objects, and the management authority includes configuring the subscribed objects, the management mode, and the experiment period.

[0109] It should also be noted that there is a one-to-one correspondence between the control experiment management method and the control experiment management device. Here, the technical details and technical effects involved in the control experiment management device are the same as those of the above identification method, which will not be elaborated one by one here. Please refer to the above control experiment management method.

[0110] By the above method, the management mode of the control experiment is configured not to go offline at the expiration. After the experiment expires, the experiment can continue to be maintained until an experiment completion instruction is received. By adopting this dynamic cycle management, on the one hand, the flexibility and stability of experiment management are improved; on the other hand, the elastic management of the experiment life cycle is realized, the problem that the experiment automatically goes offline due to the expiration of the validity period is solved, the inaccuracy and loss of data caused by the interruption of the experiment are avoided, the continuity of the experiment and the integrity of the data are ensured, the manual intervention is reduced, and the efficiency and reliability of experiment management are improved.

[0111] Next, refer to Figure 8 , please refer to Figure 8 , Figure 8 is a schematic structural diagram of an electronic device suitable for implementing the embodiments of the present application. It should be noted that Figure 8 The illustrated electronic device 800 is only an example and should not impose any limitations on the functions and usage scopes of the embodiments of the present application.

[0112] As Figure 8 shown, the electronic device 800 includes a central processing unit (CPU) 801, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 802 or the program loaded from the storage section 808 into the random access memory (RAM) 803, such as executing the method in the above embodiments. In the RAM 803, various programs and data required for system operation are also stored. The CPU 801, ROM 802, and RAM 803 are connected to each other through a bus 804. The input / output (I / O) interface 805 is also connected to the bus 804.

[0113] The following components are connected to the I / O interface 805: an input section 806 including a keyboard, a mouse, etc.; an output section 807 including, for example, a cathode ray tube (CRT), a liquid crystal display (LCD), etc. and a speaker; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the I / O interface 805 as required. A removable medium 811 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc. is mounted on the drive 810 as required so that a computer program read from the same can be installed into the storage section 808 as required.

[0114] Specifically, according to an embodiment of the present application, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, an embodiment of the present application includes a computer program product that includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for performing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via the communication section 809, and / or installed from the removable medium 811. When the computer program is executed by a central processing unit (CPU) 801, various functions defined in the apparatus of the present application are executed.

[0115] It should be noted that the computer-readable medium shown in the embodiments of the present application can be a computer-readable signal medium, a computer-readable storage medium, or any combination of the two. A computer-readable storage medium can, for example, be an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. More specific examples of the computer-readable storage medium can include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable signal medium can include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable computer program is carried. Such a propagated data signal can take various forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above.

[0116] A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium can be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0117] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of the devices, methods, and computer program products according to various embodiments of the present application. Among them, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, and the above-mentioned module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the blocks may occur in a different order than marked in the accompanying drawings. For example, two consecutive blocks shown may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram or flowchart, as well as the combination of blocks in the block diagram or flowchart, can be implemented by a dedicated hardware-based device for performing the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0118] The units described in the embodiments of the present application can be implemented in software or in hardware, and the described units can also be provided in a processor. Among them, the names of these units do not constitute a limitation to the unit itself in some cases.

[0119] The present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor of the computer, it causes the computer to execute the management method of the control experiment as described above. The computer-readable storage medium can be included in the electronic device described in the above embodiments, or can exist alone without being assembled into the electronic device.

[0120] The above embodiments are only illustrative of the principles and effects of the present application, and are not used to limit the present application. Any person familiar with this technology can modify or change the above embodiments without departing from the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by those with ordinary knowledge in the technical field without departing from the spirit and technical ideas disclosed by the present application should still be covered by the claims of the present application.

Claims

1. A method for managing a control experiment, characterized in that: include: Creating a control experiment, and determining the experimental period and management mode of the control experiment, wherein the management mode includes not shutting down the experiment when it expires; If it is monitored that the experiment period has expired, and the management mode is to not go offline after the experiment expires, the experiment will continue until an experiment completion instruction is received.

2. The method for managing a control experiment according to claim 1, characterized in that: Also includes: If it is monitored that the experiment period has expired, and the management mode is that the experiment is offline upon expiration, the experimental data of the control experiment is saved, and the control experiment is offline.

3. The method for managing a control experiment according to claim 2, characterized in that: Also includes: If it is monitored that the experiment period is about to expire, and the management mode is to go offline upon the expiration of the experiment, an expiration reminder instruction is sent, and in response to feedback information of the expiration reminder instruction, it is determined whether to extend the experiment period; The expiration date is shorter than a preset time limit.

4. The method for managing a control experiment according to claim 3, characterized in that: If the feedback information of the expiration prompt instruction is none, the current experimental data is analyzed according to the preset experimental indicators; if the current experimental data meets the preset experimental indicators, it is determined that the experimental results have achieved the expected effect, and the experimental period is not extended; if the current experimental data does not meet the preset experimental indicators, it is determined that the experimental results have not achieved the expected effect, and a first duration is generated to extend the experimental period, and the first duration is the working time required for the current control experiment to achieve the preset experimental indicators predicted by the time evaluation model.

5. The method for managing a control experiment according to claim 1, characterized in that: After determining the experimental period and management mode of the control experiment, it also includes: Determine the person in charge of the control experiment; If it is monitored that the work status of the experiment leader is about to leave, the management authority of the experiment leader will be transferred to the target object, and the handover information will be sent to notify the target object and the subscribed object; the target object is one of the subscribed objects, and the management authority includes configuring the subscribed object, the management mode and the experiment period.

6. The method for managing a control experiment according to claim 5, characterized in that: If it is monitored that the working status of the experiment leader is about to leave, the experiment handover process is triggered, and the target object to be handed over is determined according to the matching of the position level of the subscribed object with the position of the experiment leader; a handover instruction is sent to the target object, and in response to the target object's confirmation of receiving the instruction, the current management authority of the experiment leader is transferred to the target object, and a handover log is generated according to the work record of the experiment leader.

7. The method for managing a control experiment according to claim 5 or 6, characterized in that: Determine the method of completing the instruction of the experiment, including at least one of the following: In response to the experiment data verification by the experiment person in charge, if the experiment data verification passes, generating the experiment completion instruction; or Obtaining a preset experimental index of the control experiment, and if it is monitored that the current experimental data of the control experiment meets the preset experimental index, determining that the experimental result achieves the expected effect, and generating the experiment completion instruction; or The preset experimental indicators of the control experiment are obtained. If it is monitored that the current experimental data of the control experiment meets the preset experimental indicators, it is determined that the experimental results have achieved the expected effect, and an experiment completion notification is generated to prompt the experiment leader to trigger it to generate the experiment completion instruction.

8. A control experiment management device, characterized in that: include: An experiment creation module, used to create a control experiment, determine the experiment period and management mode of the control experiment, and the management mode includes that the experiment does not go offline when it expires; The first management module is used to continue the experiment until receiving an experiment completion instruction if it is monitored that the experiment period expires and the management mode is that the experiment does not go offline after expiration.

9. An electronic device, characterized in that: include: one or more processing devices; A memory for storing one or more programs; When the one or more programs are executed by the one or more processing devices, the one or more processing devices implement the method for managing a control experiment as described in any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: The computer program is used to enable a computer to execute the method for managing a control experiment according to any one of claims 1 to 7.

Images