Computer-implemented method and arrangement for testing a user experience relating to at least a part of the user interface of software

Abstract

The invention relates to a computer-implemented method for testing a user experience relating to at least a part, in particular a part of the user interface, of software, in which method analysis of data acquired when a test method is carried out for at least the part of the software and correlating at least with a user activity of a test person is restricted to a subset of the data on account of at least one acquired physiological parameter of the test person. The invention further relates to an arrangement for carrying out the method.

Description

[0001] 202414066 Foreign version

[0002] 1

[0003] Description

[0004] Computer-implemented method and arrangement for testing a user experience of at least a part of the user interface of a software.

[0005] The invention relates to a computer-implemented method for testing a user experience of at least a part, in particular the user interface, of software according to the preamble of claim 1, and to an arrangement for testing a user experience of at least a part of the user interface of software according to the preamble of claim 12.

[0006] In software development, a user's experience with the software, especially the user interface, is of paramount importance. Therefore, it is well known that tests are conducted to optimize this aspect, also referred to as "User Experience" (UX). These tests may involve users from software product development clients (business-to-consumer, B2C) and / or usability sprint tests (e.g., in software development projects) for business clients. Established methods, such as usability tests and the "think-aloud" approach, are very time-consuming in terms of data analysis.

[0007] It is known that in usability tests, a test subject typically completes predefined tasks and evaluates the user experience (UX) of the user interface using scales or questions. Additionally, a test administrator may provide assessments of the UX for the test subject, for example, using scales.

[0008] Think-aloud and, in particular, moderated usability tests are further state-of-the-art methods for UX evaluation. In these tests, the participant, who performs predefined tasks on the user interface of a device (e.g., a machine, a PC), expresses their thoughts, expectations, and feelings regarding the interaction with the user interface being evaluated. These statements can be recorded electronically for subsequent systematic analysis.

[0009] Analyzing the data collected for usability tests and think-aloud sessions is very time-consuming. Since all information from each test participant is analyzed for evaluation purposes, the analysis of the collected data is inefficient and very expensive. 202414066 Foreign version

[0010] 2

[0011] The object underlying the invention is therefore to provide a solution that overcomes the disadvantage of the prior art; in particular, the object of the invention is to provide an efficient and cost-effective method for testing a user experience.

[0012] This problem is solved starting from the computer-implemented method for testing a user experience of at least a part, in particular the user interface, of software according to the preamble of claim 1, by its characterizing features, and starting from the arrangement for testing a user experience of at least a part, in particular the user interface, of software according to the preamble of claim 12, by its characterizing features.

[0013] Unless otherwise specified in the following description, the terms "perform," "implement," "transform," "transmit," "calculate," "computer-aided," "compute," "determine," "generate," "configure," "reconstruct," "determine," "capture," and the like preferably refer to actions and / or processes and / or processing steps that modify and / or generate data and / or convert data into other data, wherein the data may be represented or exist as physical quantities, for example, as electrical impulses. In particular, the term "computer" should be interpreted as broadly as possible to encompass all electronic devices with data processing capabilities.Computers can therefore be, for example, personal computers, servers, programmable logic controllers (PLCs), handheld computer systems, pocket PC devices, mobile phones and other communication devices that can process data using a computer, processors and other electronic devices for data processing.

[0014] In the context of the invention, "computer-aided" or "computer-supported" can, for example, refer to an implementation of the method in which, in particular, a processor performs at least one process step of the method.

[0015] In the context of the invention, a processor can be understood to mean, for example, a machine or an electronic circuit. A processor can be, in particular, a central processing unit (CPU), a microprocessor, or a microcontroller. A processor can also be, for example, an integrated circuit (IC), in particular an FPGA (field-programmable gate array) or an ASIC (application-specific integrated circuit). [202414066 Foreign version]

[0016] 3 or a DSP (Digital Signal Processor) or a GPU (Graphics Processing Unit). A processor can also be a virtualized processor, a virtual machine, or a soft CPU. It can, for example, also be a programmable processor that is equipped with configuration steps for executing the aforementioned method according to the invention, or is configured with configuration steps such that the programmable processor realizes the features of the method, the component, the modules, or other aspects and / or partial aspects of the invention according to the invention.

[0017] In connection with the invention, a “storage unit”, “storage device” or “storage module” and the like can be understood to mean, for example, volatile memory in the form of random-access memory (RAM) or permanent memory such as a hard drive or data carrier, as well as a combination of one or more of these elements to form a so-called cloud.

[0018] In the context of the invention, a "module" can be understood to mean, for example, at least one processor and / or at least one memory unit for storing program instructions, which are physically connected at one location, for example, a part of a printed circuit board, and functionally interact together. For example, the processor is specifically configured to execute the program instructions in such a way that the processor performs functions to implement or realize the method according to the invention or a step of the method according to the invention.

[0019] In the computer-implemented method according to the invention for testing a user experience of at least a part, in particular the user interface, of a software, an analysis of data recorded during a test procedure for at least the part of the software, which correlates with at least one user activity of a test subject, is limited to a subset of the data based on at least one recorded physiological parameter of the test subject.

[0020] This process, among other things, limits the amount of data and makes it available for analysis to potentially improve the software. Limiting the data volume frees up resources and allows for more effective use. This is particularly true because using physiological parameters as a condition provides a basis for faster optimization, as these parameters offer an additional and more accurate dimension for evaluating the user experience. (202414066 Foreign version)

[0021] 4. These will enable an evaluation, especially an automated one, even without further feedback, for example from the user.

[0022] The arrangement according to the invention for testing a user experience of at least a part, in particular the user interface, of a software is characterized by means for carrying out the method and / or one of its further developments, thereby contributing to the implementation and mutatis mutandis to the realization of the advantages mentioned in connection with the computer-implemented method for testing a user experience of at least a part of the user interface of a software.

[0023] Further advantageous embodiments and developments of the invention are specified in the dependent claims.

[0024] A preferred embodiment of the method according to the invention comprises the following steps: a) Executing at least a part of the software according to the test procedure, b) Measuring at least one physiological parameter during at least one point in time during execution, in particular for the duration of the execution of a sub-function of the part of the software, c) Acquiring data correlating with at least one user activity, in particular at least the user interaction, in particular the interaction sequence, with the part of the software, for example during the interaction with the function, d) Acquiring the physiological parameter, e) Detecting a change in the physiological parameter, f) Performing a first analysis of the change, g) Selecting the correlating data depending on the first analysis, h) Repeating steps a) to f) until a termination condition is met.i) Providing the selected data as a basis for carrying out a second analysis based on the selected correlating data.

[0025] This defines an effective method and a first simple implementation for the automatic restriction of measurement data to be evaluated in the second analysis in connection with the software test.

[0026] According to a further advantageous embodiment of the inventive method, the selected correlating data assigned to the user activity, in particular interaction sequence, are stored in a local and / or remote location, in particular via a 202414066 foreign version

[0027] 5

[0028] The communication network-accessible storage facility, for example, a cloud storage device, is configured so that it can be retrieved by an analysis module operating an algorithm that provides the second analysis. This enables a second analysis to be performed at a later time. For example, this is advantageous when data is collected from multiple test subjects, which is usually the case, and the second analysis is only carried out once a complete test series with several people has been completed, thus enabling an optimized result.

[0029] Alternatively or additionally, the method according to the invention can be further developed such that the data is supplied, in particular via a communication interface, to an analysis module operating an algorithm that provides the second analysis. This allows the data to be transferred directly to the module performing the second analysis or to the device housing this module, thereby simultaneously triggering the start of the second analysis.

[0030] Preferably, the method according to the invention is further developed such that the first analysis of changes in the physiological parameter is triggered by the detection of at least one physiological parameter that correlates with an increase in so-called arousals and / or stress, with the detection of the increase serving as the basis for the limitation. These types of parameters are particularly suitable for detecting processes significant to the user experience, which may not even be consciously perceived by the test subject, but which, if implemented in this way, can, in the long run, make working with the software more difficult or burdensome if the arousal is negative, or, if implemented in this way, have a long-term effect of facilitating work with the software if the arousal is positive.

[0031] In a further preferred embodiment of the method according to the invention, the user activity occurring during detection and / or the corresponding data, in particular an interaction sequence, are assigned to the detected parameter and made available for the second analysis. This provides one of the possible forms of identification with which the data can be made available for the second analysis, identified, and selected based on this identification.

[0032] In a further advantageous embodiment of the method according to the invention, detection is carried out by at least one comparison of a recorded value of a physiological 202414066 foreign version

[0033] 6

[0034] Parameters with a threshold value, which can be defined. This is a simple yet effective way to implement detection. In particular, the threshold value can be adjusted based on the latest findings and / or optimization measures. That is, the threshold value is implemented as an adjustable parameter.

[0035] If the inventive method is further developed in such a way that the heart rate, pulse, skin resistance, pupil changes, voice parameters such as pitch, volume and / or speaking rate, and / or respiratory rate are recorded as physiological parameters, at least one physiological parameter is available which is very well researched with regard to its correlation with arousal and stress, and for which the sensors or devices for recording are also partially integrated into a computer and / or widely used devices such as smartphones, so that they can be easily integrated into the inventive method for implementation.

[0036] For this purpose, the further development of the inventive method, in which at least one device capable of recording one and / or more physiological parameters, in particular a computer operating the part of the software to be analyzed, in particular its microphone, a smartphone, a smartwatch and / or a comparable interface providing a communication interface and having at least one sensor, is advantageously suitable.

[0037] The method according to the invention is particularly flexible, as it can be further developed in such a way that a so-called "Remote Usability Testing", "Moderated Usability Testing", "Unmoderated Usability Testing", "A / B Testing", "Guerrilla Testing", "Eye-Tracking", "Think-Aloud Protocol", "First Click Testing" method and / or a combination of one or more of these methods is carried out as a test procedure.

[0038] If the method according to the invention is further developed such that the data correlating with user activity are generated based on the interaction with the part of the software, in particular the interaction sequence, and based on a spoken statement, triggered in particular according to a think-aloud protocol, and recorded during the duration of the interaction, in particular the interaction sequence, then, in addition to the physiological reactions, the conscious sensations are also available for the second analysis. 202414066 Foreign version

[0039] 7

[0040] Further advantages and details of the invention, as well as further developments of the invention, are explained in more detail below with reference to an exemplary embodiment shown in the single figure. It shows the

[0041] Figure (FIG) schematically illustrates an exemplary process of the computer-implemented procedure for testing a user experience of at least a part of the user interface of a software.

[0042] The embodiment described below in the figure (FIG) is a preferred embodiment, the advantages of which, as well as further embodiments or developments of the invention, are explained in more detail.

[0043] In particular, the following explanations merely show exemplary implementation possibilities of how such implementations of the teaching according to the invention could look, since it is impossible and also not helpful or necessary for understanding the invention to name all these implementation possibilities.

[0044] Furthermore, a person skilled in the art, with knowledge of the independent claims, will of course be aware of all the possibilities for realizing the invention that are customary in the prior art, so that in particular there is no need for a separate disclosure in the description.

[0045] In the exemplary embodiment(s), the described components of the embodiments each represent individual features of the invention that can be considered independently of one another, which further develop the invention independently of one another and can therefore also be regarded as part of the invention individually or in a combination other than that shown.

[0046] Furthermore, the described embodiments can also be supplemented by further features of the invention already described.

[0047] The single figure FIG schematically shows a sequence of a first embodiment of the method according to the invention.

[0048] This starts from a state designated as first step S1, from which the test of a software with regard to user experience proceeds through the further steps of the implementation example 202414066 (foreign version).

[0049] 8 of the invention. It can be seen that in a second step S2, the heart rate of the test subject is recorded and, according to the exemplary embodiment, is continued at least for the duration of the interaction. This is followed by a third step S3, in which the interaction of the test subject with the part of the software being tested in this run takes place. In this third step S3, for example, a test moderator can prompt the test subject to begin the test and / or begin asking questions about the interaction following the current part of the software, which the test subject answers orally, usually accompanying the interaction sequence belonging to this part of the software.

[0050] In this process, both the interaction sequence, such as the type and / or sequence of actions, the pace of execution and / or other parameters usable for an analysis of the user experience, are recorded in a fourth step S4, and in a fifth step S5 the spoken responses are recorded and also put into a data-processable form, while the heart rate recording started in the second step S2 is running the whole time.

[0051] The recorded heart rate is then checked to determine whether it indicates arousal. According to the exemplary embodiment, a threshold comparison is performed in a sixth step S6 for this purpose. Since, according to the invention, the data associated with the interaction sequence are to be selected that are associated with an arousal or stress state, the threshold comparison of the sixth step S6 can be performed continuously or at discrete time points in parallel with the recordings of steps S2 to S5.

[0052] It is also conceivable that the recorded heart rate is checked after completion of the interaction sequence in the sixth step S6 and that at all points where the threshold is exceeded, the associated recorded data are marked for storage, so that in a seventh step S7 those data belonging to such a detected arousal can be stored.

[0053] In an eighth step, S8, it is then checked whether there are any further parts of the software to be tested. If so, steps S2 to S7 are repeated for another part of the software. However, if no further parts are tested, this means that the test is complete and that the data collected up to that point can be used for a more in-depth analysis to improve the software. According to the exemplary implementation, in a ninth step, S9, the collected data is used to trigger, for example, a (semi-)automatic analysis algorithm by transmitting the data, in order to generate a result regarding the foreign version (202414066).

[0054] 9

[0055] To be able to provide an improved version of the software with improved user experience, provided that the test data, which are limited according to the inventive method and thus more efficiently evaluable, faster but also require less storage space or transmission bandwidth, suggest a further improvement in the analysis.

[0056] In this embodiment, a "think-aloud" (Think-Aloud Protocol) test will generally be particularly suitable. However, the invention is not limited to this, as will become clear in the following discussion of further details and advantages of this embodiment and other embodiments.

[0057] In the think-aloud process, verbal information generated by "thinking aloud" and answering questions during the user experience (UX) test is linked, according to the invention, with physiological parameters that are recorded simultaneously with the think-aloud process.

[0058] Abnormalities in physiological parameters thus become the starting point for targeted UX evaluations. This results in a focus on, and technically speaking, a data restriction of the analysis to data at times when physiological parameters change.

[0059] These changes indicate affects triggered during interaction with the system (to solve the task or, according to the example, the part of the software being tested in the UX test) and point to a higher level of arousal, which in turn is an indicator that the UX is particularly positive or (more likely) negative.

[0060] The situation in which physiological parameters change significantly is therefore used as an opportunity to analyze the content of the think-aloud and the specific user-system interaction more closely with regard to UX, in order to subsequently optimize it (in the case of negative UX experiences by the test subject) or maintain it (in the case of positive UX experiences), whereby by focusing and limiting the data, all participating modules and facilities are essentially relieved of resource consumption.

[0061] This is partly because this approach analyzes not all data, but only those identified as abnormal due to altered physiological parameters. 202414066 Foreign version

[0062] 10

[0063] Physiological parameters are recorded during the UX test / think-aloud procedure.

[0064] For this purpose, heart rate, or pulse, can be measured, for example, with a smartwatch. Alternatively or additionally, skin resistance and / or respiratory rate can also be measured, as these can also provide indications of changes in arousal and stress levels.

[0065] Changes in physiological parameters that indicate increased arousal or stress serve as triggers for deeper UX analysis. The interaction sequence between the test subject and the user interface (UI) associated with the parameter changes and the increased arousal / stress level is automatically selected as an effect for in-depth analysis. Based on the results, the UI, and therefore the product, is then optimized.

[0066] One of the key advantages is that instead of analyzing the entire usability test / think-aloud process, only the conspicuous points in the UL tester (customer) system interaction are analyzed, which are identified through the analysis of physiological parameters.

[0067] As mentioned, the approach is not limited to think-aloud tests, but can be further developed with other usability testing / evaluation methods, such as so-called "eye tracking".

[0068] Regardless of the grammatical gender of a particular term, persons with male, female or other gender identities are included.

Claims

202414066 Foreign version 11 Patent claims 1. Computer-implemented method for testing a user experience of at least a part of the user interface of a software, characterized in that an analysis of data recorded during the execution of a test procedure for at least that part of the software, which correlates with at least one user activity of a test subject, is restricted to a subset of the data based on at least one recorded physiological parameter of the test subject.

2. A method according to the preceding claim, characterized by the following steps: a) Executing at least a part of the software according to the test method, b) Measuring at least one physiological parameter during at least one point in time during execution, in particular for the duration of the execution of a sub-function of the part of the software, c) Acquiring data correlating with at least one user activity, in particular at least the user interaction, in particular the interaction sequence, with the part of the software, for example during the interaction with the function, d) Acquiring the physiological parameter, e) Detecting a change in the physiological parameter, f) Performing a first analysis of the change, g) Selecting the correlating data depending on the first analysis, h) Repeating steps a) to f) until a termination condition is met.i) Providing the selected data as a basis for carrying out a second analysis based on the selected correlating data.

3. Method according to the preceding claim, characterized by storing the selected correlating data assigned to user activity, in particular interaction sequence, in a local and / or remote storage facility, in particular accessible via a communication network, for example cloud, such that they can be retrieved by an analysis module operating an algorithm providing the second analysis.

4. Method according to one of the two preceding claims, characterized in that the supply, in particular via a communication interface, to an analysis module operating an algorithm providing the second analysis takes place. 202414066 Foreign version 12 5. Method according to one of the preceding claims, characterized in that the first analysis of changes in the physiological parameter is carried out in such a way that it is triggered by the detection of at least one physiological parameter that correlates with an increase in at least one arousal and / or stress, wherein the detection of the increase is used as the basis for the restriction.

6. Method according to the preceding claim, characterized in that the restriction is carried out in such a way that the user activity occurring during detection and / or the data correlating thereto, in particular an interaction sequence, is assigned to the detected parameter and made available for the second analysis.

7. Method according to one of the preceding claims, characterized in that the detection is carried out by at least one comparison of a detected value of a physiological parameter with a threshold value, in particular a definable one.

8. Method according to one of the preceding claims, characterized in that the physiological parameters recorded are the heart rate, pulse, skin resistance, pupil changes, parameters of the voice, such as pitch, volume and / or speaking rate, and / or respiratory rate.

9. Method according to one of the preceding claims, characterized in that at least one device capable of recording one and / or more physiological parameters, in particular a computer operating the part of the software to be analyzed, in particular its microphone, a smartphone, a smartwatch and / or a comparable interface providing a communication interface and having at least one sensor, is operated for the purpose of recording.

10. Method according to one of the preceding claims, characterized in that the test method is a so-called “Remote Usability Testing”, “Moderated Usability Testing”, “Unmoderated Usability Testing”, “A / B Testing”, “Guerrilla Testing”, “Eye-Tracking”, “Think-Aloud Protocol”, “First Click Testing” method and / or a combination of one or more of these methods. 202414066 Foreign version 13 11. Method according to the preceding claim, characterized in that the data correlating with the user activity are formed on the basis of the interaction with the part of the software, in particular the interaction sequence, and on the basis of a spoken statement, in particular triggered according to the think-aloud protocol, recorded during the duration of the interaction, in particular the interaction sequence.

12. Arrangement for testing a user experience of at least a part of the user interface of a software, characterized by means for carrying out the method according to one of the preceding claims.

13. Arrangement according to claim 12, characterized in that verbal information generated by “think-aloud” and answering questions during the UX test is linked with physiological parameters recorded simultaneously with the think-aloud.

Images