Methods and systems for optimising generative ai context

Abstract

A method for optimising contextual data (e.g. natural language data) wherein the method is starting with a prompt at a user input field of a generative AI model (e.g. text box); the method then comput

Description

Field of the Invention The invention of the present disclosure relates to methods and system for optimising the contextual data utilised by generative artificial intelligence (genAI) models. In particular, the invention relates to methods that balance the processing demands that contextual data places on a genAI model’s processing of prompts with the need for contextual data that makes genAI outputs relevant. Background Generative AI models are designed to receive a variety of different types of inputs from users, including string of natural language, images, videos, and audio files. Collectively, these inputs are classified as “prompts”, in response to which the genAI model provides some form of output at the user interface (UI) and / or in the “back-end” of a computing system. The quality of outputs from the genAI model are dependent on numerous factors, but a significant predictor of outcome is the quality of the contextual data that the user prompt contains. The term “quality” in the context of genAI prompts and outputs is widely understood to mean that a prompt is decorated with sufficient contextual information that the genAI model can accurately discern the meaning and aims of the user prompt, and that the output accurately addresses the contents of the prompt. There are numerous metrics in the literature by which model output quality can be measured objectively, for example BLEU (BiLingual Evaluation Understudy), ROUGE (Recall-Oriented Understudy for Gisting Evaluation), and SPICE (Semantic Propositional Image Caption Evaluation). That is to say, the improvements to model output quality based on improved prompts can be determined with an objective standard and are not based on subjective user experience. A prompt "Can you provide a summary of the key principles of quantum mechanics, focusing on wave-particle duality and the uncertainty principle?” succinctly defines the subject matter that the user is interested in at a general level, “quantum mechanics”, but also provides detailed contextual data indicating a specific sub-topic to focus on within this field, i.e. “wave-particle duality and the uncertainty principle”. There is a strong likelihood that the genAI model’s output will align with the user prompt’s aims, owing to the contextual data provided. In contrast, a low quality prompt could be "Tell me about science", which lacks any substantial contextual data and dramatically increasing the likelihood that the topic selected effectively randomly by the genAI model will not be the one of particular interest to the user. A common problem in the realm of user-facing genAI models is a lack of user knowledge around the subject of “prompt engineering”, being how to correctly phrase and decorate prompts in order to optimise a model’s outputs. A second problem is the immense computer resources, and associated costs, resulting from genAI models processing the prompts and producing outputs. It is therefore desirable to address the need for a balance between the competing needs of facilitating higher quality prompts and outputs with a control on the immense computer resources required to process said prompts and outputs. Maximising the volume of contextual data brings with it a massive strain on computer resources, but minimising contextual data presents a strong likelihood that model outputs become inaccurate and impractical for any meaningful use case. Summary According to a first aspect of the present disclosure, there is provided a computer-implemented method for optimising contextual data utilised by a generative artificial intelligence (genAI) model. The method comprises receiving a first prompt at a user input field associated with the genAI model; computing weighted relevance values of pieces of information in storage; ranking the weighted relevance values of each of the pieces of information; removing ranked pieces of information from the contextual data at least in part based on a pre-defined token limit; and generating a revised version of the first prompt utilising the remaining ranked pieces of information as contextual data. The inventors have found that the exemplary methods disclosed herein enhance the quality of prompts to AI models by improving their contextual data, whilst at the same time managing the significant demands placed on computer resources that can result from increasing the amount of contextual information the genAI model is tasked with considering. In particular, the exemplary methods facilitate a greatly reduced load on computing systems utilising generative AI models both in terms of bandwidth and CPU usage. Optionally, before computing weighted relevance values of the pieces of information in the storage, the method further comprises determining the presence of one or more pieces of information in the storage that are not related to the contents of the first prompt, and removing said one or more unrelated pieces of information from the contextual data. Optionally, computing weighted relevance values of the pieces of information in the storage comprises creating a vector representation of each of the pieces of information, creating a vector representation of the first prompt, and comparing the vector representation of each of the pieces of information with the vector representation of the first prompt. Optionally, the method further comprises generating a summary of one or more of the ranked pieces of information, and computing the token sum of the summarised ranked piece(s) of information, wherein the step of removing ranked pieces of information from the contextual data comprises removing one or more summarised pieces based on the pre-defined token limit. Optionally, an extent of summarisation of a ranked piece of information is based on its weighted relevance value. Optionally, a ranked piece of information with a maximal positive weighted relevance is not summarised, and a ranked piece of information with a weighted relevance equal to or exceeding a predefined threshold value is summarised. Optionally, the method further comprises generating a plurality of summaries of each of a plurality of the ranked pieces of information, and caching the plurality of summaries. Optionally, each of the plurality of summaries comprises a different length. Optionally, the storage comprises a cache or a database. Optionally, the method further comprises storing the revised first prompt in storage for use in revising subsequent prompts. Optionally, the method further comprises reviewing the contents of storage for additional piece(s) of information, identifying piece(s) of information relevant to the contents of the first prompt based on one or more criteria, and adding the piece(s) of information to the contextual data for revision of the first prompt. Optionally, the method further comprises replacing one or more of the ranked piece(s) of information in the contextual data with a different piece of information from storage having a greater relevance to the content of the first prompt based on a weighted relevance value comparison. Optionally, the method further comprises assessing the similarity of at least two pieces of information in storage, and merging the at least two pieces in response to determining they are characterised by a similarity exceeding a predefined threshold value. Optionally, assessing the similarity of the at least two pieces of information comprises determining a weighted relevance value of one or each relative to the other(s) and comparing the determined value(s). According to a second aspect of the present disclosure there is provided a computer-implemented method for optimising contextual data utilised by a generative artificial intelligence (genAI) model, comprising the following steps: receiving a plurality of pieces of information to a computing system; generating a summary of the content of at least some of the pieces of information; receiving a first prompt at a user input field associated with the genAI model; computing weighted relevance values of the pieces of information compared with the first prompt; adding a number of the most relevant pieces of information to the contextual data; generating a revised version of the first prompt using the pre-defined number of the most relevant pieces of information. As noted above, the inventors have found that the exemplary methods disclosed herein enhance the quality of prompts to AI models by improving their contextual data, whilst at the same time managing the significant demands placed on computer resources that can result from increasing the amount of contextual information the genAI model is tasked with considering. In particular, the exemplary methods facilitate a greatly reduced load on computing systems utilising generative AI models both in terms of bandwidth and CPU usage. Optionally, the method further comprises repeating the step of adding a one or more of the most relevant pieces of information to the contextual data. Optionally, the method further comprises repeating the step of adding a predefined number of the most relevant pieces of information to the contextual data until a predefined token limit is reached for the pieces of information. Optionally, the method further comprises replacing one or more of the ranked piece(s) of information in the contextual data with a different piece of information from storage having a greater relevance to the content of the first prompt based on a weighted relevance value comparison. Optionally, the method further comprises assessing the similarity of at least two pieces of information in storage, and merging the at least two pieces in response to determining they are characterised by a similarity exceeding a predefined threshold value. Optionally, comparing the similarity of the at least two pieces of information comprises determining a weighted relevance value of one or each relative to the other(s) and comparing the determined value(s). Optionally, computing weighted relevance values of the pieces of information comprises creating a vector representation of each of the pieces of information, creating a vector representation of the first prompt, and comparing the vector representation of each of the pieces of information with the vector representation of the first prompt. Optionally, the method further comprises storing the revised first prompt for use in revising subsequent prompts. According to a further aspect of the present disclosure, there is provided a system for implementing the computer implemented method described above and disclosed herein. The system comprises a virtual environment in which a generative artificial intelligence (genAI) model is deployed. The virtual environment comprises at least one user input field for the user to input a prompt to the gen AI model. The gen AI model and / or the virtual environment is in communication with one or more storage elements comprising pieces of information. Optionally, the virtual environment comprises a website, a web application, a mobile application, a virtual reality environment, or an augmented reality environment. According to a further aspect of the present disclosure there is provided computer-readable media comprising instructions stored thereon that, when executed by one or more processors, cause the processor(s) to carry out the steps of the methods described above and disclosed herein. Brief Description of Drawings Figures 1-3 illustrate embodiments of a computer-implemented “scale-down” method for optimising the contextual data utilised by a gen AI model according to an exemplary embodiment of the present disclosure; Figure 4 provides a flow diagram including steps of a computer-implemented “scale-up” method for optimising the contextual data utilised by a genAI according to an exemplary embodiment of the present disclosure; Figure 5 provides a conceptual illustration of a computer-implemented “scale-up” method according to an exemplary embodiment of the present disclosure; Figure 6 illustrates an aspect of a computer-implemented “scale-up” method according to an exemplary embodiment of the present disclosure. Figure 7 illustrates a system for implementing the exemplary methods described in the embodiments of the present disclosure. Detailed Description of Drawings The present disclosure of methods and systems for optimising the contextual information utilised by genAI models will now be made with reference to the accompanying drawings. The methods may be stored as a set of instructions on appropriate computer-readable media and are executable by one or more processors. The steps of the methods described herein may be performed by the genAI model receiving user prompts, or by another AI model, or by another non-AI software application that is appropriately configured for the relevant task. When referring to “storage” in the present disclosure, it will be understood to mean one or more data storage modules, a database, or a cache, located remotely or locally with respect to the deployment of the genAI model. The genAI model may comprise any suitably configured generative artificial intelligence model that permits inputting of prompts including one or more of natural language, images, videos, and audio files. For example, the genAI model may comprise or utilise any known model, such as but not limited to GPT-3, GPT-4, BERT, DALL-E, StyleGAN, VQ-VAE-2, WaveNet, and so on. Alternatively, the genAI model may be an in-house, custom-built model. Referring to Figure 1, a flow diagram illustrates an exemplary computer-implemented method for optimising contextual data utilised by a genAI model. In a first step 110, a first prompt is received at a user-input field of the genAI model. The user-input field may comprise a text box, an attachment button, and so on. The genAI model, or another software application, analyses the contents of the first prompt to identify one or more characteristics of the prompt. Characteristics may include, but are not limited to, tokenisation, semantic analysis, intent, an attention mechanism, context understanding, and so on. The genAI model, or another software application, then analyses the contents of storage and computes 120 a relevance score for each of a number of pieces of information in storage in order to identify contextual information that can be utilised in revising the first prompt. The relevance score is a metric designed to determine the degree of relevance a piece of information has with respect to the contents of the user’s prompt. The relevance score may comprise a weighted relevance score involving any of a variety of known techniques. For example, determining the weighted relevance score for a piece of information may involve creating a vector representation of a piece of information, creating a vector representation of the first prompt, and comparing the vector representation of the pieces of information with the vector representation of the first prompt. The degree of relevance in the vector representation may correspond to an embedding distance between the vector representation of the first prompt and the vector representation of the piece of information in a feature space. In various embodiments, the embedding distance may comprise a Euclidean distance, a cosine similarity, or a Manhattan distance. The genAI model, or another software application, may then rank 130 the relevance of each of the pieces of information that have been scored. The ranking comprise a listing from most relevant to least relevant, or vice versa. The token sum of the remaining ranked pieces of information is then computed, and one or more ranked pieces of information are then removed 140 from the contextual data at least in part based on a pre-defined token limit. The predefined token limit may be any number of tokens dependent on the use cases and is not intended to be limiting. Preferably, although not exclusively, the removal of ranked piece(s) of information begins with the least relevant pieces of information, working “up” the ranking. The method of Figure 1 may be described as a “scale-down” method of optimising the contextual information utilised by genAI models, because it starts with a ranking of some or all of the pieces of information in storage based on their relevance and cuts back pieces from the contextual data to be used based on one or more parameters such as the pre-defined token limit. Subsequent to removing ranked piece(s) of information from the contextual data, and once the token sum is less than or equal to the token limit, the genAI model may then utilise the remaining ranked pieces of information as contextual data to generate 150 a revised version of the first prompt. The revised first prompt may comprise the original user prompt and the selected contextual information from storage, or it may comprise an altered version of the original user prompt, or it may comprise an altered version of the original user prompt together with the selected contextual information from storage. By weighting and ranking the relevance of pieces of information in storage relevant to the first prompt, and then dropping ranked, weighted pieces of information from the contextual data based on the pre-defined token limit, the method of Figure 1 enhances the quality of the prompt whilst managing the demands placed on computer resources by increasing the amount of contextual information the genAI model must consider. In some embodiments the revised prompt may be stored for use in revising subsequent prompts received by the genAI model. Referring to Figure 2, a method similar to Figure 1 is illustrated but with additional advantageous features that further optimise the contextual data that is to be utilised. A summary of one or more of the ranked pieces of information is generated 210, thus reducing the number of tokens that a piece of information occupies. A summary preferably comprises a natural language string of text of a given length describing the contents of the piece of information. For example, if the piece of information is a Microsoft Word® file comprising 10 ten pages of text, a summary may be, but is not limited to, a 5-10 -sentence overview of the contents of the file including salient information. In another embodiment, if the piece of information is an image file, the summary may be, but is not limited to, a 1-3 sentence overview of what is depicted in the image. The token sum of the summarised ranked piece(s) of information is then computed, and if the sum size of the pieces still does not fit the token limit, the summarised ranked piece(s) of information are then sequentially removed from the contextual data for the gen AI model to use in revising the prompt, preferably starting with the pieces of the lowest relevance . The inventors have found that incorporating summarisation step 210 in to the scale-down method of Figure 1 further helps to reduce the bandwidth and CPU usage of computer systems implementing genAI models, whilst still permitting the decorating of prompts with important contextual data that improve their quality and ultimately the quality of model outputs. Moreover, model reliability is enhanced when the model is able to augment prompts within the bounds of its hardware resources. In some embodiments, the extent of summarisation 210 of a ranked piece of information is based on its weighted relevance value. As one example, a ranked piece of information with a maximal positive weighted relevance may not be summarised at all and instead is used in full as contextual data by the genAI model, whilst a ranked piece of information with a weighted relevance equal to or exceeding a predefined threshold value may be summarised. For example, a piece of information with a low degree of relevance may be summarised extensively. This helps to prioritise computer resources based on the extent to which contextual data will actively improve prompt quality, and therefore model output quality. The “scale-down” method of Figures 1 and 2 may be adjusted at any point with replacements or additions of further contextual data from storage, in an iterative approach. For example, in one embodiment, the methods of Figures 1 and 2 may include an additional step in which the genAI model or another software application reviews the contents of storage for additional piece(s) of information that could be used to revise the first prompt. The identification of additional piece(s) of information relevant to the contents of the first prompt may be based on one or more criteria, but preferably involves a relevance score such as the weighted relevance value, with respect to the contents of the first prompt. The steps 130-140 of Figure 1 may be performed again one or more times, and the additional piece(s) of information may be added to the contextual data for revision of the first prompt. In another embodiment, the genAI model or another software application replaces one or more of the ranked piece(s) of information in the contextual data with a different piece of information from storage having a greater relevance to the content of the first prompt based on a weighted relevance value comparison. In other embodiments, the similarity of at least two pieces of information in storage may be assessed by the genAI model, and if it is determined that they are characterised by a similarity exceeding a predefined threshold value, they may be merged. In order to assess the similarity of the at least two pieces of information, their weighted relevance values in relation to each other may be determined. Only if the at least two pieces of information are similar to each other to within a predefined value and not to the user prompt, are they then merged. Figure 3 provides a further illustrative example of the scale-down method . Pieces of information are represented by a series of blocks of different sizes denoting the varied file sizes in storage. A token limit is pre-defined, for example by an administrator of the genAI model, and is represented conceptually by a horizontal dashed line. In an optional step 1, any pieces of information that are deemed “unrelated” may be removed from the contextual data to be used at the outset. By “unrelated” it is meant that the piece of information is either unreferenced by the prompt, or the piece of information has a relevance close to or equal to nil (i.e. totally irrelevant to the content of the first prompt). The determination of a piece of information being unrelated may be based on relevance scoring as in step 120 of Figure 1. In step 2, corresponding to step 120 of Figures 1 and 2, the weighted relevance values of the remaining pieces of information in storage for consideration are computed. In some embodiments involving workflow systems, the weighted relevance value could be based on a static distance of a piece of information in a workflow relative to the prompt’s place in the workflow. For example the workflow system may be an e-learning platform having a course comprising 100 tasks to be completed by a student; the distance in this example is the number of tasks between the task related to the piece of information and the task in relation to which the user is inputting a prompt to the genAI model. In other embodiments the weighted relevance value could be based on a vector (embedding) distance. In step 3, corresponding to step 130 of Figure 3, the weighted relevance pieces of information are ranked according to their degree of relevance to the contents of the prompt. In the example of Figure 3 the relevance scoring is denoted on a scale of 0-1, with the most relevant pieces of information being labelled with a “1”, and the least relevant pieces of information being labelled with a number close to 0. As unrelated values score “0” in this metric, they may already have been removed from the contextual data in optional step 1. A token sum of the weighted relevance ranked pieces of information may then be taken. Conceptually this can be seen in Figure 3 where the 11 most relevant pieces of information falling above the dashed token line are within the pre-defined token limit, and those pieces of information falling below the dashed token line exceed the pre-defined token limit. In the example of Figure 1, after step 3 the weighted relevance ranked pieces of information below the dashed token line are then removed 140 from the contextual data, and the remaining contextual data is utilised by the genAI model to generate a revised version of the first prompt. However, Figure 3 further comprises step 4 corresponding to step 210 of Figure 2, in which the weighted relevance ranked pieces of information are summarised, and in a final step 5 all summarised ranked pieces of information exceeding the pre-defined token limit are removed from the contextual data. In the embodiment of Figure 3, the degree of summarisation of a piece of information is a function of its relevance to the first prompt. Referring to Figures 4 and 5, an alternative solution to the “scale-down” method of Figures 1-3, that may be denoted the “scale-up” method, is provided. In the scale-down method of Figures 2 and 3, information already contained in storage is summarised in response to receipt of the first prompt. In contrast, the scale-up method of Figures 4 and 5 involves summarising information as it is received at a computing system and storing the summaries for consideration when a prompt is received, thus “building” a contextual data set rather than “stripping back” pieces from the contextual data as in the scale-down method. However, both the scale-up and scale-down methods address the same problem, namely the need for prompts and model outputs of improved quality whilst managing the computer resources that this can entail. In an initial step, a plurality of pieces of information are received 410 at a computing system. The computing system may be a server associated over a distributed network with a virtual environment e.g. an e-leaming website, and in this example the plurality of pieces of information may be answers to assignments and the like in the platform that have been uploaded by students. As pieces of information are received at the computing system, a summary of the content of each piece of information may be generated 420 and stored in memory. When a prompt is received 430 at a user input field of the genAI model, the relevance scores of the summarised pieces of information are computed 440 with respect to the content of the prompt. A predefined number of the most relevant pieces of information are then added 450 to the contextual data to be used by the genAI model. For example, in one embodiment the 5 highest relevance scoring pieces of information may be maintained in the contextual data and the other pieces removed. A revised version of the first prompt may then be generated 460 by the genAI model, utilising the predefined number of the most relevant pieces of information. In preferred embodiments, revising the prompt in the scale-up method comprises using the original prompt alongside the un-summarised most relevant pieces of information selected for contextual data. A conceptual example illustrating the selection of a pre-defined number of the most relevant pieces of information is depicted in Figure 6. Figure 5 illustrates another example embodiment of the scale-up method of Figure 4, but further including an iterative step of the genAI model assessing whether further pieces of information are necessary / useful as contextual data. This process is continued iteratively until the genAI model confirms that no further pieces are needed or a pre-defined token limit is reached. In other embodiments, the iterative process in Figure 5 may involve replacing or merging one or more pieces of information with other pieces of information in storage. Referring to Figure 7, embodiments of the present disclosure also provide a system in which the methods in Figures 1-6 may be deployed. The system at least comprises a computing system 710, such as a virtual environment 710, in which is deployed a generative artificial intelligence model or models 720. The computing system 710 preferably comprises at least one user input field for a user to input a prompt to the genAI model(s) 720 of the system. The virtual environment 710 may comprise a website, a web application, a mobile application, a virtual reality environment, an augmented reality environment. The virtual environment should be configured with an appropriate API in order to host the genAI model(s) 720. The model(s) 720 themselves may be deployed via any appropriate means such as but not limited to a cloud platform, e.g. Google® Cloud, Amazon® Web Services, or Microsoft Azure®. The genAI model 720 and / or the virtual environment 710 is in direct or indirect wireless communication with one or more storage elements 730 over a network. The storage element(s) 730 may comprise a cloud database(s), a cache(s), and the like, suitably configured to store the pieces of information. The storage element(s) 730 may or may not be part of the system itself. In some embodiments, the genAI model is communication with the storage element(s) 730, whilst in other embodiments software application(s) associated with the virtual environment is / are in communication with the storage element(s) 730. Case Study In an example case study demonstrating the advantages of the scale-down method of Figure 1, one might consider an online learning or work virtual environment 720 that includes courses having lecture videos to watch and assignments to download, complete and upload. The course may comprise a “workflow” with a number of tasks, such as the lectures to watch, assignments to complete, and so on. When a task is completed, the workflow moves on to the next task and some indication of progress in the workflow is provided on the administrator end and possibly also the user. Any answers provided by the student, such as documents, may be uploaded to the virtual environment 720 and stored in storage element(s) 730. The course may have a course administrator, denoted “user A”, and at least one student denoted “user B”. In one example, there may be 100 tasks in the workflow. Each task has a task description, on average 5 supporting documents attached related to the task that must be completed, and requires user B to input (upload) one document with their answer. The average token counts for these pieces of information are as follows: • Task description: 200 tokens • Supporting material: 2200 tokens each • User input: 3300 tokens This means that the token count of a typical task is 200 + 3300 + 5*2200 = 14,500 tokens. The token count in the full system of 100 tasks is therefore 100*14,500 = 1,450,000 tokens. Running this number of tokens in a genAI model 710 would be highly impractical and require substantial computational resources, if all of the tasks were to be utilised as contextual information. In this example let's say that each task has 3 other tasks that are "related" to the one in question. Two are related for belonging in the same group and one is related because the course administrator user A has marked it explicitly as a prerequisite. Now if one runs the scale-down method of Figures 1-3 and limits the full context in a way that one only takes into consideration the pieces of information tied to a single task, then one can rule out 99% of the pieces of information in storage 730. However, this may result in the model 710 missing important contextual information and resulting in an accurate or incomplete output. The dataset may instead be limited in such a way that it takes into consideration two levels: "current task" (1st level), and "any relation with current task" (2nd level: same group or prerequisite). Following the numbers above, this means one uses the data from 1+3=4 tasks corresponding to 58,000 tokens. Alternatively if we consider 3 levels, 1st level (1): current task; 2nd level (3): prerequisite of current + same group with current; 3rd level (3): prerequisite of 2nd level, the data usage originates from 1 + 3 + 3=7 tasks corresponding to 101,500 tokens. This demonstrates that, from e.g. step 1 in Figure 3 alone, the scale-down method is particularly effective in filtering a substantial part of the full dataset from storage 730, with 1 or 2 orders of magnitude less data for the next, more expensive steps to work on, where the genAI model 710 actually has to run through all remaining pieces and evaluate their weighted relevance values. Whilst the disclosure of the present invention has been made with reference to the accompany Figures, it will be appreciated that the invention is not limited to the specific examples in those Figures.

Claims

1. A computer-implemented method for optimising contextual data utilised by a generative artificial intelligence (genAI) model, comprising the following steps: receiving a first prompt at a user input field associated with the genAI model; computing weighted relevance values of pieces of information in storage; ranking the weighted relevance values of each of the pieces of information; removing ranked pieces of information from the contextual data at least in part based on a pre-defined token limit; andgenerating a revised version of the first prompt utilising the remaining ranked pieces of information as contextual data.

2. The method of claim 1, wherein before computing weighted relevance values of the pieces of information in the storage, the method further comprises:determining the presence of one or more pieces of information in the storage that are not related to the contents of the first prompt, andremoving said one or more unrelated pieces of information from the contextual data.

3. The method of claim 1 or claim 2, wherein computing weighted relevance values of the pieces of information in the storage comprises:creating a vector representation of each of the pieces of information, creating a vector representation of the first prompt, andcomparing the vector representation of each of the pieces of information with the vector representation of the first prompt.

4. The method of claims 1-3, further comprising generating a summary of one or more of the ranked pieces of information, and computing the token sum of the summarised ranked piece(s) of information, wherein the step of removing ranked pieces of information from the contextual data comprises removing one or more summarised pieces based on the pre-defined token limit.

5. The method of claim 4, wherein an extent of summarisation of a ranked piece of information is based on its weighted relevance value.

6. The method of claim 5, wherein a ranked piece of information with a maximal positive weighted relevance is not summarised, and a ranked piece of information with a weighted relevance equal to or exceeding a predefined threshold value is summarised.

7. The method of claims 1-6, further comprising generating a plurality of summaries of each of a plurality of the ranked pieces of information, and caching the plurality of summaries.

8. The method of claim 7, wherein each of the plurality of summaries comprises a different length.

9. The method of claims 1-8, wherein the storage comprises a cache or a database.

10. The method of claims 1-9, further comprising storing the revised first prompt in storage for use in revising subsequent prompts.

11. The method of claims 1-11, further comprising reviewing the contents of storage for additional piece(s) of information, identifying piece(s) of information relevant to the contents of the first prompt based on one or more criteria, and adding the piece(s) of information to the contextual data for revision of the first prompt.

12. The method of claims 1-12, further comprising replacing one or more of the ranked piece(s) of information in the contextual data with a different piece of information from storage having a greater relevance to the content of the first prompt based on a weighted relevance value comparison.

13. The method of claims 1-13, further comprising assessing the similarity of at least two pieces of information in storage, and merging the at least two pieces in response to determining they are characterised by a similarity exceeding a predefined threshold value.

14. The method of claim 13, wherein assessing the similarity of the at least two pieces of information comprises determining a weighted relevance value of one or each relative to the other(s) and comparing the determined value(s).

15. A computer-implemented method for optimising contextual data utilised by a generative artificial intelligence (genAI) model, comprising the following steps; receiving a plurality of pieces of information to a computing system;generating a summary of the content of at least some of the pieces of information; receiving a first prompt at a user input field associated with the genAI model;computing weighted relevance values of the pieces of information compared with the first prompt;adding a number of the most relevant pieces of information to the contextual data; generating a revised version of the first prompt using the pre-defined number of the most relevant pieces of information.

16. The method of claim 15, further comprising repeating the step of adding a one or more of the most relevant pieces of information to the contextual data.

17. The method of claim 16, comprising repeating the step of adding a predefined number of the most relevant pieces of information to the contextual data until a predefined token limit is reached for the pieces of information.

18. The method of claims 15-17, further comprising replacing one or more of the ranked piece(s) of information in the contextual data with a different piece of information from storage having a greater relevance to the content of the first prompt based on a weighted relevance value comparison.

19. The method of claims 15-18, further comprising assessing the similarity of at least two pieces of information in storage, and merging the at least two pieces in response to determining they are characterised by a similarity exceeding a predefined threshold value.

20. The method of claims 15-19, wherein comparing the similarity of the at least two pieces of information comprises determining a weighted relevance value of one or each relative to the other(s) and comparing the determined value(s).

21. The method of claims 15-20, wherein computing weighted relevance values of the pieces of information comprises:creating a vector representation of each of the pieces of information, creating a vector representation of the first prompt, andcomparing the vector representation of each of the pieces of information with the vector representation of the first prompt.

22. The method of claims 15-21, further comprising storing the revised first prompt for use in revising subsequent prompts.

23. A system for implementing the computer implemented method of any one of claims 1-22, comprising a virtual environment in which a generative artificial intelligence (genAI) model is deployed, wherein the virtual environment comprises at least one user input field for the user to input a prompt to the genAI model, and wherein the genAI model and / or the virtual environment is in communication with one or more storage elements comprising pieces of information.

24. The system of claim 23, wherein the virtual environment comprises a website, a web application, a mobile application, a virtual reality environment, or an augmented reality environment.

25. Computer-readable media comprising instructions stored thereon that, when executed by one or more processors, cause the processor(s) to carry out the steps of any of claims 1-22.

Images