Interface interaction method and apparatus, device, and storage medium
By presenting interactive components in the interface and adjusting the display style based on context information, the problem of low efficiency in traditional human-computer interaction is solved, achieving more efficient information acquisition and an improved user experience.
Patent Information
- Application Number
- PCT/CN2025/103310
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-06-30
- Filing Date
- 2025-06-25
- Publication Date
- 2026-01-08
AI Technical Summary
Traditional human-computer interaction relies on precise user operations, resulting in low information acquisition efficiency and poor user experience.
By presenting interactive components in the target interface and determining the target level of the interaction intent based on the acquired context information, the display style of the interactive components is adjusted to adapt to different context information of the user and device.
It improves the efficiency of information exchange and enhances the user's interactive experience by proactively adjusting the display style of interactive components to better match the user's interactive intent.
Smart Images

Figure CN2025103310_08012026_PF_FP_ABST
Abstract
Description
Interface interaction method, device, equipment and storage medium
[0001] The present application claims priority to the Chinese patent application No. 202410870573.3, filed on June 30, 2024, entitled "Interface interaction method, device, equipment and storage medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD
[0002] The example embodiments of the present disclosure generally relate to the field of computer, and in particular, to an interface interaction method, device, equipment and computer readable storage medium. BACKGROUND
[0003] With the development of computer technology, human-computer interaction has become an important link affecting the interactive experience of users. Traditional human-computer interaction scenarios usually rely on the accurate triggering operation of the user on the interactive component. Such a process relies on the accurate operation of the user and affects the efficiency of obtaining information. SUMMARY
[0004] In a first aspect of the present disclosure, an interface interaction method is provided. The method comprises: presenting an interactive component in a target interface; determining a target level of an interaction intention for the interactive component based on obtained target context information, the target context information comprising first context information associated with a user and / or second context information associated with a device; and adjusting a display style of the interactive component based on the target level of the interaction intention.
[0005] In a second aspect of the present disclosure, an apparatus for interface interaction is provided. The apparatus comprises: a presentation module configured to present an interactive component in a target interface; a determination module configured to determine a target level of an interaction intention for the interactive component based on obtained target context information, the target context information comprising first context information associated with a user and / or second context information associated with a device; and an adjustment module configured to adjust a display style of the interactive component based on the target level of the interaction intention.
[0006] In a third aspect of the present disclosure, an electronic device is provided. The device comprises at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the device to perform the method of the first aspect.
[0007] In a fourth aspect of the present disclosure, a computer readable storage medium is provided. The computer readable storage medium has stored thereon computer executable instructions executable by a processor to implement the method of the first aspect.
[0008] In a fifth aspect of the present disclosure, a computer program product is provided. The computer program product includes computer executable instructions that, when executed by a processor, implement the method according to the first aspect of the present disclosure.
[0009] It should be understood that nothing in the Summary is to be construed as a limitation of the key or important features of embodiments of the disclosure or as limiting the scope of the disclosure. Other features of the disclosure will be apparent from review of the disclosure, which is described in its entirety herein. BRIEF DESCRIPTION OF DRAWINGS
[0010] The above and other features, aspects and advantages of embodiments of the present disclosure will become more apparent from the following detailed description, taken in conjunction with the accompanying drawings, in which like reference numbers represent like elements throughout. In the drawings:
[0011] FIG. 1 shows a schematic diagram of an example environment in which embodiments according to the present disclosure can be implemented;
[0012] FIGS. 2A-2H show interaction diagrams according to some embodiments of the present disclosure;
[0013] FIG. 3 shows a flow diagram of a process of example interface interactions according to some embodiments of the present disclosure;
[0014] FIG. 4 shows a schematic structural block diagram of example interface interactions according to some embodiments of the present disclosure; and
[0015] FIG. 5 shows a block diagram of an electronic device capable of implementing various embodiments of the present disclosure. DETAILED DESCRIPTION
[0016] Embodiments of the present disclosure will be described hereinafter with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein; rather, these embodiments are provided so that the present disclosure will be more thoroughly and completely understood. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure.
[0017] It should be noted that the headings provided herein are not limitations of the various embodiments described herein. The various embodiments described throughout this document can be included under any heading. Additionally, embodiments described in any heading can be combined with any other embodiment described in the same heading and / or a different heading in any manner.
[0018] In the description of the embodiments of the present disclosure, the term "comprising" and its similar terms shall be understood as open inclusion, i.e., "including but not limited to". The term "based on" shall be understood as "at least partially based on". The term "one embodiment" or "the embodiment" shall be understood as "at least one embodiment". The term "some embodiments" shall be understood as "at least some embodiments". The following can also include other explicit and implicit definitions. The terms "first", "second", etc. can refer to different or same objects. The following can also include other explicit and implicit definitions.
[0019] The embodiments of the present disclosure can involve data of users, acquisition and / or use of data, etc. These aspects all comply with corresponding laws and regulations and relevant provisions. In the embodiments of the present disclosure, all collection, acquisition, processing, processing, forwarding, use, etc. of data are performed on the premise that the user is aware of and confirms. Accordingly, when implementing the embodiments of the present disclosure, the type of data or information that can be involved, the use range, the use scenario, etc. should be notified to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations. The specific notification and / or authorization manner can vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this aspect.
[0020] In the present specification and embodiments, if the scheme involves processing of personal information, it will be processed on the premise of having a legal basis (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and will only be processed within the prescribed or agreed range. The user refuses to process personal information other than the necessary information required for the basic function, which does not affect the user's use of the basic function.
[0021] In the process of traditional human-computer interaction, the interactive component is difficult to adaptively change according to the user's interaction intention. This makes the interactive component rely on the user's active interaction to provide information, thereby affecting the efficiency of information provision and reducing the user experience.
[0022] Embodiments of the present disclosure propose an interface interaction scheme. According to the scheme, an interactive component can be presented in a target interface; based on acquired target context information, a target level of an interaction intention for the interactive component is determined, the target context information including first context information associated with a user and / or second context information associated with a device; and based on the target level of the interaction intention, a display style of the interactive component is adjusted.
[0023] In this way, the embodiments of the present disclosure can determine the level of the interaction intention for the interactive component, and adaptively adjust the display style of the interactive component according to different levels, thereby improving the efficiency of information interaction and improving the user's interaction experience.
[0024] Various example implementations of the subject innovation are described in further detail below in connection with the accompanying drawings.
[0025] Example Environment
[0026] FIG. 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the disclosure can be implemented. As shown in FIG. 1, the example environment 100 can include an electronic device 110.
[0027] In this example environment 100, the electronic device 110 can be running an application 120 that supports interface interaction. The application 120 can be any suitable type of application for interface interaction. A user 140 can interact with the application 120 via the electronic device 110 and / or its attached devices.
[0028] In the environment 100 of FIG. 1, the electronic device 110 can present an interface 150 for supporting interface interaction through the application 120 if the application 120 is in an active state.
[0029] In some embodiments, the electronic device 110 communicates with a server 130 to implement provisioning of services to the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a tablet computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including accessories and peripherals of these devices, or any combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as “wearable” circuitry, etc.).
[0030] The server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content distribution networks, and basic cloud computing services such as big data and artificial intelligence platforms, etc. The server 130 may, for example, include a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, etc. The server 130 can provide background services for the application 120 in the electronic device 110 that supports content presentation.
[0031] A communication connection can be established between the server 130 and the electronic device 110. The communication connection can be established through a wired manner or a wireless manner. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a universal serial bus connection, a wireless fidelity connection, and the like, and embodiments of the present disclosure are not limited in this regard. In embodiments of the present disclosure, the server 130 and the electronic device 110 can implement signaling interaction through the communication connection therebetween.
[0032] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, without implying any limitation on the scope of the present disclosure.
[0033] Example interaction
[0034] An example interaction process according to embodiments of the present disclosure will be described below with reference to the accompanying drawings.
[0035] According to some embodiments of the present disclosure, the electronic device 110 can determine the interaction intention of the user for a specific interaction component based on the obtained target context information. Further, the electronic device 110 can rank such interaction intention to determine a target level of the interaction intention.
[0036] Further, the electronic device 110 can adjust the display style of the interaction component based on the target level of the interaction intention, so that the display style can match the target level.
[0037] In this way, embodiments of the present disclosure can actively adjust the style of the interaction component according to the level of the interaction intention, thereby improving the efficiency of information interaction.
[0038] In some embodiments, such target context information can include first context information associated with the user. In some examples, the electronic device 110 can determine the focus position of the user in the target interface based on the first context information.
[0039] Further, the electronic device 110 can determine the target level of the interaction intention for the interaction component based on the relevance between the focus position and the target hot area of the interaction component.
[0040] Examples of determining the target level of the interaction intention based on the target hot area of the interaction component will be described below with reference to FIGS. 2A to 2D.
[0041] In some embodiments, the electronic device 110 can determine the relevance between the focus position and the target hot area of the interaction component based on the distance between the focus position and the target hot area.
[0042] FIG. 2A illustrates a schematic diagram of an interaction, according to some embodiments of the present disclosure. As shown in FIG. 2A, near the target interaction component (e.g., component one), the electronic device 110 can be divided into two areas based on the distance from the target interaction component. One area is an area where hover can be triggered (e.g., area one), and the other area is a hot area (also referred to as a target hot area) where prehover is triggered (e.g., area two).
[0043] In some embodiments, the electronic device 110 can predict the target interaction component that the user is about to trigger. As an example, when the focus position of the user (e.g., a cursor position, a gaze focus position, a finger position, etc.) is in area two, it indicates that the likelihood of the user triggering component one is greater than other components, i.e., the electronic device 110 predicts that the target interaction component to be triggered is component one.
[0044] In some embodiments, the electronic device 110 can determine first context information associated with the user, e.g., based on input information of the user. Such input information can include, but is not limited to, gesture information of the user, eye movement information, or input information generated using any other appropriate interaction device (e.g., a mouse, a joystick, etc.). Further, the electronic device 110 can determine the focus position of the user in the interface based on the first context information. For example, the electronic device 110 can determine whether the focus position moves into the range of the target hot area of the target interaction component, to predict the target interaction component that the user is about to select. For ease of description, the following is described by way of example using a navigation cursor.
[0045] In some embodiments, the target hot area of the target interaction component can be, e.g., a two-dimensional plane, a three-dimensional space, or a real environment in which the target interaction component is located. The present disclosure is not intended to limit the range of the hot area of the target interaction component.
[0046] In some embodiments, referring to FIG. 2B, the electronic device 110 can adaptively change the range of the target hot area based on the properties of the target interaction component itself, the location, the layout of the interface, and different application scenarios. As an example, when the location of the target interaction component is near the edge of the panel, the target hot area can also be optimized from the interaction experience, and the range of the hot area can be enlarged to better capture the intention of the user. In this way, the electronic device 110 can generate a target hot area that conforms to the interaction intention.
[0047] In some embodiments, referring to FIG. 2C, the electronic device 110 can adjust the target hot area accordingly based on the combination of the components.
[0048] In some embodiments, when the hot areas of two components overlap, the electronic device 110 can divide the weight of the range of the hot area in order to more clearly predict the intention of the user, and the corresponding integral in different weight ranges is also different.
[0049] In some embodiments, the electronic device 110 can determine the heat zone integral of different components based on the navigation cursor to predict the target interactive component that the user is about to select. For example, for the overlapping area part, the electronic device 110 can determine the component corresponding to the maximum heat zone integral as the target interactive component. Referring to FIG. 2D, component one and component two each have a corresponding exclusive heat zone, and the current position of the navigation cursor is within the heat zone of component one and also within the heat zone of component two. As an example, the electronic device 110 can determine the heat zone integral of component one and component two, and the integral value of component one (0.5) is higher than that of component two (0.2).
[0050] At this time, the electronic device 110 determines that component one is more likely to be the user's interactive target, and thus enlarges the component in advance or displays the component in a form that is distinguished from other components, thereby helping the user to more easily perform the selection operation.
[0051] In some examples, the electronic device 110 can also determine the relevance between the focus position and the target heat zone between the interactive component based on the motion information of the focus position relative to the target heat zone.
[0052] As an example, the electronic device 110 can also set a region of a multi-stage feature of the target interactive component. When the navigation cursor passes through this region, the electronic device 110 analyzes whether the cursor motion at this time meets the curve condition of the speed or acceleration based on the movement data collected in real time for the navigation cursor. If it meets the condition, it is determined that the component is likely to be the intended target of the user, and the component is enlarged in advance, thereby helping the user to more easily perform the selection operation.
[0053] In some embodiments, the target heat zone of the interactive component can be associated with different target heat zone features for different types of interactive methods (e.g., eye movement, gesture, controller, etc.). Since different interactive methods each have different attributes (e.g., the size of the navigation cursor, the use precision, the behavior habit, etc.), the electronic device 110 can switch the heat zone features according to the currently used interactive method.
[0054] In some embodiments, the motion features considered by different types of interactive methods can also be different, and the target heat zone of the component can also be different. Taking eye movement interaction as an example, the target heat zone of the component can be adjusted based on the behavior features of the eye. As an example, the range of the heat zone can be enlarged, or the shape can be adjusted to be more suitable for the eye, etc. Thus, under different interactive methods, the heat zone features that match the interactive attributes can be obtained.
[0055] In some embodiments, the electronic device 110 can determine that the component is likely to be the target of the user's intention if the user gesture, eye movement, or other controller's navigation cursor frequently moves, shakes, or wavers at the edge of the target hot zone.
[0056] In some embodiments, with reference to FIG. 2E, when the navigation cursor slowly approaches the target interactive component, the electronic device 110 can gradually present the various parts of the component based on the preset hot zone features near the target interactive component, the information split of the component, and the current moving position of the navigation cursor. As an example, when the navigation cursor of the controller gradually approaches the area corresponding to the target interactive component (e.g., a music playing component) from outside the hot zone range of the target interactive component, the target interactive component can gradually present the music playing progress, volume, screen brightness, and controls for switching, pausing, and starting music playing.
[0057] In some embodiments, the first context information associated with the user can also be determined based on the input information of the user, as discussed above.
[0058] In some embodiments, the electronic device 110 can obtain the relevant state of the user based on the input, location, perception of the scene around the user, and various resources (e.g., weather conditions, traffic congestion, news, stock prices, user plans, retail prices, etc.) of the user. For ease of understanding, the process of the present disclosure is described first with the input of the user as an example.
[0059] In some embodiments, the electronic device 110 can perform a pre-processing operation on the input of the user. The input of the user can include, for example, text, image, gesture, natural speech, action, or any combination. Such a pre-processing operation can be, for example, type division of the input of the user, etc.
[0060] Further, the electronic device 110 can perform feature extraction on the input of the user. As an example, for text input, the electronic device 110 can extract semantic features, syntactic features, part-of-speech features, etc. in the text; for image input, the electronic device 110 can extract color features, shape features, texture features, etc. in the image; for gesture input, the electronic device 110 can extract shape features, position features, time features, etc. of the gesture; for natural speech input, the electronic device 110 can extract semantic features, speech features, etc. of the natural speech.
[0061] Further, the electronic device 110 needs to recognize the features of the user input based on the feature extraction. As an example, for text, the electronic device 110 can recognize the words, sentences, semantics, etc. in the text; for images, the electronic device 110 can recognize the objects, scenes, etc. in the images; for gestures, the electronic device 110 can recognize the meaning of the gestures; for natural speech, the electronic device 110 can recognize the intent in the natural speech.
[0062] Further, the electronic device 110 needs to understand the intent of the user input based on the feature recognition, to determine the first context information associated with the user.
[0063] In some embodiments, the target context information for determining the interaction intent of the user can include second context information associated with the device. Illustratively, the second context information associated with the device can include environmental information associated with the device. Such environmental information can include, but is not limited to, the location of the electronic device 110, the physical environment in which the electronic device 110 is located, etc.
[0064] In the present disclosure, any context information mentioned in the present disclosure (including the first context information associated with the user and the second context information associated with the device) is acquired and used with the relevant user's knowledge and authorization.
[0065] In some embodiments, the second context information associated with the device can include task information associated with the device. For example, the task information can include the task flow of the electronic device 110, such a task flow can indicate the flow relationship between different tasks, the current execution task of the task flow, etc.
[0066] In some embodiments, the electronic device 110 can rank the interaction intent based on the target context information described above, to determine the target level of the interaction intent.
[0067] In some embodiments, the electronic device 110 can determine a plurality of sets of preset conditions corresponding to a plurality of preset levels. Further, the electronic device 110 can determine the target level from the plurality of preset levels based on the comparison of the target context information and the plurality of sets of preset conditions.
[0068] Taking the distance from the user’s focus position (e.g., the cursor position) to the target hot zone of the interactive component as an example, the electronic device 110 can determine the target interactive component that the user currently intends to operate based on the distance. Further, the electronic device 110 can further determine the level of the interaction intent based on the distance from the user’s focus position to the target interactive component (e.g., the distance to the center of the component). As an example, after determining the target interactive component that the user currently intends to operate, the electronic device 110 can divide the different levels of the interaction intent of the user for the interactive component based on the comparison of the distance from the focus position to the target interactive component with multiple distance ranges. For example, a larger distance can correspond to a lower level of the interaction intent, and a smaller distance can correspond to a higher level of the interaction intent.
[0069] As another example, the electronic device 110 can also grade the interaction intent based on the motion information of the focus position relative to the target interactive component. For example, if the electronic device 110 determines that the focus position is accelerating towards the target interactive component, the electronic device 110 can determine that it can indicate a higher level of the interaction intent. In contrast, if the electronic device 110 determines that the focus position is accelerating away from the target interactive component, the electronic device 110 can determine that it can indicate a lower level of the interaction intent.
[0070] As another example, the electronic device 110 may, for example, also utilize a machine learning model to process the target context information to determine the target level of the interaction intent for the interactive component. For example, the electronic device 110 can utilize a classification model to process the target context information to classify the level of the interaction intent, thereby determining the target level of the interaction intent.
[0071] It should be understood that any appropriate grading strategy can be used to divide the strength of the interaction intent, and the present disclosure is not intended to be limited in this regard.
[0072] The following will further describe an example process of adjusting the display style of the interactive component according to the target level of the target intent with reference to FIGS. 2F-2H.
[0073] In some embodiments, the electronic device 110 can split the interactive component into multiple independent sub-components based on the understanding of the interaction intent of the user, and each sub-component can be responsible for specific information presentation.
[0074] Further, the electronic device 110 can determine one or more sub-components that match the target level from the multiple independent sub-components based on the target level of the interaction intent, and can dynamically combine the one or more sub-components as the adjusted interactive component.
[0075] In some embodiments, referring to FIG. 2F, the interaction component 210 can be displayed in the target interface. As an example, the interaction component 210 can be used to display images in a photo album. When the electronic device 110 detects that the user is gazing at the interaction component 210 at this time, the level of the interaction intention can be determined based on the analysis of the user's attention (e.g., the size of the pupil at this time, the degree of focus, and whether the user is in a reading state, etc.). Further, the electronic device 110 can adjust the display style of the interaction component 210 based on the interaction intention.
[0076] For example, the electronic device 110 can adjust the display size of the interaction component 210 to enlarge the currently displayed image. Further, the electronic device 110 can capture that the user is very focused on gazing at the interaction component 210, and can further update the level of the interaction intention. Accordingly, the electronic device 110 can further adjust the interaction component to present more independent sub-components. For example, the adjusted interaction component can have a larger display size, and can display more information of the image (e.g., the time of shooting, the location, etc.). Additionally, the electronic device 110 may, for example, also recommend a list of applications 212 that can share or edit the image.
[0077] In some embodiments, referring to FIG. 2G, the electronic device 110 can determine the level of the user's interaction intention for the application A based on the second context information. For example, the electronic device 110 can grade the interaction intention based on the current location or scene, and provide the corresponding hierarchical representation of the application A.
[0078] As an example, when the user arrives near a certain commercial district, the electronic device 110 can push some related applications to the user based on the user's geographic location. When the user enters a shopping mall, the electronic device 110 can re-determine the intention based on the geographic location, and recombine the component hierarchy to present the rating information of the stores in the current shopping mall, a brief summary, etc. When the user enters a restaurant, the electronic device 110 can recombine the components based on the user's current specific restaurant location, and push the detailed menu information of the current restaurant, etc.
[0079] In some embodiments, the electronic device 110 can dynamically combine and hierarchically present the components based on the minimum value that the user can understand to carry important information according to the current state of the user, to shorten the user interaction process. As an example, as the user's task flow changes, the presentation of the components will also change, and the carried information will also conform to the current user's task flow.
[0080] In some embodiments, referring to FIG. 2H, it is illustrated that the electronic device 110 can save the previous task flow 220 of the user, such as the task flow 220 including the application F, the application H, and the application G. When the user takes a preset operation (e.g., a right swipe operation), the electronic device 110 can automatically make a recommendation based on the previously saved task flow. If the current recommendation does not meet the user's expectations, the user can also select based on the application programs recommended by the electronic device 110 in the preset area 224, or the user can directly customize the selection based on the preset control 226.
[0081] In some embodiments, the electronic device 110 can also adjust the display position of the target interaction component according to the level of the interaction intention when adjusting the display style of the target interaction component. For example, the target interaction component can be displayed in a higher priority position when the interaction intention is stronger; conversely, the target interaction component can be displayed in a lower priority position. As an example, the area in the center position of the interface can have a higher priority than the area in the edge position.
[0082] In some embodiments, such an interaction component can be an information display component provided in the graphical user interface of the mobile device. As an example, the information display component can be displayed in the top area of the graphical user interface.
[0083] It should be understood that although the above describes the style adjustment process of the interaction component as an example in the graphical user interface of the mobile device, the above solution is also applicable to the interaction component in any other appropriate interaction interface, examples of which can include but are not limited to the interaction component in the graphical interface of a personal computer, the interaction component in a virtual interaction scene (e.g., an XR scene), the interaction component in a projection interaction scene, and the like.
[0084] In this way, the embodiments of the present disclosure can obtain the user intention based on multiple approaches, and provide a hierarchical performance of the matching of the interaction component through the analysis of the user intention by the electronic device. Thus, the embodiments of the present disclosure can optimize the interaction process of the user, more quickly reach the interaction expected by the user, and / or provide the information expected by the user.
[0085] Example process
[0086] FIG. 3 shows a flowchart of an example process 300 of interface interaction, according to some embodiments of the present disclosure. The process 300 can be implemented at the electronic device 110. The process 300 is described below with reference to FIG. 1.
[0087] As shown, at block 310, the electronic device 110 presents an interaction component in a target interface.
[0088] At block 320, the electronic device 110 determines a target level of the interaction intent for the interaction component based on the obtained target context information, the target context information including first context information associated with the user and / or second context information associated with the device.
[0089] At block 330, the electronic device 110 adjusts a display style of the interaction component based on the target level of the interaction intent.
[0090] In some embodiments, determining the target level of the interaction intent for the interaction component based on the obtained target context information includes determining a focus position of the user in the target interface based on the first context information, and determining the target level of the interaction intent for the interaction component based on a correlation between the focus position and a target hot area of the interaction component.
[0091] In some embodiments, the correlation is determined based on at least one of a distance between the focus position and the target hot area, and motion information of the focus position relative to the target hot area.
[0092] In some embodiments, the first context information is determined based on input information of the user.
[0093] In some embodiments, the second context information includes at least one of environmental information associated with the device, and task information associated with the device.
[0094] In some embodiments, determining the target level of the interaction intent for the interaction component based on the obtained target context information includes determining a plurality of groups of preset conditions corresponding to a plurality of preset levels, and determining the target level from the plurality of preset levels based on a comparison between the target context information and the plurality of groups of preset conditions.
[0095] In some embodiments, determining the target level of the interaction intent for the interaction component based on the obtained target context information includes processing the target context information using a machine learning model to determine the target level of the interaction intent for the interaction component.
[0096] In some embodiments, adjusting the display style of the interaction component based on the target level of the interaction intent includes at least one of adjusting a display state of at least one element in the interaction component based on the target level, adjusting a display size of the target interface in the interaction component based on the target level, and adjusting a display position of the interaction component in the target interface based on the target level.
[0097] In some embodiments, the interaction component is associated with a plurality of independent sub-components, and adjusting the display style of the interaction component based on the target level of the interaction intent includes determining a group of sub-components from the plurality of independent sub-components that matches the target level, and adjusting the interaction component by combining the group of sub-components.
[0098] In some embodiments, the interaction component includes an information presentation component displayed at a top region of the target interface.
[0099] Example apparatuses and devices
[0100] Embodiments of the present disclosure also provide a corresponding apparatus for implementing the above method or process. FIG. 4 shows a schematic structural block diagram of an example interface interaction apparatus 400 according to certain embodiments of the present disclosure. The apparatus 400 can be implemented as or included in the electronic device 110. Various modules / components in the apparatus 400 can be implemented by hardware, software, firmware, or any combination thereof.
[0101] As shown in FIG. 4, the apparatus 400 includes a presentation module 410 configured to present an interaction component in a target interface; a determination module 420 configured to determine a target level of an interaction intent for the interaction component based on obtained target context information, the target context information including first context information associated with a user and / or second context information associated with a device; and an adjustment module 430 configured to adjust a display style of the interaction component based on the target level of the interaction intent.
[0102] In some embodiments, the determination module 420 is further configured to determine the target level of the interaction intent for the interaction component based on the obtained target context information includes: determining a focus position of the user in the target interface based on the first context information; and determining the target level of the interaction intent for the interaction component based on a correlation between the focus position and a target hot area of the interaction component.
[0103] In some embodiments, the determination module 420 is further configured to determine the correlation based on at least one of: a distance between the focus position and the target hot area, motion information of the focus position relative to the target hot area.
[0104] In some embodiments, the determination module 420 is further configured to determine the first context information based on input information of the user.
[0105] In some embodiments, the determination module 420 is further configured to determine the second context information based on at least one of: environmental information associated with the device, task information associated with the device.
[0106] In some embodiments, the determination module 420 is further configured to determine the target level of the interaction intent for the interaction component based on the obtained target context information includes: determining a plurality of groups of preset conditions corresponding to a plurality of preset levels; and determining the target level from the plurality of preset levels based on a comparison between the target context information and the plurality of groups of preset conditions.
[0107] In some embodiments, the determining module 420 is further configured to determine the target level of the interaction intention for the interaction component based on the obtained target context information includes processing the target context information by using a machine learning model to determine the target level of the interaction intention for the interaction component.
[0108] In some embodiments, the determining module 420 is further configured to adjust the display style of the interaction component based on the target level of the interaction intention includes at least one of the following: adjusting a display state of at least one element in the interaction component based on the target level; adjusting a display size of the target interface in the interaction component based on the target level; adjusting a display position of the interaction component in the target interface based on the target level.
[0109] In some embodiments, the presenting module 410 is further configured to: the interaction component is associated with a plurality of independent sub-components, and adjusting the display style of the interaction component based on the target level of the interaction intention includes: determining a group of sub-components in the plurality of independent sub-components that matches the target level; and adjusting the interaction component by combining the group of sub-components.
[0110] In some embodiments, the presenting module 410 is further configured to: the interaction component includes an information display component displayed in a top region of the target interface.
[0111] The modules included in the apparatus 400 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units can be implemented using software and / or firmware, e.g., machine executable instructions stored on a storage medium. In addition to or alternatively, some or all of the modules in the apparatus 400 can be implemented at least partially by one or more hardware logic components. As an example and not by way of limitation, example types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SOCs), complex programmable logic devices (CPLDs), etc.
[0112] FIG. 5 shows a block diagram of an electronic device 500 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 500 illustrated in FIG. 5 is exemplary only and should not be taken as limiting on the functionality and scope of the embodiments described herein. The electronic device 500 illustrated in FIG. 5 can be used to implement the electronic device 110 of FIG. 1.
[0113] As shown in FIG. 5, electronic device 500 is in the form of a general-purpose electronic device. Components of electronic device 500 can include, but are not limited to, one or more processing units or processors 510, memory 520, storage 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. Processor 510 can be a real or virtual processor and capable of executing various processing units according to programs stored in memory 520. In a multi-processing system, multiple processors can execute computer-executable instructions in parallel to improve the processing power of electronic device 500.
[0114] Electronic device 500 typically includes a plurality of computer storage media. Such media can be any available media that is accessible by electronic device 500 and includes both volatile and non-volatile media, removable and non-removable media. Memory 520 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read only memory (ROM), electrically erasable programmable read only memory (EEPROM), flash memory), or some combination thereof. Storage 530 can be removable or non-removable media and can include machine- readable media such as a flash drive, a magnetic disk drive, or any other media that can be used to store information and / or data and that can be accessed by electronic device 500.
[0115] Electronic device 500 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, a disk drive for reading from or writing to a removable, non- volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable, non-volatile optical disk (e.g., a CD-ROM) can be provided. In such instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. Memory 520 can include a computer program product 525 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.
[0116] Communication unit 540 enables communications with other electronic devices over a communication medium. Additionally, the functionality of the components of electronic device 500 can be implemented in a single computing cluster or a plurality of computer machines capable of communicating over a communication connection. As such, electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes.
[0117] The input device 550 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 560 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown), such as storage devices, display devices, etc., one or more devices that enable a user to interact with the electronic device 500, or any devices (e.g., a network card, a modem, etc.) that enable the electronic device 500 to communicate with one or more other electronic devices, as desired via the communication unit 540. Such communication can be carried out via an input / output (I / O) interface (not shown).
[0118] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.
[0119] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0120] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0121] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0122] The computer program product of the present disclosure can be a computer program product, which is a machine-readable medium (media) having instances of the software embodied thereon, such as computer software, firmware, wireless application protocol (WAP), middleware or microcode. For example, a computer program product can be a floppy disk, a CD-ROM, a DVD, a Blu-ray Disc™, a flash drive, a memory stick, a magnetic tape, or a hard disk drive. The machine-readable medium can be a single medium, or multiple media, of the same or different type. The computer program product can be one or more computer program components embodied in medium and / or transmission signals. The computer program product can have one or more computer readable and / or computer executable components embodied in medium and / or transmission signals. The computer program product can be one or more computer readable and / or computer executable components embodied in medium and / or transmission signals. The computer program product can also be at least one or any combination of circuitry, integrated circuits, or processors dedicated for encoding and decoding execution result data. The computer program product can be supplied in a single package or distributed in multiple packages. The computer program product can be supplied as one or more computer programs, which were written to a disc or other computer readable medium, or were downloaded from a network.
[0123] The implementations of the disclosure have been described above with the intent to be illustrative rather than limiting. Although the implementations of the disclosure have been described with regard to one or more implementations, it will be recognized that various modifications and changes can be made by those skilled in the art that will achieve the desirable results of the implementations, such one or more of the above. For instance, different material can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials can be utilized. Different dimensions and shapes of the components can be utilized. Different materials
Claims
1. A method for interface interaction, comprising: presenting an interaction component in a target interface; determining a target level of an interaction intention for the interaction component based on obtained target context information, the target context information comprising first context information associated with a user and / or second context information associated with a device; and adjusting a display style of the interaction component based on the target level of the interaction intention.
2. The method of claim 1, wherein determining the target level of the interaction intention for the interaction component based on the obtained target context information comprises: determining a focus position of the user in the target interface based on the first context information; and determining the target level of the interaction intention for the interaction component based on a relevance between the focus position and a target hot zone of the interaction component.
3. The method of claim 2, wherein the relevance is determined based on at least one of: a distance between the focus position and the target hot zone, motion information of the focus position relative to the target hot zone.
4. The method of claim 1, wherein the first context information is determined based on input information of the user.
5. The method of claim 1, wherein the second context information comprises at least one of: environment information associated with the device; task information associated with the device.
6. The method of claim 1, wherein determining the target level of the interaction intention for the interaction component based on the obtained target context information comprises: determining a plurality of groups of preset conditions corresponding to a plurality of preset levels; and determining the target level from the plurality of preset levels based on a comparison between the target context information and the plurality of groups of preset conditions.
7. The method of claim 1, wherein determining the target level of the interaction intention for the interaction component based on the obtained target context information comprises: processing the target context information with a machine learning model to determine the target level of the interaction intention for the interaction component.
8. The method of claim 1, wherein adjusting the display style of the interaction component based on the target level of the interaction intention comprises at least one of: adjusting a display state of at least one element in the interaction component based on the target level; adjusting a display size of the interaction component in the target interface based on the target level; adjusting a display position of the interaction component in the target interface based on the target level.
9. The method of claim 1, wherein the interaction component is associated with a plurality of independent sub-components, and adjusting the display style of the interaction component based on the target level of the interaction intention comprises: determining a group of sub-components from the plurality of independent sub-components that matches the target level; and adjusting the interaction component by combining the group of sub-components. displaying an information presentation component in a top region of the target interface.
11. An apparatus for interface interaction, comprising: a presentation module configured to present an interaction component in a target interface; 10. The method of claim 1, wherein the interaction component comprises: a determining module configured to determine a target level of an interaction intention for the interaction component based on obtained target context information, the target context information comprising first context information associated with a user and / or second context information associated with a device; and an adjusting module configured to adjust a display style of the interaction component based on the target level of the interaction intention.
12. An electronic device, comprising: at least one processor; and at least one memory that is coupled to the at least one processor and stores instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, cause the electronic device to perform the method according to any one of claims 1-10.
13. A computer-readable storage medium having computer-executable instructions stored thereon that are executable by a processor to implement the method according to any one of claims 1-10.
14. A computer program product comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to any one of claims 1-10.
Citation Information
Patent Citations
Context specific user interface
CN101479722A
Page interaction method and device
CN109725802A
Man-machine interaction and content search method and device, equipment and storage medium
CN110765312A