Display control method and device and electronic equipment
By obtaining the target parameters of participants in the video conference and dynamically adjusting the interface layout, the problem of fixed video communication interface layout in the existing technology is solved, and the flexibility and adaptability of interface layout is achieved to meet the needs of different application scenarios.
Patent Information
- Application Number
- CN202411025680.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-29
- Publication Date
- 2024-11-12
AI Technical Summary
The existing video communication interface layout is fixed, which cannot meet the needs of different application scenarios, and cannot be dynamically adjusted to adapt to the participants' identity and environmental information.
By obtaining the target parameters of the participant, including identity and environment data, dynamically determine the layout of the display interface, match the corresponding layout according to different conditions and scenes, and provide a variety of layout choices to adapt to different usage scenarios. .
It realizes dynamic adjustment of the video conference interface layout based on the participants' identity and environmental information, meets the needs of different application scenarios, and improves the flexibility and adaptability of user experience.
Smart Images

Figure CN118945405A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of display technology, and more specifically, to a display control method, device and electronic equipment. Background Art
[0002] Currently, there are various application scenarios for realizing video communication through the Internet, such as video conferencing, video teaching, etc., but the interface layouts of these video communications are often fixed and cannot meet the needs of different application scenarios. Summary of the invention
[0003] In view of this, this application provides the following technical solutions:
[0004] The first aspect of the present application provides a display control method, comprising:
[0005] If at least one first device performs the target operation at the first moment, obtaining a target parameter of a first object using the at least one first device; the target parameter includes data characterizing the identity and / or environment of the first object;
[0006] In response to the target parameter satisfying a first condition, outputting a display interface having a first layout on the at least one first device;
[0007] or, in response to the target parameter satisfying a second condition, outputting a display interface having a second layout on the at least one first device;
[0008] The first condition is different from the second condition, and the first layout is different from the second layout.
[0009] In a possible implementation, at the first moment, only one first device performs the target operation, and the first device is the only device that performs the target operation, and the obtained target parameters only include a target parameter of a first object using the first device;
[0010] In response to the target parameter satisfying the first condition, outputting a display interface having a first layout on the at least one first device includes:
[0011] In response to a target parameter of a first object of the first device satisfying a first condition, a first layout matching the first condition is selected.
[0012] In a possible implementation, at the first moment, only one first device performs the target operation, and before the first moment, at least one first device performs the target operation, and the obtained target parameters include at least two target parameters of at least two first objects using the first device;
[0013] In response to the target parameter satisfying the first condition, outputting a display interface having a first layout on the at least one first device includes:
[0014] Correlation analysis of the at least two target parameters;
[0015] In response to at least two target parameters satisfying a first condition, the electronic device that performed the target operation at the first moment is controlled to output a display interface having the first layout; the display interface on the first device that performed the target operation before the first moment is controlled to maintain or adjust to a display interface having the first layout.
[0016] In a possible implementation, at least two first devices perform the target operation at the first moment, and no first device performs the target operation before the first moment, and the obtained target parameters include at least two target parameters of at least two first objects using the first devices;
[0017] In response to the target parameter satisfying the first condition, outputting a display interface having a first layout on the at least one first device includes:
[0018] Correlation analysis of the at least two target parameters;
[0019] In response to the at least two target parameters satisfying a first condition, control is performed to output a display interface having the first layout on the at least two first devices.
[0020] In a possible implementation, at least two first devices perform the target operation at the first moment, and at least one first device performs the target operation before the first moment, and the obtained target parameters include multiple target parameters of multiple first objects using the first devices;
[0021] In response to the target parameter satisfying the first condition, outputting a display interface having a first layout on the at least one first device includes:
[0022] Associatively analyzing the multiple target parameters;
[0023] In response to the multiple target parameters satisfying a first condition, the electronic device that performed the target operation at the first moment is controlled to output a display interface having the first layout; the display interface of the first device that performed the target operation before the first moment is controlled to maintain or adjust to a display interface having the first layout.
[0024] In a possible implementation, determining the first layout or the second layout includes:
[0025] Determining a usage scenario based on parameter conditions satisfied by the target parameters;
[0026] A matching scene layout is determined based on the usage scenario, where the scene layout is the first layout or the second layout.
[0027] In a possible implementation, the scene layout is a first-level layout, under which there are different second-level layouts, and the second-level layouts of the first devices corresponding to the first objects with different identity attributes are different.
[0028] In a possible implementation, the usage scenario corresponding to the first condition or the second condition is any one of the following scenarios:
[0029] First scenario: the environment of at least one first object is the target environment, and there are first objects with different identities;
[0030] Second scenario: there are at least two first objects, and at least one first device outputs shared content;
[0031] A third scenario: at least two first objects corresponding to at least two first devices have different identities;
[0032] The scene layout includes at least one of the following:
[0033] There are at least two video frames corresponding to different first objects, and there are video frames of different sizes;
[0034] There is a shared screen display area;
[0035] There is a first tool display area, which includes touchable tools. The touchable tools are used to achieve recording and / or zooming of a specified video screen.
[0036] A second aspect of the present application provides a display control device, comprising:
[0037] A parameter acquisition module, configured to obtain target parameters of a first object using at least one first device when at least one first device performs a target operation at a first moment; the target parameters include data characterizing the identity and / or environment of the first object;
[0038] a layout determination module, configured to output a display interface having a first layout on the at least one first device in response to the target parameter satisfying a first condition; or, in response to the target parameter satisfying a second condition, output a display interface having a second layout on the at least one first device;
[0039] The first condition is different from the second condition, and the first layout is different from the second layout.
[0040] According to a third aspect of the present application, an electronic device includes at least one processor and a memory connected to the processor, wherein:
[0041] The memory is used to store computer programs;
[0042] The processor is used to execute the computer program so that the electronic device can implement any one of the above display control methods. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.
[0044] Figure 1 A flow chart of a display control method disclosed in an embodiment of the present application;
[0045] Figure 2 This is an example diagram of a layout interface with only one participant disclosed in the embodiment of the present application;
[0046] Figure 3 This is an example diagram of a layout interface with two conference participants disclosed in an embodiment of the present application;
[0047] Figure 4 This is an example diagram of the scene layout interface of the action teaching disclosed in the embodiment of the present application;
[0048] Figure 5 This is an example diagram of the second-level layout page for users with different identities under the same layout disclosed in the embodiment of the present application;
[0049] Figure 6 This is an example diagram of an interface of a scene layout for English teaching disclosed in an embodiment of the present application;
[0050] Figure 7 A schematic diagram of the structure of a display control device disclosed in an embodiment of the present application;
[0051] Figure 8 A schematic diagram of the structure of an electronic device disclosed in an embodiment of the present application. DETAILED DESCRIPTION
[0052] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0053] The embodiments of the present application can be applied to electronic devices. The present application does not limit the product form of the electronic device, which can include but is not limited to servers, smart phones, tablet computers, wearable devices, personal computers (PCs), netbooks, etc., and can be selected according to application requirements.
[0054] Figure 1 This is a flow chart of a display control method disclosed in an embodiment of the present application. Figure 1 As shown, the display control method may include:
[0055] Step 101: If at least one first device performs a target operation at a first moment, obtain target parameters of a first object using the at least one first device; the target parameters include data characterizing the identity and / or environment of the first object.
[0056] Among them, the first device performs the target operation, which can be understood as an operation triggered by the user's behavior of triggering the video session on the electronic device, such as the user clicking the "join meeting" operation in a conference application interface. When the user clicks "join the meeting", the electronic device responds to the user's triggering operation and considers that it has performed the target operation. Here, the electronic device responds to the user's triggering operation, which may include but is not limited to: displaying the user's account information (avatar, nickname) in the conference sharing area, outputting the conference sharing screen (including the video area, operation area, conference member display area, etc.) to the first device where the user is located, collecting user data (images, sounds), etc.
[0057] In this application, any electronic device that can perform the target operation to enter the same video session is the first device. There is no fixed limit on the number of first devices that perform the target operation at the first moment, and it can be one or more; that is, the user who joins the conference at the first moment can be one or at least two users who join the conference at the same time at the first moment.
[0058] The first device that performs the target operation at the first moment may be the first device that performs the target operation, which corresponds to the first user entering the meeting; or, the first device that performs the target operation at the first moment is not the first device that performs the target operation, which corresponds to adding a new user when there is already at least one user in the meeting.
[0059] In an embodiment of the present application, when the first device performs a target operation, it can control the acquisition of the first object target parameters of the first device, where the first object is the user of the first device (hereinafter referred to as the participant). The target parameters may include multiple data. In the present application, the target parameters at least include data representing the identity of the first object or data representing the environment in which the first object is located. The identity data of the first object may include occupation, name (nickname), group, etc., which can be obtained from the registration information of the participant; the environmental data of the first object can be obtained based on the background analysis of the participant's image captured in real time by the camera of the participant's first device; the environmental data can be pre-configured into common categories such as office, outdoor, home, etc.
[0060] Step 102: In response to the target parameter satisfying a first condition, outputting a display interface having a first layout on the at least one first device; or, in response to the target parameter satisfying a second condition, outputting a display interface having a second layout on the at least one first device.
[0061] Among them, the first condition is different from the second condition, and the first layout is different from the second layout. It should be noted that in actual situations, there are multiple condition categories that the target parameter can meet, not limited to the first condition and the second condition, and there are also multiple layout categories, which can correspond to each condition one by one, or the number is less than the condition category, that is, there may be two or more different conditions corresponding to the same layout type; and the first condition and the second condition correspond to different layout types.
[0062] In this application, the layout of the display page on the first device is variable, and the layout is determined based on the conditions satisfied by the target parameters. The target parameters represent the user of the first device, that is, the relevant information of the participants, so the final layout can well meet the needs of the participants and is more in line with the actual usage scenario.
[0063] In one implementation, at the first moment, there is only one first device that performs the target operation, and the first device is the only device that performs the target operation, and the obtained target parameters only include a target parameter of a first object using the first device. That is, the first device is a device that performs the target operation for the first time, and the user of the first device is the first participant to enter the meeting, then in response to the target parameter satisfying the first condition, outputting a display interface with a first layout on the at least one first device may include: in response to the target parameter of the first object of the first device satisfying the first condition, selecting a first layout that matches the first condition.
[0064] Since the first device is the only device that performs the target operation, only the target parameters of the first object of the first device are available for reference when determining the layout of the conference interface. Therefore, in this embodiment, the scene layout is matched only based on the conditions satisfied by the target parameters of the first object.
[0065] For example, at the first moment, the first user joins the video session, and the identity information of the first user in the registration information in the video session application is "teacher". Then, after only the first user joins the video session at the first moment, based on his identity attribute of "teacher", he is matched with the teaching scene layout. In the teaching scene layout, there is a first display area for displaying the "teacher" video screen, and a second display area for displaying the "student" video screen; it can be understood that the size of the first display area is larger than the size of the second display area, and there may be multiple second display areas in the layout, because there may be more than one user with the identity of "student". After the first moment, if no "student" user has joined the session, the first display area displays the video screen of the "teacher" user, and the second display area is blank because the "student" user has not joined the session, or displays a preset fixed image, such as a silhouette image of a person's upper body.
[0066] In another implementation, at the first moment, only one first device performs the target operation, and before the first moment, at least one first device performs the target operation, and the obtained target parameters include at least two target parameters of at least two first objects using the first device. That is, the first device is not the device that performs the target operation for the first time, and the user of the first device is not the first participant to enter the meeting.
[0067] In response to the target parameter satisfying the first condition, outputting a display interface having a first layout on the at least one first device may include: associating and analyzing the at least two target parameters; in response to the at least two target parameters satisfying the first condition, controlling the electronic device that performed the target operation at the first moment to output a display interface having the first layout; controlling the display interface on the first device that performed the target operation before the first moment to maintain or adjust to a display interface having the first layout.
[0068] In this implementation, before the first moment, a first device has already performed the target operation, so the first device that performs the target operation at the first moment is not the only first device, that is, the first object of the first device that performs the target operation at the first moment is not the only user who joins the video session. Therefore, when determining the scene layout of the page, it is necessary to associate and analyze the target parameters of all first objects that have joined the video session. It should be noted that when the first object that joins the video session before the first moment joins, a scene layout has been determined based on its target parameters. When the first object joins the video session again at the first moment, since it is necessary to associate and analyze the target parameters of at least two first objects, the scene layout that matches the conditions satisfied by the target parameters of at least two first objects may be different from the scene layout that matches before the first moment. In this case, the electronic device that performs the target operation at the first moment directly outputs the scene layout matched at the first moment, and the scene layout on the electronic device that performs the target operation before the first moment is adjusted from the previous scene layout to the scene layout matched at the first moment.
[0069] For example, user 1 (student) first enters the video conference, and the first scene layout is determined based on the target parameters of user 1, and a page with the first scene layout is displayed on the electronic device of user 1, such as Figure 2 As shown (the small box below the figure is a functional interactive control); 5 seconds later (corresponding to the first moment) user 2 (teacher) enters the video conference, and the second scene layout is determined based on the target parameters of user 1 and user 2, then the page of the second scene layout is directly displayed on the electronic device of user 2, such as Figure 3 As shown, the page of the first scene layout on the electronic device of user 1 is adjusted to the page of the second scene layout.
[0070] Of course, there is also a possibility that user 1 has previously entered the video session and the first layout is matched based on the user's target parameters, and then user 2 joins the video session at the first moment, but the first scene layout is still matched based on the target parameters of the two users. In this case, the electronic device of user 2 outputs a page with the first layout, and the electronic device of user 1 maintains the page with the first layout.
[0071] In another implementation, at least two first devices perform the target operation at the first moment, and there is no first device that performs the target operation before the first moment, and the obtained target parameters include at least two target parameters of at least two first objects using the first devices. That is, the at least two first devices are devices that perform the target operation for the first time, and at least two users of the at least two first devices simultaneously become the first participants to enter the meeting.
[0072] In response to the target parameter satisfying the first condition, outputting a display interface having a first layout on the at least one first device may include: associating and analyzing the at least two target parameters; and in response to the at least two target parameters satisfying the first condition, controlling the output of the display interface having the first layout on the at least two first devices.
[0073] In this implementation, there is no electronic device that has performed the target operation before the first moment, but at the first moment at least two first devices simultaneously perform the target operation and obtain at least two target parameters of at least two first objects. Therefore, it is necessary to match the appropriate scene layout based on the conditions satisfied by the at least two target parameters.
[0074] For example, at the first moment, user 1 (employee identity) and user 2 (employee identity) enter a video conversation at the same time. Based on the identity attributes of the two, it is considered that this video conversation is only a communication between users, and there are no people with special identities, such as teachers, leaders, etc. They can be matched to the first scene layout. In the first scene layout, the video display area size of user 1 and user 2 is the same.
[0075] In another implementation, at least two first devices perform the target operation at the first moment, and at least one first device performs the target operation before the first moment, and the obtained target parameters include multiple target parameters of multiple first objects using the first devices.
[0076] In response to the target parameters satisfying the first condition, outputting a display interface having a first layout on the at least one first device may include: associating and analyzing the multiple target parameters; in response to the multiple target parameters satisfying the first condition, controlling the electronic device that performed the target operation at the first moment to output a display interface having the first layout; controlling the display interface of the first device that performed the target operation before the first moment to maintain or adjust to a display interface having the first layout.
[0077] In this implementation, before the first moment, a first device has already performed the target operation, so at least one first device that performs the target operation at the first moment is not the device that performs the target operation for the first time. There are users who have joined the video session before the first moment. Therefore, when determining the scene layout of the page, it is necessary to associate and analyze the target parameters of all first objects that have joined the video session.
[0078] For example, user 1 first enters a video session, and at the first moment a few seconds or minutes later, user 2 and user 3 join the video session at the same time. When matching the scene layout, it is necessary to perform correlation analysis on the target parameters of all users who have joined the video session, including user 1, user 2, and user 3, and match the appropriate scene layout.
[0079] The above content introduces the specific implementation of matching layout scenes in several different scenarios, but does not constitute a fixed restriction on controlling the display interface with the first layout outputted by the at least one first device. The introduction of the above content will help technical personnel in the field to better understand and implement the technical solution of the present application.
[0080] In the aforementioned embodiments, determining the first layout or the second layout may include: determining a usage scenario based on parameter conditions satisfied by the target parameters; and determining a matching scene layout based on the usage scenario, the scene layout being the first layout or the second layout.
[0081] As mentioned above, the target parameters include at least the identity data of the first object and / or the environment in which it is located. In the previous embodiments, the target parameters are introduced as identity data. In this embodiment, the target parameters are taken as the environment in which the first object is located, or the target parameters include both identity data and environment data.
[0082] For example, in a scene, the environment data of three users are obtained at the first moment, where the environment data of user 1 is identified as a gym, and the environment data of user 2 and user 3 are identified as a living room. Based on the target parameters of the three users, it is considered that they meet the action teaching scene, and the scene layout of the action teaching scene can be matched. The scene layout of the action teaching scene is as follows: Figure 4 As shown, the area corresponding to user 1 is the video screen display area for users in the gym environment, and the area corresponding to user 2 and the area corresponding to user 3 are the video screen display areas for users in the living room.
[0083] In one implementation, the scene layout is a first-level layout, under which there are different second-level layouts, and the second-level layouts of the first devices corresponding to the first objects with different identity attributes are different. For example, in the aforementioned example content, the scene layout of the action teaching is determined to be a determined first-level layout, but under the first-level layout, there are different second-level layouts for users with different identity attributes. Figure 5 This is an example diagram of the second-level layout page for different identity users under the same layout disclosed in the embodiment of this application, where the upper figure is an example of the page layout of the teacher side, and the lower figure is an example of the page layout of the student side. Figure 5As shown, in the page layout of the teacher's side, in addition to the video images of the teacher and the students, the upper area of the interface also includes several recording tools, and the teacher can trigger these tools to record actions in a specific period of time; in the page layout of the student's side, in addition to the video images of the teacher and the students, the right area of the interface also includes a video display area, which contains several video contents, which are videos recorded by the teacher's side, and student users can choose to click to watch according to their own needs.
[0084] In an embodiment of the present application, the first-level layout can be first determined in combination with the environmental data in the target parameters of the first object, and then the second-level layout under the first-level layout can be determined in combination with the identity data in the target parameters of the first object. Under the same first-level layout, electronic devices of users with different identities can also present different second-level layouts, so that the layout page displays richer details and better meets the usage needs of users with different identities.
[0085] In the aforementioned embodiments, the usage scenario corresponding to the first condition or the second condition is any one of the following scenarios: the first scenario: the environment in which at least one first object is located is the target environment, and there are first objects with different identities; the second scenario: there are at least two first objects, and at least one first device outputs shared content; the third scenario: at least two first objects corresponding to at least two first devices have different identities.
[0086] In the first scenario, for example, a yoga class in a video conference, at least one of the users joining the video session is in a gym or outdoors, and there are teachers and students among the users participating in the session. In the second scenario, for example, an English class in a video conference, there are two users joining the video conference, and one of the users has shared content output on its terminal. The layout output interface is as follows: Figure 6 In the third scenario, if a discussion meeting is held in the form of a video conference, multiple users join the video conference, and some of them are group leaders and some are group members.
[0087] The scene layout includes at least one of the following: there are at least two video screens corresponding to different first objects, and there are video screens of different sizes; there is a shared screen display area; there is a first tool display area, the first tool display area includes a touchable tool, and the touchable tool is used to realize the recording of a specified video screen.
[0088] In one example, in a display interface of a layout, the sizes of video display screens of users with different identities may be different. For example, in a conference interface with employees and leaders, the size of the leader's video screen will be larger than that of the employee; in a conference interface with teachers and students, the size of the teacher's video screen will be larger than that of the student.
[0089] In another example, a participant has files that need to be shared and presented, such as PPT, video, image, document, etc., so that other participants can better understand the content of the content sharing party.
[0090] In another example, the layout display interface includes some auxiliary tools, such as a recording tool for recording video images, a zoom tool for controlling the size of the video images, etc., to meet different needs of users.
[0091] In a specific implementation, before the display control scheme disclosed in the present application is implemented, N scene types can be prepared in advance, and each scene type corresponds to a default scene layout; then a multi-classification model is established, and a mature multi-classification algorithm (such as RNN, etc.) is used to achieve the matching of the scene layout; specifically, a set of user state vectors can be input into the multi-classification model, the number of which is the number of participants, and the user state vector is [occupation, surrounding environment]. Occupation represents identity, which is the content registered when the user registers. There are A types, represented by numbers, such as 1 for teachers, 2 for students, etc.; the surrounding environment is the surrounding environment in which the user is in a video conference and requires real-time recognition by another model, and there are C types, represented by numbers, such as 1 for study; the output result is [scene type], represented by numbers, corresponding to N scenes, for example, the result is [1], 1 represents outdoor teaching.
[0092] After the camera is turned on, another model is used to identify the surrounding environment and generate a complete user state vector. The user state vector of each participant is then passed into the multi-classification model to obtain the scene type and change the layout of the video conference interface.
[0093] In addition, it should be noted that after the video conferencing interface layout is determined and output, the user can also adjust some screens in the interface layout according to his or her own preferences or needs, such as enlarging or reducing the video display area of a participating user, or adjusting the position of each user's video screen, etc. This application does not have fixed restrictions on this.
[0094] The display control method described in the embodiment of the present application can match different scene layouts according to different target attributes of the participants, meet the user's usage needs, and make it more convenient for users to use.
[0095] For the aforementioned method embodiments, for the sake of simplicity, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the order of the actions described, because according to the present application, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.
[0096] The method is described in detail in the embodiments disclosed in the above-mentioned application. The method of the application can be implemented by various forms of devices. Therefore, the application also discloses a device, and a specific embodiment is given below for detailed description.
[0097] Figure 7 Schematic diagram of the structure of a display control device disclosed in an embodiment of the present application. Figure 7 As shown, the display control device 70 may include:
[0098] The parameter acquisition module 701 is used to obtain target parameters of a first object using at least one first device when there is at least one first device performing a target operation at a first moment; the target parameters include data characterizing the identity and / or environment of the first object.
[0099] The layout determination module 702 is used to output a display interface with a first layout on the at least one first device in response to the target parameter satisfying a first condition; or to output a display interface with a second layout on the at least one first device in response to the target parameter satisfying a second condition.
[0100] The first condition is different from the second condition, and the first layout is different from the second layout.
[0101] In this application, the layout of the display page on the first device is variable, and the layout is determined based on the conditions satisfied by the target parameters. The target parameters represent the user of the first device, that is, the relevant information of the participants, so the final layout can well meet the needs of the participants and is more in line with the actual usage scenario.
[0102] In one implementation, at the first moment, there is only one first device that performs the target operation, and the first device is the only device that performs the target operation, and the obtained target parameters only include a target parameter of a first object using the first device; the layout determination module can be specifically used to: in response to the target parameter of the first object of the first device satisfying a first condition, select a first layout that matches the first condition.
[0103] In one implementation, at the first moment, only one first device performs the target operation, and before the first moment, at least one first device performs the target operation, and the obtained target parameters include at least two target parameters of at least two first objects using the first device; the layout determination module can be specifically used to: associate and analyze the at least two target parameters; in response to the at least two target parameters satisfying a first condition, control the electronic device that performs the target operation at the first moment to output a display interface with the first layout; control the display interface on the first device that performed the target operation before the first moment to maintain or adjust to a display interface with the first layout.
[0104] In one implementation, at the first moment there are at least two first devices that perform the target operation, and before the first moment there is no first device that performs the target operation, and the obtained target parameters include at least two target parameters of at least two first objects using the first devices; the layout determination module can be specifically used to: associate and analyze the at least two target parameters; in response to the at least two target parameters satisfying the first condition, control the output of a display interface having the first layout on the at least two first devices.
[0105] In one implementation, at least two first devices perform the target operation at the first moment, and at least one first device performs the target operation before the first moment, and the obtained target parameters include multiple target parameters of multiple first objects using the first devices; the layout determination module can be specifically used to: associate and analyze the multiple target parameters; in response to the multiple target parameters satisfying a first condition, control the electronic device that performs the target operation at the first moment to output a display interface with the first layout; control the display interface of the first device that performed the target operation before the first moment to maintain or adjust to a display interface with the first layout.
[0106] In one implementation, the layout determination module includes: a scene determination module, used to determine a usage scene based on parameter conditions satisfied by the target parameters; and a layout matching module, used to determine a matching scene layout based on the usage scene, wherein the scene layout is the first layout or the second layout.
[0107] In one implementation, the scene layout is a first-level layout, under which there are different second-level layouts, and the second-level layouts of the first devices corresponding to the first objects with different identity attributes are different.
[0108] In one implementation, the usage scenario corresponding to the first condition or the second condition is any one of the following scenarios: a first scenario: the environment in which at least one first object is located is a target environment, and there are first objects with different identities; a second scenario: there are at least two first objects, and at least one first device outputs shared content; a third scenario: at least two first objects corresponding to at least two first devices have different identities;
[0109] The scene layout includes at least one of the following: there are at least two video screens corresponding to different first objects, and there are video screens of different sizes; there is a shared screen display area; there is a first tool display area, the first tool display area includes a touchable tool, and the touchable tool is used to realize recording and / or scaling of a specified video screen.
[0110] The specific implementation of the above-mentioned display control device and the modules it contains, as well as other possible lines of sight, can be found in the corresponding parts of the method embodiment, which will not be repeated here.
[0111] Any one of the display control devices described in the above embodiments includes a processor and a memory. The parameter acquisition module, layout determination module, scene determination module, layout matching module, etc. in the above embodiments are all stored in the memory as program modules, and the processor executes the above program modules stored in the memory to implement corresponding functions.
[0112] The processor includes a kernel, which retrieves the corresponding program module from the memory. One or more kernels can be set, and the processing of the access data can be realized by adjusting the kernel parameters.
[0113] The memory may include non-permanent memory in a computer-readable medium, random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.
[0114] In an exemplary embodiment, a computer-readable storage medium is also provided, which can be directly loaded into the internal memory of a computer and contains software code. After being loaded and executed by a computer, the computer program can implement the steps shown in any embodiment of the above display control method.
[0115] In an exemplary embodiment, a computer program product is also provided, which can be directly loaded into the internal memory of a computer and contains software codes. After being loaded and executed by a computer, the computer program can implement the steps shown in any embodiment of the display control method described above.
[0116] Furthermore, an embodiment of the present application provides an electronic device. Figure 8This is a schematic diagram of the structure of an electronic device disclosed in an embodiment of the present application. Figure 8 As shown, the electronic device includes at least one processor 801, and at least one memory 802 and a bus 803 connected to the processor; wherein the processor and the memory communicate with each other via the bus; the processor is used to call the program instructions in the memory to execute the above-mentioned display control method.
[0117] The electronic device may be any one of a plurality of first devices that perform the target operation, that is, one main device as a computing center is selected from a plurality of participating devices, or the electronic device may be a server of a video conference.
[0118] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.
[0119] It should also be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the presence of other identical elements in the process, method, article or device including the elements.
[0120] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
[0121] The above description of the disclosed embodiments enables those skilled in the art to implement or use the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A display control method, comprising: If at least one first device performs the target operation at the first moment, obtaining a target parameter of a first object using the at least one first device; The target parameters include data characterizing the identity and / or environment of the first object; In response to the target parameter satisfying a first condition, outputting a display interface having a first layout on the at least one first device; or, in response to the target parameter satisfying a second condition, outputting a display interface having a second layout on the at least one first device; The first condition is different from the second condition, and the first layout is different from the second layout.
2. The display control method according to claim 1, wherein at the first moment, only one first device performs the target operation, and the first device is the only device that performs the target operation, and the obtained target parameters only include a target parameter of a first object using the first device; In response to the target parameter satisfying the first condition, outputting a display interface having a first layout on the at least one first device includes: In response to a target parameter of a first object of the first device satisfying a first condition, a first layout matching the first condition is selected.
3. The display control method according to claim 1, wherein at the first moment, only one first device performs the target operation, and before the first moment, at least one first device performs the target operation, and the obtained target parameters include at least two target parameters of at least two first objects using the first device; In response to the target parameter satisfying the first condition, outputting a display interface having a first layout on the at least one first device includes: Correlation analysis of the at least two target parameters; In response to at least two target parameters satisfying a first condition, the electronic device that performed the target operation at the first moment is controlled to output a display interface having the first layout; the display interface on the first device that performed the target operation before the first moment is controlled to maintain or adjust to a display interface having the first layout.
4. The display control method according to claim 1, wherein at least two first devices perform a target operation at the first moment, and no first device performs the target operation before the first moment, and the obtained target parameters include at least two target parameters of at least two first objects using the first devices; In response to the target parameter satisfying the first condition, outputting a display interface having a first layout on the at least one first device includes: Correlation analysis of the at least two target parameters; In response to the at least two target parameters satisfying a first condition, control is performed to output a display interface having the first layout on the at least two first devices.
5. The display control method according to claim 1, wherein at least two first devices perform the target operation at the first moment, and at least one first device performs the target operation before the first moment, and the obtained target parameters include multiple target parameters of multiple first objects using the first devices; In response to the target parameter satisfying the first condition, outputting a display interface having a first layout on the at least one first device includes: Associatively analyzing the multiple target parameters; In response to the multiple target parameters satisfying a first condition, the electronic device that performed the target operation at the first moment is controlled to output a display interface having the first layout; the display interface of the first device that performed the target operation before the first moment is controlled to maintain or adjust to a display interface having the first layout.
6. The display control method according to any one of claims 1 to 5, wherein determining the first layout or the second layout comprises: Determining a usage scenario based on parameter conditions satisfied by the target parameters; A matching scene layout is determined based on the usage scenario, where the scene layout is the first layout or the second layout.
7. The display control method according to claim 6, wherein the scene layout is a first-level layout, and there are different second-level layouts under the first-level layout, and the second-level layouts of the first devices corresponding to the first objects with different identity attributes are different.
8. The display control method according to claim 6, wherein the usage scenario corresponding to the first condition or the second condition is any one of the following scenarios: First scenario: the environment of at least one first object is the target environment, and there are first objects with different identities; Second scenario: there are at least two first objects, and at least one first device outputs shared content; A third scenario: at least two first objects corresponding to at least two first devices have different identities; The scene layout includes at least one of the following: There are at least two video frames corresponding to different first objects, and there are video frames of different sizes; There is a shared screen display area; There is a first tool display area, which includes touchable tools. The touchable tools are used to achieve recording and / or zooming of a specified video screen.
9. A display control device, comprising: A parameter acquisition module, configured to obtain a target parameter of a first object using at least one first device when at a first moment there is at least one first device executing a target operation; The target parameters include data characterizing the identity and / or environment of the first object; a layout determination module, configured to output a display interface having a first layout on the at least one first device in response to the target parameter satisfying a first condition; or, in response to the target parameter satisfying a second condition, output a display interface having a second layout on the at least one first device; The first condition is different from the second condition, and the first layout is different from the second layout.
10. An electronic device comprising at least one processor and a memory connected to the processor, wherein: The memory is used to store computer programs; The processor is used to execute the computer program; The computer program includes: if there is at least one first device performing a target operation at a first moment, obtaining target parameters of a first object using the at least one first device; the target parameters include data characterizing the identity and / or environment of the first object; in response to the target parameters satisfying a first condition, outputting a display interface with a first layout on the at least one first device; or, in response to the target parameters satisfying a second condition, outputting a display interface with a second layout on the at least one first device; the first condition is different from the second condition, and the first layout is different from the second layout.
