Display control method and system

Abstract

The embodiment of the invention provides a display control method and system. The method comprises the steps that image information of one or more users located in a preset area range of display equipment is obtained; determining at least one user in the system, identity information of the user in each system and screen viewing information of the user in each system to the display device based on the image information; determining a user category to which the user in each system belongs based on the identity information; for each user category, determining a screen viewing weight corresponding to the user category based on the user category and the screen viewing information of the users in the system belonging to the user category; and determining a display mode of the display device based on the numerical relationship of the screen viewing weights corresponding to the user categories.

Description

Technical Field

[0001] This specification relates to the field of intelligent control, and in particular to a display control method and system. Background Art

[0002] Actual business operations (e.g., meetings, presentations, and demonstrations) often involve numerous members simultaneously observing or collaborating on decisions. Different members often have varying interests and needs for the information displayed on devices (e.g., screens used to present presentation content). Furthermore, members of varying identities or ranks (e.g., management and employees in a meeting) also hold varying degrees of importance in the observation or decision-making process. Therefore, to ensure that the viewing needs of all members are met while also prioritizing the viewing experience of key members (e.g., senior-level members), it is crucial to dynamically display personalized information relevant to the observing or decision-making members on the display screen.

[0003] Based on this, it is desired to provide a display control method and system. Summary of the Invention

[0004] One or more embodiments of this specification provide a display control method. The display control method includes: obtaining image information of one or more users within a preset area of ​​a display device; determining at least one in-system user among the one or more users, identity information of each in-system user, and screen viewing information of each in-system user on the display device based on the image information; determining the user category to which each in-system user belongs based on the identity information; determining, for each user category, the screen viewing weight corresponding to the user category based on the user category and the screen viewing information of the in-system users belonging to the user category; and determining the display mode of the display device based on the numerical relationship between the screen viewing weights corresponding to each user category.

[0005] In some embodiments, for each user category: obtain the preset weight corresponding to the user category; determine the first coefficient corresponding to the user category based on the preset weight corresponding to the user category and the number of users; determine the second coefficient corresponding to the user category based on the screen viewing information of users in the system belonging to the user category and the preset weight corresponding to the user category; determine the screen viewing weight corresponding to the user category based on the first coefficient and the second coefficient.

[0006] In some embodiments, for the at least one user within the system, at least one intended user viewing the display device is determined based on the screen viewing information; the distance information and gaze duration of the at least one intended user relative to the display device are determined based on the screen viewing information; and for each of the user categories, the second coefficient of the user category is determined based on the distance information and the gaze duration of the intended users belonging to the user category.

[0007] In some embodiments, the screen viewing weights corresponding to all the user categories are sorted from large to small to obtain a sorting result; based on the sorting result, whether the numerical relationship meets the first preset condition is judged; in response to the numerical relationship meeting the first preset condition, the display mode is determined to be the main screen exclusive mode; in response to the numerical relationship not meeting the first preset condition, whether the numerical relationship meets the second preset condition is judged; in response to the numerical relationship meeting the second preset condition, the display mode is determined to be the split-screen negotiation mode; in response to the numerical relationship not meeting the second preset condition, whether the numerical relationship meets the third preset condition is judged; in response to the numerical relationship meeting the third preset condition, the display mode is determined to be the main-sub-screen mode.

[0008] In some embodiments, in response to the display mode being the main screen exclusive mode, the display interface of the display device is controlled to only display the display content corresponding to the user category corresponding to the first screen viewing weight.

[0009] In some embodiments, in response to the display mode being the split-screen negotiation mode, the display interface of the display device is divided into a first display area and a second display area; the first display area is controlled to display the display content corresponding to the user category corresponding to the first screen viewing weight; and the second display area is controlled to display the display content corresponding to the user category corresponding to the second screen viewing weight.

[0010] In some embodiments, in response to the display mode being the main-sub-screen mode, multiple shortlisted user categories are determined; the display interface of the display device is divided into multiple display areas; the at least one main display area is controlled to respectively display the display content corresponding to the at least one main user category, and the at least one sub-display area is controlled to respectively display the display content corresponding to the at least one sub-user category.

[0011] In some embodiments, based on the display mode currently in which the display device is located, a plurality of legitimate users are determined; and based on the screen viewing information of the plurality of legitimate users, a display module to be enlarged is determined.

[0012] In some embodiments, when the display device is in the split-screen negotiation mode: in response to the presence of the display module to be enlarged in both the first display area and the second display area, the conflict arbitration score of the first user category and the second user category is determined based on the user level and line of sight projection angle of each of the legitimate users in the first user category and the second user category, and the business importance of the display module to be enlarged; based on the conflict arbitration score, the target display module is determined, and the target display module is enlarged and displayed across the split-screen area.

[0013] In some embodiments, when the display device is in the main-sub-screen mode: in response to the presence of the display module to be enlarged in the main display area, the display module to be enlarged in the main display area is determined as the target display module, and the target display module is enlarged and displayed in the main display area or across the split-screen area; in response to the presence of the display module to be enlarged in the sub-display area and the absence of the display module to be enlarged in the main display area, the display module to be enlarged in the sub-display area is determined as the target display module, and the target display module is enlarged and displayed in the main display area or across the split-screen area.

[0014] In some embodiments, at least one non-system user and the screen viewing information of each non-system user are determined from the one or more users based on the image information; a screen viewing scene is determined based on the user category to which the at least one system user belongs and the screen viewing information, as well as the screen viewing information of the at least one non-system user; and the display mode is adjusted based on the screen viewing scene.

[0015] In some embodiments, in response to the existence of a viewing position of a user within the system located in the central area of ​​the viewing position of the non-system user: the viewing scene is determined to be the explanation and demonstration scene; the display mode of the display device is adjusted to the main screen exclusive mode, and the display interface of the display device is controlled to display the display content corresponding to the user category to which the user within the system located in the central area belongs.

[0016] In some embodiments, for each of the non-system users, the location feature count of the non-system user is determined; and in response to the location feature counts of all the non-system users being greater than zero, the viewing scene is determined to be the explanation and demonstration scene; the display mode of the display device is adjusted to the main screen exclusive mode, and the display interface of the display device is controlled to display the display content corresponding to the user category to which the system user adjacent to the viewing position of the non-system user belongs.

[0017] One or more embodiments of the present specification provide a display control system. The display control system includes: an acquisition module for acquiring image information of one or more users within a preset area of ​​a display device; a user determination module for determining, based on the image information, at least one in-system user among the one or more users, the identity information of each in-system user, and the screen viewing information of each in-system user on the display device; a category determination module for determining, based on the identity information, the user category to which each in-system user belongs; a weight determination module for determining, for each user category, the screen viewing weight corresponding to the user category based on the user category and the screen viewing information of the in-system users belonging to the user category; and a mode determination module for determining the display mode of the display device based on the numerical relationship between the screen viewing weights corresponding to each user category.

[0018] One or more embodiments of the present specification provide a display control device, including a processor, wherein the processor is configured to execute a display control method.

[0019] One or more embodiments of the present specification provide a computer-readable storage medium, wherein the storage medium stores computer instructions. When a computer reads the computer instructions in the storage medium, the computer executes a display control method. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] This specification will be further described in the form of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not limiting, and in these embodiments, like numbers represent like structures, wherein: Figure 1 is a schematic diagram of an application scenario of a display control system according to some embodiments of this specification; Figure 2 is a module diagram of a display control system according to some embodiments of this specification; Figure 3 is an exemplary flow chart of a display control method according to some embodiments of this specification; Figure 4A is a schematic diagram of a main screen exclusive mode according to some embodiments of this specification; Figure 4B is a schematic diagram of a split-screen negotiation mode according to some embodiments of this specification; Figure 4C is a schematic diagram of the main-secondary screen mode according to some embodiments of this specification; Figure 5A is a schematic diagram of a user's screen viewing position according to some embodiments of this specification; Figure 5Bis a schematic diagram of a user's screen viewing position according to other embodiments of this specification; Figure 6 is an exemplary flow chart of determining screen viewing weights according to some embodiments of this specification; and Figure 7 is an exemplary flowchart of determining a display mode according to some embodiments of this specification. DETAILED DESCRIPTION

[0021] To more clearly illustrate the technical solutions of the embodiments of this specification, the following briefly describes the drawings required for describing the embodiments. Obviously, the drawings described below are merely examples or embodiments of this specification. Those skilled in the art can apply this specification to other similar scenarios based on these drawings without inventive effort. Unless otherwise apparent from the context or otherwise noted, the same reference numerals in the figures represent the same structure or operation.

[0022] It should be understood that the terms "system," "device," "unit," and / or "module" used herein are a method for distinguishing different components, elements, parts, portions, or assemblies at different levels. However, if other terms can achieve the same purpose, the terms may be replaced by other expressions.

[0023] As used in this specification and claims, unless the context clearly indicates otherwise, the words "a," "an," "an," and / or "the" do not refer to the singular but also include the plural. Generally speaking, the terms "comprises" and "include" only indicate the inclusion of the steps and elements specifically identified, and these steps and elements do not constitute an exclusive list. A method or apparatus may also include other steps or elements.

[0024] Flowcharts are used throughout this specification to illustrate the operations performed by systems according to embodiments of this specification. It should be understood that preceding or following operations do not necessarily need to be performed in exact order. Instead, the steps may be processed in reverse order or simultaneously. Furthermore, other operations may be added to these processes, or one or more operations may be removed from these processes.

[0025] Figure 1 This is a schematic diagram of an application scenario of a display control system according to some embodiments of this specification. Figure 1 As shown, an application scenario 100 of a display control system (hereinafter referred to as application scenario 100 ) may include a processing device 110 , a network 120 , a storage device 130 , a display device 140 , an image acquisition apparatus 150 , and one or more users 160 .

[0026] The processing device 110 is used to process the data and / or information obtained from the storage device 130 and / or the image acquisition device 150, and to control the display mode and / or display content of the display device 140. For example, the processing device 110 can obtain the image information (for example, the user's facial image) of one or more users 160 located within the preset area of ​​the display device from the image acquisition device 150, and determine at least one in-system user among the one or more users 160 and the screen viewing information of each in-system user on the display device 140 based on the image information. For another example, the processing device 110 can retrieve the identity information of each in-system user from the storage device 130 based on the determined at least one in-system user. For another example, the processing device 110 can determine the user category to which each in-system user belongs based on the identity information; determine the screen viewing weight corresponding to each user category based on the user category and the screen viewing information; and determine the display mode of the display device based on the numerical relationship between the screen viewing weights corresponding to each user category. For more information about the processing device 110, please refer to Figure 3 、 Figure 6 and Figure 7 and its related descriptions.

[0027] In some embodiments, processing device 110 may include a processor. In some embodiments, processing device 110 may be a single server or a group of servers.

[0028] The network 120 is used to connect the various components of the application scenario 100 and / or connect the system with external resources. The network 120 enables communication between the various components and with other components outside the system to achieve the exchange of data and / or information. For example, the network 120 can transmit image information of one or more users 160 captured by the image acquisition device 150 to the processing device 110. For another example, the network 120 can transmit instructions generated by the processing device 110 to control the display mode of the display device 140 (for example, instructions to control the display mode of the display device 140 to adjust to the main screen exclusive mode) to the display device 140.

[0029] The network 120 may be a wireless network or a wired network and utilize standard communication technologies and / or protocols. For example, the network 120 may be the Internet, or any other network, including but not limited to a local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a mobile, wired, or wireless network, a private network, a virtual private network, or any combination thereof.

[0030] Storage device 130 is used to store data and / or instructions. For example, storage device 130 may store image information of one or more users 160 captured by image acquisition device 150. For another example, storage device 130 may store identity information (e.g., user ID, name, company affiliation, etc.) entered by one or more users 160, as well as the correspondence between image information and identity information for each of one or more users 160. Storage device 130 may be implemented in a single central server, multiple servers connected via a communication link, or multiple personal devices.

[0031] The display device 140 refers to a device for presenting display content (e.g., text, images, videos, etc.), such as a display screen, a projection screen, a television screen, etc. In some embodiments, the display device 140 may also be a multi-screen display system composed of multiple screens (e.g., multiple display screens).

[0032] In some embodiments, the display device 140 may be configured with an observation device (e.g., a UWB (Ultra-Wideband) device, a TOF (Time of Flight) sensor, etc.) to determine the distance, coordinates, and / or direction (angle) of one or more users 160 relative to the display device 140 .

[0033] Image acquisition device 150 is used to acquire image information of one or more users 160. For example, image acquisition device 150 may include a video camera, a webcam, or a still camera. The image information may be a picture or video of the user including the user's face. In some embodiments, image acquisition device 150 also includes a biometric information recognition device to acquire eye movement trajectories, pupil changes, and other information of one or more users 160.

[0034] In some embodiments, the image acquisition device 150 may be integrated into or on the surface of the display device 140 , that is, the image acquisition device 150 is a component of the display device 140 and is directly connected to other parts of the display device 140 .

[0035] In some embodiments, the image acquisition device 150 may be independent of the display device 140 .

[0036] One or more users 160 can interact with the display device 140 or view the content displayed by the display device 140. For example, the one or more users 160 may include management personnel (e.g., managers, supervisors, etc.), employees, etc. within at least one enterprise. In some embodiments, the one or more users 160 include users within the system and users outside the system. For example Figure 1As shown, one or more users 160 include system users 161, 163, 164, and 165, and non-system users 162. For more information about system users and non-system users, see Figure 3 and its related descriptions.

[0037] Figure 2 is an exemplary module diagram of a display control system according to some embodiments of this specification. Figure 2 As shown, the display control system 200 may include an acquisition module 210 , a user determination module 220 , a category determination module 230 , a weight determination module 240 and a mode determination module 250 .

[0038] The acquisition module 210 is used to acquire image information of one or more users within a preset area of ​​the display device. For more information about the acquisition module 210, please refer to Figure 3 and its related descriptions.

[0039] The user determination module 220 is used to determine at least one in-system user among one or more users, identity information of each in-system user, and screen viewing information of each in-system user on the display device based on the image information.

[0040] In some embodiments, the user determination module 220 is further used to: determine at least one non-system user and the screen viewing information of each non-system user from one or more users based on image information; determine the screen viewing scene based on the user category and screen viewing information of at least one system user and the screen viewing information of at least one non-system user; and adjust the display mode based on the screen viewing scene.

[0041] In some embodiments, the user determination module 220 is further used to: determine that the viewing scene is a lecture and demonstration scene in response to the existence of a system user's viewing position being located in the center area of ​​the viewing positions of non-system users; adjust the display mode of the display device to the main screen exclusive mode, and control the display interface of the display device to display the display content corresponding to the user category to which the system user located in the center area belongs.

[0042] In some embodiments, the user determination module 220 is further used to: determine the location feature count of each non-system user respectively; in response to the location feature counts of all non-system users being greater than zero, determine that the viewing scene is a lecture and demonstration scene; adjust the display mode of the display device to the main screen exclusive mode, and control the display interface of the display device to display the display content corresponding to the user category to which the system user adjacent to the viewing position of the non-system user belongs.

[0043] For more information about the user determination module 220, see Figure 3 and its related descriptions.

[0044] The category determination module 230 is used to determine the user category to which each user in the system belongs based on the identity information. For more information about the category determination module 230, please refer to Figure 3 and its related descriptions.

[0045] The weight determination module 240 is configured to determine, for each user category, a screen viewing weight corresponding to the user category based on the user category and the screen viewing information of users in the system belonging to the user category.

[0046] In some embodiments, the weight determination module 240 is further used to: obtain the preset weight corresponding to the user category; determine the first coefficient corresponding to the user category based on the preset weight corresponding to the user category and the number of users; determine the second coefficient corresponding to the user category based on the screen viewing information of users in the system belonging to the user category and the preset weight corresponding to the user category; determine the screen viewing weight corresponding to the user category based on the first coefficient and the second coefficient.

[0047] In some embodiments, the weight determination module 240 is further used to: determine, for at least one user within the system, at least one intended user who views the display device based on the screen viewing information; determine, based on the screen viewing information, the distance information and gaze duration of at least one intended user relative to the display device; and, for each user category, determine the second coefficient of the user category based on the distance information and gaze duration of the intended users belonging to the user category.

[0048] For more information about the weight determination module 240, see Figure 3 and its related descriptions.

[0049] The mode determination module 250 is used to determine the display mode of the display device based on the numerical relationship between the screen viewing weights corresponding to each user category.

[0050] In some embodiments, the mode determination module 250 is further used to: sort the viewing weights corresponding to all user categories from large to small to obtain a sorting result; based on the sorting result, determine whether the numerical relationship meets the first preset condition; in response to the numerical relationship meeting the first preset condition, determine that the display mode is the main screen exclusive mode; in response to the numerical relationship not meeting the first preset condition, determine whether the numerical relationship meets the second preset condition; in response to the numerical relationship meeting the second preset condition, determine that the display mode is the split-screen negotiation mode; in response to the numerical relationship not meeting the second preset condition, determine whether the numerical relationship meets the third preset condition; in response to the numerical relationship meeting the third preset condition, determine that the display mode is the main-slave screen mode.

[0051] In some embodiments, the mode determination module 250 is further configured to: in response to the display mode being the main screen exclusive mode, control the display interface of the display device to only display content corresponding to the user category corresponding to the first screen viewing weight.

[0052] In some embodiments, the mode determination module 250 is further configured to: in response to the display mode being the split-screen negotiation mode, divide the display interface of the display device into a first display area and a second display area.

[0053] In some embodiments, the mode determination module 250 is further used to: when the display mode is a split-screen negotiation mode, control the first display area to display the display content corresponding to the user category corresponding to the first viewing weight, and control the second display area to display the display content corresponding to the user category corresponding to the second viewing weight.

[0054] In some embodiments, the mode determination module 250 is further used to: determine multiple shortlisted user categories in response to the display mode being the main-sub-screen mode; divide the display interface of the display device into multiple display areas; control at least one main display area to display display content corresponding to at least one main user category, and control at least one sub-display area to display display content corresponding to at least one sub-user category.

[0055] In some embodiments, the mode determination module 250 is further configured to: determine a plurality of legitimate users based on the current display mode of the display device; and determine a display module to be magnified based on the screen viewing information of the plurality of legitimate users.

[0056] In some embodiments, the mode determination module 250 is further used to: when the display device is in a split-screen negotiation mode, in response to the presence of display modules to be enlarged in both the first display area and the second display area, determine the conflict arbitration score of the first user category and the second user category based on the user level and line of sight projection angle of each legitimate user in the first user category and the second user category, and the business importance of the display module to be enlarged; based on the conflict arbitration score, determine the target display module, and enlarge the display of the target display module across the split-screen area.

[0057] In some embodiments, the mode determination module 250 is further used to: when the display device is in the main-sub-screen mode, in response to the presence of a display module to be enlarged in the main display area, determine the display module to be enlarged in the main display area as the target display module, and enlarge the target display module in the main display area or the cross-split screen area; in response to the presence of a display module to be enlarged in the sub-display area and the absence of a display module to be enlarged in the main display area, determine the display module to be enlarged in the sub-display area as the target display module, and enlarge the target display module in the main display area or the cross-split screen area.

[0058] For more information about the mode determination module 250, see Figure 3 and its related descriptions.

[0059] It should be noted that the above description of the display control system 200 and its modules is for convenience only and does not limit this specification to the scope of the embodiments. It is understandable that those skilled in the art, after understanding the principles of the system, may arbitrarily combine the modules or form subsystems connected to other modules without deviating from the principles. In some embodiments, Figure 2 The acquisition module 210, user determination module 220, category determination module 230, weight determination module 240, and mode determination module 250 disclosed in the disclosure may be different modules within a system, or a single module may implement the functions of two or more of the aforementioned modules. For example, each module may share a storage module, or each module may have its own storage module. Such variations are within the scope of protection of this specification.

[0060] Figure 3 is an exemplary flow chart of a display control method according to some embodiments of this specification. Figure 3 As shown, the process 300 includes the following steps: In some embodiments, the process 300 may be executed by the processing device 110 or the display control system 200 .

[0061] Step 310 : Acquire image information of one or more users within a preset area of ​​the display device. In some embodiments, step 310 may be performed by the processing device 110 or the acquisition module 210 .

[0062] A display device (eg, display device 140 ) refers to a device for presenting display content, such as a display screen, a projection screen, a television screen, and the like.

[0063] Display content refers to the media content presented on the display interface of a display device (for example, the displayable area of ​​a display screen). Display content may include plain text, reports, pictures, videos, etc.

[0064] It should be noted that a display content corresponds to a collection of media content, rather than being limited to a single media content. For example, a display content can include multiple pictures. For another example, a display content can include two reports, two pictures, and a video.

[0065] The preset area range refers to the two-dimensional area range in the horizontal direction in front of the display device. The front of the display device refers to the direction facing the display interface of the display device. The shape and size of the preset area range can be preset. For example, the preset area range can be a rectangular area on the ground in front of the display device with an area of ​​200m2 . For another example, the preset area range may be a semicircular horizontal plane area located in front of the display device, with the geometric center point of the display device as the center, and a radius of 30m. In the horizontal direction, part of the boundary of the preset area range may be close to the display device, or separated from the display device by a preset distance. For example, taking the shape of the preset area range as a semicircle (a semicircle includes a straight side and a semicircular arc side) as an example, the straight side boundary of the preset area range may be separated from the front of the display device (that is, the side where the display interface is located) by a preset distance, and the preset distance may be 0.5m, 1m, 1.5m, etc.

[0066] A user (eg, one or more users 160 ) refers to a person who interacts with a display device or views content displayed by the display device, such as a corporate member participating in a meeting or a person viewing a presentation.

[0067] In some embodiments, the display device may be configured with an observation device (e.g., a UWB (Ultra-Wideband) device, a TOF (Time of Flight) sensor, etc.). The observation device is used to determine the viewing position of one or more users. The viewing position of a user includes the distance, coordinates, and / or direction (angle) of the user relative to the display device.

[0068] For example, taking the observation device as a UWB device, the UWB device includes a UWB base station and a UWB tag. Among them, the UWB tag can be worn by each user (for example, the UWB tag is configured on the user through a bracelet or a badge), and the UWB base station can be configured on the display device. The UWB tag is used to transmit a pulse signal (for example, a nanosecond-level non-sinusoidal narrow pulse), and the UWB base station is used to receive the pulse signal transmitted by each UWB tag and calculate the distance and / or direction of each UWB tag relative to the UWB base station. Based on this, the processing device 110 or the acquisition module 210 can determine the distance and / or direction of each user relative to the display device as the viewing position of each user through the UWB device, and then determine whether each user is within the preset area range in combination with the position and size of the preset area range.

[0069] As another example, assuming the observation device is a time-of-flight sensor, the TOF sensor can transmit light signals and receive light signals reflected by users, and calculate the round-trip time of the light signals between the TOF sensor and each user, thereby calculating the distance and / or direction of each user relative to the TOF sensor. Based on this, the processing device 110 or the acquisition module 210 can use the TOF sensor to determine the distance of each user relative to the display device as the viewing position of each user, and then, combined with the position and size of the preset area range, determine whether each user is within the preset area range.

[0070] Image information refers to images or videos related to the user, such as images of the user's face or body posture. For example, the image acquisition device may be a camera that captures the user's face and / or body posture. The processing device 110 or the acquisition module 210 may acquire the user's image information via the image acquisition device (e.g., image acquisition device 150).

[0071] In some embodiments, the image information also includes the user's eye movement trajectory information, pupil change information, etc. The eye movement trajectory information reflects the trajectory of the user's line of sight on the surface of the object the user is observing, and the pupil change information reflects the changes in the size of the user's pupil when viewing the display device.

[0072] In some embodiments, the image acquisition device may be configured with a biometric information recognition device to obtain the user's eye movement trajectory information and / or pupil change information. For example, the biometric information recognition device may be an eye tracker that uses eye tracking technology to obtain the user's eye movement trajectory information.

[0073] In some embodiments, the image acquisition device may acquire image information of a user within a preset area of ​​the display device at a preset frequency and transmit the image information to the processing device 110 or the acquisition module 210. Exemplary preset frequencies may be 60 times / minute, 30 times / minute, 20 times / minute, etc.

[0074] Step 320 : Determine at least one user in the system among the one or more users, the identity information of each user in the system, and the screen viewing information of each user in the system on the display device based on the image information. In some embodiments, step 320 may be performed by the processing device 110 or the user determination module 220 .

[0075] In-system users are users whose identity information has been entered into a personnel management system (e.g., a personnel management system stored in a storage device). For example, in the application scenario of display control system 200, such as an exhibition visitor, the personnel management system could be an application created by the exhibition organizer to manage attendees. In-system users could be members of companies invited to the exhibition. Their identity information has been pre-entered into the personnel management system, and they are therefore referred to as in-system users.

[0076] It is understood that in the application scenario of the display control system 200, in addition to system users, there may also be non-system users. For example, taking the application scenario of the display control system 200 as an example, among the users who visit the exhibition, there may also be people who are not invited but still come to visit the exhibition. The exhibition behavior of these people cannot be predicted in advance, and therefore the identity information of these people cannot be entered into the personnel management system in advance. Therefore, they are called non-system users.

[0077] Identity information refers to information related to a user's identity. This information may include the user's ID, name, company affiliation, and company type (e.g., investor, general contractor, or contractor). For example, a user's identity information might be "ID: 0275, name: Zhang San, company A, and company type: contractor."

[0078] In some embodiments, the processing device 110 or the user determination module 220 can match the acquired image information of each user based on the facial image in the user's image information (hereinafter referred to as the current facial image) with the facial images of various users pre-stored in a storage device (e.g., storage device 130) (hereinafter referred to as pre-stored facial images). If a pre-stored facial image successfully matches, the user is determined as a user within the system. The aforementioned matching refers to determining the similarity between each pre-stored facial image and the current facial image, and a successful match means that the aforementioned similarity is greater than a preset similarity threshold. In conjunction with the foregoing, the storage device can store the identity information of one or more users, as well as the correspondence between the image information and the identity information of each of the one or more users. Based on this, the processing device 110 or the user determination module 220 can determine the identity information corresponding to the successfully matched pre-stored facial image as the identity information of the user.

[0079] In some embodiments, the processing device 110 or the user determination module 220 may be configured with an image recognition model. The image recognition model is a machine learning model (e.g., a convolutional neural network (CNN) model). The input of the image recognition model is the currently acquired user image information, and the output is whether the user is a user in the system and the identity information of the user in the system.

[0080] In some embodiments, the processing device 110 or the user determination module 220 may also determine the identity information of at least one user in the system and each user in the system in other ways, which are not limited here.

[0081] Screen viewing information refers to information reflecting a user's behavior while viewing a display device. This information includes whether the user is currently looking at the display device, their relative position relative to the display device, and the duration of their gaze. For example, a user's screen viewing information might be "currently looking at the display device, located directly in front of the display device, 5 meters away from the display device, and has been looking for 2 minutes."

[0082] In some embodiments, the processing device 110 or the user determination module 220 may determine whether the user in the system is looking at the display device based on the eye movement trajectory information in the image information. For example, the processing device 110 or the user determination module 220 may determine the gaze point corresponding to the time point at which the image information was acquired in the eye movement trajectory. If the gaze point is located on the display device, then the user in the system is determined to be looking at the display device.

[0083] In some embodiments, the duration of a gaze at a display device can be determined based on the number of times a user within the system is consecutively determined to be gazing at the display device. For example, assuming that the image acquisition device acquires image information (including eye movement trajectory information) 60 times per minute (i.e., once per second) (it is understood that each time image information is acquired, a determination is made as to whether the user within the system is gazing at the display device). If a user within the system is determined to be gazing at the display device based on the most recently acquired eye movement trajectory information, and prior to this determination, the user has been determined to be gazing at the display device 22 times in a row, then the duration of the user's gaze at the display device within the system is 22 + 1 = 23 seconds.

[0084] In some embodiments, the position of a user within the system relative to the display device when looking at the display device can be determined based on the distance and direction of the user within the system relative to the display device. For information on how to obtain the aforementioned distance and direction, please refer to the above description. In some embodiments, based on the distance and direction of the user within the system relative to the display device, the coordinate value of the user within the system relative to the display device (i.e., the coordinate value with the geometric center point of the display device as the origin) can be calculated as the position of the user within the system relative to the display device when looking at the display device.

[0085] Step 330 : Determine the user category to which each user in the system belongs based on the identity information. In some embodiments, step 330 may be performed by the processing device 110 or the category determination module 230 .

[0086] User categories refer to the classification categories to which users in the system belong. There are multiple user categories, and each user category includes one or more users in the system.

[0087] In some embodiments, the user category is related to the enterprise to which the user belongs. In some embodiments, the user category can be divided based on the position of the user in the enterprise within the system. For example, the number of user categories can be four, and the four user categories are directors, executives, middle management, and employees. Among them, the directors category includes the chairman and directors of the enterprise, the executives category includes the general manager, deputy general manager, director, and deputy director of the enterprise, the middle management category includes managers, deputy managers, and supervisors of various departments of the enterprise, and the employee category includes ordinary employees of the enterprise.

[0088] In some embodiments, the processing device 110 or the user determination module 220 may access the internal system of the enterprise to which each user in the system belongs (e.g., a human resources management system, an office automation (OA) system, etc.), and based on the identity information (e.g., user ID or name) of each user in the system, query the internal enterprise system for the position of each user in the system, thereby determining the user category to which each user in the system belongs. For example, if user Zhang San in the system belongs to enterprise A, the processing device 110 or the user determination module 220 may access the OA system of enterprise A and query Zhang San's position. For example, assuming that Zhang San's position is human resources manager, the user category to which Zhang San belongs is middle management.

[0089] In some embodiments, each user category corresponds to a display content, which includes content that users in the system within that user category are interested in or expect to see. For example, the display content for directors might include company revenue reports or new product demonstration videos. Another example is that the display content for mid-level management might include performance summaries or work schedules for the next quarter.

[0090] Step 340 : For each user category, determine the screen viewing weight corresponding to the user category based on the user category and the screen viewing information of the users in the system belonging to the user category. In some embodiments, step 340 may be performed by the processing device 110 or the weight determination module 240 .

[0091] The screen viewing weight is a numerical value used to measure the user's priority in allocating display resources to a display device. The larger the screen viewing weight corresponding to a user category, the more attention and importance that user category receives, and the more inclined the display content on the display device is to be displayed for users within the system belonging to that user category. For example, the larger the screen viewing weight of a user category, the larger the area of ​​the displayed content on the display device's display interface.

[0092] In some embodiments, for each of the user categories, the processing device 110 or the weight determination module 240 can obtain the preset weight corresponding to the user category; determine the screen viewing ratio based on the screen viewing information of users in the system belonging to the user category; and determine the screen viewing weight corresponding to the user category based on the preset weight and screen viewing ratio corresponding to the user category.

[0093] Preset weights are values ​​pre-set for each user category, reflecting their importance. For example, the preset weights for Directors, Executives, Middle Managers, and Employees could be 10, 5, 3, and 1, respectively, decreasing in order based on the level of users within the system. Another example could be Directors, Executives, Middle Managers, Senior Employees (e.g., Engineers, Designers), and General Employees, with preset weights of 5, 4, 3, 2, and 1, respectively.

[0094] The preset weights corresponding to each user category may be pre-stored in a storage device (eg, storage device 130 ), and the processing device 110 or the weight determination module 240 may call the preset weights of each user category from the storage device.

[0095] The screen viewing ratio refers to the percentage of users in a user category who are currently looking at a display device, compared to all users in that user category. For example, if a user category includes five users in the system, and two of them are currently looking at a display device, the screen viewing ratio for that user category is 40%.

[0096] After obtaining the preset weights for the user categories and determining the screen viewing ratios, the processing device 110 or the weight determination module 240 may calculate the screen viewing weights for the user categories based on the preset weights and screen viewing ratios for the user categories. For example, the product of the preset weights for the user categories and the screen viewing ratios may be used as the screen viewing weights for the user categories.

[0097] In some embodiments, for each user category, the processing device 110 or the weight determination module 240 may obtain a preset weight corresponding to the user category; determine a first coefficient corresponding to the user category based on the preset weight corresponding to the user category and the number of users; determine a second coefficient corresponding to the user category based on the screen viewing information of users in the system belonging to the user category and the preset weight corresponding to the user category; and determine the screen viewing weight corresponding to the user category based on the first coefficient and the second coefficient. For more information about this embodiment, please refer to Figure 6 and its related descriptions.

[0098] Step 350 : Determine the display mode of the display device based on the numerical relationship between the screen viewing weights corresponding to the user categories. In some embodiments, step 350 may be performed by the processing device 110 or the mode determination module 250 .

[0099] The numerical relationship between the screen viewing weights corresponding to each user category refers to the mathematical relationship between the screen viewing weight values ​​corresponding to each user category, such as a size relationship, a proportional relationship, a multiple relationship, etc.

[0100] A display mode refers to the layout of the displayed content on a display interface of a display device (e.g., display device 140). Different layout modes display different amounts of content and have different attributes (e.g., position, shape, size, etc.) of the displayed content.

[0101] In some embodiments, the display modes include main screen exclusive mode, split screen negotiation mode and main and sub-screen mode.

[0102] The main screen exclusive mode means that the display interface of the display device includes only one display area, and the display area is exclusively occupied by one display content.

[0103] Figure 4A This is a schematic diagram of the main screen exclusive mode shown in some embodiments of this specification.

[0104] For example, Figure 4A As shown, the display interface 400 of the display device includes only one display area 411 , and the display area 411 is exclusively occupied by one display content.

[0105] The split-screen negotiation mode means that the display interface of the display device is divided into two display areas (a first display area and a second display area) arranged left and right or up and down, and each display area presents one display content.

[0106] Figure 4B This is a schematic diagram of the split-screen negotiation mode shown in some embodiments of this specification.

[0107] For example, Figure 4B As shown, the display interface 400 of the display device presents a first display area 421 and a second display area 422 arranged left and right, and the first display area 421 and the second display area 422 respectively present different display contents.

[0108] The main-sub-screen mode means that the display interface of the display device is divided into multiple display areas, and the multiple display areas include at least one main display area and at least one sub-display area, and the area of ​​the main display area is larger than the area of ​​each sub-display area.

[0109] Figure 4C This is a schematic diagram of the main-secondary screen mode according to some embodiments of this specification.

[0110] For example, Figure 4C As shown, the display interface 400 of the display device presents three display areas arranged left and right, including a main display area 431, a sub-display area 432 and a sub-display area 433, and the above three display areas respectively present different display contents.

[0111] In some embodiments, the processing device 110 or the mode determination module 250 can sort the viewing weights corresponding to all user categories from large to small to obtain a sorting result; based on the sorting result, determine whether the numerical relationship meets the first preset condition; in response to the numerical relationship meeting the first preset condition, determine that the display mode is the main screen exclusive mode; in response to the numerical relationship not meeting the first preset condition, determine whether the numerical relationship meets the second preset condition; in response to the numerical relationship meeting the second preset condition, determine that the display mode is the split-screen negotiation mode; in response to the numerical relationship not meeting the second preset condition, determine whether the numerical relationship meets the third preset condition; in response to the numerical relationship meeting the third preset condition, determine that the display mode is the main-secondary screen mode. For more information about this embodiment, please refer to Figure 7 and its related descriptions.

[0112] In some embodiments, as Figure 3 As shown, the process 300 further includes the following steps 360 to 380.

[0113] Step 360 : Determine at least one non-system user and screen viewing information of each non-system user from the one or more users based on the image information. In some embodiments, step 360 may be performed by the processing device 110 or the user determination module 220 .

[0114] In conjunction with the above, "in-system users" refers to users who have completed identity entry in the personnel management system. Based on this, "out-system users" refers to users who have not completed identity entry in the personnel management system. For more information about "out-system users," please refer to the above description.

[0115] In conjunction with the foregoing, screen viewing information refers to information reflecting the user's behavior when viewing a display device.

[0116] In some embodiments, the processing device 110 or the user determination module 220 may determine the screen viewing information of users outside the system based on a method similar to determining the screen viewing information of users within the system. For more details, please refer to the above text and will not be repeated here.

[0117] Step 370 : Determine a viewing scenario based on the user category and viewing information of at least one user within the system and the viewing information of at least one user outside the system. In some embodiments, step 370 may be performed by the processing device 110 or the mode determination module 250 .

[0118] The viewing scene comprehensively reflects the viewing scenario of the display device by all users (including users in the system and those outside the system). Viewing scenarios include explanation and demonstration scenarios, and exhibition visit scenarios.

[0119] An explanation and demonstration scenario refers to an interactive scenario in which explanations and demonstrations are performed through a display device, for example, a scenario in which the functions of a new product are explained and demonstrated through a display device.

[0120] A display viewing scene refers to a scene in which display content is presented through a display device for viewing, for example, a scene in which the appearance of a new product is displayed through a display device.

[0121] In some embodiments, the processing device 110 or the mode determination module 250 may determine the screen viewing scenario based on the screen viewing positions of users within the system and the screen viewing positions of users outside the system.

[0122] In some embodiments, in response to the screen viewing position of the system user being located in the center area of ​​the screen viewing positions of the non-system users, the processing device 110 or the mode determination module 250 determines that the screen viewing scene is a lecture and demonstration scene.

[0123] The screen viewing positions of the users within the system are located in the center of the screen viewing positions of the non-system users, which means that there is at least one user within the system in the area surrounded by a plurality of non-system users.

[0124] Figure 5A This is a schematic diagram of the user's screen viewing position according to some embodiments of this specification.

[0125] For example, Figure 5A As shown, in an area surrounded by multiple non-system users (including non-system users 521, 522, 523, 524, 525, 526, 527 and 528), there is at least one system user (including system users 511 and 512). At this time, the processing device 110 or the mode determination module 250 can determine that the viewing scene is a demonstration scene.

[0126] In some embodiments, the processing device 110 or the mode determination module 250 can determine the location feature count of each non-system user respectively; in response to the location feature counts of all non-system users being greater than zero, it is determined that the viewing scene is a demonstration scene.

[0127] The location feature count refers to the number of users in the system whose viewing locations are adjacent to that of a non-system user. For example, if three users in the system have viewing locations adjacent to that of a non-system user, the location feature count for that non-system user is 3.

[0128] Figure 5B This is a schematic diagram of the user's screen viewing position shown in other embodiments of this specification.

[0129] For example, Figure 5BAs shown, there are four non-system users, namely non-system users 541, 542, 543, and 544. The system users adjacent to the viewing position of non-system user 541 include system users 531, 532, and 535. The system users adjacent to the viewing position of non-system user 542 include system users 533 and 537. The system users adjacent to the viewing position of non-system user 543 include system users 533, 536, 537, and 5310. The system users adjacent to the viewing position of non-system user 544 include system users 534, 538, and 539. Therefore, it can be statistically determined that the location feature counts of non-system users 541, 542, 543, and 544 are 3, 2, 4, and 3, respectively (all greater than zero). At this point, the processing device 110 or the mode determination module 250 can determine that the viewing scene is a lecture and demonstration scene.

[0130] Step 380: Adjust the display mode based on the viewing scenario.

[0131] In some embodiments, a storage device (e.g., storage device 130) may pre-store a correspondence between display modes and viewing scenarios. After determining the viewing scenario, processing device 110 or mode determination module 250 retrieves the correspondence from the storage device and determines an adjusted display mode based on the viewing scenario and the correspondence. For example, if a lecture and demonstration scenario corresponds to the main screen exclusive mode, processing device 110 or mode determination module 250, upon determining that the viewing scenario is the lecture and demonstration scenario, determines that the display mode needs to be adjusted to the main screen exclusive mode.

[0132] In some embodiments, in response to the existence of a system user's viewing position located in the center area of ​​a non-system user's viewing position, the processing device 110 or the mode determination module 250 determines that the viewing scene is a lecture and demonstration scene, and then, the processing device 110 or the mode determination module 250 adjusts the display mode of the display device to the main screen exclusive mode, and controls the display interface of the display device to display the display content corresponding to the user category to which the system user located in the center area belongs.

[0133] Continue to refer to Figure 5A , combined with the above, the processing device 110 or the mode determination module 250 is based on Figure 5A The user viewing position shown can determine that the viewing scene is an explanation and demonstration scene. At this time, the processing device 110 or the mode determination module 250 can further adjust the display mode of the display device to the main screen exclusive mode, and control the display interface of the display device to display the display content corresponding to the user category to which the user in the system located in the center area belongs (that is, the user category to which users 511 and 512 in the system belong).

[0134] In some embodiments, the processing device 110 or the mode determination module 250 can determine the location feature count of each non-system user respectively; in response to the location feature counts of all non-system users being greater than zero, it is determined that the viewing scene is a lecture and demonstration scene, and then the processing device 110 or the mode determination module 250 adjusts the display mode of the display device to the main screen exclusive mode, and controls the display interface of the display device to display the display content corresponding to the user category to which the system user located in the center area belongs.

[0135] Continue to refer to Figure 5B , combined with the above, the processing device 110 or the mode determination module 250 is based on Figure 5B The user viewing position shown can determine that the viewing scene is an explanation and demonstration scene. At this time, the processing device 110 or the mode determination module 250 can further adjust the display mode of the display device to the main screen exclusive mode, and control the display interface of the display device to display the display content corresponding to the user category of the system user (system users 531~5310) adjacent to the viewing position of the non-system user.

[0136] In some embodiments of this specification, the spatial position and positional relationship of users within the system and users outside the system are used to accurately identify the explanation and demonstration scene, and automatically switch the display mode to the main screen exclusive mode, thereby ensuring the user's viewing experience and eliminating the need for manual switching, saving labor costs.

[0137] In some embodiments of this specification, by determining the viewing scenario and dynamically adapting the optimal interface presentation strategy (display mode) according to the viewing scenario, the efficiency of information transmission can be improved, the user experience can be optimized, and the cost of manual switching can be reduced.

[0138] In some embodiments of the present specification, by introducing user categories and screen viewing information to dynamically calculate the viewing weight, the display mode of the display device can be made more convenient for high-weight users to view, so as to ensure that important information is accurately displayed to high-weight users, and to avoid important information not being well displayed due to the presence of secondary users; by setting three display modes (main screen exclusive mode, split-screen negotiation mode and main-sub screen mode), the main screen exclusive mode can be used to display the content of interest to users whose viewing weight is significantly higher than other users, and the split-screen negotiation mode can be used to display the relevant content to users with similar weights respectively, ensuring that different categories of roles efficiently obtain the required display content.

[0139] It should be noted that the above description of process 300 is for illustration and purpose only and does not limit the scope of application of this specification. Those skilled in the art may, under the guidance of this specification, make various modifications and changes to process 300. However, such modifications and changes remain within the scope of this specification. For example, after executing step 310, steps 360 to 380 may be executed first, and then steps 320 to 350 may be executed. For another example, process 300 may only include steps 310 to 350. For another example, process 300 may only include steps 310 and steps 360 to 380.

[0140] Figure 6 FIG. 1 is an exemplary flow chart of determining screen viewing weights according to some embodiments of this specification. Figure 6 As shown, the process 600 includes the following steps: In some embodiments, the process 600 may be executed by the processing device 110 or the weight determination module 240 .

[0141] Step 610: For each user category, obtain the preset weight corresponding to the user category.

[0142] For more information about user categories and preset weights, see Figure 3 and its related descriptions.

[0143] Step 620: Determine a first coefficient corresponding to the user category based on the preset weight corresponding to the user category and the number of users.

[0144] The number of users corresponding to a user category refers to the number of users in the system that belong to that user category.

[0145] In some embodiments, the first coefficient may be calculated based on preset weights corresponding to user categories and the number of users.

[0146] In some embodiments, the calculation method of the first coefficient can be shown in the following formula (1): (1) in, For the ( is a positive integer, , is the number of user categories) the first coefficient of the user category, For the The preset weights of user categories, For the The number of users in each user category.

[0147] Step 630: Determine the second coefficient corresponding to the user category based on the screen viewing information of users in the system belonging to the user category and the preset weight corresponding to the user category. Figure 3 and its related descriptions.

[0148] The second coefficient is different from the first coefficient.

[0149] In some embodiments, the second coefficient may be calculated based on screen viewing information of users in the system belonging to a user category and a preset weight corresponding to the user category.

[0150] In some embodiments, the second coefficient may be calculated as shown in the following formula (2): (2) in, For the The second coefficient of the user category, For the User category ( is a positive integer, ) is the screen viewing information score of users in the system. The meanings of other parameters in formula (2) are the same as those in formula (1), and can be referred to formula (1).

[0151] The screen viewing information score refers to a score value determined based on the screen viewing information of users in the system.

[0152] In some embodiments, the processing device 110 or the weight determination module 240 determines the screen viewing information score corresponding to the screen viewing information of users in each system based on a vector matching method.

[0153] Specifically, a storage device (e.g., storage device 130) may be configured with a vector database, which may store multiple reference vectors and a reference score corresponding to each reference vector (e.g., 1, 2, 5, 20, etc.). Each reference vector includes multiple elements, each of which represents whether the user is looking at the display device (for example, 1 represents looking and 0 represents not looking), the distance relative to the display device when looking at the display device, the direction relative to the display device when looking at the display device (represented by the angle between the user's line of sight within the system and the normal line of the display interface of the display device (a line perpendicular to the display interface of the display device)), and the duration of the user's gaze on the display device. The reference score corresponding to the reference vector can be preset. For example, a reference vector may be (1, 3.1, 25, 15), which means: the user within the system is currently looking at the display device, the distance relative to the display device is 3.1 meters, the line of sight relative to the display device is in a 25° direction, and the user has been looking at the display device for 15 seconds.

[0154] The processing device 110 or the weight determination module 240 can construct a feature vector corresponding to the screen viewing information of each user in the system based on the screen viewing information of each user in the system. Similar to the reference vector, the feature vector includes multiple elements, and the value of each element represents whether the display device is being looked at (for example, 1 represents looking at, and 0 represents not looking at), the distance relative to the display device when looking at the display device, the direction relative to the display device when looking at the display device, and the length of time the display device has been looked at. For example, the reference vector can be (1, 2.3, 10, 17), which means: the user in the system is currently looking at the display device, the distance relative to the display device is 2.3m, the direction of the line of sight relative to the display device is 10°, and the length of time the display device has been looked at is 17s.

[0155] Furthermore, the processing device 110 or the weight determination module 240 can respectively calculate the vector distance between each reference vector in the vector database and the feature vector, and use the reference score corresponding to the reference vector with the smallest vector distance as the viewing information score corresponding to the viewing information of the user in the system. For example, assuming that the feature vector corresponding to the viewing information of the user in the system is vector X, after calculation, among the various reference vectors in the vector database, the reference vector with the smallest vector distance to vector X is vector Y, and the reference score corresponding to vector Y is 7, then the viewing information score corresponding to the viewing information of the user in the system is 7. The calculation method of the vector distance can be Euclidean distance, Manhattan distance, Chebyshev distance, cosine similarity, etc., which is not limited here.

[0156] In some embodiments, the processing device 110 or the weight determination module 240 is configured with a rating determination model to determine a viewing information score corresponding to the viewing information. The rating determination model is a machine learning model. The input of the rating determination model includes the viewing information of each user within the system belonging to each user category, and the output of the rating determination model includes the viewing information score corresponding to each user within the system. The viewing information corresponding to multiple user categories can be input into the rating determination model simultaneously (e.g., grouped), or the viewing information corresponding to each user category can be input into the rating determination model separately.

[0157] In some embodiments, the processing device 110 or the weight determination module 240 determines, for at least one user within the system, at least one intended user who views the display device based on the screen viewing information.

[0158] A potential user is a user in the system who has looked at a display device within a preset time period. The preset time period is the period before the current moment. The duration of the preset time period can be preset, for example, 20 seconds, 30 seconds, 1 minute, etc.

[0159] For example, using a preset time period of 30 seconds as an example, if the user's screen viewing information 25 seconds prior to the current moment indicates that they were looking at the display device, then the user in the system will be identified as an intended user. As another example, still using a preset time period of 30 seconds as an example, if the user's screen viewing information 30 seconds prior to the current moment indicates that they were not looking at the display device, then the user in the system will not be identified as an intended user.

[0160] After determining at least one intended user, the processing device 110 or the weight determination module 240 determines the distance information and gaze duration of the at least one intended user relative to the display device based on the screen viewing information. The aforementioned distance information and gaze duration can be directly determined based on the screen viewing information of the at least one intended user. For more information about screen viewing information, please refer to Figure 3 and its related descriptions.

[0161] In some embodiments, the processing device 110 or the weight determination module 240 determines, for each user category, the second coefficient of the user category based on the distance information and gaze duration of the intended users belonging to the user category.

[0162] In some embodiments, for each user category, the second coefficient can be calculated based on the distance information (characterizing the distance of the intended user relative to the display device) and gaze duration of the intended users belonging to the user category, and a preset weight of the user category.

[0163] In some embodiments, the second coefficient may be calculated as shown in the following formula (3): (3) in, For the The second coefficient of the user category, For the The number of intended users in each user category, For the User category ( is a positive integer, ) The gaze duration of the intended user, For the The sum of the gaze durations of all intended users in a user category, is the distance attenuation coefficient (constant), For the User category The distance between the intended user and the display device, For the The preset weights for each user category.

[0164] Step 640: Determine the screen viewing weight corresponding to the user category based on the first coefficient and the second coefficient.

[0165] In some embodiments, the screen viewing weight corresponding to the user category can be calculated based on the first coefficient and the second coefficient.

[0166] In some embodiments, the method for calculating the screen viewing weight may be as shown in the following formula (4): (4) in, For the The viewing weight of each user category, and is the proportionality coefficient, and The meanings of other parameters in formula (4) are the same as those in formula (1) to formula (3), and can be referred to formula (1) to formula (3).

[0167] In some embodiments, the method for calculating the screen viewing weight may be as shown in the following formula (5): (5) The meanings of the parameters in formula (5) are the same as those in formula (1) to formula (4), and reference can be made to formula (1) to formula (4).

[0168] In some embodiments of the present specification, different screen viewing weights are determined for users of different user categories to ensure that high-weight users have screen viewing priority, thereby preventing the display device from being disturbed by the excessive number of low-weight user groups in displaying key information; the actual screen viewing weight is determined based on the gaze duration and the distance when gazing at the display device, thereby reducing the contribution of long-distance or short-gaze users to the weight, making the determined screen viewing weight more reasonable.

[0169] Figure 7 FIG. 1 is an exemplary flow chart of determining a display mode according to some embodiments of this specification. Figure 7 As shown, the process 700 includes the following steps: In some embodiments, the process 700 may be executed by the processing device 110 or the mode determination module 250 .

[0170] Step 710: sort the screen viewing weights corresponding to all user categories from large to small to obtain a sorting result.

[0171] Step 720: Based on the sorting result, determine whether the numerical relationship meets the first preset condition.

[0172] The above numerical relationship refers to the numerical relationship of the viewing weights corresponding to each user category. In conjunction with the previous text, the numerical relationship of the viewing weights corresponding to each user category refers to the mathematical relationship of the viewing weight values ​​corresponding to each user category, such as the size relationship, proportional relationship, multiple relationship, etc.

[0173] The first preset condition includes the first viewing weight being no less than a preset multiple (e.g., 2x, 3x, 5x, etc.) of the median viewing weight, or the first viewing weight being greater than half of the total viewing weights. The first viewing weight is the viewing weight ranked first in the sorted result (i.e., the maximum value among all viewing weights). The median viewing weight is the median of the viewing weights corresponding to each user category. The total viewing weight is the sum of the viewing weights corresponding to all user categories. For example, assuming there are five user categories and a preset multiple of 2, the viewing weights corresponding to these five user categories are 2, 10, 3, 4, and 7, respectively. The sorting result from largest to smallest is 10-7-4-3-2. Therefore, the first viewing weight is 10, the median viewing weight is 4, and the first viewing weight is greater than the preset multiple (10 > 4 × 2) of the median viewing weight. Therefore, the numerical relationship satisfies the first preset condition. For another example, there are 5 user categories, and the corresponding viewing weights of these 5 user categories are 2, 15, 1, 4, and 6 respectively. The sorting result from large to small is 15-6-4-2-1, so the first viewing weight is 15, and the total viewing weight is 15+6+4+2+1=28. The first viewing weight is greater than half of the total viewing weight (15>28 / 2), so the numerical relationship meets the first preset condition.

[0174] Step 730 , in response to the numerical relationship satisfying the first preset condition, determining that the display mode is the main screen exclusive mode; in response to the numerical relationship not satisfying the first preset condition, proceeding to step 740 .

[0175] In some embodiments, in response to the display mode being the main screen exclusive mode, the processing device 110 or the mode determination module 250 controls the display interface of the display device to only display content corresponding to the user category corresponding to the first viewing weight.

[0176] For example, Figure 4A As shown, the processing device 110 or the mode determination module 250 controls the display interface 400 of the display device to display only the display content corresponding to the user category corresponding to the first viewing weight. For example, assuming that the user category corresponding to the first viewing weight is a director, the processing device 110 or the mode determination module 250 controls the display interface 400 of the display device to display only the display content corresponding to directors (e.g., pictures or reports that directors desire to view).

[0177] Step 740: Determine whether the numerical relationship meets a second preset condition.

[0178] The second preset condition includes the sum of the first weights being no less than a preset multiple of the median viewing weight, or the sum of the first weights being greater than half of the total viewing weights. The first weight sum is the sum of the first viewing weight and the second viewing weight. The second viewing weight is the second-highest viewing weight in the above-mentioned descending order (i.e., the second-highest viewing weight among all viewing weights). For example, assuming there are five user categories and a preset multiple of 3, the viewing weights corresponding to these five user categories are 5, 1, 3, 8, and 4, respectively. The descending order is 8-5-4-3-1, resulting in a first viewing weight of 8 and a second viewing weight of 5. The sum of the first weights is 8+5=13, and the median viewing weight is 4. The sum of the first weights is greater than the preset multiple of the median viewing weight (13>4×3), and the numerical relationship satisfies the second preset condition. For another example, there are 5 user categories, and the corresponding viewing weights of these 5 user categories are 2, 9, 1, 4, and 6 respectively. The sorting result from large to small is 9-6-4-2-1, so the first viewing weight is 9, the second viewing weight is 6, the sum of the first weights is 9+6=15, and the total viewing weights is 9+6+4+2+1=22. The sum of the first weights is greater than half of the total viewing weights (15>22 / 2), so the numerical relationship meets the second preset condition.

[0179] Step 750 , in response to the numerical relationship satisfying the second preset condition, determining that the display mode is the split-screen negotiation mode; in response to the numerical relationship not satisfying the second preset condition, proceeding to step 760 .

[0180] In some embodiments, in response to the display mode being the split-screen negotiation mode, the processing device 110 or the mode determination module 250 divides the display interface of the display device into a first display area and a second display area.

[0181] For example, Figure 4B As shown, in response to the display mode being the split-screen negotiation mode, the processing device 110 or the mode determination module 250 divides the display interface 400 of the display device into a first display area 421 and a second display area 422 .

[0182] In some embodiments, the processing device 110 or the mode determination module 250 divides the display interface of the display device into a first display area and a second display area based on the first viewing weight and the second viewing weight. In some embodiments, the area ratio between the first display area and the second display area is determined based on the ratio of the first viewing weight to the second viewing weight. For example, if the ratio of the first viewing weight to the second viewing weight is 3:2, then the area ratio between the first display area and the second display area is also 3:2.

[0183] In some embodiments, when the display mode is a split-screen negotiation mode, the processing device 110 or the mode determination module 250 controls the first display area to display the display content corresponding to the user category corresponding to the first viewing weight, and controls the second display area to display the display content corresponding to the user category corresponding to the second viewing weight.

[0184] For example, Figure 4B As shown, the processing device 110 or the mode determination module 250 controls the first display area 421 to display the display content corresponding to the user category corresponding to the first viewing weight, and controls the second display area 422 to display the display content corresponding to the user category corresponding to the second viewing weight. For example, assuming that the user category corresponding to the first viewing weight is directors, and the user category corresponding to the second viewing weight is executives, the processing device 110 or the mode determination module 250 controls the first display area 421 of the display device to display the display content corresponding to directors (e.g., pictures or reports that directors want to view), and controls the second display area 422 of the display device to display the display content corresponding to executives (e.g., pictures or videos that executives want to view).

[0185] Step 760: Determine whether the numerical relationship meets the third preset condition.

[0186] The second preset condition includes the sum of the second weights being no less than a preset multiple of the median viewing weight, or the sum of the second weights being greater than half the sum of the viewing weights. The second weight sum is the sum of the first, second, and third viewing weights. The third viewing weight is the third-ranked viewing weight in the aforementioned descending order (i.e., the third-highest viewing weight among all viewing weights). For example, assuming there are five user categories and a preset multiple of 3, the viewing weights corresponding to these five user categories are 5, 1, 3, 6, and 4, respectively. The sorting result is 6-5-4-3-1, resulting in a first viewing weight of 6, a second viewing weight of 5, and a third viewing weight of 4. The sum of the second weights is 6+5+4=15, and the median viewing weight is 4. The sum of the second weights is greater than the preset multiple of the median viewing weight (15>4×3), and the numerical relationship satisfies the third preset condition. For another example, there are 7 user categories, and the corresponding viewing weights of these 7 user categories are 2, 7, 1, 4, 5, 3, and 8 respectively. The sorting result is 8-7-5-4-3-2-1, then the first viewing weight is 8, the second viewing weight is 7, and the third viewing weight is 5. The sum of the second weights is 8+7+5=20, and the total viewing weights is 8+7+5+4+3+2+1=30. The sum of the first weights is greater than half of the total viewing weights (20>30 / 2), so the numerical relationship meets the third preset condition.

[0187] Step 770: In response to the numerical relationship satisfying the third preset condition, determining that the display mode is the primary-secondary screen mode.

[0188] In some embodiments, in response to the display mode being the primary-slave screen mode, the processing device 110 or the mode determination module 250 may determine a plurality of shortlisted user categories.

[0189] The multiple shortlisted user categories are user categories corresponding to the top N viewing weights in the aforementioned sorting results. The multiple shortlisted user categories include at least one main user category and at least one secondary user category. The main user category is the user category corresponding to the top M viewing weights in the sorting results, and the secondary user category is the user category other than the main user category in the multiple shortlisted user categories, where N and M are both positive integers, and N>M≥1. For example, taking N=3 and M=1 as an example, the multiple shortlisted user categories are user categories corresponding to the top 3 viewing weights in the sorting results, the main user category is the user category corresponding to the top 1 viewing weight (first viewing weight) in the sorting results, and the secondary user category is the user category corresponding to the 2 viewing weights that are ranked 2nd (second viewing weight) and 3rd (third viewing weight) in the sorting results. For another example, taking N=5 and M=2, the multiple shortlisted user categories are the user categories corresponding to the top 5 viewing weights in the sorting results, the main user category is the user category corresponding to the top 2 viewing weights (the first viewing weight and the second viewing weight) in the sorting results, and the secondary user category is the user category corresponding to the 3 viewing weights ranked from the 3rd (third viewing weight) to the 5th in the sorting results.

[0190] In some embodiments, when the display mode is primary / secondary screen mode, the display interface of the display device is divided into multiple display areas. The multiple display areas include at least one primary display area and at least one secondary display area. The number of the at least one primary display area is equal to the number of the at least one primary user category, and the number of the at least one secondary display area is equal to the number of the at least one secondary user category.

[0191] For example, Figure 4C As shown, in response to the display mode being the main-sub-screen mode, taking the number of main user categories as 1 and the number of sub-user categories as 2 as an example, the processing device 110 or the mode determination module 250 divides the display interface 400 of the display device into a main display area (i.e., the main display area 431) and two sub-display areas (including sub-display area 432 and sub-display area 433).

[0192] In some embodiments, the area of ​​the primary display region is larger than the area of ​​the secondary display region. Figure 4C As shown, the area of ​​the main display area 431 is larger than the areas of the auxiliary display area 432 and the auxiliary display area 433.

[0193] In some embodiments, when the display mode is the primary-secondary screen mode, the area ratio of each display area is determined based on the ratio of the viewing weight of each display area. Figure 4C As shown, assuming that the ratio of the viewing weights corresponding to the main display area 431, the sub-display area 432, and the sub-display area 433 is 6:3:2, the ratio of the areas of the display area 431, the sub-display area 432, and the sub-display area 433 is 6:3:2.

[0194] In some embodiments, in response to the display mode being the main-sub-screen mode, the processing device 110 or the mode determination module 250 controls at least one main display area to display display content corresponding to at least one main user category, and controls at least one sub-display area to display display content corresponding to at least one sub-user category.

[0195] For example, Figure 4C As shown, the processing device 110 or the mode determination module 250 controls the main display area 431 to display the display content corresponding to the user category corresponding to the first viewing weight, controls the secondary display area 432 to display the display content corresponding to the user category corresponding to the second viewing weight, and controls the secondary display area 433 to display the display content corresponding to the user category corresponding to the third viewing weight. For example, assuming that the user category corresponding to the first viewing weight is directors, the user category corresponding to the second viewing weight is executives, and the user category corresponding to the third viewing weight is employees, the processing device 110 or the mode determination module 250 controls the main display area 431 of the display device to display the display content corresponding to directors (e.g., pictures or reports that directors want to view), controls the secondary display area 432 of the display device to display the display content corresponding to executives (e.g., pictures or videos that executives want to view), and controls the secondary display area 433 of the display device to display the display content corresponding to employees (e.g., pictures or videos that employees want to view).

[0196] In some embodiments of this specification, the above method for determining the display mode of a display device takes into account the viewing needs of all users while better ensuring the viewing experience of important users (users in user categories with greater screen viewing weight).

[0197] In some embodiments, process 700 further includes the following steps 780 and 790 .

[0198] Step 780: Determine multiple legitimate users based on the current display mode of the display device.

[0199] Legal users are system users within the user category corresponding to the content currently displayed on the display device. For example, if the display mode is main screen exclusive mode and the displayed content is for director-class users, legal users are system users within the director category. For another example, if the display mode is split-screen negotiation mode and the displayed content is for director-class and executive-class users, legal users are system users within the director-class and executive-class categories.

[0200] Step 790: Determine the display module to be enlarged based on the screen viewing information of multiple legitimate users.

[0201] A display module is a module located within the display interface of a display device that displays content corresponding to a user category. For example, a display module can be a component in a Building Information Modeling (BIM), a specific data area in a data dashboard, or a single image among multiple images.

[0202] A display area (e.g., the first display area, the second display area, the main display area, or the secondary display area) can include one or more display modules. A display module can independently present at least a portion of the display content of its display area in the display interface, and the display content presented by each display module does not overlap. For example, if a display area includes three display modules and the display content of the display area includes six images, the three display modules can each present two of the six images, or one, two, or three of the six images, respectively.

[0203] The display module to be magnified refers to a display module determined from all display modules included in the display interface of the display device and potentially to be subsequently magnified. In some embodiments, the processing device 110 or the mode determination module 250 may determine a target display module from the display modules to be magnified and magnify the target display module. For more information on the method for determining the target display module, please refer to the following description.

[0204] The aforementioned enlargement refers to expanding the area of ​​the display module in the display interface and proportionally enlarging the area of ​​the displayed content in the display module. For example, if the area of ​​the display module is enlarged to twice its original area, the area of ​​the image or video contained in the display module will also be enlarged to twice its original area.

[0205] There are many ways to enlarge the display module. For example, the target display module is to be enlarged, and the area of ​​other display modules that are not enlarged is reduced to make room in the display interface for the area required for enlarging the target display module. For another example, a new display area is created in the display interface (for example, across the split-screen area), the newly created display area is suspended above the other display areas, and the target display module is enlarged and displayed in the newly created display area (in this form, the area of ​​the original display area and the display content therein remains unchanged, and the newly created display area may cause some obstruction to the display content in the original display area). For more information about the cross-split-screen area, please refer to the description below. The display module can also be enlarged in other ways, which are not limited here.

[0206] In some embodiments, the screen viewing information further includes whether the user in the system is gazing at each display module in each display area and the gazing time.

[0207] In some embodiments, the processing device 110 or the mode determination module 250 can determine whether the user in the system is looking at the display device based on the eye movement trajectory information in the image information. For example, the processing device 110 or the mode determination module 250 can determine the gaze point corresponding to the time point when the image information was acquired in the eye movement trajectory. If the gaze point is located on a certain display module, then the user in the system is determined to be looking at that display module.

[0208] In some embodiments, the duration of a gaze at a display module can be determined based on the number of times a user within the system is consecutively determined to be gazing at the display module. For example, assuming that the image acquisition device acquires image information (including eye movement trajectory information) 60 times per minute (i.e., once per second) (it is understood that each time image information is acquired, a determination is made as to whether the user within the system is gazing at a particular display module). If a user within the system is determined to be gazing at a particular display module based on the most recently acquired eye movement trajectory information, and prior to this determination, the user has been determined to be gazing at the display module 10 times in a row, then the duration of the gaze at the display module by the user within the system is 10 + 1 = 11 seconds.

[0209] In some embodiments, the processing device 110 or the mode determination module 250 may determine, for each display module, whether the total gaze duration of the display module meets a fourth preset condition; in response to meeting the fourth preset condition, determine that the display module is the display module to be enlarged.

[0210] The total gaze time refers to the sum of the time that all legitimate users gaze at the display module.

[0211] The fourth preset condition includes that the total gaze duration is greater than a preset duration threshold, for example, 2 minutes, 3 minutes, or 5 minutes.

[0212] In some embodiments, when the display device is in split-screen negotiation mode, in response to the presence of a display module to be enlarged in both the first display area and the second display area, the processing device 110 or the mode determination module 250 determines conflict arbitration scores for the first user category and the second user category based on the user level and sight projection angle of each legitimate user in the first user category and the second user category, as well as the business importance of the display module to be enlarged. The first user category is the user category corresponding to the display content of the first display area, and the second user category is the user category corresponding to the display content of the second display area.

[0213] User level reflects the importance of users in the system.

[0214] User level is positively correlated with the user's rank within the system. That is, the higher the user's rank within the system, the higher the user level. For example, the chairman's user level is higher than the general manager's, who is higher than the department manager's, and so on. User level can be represented by a user level score; higher user levels are associated with higher user level scores. For example, the chairman's user level score is 10, a director's user level score is 9, a general manager's user level score is 8, and so on.

[0215] The line of sight projection angle refers to the angle between the user's line of sight and the normal line of the display module (a line perpendicular to the display interface of the display device). The line of sight projection angle can be determined based on the user's viewing information within the system. For example, it can be calculated based on the user's distance and direction relative to the display device, the point of the user's eye movement trajectory on the display device, and the position (coordinates) of the display module on the display interface of the display device.

[0216] The business importance of the display module to be magnified reflects its relevance to the enterprise's core business. The higher the business importance, the more relevant the content displayed in the magnified display module is to the enterprise's core business. For example, in the case of a construction company, the display modules containing content related to construction progress, construction budget, and construction safety would have higher business importance, while other display modules would have lower business importance.

[0217] In some embodiments, the business importance of the display module to be magnified is characterized based on a business importance score, where a higher business importance score represents a higher business importance.

[0218] In some embodiments, the business importance of the display module to be enlarged can be binary, that is, the business importance score of the display module to be enlarged with higher business importance (for example, the display module where the display content related to the construction progress, construction budget, and construction safety of the construction company mentioned in the previous example is located) is set to 1, and the business importance score of the display module to be enlarged with lower business importance is set to 0.

[0219] The conflict arbitration score reflects the magnification priority of the display module to be magnified. In the first user category and the second user category, the display module to be magnified in the display area corresponding to the user with the higher conflict arbitration score will be magnified first.

[0220] In some embodiments, the conflict arbitration score is calculated based on the user level and sight projection angle of each user in the system, and the business importance of the display module to be magnified.

[0221] In some embodiments, the conflict arbitration score may be calculated as shown in the following formula (6): (6) in, Score the conflict arbitration for the first user class or the second user class ( =1 or 2, =1 corresponds to the first user category, =2 corresponds to the second user category, the same below), is the number of legitimate users belonging to the first user category or the second user category, For the first user category or the second user category ( is a positive integer, ) user level scores of legitimate users, is the service importance score of the display module to be enlarged in the first display area or the second display area ( =1 corresponds to the first display area, =2 corresponds to the second display area), is the natural logarithm, is the decay rate related to user level (constant), For the first user category or the second user category The gaze time of a legitimate user on the enlarged display module, is the sight angle compensation coefficient (constant), represents the first user category or the second user category. The vector of the sight direction of a legitimate user, is the normal vector of the display device.

[0222] In some embodiments, when the display device is in the split-screen negotiation mode, the processing device 110 or the mode determination module 250 determines the target display module based on the conflict arbitration score, and magnifies the target display module in the cross-split-screen area. For example, the display module to be magnified in the display area corresponding to the user category with a larger conflict arbitration score is determined as the target display module. The cross-split-screen area refers to a portion of the display interface that spans at least two display areas. For example Figure 4BThe cross-split screen area 423 spanning the first display area 421 and the second display area 422, or Figure 4C The cross-split screen area 434 shown spans the main display area 431 and the auxiliary display areas 432 and 433. The zooming in refers to enlarging the area of ​​the target display module, and the displayed content therein is enlarged in proportion.

[0223] For example, if the conflict arbitration score for the first user category is greater than that for the second user category, the display module to be enlarged in the first display area is determined as the target display module, and the target display module is enlarged and displayed in the cross-split-screen area. In this embodiment, the display content of the cross-split-screen area 423 is displayed above the display content of the first display area 421 and the display content of the second display area 422, that is, the display content corresponding to the cross-split-screen area 423 is placed at the top.

[0224] In some embodiments, when the display device is in the main-sub-screen mode, in response to the presence of a display module to be enlarged in the main display area, the processing device 110 or the mode determination module 250 determines the display module to be enlarged in the main display area as the target display module, and enlarges the target display module within the main display area or across the split-screen area.

[0225] For example, Figure 4C As shown, if there is a display module to be enlarged in the main display area 431, the display module to be enlarged is determined as the target display module, and the target display module is enlarged and displayed in the main display area 431 or across the split-screen area 434.

[0226] In some embodiments, when the display device is in the main-sub-screen mode, in response to the presence of a display module to be enlarged in the sub-display area and the absence of a display module to be enlarged in the main display area, the processing device 110 or the mode determination module 250 determines the display module to be enlarged in the sub-display area as the target display module, and enlarges and displays the target display module in the main display area or across the split-screen area.

[0227] For example, Figure 4C As shown, if there is a display module to be enlarged in the secondary display area 432 and there is no display module to be enlarged in the main display area 431, the display module to be enlarged is determined as the target display module, and the target display module is enlarged and displayed in the main display area 431 or across the split-screen area 434.

[0228] In some embodiments of this specification, the user's viewing experience is optimized by enlarging the display module; when various types of users compete for display resources at the same time (for example, each type wants to enlarge their corresponding display content), the rationality of the display module enlargement strategy and display resource allocation is improved by determining the target display module and enlarging it.

[0229] While the basic concepts have been described above, it will be apparent to those skilled in the art that the detailed disclosure is merely illustrative and does not limit this specification. Although not explicitly stated herein, various modifications, improvements, and revisions to this specification may be made by those skilled in the art. Such modifications, improvements, and revisions are suggested in this specification and remain within the spirit and scope of the exemplary embodiments of this specification.

[0230] This specification also uses specific terms to describe the embodiments of this specification. For example, "one embodiment," "an embodiment," and / or "some embodiments" refer to a feature, structure, or characteristic associated with at least one embodiment of this specification. Therefore, it should be emphasized and noted that references to "one embodiment," "an embodiment," or "an alternative embodiment" two or more times in different locations in this specification do not necessarily refer to the same embodiment. Furthermore, certain features, structures, or characteristics of one or more embodiments of this specification may be appropriately combined.

[0231] In addition, unless expressly stated in the claims, the order of the processing elements and sequences, the use of alphanumeric characters, or the use of other names described in this specification are not intended to limit the order of the processes and methods of this specification. Although the above disclosure discusses some of the invention embodiments currently considered useful through various examples, it should be understood that such details are for illustrative purposes only, and the appended claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that are consistent with the spirit and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only by software solutions, such as installing the described system on an existing server or mobile device.

[0232] Similarly, it should be noted that, in order to simplify the presentation of this specification and thus facilitate understanding of one or more embodiments of the invention, the foregoing descriptions of the embodiments of this specification sometimes combine multiple features into a single embodiment, figure, or description thereof. However, this disclosure method does not imply that the subject matter of this specification requires more features than those recited in the claims. In fact, an embodiment may have fewer features than all of the features of a single disclosed embodiment.

[0233] In some embodiments, numbers describing the quantity of components and attributes are used. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximately" or "substantially" in some examples. Unless otherwise stated, "about", "approximately" or "substantially" indicate that the numbers are allowed to vary by ±20%. Accordingly, in some embodiments, the numerical parameters used in the description and claims are approximate values, which may vary according to the required features of the individual embodiments. In some embodiments, the numerical parameters should take into account the specified significant digits and adopt the general method of retaining digits. Although the numerical domains and parameters used to confirm the breadth of their range in some embodiments of this specification are approximate values, in specific embodiments, the settings of such numerical values ​​are as accurate as possible within the feasible range.

[0234] Each patent, patent application, patent application publication, and other materials, such as articles, books, specifications, publications, and documents, cited in this specification is hereby incorporated by reference in its entirety. This excludes any application history documents that are inconsistent with or conflicting with the content of this specification, as well as any documents (currently or subsequently appended to this specification) that limit the broadest scope of the claims of this specification. It should be noted that if the descriptions, definitions, and / or terminology used in the accompanying materials are inconsistent or conflicting with the content of this specification, the descriptions, definitions, and / or terminology used in this specification shall prevail.

[0235] Finally, it should be understood that the embodiments described in this specification are intended only to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, by way of example and not limitation, alternative configurations of the embodiments of this specification may be considered consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly described and illustrated in this specification.

Claims

1. A display control method, characterized in that: include: Acquiring image information of one or more users within a preset area of ​​the display device; Determine, based on the image information, at least one in-system user among the one or more users, identity information of each in-system user, and screen viewing information of each in-system user on the display device; Determining a user category to which each user in the system belongs based on the identity information, wherein the number of the user categories is multiple, and each user category includes one or more users in the system; For each user category, determining a screen viewing weight corresponding to the user category based on the user category and the screen viewing information of users in the system belonging to the user category; as well as Based on the numerical relationship between the screen viewing weights corresponding to each of the user categories, the display mode of the display device is determined, and the display mode includes a main screen exclusive mode, a split screen negotiation mode and a main and sub-screen mode.

2. The method according to claim 1, characterized in that The determining, based on the user category and the screen viewing information of the users in the system belonging to the user category, of a screen viewing weight corresponding to each user category includes: For each of the user categories, Get the preset weight corresponding to the user category; Determining a first coefficient corresponding to the user category based on the preset weight corresponding to the user category and the number of users; determining, based on the screen viewing information of users in the system belonging to the user category and the preset weight corresponding to the user category, a second coefficient corresponding to the user category, where the first coefficient and the second coefficient are different coefficients; The screen viewing weight corresponding to the user category is determined based on the first coefficient and the second coefficient.

3. The method according to claim 2, characterized in that The determining, based on the screen viewing information of users in the system belonging to the user category and the preset weight corresponding to the user category, a second coefficient corresponding to the user category includes: For the at least one user within the system, determining at least one user who intends to view the display device based on the screen viewing information; Determining distance information and gaze duration of the at least one intended user relative to the display device based on the screen viewing information; For each user category, the second coefficient of the user category is determined based on the distance information and the gaze duration of the intended users belonging to the user category.

4. The method according to claim 1, wherein The determining the display mode of the display device based on the numerical relationship between the screen viewing weights corresponding to the respective user categories includes: Sort the screen viewing weights corresponding to all the user categories from large to small to obtain a sorting result; Based on the sorting result, it is determined whether the numerical relationship meets a first preset condition, In response to the numerical relationship satisfying the first preset condition, determining that the display mode is the main screen exclusive mode; the first preset condition includes that the first viewing weight is not less than a preset multiple of the median viewing weight, or that the first viewing weight is greater than half of the total viewing weights, wherein the first viewing weight is the viewing weight ranked first in the sorting result, the median viewing weight is the median of the viewing weights corresponding to each of the user categories, and the total viewing weight is the sum of the viewing weights corresponding to all the user categories; In response to the numerical relationship not satisfying the first preset condition, determining whether the numerical relationship satisfies a second preset condition, In response to the numerical relationship satisfying the second preset condition, determining that the display mode is the split-screen negotiation mode; the second preset condition includes that the first weight sum is not less than a preset multiple of the median viewing weight, or the first weight sum is greater than half of the sum of the viewing weights, wherein the first weight sum is the sum of the first viewing weight and the second viewing weight, and the second viewing weight is the viewing weight ranked second in the sorting result; In response to the numerical relationship not satisfying the second preset condition, determining whether the numerical relationship satisfies a third preset condition, In response to the numerical relationship satisfying the third preset condition, the display mode is determined to be the main-sub-screen mode, and the third preset condition includes that the sum of the second weights is not less than a preset multiple of the median viewing weight, or the sum of the second weights is greater than half of the total viewing weights, and the sum of the second weights is the sum of the first viewing weight, the second viewing weight and the third viewing weight, wherein the third viewing weight is the viewing weight ranked third in the sorting result.

5. The method according to claim 4, characterized in that Determining the display mode of the display device further includes: In response to the display mode being the main screen exclusive mode, the display interface of the display device is controlled to only display the display content corresponding to the user category corresponding to the first screen viewing weight.

6. The method according to claim 4, characterized in that Determining the display mode of the display device further includes: In response to the display mode being the split-screen negotiation mode, the display interface of the display device is divided into a first display area and a second display area, and the ratio of the areas of the first display area and the second display area is determined based on the ratio of the first viewing screen weight to the second viewing screen weight.

7. The method according to claim 6, characterized in that Determining the display mode of the display device further includes: controlling the first display area to display the display content corresponding to the user category corresponding to the first screen viewing weight; The second display area is controlled to display the display content corresponding to the user category corresponding to the second screen viewing weight.

8. The method according to claim 4, characterized in that Determining the display mode of the display device further includes: In response to the display mode being the primary-secondary screen mode, determining a plurality of shortlisted user categories, the plurality of shortlisted user categories being user categories corresponding to the top N viewing weights in the sorting result, the plurality of shortlisted user categories including at least one primary user category and at least one secondary user category, the primary user category being the user category corresponding to the top M viewing weights in the sorting result, and the secondary user category being the user category other than the primary user category in the plurality of shortlisted user categories, wherein N and M are both positive integers, and N>M≥1; Dividing a display interface of the display device into a plurality of display areas, wherein the plurality of display areas include at least one main display area and at least one secondary display area, wherein the number of the at least one main display area is equal to the number of the at least one main user category, and the number of the at least one secondary display area is equal to the number of the at least one secondary user category, and the area of ​​the main display area is larger than the area of ​​the secondary display area; The at least one main display area is controlled to display the display content corresponding to the at least one main user category, and the at least one secondary display area is controlled to display the display content corresponding to the at least one secondary user category.

9. The method according to any one of claims 5 to 8, characterized in that Also includes: determining a plurality of legitimate users based on the display mode currently in which the display device is located, wherein the legitimate users include system users in the user category corresponding to the display content currently displayed by the display device; Based on the screen viewing information of the multiple legitimate users, a display module to be enlarged is determined, where the display module is a module in the display interface of the display device, used to display the display content corresponding to the user category.

10. The method according to claim 9, characterized in that The determining the display module to be magnified based on the screen viewing information of the multiple legitimate users includes: When the display device is in the split-screen negotiation mode, In response to the presence of the display module to be enlarged in both the first display area and the second display area, determining a conflict arbitration score for the first user category and the second user category based on the user level and sight projection angle of each of the legitimate users in the first user category and the second user category, and the service importance of the display module to be enlarged, wherein the first user category is the user category corresponding to the display content of the first display area, and the second user category is the user category corresponding to the display content of the second display area; Based on the conflict arbitration score, a target display module is determined, and the target display module is magnified and displayed in the cross-split screen area.

11. The method according to claim 9, characterized in that The determining the display module to be magnified based on the screen viewing information of the multiple legitimate users includes: When the display device is in the main-slave screen mode, In response to the presence of the display module to be enlarged in the main display area, determining the display module to be enlarged in the main display area as a target display module, and displaying the target display module in an enlarged manner in the main display area or across the split-screen area; In response to the presence of the display module to be enlarged in the secondary display area and the absence of the display module to be enlarged in the main display area, the display module to be enlarged in the secondary display area is determined as the target display module, and the target display module is enlarged and displayed in the main display area or the cross-split screen area.

12. The method according to claim 1, characterized in that Also includes: Determining at least one non-system user and screen viewing information of each non-system user from the one or more users based on the image information; determining a screen viewing scene based on the user category to which the at least one in-system user belongs and the screen viewing information, and the screen viewing information of the at least one non-system user; The screen viewing scenes include explanation and demonstration scenes and visiting and displaying scenes; Based on the screen viewing scenario, the display mode is adjusted.

13. The method according to claim 12, characterized in that The determining of the screen viewing scene includes: In response to the screen viewing position of the user in the system being located in the center area of ​​the screen viewing position of the non-user in the system, Determining that the screen viewing scene is the explanation and demonstration scene; The display mode of the display device is adjusted to the main screen exclusive mode, and the display interface of the display device is controlled to display the display content corresponding to the user category to which the user in the system located in the central area belongs.

14. The method according to claim 12, characterized in that The determining of the screen viewing scene includes: For each of the non-system users, determining a location feature count of the non-system user, the location feature count being the number of system users whose viewing positions are adjacent to the viewing position of the non-system user; and In response to the location feature counts of all the non-system users being greater than zero, Determining that the screen viewing scene is the explanation and demonstration scene; and The display mode of the display device is adjusted to the main screen exclusive mode, and the display interface of the display device is controlled to display the display content corresponding to the user category to which the system user who is adjacent to the viewing position of the non-system user belongs.

15. A display control system, characterized in that: include: An acquisition module, configured to acquire image information of one or more users within a preset area of ​​the display device; a user determination module configured to determine, based on the image information, at least one in-system user among the one or more users, identity information of each in-system user, and screen viewing information of each in-system user on the display device; a category determination module, configured to determine, based on the identity information, a user category to which each user in the system belongs, wherein the number of the user categories is multiple, and each user category includes one or more users in the system; a weight determination module, configured to determine, for each user category, a screen viewing weight corresponding to the user category based on the user category and the screen viewing information of users in the system belonging to the user category; as well as The mode determination module is used to determine the display mode of the display device based on the numerical relationship between the screen viewing weights corresponding to each user category, and the display mode includes the main screen exclusive mode, the split screen negotiation mode and the main and sub-screen mode.

Images