Information display control method, device, readable storage medium and program product

Abstract

The application discloses an information display control method, device, readable storage medium and program product. The information display control method comprises the following steps: acquiring first position information corresponding to an effective input device and second position information corresponding to each display device; temporarily matching a target display device corresponding to the effective input device in each display device based on the first position information and the second position information; and reading corresponding display information to the target display device for display based on an effective input signal of the effective input device. The application solves the technical problem that a corresponding display device cannot display due to a fault of the effective input device.

Description

Technical Field

[0001] This application relates to the field of intelligent control technology in financial technology (Fintech), and in particular to an information display control method, device, readable storage medium, and program product. Background Technology

[0002] With the continuous development of fintech, especially internet fintech, more and more technologies (such as distributed systems and artificial intelligence) are being applied in the financial field. However, the financial industry is also placing higher demands on technology, such as on the distribution of tasks to be completed.

[0003] With the continuous development of computer software and artificial intelligence, the application of smart devices is becoming more and more widespread. In some scenarios, multiple display devices are usually required, such as museum scenes or conference venues. In the case of multiple display devices, the display devices are usually paired one-to-one with the valid input devices. That is, one display device receives the signal of a corresponding valid input device, such as a keyboard and a corresponding display screen, to realize information display control. However, once the valid input device fails, the corresponding display device will be unable to display because it cannot obtain a valid input signal. Summary of the Invention

[0004] The main objective of this application is to provide an information display control method, device, readable storage medium, and program product, aiming to solve the technical problem in the prior art where the corresponding display device cannot display due to the failure of the effective input device.

[0005] To achieve the above objectives, this application provides an information display control method, which is applied to an information display control device, and includes:

[0006] Obtain the first position information corresponding to the valid input device and the second position information corresponding to each display device;

[0007] Based on the first location information and each of the second location information, a target display device corresponding to the valid input device is temporarily matched among each of the display devices;

[0008] Based on the valid input signal from the valid input device, the corresponding display information is read and displayed on the target display device.

[0009] This application also provides an information display control device, which is a virtual device and is applied to an information display control equipment. The information display control device includes:

[0010] The location acquisition module is used to acquire first location information corresponding to valid input devices and second location information corresponding to each display device;

[0011] A temporary matching module is used to temporarily match the target display device corresponding to the valid input device among the display devices based on the first location information and each of the second location information;

[0012] The display module is used to read the corresponding display information and display it on the target display device based on the valid input signal of the valid input device.

[0013] This application also provides an information display control device, which is a physical device. The information display control device includes: a memory, a processor, and a program of the information display control method stored in the memory and executable on the processor. When the program of the information display control method is executed by the processor, it can implement the steps of the information display control method as described above.

[0014] This application also provides a readable storage medium storing a program for implementing an information display control method, wherein when the program for the information display control method is executed by a processor, it implements the steps of the information display control method as described above.

[0015] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the information display control method described above.

[0016] This application provides an information display control method, device, readable storage medium, and program product. Compared to the prior art, which typically uses a one-to-one correspondence between display devices and valid input devices for information display control, this application first obtains first position information corresponding to each valid input device and second position information corresponding to each display device. Then, based on the first position information and each of the second position information, it temporarily matches the target display device corresponding to the valid input device among the display devices. Therefore, there is only a temporary matching relationship between the valid input device and the corresponding target display device. Even if the valid input device malfunctions, the target display device can temporarily re-match other valid input devices for display. Based on the valid input signal of the valid input device, the corresponding display information is read and displayed on the target display device, thus realizing information display control. Therefore, it overcomes the technical defect in the prior art where a failure of a valid input device will cause the corresponding display device to be unable to display due to the inability to obtain a valid input signal. Therefore, it solves the technical problem that the corresponding display device cannot display due to the failure of a valid input device. Attached Figure Description

[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a flowchart illustrating the first embodiment of the information display control method of this application;

[0020] Figure 2 This is a flowchart illustrating the second embodiment of the information display control method of this application;

[0021] Figure 3 This is a flowchart illustrating the third embodiment of the information display control method of this application;

[0022] Figure 4 This is a schematic diagram of the information display control method of this application, which determines the corresponding target display device based on distance and / or orientation.

[0023] Figure 5 This is a block diagram illustrating an electronic device 800 according to an exemplary embodiment;

[0024] Figure 6 This is a block diagram illustrating an electronic device 1900 according to an exemplary embodiment.

[0025] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0026] It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of this application.

[0027] This application provides an information display control method. In the first embodiment of the information display control method of this application, refer to... Figure 1 The information display control method includes:

[0028] Step S10: Obtain the first position information corresponding to the valid input device and the second position information corresponding to each display device;

[0029] In this embodiment, it should be noted that the application scenario includes multiple input devices and multiple display devices. The multiple input devices and multiple display devices do not have a one-to-one correspondence. That is to say, a certain input device can be displayed on any display device. At the same time, the multiple display devices can be distributed in a distributed manner, and the multiple input devices can also be moved. The display device to be displayed can be selected among the multiple display devices by using positioning.

[0030] Additionally, the valid input device can be selected from among the various input devices. The valid input device is a device for inputting valid signals, such as a keyboard, mouse, and microphone. The display device is a device for displaying information, including liquid crystal displays and projection displays. The first position information is the spatial position information of the valid input device, which can be the spatial coordinates of the valid input device or the height of the valid input device above the ground. The second position information is the spatial position information of the display device, which can be the spatial coordinates of the display device or the height of the display device above the ground.

[0031] Further, the specific steps for obtaining the first location information corresponding to the valid input device include: obtaining input signals corresponding to several (or more) input devices; determining valid input signals based on the input signals corresponding to several input devices to eliminate invalid input signals such as erroneous operations or noise; determining the corresponding valid input device based on the valid input signal; locating the valid input device to obtain the first location information of the valid input device.

[0032] In one feasible approach, the step of determining the corresponding valid input device based on the valid input signal can be: extracting the input device code contained in the valid input signal, and then determining the corresponding valid input device based on the input device code. The input device code is the identifier of the input device. Several input devices can be pre-coded to generate input device codes corresponding to each input device. For example, 1#, 2#, ..., N# (N≥2) can be generated as input device codes respectively. Furthermore, the input device codes corresponding to each input device can be hidden in their respective input signals. For example, the input device codes can be stored in the starting address of the input signal.

[0033] Furthermore, each input device is equipped with a positioning mechanism or positioning algorithm. For example, the positioning mechanism can be a navigation positioning mechanism, such as a navigation positioning chip. The positioning mechanism or positioning algorithm can locate the position information of each input device. Once a valid input device is identified, the valid input device can be located to obtain the first location information of the valid input device.

[0034] Furthermore, in one feasible embodiment, the step of determining a valid input signal based on the input signals corresponding to several input devices may further include: determining the start point and end point of the input signals corresponding to several input devices; converting the input signals corresponding to several input devices into string text within the start point and the end point; extracting features from the string text based on preset feature extraction rules to obtain text features; comparing the text features with preset text features respectively to obtain comparison results; and determining whether the input signals of several input devices are the valid input signals based on the comparison results.

[0035] In this embodiment, the step of determining the start point and end point of the input signal corresponding to the plurality of input devices may further include: determining the trigger time point corresponding to the first triggering of the plurality of input devices, and taking the trigger time point as the start point; based on the trigger time point, detecting the triggered actions after the trigger time point in real time, and determining that the time interval between the Nth triggered action and the (N+1)th triggered action is greater than a set time interval, and then determining the time of completion of the Nth triggered action as the end point of the input signal.

[0036] For example, the input device can be a keyboard, and the user inputs the corresponding input signal through the keyboard. The trigger time point corresponding to the first trigger of the keyboard is taken as the starting point; the triggering action of the keyboard after the trigger time point is detected in real time, and the time interval between the Nth triggering action and the N+1th triggering action is calculated in real time. If the time interval is greater than the set time interval, the time when the Nth triggering action is completed is determined as the end point of the input signal.

[0037] For example, the input device can be a microphone, and the user inputs the corresponding input signal through the microphone. The trigger time point corresponding to the first trigger of the microphone is taken as the starting point. The triggering action of the microphone after the trigger time point is detected in real time, and the time interval between the Nth triggering action and the N+1th triggering action is calculated in real time. If the time interval is greater than the set time interval, the time when the Nth triggering action is completed is determined as the end point of the input signal.

[0038] In this embodiment, the step of converting the input signals corresponding to several input devices into string text within the starting point and the ending point may further include: determining the type of the input signal; if the type of the input signal is a voice command, then using a speaker recognition algorithm to convert the input signal into string text; if the type is a keyboard command, then obtaining that the keyboard corresponds to an input method, and when the key of the keyboard is triggered, converting the keyboard command into string text according to the input method.

[0039] In this embodiment, the input device is not limited to a microphone and keyboard, but may also include other graphical or motion-based input devices, such as touch screens or motion recognition input devices.

[0040] In this embodiment, the step of extracting features from the string text based on preset feature extraction rules to obtain text features may further include: determining the type of input signal corresponding to the plurality of input devices; if the type is a voice command, then retrieving the preset feature extraction rules corresponding to the voice command, segmenting the string text into words, and obtaining several word features after segmentation; and determining the content words among the several word features as the text features. If the type is a keyboard command, then retrieving the preset feature extraction rules corresponding to the keyboard command, determining whether the string text can form Chinese characters or Western characters; if it can form, then determining the content words among the Chinese characters or English characters as the text features; if it cannot form, then determining the input signals corresponding to the plurality of input devices as invalid input signals, and clearing the corresponding input signals.

[0041] In this embodiment, the step of determining the content words in the plurality of word features as the text features or determining the content words in the Chinese characters or English characters as the text features may further include: determining the number of content words; determining whether the content words in the plurality of word features are the text features based on the number of content words and the obtained set number.

[0042] In this embodiment, specifically, the step of determining whether a content word in the plurality of word features is a text feature based on the number of content words and the set number obtained may further include: comparing the number of content words with the set number; if the number of content words is less than the set number, then determining the input signal corresponding to the plurality of input devices as an invalid input signal and clearing the corresponding input signal; if the number of content words is greater than or equal to the set number, then determining the content word in the plurality of word features as the text feature; wherein, the set number is a positive integer ≥1.

[0043] In this embodiment, the preset feature extraction rules corresponding to the speech are used to extract the content words of the string text and delete stop words in the string text to obtain the content words of the string text. For example, the jieba word segmentation tool and the custom dictionary in the word segmentation tool can be used to segment the text to obtain several word features after segmentation. A stop word list is set, and the stop word list is used to filter the stop words of the several word features after segmentation. The stop words can be added to the existing stop word list according to the specific scenario. The stop words can be modal particles, auxiliary words, and / or punctuation marks (including prepositions of Western characters, etc.). The remaining content words in the several word features are determined as the text features.

[0044] Accordingly, in this embodiment, if the type of the input signal is a keyboard command, then the preset feature extraction rule corresponding to the keyboard is invoked to extract the content words of the string text, and stop words in the string text are deleted to obtain the content words of the string text. It is then determined whether the string text can form Chinese characters or Western characters; if it can, then the content words in the Chinese characters or English characters are determined as the text features by using the preset feature extraction rule corresponding to the keyboard; if it cannot, then the input signals corresponding to the plurality of input devices are determined to be invalid input signals, and the corresponding input signals are cleared.

[0045] In this embodiment, specifically, if the input signal is a keyboard command, a preset feature extraction rule corresponding to the keyboard is retrieved based on the current input method of the input device. For example, if the input method is a Chinese input method, such as Wubi or other Chinese-format input methods, the corresponding preset feature extraction rule is set based on Chinese. Using this preset feature extraction rule, the content words of the string text can be extracted, and stop words in the string text can be deleted to obtain the content words of the string text. As another example, if the input method is a Western input method, the type of the Western input method is further determined. For example, if the Western input method type is English, stop words in the string text corresponding to English are deleted to obtain the content words of the string text corresponding to English.

[0046] If the type of the input signal is a keyboard command, the method for determining whether the string text can form Chinese characters or Western characters based on the current input method of the input device may further include: obtaining the current input method of the input device; and determining whether the string text can form Chinese characters or Western characters based on the input method.

[0047] In this embodiment, the step of comparing the text features with preset text features to obtain comparison results may further include: constructing a feature database; comparing the text features with preset text features in the feature database to obtain comparison results. Specifically, in the embodiments of this application and other possible embodiments, the method of constructing a feature database includes: determining preset text features corresponding to the content to be displayed; and constructing a feature database based on the preset text features. For example, in financial institutions, the preset text features corresponding to the content to be displayed include, but are not limited to: text information in Chinese and Western forms related to deposits, withdrawals, stocks, funds, insurance, foreign exchange, or other business and industry terms, or one or more of the full name or abbreviation of the company issuing the corresponding stock.

[0048] In this embodiment, the step of determining whether the input signals of several input devices are valid input signals based on the comparison results may further include: determining the number of content words and the number of results in the comparison results that conform to the preset text features; determining the proportion based on the number of content words and the number of results; and determining whether it is a valid input signal based on the proportion and the preset proportion.

[0049] In an embodiment of this application, the method for determining whether an input signal is valid based on the percentage and a set percentage includes: comparing the percentage with a set percentage; if the percentage is greater than or equal to the set percentage, then determining the input signal as a valid input signal; otherwise, determining the input signal as an invalid input signal and clearing the corresponding input signal. The set percentage can be set to 50%.

[0050] In embodiments of this application, the method for determining the number of content words and the number of results in the comparison results that conform to the preset text features includes: converting the content words and the preset text features into a first text vector and a second text vector, respectively; calculating the similarity between the first text vector and the second text vector; determining the magnitude of the similarity compared to a preset similarity; if the similarity is greater than or equal to the preset similarity, then the number of content words and the number of results in the comparison results that conform to the preset text features; incrementing the result count by 1 and updating the result count. The preset similarity can be 0.7.

[0051] Specifically, in this application and other possible embodiments, the cosine similarity between the first text vector and the second text vector can be calculated; the greater the cosine similarity, the more similar the first text vector and the second text vector are considered, and the more the content words conform to the preset text features.

[0052] Step S20: Based on the first location information and each of the second location information, temporarily match the target display device corresponding to the valid input device among each of the display devices;

[0053] In this embodiment, it should be noted that while considering the distance between the effective input device and the corresponding display device, it is also necessary to consider the orientation of the effective input device and the corresponding display device. Since several display devices may not be set on the same plane, they may be set on a ring mechanism or, although they are set on the same plane, they may have different orientations. In this case, in order to provide a better user experience, it is necessary to consider both the relative orientation and the relative distance between the effective input device and the display device.

[0054] Based on the first location information and each of the second location information, a target display device corresponding to the valid input device is temporarily matched among the display devices. Specifically, based on the first location information and each of the second location information, the relative distance information between the valid input device and each of the display devices is calculated, and the relative orientation information between the valid input device and each of the display devices is calculated. Then, based on the relative distance information and the relative orientation information, a target display device that meets the preset information clear display conditions is selected among the display devices, so that the information display of the target display device can be clearly seen at the valid input device. The preset information clear display conditions include at least one of the following: the distance between the effective input device and the display device is within a preset distance range, and the display screen of the display device is within the field of view of the effective input device. For example, assuming the field of view is set to face the effective input device, the line of sight straight ahead is set as the standard line of sight, and the field of view offset upward by a preset first angle, offset to the left by a preset second angle, and offset to the right by a preset third angle relative to the standard line of sight is the field of view of the effective input device. The preset first angle, preset second angle, and preset third angle can all be set to 15 degrees, 30 degrees, and 60 degrees, etc., and can be set according to the actual scenario. It is not limited here.

[0055] Wherein, the first location information includes at least one first spatial location point, and the second location information includes at least one second spatial location point.

[0056] The step of temporarily matching the target display device corresponding to the valid input device among the display devices based on the first location information and each of the second location information includes:

[0057] Step S21: Calculate the distance between the first spatial location point and each of the second spatial location points to obtain the distance between each location;

[0058] In this embodiment, it should be noted that the first spatial location point is a point representing the spatial location of the effective input device. For example, the geometric center of the effective input device can be selected as the first spatial location point, or the corner of the edge contour of the effective input device can be selected as the first spatial location point, or the first spatial location point can be randomly selected directly on the surface of the effective input device. Further, the second spatial location point is a point representing the spatial location of the display device. For example, the geometric center of the display screen of the display device can be selected as the second spatial location point, or the corner of the edge contour of the display screen of the display device can be selected as the second spatial location point, or the second spatial location point can be randomly selected directly on the display screen of the display device.

[0059] Calculate the distance between the first spatial location point and each of the second spatial location points to obtain the distance between each location. Specifically, based on the spatial location coordinates corresponding to the first spatial location point and the spatial location coordinates corresponding to each of the second spatial location points, calculate the distance between the first spatial location point and each of the second spatial location points to obtain the distance between each location.

[0060] Step S22: Based on the distance between each location, temporarily match the target display device corresponding to the valid input device among the display devices.

[0061] In this embodiment, based on the distances to each location, a target display device corresponding to the valid input device is temporarily matched among the display devices. Specifically, the shortest location distance is selected from the distances to each location, and the display device corresponding to the shortest location distance is used as the target display device temporarily matched with the valid input device. This ensures that the target display device and the valid input device are the closest, so that the information displayed on the target display device can be seen more clearly at the valid input device.

[0062] Additionally, before step S20, the method further includes: determining the state of the display device corresponding to the valid input device; if the state is in an occupied state, updating each display device corresponding to the valid input device, and re-determining each display device corresponding to the valid input device.

[0063] In one feasible approach, the step of updating the display device corresponding to the valid input device and re-determining the display device corresponding to the valid input device may further include: removing the display devices that are in an occupied state from each display device, and taking each remaining display device that is not in an occupied state as the display devices corresponding to the re-determined valid input device.

[0064] Step S30: Based on the valid input signal of the valid input device, read the corresponding display information and display it on the target display device.

[0065] In this embodiment, based on the valid input signal of the valid input device, the corresponding display information is read and displayed on the target display device. Specifically, based on the valid input signal of the valid input device, the target display content corresponding to the valid input signal is read and displayed on the screen of the target display device. The target display content can be video, image, or text, etc.

[0066] The step of reading the corresponding display information and displaying it on the target display device based on the valid input signal of the valid input device includes:

[0067] Step S31: Set the target display device to an occupied state and determine whether there is a target user in front of the target display device;

[0068] In this embodiment, it should be noted that when the target display device is in an occupied state, the information displayed by the target display device is controlled by the valid input signal of the valid input device temporarily matched with the target display device.

[0069] The target display device is set to an occupied state, and it is determined whether there is a target user in front of the target display device. Specifically, the target display device is set to an occupied state, and then the area in front of the display screen of the target display device is photographed based on the camera installed on the target display device to obtain an area image. Then, based on the area image, it is determined whether there is a target user in front of the target display device. For example, image detection can be performed on the area image to detect whether there is a human image in the area image, and then it can be determined whether there is a target user in front of the target display device.

[0070] Step S32: If it exists, then the target user is designated as the user occupying the target display device.

[0071] Step S33: If the target display device does not exist, then release the occupancy status of the target display device.

[0072] In this embodiment, it should be noted that the process of determining whether there is a target user in front of the target display device is continuous. For example, it can be set to perform the process of determining whether there is a target user in front of the target display device once every preset period. The preset period can be set to 1 second, 2 seconds, or 5 seconds, etc.

[0073] If the target user exists, the target user will be designated as the user occupying the target display device. If the target user does not exist, it proves that the target display device is unused, thereby releasing the target display device from its occupied state and canceling the temporary matching relationship between the valid input device and the target display device.

[0074] Further, specifically, after determining the target display device corresponding to the valid input device from the display devices, a temporary matching relationship is established between the valid input device and the corresponding target display device. The target display device is set to an occupied state, and an area image in front of the target display device is acquired. The user in the area image is extracted and set as the designated user of the target display device. If the valid input device does not receive an input signal within a set time period, the area image in front of the target display device is acquired again. Based on the area image, it is determined whether there is a human image in front of the target display device. If there is a human image, it is determined whether the human image is the designated user. If it is the designated user, the target display device continues to display the content corresponding to the input signal. If it is not the designated user, the temporary matching relationship between the valid input device and the target display device is released, and the target display device is controlled to switch from the occupied state to a standby state. At the same time, if there is no human image, the temporary matching relationship between the valid input device and the target display device is released, and the target display device is controlled to switch from the occupied state to a standby state.

[0075] Furthermore, the step of detecting whether a human figure exists in the region image and determining whether a target user exists in front of the target display device by performing image detection on the region image may include: obtaining a pre-trained segmentation model; inputting the region image into the segmentation model to obtain a corresponding segmentation mask image; and determining whether a human figure exists in front of the target display device based on the segmentation mask image.

[0076] Specifically, the segmentation model can be an artificial neural network, such as a U-Net network or a PDV-Net network. The method for determining whether a human image exists in front of the target display device based on the segmented mask image may include comparing the segmented mask image with a set multi-morphological human image to obtain a human image comparison result; and determining whether a human image exists in front of the target display device based on the human image comparison result. If the human image comparison result meets the set human image requirements, it is determined that a human image exists in front of the target display device; otherwise, it is determined that no human image exists in front of the target display device. The human image refers to the overall structure of a person, including all features such as the brain and limbs. The comparison of the segmented mask image with the set multi-morphological human image may include: calculating the overlap area between the segmented mask image and multiple set multi-morphological human image images, obtaining multiple human image comparison results based on the multiple overlap areas; if one of the multiple human image comparison results is greater than a set comparison result, it is considered to meet the set human image requirements; otherwise, it is considered not to meet the set human image requirements. The set multi-morphological human image images are images of various possible human poses.

[0077] Furthermore, the method for determining whether the portrait is the designated user may include: acquiring a first area image of the user in front of the target display device for a first time period; extracting features of the user based on the first area image to obtain a first feature; and extracting features of the user based on a second area image in front of the target display device to obtain a second feature; and determining whether the portrait is the designated user based on the first feature and the second feature.

[0078] Specifically, if the feature similarity between the first feature and the second feature is greater than or equal to a set feature similarity, then the person is considered to be the set user; otherwise, the person is considered not to be the set user, and the first region image and its corresponding first feature, as well as the second region image and its corresponding second feature, are cleared. The first feature can be a facial feature or other salient feature. Furthermore, the method of extracting the user's features from the first region image to obtain the first feature, or extracting the user's features from the second region image before re-acquiring the target display device to obtain the second feature, can employ traditional feature extraction methods or a neural network model for saliency detection.

[0079] This application provides an information display control method. Compared to the prior art where display devices are typically matched one-to-one with valid input devices for information display control, this application first obtains first position information corresponding to each valid input device and second position information corresponding to each display device. Then, based on the first position information and each of the second position information, a target display device corresponding to the valid input device is temporarily matched among the display devices. Therefore, there is only a temporary matching relationship between the valid input device and the corresponding target display device. Even if the valid input device fails, the target display device can temporarily match other valid input devices for display. Based on the valid input signal of the valid input device, the corresponding display information is read and displayed on the target display device, thus realizing information display control. Therefore, this overcomes the technical defect in the prior art where a failure of a valid input device will cause the corresponding display device to be unable to display due to the inability to obtain a valid input signal. Thus, it solves the technical problem that the corresponding display device cannot display due to the failure of a valid input device.

[0080] Furthermore, referring to Figure 2 Based on the first embodiment of this application, in another embodiment of this application, the first location information includes at least a first spatial location point, and the second location information includes at least a second spatial location point.

[0081] The step of temporarily matching the target display device corresponding to the valid input device among the display devices based on the first location information and each of the second location information includes:

[0082] Step A10: Obtain the user location plane and calculate the first orientation information of the first spatial location point relative to the user location plane;

[0083] In this embodiment, it should be noted that the first spatial location point is a point representing the spatial location of the effective input device. For example, the geometric center of the effective input device can be selected as the first spatial location point, or the corner of the edge contour of the effective input device can be selected as the first spatial location point, or the first spatial location point can be randomly selected directly on the surface of the effective input device. Further, the second spatial location point is a point representing the spatial location of the display device. For example, the geometric center of the display screen of the display device can be selected as the second spatial location point, or the corner of the edge contour of the display screen of the display device can be selected as the second spatial location point, or the second spatial location point can be randomly selected directly on the display screen of the display device.

[0084] Additionally, the first orientation information indicates the orientation of the valid input device relative to the user. This first orientation information can be a vector representing the orientation, or an angle representing the orientation, etc. The user position plane is a plane representing the user's position; specifically, it can be a plane formed along the top of the human body from the top of the head to the bottom of the feet, or a plane formed along the top of the human body from the top of the head to the chin.

[0085] Obtain the user's location plane and calculate the first orientation information of the first spatial location point relative to the user's location plane. Specifically, obtain the user's location plane and generate a first orientation vector that passes through the first spatial location point and is perpendicular to the user's location plane, and use the first orientation vector as the first orientation information.

[0086] Step A20: Obtain the display plane corresponding to each of the display devices, and calculate the second orientation information of each second spatial position point relative to its corresponding display plane;

[0087] In this embodiment, it should be noted that the display plane refers to the plane on which the display screen of the display device is located. If the display screen is a flat display screen, the plane on which the display screen is located can be used as the display plane. If the display screen is a curved display screen, the plane formed by the edge contour of the display screen can be used as the display plane.

[0088] Obtain the display plane corresponding to each of the display devices, and calculate the second orientation information of each second spatial position point relative to its corresponding display plane. Specifically, obtain the display plane corresponding to each of the display devices, and generate a second orientation vector through each second spatial position point relative to the display plane corresponding to each spatial position point, and use the second orientation vector as the second orientation information.

[0089] Step A30: Based on the first orientation information and each of the second orientation information, temporarily match the target display device corresponding to the valid input device among each of the display devices.

[0090] Based on the first orientation information and each of the second orientation information, a target display device corresponding to the valid input device is temporarily matched among the display devices. Specifically, based on the first orientation vector and each of the second orientation vectors, a target display device corresponding to the valid input device that conforms to a preset user display perspective is temporarily matched among the display devices, so that the target display device can clearly display the display information on the display screen of the target display device to the user. The preset user display perspective is a pre-set display perspective suitable for the display device to display information to the user. The better the display perspective of the target display device for the user, the clearer the user can receive the display information on the display screen of the target display device.

[0091] Wherein, the first azimuth information includes at least a first azimuth vector, and the second azimuth information includes at least a second azimuth vector.

[0092] The step of temporarily matching the target display device corresponding to the valid input device among the display devices based on the first orientation information and each of the second orientation information includes:

[0093] Step A31: Calculate the vector angles between the first azimuth vector and each of the second azimuth vectors;

[0094] In this embodiment, it should be noted that the included angle can be the angle formed by the first azimuth vector in a counterclockwise direction and the second azimuth vector, or it can be the angle formed by the first azimuth vector in a clockwise direction and the second azimuth vector.

[0095] Step A32: Based on the included angle of each vector, temporarily match the target display device corresponding to the valid input device among each display device.

[0096] In this embodiment, based on the included angles of each vector, a target display device corresponding to the valid input device is temporarily matched among the display devices. Specifically, the target vector angle closest to the preset vector angle is selected from the included vector angles, and the display device corresponding to the target vector angle is taken as the target display device corresponding to the valid input device. The preset vector angle is a pre-set angle that is most suitable for the target display device to display information to the user. The preset vector angle can be set to 30 degrees or 0 degrees, etc.

[0097] This application provides a method for temporarily matching a display device corresponding to a valid input device based on azimuth information. Specifically, it involves obtaining a user's location plane and calculating first azimuth information of a first spatial location point relative to the user's location plane. Then, it obtains the display plane corresponding to each display device and calculates second azimuth information of each second spatial location point relative to its corresponding display plane. Based on the first and second azimuth information, it temporarily matches a target display device corresponding to the valid input device among the display devices. This achieves the purpose of temporarily matching a target display device with the most suitable orientation for displaying information to the user. Since the matching relationship between the valid input device and the corresponding target display device is only temporary, even if the valid input device malfunctions, the target display device can temporarily re-match another valid input device for display. Therefore, while ensuring that the target display device can clearly display information to the user from the appropriate orientation, it also solves the technical problem of the corresponding display device being unable to display due to a malfunction of the valid input device.

[0098] Furthermore, referring to Figure 3 Based on the first and second embodiments of this application, in another embodiment of this application, the first location information includes at least a first spatial location point, and the second location information includes at least a second spatial location point.

[0099] The step of temporarily matching the target display device corresponding to the valid input device among the display devices based on the first location information and each of the second location information includes:

[0100] Step B10: Calculate the distance between the first spatial location point and each of the second spatial location points to obtain the distance between each location;

[0101] In this embodiment, it should be noted that the first spatial location point is a point representing the spatial location of the effective input device. For example, the geometric center of the effective input device can be selected as the first spatial location point, or the corner of the edge contour of the effective input device can be selected as the first spatial location point, or the first spatial location point can be randomly selected directly on the surface of the effective input device. Further, the second spatial location point is a point representing the spatial location of the display device. For example, the geometric center of the display screen of the display device can be selected as the second spatial location point, or the corner of the edge contour of the display screen of the display device can be selected as the second spatial location point, or the second spatial location point can be randomly selected directly on the display screen of the display device.

[0102] Calculate the distance between the first spatial location point and each of the second spatial location points to obtain the distance between each location. Specifically, based on the spatial location coordinates corresponding to the first spatial location point and the spatial location coordinates corresponding to each of the second spatial location points, calculate the distance between the first spatial location point and each of the second spatial location points to obtain the distance between each location.

[0103] Step B20: Obtain the user location plane and calculate the first orientation information of the first spatial location point relative to the user location plane;

[0104] In this embodiment, it should be noted that the first orientation information is information indicating the orientation of the valid input device relative to the user. The first orientation information can be a vector representing the orientation, or it can be an angle representing the orientation, etc. The user position plane is a plane representing the user's position, specifically it can be a plane formed along the top of the human body from the top of the head to the bottom of the feet, or it can be a plane formed along the top of the human body from the top of the head to the chin.

[0105] Obtain the user's location plane and calculate the first orientation information of the first spatial location point relative to the user's location plane. Specifically, obtain the user's location plane and generate a first orientation vector that passes through the first spatial location point and is perpendicular to the user's location plane, and use the first orientation vector as the first orientation information.

[0106] Step B30: Obtain the display plane corresponding to each of the display devices, and calculate the second orientation information of each second spatial position point relative to its corresponding display plane;

[0107] In this embodiment, it should be noted that the display plane refers to the plane on which the display screen of the display device is located. If the display screen is a flat display screen, the plane on which the display screen is located can be used as the display plane. If the display screen is a curved display screen, the plane formed by the edge contour of the display screen can be used as the display plane.

[0108] Obtain the display plane corresponding to each of the display devices, and calculate the second orientation information of each second spatial position point relative to its corresponding display plane. Specifically, obtain the display plane corresponding to each of the display devices, and generate a second orientation vector through each second spatial position point relative to the display plane corresponding to each spatial position point, and use the second orientation vector as the second orientation information.

[0109] Step B40: Based on the distance to each location, the first orientation information, and the second orientation information, temporarily match the target display device corresponding to the valid input device among the display devices.

[0110] In this embodiment, based on the location distances, the first orientation information, and the second orientation information, a target display device corresponding to the valid input device is temporarily matched among the display devices. Specifically, based on the location distances, the first orientation information, and the second orientation information, a target display device corresponding to the valid input device that meets the preset user display angle and preset user display distance is temporarily matched among the display devices, so that the target display device can clearly display the display information on its screen to the user. The preset user display angle is a pre-set display angle suitable for the display device to display information to the user, and the better the display angle of the target display device for the user, the clearer the user can receive the display information on the screen of the target display device. The preset user display distance is a pre-set display distance between the display device and the user suitable for the display device to display information to the user, and the shorter the display distance of the target display device for the user, the clearer the user can receive the display information on the screen of the target display device.

[0111] Wherein, the first azimuth information includes at least a first azimuth vector, and the second azimuth information includes at least a second azimuth vector.

[0112] The step of temporarily matching the target display device corresponding to the valid input device among the display devices based on the location distances, the first orientation information, and the second orientation information includes:

[0113] Step B41: Calculate the vector angles between the first azimuth vector and each of the second azimuth vectors;

[0114] In this embodiment, it should be noted that the included angle can be the angle formed by the first azimuth vector in a counterclockwise direction and the second azimuth vector, or it can be the angle formed by the first azimuth vector in a clockwise direction and the second azimuth vector.

[0115] Step B42: Based on the preset first angle range and the angles of each vector, select each initial target display device from among the display devices;

[0116] In this embodiment, based on a preset first angle range and the included angles of each vector, each initial target display device is selected from the display devices. Specifically, each target vector included angle within the preset first angle range is selected from the included angles of each vector, and the display device corresponding to each target vector included angle is used as each initial target display device. Each initial target display device has a suitable angle to clearly display information to the user.

[0117] The step of selecting each initial target display device from among the display devices based on a preset first angle range and the angles of each vector includes:

[0118] Step B421: Find the target vector angles that are within the preset first angle range among the vector angles;

[0119] Step B422: If the search is successful, the display device corresponding to the included angle of each of the target vectors is taken as the initial target display device;

[0120] Step B423: If the search fails, the preset first included angle range is adjusted to a preset second included angle range based on the preset offset angle range, and the display devices corresponding to the included angles of each vector within the preset second included angle range are taken as the initial target display devices.

[0121] In this embodiment, if it is successful to find the target vector angles within the preset first angle range among the vector angles, the display device corresponding to each target vector angle is directly used as the initial target display device. If it is unsuccessful to find the target vector angles within the preset first angle range among the vector angles, the preset first angle range is adjusted to a preset second angle range based on a preset offset angle range. The preset second angle range is larger than the preset first angle range to find the initial target display device in a larger angle range. Then, the display devices corresponding to the vector angles within the preset second angle range are used as the initial target display devices. For example, assuming the first angle range is 0 to 30 degrees and the preset offset angle range is 0 to 20 degrees, then if a preset offset angle of 20 degrees is selected within the preset offset angle range, the second angle range is 0 to 50 degrees.

[0122] In another embodiment, if the search fails, the display device closest to the preset first angle range is determined as the display device to be rotated; based on the direction of the vector angle corresponding to the display device to be rotated being close to the preset first angle range, the rotation direction of the display device to be rotated is controlled, and based on the offset angle of the vector angle corresponding to the display device to be rotated relative to the preset first angle range as the rotation angle, the display device to be rotated is controlled to rotate, and the rotated display device is determined as the initial target display device. For example, assuming the preset first angle range is 0 to 30 degrees, and the vector angle of the display device to be rotated is the angle formed by the first azimuth vector along the counterclockwise direction and the second azimuth vector, specifically 40 degrees, then the display device to be rotated needs to be controlled to rotate 10 degrees counterclockwise. Alternatively, the rotated display device to be rotated can also be directly determined as the target display device.

[0123] Step B43: Select the target display device from the initial target display devices based on the distance to each of the locations.

[0124] In this embodiment, based on each of the said position distances, the target display device is selected from each of the said initial target display devices. Specifically, the target position distance corresponding to each of the said position distances is extracted, and then the shortest target position distance is determined from each of the said target position distances. Then, the initial target display device corresponding to the shortest target position distance is taken as the target display device.

[0125] Figure 4 This diagram illustrates a schematic of a target display device determined based on distance and / or orientation according to an embodiment of this application; as shown below. Figure 4 As shown, the first spatial position point b in the first position information of the effective input device and the second spatial position point a in the second position information of each display device are extracted respectively; to simplify the image, Figure 4 The document only provides a second spatial location point 'a' in the second location information of a display device. The display device is suspended above the input device, and the screen of the display device faces the ground to facilitate the user's viewing of the content displayed on the screen.

[0126] exist Figure 4 In this context, based on the first spatial position point b of the effective input device and the second spatial position point a of the display device, the distance d from the first spatial position point b to the second spatial position point a of each display device can be calculated; the display device corresponding to the minimum distance can be determined as the target display device corresponding to the effective input device.

[0127] exist Figure 4 In the process, the first orientation information of the valid input device and the second orientation information corresponding to each of the display devices can be obtained simultaneously; before determining the display device corresponding to the minimum distance as the target display device corresponding to the valid input device, an initial target display device is determined based on the first orientation information and the second orientation information corresponding to each display device; among the initial target display devices, the display device corresponding to the minimum distance is selected and determined as the target display device corresponding to the valid input device.

[0128] exist Figure 4Before acquiring the first orientation information of the valid input device and the second orientation information corresponding to each of the display devices, the method for determining the first orientation information and each of the second orientation information includes: acquiring the user's location, the first spatial location point b, and the second spatial location point a corresponding to each display device; taking the user's location as the user's location plane B (the front of plane B can be the user's chest, and the back can be the user's back), generating a first orientation vector perpendicular to the user's location plane B based on the first spatial location point b. Obtain the first orientation information; using the display screen A of each of the display devices as the display plane, generate a second orientation vector perpendicular to the display screen A based on the second spatial position point a. The second orientation information is obtained. Specifically, the user position plane B obtained from the user's location is the plane formed along the top of the human body to the bottom, and the plane obtained from the display screen A of the display device is the display plane where the display screen is located; the first orientation vector The second orientation vector is the normal vector of the user's location plane B. This is the normal vector of the display plane obtained by the display screen A of the display device. Therefore, the first orientation vector can be calculated in space. With the second orientation vector The angle θ formed by the vectors is the second orientation vector. Along counterclockwise and the first orientation vector The resulting included angle θ.

[0129] exist Figure 4 If the included angle θ of the vectors is within a preset first angle range, then the display device corresponding to the second azimuth vector is determined as the initial target display device. There may be multiple initial target display devices, as long as the first azimuth vector... With each of the second orientation vectors Display devices whose vector angle θ falls within a preset first angle range are considered initial target display devices. Based on this, a selection is made based on distance; among the initial target display devices, the display device with the smallest distance is selected as the target display device corresponding to the valid input device. The preset first angle range can be set to 0 to 20 degrees or 0 to 30 degrees, etc., and those skilled in the art can also set the preset first angle range according to actual needs.

[0130] However, if the included angle θ of the vector is outside the preset first angle range, it indicates that there is no corresponding initial target display device. In this case, the preset first angle range needs to be widened, and an acceptable display orientation is sufficient, rather than the optimal one. Then, the difference Δθ between the included angle θ and the upper or lower threshold of the preset first angle range is calculated, along with a preset offset angle range. If the difference Δθ is within the preset offset angle range, the display device corresponding to the difference Δθ is determined as the initial target display device. The preset offset angle range can be set to 0 to 10 degrees or 0 to 20 degrees, etc., and those skilled in the art can also set the preset offset angle range according to actual needs.

[0131] Meanwhile, there may be situations where all the differences are outside the preset offset angle range. In this case, the display device with the smallest difference Δθ needs to be identified as the display device to be rotated. The rotation direction of the display device to be rotated is controlled based on the sign of the difference Δθ, and the rotation angle of the display device to be rotated is determined based on the offset difference between the difference Δθ and the edge threshold of the preset offset angle range. The edge threshold of the preset offset angle range includes an upper threshold and a lower threshold of the preset offset angle range. For example, if the preset offset angle range is 0 to 30 degrees, then the upper threshold is 30 degrees and the lower threshold is 0 degrees. Thus, the rotated display device to be rotated is identified as the initial target display device.

[0132] In this application and its corresponding embodiments, when the included angle of the vectors is no longer within the preset first included angle range, the first azimuth vector can be used. With the second orientation vector The vector angle θ is subtracted from the nearest boundary value (upper or lower threshold) within the preset first angle range to obtain the difference Δθ between the vector angle θ and the nearest boundary value. If the sign of the difference Δθ is positive, it indicates that the orientation of the display device to be rotated needs to be adjusted downwards (rotated). Based on the offset difference Δθ between the difference Δθ and the upper threshold of the preset offset angle range, the display device to be rotated is adjusted downwards (rotated). Simultaneously, the first orientation vector is detected in real time. The second orientation vector of the rotating display device The resulting vector angle θ is used to calculate the difference Δθ in real time until the offset difference Δ is less than 0 or the vector angle θ is within a preset first angle range. At this point, the downward adjustment (rotation) of the display device to be rotated is stopped, and the rotated display device is determined as the initial target display device. Similarly, if the sign of the difference Δθ is negative, it indicates that the orientation of the display device to be rotated needs to be adjusted (rotated) upward. Based on the offset difference Δθ and the lower threshold of the preset offset angle range, the display device to be rotated is adjusted (rotated) upward. During the adjustment, the first orientation vector is detected in real time. The second orientation vector of the rotating display device The resulting vector angle θ is used to calculate the difference Δθ in real time until the offset difference Δ is less than 0 or the vector angle θ is within the preset first angle range. Then, the downward adjustment (rotation) of the display device to be rotated is stopped, and the rotated display device is determined as the initial target display device.

[0133] Whether to stop adjusting (rotating) the display device until the offset difference Δ is less than 0, or to stop adjusting (rotating) the display device until the included vector angle θ is within a preset first angle range, needs to be determined manually. For example, if it is only necessary to adjust the display device to an acceptable offset angle range, the condition can be set to stop adjusting (rotating) the display device until the offset difference Δ is less than 0; if it is necessary to adjust the display device to the optimal range, the adjustment (rotation) of the display device can be stopped after the included vector angle θ is within the preset first angle range.

[0134] However, in this application and other possible embodiments, if the adjustment (rotation) of the display device to be rotated is stopped after the included angle θ of the vector is within the preset first included angle range, or if the offset difference Δ is less than 0, then step S30 is executed to display the read display content on the display device as soon as possible, so as to enhance the user experience.

[0135] This application provides a method for temporarily matching a display device corresponding to a valid input device based on orientation and distance information. Specifically, it first calculates the distance between a first spatial location point and each of the second spatial location points to obtain the distances between each location. Then, it obtains a user location plane and calculates the first orientation information of the first spatial location point relative to the user location plane. Next, it obtains the display plane corresponding to each of the display devices and calculates the second orientation information of each of the second spatial location points relative to their respective display planes. Finally, based on the location distances, the first orientation information, and the second orientation information, it temporarily matches the valid input device among the display devices. The corresponding target display device can then temporarily match the target display device with the most suitable orientation and distance for displaying information to the user, so that the selected target display device can clearly display information to the user. Since there is only a temporary matching relationship between the valid input device and the corresponding target display device, even if the valid input device fails, the target display device can temporarily match another valid input device for display. Therefore, while ensuring that the target display device can clearly display information to the user at the appropriate orientation and distance, it also solves the technical problem of the corresponding display device being unable to display due to the failure of the valid input device.

[0136] The execution entity of the information display control method of this application can be a processing device. For example, the processing method can be executed by a terminal device, a server, or other processing devices. The terminal device can be a user equipment (UE), mobile device, user terminal, terminal, cellular phone, cordless phone, personal digital assistant (PDA), handheld device, computing device, vehicle-mounted device, wearable device, etc. In some possible implementations, the information display control method can be implemented by a processor calling computer-readable instructions stored in memory.

[0137] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0138] This application also proposes an information display control device, which includes: a position acquisition module, used to acquire first position information corresponding to a valid input device and second position information corresponding to each display device;

[0139] A temporary matching module is used to temporarily match the target display device corresponding to the valid input device among the display devices based on the first location information and each of the second location information;

[0140] The display module is used to read the corresponding display information and display it on the target display device based on the valid input signal of the valid input device.

[0141] Optionally, the first location information includes at least a first spatial location point, the second location information includes at least a second spatial location point, and the temporary matching module is further configured to:

[0142] Calculate the distance between the first spatial location point and each of the second spatial location points to obtain the distance between each location;

[0143] Based on the distance to each location, a target display device corresponding to the valid input device is temporarily matched among the display devices.

[0144] Optionally, the first location information includes at least a first spatial location point, the second location information includes at least a second spatial location point, and the temporary matching module is further configured to:

[0145] Obtain the user's location plane and calculate the first orientation information of the first spatial location point relative to the user's location plane;

[0146] Obtain the display plane corresponding to each of the aforementioned display devices, and calculate the second orientation information of each second spatial position point relative to its corresponding display plane;

[0147] Based on the first location information and each of the second location information, a target display device corresponding to the valid input device is temporarily matched among each of the display devices.

[0148] Optionally, the first azimuth information includes at least a first azimuth vector, the second azimuth information includes at least a second azimuth vector, and the temporary matching module is further configured to:

[0149] Calculate the vector angles between the first azimuth vector and each of the second azimuth vectors respectively;

[0150] Based on the included angle of each vector, a target display device corresponding to the valid input device is temporarily matched among the display devices.

[0151] Optionally, the first location information includes at least a first spatial location point, the second location information includes at least a second spatial location point, and the temporary matching module is further configured to:

[0152] Calculate the distance between the first spatial location point and each of the second spatial location points to obtain the distance between each location;

[0153] Obtain the user's location plane and calculate the first orientation information of the first spatial location point relative to the user's location plane;

[0154] Obtain the display plane corresponding to each of the aforementioned display devices, and calculate the second orientation information of each second spatial position point relative to its corresponding display plane;

[0155] Based on the location distances, the first orientation information, and the second orientation information, a target display device corresponding to the valid input device is temporarily matched among the display devices.

[0156] Optionally, the first azimuth information includes at least a first azimuth vector, the second azimuth information includes at least a second azimuth vector, and the temporary matching module is further configured to:

[0157] Calculate the vector angles between the first azimuth vector and each of the second azimuth vectors respectively;

[0158] Based on the preset first included angle range and the included angles of each of the vectors, each initial target display device is selected from each of the display devices;

[0159] Based on the distance to each of the aforementioned locations, the target display device is selected from the initial target display devices.

[0160] Optionally, the temporary matching module is further configured to:

[0161] Find the angles of each target vector that fall within the preset first angle range among the angles of each vector;

[0162] If the search is successful, the display device corresponding to the included angle of each of the target vectors will be used as the initial target display device.

[0163] If the search fails, the preset first included angle range is adjusted to a preset second included angle range based on the preset offset angle range, and the display devices corresponding to the included angles of each vector within the preset second included angle range are taken as the initial target display devices.

[0164] Optionally, the display module is further configured to:

[0165] Set the target display device to an occupied state and determine whether there is a target user in front of the target display device;

[0166] If it exists, then the target user will be designated as the user occupying the target display device.

[0167] If it does not exist, then the occupancy status of the target display device is released.

[0168] The specific implementation of the information display control device in this application is basically the same as the embodiments of the information display control method described above, and will not be repeated here.

[0169] In some embodiments, the functions or modules of the apparatus provided in this application can be used to perform the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0170] This application also proposes a computer-readable storage medium storing computer program instructions thereon, which, when executed by a processor, implement the above-described method. The computer-readable storage medium may be a non-volatile computer-readable storage medium.

[0171] The specific implementation of the computer-readable storage medium in this application is basically the same as the embodiments of the information display control method described above, and will not be repeated here.

[0172] This application also proposes an electronic device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured as described above. The electronic device can be provided as a terminal, a server, or other type of device.

[0173] Figure 3 This is a block diagram illustrating an electronic device 800 according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, or other terminal.

[0174] Reference Figure 5 The electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0175] Processing component 802 typically controls the overall operation of electronic device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0176] Memory 804 is configured to store various types of data to support the operation of electronic device 800. Examples of this data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0177] Power supply component 806 provides power to various components of electronic device 800. Power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800.

[0178] Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0179] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when electronic device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

[0180] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0181] Sensor assembly 814 includes one or more sensors for providing state assessments of various aspects of electronic device 800. For example, sensor assembly 814 can detect the on / off state of electronic device 800, the relative positioning of components such as the display and keypad of electronic device 800, changes in position of electronic device 800 or a component of electronic device 800, the presence or absence of user contact with electronic device 800, orientation or acceleration / deceleration of electronic device 800, and temperature changes of electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0182] Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices. Electronic device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0183] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0184] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions that can be executed by a processor 820 of an electronic device 800 to perform the above-described method.

[0185] Figure 6 This is a block diagram illustrating an electronic device 1900 according to an exemplary embodiment. For example, the electronic device 1900 may be provided as a server. (Refer to...) Figure 6The electronic device 1900 includes a processing component 1922, which further includes one or more processors, and memory resources represented by memory 1932 for storing instructions, such as application programs, that can be executed by the processing component 1922. The application programs stored in memory 1932 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 1922 is configured to execute instructions to perform the methods described above.

[0186] Electronic device 1900 may also include a power supply component 1926 configured to perform power management of electronic device 1900, a wired or wireless network interface 1950 configured to connect electronic device 1900 to a network, and an input / output (I / O) interface 1958. Electronic device 1900 can operate on an operating system stored in memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or similar.

[0187] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions that can be executed by a processing component 1922 of an electronic device 1900 to perform the above-described method.

[0188] This application may be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this application.

[0189] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0190] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0191] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information from the computer-readable program instructions. These electronic circuits can execute the computer-readable program instructions to implement various aspects of this application.

[0192] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0193] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0194] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0195] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0196] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical applications, or technical improvements to the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. An information display control method, characterized in that, The information display control method includes: Obtain the first position information corresponding to the valid input device and the second position information corresponding to each display device; Based on the first location information and each of the second location information, a target display device corresponding to the valid input device is temporarily matched among each of the display devices; Based on the valid input signal from the valid input device, the corresponding display information is read and displayed on the target display device. The first location information includes at least one first spatial location point, and the second location information includes at least one second spatial location point. The step of temporarily matching the target display device corresponding to the valid input device among the display devices based on the first location information and each of the second location information includes: Calculate the distance between the first spatial location point and each of the second spatial location points to obtain the distance between each location; Obtain the user's location plane and calculate the first orientation information of the first spatial location point relative to the user's location plane; Obtain the display plane corresponding to each of the aforementioned display devices, and calculate the second orientation information of each second spatial position point relative to its corresponding display plane; Based on the location distances, the first orientation information, and the second orientation information, a target display device corresponding to the valid input device is temporarily matched among the display devices. The first azimuth information includes at least a first azimuth vector, and the second azimuth information includes at least a second azimuth vector. The step of temporarily matching the target display device corresponding to the valid input device among the display devices based on the location distances, the first orientation information, and the second orientation information includes: Calculate the vector angles between the first azimuth vector and each of the second azimuth vectors respectively; Based on the preset first included angle range and the included angles of each of the vectors, each initial target display device is selected from each of the display devices; Based on the aforementioned location distances, the target display device is selected from the aforementioned initial target display devices; The step of selecting each initial target display device from among the display devices based on a preset first angle range and the angles of each vector includes: Find the angles of each target vector that fall within the preset first angle range among the angles of each vector; If the search is successful, the display device corresponding to the included angle of each of the target vectors will be used as the initial target display device. If the search fails, the preset first included angle range is adjusted to a preset second included angle range based on the preset offset angle range, and the display devices corresponding to the included angles of each vector within the preset second included angle range are taken as the initial target display devices.

2. The information display control method as described in claim 1, characterized in that, The step of reading corresponding display information based on the valid input signal from the valid input device and displaying it on the target display device includes: Set the target display device to an occupied state and determine whether there is a target user in front of the target display device; If it exists, then the target user will be designated as the user occupying the target display device. If it does not exist, then the occupancy status of the target display device is released.

3. An information display and control device, characterized in that, The information display control device includes: a memory, a processor, and a program stored in the memory for implementing the information display control method. The memory is used to store the program that implements the information display control method; The processor is configured to execute a program that implements the information display control method, thereby implementing the steps of the information display control method as described in any one of claims 1 to 2.

4. A readable storage medium, characterized in that, The readable storage medium stores a program for implementing the information display control method, which is executed by a processor to implement the steps of the information display control method as described in any one of claims 1 to 2.

5. A program product, said program product being a computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the information display control method as described in any one of claims 1 to 2.

Images