Multi-party relationship processing method, device, readable storage medium and program product
By acquiring the location information of the signal input party and the device, selecting the target display device and establishing a temporary binding, the problem of wasted resources of the signal input party and the device is solved, and efficient use of resources is achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- WEBANK (CHINA)
- Filing Date
- 2021-06-28
- Publication Date
- 2026-06-19
AI Technical Summary
In existing technologies, signal input, input devices, and display devices are typically bound together in a one-to-one correspondence, leading to a waste of resources.
By acquiring the location information of the signal input party, input device, and display device, a target display device that meets the information display conditions is selected, a temporary binding relationship is established, and unnecessary bindings are removed.
It saves resources on signal input, input devices, and display devices, and improves resource utilization efficiency.
Smart Images

Figure CN113342182B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of smart device technology in financial technology (Fintech), and more particularly to a method, device, readable storage medium, and program product for processing multi-party relationships. Background Technology
[0002] With the continuous development of fintech, especially internet fintech, more and more technologies (such as distributed systems and artificial intelligence) are being applied in the financial field. However, the financial industry is also placing higher demands on technology, such as on the distribution of tasks to be completed.
[0003] With the continuous development of computer software and artificial intelligence, the application of smart devices is becoming increasingly widespread. Currently, multi-party collaboration is commonly used in the display field. For example, a signal input party can display on a corresponding display device through an input device. The signal input party can be a robot or a smart terminal, and there can be multiple display devices and multiple input devices. However, currently, the signal input party, input device, and display device are usually bound one-to-one. As a result, when the signal input party is not using the input device, the one-to-one binding of the signal input party, input device, and display device will cause them to occupy resources, resulting in resource waste. Summary of the Invention
[0004] The main objective of this application is to provide a method, apparatus, readable storage medium, and program product for processing multi-party relationships, aiming to solve the technical problem of resource waste caused by the mutual occupation of resources by the signal input party, input device, and display device in the prior art.
[0005] To achieve the above objectives, this application provides a method for processing multi-party relationships, which is applied to a multi-party relationship processing device. The method includes:
[0006] Acquire the first positioning information of the signal input party, the second positioning information corresponding to the input device, and the third positioning information corresponding to each display device;
[0007] Based on the first positioning information, the second positioning information, and each of the third positioning information, a target display device that meets the information clear display conditions corresponding to the signal input party is selected from among the display devices;
[0008] Establish or terminate a temporary binding relationship between the signal input party, the input device, and the target display device.
[0009] This application also provides a multi-party relationship processing apparatus, which is a virtual apparatus and is applied to a multi-party relationship processing device. The multi-party relationship processing apparatus includes:
[0010] The acquisition module is used to acquire the first positioning information of the signal input party, the second positioning information corresponding to the input device, and the third positioning information corresponding to each display device;
[0011] The selection module is used to select a target display device that meets the information clear display conditions corresponding to the signal input party from among the display devices based on the first positioning information, the second positioning information and each of the third positioning information;
[0012] The relationship processing module is used to establish or terminate the temporary binding relationship between the signal input party, the input device, and the target display device.
[0013] This application also provides a multi-party relationship processing device, which is a physical device. The multi-party relationship processing device includes: a memory, a processor, and a program of the multi-party relationship processing method stored in the memory and executable on the processor. When the program of the multi-party relationship processing method is executed by the processor, it can implement the steps of the multi-party relationship processing method as described above.
[0014] This application also provides a readable storage medium storing a program implementing a multi-party relationship processing method, wherein when the program is executed by a processor, it implements the steps of the multi-party relationship processing method as described above.
[0015] This application also provides a computer program product, including a computer program that, when executed by a processor, implements the steps of the multi-party relationship processing method described above.
[0016] This application provides a method, apparatus, readable storage medium, and program product for processing multi-party relationships. Compared to the existing technology that typically uses a one-to-one binding of signal input parties, input devices, and display devices for multi-party collaborative display, this application first obtains the first positioning information of the signal input party, the second positioning information corresponding to the input device, and the third positioning information corresponding to each display device. Then, based on the first positioning information, the second positioning information, and each of the third positioning information, it selects a target display device from among the display devices that corresponds to the information display conditions of the signal input party, so that the display device clearly displays information to the signal input party, thereby establishing or de-binding a temporary binding relationship between the signal input party, the input device, and the target display device. In this system, since the target display device is selected from multiple display devices, and the binding relationship is temporary, the binding relationship between the signal input party, the input device, and the target display device can be released at any time when the signal input party does not input a signal through the input device. When the signal input party inputs a signal through the input device, the target display device can be reselected at any time, and the temporary binding relationship can be re-established. Therefore, this system overcomes the technical defect that when the signal input party is not using the input device, the one-to-one binding of the signal input party, the input device, and the display device will cause the signal input party, the input device, and the display device to occupy resources with each other, resulting in resource waste. This system saves the resources occupied by the signal input party, the input device, and the display device. Attached Figure Description
[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0019] Figure 1 This is a flowchart illustrating the first embodiment of the multi-party relationship processing method of this application;
[0020] Figure 2 This is a flowchart illustrating the second embodiment of the multi-party relationship processing method of this application;
[0021] Figure 3 This is a schematic diagram illustrating the determination of the distance between the location points, the first direction vector, and the second direction vector in the multi-party relationship processing method of this application.
[0022] Figure 4This is a flowchart illustrating the third embodiment of the multi-party relationship processing method of this application;
[0023] Figure 5 This is a schematic diagram of the device structure of the hardware operating environment involved in the multi-party relationship processing method in the embodiments of this application.
[0024] The purpose, features, and advantages of this application will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation
[0025] It should be understood that the specific embodiments described herein are for illustrative purposes only and are not intended to limit the scope of this application.
[0026] This application provides a method for processing multi-party relationships. In the first embodiment of this application's method for processing multi-party relationships, refer to... Figure 1 The multi-party relationship processing method includes:
[0027] Step S10: Obtain the first positioning information of the signal input party, the second positioning information corresponding to the input device, and the third positioning information corresponding to each display device;
[0028] In this embodiment, it should be noted that the signal input party is the party that inputs signals onto an input device. The signal input party can be a user, robot, or other intelligent terminal. The input device is a device that generates instructions based on the operation of the signal input party, including a keyboard, mouse, and microphone. The display device is a device that displays information based on the generated instructions, including liquid crystal displays and projection displays. The first positioning information is the positioning location information of the signal input party, which can be the coordinates of the signal input party's location or its height above the ground. The second positioning information is the positioning location information of the input device, which can be the coordinates of the input device's location or its height above the ground. The third positioning information is the positioning location information of the display device, which can be the coordinates of the display device's location or its height above the ground.
[0029] Additionally, it should be noted that any one of the following positioning information—the first positioning information corresponding to the signal input party, the second positioning information of the input device, and the third positioning information of the display device—can change over time. The signal input party, input device, and display device are all equipped with corresponding positioning mechanisms or positioning algorithms; for example, the positioning mechanism can be a navigation positioning mechanism, such as a navigation positioning chip. The positioning mechanism or positioning algorithm can locate the first positioning information, the second positioning information, and the third positioning information corresponding to the signal input party, input device, and display device. Even if the positions of the signal input party, input device, and display device change, the location of the first positioning information, the second positioning information, and the third positioning information corresponding to the signal input party, input device, and display device can still be determined.
[0030] For example, the signal input party can be a user, robot, or other intelligent terminal operating the input device, and its position can certainly be adjusted as needed. Simultaneously, the input device is a device that generates corresponding instructions based on the operation of the signal input party. This device can be a mobile terminal, a movable keyboard, microphone, or microphone, and its position is definitely adjustable as needed. The display device displays the instructions generated by the input device. Since there are multiple display devices, the display device closest to both the signal input party and the input device can be selected to respond to the input device instructions; therefore, the position of the display device does not need to be adjusted.
[0031] The step of obtaining the first positioning information of the signal input party and the second positioning information corresponding to the input device includes:
[0032] Step S11: Obtain the generation instructions corresponding to several input devices;
[0033] Step S12: Determine the valid instruction from each of the generated instructions, and use the input device corresponding to the valid instruction as the valid input device;
[0034] Step S13: Locate the signal input source and the valid input device to obtain the first location information and the second location information.
[0035] In this embodiment, it should be noted that multiple signal input parties and several input devices may exist in a public place. All of these signal input parties and input devices are movable. When multiple signal input parties operate their respective input devices, the input devices can generate multiple generation instructions. For example, a signal input party manipulating an input device can generate a generation instruction. At this time, it is necessary to determine the valid instruction from among the multiple generation instructions to avoid binding the signal input party, input device, and display device due to misoperation. That is, the valid input device is determined from among the aforementioned input devices, and the valid input device and its corresponding signal input party are located to obtain first positioning information of the signal input party used to operate the valid input device over time and second positioning information of the valid input device. In other words, the corresponding input device is determined to be a valid input device through the valid instruction, and the generation instruction generated by the valid input device is a valid instruction.
[0036] The step of determining a valid instruction from each of the generated instructions includes:
[0037] Step S121: Determine the type of input device corresponding to each of the generated instructions;
[0038] Step S122: Based on the type, determine the preset feature extraction rules corresponding to each of the generation instructions;
[0039] Step S123: Based on preset feature extraction rules, feature extraction is performed on the string text within each of the generated instructions to obtain each text feature;
[0040] Step S124: Compare each of the stated text features with the preset text features to obtain the comparison results;
[0041] Step S125: Based on the comparison results, determine the valid instruction among the generated instructions.
[0042] In this application, before extracting features from the string text within each of the generated instructions, it is necessary to determine the string text within each of the generated instructions. The method includes: determining the start and end points of the generated instructions corresponding to the plurality of input devices; converting the instructions corresponding to the plurality of input devices into string text within the start and end points; determining the type of the input device corresponding to each generated instruction; determining a preset feature extraction rule corresponding to each generated instruction based on the type; extracting features from each string text based on the preset feature extraction rule to obtain each text feature; comparing each text feature with the preset text feature to obtain a comparison result; and determining the valid instruction in each of the generated instructions.
[0043] In this embodiment of the application, the method for determining the start and end points of the instructions corresponding to the plurality of input devices includes: determining the trigger time point corresponding to the first triggering of the plurality of input devices, and taking the trigger time point as the start point; based on the trigger time point, detecting the triggered actions after the trigger time point in real time, determining that the time interval between the Nth triggered action and the N+1th triggered action is greater than a set time interval, and then determining the completion time of the Nth triggered action as the end point of the generated instruction.
[0044] For example, the input device can be a keyboard, and the signal input party inputs the corresponding command through the keyboard, taking the trigger time point corresponding to the first trigger of the keyboard as the starting point; the triggering action of the keyboard after the trigger time point is detected in real time, and the time interval between the Nth triggering action and the N+1th triggering action is calculated in real time. If the time interval is greater than the set time interval, the time of completion of the Nth triggering action is determined as the termination point of the generated command.
[0045] For example, the input device can be a microphone, and the signal input party inputs the corresponding command through the microphone, taking the trigger time point corresponding to the first trigger of the microphone as the starting point; the triggering action of the microphone after the trigger time point is detected in real time, and the time interval between the Nth triggering action and the N+1th triggering action is calculated in real time. If the time interval is greater than the set time interval, the time of completion of the Nth triggering action is determined as the termination point of the generated command.
[0046] In this embodiment of the application, determining the type of the input device corresponding to each of the generated instructions, and determining the preset feature extraction rule corresponding to each of the generated instructions based on the type, includes: determining the instruction type of the input device corresponding to each of the generated instructions; if the type of the generated instruction is a voice instruction, then using a speaker recognition algorithm to convert the instruction into string text; if the type is a keyboard instruction, obtaining that the keyboard corresponds to an input method, and when the key of the keyboard is triggered, converting the keyboard instruction into string text according to the input method.
[0047] In addition, in this application, the input device is not limited to a microphone and keyboard, but may also include other graphical or motion-based input devices, such as touch screens or motion recognition input devices.
[0048] In this embodiment of the application, the method of extracting features from the string text within each generated instruction based on preset feature extraction rules to obtain each text feature includes: determining the type of instruction corresponding to the input device; if the type is a voice instruction, then retrieving the preset feature extraction rules corresponding to the voice, segmenting the string text into words, and obtaining several word features after segmentation; determining the content words among the several word features as the text features. If the type is a keyboard instruction, then retrieving the preset feature extraction rules corresponding to the keyboard, determining whether the string text can form Chinese characters or Western characters; if it can form, then determining the content words among the Chinese characters or English characters as the text features; if it cannot form, then determining that the instruction corresponding to the input device is an invalid instruction, and clearing the corresponding generated instruction.
[0049] In this embodiment of the application, the method for determining the content words in the plurality of word features as the text features or determining the content words in the Chinese characters or English characters as the text features includes: determining the number of content words; determining whether the content words in the plurality of word features are the text features based on the number of content words and a predetermined number obtained.
[0050] In this embodiment of the application, specifically, the method for determining whether a content word in the plurality of word features is a text feature based on the number of content words and a predetermined number includes: comparing the number of content words with the predetermined number; if the number of content words is less than the predetermined number, then determining the instruction corresponding to the input device as an invalid instruction and clearing the corresponding generation instruction; if the number of content words is greater than or equal to the predetermined number, then determining the content word in the plurality of word features as the text feature; wherein, the predetermined number is a positive integer ≥ 1.
[0051] In this embodiment, the preset feature extraction rules corresponding to the speech are used to extract the content words of the string text and delete stop words in the string text to obtain the content words of the string text. For example, the jieba word segmentation tool and the custom dictionary in the word segmentation tool can be used to segment the text to obtain several word features after segmentation. A stop word list is set, and the stop words in the several word features after segmentation are filtered using the stop word list. The stop words can be added to the existing stop word list according to the specific scenario. The stop words can be modal particles, auxiliary words, and / or punctuation marks (including prepositions of Western characters, etc.). The remaining content words in the several word features are determined as the text features.
[0052] Accordingly, in this embodiment, if the type is a keyboard instruction, the preset feature extraction rule corresponding to the keyboard is invoked to extract the content words of the string text, and stop words in the string text are deleted to obtain the content words of the string text. It is then determined whether the string text can form Chinese characters or Western characters; if it can, the content words in the Chinese characters or English characters are identified as the text features by using the preset feature extraction rule corresponding to the keyboard; if it cannot, the instruction corresponding to the input device is determined to be an invalid instruction, and the corresponding generation instruction is cleared.
[0053] In this embodiment, specifically, if the type is a keyboard command, a preset feature extraction rule corresponding to the keyboard is retrieved based on the current input method of the input device. For example, if the input method is a Chinese input method, such as Wubi or other Chinese-format input methods, the corresponding preset feature extraction rule is set based on Chinese. Using this preset feature extraction rule, the content words of the string text can be extracted, and stop words in the string text can be deleted to obtain the content words of the string text. As another example, if the input method is a Western input method, the type of the Western input method is further determined. For example, if the Western input method type is English, stop words in the string text corresponding to English are deleted to obtain the content words of the string text corresponding to English.
[0054] The method for determining whether the string text can form Chinese characters or Western characters based on the current input method of the input device if the type is a keyboard command includes: obtaining the current input method of the input device; and determining whether the string text can form Chinese characters or Western characters based on the input method.
[0055] In this embodiment, the method for determining the valid instruction among the generated instructions based on the comparison result includes: constructing a feature database; comparing the text features with preset text features in the feature database to obtain a comparison result. Specifically, in this embodiment and other possible embodiments, the method for constructing the feature database includes: determining preset text features corresponding to the content to be displayed; and constructing the feature database based on the preset text features. For example, in financial institutions, the preset text features corresponding to the content to be displayed include, but are not limited to: text information in Chinese and Western forms related to deposits, withdrawals, stocks, funds, insurance, foreign exchange, or other business and industry terms, or one or more of the full name or abbreviation of the company issuing the corresponding stock.
[0056] In this embodiment of the application, the method for determining the valid instruction among the generated instructions based on the comparison results includes: determining the number of content words and the number of results in the comparison results that conform to the preset text features; determining the proportion based on the number of content words and the number of results; and determining whether the generated instruction is the valid instruction based on the proportion and the preset proportion.
[0057] In this embodiment, the method for determining whether a command is valid based on the ratio and a set ratio includes: comparing the ratio with a set ratio; if the ratio is greater than or equal to the set ratio, then the generated command is determined to be a valid command; otherwise, the generated command is determined to be an invalid command, and the corresponding generated command is cleared. The set ratio can be set to 50%. In this embodiment, the method for determining the number of content words and the number of results in the comparison results that match the preset text features includes: converting the content words and the preset text features into a first text vector and a second text vector, respectively; calculating the similarity between the first text vector and the second text vector; determining the magnitude of the similarity compared to a set similarity; if the similarity is greater than or equal to the set similarity, then the number of content words and the number of results in the comparison results match the preset text features; incrementing the result count by 1 and updating the result count. The set similarity can be 0.7.
[0058] Specifically, in this application and other possible embodiments, the cosine similarity between the first text vector and the second text vector can be calculated; the greater the cosine similarity, the more similar the first text vector and the second text vector are considered, and the more the content words conform to the preset text features.
[0059] Step S20: Based on the first positioning information, the second positioning information, and each of the third positioning information, select a target display device from among the display devices that meets the information clear display conditions corresponding to the signal input party;
[0060] In this embodiment, based on the first positioning information, the second positioning information, and each of the third positioning information, a target display device that meets the information clear display conditions corresponding to the signal input party is selected from among the display devices. Specifically, the generation instruction sent by the input device to the display device is obtained, and it is determined whether the generation instruction is a valid instruction. If it is a valid instruction, the positional distance between the first positioning information and the second positioning information of the input device that generated the valid instruction is determined. If the positional distance is less than or equal to a set positional distance, a binding is established between the input device that generated the valid instruction and the signal input party, and the state of the input device at this time is set to an occupied state. And based on the positional relationship between the first positioning information, the second positioning information, and the multiple third positioning information, a valid display device among the multiple display devices is determined as the target display device.
[0061] The method for determining a valid display device among the plurality of display devices as a target display device based on the positional relationship of the first positioning information, the second positioning information, and the plurality of third positioning information includes: calculating relative positional information between the signal input party, the input device, and each of the third positioning information based on the first positioning information, the second positioning information, and each of the third positioning information; and then selecting a target display device among the display devices that meets the information clear display condition corresponding to the signal input party based on the relative positional information, so that when the signal input party inputs a signal at the input device, the target display device can clearly display information to the signal input party. The information clear display condition can be preset relative positional information. The step of selecting a target display device among the display devices that meets the information clear display condition corresponding to the signal input party based on the relative positional information includes:
[0062] Select the target relative position information that is closest to the preset relative position information from the relative position information, and then use the display device corresponding to the target relative position information as the target display device. The relative position information can be relative distance and relative orientation, etc.
[0063] The conditions for clearly displaying the information include orientation selection conditions; the second positioning information includes at least one first positioning point; the third positioning information includes at least one second positioning point; and the display device includes at least one display screen.
[0064] The step of selecting a target display device that meets the information clear display conditions corresponding to the signal input party from among the display devices based on the first positioning information, the second positioning information, and each of the third positioning information includes:
[0065] Step S21: Based on the first positioning information, calculate the orientation of the first positioning point relative to the signal input point to obtain the first direction positioning information;
[0066] In this embodiment, it should be noted that the first positioning point is a point representing the positioning position of the input device. For example, the center of gravity of the input device can be selected as the first positioning point, or any point on the edge contour of the input device can be selected as the first positioning point, or the first positioning point can be randomly selected directly on the surface of the input device. Furthermore, the second positioning point is a point representing the positioning position of the display device. For example, the center of gravity of the display screen of the display device can be selected as the second positioning point, or any point on the edge contour of the display screen of the display device can be selected as the second positioning point, or the second positioning point can be randomly selected directly on the display screen of the display device.
[0067] Based on the first positioning information, the orientation of the first positioning point relative to the signal input party is calculated to obtain first direction positioning information. Specifically, based on the first positioning information, the signal input plane corresponding to the signal input party is determined, and a first direction vector perpendicular to the signal input plane passing through the first positioning point is generated. The first direction vector is used as the first direction positioning information. The step of determining the signal input plane corresponding to the signal input party based on the first positioning information includes:
[0068] Based on multiple positioning points in the positioning information, a signal input plane corresponding to the signal input party is established. Alternatively, if the signal input party is a robot or a user, the plane formed along the top of the human body to the bottom of the feet can also be used as the signal input plane, or the plane formed along the top of the human body to the chin can also be used as the signal input plane.
[0069] Step S22: Calculate the orientation of each second positioning point relative to its corresponding display screen to obtain positioning information in each second direction;
[0070] In this embodiment, the orientation of each second positioning point relative to its corresponding display screen is calculated to obtain second-direction positioning information. Specifically, the display plane corresponding to the display screen of each display device is obtained, and then a second direction vector passing through each second positioning point relative to the display plane corresponding to each positioning point is generated. The second direction vector is used as the second positioning information. The display plane is the plane where the display screen of the display device is located. In one possible implementation, if the display screen is a flat display screen, the plane where the display screen is located can be used as the display plane. If the display screen is a curved display screen, the plane formed by the edge contour of the display screen can be used as the display plane.
[0071] Step S23: Based on the first directional positioning information and each of the second directional positioning information, select a target display device that meets the orientation selection conditions from among the display devices.
[0072] In this embodiment, based on the first directional positioning information and each of the second directional positioning information, a target display device that meets the orientation selection conditions is selected from among the display devices. Specifically, based on the vector angle between the first directional vector and each of the second directional vectors, a target display device that meets the orientation selection conditions is selected from among the display devices, so that the target display device can clearly display the display information on the display screen of the target display device to the user from a suitable orientation. The specific process of selecting a target display device that meets the orientation selection conditions based on the vector angle between the first directional vector and each of the second directional vectors can be either selecting the display device corresponding to the smallest vector angle as the target display device, or selecting the display device corresponding to the vector angle closest to the preset target vector angle as the target display device. The preset target vector angle is a pre-set positioning information in which the target display device can most clearly display information to the signal input party when the signal input party makes a signal input.
[0073] Step S30: Establish or terminate the temporary binding relationship between the signal input party, the input device, and the target display device.
[0074] The step of establishing or de-binding the temporary binding relationship between the signal input party, the input device, and the target display device further includes:
[0075] Step S31: Establish a temporary binding relationship between the signal input party, the input device, and the target display device; Step S32: Detect whether the position information between the signal input party and the target display device conforms to the set position information; Step S33: If the position information does not conform to the set position information, release the temporary binding relationship between the signal input party, the input device, and the target display device; Step S34: If the position information conforms to the set position information, maintain the temporary binding relationship between the signal input party, the input device, and the target display device.
[0076] In this embodiment, after determining the target display device, a temporary binding relationship is established between the target display device and the signal input party and the input device. After establishing the temporary binding relationship between the signal input party, the input device, and the target display device, the state of the target display device is set to occupied state. The position information of the target display device and the signal input party is detected at set intervals. If the position information matches the set position information, the temporary binding relationship between the signal input party, the input device, and the target display device is maintained. Otherwise, the temporary binding relationship between the signal input party and the target display device is released sequentially, and the temporary binding relationship between the target display device and the input device is released, changing the occupied state of the corresponding input device and the target display device to an idle state. After releasing the temporary binding relationship between the signal input party, the input device, and the target display device, the target display device can be re-determined based on the position relationship of the second and third location information monitored in real time, and the temporary binding relationship between the signal input party, the input device, and the target display device can be re-established.
[0077] The multi-party relationship processing method further includes, after the step of establishing a temporary binding relationship among the signal input party, the input device, and the target display device:
[0078] Step A10: Obtain image information in front of the target display device;
[0079] In this embodiment, it should be noted that the display device is equipped with a camera. After establishing a temporary binding relationship between the signal input party, the input device, and the target display device, the camera can periodically take pictures of the area in front of the display device to obtain image information in front of the display device.
[0080] Step A20: If the features of the image information match the features of the initial image information corresponding to the signal input party, then the temporary binding relationship between the signal input party, the input device, and the target display device shall be maintained.
[0081] In this embodiment, it should be noted that the initial image information is an image captured by the camera of the target display device when establishing a temporary binding relationship between the signal input party, the input device, and the target display device. This image contains image features of the signal input party that is operating the input device.
[0082] Step A30: If the features of the second image information do not match the features of the initial image information corresponding to the signal input party, then the temporary binding relationship between the signal input party, the input device, and the target display device is released.
[0083] Specifically, if the characteristics of the image information match the characteristics of the initial image information corresponding to the signal input party, it proves that the signal input party is still using the input device and the target display device, and therefore it is necessary to continue to maintain the temporary binding relationship between the signal input party, the input device, and the target display device; if the characteristics of the second image information do not match the characteristics of the initial image information corresponding to the signal input party, it proves that the signal input party is no longer using the input device and the target display device, and therefore it is necessary to release the temporary binding relationship between the signal input party, the input device, and the target display device to release device resources.
[0084] This application provides a method for handling multi-party relationships. Compared to existing technologies that typically use a one-to-one binding of signal input parties, input devices, and display devices for collaborative display, this application first obtains first positioning information of the signal input party, second positioning information corresponding to the input device, and third positioning information corresponding to each display device. Then, based on the first positioning information, the second positioning information, and each of the third positioning information, a target display device corresponding to the information display conditions of the signal input party is selected from among the display devices. This allows the display device to clearly display information to the signal input party, thereby establishing or dissolving the relationship between the signal input party, the input device, and the target display device. The temporary binding relationship allows the signal input party, the input device, and the target display device to be unbound at any time when the signal input party is not inputting a signal through the input device. Conversely, when the signal input party inputs a signal through the input device, the target display device can be reselected and the temporary binding relationship can be re-established. Therefore, this overcomes the technical defect of resource waste caused by the one-to-one binding of the signal input party, input device, and display device when the signal input party is not using the input device, which would result in the signal input party, input device, and display device occupying resources from each other. This method saves resources occupied by the signal input party, input device, and display device.
[0085] Furthermore, referring to Figure 2 Based on the first embodiment of this application, in another embodiment of this application, the second positioning information includes at least a first positioning location point, the third positioning information includes at least a second positioning location point, and the display device includes at least a display screen.
[0086] The step of selecting a target display device that meets the information clear display conditions corresponding to the signal input party from among the display devices based on the first positioning information, the second positioning information, and each of the third positioning information includes:
[0087] Step B10: Based on the first positioning information, calculate the orientation of the first positioning point relative to the signal input point to obtain the first direction positioning information;
[0088] In this embodiment, it should be noted that the first positioning point is a point representing the positioning position of the input device. For example, the center of gravity of the input device can be selected as the first positioning point, or any point on the edge contour of the input device can be selected as the first positioning point, or the first positioning point can be randomly selected directly on the surface of the input device. Furthermore, the second positioning point is a point representing the positioning position of the display device. For example, the center of gravity of the display screen of the display device can be selected as the second positioning point, or any point on the edge contour of the display screen of the display device can be selected as the second positioning point, or the second positioning point can be randomly selected directly on the display screen of the display device.
[0089] Based on the first positioning information, the orientation of the first positioning point relative to the signal input party is calculated to obtain first direction positioning information. Specifically, based on the first positioning information, the signal input plane corresponding to the signal input party is determined, and a first direction vector perpendicular to the signal input plane passing through the first positioning point is generated. The first direction vector is used as the first direction positioning information. The step of determining the signal input plane corresponding to the signal input party based on the first positioning information includes:
[0090] Based on multiple positioning points in the positioning information, a signal input plane corresponding to the signal input party is established. Alternatively, if the signal input party is a robot or a user, the plane formed along the top of the human body to the bottom of the feet can also be used as the signal input plane, or the plane formed along the top of the human body to the chin can also be used as the signal input plane.
[0091] Step B20: Calculate the orientation of each second positioning point relative to its corresponding display screen to obtain positioning information for each second direction;
[0092] In this embodiment, the orientation of each second positioning point relative to its corresponding display screen is calculated to obtain positioning information in each second direction. Specifically, the display plane corresponding to the display screen of each display device is obtained, and then a second direction vector passing through each second positioning point relative to the display plane corresponding to each positioning point is generated. The second direction vector is used as the second positioning information.
[0093] Step B30: Calculate the distance between the first positioning point and each of the second positioning points to obtain the distance positioning information;
[0094] In this embodiment, the distance between the first positioning point and each of the second positioning points is calculated to obtain distance positioning information. Specifically, based on the positioning coordinates corresponding to the first positioning point and the positioning coordinates corresponding to each of the second positioning points, the distance between the first positioning point and each of the second positioning points is calculated to obtain the distance between each positioning point, and the distance between the positioning points is used as distance positioning information.
[0095] Step B40: Based on the first direction positioning information, each of the second direction positioning information and each of the distance positioning information, select a target display device that meets the conditions for clear information display from among the display devices.
[0096] In this embodiment, based on the first direction positioning information, each of the second direction positioning information, and each of the distance positioning information, a target display device that meets the conditions for clear information display is selected from among the display devices. Specifically, based on the distance of each location point, the first positioning information, and each of the second positioning information, a target display device that meets the preset user display angle and preset user display distance corresponding to the input device is temporarily matched among the display devices, so that the target display device can clearly display the display information on the display screen of the target display device to the user. The preset user display angle is a pre-set display angle suitable for the display device to display information to the user, and the better the display angle of the target display device relative to the user, the clearer the user can receive the display information on the display screen of the target display device. The preset user display distance is a pre-set display distance between the display device and the user suitable for the display device to display information to the user, and the shorter the display distance of the target display device relative to the user, the clearer the user can receive the display information on the display screen of the target display device.
[0097] The information clearly displayed conditions include orientation selection conditions and distance selection conditions.
[0098] The step of selecting a target display device that meets the information clear display condition from among the display devices based on the first direction positioning information, each of the second direction positioning information, and each of the distance positioning information includes:
[0099] Step B41: Based on the first directional positioning information and each of the second directional positioning information, select each initial target display device that meets the orientation selection conditions from among the display devices;
[0100] In this embodiment, based on the first direction positioning information and each of the second direction positioning information, each initial target display device that meets the orientation selection conditions is selected from each of the display devices. Specifically, based on the first direction vector and each of the second direction vectors, a target display device that meets the preset orientation selection conditions corresponding to the input device is temporarily matched among the display devices. The preset orientation selection conditions are conditions used to limit the orientation of the target display device relative to the signal input. For example, the preset orientation selection conditions can be set as the orientation of the angle between the first direction vector and the second direction vector, so that the temporarily matched target display device can clearly display information to the signal input from a suitable orientation.
[0101] Wherein, the first directional positioning information includes at least a first directional vector, and the second directional positioning information includes at least a second directional vector;
[0102] The step of selecting initial target display devices that meet the orientation selection conditions from among the display devices based on the first orientation positioning information and each of the second orientation positioning information includes:
[0103] Step B411: Calculate the vector angles between the first direction vector and each of the second direction vectors;
[0104] In this embodiment, it should be noted that the included angle can be the angle formed by the first direction vector in a counterclockwise direction and the second direction vector, or it can be the angle formed by the first direction vector in a clockwise direction and the second direction vector.
[0105] Step B412: Based on the included angles of each vector and the preset first included angle range, select each initial target display device that meets the orientation selection conditions from among the display devices.
[0106] In this embodiment, based on the included angles of each vector and a preset first included angle range, each initial target display device that meets the orientation selection conditions is selected from the display devices. Specifically, each target vector included angle that is within the preset first included angle range is selected from the included angles of each vector, and the display device corresponding to each target vector included angle is used as the initial target display device corresponding to the input device.
[0107] Step B42: Based on the distance positioning information, select a target display device that meets the distance selection criteria from among the initial target display devices.
[0108] In this embodiment, based on the distance positioning information, a target display device that meets the distance selection conditions is selected from the initial target display devices. Specifically, the target location point distance corresponding to each initial target display device is extracted from the location point distance, and then the shortest target location point distance is determined from the target location point distance. The initial target display device corresponding to the shortest target location point distance is then used as the target display device.
[0109] The step of selecting initial target display devices that meet the orientation selection conditions from among the display devices based on the included angles of each vector and a preset included angle range is as follows:
[0110] Step B421: Find the target vector angles that are within the preset first angle range among the vector angles;
[0111] Step B422: If the search is successful, the display device corresponding to the included angle of each of the target vectors is taken as the initial target display device;
[0112] Step B423: If the search fails, the preset first included angle range is adjusted to a preset second included angle range based on the preset offset angle range, and the display devices corresponding to the included angles of each vector within the preset second included angle range are taken as the initial target display devices.
[0113] In this embodiment, if it is successful to find the target vector angles within the preset first angle range among the vector angles, the display device corresponding to each target vector angle is directly used as the initial target display device. If it is unsuccessful to find the target vector angles within the preset first angle range among the vector angles, the preset first angle range is adjusted to a preset second angle range based on a preset offset angle range. The preset second angle range is larger than the preset first angle range to find the initial target display device in a larger angle range. Then, the display devices corresponding to the vector angles within the preset second angle range are used as the initial target display devices. For example, assuming the first angle range is 0 to 30 degrees and the preset offset angle range is 0 to 20 degrees, then if a preset offset angle of 20 degrees is selected within the preset offset angle range, the second angle range is 0 to 50 degrees.
[0114] This application provides a method for selecting a target display device that meets the information clarity display conditions corresponding to the signal input party based on directional positioning information and distance information. Specifically, based on the first positioning information, the orientation of the first positioning point relative to the signal input party is calculated to obtain first directional positioning information. Then, the orientation of each second positioning point relative to its corresponding display screen is calculated to obtain second directional positioning information. Finally, the distance between the first positioning point and each second positioning point is calculated to obtain distance positioning information. Based on the first directional positioning information, each second directional positioning information, and each distance positioning information, a target display device that meets the information clarity display conditions is selected from among the display devices. This achieves the goal of selecting a target display device with the most suitable orientation and distance for displaying information to the signal input party. By selecting the most suitable display device, input device, and signal input party to establish a temporary binding relationship, the purpose of establishing a temporary binding relationship between the signal input party, input device, and display device based on distance and direction positioning information is achieved. Since the binding relationship is temporary, when the signal input party does not input a signal through the input device, the binding relationship between the signal input party, the input device, and the target display device can be released at any time. Conversely, when the signal input party inputs a signal through the input device, a new target display device can be selected and a new temporary binding relationship can be established. This lays the foundation for overcoming the technical defect that when the signal input party is not using the input device, the one-to-one binding of the signal input party, input device, and display device would lead to resource waste due to mutual resource occupation among the signal input party, input device, and display device.
[0115] Furthermore, referring to Figure 3 Based on the first and second embodiments of this application, in another embodiment of this application, the information display conditions include distance selection conditions, the second positioning information includes at least a first positioning location point, the third positioning information includes at least a second positioning location point, and the display device includes at least a display screen.
[0116] The step of selecting a target display device that meets the information clear display conditions corresponding to the signal input party from among the display devices based on the first positioning information, the second positioning information, and each of the third positioning information includes:
[0117] Step C10: Calculate the distance between the first positioning point and each of the second positioning points to obtain the distance positioning information;
[0118] In this embodiment, the distance between the first positioning point and each of the second positioning points is calculated to obtain distance positioning information. Specifically, based on the positioning coordinates corresponding to the first positioning point and the positioning coordinates corresponding to each of the second positioning points, the distance between the first positioning point and each of the second positioning points is calculated to obtain the distance between each positioning point, and the distance between the positioning points is used as distance positioning information.
[0119] Step C20: Based on the distance positioning information, select a target display device that meets the distance selection criteria from among the display devices.
[0120] In this embodiment, based on the distance positioning information, a target display device that meets the distance selection conditions is selected from the display devices. Specifically, the shortest distance between the location points is selected, and the display device corresponding to the shortest distance is taken as the target display device. This ensures that the distance between the target display device and the input device is minimized. Since the signal input party inputs the signal at the input device, the distance between the signal input party and the target display device is sufficiently short, allowing the target display device to clearly display information to the signal input party within a suitable distance.
[0121] This application provides a method for selecting a target display device that meets the information clear display conditions corresponding to the signal input party based on distance information. Specifically, it first calculates the distance between the first positioning point and each of the second positioning points to obtain distance positioning information. Then, based on the distance positioning information, it selects a target display device that meets the distance selection conditions from among the display devices. This achieves the purpose of selecting a target display device with the most suitable distance for displaying information to the signal input party, thereby establishing a temporary binding relationship between the most suitable display device, input device, and signal input party. This realizes the temporary establishment of a signal input party and input device relationship based on distance information. The purpose of this temporary binding relationship between the signal input device and the display device is that, since the binding relationship is temporary, when the signal input party does not input a signal through the input device, the binding relationship between the signal input party, the input device, and the target display device can be released at any time. When the signal input party inputs a signal through the input device, the target display device can be reselected at any time, and the temporary binding relationship can be re-established. This lays the foundation for overcoming the technical defect that when the signal input party is not using the input device, the one-to-one binding of the signal input party, the input device, and the display device will cause the signal input party, the input device, and the display device to occupy resources and thus waste resources.
[0122] Furthermore, Figure 4This application illustrates a schematic diagram showing the determination of a corresponding target display device based on distance and / or orientation in an embodiment of this application; as shown... Figure 4 As shown, the first positioning point b from the first positioning information of the valid input device and the second positioning point a from the second positioning information of each display device are extracted respectively; to simplify the image, Figure 4 The document only provides a second positioning point 'a' in the second positioning information of a display device. The display device is suspended above the input device, and the display screen of the display device faces the ground to facilitate the user's viewing of the content displayed on the screen.
[0123] exist Figure 4 In this process, based on the first positioning point b of the effective input device and the second positioning point a of the display device, the distance d from the first positioning point b to the second positioning point a of each display device can be calculated; the display device corresponding to the minimum distance can be determined as the target display device corresponding to the effective input device.
[0124] exist Figure 4 In the process, the first directional positioning information of the valid input device and the second directional positioning information corresponding to each of the display devices can be obtained simultaneously; before determining the display device corresponding to the minimum distance as the target display device corresponding to the valid input device, an initial target display device is determined based on the first directional positioning information and the second directional positioning information corresponding to each display device; among the initial target display devices, the display device corresponding to the minimum distance is selected and determined as the target display device corresponding to the valid input device.
[0125] exist Figure 4 In the process, when the signal input is a user, before selecting a target display device that meets the information clear display conditions corresponding to the signal input from among the display devices, the first directional positioning information and each second directional positioning information are determined. The determination method includes: obtaining the user's location, the first positioning position point b, and the second positioning position point a corresponding to each display device; taking the user's location as the user's position plane B (the front of plane B can be the user's chest, and the back can be the user's back), generating a first direction vector perpendicular to the user's position plane B based on the first positioning position point b. Obtain the first direction positioning information; using the display screen A of each of the display devices as the display plane, generate a second direction vector perpendicular to the display screen A based on the second positioning position point a. The second direction positioning information is obtained. Specifically, the user position plane B obtained from the user's location is the plane formed along the top of the human body to the bottom of the body, and the plane obtained from the display screen A of the display device is the display plane where the display screen is located; the first direction vector The normal vector is the plane B at the user's location, and the second direction vector is... This is the normal vector of the display plane obtained by the display screen A of the display device. Therefore, the first direction vector can be calculated separately in space. With the second direction vector The angle θ formed by the vectors is the second direction vector. Along counterclockwise and the first direction vector The resulting included angle θ.
[0126] exist Figure 4 If the included angle θ of the vectors is within a preset first angle range, then the display device corresponding to the second direction vector is determined as the initial target display device. There may be multiple initial target display devices, as long as the first direction vector... With each of the second direction vectors Display devices whose vector angle θ falls within a preset first angle range are considered initial target display devices. Based on this, a selection is made based on distance; among the initial target display devices, the display device with the smallest distance is selected as the target display device corresponding to the valid input device. The preset first angle range can be set to 0 to 20 degrees or 0 to 30 degrees, etc., and those skilled in the art can also set the preset first angle range according to actual needs.
[0127] However, if the included angle θ of the vector is outside the preset first angle range, it indicates that there is no corresponding initial target display device. In this case, the preset first angle range needs to be widened, and an acceptable display orientation is sufficient, rather than the optimal one. Then, the difference Δθ between the included angle θ and the upper or lower threshold of the preset first angle range is calculated, along with a preset offset angle range. If the difference Δθ is within the preset offset angle range, the display device corresponding to the difference Δθ is determined as the initial target display device. The preset offset angle range can be set to 0 to 10 degrees or 0 to 20 degrees, etc., and those skilled in the art can also set the preset offset angle range according to actual needs.
[0128] Meanwhile, there may be situations where all the differences are outside the preset offset angle range. In this case, the display device with the smallest difference Δθ needs to be identified as the display device to be rotated. The rotation direction of the display device to be rotated is controlled based on the sign of the difference Δθ, and the rotation angle of the display device to be rotated is determined based on the offset difference between the difference Δθ and the edge threshold of the preset offset angle range. The edge threshold of the preset offset angle range includes an upper threshold and a lower threshold of the preset offset angle range. For example, if the preset offset angle range is 0 to 30 degrees, then the upper threshold is 30 degrees and the lower threshold is 0 degrees. Thus, the rotated display device to be rotated is identified as the initial target display device.
[0129] In this application and its corresponding embodiments, when the included angle of the vectors is no longer within the preset first included angle range, the first direction vector can be used. With the second direction vector The vector angle θ is subtracted from the nearest boundary value (upper or lower threshold) within the preset first angle range to obtain the difference Δθ between the vector angle θ and the nearest boundary value. If the sign of the difference Δθ is positive, it indicates that the orientation of the display device to be rotated needs to be adjusted downwards (rotated). Based on the offset difference Δθ between the difference Δθ and the upper threshold of the preset offset angle range, the display device to be rotated is adjusted downwards (rotated). Simultaneously, the first direction vector is detected in real time. The second direction vector of the rotating display device The resulting vector angle θ is used to calculate the difference Δθ in real time until the offset difference Δ is less than 0 or the vector angle θ is within a preset first angle range. At this point, the downward adjustment (rotation) of the display device to be rotated is stopped, and the rotated display device is determined as the initial target display device. Similarly, if the sign of the difference Δθ is negative, it indicates that the orientation of the display device to be rotated needs to be adjusted (rotated) upward. Based on the offset difference Δθ and the lower threshold of the preset offset angle range, the display device to be rotated is adjusted (rotated) upward. During the adjustment, the first direction vector is detected in real time. The second direction vector of the rotating display device The resulting vector angle θ is used to calculate the difference Δθ in real time until the offset difference Δ is less than 0 or the vector angle θ is within the preset first angle range. Then, the downward adjustment (rotation) of the display device to be rotated is stopped, and the rotated display device is determined as the initial target display device.
[0130] Whether to stop adjusting (rotating) the display device until the offset difference Δ is less than 0, or to stop adjusting (rotating) the display device until the included vector angle θ is within a preset first angle range, needs to be determined manually. For example, if it is only necessary to adjust the display device to an acceptable offset angle range, the condition can be set to stop adjusting (rotating) the display device until the offset difference Δ is less than 0; if it is necessary to adjust the display device to the optimal range, the adjustment (rotation) of the display device can be stopped after the included vector angle θ is within the preset first angle range.
[0131] However, in this application and other possible embodiments, if the adjustment (rotation) of the display device to be rotated is stopped after the included vector angle θ is within the preset first included angle range, or if the offset difference Δ is less than 0, then step S30 is executed to establish a temporary binding relationship between the signal input party, the input device and the target display device as soon as possible.
[0132] Reference Figure 5 , Figure 5 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiments of this application.
[0133] like Figure 5 As shown, the multi-party relationship processing device may include: a processor 1001, such as a CPU, a memory 1005, and a communication bus 1002. The communication bus 1002 is used to establish communication between the processor 1001 and the memory 1005. The memory 1005 may be a high-speed RAM or a stable, non-volatile memory, such as a disk drive. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001.
[0134] Optionally, the multi-party relationship processing device may also include a rectangular user interface, a network interface, a camera, RF (Radio Frequency) circuitry, sensors, audio circuitry, a WiFi module, etc. The rectangular user interface may include a display screen and an input submodule such as a keyboard. Optionally, the rectangular user interface may also include a standard wired interface or a wireless interface. The network interface may optionally include a standard wired interface or a wireless interface (such as a WiFi interface).
[0135] Those skilled in the art will understand that Figure 5 The multi-party relationship processing device structure shown in the figure does not constitute a limitation on the multi-party relationship processing device. It may include more or fewer components than shown, or combine certain components, or have different component arrangements.
[0136] like Figure 5As shown, the memory 1005, as a computer storage medium, may include an operating system, a network communication module, and a multi-party relationship processing program. The operating system is a program that manages and controls the hardware and software resources of the multi-party relationship processing device, supporting the operation of the multi-party relationship processing program and other software and / or programs. The network communication module is used to enable communication between the various components within the memory 1005, as well as communication with other hardware and software in the multi-party relationship processing system.
[0137] exist Figure 5 In the multi-party relationship processing device shown, the processor 1001 is used to execute the multi-party relationship processing program stored in the memory 1005 to implement the steps of the multi-party relationship processing method described above.
[0138] The specific implementation of the multi-party relationship processing device in this application is basically the same as the embodiments of the multi-party relationship processing method described above, and will not be repeated here.
[0139] This application embodiment also provides a multi-party relationship processing apparatus, which is applied to a multi-party relationship processing device, and the multi-party relationship processing apparatus includes:
[0140] The acquisition module is used to acquire the first positioning information of the signal input party, the second positioning information corresponding to the input device, and the third positioning information corresponding to each display device;
[0141] The selection module is used to select a target display device that meets the information clear display conditions corresponding to the signal input party from among the display devices based on the first positioning information, the second positioning information and each of the third positioning information;
[0142] The relationship processing module is used to establish or terminate the temporary binding relationship between the signal input party, the input device, and the target display device.
[0143] Optionally, the second positioning information includes at least a first positioning location point, the third positioning information includes at least a second positioning location point, the display device includes at least a display screen, and the selection module is further configured to:
[0144] Based on the first positioning information, the orientation of the first positioning point relative to the signal input point is calculated to obtain the first direction positioning information;
[0145] Calculate the orientation of each second positioning point relative to its corresponding display screen to obtain positioning information for each second direction;
[0146] Calculate the distance between the first positioning point and each of the second positioning points to obtain the positioning information for each distance;
[0147] Based on the first direction positioning information, each of the second direction positioning information and each of the distance positioning information, a target display device that meets the conditions for clear information display is selected from each of the display devices.
[0148] Optionally, the information display conditions include orientation selection conditions and distance selection conditions, and the selection module is further used for:
[0149] Based on the first directional positioning information and each of the second directional positioning information, each initial target display device that meets the orientation selection conditions is selected from each of the display devices;
[0150] Based on the distance positioning information, a target display device that meets the distance selection criteria is selected from the initial target display devices.
[0151] Optionally, the first direction positioning information includes at least a first direction vector, the second direction positioning information includes at least a second direction vector, and the selection module is further configured to:
[0152] Calculate the vector angles between the first direction vector and each of the second direction vectors;
[0153] Based on the included angles of each vector and the preset first included angle range, each initial target display device that meets the orientation selection conditions is selected from among the display devices.
[0154] Optionally, the selection module is further configured to:
[0155] Find the angles of each target vector that fall within the preset first angle range among the angles of each vector;
[0156] If the search is successful, the display device corresponding to the included angle of each of the target vectors will be used as the initial target display device.
[0157] If the search fails, the preset first included angle range is adjusted to a preset second included angle range based on the preset offset angle range, and the display devices corresponding to the included angles of each vector within the preset second included angle range are taken as the initial target display devices.
[0158] Optionally, the relationship processing module is further configured to:
[0159] Establish a temporary binding relationship between the signal input party, the input device, and the target display device;
[0160] Detect whether the position information between the signal input point and the target display device matches the set position information;
[0161] If the location information does not match the set location information, then the temporary binding relationship between the signal input party, the input device, and the target display device is released;
[0162] If the location information matches the set location information, the temporary binding relationship between the signal input party, the input device, and the target display device will continue to be maintained.
[0163] Optionally, the multi-party relationship processing device is further used for:
[0164] Acquire image information in front of the target display device;
[0165] If the features of the image information match the features of the initial image information corresponding to the signal input device, then the temporary binding relationship between the signal input device, the input device, and the target display device will continue to be maintained.
[0166] If the features of the second image information do not match the features of the initial image information corresponding to the signal input party, then the temporary binding relationship between the signal input party, the input device, and the target display device is released.
[0167] Optionally, the acquisition module is further configured to:
[0168] Obtain the generation instructions corresponding to several input devices;
[0169] Valid instructions are determined from the generated instructions, and the input device corresponding to the valid instructions is taken as a valid input device.
[0170] The signal input source and the valid input device are located to obtain the first location information and the second location information.
[0171] Optionally, the acquisition module is further configured to:
[0172] Determine the type of input device corresponding to each of the generated instructions;
[0173] Based on the type, determine the preset feature extraction rules corresponding to each of the generation instructions;
[0174] Based on preset feature extraction rules, feature extraction is performed on the string text within each of the generated instructions to obtain each text feature;
[0175] The text features described are compared with the preset text features to obtain the comparison results;
[0176] Based on the comparison results, the valid instruction is determined from each of the generated instructions.
[0177] Optionally, the information display conditions include distance selection conditions, the second positioning information includes at least a first positioning location point, the third positioning information includes at least a second positioning location point, the display device includes at least a display screen, and the selection module is further configured to:
[0178] Calculate the distance between the first positioning point and each of the second positioning points to obtain the positioning information for each distance;
[0179] Based on the distance positioning information, a target display device that meets the distance selection criteria is selected from among the display devices.
[0180] Optionally, the information display conditions include orientation selection conditions, the second positioning information includes at least a first positioning point, the third positioning information includes at least a second positioning point, the display device includes at least a display screen, and the selection module is further configured to:
[0181] Based on the first positioning information, the orientation of the first positioning point relative to the signal input point is calculated to obtain the first direction positioning information;
[0182] Calculate the orientation of each second positioning point relative to its corresponding display screen to obtain positioning information for each second direction;
[0183] Based on the first directional positioning information and each of the second directional positioning information, a target display device that meets the orientation selection conditions is selected from among the display devices.
[0184] The specific implementation of the multi-party relationship processing device of this application is basically the same as the embodiments of the multi-party relationship processing method described above, and will not be repeated here.
[0185] This application provides a readable storage medium that stores one or more programs, which can be executed by one or more processors to implement the steps of the multi-party relationship processing method described above.
[0186] The specific implementation of the readable storage medium in this application is basically the same as the embodiments of the multi-party relationship processing method described above, and will not be repeated here.
[0187] This application provides a computer program product, which includes one or more computer programs. The one or more computer programs can be executed by one or more processors to implement the steps of the multi-party relationship processing method described above.
[0188] The specific implementation of the computer program product in this application is basically the same as the embodiments of the above-described multi-party relationship processing method, and will not be repeated here.
[0189] The above are merely preferred embodiments of this application and do not limit the patent scope of this application. Any equivalent structural or procedural transformations made using the content of this application's specification and drawings, or direct or indirect applications in other related technical fields, are similarly included within the patent scope of this application.
Claims
1. A multi-party relationship processing method, characterized by, The multi-party relationship processing method includes: Acquire the first positioning information of the signal input party, the second positioning information corresponding to the input device, and the third positioning information corresponding to each display device; Based on the first positioning information, the second positioning information, and each of the third positioning information, a target display device that meets the information clear display conditions corresponding to the signal input party is selected from among the display devices; Establish or terminate a temporary binding relationship between the signal input party, the input device, and the target display device; The second positioning information includes at least one first positioning location point, the third positioning information includes at least one second positioning location point, and the display device includes at least one display screen. The step of selecting a target display device that meets the information clear display conditions corresponding to the signal input party from among the display devices based on the first positioning information, the second positioning information, and each of the third positioning information includes: Based on the first positioning information, the orientation of the first positioning point relative to the signal input point is calculated to obtain the first direction positioning information; Calculate the orientation of each second positioning point relative to its corresponding display screen to obtain positioning information for each second direction; Calculate the distance between the first positioning point and each of the second positioning points to obtain the positioning information for each distance; Based on the first direction positioning information, each of the second direction positioning information and each of the distance positioning information, a target display device that meets the conditions for clear information display is selected from each of the display devices; The information clearly displays the conditions, including orientation selection conditions and distance selection conditions. The step of selecting a target display device that meets the information clear display condition from among the display devices based on the first direction positioning information, each of the second direction positioning information, and each of the distance positioning information includes: Based on the first directional positioning information and each of the second directional positioning information, each initial target display device that meets the orientation selection conditions is selected from each of the display devices; Based on the distance positioning information, a target display device that meets the distance selection criteria is selected from the initial target display devices; The first direction positioning information includes at least a first direction vector, and the second direction positioning information includes at least a second direction vector. The step of selecting initial target display devices that meet the orientation selection conditions from among the display devices based on the first orientation positioning information and each of the second orientation positioning information includes: Calculate the vector angles between the first direction vector and each of the second direction vectors; Based on the included angles of each vector and the preset first included angle range, select each initial target display device that meets the orientation selection conditions from among the display devices; The step of selecting initial target display devices that meet the orientation selection conditions from among the display devices based on the included angles of each vector and a preset included angle range includes: Find the angles of each target vector that fall within the preset first angle range among the angles of each vector; If the search is successful, the display device corresponding to the included angle of each of the target vectors will be used as the initial target display device. If the search fails, the preset first included angle range is adjusted to a preset second included angle range based on the preset offset angle range, and the display devices corresponding to the included angles of each vector within the preset second included angle range are taken as the initial target display devices.
2. The multi-party relationship processing method as described in claim 1, characterized in that, The step of establishing or de-binding the temporary binding relationship between the signal input party, the input device, and the target display device further includes: Establish a temporary binding relationship between the signal input party, the input device, and the target display device; Detect whether the position information between the signal input point and the target display device matches the set position information; If the location information does not match the set location information, then the temporary binding relationship between the signal input party, the input device, and the target display device is released; If the location information matches the set location information, the temporary binding relationship between the signal input party, the input device, and the target display device will continue to be maintained.
3. The multi-party relationship processing method as described in claim 2, characterized in that, After the step of establishing a temporary binding relationship among the signal input party, the input device, and the target display device, the multi-party relationship processing method further includes: Acquire image information in front of the target display device; If the features of the image information match the features of the initial image information corresponding to the signal input device, then the temporary binding relationship between the signal input device, the input device, and the target display device will continue to be maintained. If the characteristics of the image information do not match the characteristics of the initial image information corresponding to the signal input party, then the temporary binding relationship between the signal input party, the input device, and the target display device is released.
4. The multi-party relationship processing method as described in claim 1, characterized in that, The steps of acquiring the first positioning information of the signal input party and the second positioning information corresponding to the input device include: Obtain the generation instructions corresponding to several input devices; Valid instructions are determined from the generated instructions, and the input device corresponding to the valid instructions is taken as a valid input device. The signal input source and the valid input device are located to obtain the first location information and the second location information.
5. The multi-party relationship processing method as described in claim 4, characterized in that, The step of determining valid instructions from the generated instructions includes: Determine the type of input device corresponding to each of the generated instructions; Based on the type, determine the preset feature extraction rules corresponding to each of the generation instructions; Based on preset feature extraction rules, feature extraction is performed on the string text within each of the generated instructions to obtain each text feature; The text features described are compared with the preset text features to obtain the comparison results; Based on the comparison results, the valid instruction is determined from each of the generated instructions.
6. A multi-party relationship processing device, characterized in that, The multi-party relationship processing device includes: a memory, a processor, and a program stored in the memory for implementing the multi-party relationship processing method. The memory is used to store programs that implement multi-party relationship processing methods; The processor is configured to execute a program that implements the multi-party relationship processing method to implement the steps of the multi-party relationship processing method as described in any one of claims 1 to 5.
7. A readable storage medium, characterized in that, The readable storage medium stores a program implementing a multi-party relationship processing method, which is executed by a processor to implement the steps of the multi-party relationship processing method as described in any one of claims 1 to 5.
8. A program product, said program product being a computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the multi-party relationship processing method as described in any one of claims 1 to 5.
Citation Information
Patent Citations
Augmented reality display method and device for indoor environment and terminal equipment
CN111028358A
Symbol identification method, apparatus, device, and storage medium
WO2020082562A1