Visual auxiliary screen matching method and device, terminal equipment and storage medium

By generating a 3D real-world model of the display screen and determining the cabinet topology, the complex screen configuration problem in multi-screen splicing is solved, realizing an intuitive configuration process and improving the efficiency and accuracy of multi-screen splicing.

CN115712403BActive Publication Date: 2026-01-02XIAN NOVASTAR TECH
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202211411459.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-11-11
Publication Date
2026-01-02
Estimated Expiration
2042-11-11

AI Technical Summary

Technical Problem

In existing technologies, when multiple screens are spliced ​​together to form a three-dimensional screen, the topological configuration of the display cabinet is complex and difficult, making it difficult to achieve effective screen matching in different two-dimensional planes.

Method used

By acquiring the spatial data of the display screen, a 3D real-scene model is generated and displayed in the visual display configuration interface. It responds to the user's configuration of the target display screen cabinet model and determines the topological relationship between the cabinets to assist in the display configuration.

Benefits of technology

It enables intuitive operation of the display cabinet topology in a visual interface, simplifies the configuration process, and improves the efficiency and accuracy of multi-screen splicing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115712403B_ABST
    Figure CN115712403B_ABST
Patent Text Reader

Abstract

The application is suitable for the technical field of display, and provides a visual auxiliary screen matching method and device, a terminal device and a storage medium. The visual auxiliary screen matching method is applied to a terminal device connected with multiple display screens. The multiple display screens are in a preset space. Each display screen includes multiple boxes. The visual auxiliary screen matching method includes: acquiring spatial data of the multiple display screens; generating a three-dimensional real scene model including the multiple display screens according to the spatial data, and displaying the three-dimensional real scene model in a visual screen matching interface; and in response to a box model configuration of a target display screen in the three-dimensional real scene model, determining a topological relationship between the multiple boxes of the target display screen, so as to assist the target display screen in screen matching. The above scheme can display the generated three-dimensional real scene model in the visual screen matching interface, facilitate intuitive operation of the generated three-dimensional real scene model by a user, and solve the problem that a complex operation leads to difficult topological relationship configuration.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of display, and particularly relates to a visual auxiliary screen matching method and device, a terminal device and a storage medium. BACKGROUND

[0002] With the continuous integration and development of liquid crystal splicing technology and control technology, large screens formed by multi-screen splicing have been widely applied. In actual application, in order to ensure that the display content on the large screen formed by splicing is correct, it is usually necessary to match the screen of the large screen, that is, to perform display screen box topology configuration. In the prior art, the topology relationship of multiple boxes is usually arranged in a two-dimensional plane to preview the display effect of the large screen after the current arrangement.

[0003] If multiple display screens need to form a three-dimensional screen located in different two-dimensional planes to display a complete picture, for example, a complete picture needs to be displayed on the sky screen, the ground screen and other angle display screens in a three-dimensional space, at this time, screen matching needs to be performed in different two-dimensional planes, and multiple times of adjustment of multiple boxes of a display screen are necessary, which is complex in operation and difficult in configuration. SUMMARY

[0004] The embodiments of the present application provide a visual auxiliary screen matching method and device, a terminal device and a storage medium, which can realize visual screen matching in any environment and solve the problem of difficult configuration caused by complex operation in an intuitive manner.

[0005] The first aspect of the embodiments of the present application provides a visual auxiliary screen matching method applied to a terminal device connected to multiple display screens, the multiple display screens being located in a preset space, each display screen including multiple boxes, and the visual auxiliary screen matching method comprising:

[0006] obtaining spatial data of the multiple display screens;

[0007] generating a three-dimensional real scene model containing the multiple display screens according to the spatial data and displaying the three-dimensional real scene model in a visual screen matching interface;

[0008] determining a topology relationship between multiple boxes of a target display screen in the three-dimensional real scene model in response to box model configuration of the target display screen, to assist the target display screen in screen matching.

[0009] The second aspect of the embodiments of the present application provides a visual auxiliary screen matching device coupled to a terminal device connected to multiple display screens, the multiple display screens being located in a preset space, each display screen including multiple boxes, and the visual auxiliary screen matching device comprising:

[0010] acquire spatial data of the plurality of display screens;

[0011] generate a three-dimensional real scene model including the plurality of display screens according to the spatial data, and display the three-dimensional real scene model in a visual screen matching interface;

[0012] determine a topological relationship between a plurality of boxes of a target display screen in the three-dimensional real scene model according to a box model configuration of the target display screen, to assist the target display screen in screen matching.

[0013] A third aspect of the embodiment of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the visual auxiliary screen matching method in the first aspect when executing the computer program.

[0014] A fourth aspect of the embodiment of the present application provides a computer readable storage medium, and the computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the visual auxiliary screen matching method in the first aspect.

[0015] A fifth aspect of the embodiment of the present application provides a computer program product, and when the computer program product is executed on a terminal device, the terminal device executes the visual auxiliary screen matching method in the first aspect.

[0016] Compared with the prior art, the embodiment of the present application has the following beneficial effects:

[0017] After acquiring the spatial data of the plurality of display screens, the three-dimensional real scene model including the plurality of display screens is generated according to the spatial data, and the three-dimensional real scene model is displayed in the visual screen matching interface. Then, the topological relationship between the plurality of boxes of the target display screen is determined according to the box model configuration of the target display screen in the three-dimensional real scene model, to assist the target display screen in screen matching. The above scheme can display the generated three-dimensional real scene model in the visual screen matching interface, facilitate the user to intuitively operate the generated three-dimensional real scene model, and solve the problem that the complex operation leads to difficult configuration of the topological relationship. BRIEF DESCRIPTION OF DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings needed to be used in the embodiments or prior art description. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0019] Figure 1is an application scenario provided by an embodiment of the present application;

[0020] Figure 2 is a flow diagram of a visual auxiliary screen matching method provided by an embodiment one of the present application;

[0021] Figure 3 is a flow diagram of a visual auxiliary screen matching method provided by an embodiment two of the present application;

[0022] Figure 4 is a structural diagram of a visual auxiliary screen matching device provided by an embodiment three of the present application;

[0023] Figure 5 is a structural diagram of a terminal device provided by an embodiment four of the present application. DETAILED DESCRIPTION

[0024] In the following description, for the purpose of explanation and not limitation, specific details are set forth, such as particular system configurations, techniques, etc., in order to provide a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application can be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

[0025] It should be understood that the display screen in the present application can be an LCD display screen, an LED display screen, an OLED display screen, etc. capable of being used for display. Taking an LED display screen as an example, the LED display screen can be a common LED display screen, a microLED display screen or a miniLED display screen, or a new type of LED display screen in the future. Further, in some embodiments, the packaging method of the LED display screen can also be one of the following packaging methods: for example, surface mounted technology (SMT), chips on board (COB), chip on glass (COG), or a new packaging method in the future.

[0026] It should be understood that the terminal device in the present application can include a host computer and a display control device, the host computer of which can refer to screen matching software on the terminal device, and the display control device of which can refer to a sending card or a sending device. The sending card sends configuration information containing the topological relationship between the multiple cabinets of the target display screen to the host computer controlling the display screen, so that the multiple cabinets of the target display screen adjust their own configurations and display the input source after display.

[0027] It should be understood that the word “comprise” or variations such as “comprises” or “comprising”, when used in this specification and in the accompanying claims, specify the presence of stated features, integers, steps, operations, elements, components and / or groups but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups thereof.

[0028] It should also be understood that the term “and / or” when used in this specification and in the following claims is to be interpreted as “one or the other or both” and / or “any combination of the items in the list”. It should be understood that the terms “a” and “an” as used in this specification and in the following claims indicate “one or more”.

[0029] As used in this specification and in the claims, the terms “if’ and “when” can be interpreted to mean “upon” or “in response to a determination” or “in response to a detection” depending on the context. Similarly, the phrase “if it is determined” or “if [a described condition or event] is detected” can be interpreted to mean “upon a determination” or “in response to a determination” or “upon detecting [a described condition or event]” or “in response to detecting [a described condition or event]”, depending on the context.

[0030] In addition, the terms “first”, “second”, “third”, etc. as used in the description of the application and the following claims are only used to distinguish descriptions and cannot be understood as indicating or implying relative importance.

[0031] Reference in the specification to “one embodiment” or “some embodiments” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the application. The appearances of the phrases “in one embodiment”, “in some embodiments”, “in other embodiments”, “in additional embodiments”, etc. in various places in the specification are not necessarily all referring to the same embodiment, although they can. The terms “comprise”, “comprises”, “comprising”, “include”, “includes”, “including” and the like are synonymous with “containing” or “comprising”, unless otherwise indicated. The use of the terms “comprise”, “comprises”, “comprising”, “include”, “includes”, “including” and the like are not intended to exclude other features, integers, steps, operations, elements, components and / or groups thereof.

[0032] The visual auxiliary screen matching method provided by the embodiments of the present application can be applied to a terminal device connected with multiple display screens, wherein the multiple display screens are in a preset space, and each display screen includes multiple cabinets.

[0033] Referring to Figure 1 An application scenario provided by the embodiments of the present application is shown in FIG. 1. As shown in FIG. 1, a terminal device 100 is connected with multiple display screens 110, and the multiple display screens 110 are in a preset space. Figure 1As shown, the terminal device can be connected with the input source and multiple display screens in a preset space, and the terminal device can include a host computer and a display control device. The visual auxiliary screen matching method provided by the embodiment of the application can obtain the space data of the multiple display screens by operating the host computer, and generate a three-dimensional real scene model including the multiple display screens by using a VR display module in the host computer according to the obtained space data, and display the three-dimensional real scene model in a visual screen matching interface. After the three-dimensional real scene model (for example, a VR real scene model) of the multiple display screens is displayed in the visual screen matching interface of the terminal device, since the multiple display screens are in the same preset space and the display screens are composed of multiple cabinets, the user can first select a target display screen in the three-dimensional real scene model, and configure the cabinet models constituting the target display screen, that is, configure the topological relationship between the cabinets. Then, the terminal device can obtain configuration information including the topological relationship between the multiple cabinets in response to the configuration of the cabinet models of the target display screen (for example, the user's configuration of the cabinet models of the target display screen). The host computer and the display control device can send the configuration information to the target display screen on site, so as to adjust the topological relationship between the multiple cabinets constituting the target display screen on site, thereby achieving the purpose of assisting the target display screen in screen matching.

[0034] The host computer can be a screen matching software on the terminal device.

[0035] The terminal device generally refers to various terminal devices such as a personal computer (PC), a tablet computer, a personal digital assistant (PDA), a mobile internet device (MID), and the like, which can run the visual auxiliary screen matching method program, and the embodiment of the application is not limited thereto.

[0036] It should be understood that Figure 1 To realize one application scenario of the visual auxiliary screen matching method provided by the embodiment of the application, the hardware architecture of the application scenario is only an example, and the visual auxiliary screen matching method provided by the embodiment of the application can also be realized by other hardware architectures, and the application is not limited thereto.

[0037] The visual auxiliary screen matching method provided by the embodiment of the application is implemented as follows:

[0038] The input source display sub-region is arranged in the screen matching software. The screen matching software can acquire spatial data of a plurality of display screens scanned by the 3D scanning software, and then generate a VR real scene model including the plurality of display screens by using a VR display module in the screen matching software according to the spatial data, and display the VR real scene model in a screen matching interface of the screen matching software for user configuration. When the user configures, the user can combine the input source with the VR real scene model to obtain a VR real scene model of the plurality of display screens containing images. The user can configure a plurality of box models of a target display screen selected in the VR real scene model according to a desired display effect, and then obtain configuration information (such as position, rotation angle, and wiring relationship, etc.) of a plurality of boxes of the target display screen constructed on site according to the configuration of each box model, determine the topological relationship between the plurality of boxes constituting the target display screen, and send the configuration information containing the topological relationship between the plurality of boxes to the display screen control device, so that the display screen control device adjusts the topological relationship between the plurality of boxes of the target display screen according to the received configuration information, and realizes visual auxiliary screen matching through the VR real scene model of the plurality of display screens displayed in the screen matching interface.

[0039] The following will be based on the above Figure 1 The application examples provide a visual auxiliary screen matching method. The application examples provide a visual auxiliary screen matching method.

[0040] It should be understood that the size of the serial number of each step in the embodiment does not mean the order of execution, and the execution order of each process should be determined according to its function and inherent logic, and should not constitute any limitation on the implementation process of the application examples.

[0041] Referring to Figure 2 , a flowchart of a visual auxiliary screen matching method provided by an application example is shown. As Figure 2 indicated, the visual auxiliary screen matching method can include the following steps:

[0042] Step 201, acquiring spatial data of a plurality of display screens.

[0043] It should be noted that the visual auxiliary screen matching method of the application examples can be executed by the visual auxiliary screen matching device of the application examples. The visual auxiliary screen matching device of the application examples can be configured in a terminal device connected to a plurality of display screens to execute the visual auxiliary screen matching method of the application examples. For example, the device of the application examples can be configured in the host computer software of the terminal device, and the application examples are not limited thereto.

[0044] The multiple display screens can be multiple display screens in a same preset space. It should be noted that the multiple display screens in the same preset space can have display surfaces in different two-dimensional planes, for example, the multiple display screens are respectively a sky screen and a ground screen in the preset space. The display surfaces of the multiple display screens are in different two-dimensional planes, so that the method of the embodiment of the present application is more comprehensive.

[0045] The space data can be original data obtained by using a three-dimensional scanning device to scan. For example, a three-dimensional scanner obtains shape and spatial position data of a box of each display screen by scanning the multiple display screens in the preset space. It should be noted that the space data, also referred to as geometric data, is used to represent information such as position, shape, size distribution, and the like of an object. In the embodiment of the present application, the space data of the display screen can include shape data and / or position data of the box constituting the display screen.

[0046] In the embodiment of the present application, the multiple display screens can be scanned by using 3D scanning software. Since each display screen includes multiple boxes, shape data and / or position data of the multiple boxes constituting the display screen can be generated. Then, the terminal device can obtain the space data by data transmission. That is, the terminal device automatically obtains the shape data and / or position data of the multiple boxes in each display screen in the 3D scanning software by real-time scanning of the 3D scanning software when new scanning data is added in the 3D scanning software. Alternatively, the 3D scanning software imports the scanning data to the terminal device, that is, the terminal device does not need to monitor the 3D scanning software in real time, and only needs to select whether to respond when the 3D scanning software imports the scanning data to the terminal device. The position data can include three-dimensional spatial coordinates.

[0047] As a possible implementation manner, the terminal device can automatically obtain three-dimensional spatial coordinates of the multiple boxes in each display screen scanned by the three-dimensional scanning device. For example, the 3D scanning software scans the multiple display screens in the preset space, stores the obtained data in the 3D scanning software, and the terminal device monitors the 3D scanning software in real time. After detecting that new scanning data is stored in the 3D scanning software, the terminal device automatically extracts the new scanning data to the screen matching software of the terminal device, so that the screen matching software generates a corresponding three-dimensional real scene model according to the obtained data.

[0048] As a possible implementation manner, the spatial data of the plurality of boxes in each display screen imported by the scanning device can also be received in response to a data import instruction of the scanning device. For example, the plurality of display screens are scanned by the 3D scanning software, and the scanned data is stored in the 3D scanning software. After detecting that new scanning data is stored in the 3D scanning software, the 3D scanning software can send a data import instruction to the terminal device. After receiving the response of the terminal device, the scanning data stored in the 3D scanning software is imported into the screen matching software of the terminal device. The terminal device receives the scanning data imported by the 3D scanning software, so that the screen matching software generates a corresponding three-dimensional real scene model according to the obtained data.

[0049] In step 202, a three-dimensional real scene model containing a plurality of display screens is generated according to the spatial data, and is displayed in a visual screen matching interface.

[0050] The plurality of display screens can be display screens in the same preset space. It should be noted that the display surfaces of the plurality of display screens can be in the same two-dimensional plane, or can be in different two-dimensional planes. The position and orientation of the display surfaces of the plurality of display screens are not limited in the present application.

[0051] The three-dimensional real scene model can be a VR real scene model. It should be noted that in the process of generating a VR real scene model, three-dimensional data of an actual environment is first obtained, and then a corresponding real scene model is established according to the needs of the application. The corresponding real scene model can be established according to the needs of the application by embedding a VR display module in the screen matching software.

[0052] The visual screen matching interface can be a screen matching interface of the screen matching software. It should be noted that the visual screen matching interface includes a VR display interface, which can be displayed by the VR display module. The visual screen matching interface also includes at least an input source display sub-region. The terminal device can obtain the input sources of the plurality of display screens and display the input sources in the input source display sub-region. When the three-dimensional real scene model displayed in the VR display interface is configured, the input sources can be displayed in each display screen model in the three-dimensional real scene model, so as to preview the effect diagram of the plurality of display screens displaying corresponding input sources in the preset space.

[0053] As a possible implementation manner, after the spatial data is acquired, the screen matching software in the terminal device can construct a three-dimensional model of the plurality of display screens according to the spatial data. Since each display screen is composed of a plurality of cabinets, the three-dimensional model of each display screen includes three-dimensional models of the plurality of cabinets. Since the spatial data includes position data of the plurality of cabinets, according to the position data and the three-dimensional models of the plurality of cabinets constituting the display screen, the three-dimensional models of the plurality of cabinets can be placed according to the actual positions to generate a three-dimensional model of the display screen same as the actual environment position. Then, the same operation is performed on the cabinets in the plurality of display screens to generate a plurality of three-dimensional models of the display screens same as the actual environment position. According to the plurality of three-dimensional models of the display screens same as the actual environment position, a three-dimensional real scene model of the plurality of display screens same as the actual environment position can be finally generated.

[0054] As a possible implementation manner, a specific mark can also be arranged on the surface of the display screen in the actual environment on site, for example, a specific mark is pasted around the display screen, that is, each display screen surface has a unique corresponding mark. When the three-dimensional real scene model of the plurality of display screens same as the actual environment position is generated according to the three-dimensional models of the plurality of display screens, the following manner can be adopted:

[0055] identifying the mark of each display screen;

[0056] automatically marking the three-dimensional models of the plurality of display screens according to the identified mark of each display screen to obtain the mark of the three-dimensional model of each display screen;

[0057] determining the positions of the three-dimensional models of the plurality of display screens in the three-dimensional real scene model according to the mark of the three-dimensional model of each display screen, and generating the three-dimensional real scene model corresponding to the preset space.

[0058] It should be understood that since each display screen has a unique mark, when the three-dimensional real scene model is displayed in the visual screen matching interface, each display screen in the three-dimensional real scene model also has a mark based on the mark of the display screen. The user can determine the correspondence between the three-dimensional model of the display screen and the display screen on site according to the mark.

[0059] It should be understood that since each display screen has a unique mark, when the three-dimensional real scene model is displayed in the visual screen matching interface, each display screen in the three-dimensional real scene model also has a mark based on the mark of the display screen. The user can determine the correspondence between the three-dimensional model of the display screen and the display screen on site according to the mark.

[0060] In step 203, in response to the cabinet model configuration of the target display screen in the three-dimensional real scene model, the topological relationship between the plurality of cabinets of the target display screen is determined to assist the target display screen in screen matching.

[0061] The box model configuration of the target display screen in the three-dimensional real scene model can refer to that the user edits the three-dimensional real scene model displayed in the visual screen matching interface. For example, by clicking any three-dimensional model corresponding to a display screen in the three-dimensional real scene model, the position, angle and wiring relationship of the three-dimensional model corresponding to the box in the display screen can be edited. In response to the configuration, the screen matching software can pop up an interface for viewing and editing the topologies of the multiple box models included in the three-dimensional model when the user clicks any three-dimensional model corresponding to a display screen. After editing is completed, the three-dimensional real scene model will be changed according to the user's operation, which facilitates the user to intuitively preview the topologies between the boxes of each display screen in the entire preset space without switching two-dimensional planes and editing in each two-dimensional plane, and can improve the efficiency of screen matching.

[0062] As a possible implementation manner, the target display screen can be selected in the visual interface in response to the configuration instruction, and each box model constituting the target display screen is configured. The position, angle and wiring of each box corresponding three-dimensional model are configured, and the position relationship, angle relationship and wiring relationship between the three-dimensional models corresponding to each box are determined. Then, the topological relationship between each box is determined according to the position relationship, angle relationship and wiring relationship between the three-dimensional models corresponding to each box.

[0063] It should be understood that the user can select any display screen as the target display screen, and can determine the topological relationship between each box constituting the target display screen based on the above operation, and then the topological relationship between the multiple boxes of each display screen in the preset space can be determined.

[0064] The topological relationship can include the position relationship, the angle relationship and the wiring relationship.

[0065] The box model can refer to the three-dimensional model corresponding to the box.

[0066] For example, after the three-dimensional real scene model including the plurality of display screens is displayed on the screen matching interface, a user can click the three-dimensional model corresponding to one of the display screens, and the display screen is the target display screen. After the topology editing interface is popped up, the position, angle, and wiring of the three-dimensional model corresponding to each cabinet of the target display screen can be configured. The terminal device adjusts the topology structure of the three-dimensional model corresponding to each cabinet in the three-dimensional real scene model in response to the configuration of the user, and displays the topology structure. The position relationship, angle relationship, and wiring relationship between the three-dimensional models corresponding to each cabinet can be determined according to the above method. Then, because the three-dimensional real scene model is completely corresponding to the plurality of display screens in the preset space, the topology relationship between the cabinets can be determined according to the position relationship, angle relationship, and wiring relationship between the three-dimensional models corresponding to each cabinet. In this way, the topology relationship between each cabinet in the target display screen is determined. The user can perform the same operation on the plurality of display screens. Then, the terminal device can configure the plurality of display screens in the preset space according to the topology relationship between the cabinets corresponding to each display screen.

[0067] As a possible implementation, after the topology relationship between the cabinets corresponding to each display screen is determined, if it is desired to adjust the topology structure of each display screen in the field, configuration information including the topology relationship can be generated according to the topology relationship between the cabinets of each display screen. Then, the configuration information is sent to a control device (i.e., a display screen control device) that controls the display screen, so that each cabinet of each display screen adjusts its own configuration to complete the adjustment of the topology structure of the plurality of display screens in the preset space. After the adjustment, the corresponding input source is displayed, and the screen matching operation of each display screen can be completed.

[0068] After the spatial data of the plurality of display screens is obtained, the embodiment of the present application can generate a three-dimensional real scene model including the plurality of display screens according to the spatial data, and display the three-dimensional real scene model in the visual screen matching interface. Then, the topology relationship between the plurality of cabinets of the target display screen is determined in response to the cabinet model configuration of the target display screen in the three-dimensional real scene model, to assist the target display screen in screen matching. The above scheme can display the generated three-dimensional real scene model in the visual screen matching interface, so that the user can intuitively operate the generated three-dimensional real scene model, and the problem of difficult topology relationship configuration caused by complex operation is solved.

[0069] Referring to Figure 3 , a flowchart of a visual auxiliary screen matching method provided by an embodiment of the present application is shown. As Figure 3 indicated, the visual auxiliary screen matching method can include the following steps:

[0070] In step 301, spatial data of a plurality of display screens and environmental spatial data of an environment surrounding the plurality of display screens in a preset space are obtained.

[0071] The preset space can be a three-dimensional space in which the plurality of display screens are located. It should be noted that if the plurality of display screens are installed outdoors, the range of the preset space can be freely set, and the present application does not limit this. If the plurality of display screens are installed indoors, the range of the preset space should be the range of the space constituted by the enclosed indoor space, because in the enclosed indoor space, the adjustment range of the cabinet topology structure of the plurality of display screens is limited, and therefore the range of the preset space needs to be set as the range of the space constituted by the enclosed indoor space.

[0072] The environmental space data can be space data of an environment surrounding the plurality of display screens, such as space data of obstacles in the surrounding environment.

[0073] As a possible implementation manner, the method for acquiring the environmental space data of the environment surrounding the plurality of display screens is the same as the method for acquiring the space data of the plurality of display screens in Embodiment 1, and details are not described herein again. For details, refer to the method for acquiring the space data of the plurality of display screens in Embodiment 1.

[0074] For example, in Embodiment 1, the space data of the plurality of display screens is acquired by using 3D scanning software to scan the plurality of display screens, to generate shape data and position data of the cabinet of the plurality of display screens, and then the terminal device can acquire the space data by data transmission. In this embodiment, the environmental space data is acquired by using 3D scanning software to scan the entire preset space, and other objects except the plurality of display screens are taken as the environmental space data of the environment surrounding the plurality of display screens.

[0075] It should be understood that the above examples are only exemplary and cannot be regarded as a limitation of the present application. In actual use, the method for acquiring the space data of the plurality of display screens in Embodiment 1 can be referred to.

[0076] In step 302, a three-dimensional model of the plurality of display screens and the surrounding environment is constructed according to the space data of the plurality of display screens and the environmental space data of the environment surrounding the plurality of display screens.

[0077] In this embodiment, the space data of the plurality of display screens includes shape data and / or position data of the cabinet constituting each display screen. After the terminal device acquires the space data of the plurality of display screens and the environmental space data of the environment surrounding the plurality of display screens, the screen matching software in the terminal device can construct a three-dimensional model of the plurality of display screens and the environment surrounding the plurality of display screens according to the space data of the plurality of display screens and the environmental space data of the environment surrounding the plurality of display screens, to completely restore the actual scene corresponding to the preset space. For example, a table is placed around the display screen, and therefore a three-dimensional model of the table needs to be constructed. The display screen is installed on a wall, and therefore a three-dimensional model of the wall needs to be constructed.

[0078] In step 303, a three-dimensional real scene model corresponding to the preset space is generated according to the plurality of display screens and the three-dimensional model of the surrounding environment.

[0079] It should be noted that in the process of generating the VR real scene model, three-dimensional data of the actual environment is first acquired, and then a corresponding real scene model is established according to the application requirement. The corresponding real scene model can be established according to the application requirement by embedding a VR display module in the screen matching software.

[0080] As a possible implementation manner, after obtaining the three-dimensional models of the plurality of display screens and the surrounding environment, the actual positions of each three-dimensional model in the preset space can be determined according to the spatial data of the display screens and the environmental spatial data of the surrounding environment, the objects of the plurality of display screens and the surrounding environment are placed according to the obtained actual positions, and finally a three-dimensional real scene model of the preset space which is the same as the actual scene can be generated.

[0081] As a possible implementation manner, a specific mark can also be set on the surface of the display screen in the actual scene, for example, a specific mark is pasted around the display screen, that is, each display screen surface has a unique corresponding mark, and the following manner can be used to generate the three-dimensional real scene model corresponding to the preset space:

[0082] identifying the mark of each display screen;

[0083] automatically marking the three-dimensional models of the plurality of display screens according to the identified mark of each display screen to obtain the mark of the three-dimensional model of each display screen;

[0084] determining the positions of the three-dimensional models of the plurality of display screens in the three-dimensional real scene model according to the mark of the three-dimensional model of each display screen, and generating the three-dimensional real scene model corresponding to the preset space.

[0085] It should be understood that the positions of the three-dimensional models of the plurality of display screens in the three-dimensional real scene model can be determined according to the mark of each three-dimensional model, and the positions of the objects existing around the plurality of display screens can be obtained according to the environmental spatial data, and the mark on the display screen can mainly facilitate the user to determine the corresponding relationship between the three-dimensional model of the display screen and the on-site display screen box according to the mark.

[0086] In step 304, a topological relationship between a plurality of boxes of a target display screen is determined in response to a box model configuration of the target display screen in the three-dimensional real scene model corresponding to the preset space, to assist the target display screen in screen matching.

[0087] The step 304 of the present embodiment is the same as the step 103 of the foregoing embodiment, and can be mutually referred to. The present embodiment will not be described here again.

[0088] Compared with the first embodiment, the embodiment of the application further obtains environmental space data of the surrounding environment of the plurality of display screens in the preset space on the basis of the space data of the plurality of display screens, and a three-dimensional real scene model corresponding to the preset space can be generated according to the space data and the environmental space data. In the case that the plurality of display screens exist in an indoor space, the configuration of each cabinet model by the user will be restricted by the preset space, and therefore it is necessary to generate the real scene model corresponding to the preset space to improve the accuracy of the configuration of each cabinet model.

[0089] Referring to Figure 4 FIG. 3 shows a structural schematic diagram of a visual auxiliary screen matching device provided by the third embodiment of the application. For ease of illustration, only parts related to the embodiments of the application are shown.

[0090] The visual auxiliary screen matching device can specifically include the following modules:

[0091] The data acquisition module 401 is configured to acquire space data of a plurality of display screens.

[0092] The model generation module 402 is configured to generate a three-dimensional real scene model containing the plurality of display screens according to the space data, and display the three-dimensional real scene model in a visual screen matching interface.

[0093] The auxiliary screen matching module 403 is configured to determine a topological relationship between a plurality of cabinets of a target display screen in response to a cabinet model configuration of the target display screen in the three-dimensional real scene model, to assist the target display screen in screen matching.

[0094] In the embodiments of the application, the data acquisition module 401 can be specifically configured to:

[0095] acquire shape data and / or position data of the cabinets of the plurality of display screens.

[0096] In the embodiments of the application, the position data includes three-dimensional space coordinates, and the data acquisition module 401 can specifically include the following sub-modules:

[0097] The automatic acquisition sub-module is configured to acquire three-dimensional space coordinates of a plurality of cabinets in each display screen scanned by a scanning device; or

[0098] The data receiving sub-module is configured to receive three-dimensional space coordinates of a plurality of cabinets in each display screen imported by a scanning device in response to a data import instruction of the scanning device.

[0099] In the embodiments of the application, the plurality of display screens are in a preset space, and the visual auxiliary screen matching device can specifically further include the following modules:

[0100] The space data acquisition module is configured to acquire environmental space data of a surrounding environment of the plurality of display screens in the preset space.

[0101] Correspondingly, the model generation module 402 can specifically include the following sub-modules:

[0102] a three-dimensional construction sub-module, configured to construct a three-dimensional model of the plurality of display screens and the surrounding environment according to spatial data of the plurality of display screens and environmental spatial data of the surrounding environment of the plurality of display screens, the spatial data of the plurality of display screens including shape data and / or position data of a box constituting each display screen;

[0103] a spatial model generation sub-module, configured to generate a three-dimensional real scene model of a preset space according to the three-dimensional model of the plurality of display screens and the surrounding environment, the three-dimensional real scene model of the preset space at least including a three-dimensional real scene model of the plurality of display screens.

[0104] In the embodiments of the present application, each display screen surface has a unique corresponding identifier, and the spatial model generation sub-module can specifically further include the following units:

[0105] an identifier identification unit, configured to identify the identifier of each display screen;

[0106] an automatic marking unit, configured to automatically mark the three-dimensional model of the plurality of display screens according to the identified identifier of each display screen, to obtain the identifier of the three-dimensional model of each display screen;

[0107] a model generation unit, configured to determine the position of the three-dimensional model corresponding to the plurality of display screens in the three-dimensional real scene model according to the identifier of the three-dimensional model of each display screen, and generate the three-dimensional real scene model corresponding to the preset space.

[0108] In the embodiments of the present application, the topological relationship includes a position relationship, an angle relationship, and a wiring relationship, the box model refers to a three-dimensional model corresponding to a box constituting a display screen, and the auxiliary screen matching module 403 can specifically include the following sub-modules:

[0109] a configuration sub-module, configured to select a target display screen in a visual interface in response to a configuration instruction, and configure the position, angle, and wiring of the three-dimensional model corresponding to each box constituting the target display screen, to determine the position relationship, angle relationship, and wiring relationship between the three-dimensional models corresponding to the boxes;

[0110] a topological determination sub-module, configured to determine the topological relationship between the boxes according to the position relationship, angle relationship, and wiring relationship between the three-dimensional models corresponding to the boxes.

[0111] In the embodiments of the present application, the auxiliary screen matching module 403 can specifically further include the following sub-modules:

[0112] an information generation sub-module, configured to generate configuration information containing the topological relationship according to the topological relationship between the plurality of boxes of the target display screen;

[0113] The information sending submodule is used to send configuration information to the control device that controls the target display screen, so that multiple cabinets of the target display screen can adjust their own configurations and display the corresponding input source.

[0114] The visualization-assisted screen matching device provided in this application embodiment can be applied in the foregoing method embodiments. For details, please refer to the description of the above method embodiments, which will not be repeated here.

[0115] Figure 5 This is a schematic diagram of the terminal device provided in Embodiment 4 of this application. Figure 5 As shown, the terminal device 500 of this embodiment includes: at least one processor 510 ( Figure 5 (Only one is shown) a processor, a memory 520, and a computer program 521 stored in the memory 520 and executable on the at least one processor 510, wherein the processor 510 executes the computer program 521 to implement the steps in the above-described visualization-assisted screen matching method embodiment.

[0116] The terminal device 500 can be a desktop computer, laptop, handheld computer, cloud server, or other computing device. This terminal device may include, but is not limited to, a processor 510 and a memory 520. Those skilled in the art will understand that... Figure 5 This is merely an example of terminal device 500 and does not constitute a limitation on terminal device 500. It may include more or fewer components than shown in the figure, or combine certain components, or different components, such as input / output devices, network access devices, etc.

[0117] The processor 510 may be a Central Processing Unit (CPU), or it may be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor.

[0118] The memory 520 can be an internal storage unit of the terminal device 500 in some embodiments, for example, a hard disk or a memory of the terminal device 500. The memory 520 can also be an external storage device of the terminal device 500 in other embodiments, for example, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal device 500. Further, the memory 520 can include both an internal storage unit and an external storage device of the terminal device 500. The memory 520 is used to store an operating system, an application program, a boot loader, data, and other programs, etc., for example, program codes of the computer program, etc. The memory 520 can also be used to temporarily store data that has been output or will be output.

[0119] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the division of the above functional units and modules is taken as an example, and in actual application, the above functions can be completed by different functional units and modules according to needs, that is, the internal structure of the apparatus is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit. In addition, the specific names of each functional unit and module are only for the convenience of mutual distinction, and do not limit the protection scope of the present application. The specific working process of the units and modules in the system can refer to the corresponding process in the foregoing method embodiments, which will not be described here.

[0120] In the above embodiments, the description of each embodiment has its own emphasis, and the parts not described or recorded in detail in a certain embodiment can be referred to the relevant description of other embodiments.

[0121] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0122] In the embodiments of the present application, it should be understood that the disclosed apparatus / terminal device and method can be implemented in other manners. For example, the embodiments of the apparatus / terminal device described above are merely schematic, and the division of the modules or units is merely logical function division, and there can be another division manner in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections between the units can be indirect couplings or communication connections through some interfaces, devices or units, and can be electrical, mechanical or in other forms.

[0123] The units described as separate components can or can not be physically separate, and the components shown as units can or can not be physical units, i.e., can be located in one place, or can be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiments.

[0124] In addition, each functional unit in the various embodiments of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0125] The integrated module / unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, all or part of the flow of the above-mentioned embodiment methods can also be completed by a computer program instructing related hardware, and the computer program can be stored in a computer readable storage medium. When the processor executes the computer program, the steps of each method embodiment described above can be implemented. The computer program includes computer program code, which can be in the form of source code, object code, executable file or some intermediate form. The computer readable medium can include any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the computer readable medium can include appropriate contents according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.

[0126] The application implements all or part of the processes in the above-mentioned embodiment methods, and can also be completed by a computer program product. When the computer program product runs on a terminal device, the terminal device is caused to perform the steps in each of the above-mentioned method embodiments.

[0127] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions recorded in the foregoing embodiments can be modified, or some technical features can be replaced by equivalent replacements; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.

Claims

1. A visual aid for a tinting method, characterized in that The application is applied to a terminal device connected with multiple display screens in a preset space, each of the display screens comprises multiple cabinets, and the visual auxiliary screen matching method comprises the following steps: Obtain spatial data of the multiple display screens; According to the spatial data, generate a three-dimensional real scene model containing the multiple display screens and display it in a visual screen matching interface; In response to a cabinet model configuration of a target display screen in the three-dimensional real scene model, determine a topological relationship between multiple cabinets of the target display screen to assist the target display screen in screen matching; According to the spatial data, construct a three-dimensional model of the multiple display screens; Identify an identifier arranged on a surface of each display screen, and automatically mark the three-dimensional model of the multiple display screens according to the identified identifier of each display screen to obtain a three-dimensional model identifier of each display screen; According to the three-dimensional model identifier of each display screen, determine a position of the corresponding three-dimensional model of the multiple display screens in the three-dimensional real scene model, and generate the three-dimensional real scene model containing the multiple display screens. The spatial data of the display screens comprises shape data and / or position data of the multiple cabinets.

2. The visual aid prescription-fitting method of claim 1, wherein, The position data comprises three-dimensional space coordinates, and the obtaining of the spatial data of the multiple display screens comprises:

3. The visual aid prescription-fitting method of claim 2, wherein, Obtain three-dimensional space coordinates of the multiple cabinets in each display screen scanned by a scanning device; or In response to a data import instruction of the scanning device, receive three-dimensional space coordinates of the multiple cabinets in each display screen imported by the scanning device. The multiple display screens are in a preset space, and before the generating of the three-dimensional real scene model containing the multiple display screens according to the spatial data, the method further comprises:

4. The visual aid prescription-fitting method of claim 1, wherein, Obtain environmental spatial data of a surrounding environment of the multiple display screens in the preset space; Accordingly, the generating of the three-dimensional real scene model containing the multiple display screens according to the spatial data comprises: According to the spatial data of the multiple display screens and the environmental spatial data of the surrounding environment of the multiple display screens, construct a three-dimensional model of the multiple display screens and the surrounding environment, wherein the spatial data of the multiple display screens comprises shape data and / or position data of cabinets constituting each display screen; According to the three-dimensional model of the multiple display screens and the surrounding environment, generate a three-dimensional real scene model of the preset space, wherein the three-dimensional real scene model of the preset space at least comprises a three-dimensional real scene model of the multiple display screens. Each display screen surface has a unique corresponding identifier, and the generating of the corresponding three-dimensional real scene model of the preset space comprises:

5. The visual aid prescription-fitting method of claim 4, wherein, Identify an identifier of each display screen; According to the identified identifier of each display screen, automatically mark a three-dimensional model of the multiple display screens to obtain an identifier of the three-dimensional model of each display screen; According to the identifier of the three-dimensional model of each display screen, determine a position of the corresponding three-dimensional model of the multiple display screens in the three-dimensional real scene model, and generate the corresponding three-dimensional real scene model of the preset space. ​ 6. The visual aid prescription-fitting method of claim 1, wherein, The topological relationship includes a position relationship, an angle relationship, and a wiring relationship, the cabinet model refers to a three-dimensional model corresponding to a cabinet constituting the display screen, and the determining the topological relationship between the multiple cabinets of the target display screen in response to the cabinet model configuration of the target display screen in the three-dimensional real scene model includes: In response to a configuration instruction, selecting a target display screen in the visualization interface, and configuring the position, angle, and wiring of the three-dimensional model corresponding to each cabinet constituting the target display screen to determine the position relationship, angle relationship, and wiring relationship between the three-dimensional models corresponding to the cabinets. According to the position relationship, angle relationship, and wiring relationship between the three-dimensional models corresponding to the cabinets, the topological relationship between the cabinets is determined.

7. The visual aid prescription-fitting method of claim 1, wherein, The assisting the target display screen in screen matching includes: According to the topological relationship between the multiple cabinets of the target display screen, configuration information containing the topological relationship is generated; The configuration information is sent to a control device controlling the target display screen, so that the multiple cabinets of the target display screen display corresponding input sources after adjusting their own configurations.

8. An auxiliary screen matching device for visualization, characterized in that The visualization auxiliary screen matching device is coupled with a terminal device connected with multiple display screens, the multiple display screens are in a preset space, each display screen includes multiple cabinets, and the visualization auxiliary screen matching device includes: A data acquisition module configured to acquire spatial data of the multiple display screens; A model generation module configured to generate a three-dimensional real scene model containing the multiple display screens according to the spatial data and display the three-dimensional real scene model in a visualization screen matching interface; An auxiliary screen matching module configured to determine a topological relationship between multiple cabinets of a target display screen in response to a cabinet model configuration of the target display screen in the three-dimensional real scene model to assist the target display screen in screen matching. The model generation module is further configured to: According to the spatial data, construct three-dimensional models of the multiple display screens; Identify an identifier arranged on a surface of each display screen, and automatically mark the three-dimensional models of the multiple display screens according to the identified identifier of each display screen to obtain a three-dimensional model identifier of each display screen; According to the three-dimensional model identifier of each display screen, determine the positions of the three-dimensional models corresponding to the multiple display screens in the three-dimensional real scene model, and generate a three-dimensional real scene model containing the multiple display screens.

9. A terminal device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the computer program to implement the method of any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, the computer program comprising instructions that, when executed by a computer, cause the computer to perform the method of any one of claims 1 to 9. The computer program is executed by the processor to implement the method of any one of claims 1 to 7.

Citation Information

Patent Citations

  • Monitoring method and device of LED (Light Emitting Diode) display screen

    CN104239185A

  • Visual screen configuration method, device and system and computer readable medium

    CN112394893A

  • Display system management method and device and computer readable storage medium

    CN114461154A

  • Screen configuration method and device of display screen, storage medium and processor

    CN114489537A