Method and device for controlling electronic sand table, storage medium and electronic equipment

Abstract

The application discloses a control method and device of an electronic sand table, a storage medium and electronic equipment. The method comprises the following steps: obtaining a model file of a target electronic sand table, and generating the target electronic sand table according to the model file; performing coordinate conversion processing on three-dimensional coordinate systems corresponding to a plurality of three-dimensional building models to obtain two-dimensional coordinate systems corresponding to the plurality of three-dimensional building models; determining labels corresponding to the plurality of three-dimensional building models, and displaying the labels corresponding to the plurality of three-dimensional building models in the two-dimensional coordinate systems corresponding to the plurality of three-dimensional building models; obtaining operation information of a target control, and determining a target three-dimensional building model selected by a target object based on the operation information; and generating target prompt information according to the target three-dimensional building model. The application solves the technical problem of poor controllability of the model of the electronic sand table in the prior art.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and more specifically, to a control method, apparatus, storage medium, and electronic device for an electronic sand table. Background Technology

[0002] Currently, when using the intelligent assessment platform for teacher professional competence, it is necessary to display electronic sand table models of the teaching building environment on a webpage, presenting three-dimensional building models of the smart campus, such as teaching buildings, laboratory buildings, gymnasiums, libraries, school hospitals, dormitories, and canteens. Each three-dimensional building model corresponds to different test content. For example, the teaching building mainly includes multimedia teaching classrooms and smart learning classrooms, equipped with hardware such as electronic whiteboards, handheld devices (tablets), and projectors, allowing teachers to assess their information technology application skills in the teaching building; teachers can assess their experimental operation skills in the laboratory building.

[0003] In related technologies, when displaying the aforementioned 3D building models in an electronic sand table format, each building model is loaded individually, lacking a unified building model loader, resulting in long loading times. Furthermore, after the model scene is loaded, the names of the building models are not displayed on the web page screen. Users (e.g., teachers) cannot clearly understand the meaning of the building model they are currently viewing. When users click on a model, they cannot perform operations such as zooming in or dynamically selecting the model, resulting in poor controllability of the building models. Additionally, during scene movement, due to the lack of boundary constraints in 3D scenes, there is a problem of significant scene displacement.

[0004] There is currently no effective solution to the above problems. Summary of the Invention

[0005] This invention provides a control method, device, storage medium, and electronic device for an electronic sand table, to at least solve the technical problem of poor controllability of electronic sand table models in the prior art.

[0006] According to one aspect of the present invention, a control method for an electronic sand table is provided, applied to an intelligent assessment platform for teacher professional competence, comprising: acquiring a model file of a target electronic sand table, and generating a target electronic sand table based on the model file, wherein the target electronic sand table includes multiple three-dimensional building models; performing coordinate transformation processing on the three-dimensional coordinate systems corresponding to the multiple three-dimensional building models to obtain two-dimensional coordinate systems corresponding to the multiple three-dimensional building models; determining labels corresponding to the multiple three-dimensional building models, and displaying the labels corresponding to the multiple three-dimensional building models in the two-dimensional coordinate systems corresponding to the multiple three-dimensional building models; acquiring operation information of a target control, and determining the target three-dimensional building model selected by a target object based on the operation information, wherein the operation information is generated in response to operation instructions triggered by the target object through the target control on the multiple three-dimensional building models; generating target prompt information based on the target three-dimensional building model, wherein the target prompt information corresponds to the target three-dimensional building model, and the target prompt information is used to prompt the target object to conduct a professional competence test in the scene corresponding to the target three-dimensional building model.

[0007] Furthermore, the control method of the electronic sand table also includes: obtaining a first coordinate vector, wherein the first coordinate vector is a representation vector of a three-dimensional coordinate system; performing coordinate transformation processing on the first coordinate vector according to a matrix transformation function to obtain a second coordinate vector, wherein the second coordinate vector is a representation vector of a camera coordinate system; and performing projection transformation processing on the second coordinate vector to obtain a third coordinate vector, wherein the third coordinate vector is a representation vector of a two-dimensional coordinate system.

[0008] Furthermore, the control method for the electronic sand table also includes: determining the labels corresponding to multiple 3D building models based on the scene attribute information in the model file; obtaining the two-dimensional coordinate vector corresponding to the camera position, where the camera position is the viewing position of the current viewpoint; calculating the position coordinate vectors of the labels corresponding to the multiple 3D building models in the two-dimensional coordinate system based on the two-dimensional coordinate vectors corresponding to the camera position, thus obtaining the position coordinate vector of the label corresponding to each 3D building model; determining the position of the labels corresponding to the multiple 3D building models based on the position coordinate vector of the label corresponding to each 3D building model; and displaying the labels corresponding to the multiple 3D building models at their respective positions.

[0009] Furthermore, the control method for the electronic sand table also includes: acquiring operation information, wherein the operation information includes at least the position coordinates of the clicked position of the target control, and the position coordinates are coordinates in a two-dimensional coordinate system; inputting the position coordinates into the target ray projector for ray projection processing to obtain a tag set corresponding to the first three-dimensional building model set, wherein the first three-dimensional building model set is a model set composed of three-dimensional building models traversed by the ray emitted by the target ray projector based on the position coordinates; determining the target tag from the tag set according to the tag matching rules, and determining the target three-dimensional building model according to the target tag.

[0010] Furthermore, the control method for the electronic sand table also includes: parsing the model file to obtain scene attribute information; calling the model rendering function to render the scene attribute information and generate the target electronic sand table.

[0011] Furthermore, the control method for the electronic sand table also includes: after parsing the model file to obtain scene attribute information, initializing the model loader to generate a model builder; using the model builder to perform scene creation processing on the scene attribute information to generate the scene model camera, scene model lighting, and scene model operation rules of the target electronic sand table. The scene model camera is used to determine the camera position, the scene model lighting is used to realize the color display of multiple three-dimensional building models, and the scene model operation rules are used to realize the operation of the target electronic sand table.

[0012] Furthermore, the control method for the electronic sand table also includes: before calling the model rendering function to render the scene attribute information and generate the target electronic sand table, configuring the range of movement values ​​of the target coordinate axis of the three-dimensional coordinate system in the target script, so as to reset the camera position if the coordinates corresponding to the camera position exceed the range of movement values.

[0013] According to another aspect of the present invention, a control device for an electronic sand table is also provided, comprising: a first acquisition module, configured to acquire a model file of a target electronic sand table and generate a target electronic sand table based on the model file, wherein the target electronic sand table includes multiple three-dimensional building models; a first processing module, configured to perform coordinate transformation processing on the three-dimensional coordinate systems corresponding to the multiple three-dimensional building models to obtain two-dimensional coordinate systems corresponding to the multiple three-dimensional building models; a second processing module, configured to determine the labels corresponding to the multiple three-dimensional building models and display the labels corresponding to the multiple three-dimensional building models in the two-dimensional coordinate systems corresponding to the multiple three-dimensional building models; a second acquisition module, configured to acquire operation information of a target control and determine the target three-dimensional building model selected by a target object based on the operation information, wherein the operation information is generated in response to the operation instructions triggered by the target object through the target control on the multiple three-dimensional building models; and a third processing module, configured to generate target prompt information based on the target three-dimensional building model, wherein the target prompt information corresponds to the target three-dimensional building model and is used to prompt the target object to perform a professional ability test in the scene corresponding to the target three-dimensional building model.

[0014] According to another aspect of the present invention, a computer-readable storage medium is also provided, wherein a computer program is stored in the computer program, wherein the computer program is configured to execute the above-described control method for an electronic sand table when it is run.

[0015] According to another aspect of the present invention, an electronic device is also provided, the electronic device including one or more processors; a memory for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors are configured to run the programs, wherein the programs are configured to execute the above-described control method for an electronic sand table during runtime.

[0016] In this embodiment of the invention, a method is adopted to convert a three-dimensional coordinate system into a two-dimensional coordinate system to display building model labels and select building models. First, the model file of the target electronic sand table is obtained, and the target electronic sand table is generated based on the model file. Then, coordinate transformation is performed on the three-dimensional coordinate systems corresponding to multiple three-dimensional building models to obtain the corresponding two-dimensional coordinate systems. Next, labels corresponding to the multiple three-dimensional building models are determined, and these labels are displayed in the corresponding two-dimensional coordinate systems. Then, the operation information of the target control is obtained, and based on the operation information, the target three-dimensional building model selected by the target object is determined. Finally, target prompt information is generated based on the target three-dimensional building model. The target electronic sand table includes multiple three-dimensional building models, the operation information is generated in response to the operation commands triggered by the target object through the target control on the multiple three-dimensional building models, and the target prompt information corresponds to the target three-dimensional building model. The target prompt information is used to prompt the target object to perform a professional capability test in the scene corresponding to the target three-dimensional building model.

[0017] In the above process, by acquiring the model file of the target electronic sand table, a data foundation is provided for the subsequent generation of the target electronic sand table; by performing coordinate transformation on the three-dimensional coordinate systems corresponding to multiple three-dimensional building models, a two-dimensional coordinate system corresponding to multiple three-dimensional building models can be obtained, providing a data foundation for the subsequent display of labels corresponding to the three-dimensional building models; by displaying the labels corresponding to multiple three-dimensional building models in the two-dimensional coordinate systems corresponding to multiple three-dimensional building models, users can clearly understand the meaning of the building model they are currently facing, improving the user experience; by acquiring the operation information of the target control, the target three-dimensional building model selected by the target object can be determined, realizing the dynamic selection operation of the model, thereby generating corresponding target prompt information based on the target three-dimensional building model selected by the user, enabling users to conduct professional ability tests in the scene corresponding to the selected target three-dimensional building model, improving the controllability of the electronic sand table model.

[0018] Therefore, the technical solution of this invention achieves the goal of displaying building model tags, selecting building models, and prompting users to take relevant ability tests on the web page of the intelligent assessment platform for teachers' professional abilities. This improves the controllability of the electronic sand table model and solves the technical problem of poor controllability of the electronic sand table model in the prior art. Attached Figure Description

[0019] The accompanying drawings, which are included to provide a further understanding of the invention and form part of this application, illustrate exemplary embodiments of the invention and, together with their description, serve to explain the invention and do not constitute an undue limitation thereof. In the drawings:

[0020] Figure 1 This is a flowchart of an optional control method for an electronic sand table according to an embodiment of the present invention;

[0021] Figure 2 This is a flowchart of an optional three-dimensional model scene loading method according to an embodiment of the present invention;

[0022] Figure 3 This is a schematic diagram of an optional three-dimensional coordinate system according to an embodiment of the present invention;

[0023] Figure 4 This is a schematic diagram of an optional two-dimensional coordinate system according to an embodiment of the present invention;

[0024] Figure 5 This is a schematic diagram of an optional three-dimensional transformation matrix according to an embodiment of the present invention;

[0025] Figure 6 This is a flowchart of an optional model loader according to an embodiment of the present invention;

[0026] Figure 7 This is a schematic diagram of an optional range of values ​​for the movement of a target coordinate axis according to an embodiment of the present invention;

[0027] Figure 8 This is a schematic diagram of an optional electronic sand table control device according to an embodiment of the present invention;

[0028] Figure 9 This is a schematic diagram of an optional electronic device according to an embodiment of the present invention. Detailed Implementation

[0029] To enable those skilled in the art to better understand the present invention, the technical solutions of the present invention will be clearly and completely described below with reference to the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort should fall within the scope of protection of the present invention.

[0030] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this invention are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of the invention described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0031] It should be noted that all relevant information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this invention are information and data authorized by the user or fully authorized by all parties. For example, this system has an interface with the relevant user or organization. Before obtaining relevant information, it needs to send an acquisition request to the aforementioned user or organization through the interface, and obtain the relevant information after receiving consent from the aforementioned user or organization.

[0032] Example 1

[0033] According to an embodiment of the present invention, a method embodiment for controlling an electronic sand table is provided. It should be noted that the steps shown in the flowchart in the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions. Furthermore, although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in a different order than that shown here.

[0034] Figure 1 This is a flowchart of an optional electronic sand table control method according to an embodiment of the present invention, such as... Figure 1 As shown, the method includes the following steps:

[0035] Step S101: Obtain the model file of the target electronic sand table, and generate the target electronic sand table based on the model file. The target electronic sand table includes multiple three-dimensional building models.

[0036] In the above steps, the model file of the target electronic sand table can be obtained through application systems, processors, electronic devices, and other devices. Optionally, the target electronic sand table can be an electronic sand table of the teaching building environment, including multiple three-dimensional building models such as teaching buildings, laboratory buildings, art centers, administration buildings, science and technology buildings, gymnasiums, playgrounds, mental health education and counseling centers, libraries, teacher development centers, school hospitals, academic lecture halls, dormitories, and canteens.

[0037] Optionally, before obtaining the model file of the target electronic sand table, a first model file is obtained, wherein the first model file is a ZIP file; the first model file is decompressed to obtain the model file of the target electronic sand table. Specifically, the first model file is a ZIP file compressed using a ZIP file compression algorithm, and the model file of the target electronic sand table is the decompressed model file. Since the 3D model is stored on the server side and the model file itself is large, it takes a long time to download and transmit over the network. Therefore, using a ZIP file compression algorithm to optimize its size can reduce the model loading time and improve the model loading efficiency.

[0038] Optionally, in this embodiment, the first model file, i.e., the ZIP file of the model file, is obtained through the business interface on the portal homepage of the web page of the intelligent assessment platform for teacher professional competence. Then, the model file of the target electronic sand table is obtained by decompression. Furthermore, all data parameters of the model file are uniformly transmitted to the model loader for model rendering and loading.

[0039] Figure 2 This is a flowchart of an optional 3D model scene loading method according to an embodiment of the present invention, such as... Figure 2 As shown, the model file is decompressed to obtain the model file of the target electronic sand table. Then, the model file's validity, i.e., its conformity to standards, is checked. If the model file does not conform to standards, the user is prompted to submit a compliant model file. If the model file conforms to standards, the model loader is initialized, and a model loading device (i.e., a model builder) is constructed. Then, the model rendering engine is called, and the model is rendered according to various loading indicators of the model scene. Finally, the scene successfully loads the model, generating the target electronic sand table. Specifically, the various 3D building models of the target electronic sand table are placed in their respective positions according to preset rules.

[0040] Step S102: Perform coordinate transformation on the three-dimensional coordinate systems corresponding to the multiple three-dimensional building models to obtain the two-dimensional coordinate systems corresponding to the multiple three-dimensional building models.

[0041] In the above steps, the three-dimensional coordinate system can be the world coordinate system relative to the real world space, and the two-dimensional coordinate system can be the screen two-dimensional coordinate system relative to the screen. Optionally, in the target electronic sand table display scene of the intelligent assessment platform for teacher professional competence, the content presented on the display interface is displayed by rendering objects in the world coordinate system and converting them to the screen two-dimensional coordinate system.

[0042] Figure 3 This is a schematic diagram of an optional three-dimensional coordinate system according to an embodiment of the present invention. Figure 4 This is a schematic diagram of an optional two-dimensional coordinate system according to an embodiment of the present invention, such as... Figure 3 , Figure 4 The image shows a two-dimensional planar diagram illustrating the relationship between the three-dimensional world coordinate system and the two-dimensional coordinate system of the PC screen. The world coordinate system is a coordinate system relative to the real-world space. All models of the three-dimensional electronic sandbox scene exist in this world space, and each model has a position coordinate in this world space.

[0043] Optionally, the model scene is built within a 3D scene, but the label content at the top of the model, i.e., the building model name, cannot exist as a 3D model. Therefore, after the electronic sand table scene content is loaded, due to limitations, the model labels cannot be displayed. It is necessary to load the corresponding text label files within the 2D plane of the web page screen to achieve dynamic loading of the model's text labels. Specifically, by converting the model's spatial coordinates (3D world coordinate system) to the screen's 2D coordinate system and binding the model to the text labels, the text labels can move synchronously with the model as the scene model moves.

[0044] Step S103: Determine the labels corresponding to multiple 3D building models, and display the labels corresponding to multiple 3D building models in the 2D coordinate system corresponding to the multiple 3D building models.

[0045] In the above steps, the labels corresponding to the 3D building models can be the names of the buildings, such as teaching buildings, laboratory buildings, art centers, and administration buildings. Optionally, based on the scene attribute information in the model files, labels corresponding to multiple 3D building models can be determined. The scene attribute information can include model name, model size, file name, scaling ratio, spatial coordinates, and other information.

[0046] Optionally, in the two-dimensional coordinate system corresponding to multiple three-dimensional building models, labels corresponding to multiple three-dimensional building models can be displayed. For example, the label "Teaching Building" can be displayed on the top of the three-dimensional building model of the teaching building.

[0047] Step S104: Obtain the operation information of the target control, and determine the target 3D building model selected by the target object based on the operation information. The operation information is generated in response to the operation instructions triggered by the target object on multiple 3D building models through the target control.

[0048] In the above steps, the target control can be a mouse, the operation information can be the mouse click location, the target object can be a user (e.g., a teacher conducting a professional skills test), and the operation command can be a selection command. Optionally, the user can issue a selection command on multiple 3D building models using the mouse. The target 3D building model selected by the user can be determined based on the mouse click location. For example, if the user clicks on a 3D building model of a teaching building, the target 3D building model is the teaching building 3D building model.

[0049] Step S105: Generate target prompt information based on the target 3D building model. The target prompt information corresponds to the target 3D building model and is used to prompt the target object to conduct a professional ability test in the scene corresponding to the target 3D building model.

[0050] In the above steps, the target prompt information corresponds to the target 3D building model. For example, if the target 3D building model is a teaching building, the target prompt information can be "Welcome to the teaching building. You can complete the information technology application ability assessment here." If the target 3D building model is a laboratory building, the target prompt information can be "Welcome to the laboratory building. You can complete the experimental operation ability assessment here."

[0051] Optionally, the scene attribute information in the model file may also include the correspondence between the 3D building model and the prompt information. Based on the correspondence, after determining the target 3D building model selected by the target object, the corresponding target prompt information can be determined and displayed to the user.

[0052] Based on the scheme defined in steps S101 to S105 above, it can be understood that in this embodiment of the invention, the method of converting a three-dimensional coordinate system into a two-dimensional coordinate system to display building model labels and select building models involves first obtaining the model file of the target electronic sand table, generating the target electronic sand table based on the model file, then performing coordinate transformation on the three-dimensional coordinate systems corresponding to multiple three-dimensional building models to obtain the two-dimensional coordinate systems corresponding to multiple three-dimensional building models, then determining the labels corresponding to multiple three-dimensional building models, and displaying the labels corresponding to multiple three-dimensional building models in the two-dimensional coordinate systems corresponding to multiple three-dimensional building models, then obtaining the operation information of the target control, and determining the target three-dimensional building model selected by the target object based on the operation information, and then generating target prompt information based on the target three-dimensional building model. The target electronic sand table includes multiple three-dimensional building models, the operation information is generated in response to the operation commands triggered by the target object through the target control on multiple three-dimensional building models, and the target prompt information corresponds to the target three-dimensional building model. The target prompt information is used to prompt the target object to perform a professional ability test in the scene corresponding to the target three-dimensional building model.

[0053] It is noteworthy that, in the above process, obtaining the model file of the target electronic sand table provides the data foundation for the subsequent generation of the target electronic sand table; by performing coordinate transformation on the three-dimensional coordinate systems corresponding to multiple three-dimensional building models, we can obtain the two-dimensional coordinate systems corresponding to multiple three-dimensional building models, providing the data foundation for the subsequent display of labels corresponding to the three-dimensional building models; by displaying the labels corresponding to multiple three-dimensional building models in the two-dimensional coordinate systems corresponding to multiple three-dimensional building models, users can clearly understand the meaning of the building model they are currently facing, improving the user experience; by obtaining the operation information of the target control, we can determine the target three-dimensional building model selected by the target object, realizing the dynamic selection operation of the model, thereby generating corresponding target prompt information based on the target three-dimensional building model selected by the user, enabling users to conduct professional ability tests in the scene corresponding to the selected target three-dimensional building model, improving the controllability of the electronic sand table model.

[0054] Therefore, the technical solution of this invention achieves the goal of displaying building model tags, selecting building models, and prompting users to take relevant ability tests on the web page of the intelligent assessment platform for teachers' professional abilities. This improves the controllability of the electronic sand table model and solves the technical problem of poor controllability of the electronic sand table model in the prior art.

[0055] In one optional embodiment, in the process of transforming the three-dimensional coordinate systems corresponding to multiple three-dimensional building models to obtain the two-dimensional coordinate systems corresponding to multiple three-dimensional building models, a first coordinate vector is first obtained. Then, according to a matrix transformation function, the first coordinate vector is transformed to obtain a second coordinate vector. Finally, the second coordinate vector is transformed by projection to obtain a third coordinate vector. Here, the first coordinate vector is the representation vector of the three-dimensional coordinate system, the second coordinate vector is the representation vector of the camera coordinate system, and the third coordinate vector is the representation vector of the two-dimensional coordinate system.

[0056] Optionally, all linear transformations in a 3D scene consist of translation, rotation, and scaling. Figure 5 This is a schematic diagram of an optional three-dimensional transformation matrix according to an embodiment of the present invention, such as... Figure 5 As shown, a 4x4 three-dimensional transformation matrix with coordinate parameter M is first defined. The first three columns represent the coordinates of the i-hat, j-hat, and z-hat after rotation. That is, each column of the linear transformation matrix represents the unit vector representation of the x, y, and z axes of the transformed coordinate system. Specifically, the first column (M11, M21, M31) represents the i-hat, the second column (M12, M22, M32) represents the j-hat, and the third column (M13, M23, M33) represents the z-hat.

[0057] Optionally, there exists a matrix `Matrix_WorldToLocal` that can transform its coordinates in the world coordinate system to coordinates in the local coordinate system, and a matrix `Matrix_LocalToWorld` that can perform the inverse transformation, realizing the conversion between the local coordinate matrix and the world coordinate matrix. These two matrices are inverses of each other.

[0058] Optionally, in the 3D electronic sandbox world of the intelligent assessment platform for teacher professional competence, different users see different scenes. Assuming a coordinate system is established centered on the user, each user represents a different local coordinate system. This coordinate system is generally called the camera coordinate system, or the visual coordinate system, and this local space is called the camera space or visual space. Optionally, let the matrix transformation function for converting the world coordinate system to the camera coordinate system be Matrix_WorldToCamera. Let the world coordinate system of the user in the 3D electronic sandbox scene of the intelligent assessment platform for teacher professional competence be U_world(x, y, z). The camera coordinates U_camera can be obtained through the matrix transformation function Matrix_WorldToCamera. Specifically, U_camera = U_world * Matrix_WorldToCamera.

[0059] Optionally, the first coordinate vector, U_world(x, y, z), is obtained through the business interface. Then, according to the matrix transformation function Matrix_WorldToCamera, the first coordinate vector is transformed using the above formula to obtain the second coordinate vector, U_camera.

[0060] Furthermore, after obtaining the value of U_camera, this value is projected onto the screen in two-dimensional coordinates. This involves performing a projection transformation on the second coordinate vector to obtain the third coordinate vector. Specifically, since the camera is set at the origin of the coordinate system (0, 0, 0), let the coordinates of U_camera, i.e., the second coordinate vector, be (Ux, Uy, Uz). Let the coordinates of U_camera projected onto the screen canvas, i.e., the third coordinate vector, be Ut_camera. Since the projected image is a triangle, according to the principle of similar triangles, we can obtain:

[0061] Uy / Uz=Ut.y / 1

[0062] Ut.y = Uy / Uz

[0063] Alternatively, following the principle of similar triangles, we can similarly obtain:

[0064] Ut.x = Ux / Uz

[0065] Therefore, the transformed two-dimensional screen coordinates can be obtained using the following formula:

[0066] Ut.x = Ux / Uz

[0067] Ut.y = Uy / Uz

[0068] Where Ut.x corresponds to the X-axis of the two-dimensional coordinate system, and Ut.y corresponds to the Y-axis of the two-dimensional coordinate system.

[0069] Optionally, since the projected object is always seen along the negative Z-axis in the camera coordinate system according to the projection principle, the formula needs to be transformed. The transformed formula is as follows:

[0070] Ut.x = Ux / (-Uz)

[0071] Ut.y = Uy / (-Uz)

[0072] It should be noted that by converting the three-dimensional world coordinate system into the screen's two-dimensional coordinate system, it is possible to display the labels corresponding to the three-dimensional building model, and to bind the model with the text labels, so that when the scene model moves, the text labels move synchronously with the model.

[0073] In one optional embodiment, during the process of determining labels corresponding to multiple 3D building models and displaying these labels in a 2D coordinate system, the process first involves determining the labels for each 3D building model based on scene attribute information in the model file. Then, the 2D coordinate vector corresponding to the camera position is obtained. Next, based on this 2D coordinate vector, the position coordinate vectors of the labels for each 3D building model in the 2D coordinate system are calculated, resulting in the position coordinate vector for each label. Finally, the positions of the labels for each 3D building model are determined based on these position coordinate vectors, and the labels are then displayed at their respective positions. Here, the camera position refers to the viewing position of the current perspective.

[0074] Optionally, based on the scene attribute information in the model file, tags can be determined for multiple 3D building models. The scene attribute information can include model name, model size, file name, scaling ratio, spatial coordinates, etc. For example, if the model name of the building model is "teaching building", then the corresponding tag is "teaching building".

[0075] Furthermore, the two-dimensional coordinate vector corresponding to the camera position is obtained, that is, the two-dimensional coordinate vector corresponding to the current viewing position. Then, based on the two-dimensional coordinate vector corresponding to the camera position, the position coordinate vectors of the labels corresponding to multiple 3D building models in the two-dimensional coordinate system are calculated respectively, thus obtaining the position coordinate vector of the label corresponding to each 3D building model. Optionally, let the two-dimensional screen coordinates of the camera space, that is, the two-dimensional coordinate vector corresponding to the camera position, be B(Xb, Yb). Since the labels need to be displayed floating on top of the 3D building models, let the world coordinate height of the 3D building models be Ya, and calculate the position coordinate vectors of the labels corresponding to multiple 3D building models in the two-dimensional coordinate system respectively.

[0076] Optionally, the distance from the left side of the screen to the label is calculated using the following formula: Xb * (width of the current browser's visible content area / 2) + width of the current browser's visible content area / 2. Optionally, the distance from the top of the screen to the label is calculated using the following formula: -Yb * (height of the current browser's visible content area / 2) + height of the current browser's visible content area / 2 - 3D object world coordinates Ya.

[0077] Optionally, after calculating the position coordinate vector of the label corresponding to each 3D building model using the above formula, the position of the label corresponding to multiple 3D building models can be determined, that is, the two-dimensional screen coordinate values ​​of the label position corresponding to the 3D building model can be obtained.

[0078] Furthermore, the tags corresponding to the multiple 3D building models are displayed at their respective positions. Optionally, the DIV tag function in HTML can be used to create tag content for the 3D building models to achieve the display of tags corresponding to multiple 3D building models.

[0079] In one optional embodiment, during the process of acquiring the operation information of the target control and determining the target 3D building model selected by the target object based on the operation information, the operation information is first acquired, then the position coordinates are input into the target ray projector for ray projection processing to obtain a tag set corresponding to the first 3D building model set. Then, according to the tag matching rules, the target tag is determined from the tag set, and the target 3D building model is determined based on the target tag. The operation information includes at least the position coordinates of the clicked position of the target control, where the position coordinates are coordinates in a two-dimensional coordinate system. The first 3D building model set is a model set composed of 3D building models traversed by the rays emitted by the target ray projector based on the position coordinates.

[0080] Optionally, by listening to user interface click events, operation information can be obtained when the target object clicks on the 3D building model. Optionally, the target raycaster can be a raycaster. By inputting the position coordinates into the raycaster for ray casting, a tag set corresponding to the first set of 3D building models can be obtained.

[0081] Specifically, by obtaining the X and Y coordinates of the mouse click on the screen, the actual user operation data is obtained. The formula for calculating the two-dimensional coordinates of the mouse click position is as follows:

[0082] X-axis coordinate = (mouse click X-axis clientX coordinate value / width of the current browser's visible content area) * 2 - 1 (world coordinate range);

[0083] Y-axis coordinate = -(mouse click Y-axis client Y-coordinate value / height of the current browser's visible content area) * 2 + 1 (world coordinate range).

[0084] Where clientX is the distance from the current mouse click position to the leftmost edge of the browser window's content area, and clientY is the distance from the current mouse click position to the top edge of the browser window's content area.

[0085] Further, after obtaining the X-axis and Y-axis coordinates, the X-axis and Y-axis coordinate positions, i.e., the position coordinates, are input into Raycaster for ray projection processing. Specifically, Raycaster emits a laser ray along the direction of the two-dimensional vector formed by the mouse click X-axis and Y-axis coordinate positions. All models penetrated by the ray constitute the first set of 3D building models. By obtaining the tags corresponding to the 3D building models penetrated by the laser ray, i.e., the first set of 3D building models, a tag set can be obtained. Therefore, according to tag matching rules, the target tag can be determined from the tag set, and the target 3D building model can be determined based on the target tag. For example, the tag matching rule could be that the model name of the building model is "teaching building," and the corresponding tag is "teaching building."

[0086] Optionally, suppose the mouse clicks on point P on the screen, and the coordinates (clientX, clientY) are obtained after the click. Let the coordinates of point P in world coordinates be P1(X1, Y1). Since the click operation on point P occurs in the two-dimensional coordinates of the screen, the top left corner is the origin coordinates (0, 0). Further, the value of the screen center origin P2(X2, Y2) is calculated using the following formula:

[0087] X2 = clientX - width of the current browser's visible content area / 2

[0088] Y2 = Height of the current browser's visible content area / 2 - clientY

[0089] Optionally, since the default coordinates range from 1 to -1, the offset is corrected using the following formula to remove the influence of the default coordinates:

[0090] X1 = (clientX - width of the current browser's visible content area / 2) / (width of the current browser's visible content area / 2) = (clientX / width of the current browser's visible content area) * 2 - 1

[0091] Y1 = (Height of the current browser's visible content area / 2 - clientY) / (Height of the current browser's visible content area / 2) = (clientY / Width of the current browser's visible content area) * 2 + 1

[0092] Optionally, the above formula can be used to obtain the 3D building model through which the Raycaster laser ray passes. By matching the names, the world coordinates of the model to be displayed when the mouse is clicked can be obtained, thus realizing the correct identification of the model clicked by the user. This enables operations such as selecting the scene model and changing the viewpoint.

[0093] Optionally, after obtaining the world coordinates of the model to be displayed when the mouse is clicked, the scene view can be freely scaled by dynamically updating the camera position to 45 (the straight-line distance from the target position).

[0094] In one optional embodiment, during the process of generating the target electronic sand table based on the model file, the model file is first parsed to obtain scene attribute information, and then the model rendering function is called to render the scene attribute information to generate the target electronic sand table.

[0095] In one optional embodiment, after parsing the model file to obtain scene attribute information, the model loader is initialized to generate a model builder. Then, the scene attribute information is processed by the model builder to generate the scene model camera, scene model lights, and scene model operation rules of the target electronic sand table. The scene model camera is used to determine the camera position, the scene model lights are used to realize the color display of multiple three-dimensional building models, and the scene model operation rules are used to realize the operation of the target electronic sand table.

[0096] Optionally, by parsing the model file through the business interface, scene attribute information can be obtained. Then, the business interface calls the model rendering function to render the scene attribute information, thereby generating the target electronic sand table.

[0097] Optional, Figure 6 This is a flowchart of an optional model loader according to an embodiment of the present invention, such as... Figure 6 As shown, the process begins with initializing the model builder, which involves initializing the model loader to generate the model builder. Then, the model scene is initialized, including asynchronously creating the scene model camera, the asynchronous model track operation mechanism, and the asynchronous scene model lighting. Specifically, the model builder processes the scene attribute information to generate the scene model camera, scene model lighting, and scene model operation rules for the target electronic sand table. In detail, the model file undergoes unified model scene initialization operations through the model builder initialization, asynchronously executing scene model camera, track, lighting, materials, and other related functions during this stage.

[0098] Furthermore, the scene is loaded through the model rendering engine, i.e., rendering the model scene container. The model is loaded asynchronously by parsing the model attribute information. After the model is parsed, operations such as binding model display labels and binding model laser scan click events can be performed asynchronously. Further, frame-by-frame animation rendering is performed, i.e., the model animation frame rendering function is called, allowing users to interact with the model, such as clicking and dragging.

[0099] It should be noted that in the above process, a unified model loader was used to achieve batch dynamic loading of 3D building models, which improved the model loading efficiency.

[0100] In one optional embodiment, before calling the model rendering function to render the scene attribute information and generate the target electronic sand table, the target coordinate axis movement range of the three-dimensional coordinate system is configured in the target script so that the camera position is reset if the coordinates corresponding to the camera position exceed the movement range.

[0101] Optional, Figure 7 This is a schematic diagram illustrating the optional range of movement values ​​for a target coordinate axis according to an embodiment of the present invention, as shown below. Figure 7 As shown, in a 3D scene, the building model can extend infinitely within the plane formed by the Z-axis and X-axis. Without boundary control, the model's movement will exceed the user's clickable range. Therefore, when moving the scene, the movement range of the Z-axis and X-axis needs to be limited. If the range is exceeded, the scene view is reset. Optionally, after resetting, the model will automatically return to the origin, with coordinates Z:X:Y(0,0,0).

[0102] Optionally, the target script can be a program script of the graphics rendering engine, the target coordinate axes can be the Z-axis and the X-axis, and the movement range can be limited to the Z-axis movement range (-40, 65) and the X-axis movement range (-40, 60).

[0103] Optionally, since the 3D building model is rendered and loaded in the world coordinate system (3D coordinate system), while operations such as mouse dragging and screen movement are performed in the screen coordinate system (2D coordinate system), it is necessary to obtain the world coordinates corresponding to the camera (i.e., the camera position), convert the camera world coordinate position to screen coordinates, and when the camera movement is within the range of movement values, the scene model is not reset; if it exceeds the range, the camera view is reset.

[0104] It should be noted that by setting the range of movement values ​​for the target coordinate axis, the camera position can be reset when the movement value exceeds the range, which solves the problem of large scene displacement and can improve the user's interactive experience.

[0105] Therefore, the technical solution of this invention achieves the goal of displaying building model tags, selecting building models, and prompting users to take relevant ability tests on the web page of the intelligent assessment platform for teachers' professional abilities. This improves the controllability of the electronic sand table model and solves the technical problem of poor controllability of the electronic sand table model in the prior art.

[0106] Example 2

[0107] According to an embodiment of the present invention, an embodiment of a control device for an electronic sand table is provided, wherein, Figure 8 This is a schematic diagram of an optional electronic sand table control device according to an embodiment of the present invention, such as... Figure 8 As shown, the device includes: a first acquisition module 801, used to acquire the model file of the target electronic sand table and generate the target electronic sand table based on the model file, wherein the target electronic sand table includes multiple three-dimensional building models; a first processing module 802, used to perform coordinate transformation processing on the three-dimensional coordinate systems corresponding to the multiple three-dimensional building models to obtain two-dimensional coordinate systems corresponding to the multiple three-dimensional building models; a second processing module 803, used to determine the labels corresponding to the multiple three-dimensional building models and display the labels corresponding to the multiple three-dimensional building models in the two-dimensional coordinate systems corresponding to the multiple three-dimensional building models; a second acquisition module 804, used to acquire the operation information of the target control and determine the target three-dimensional building model selected by the target object based on the operation information, wherein the operation information is generated in response to the operation command triggered by the target object through the target control on the multiple three-dimensional building models; and a third processing module 805, used to generate target prompt information based on the target three-dimensional building model, wherein the target prompt information corresponds to the target three-dimensional building model and is used to prompt the target object to perform a professional ability test in the scene corresponding to the target three-dimensional building model.

[0108] It should be noted that the first acquisition module 801, the first processing module 802, the second processing module 803, the second acquisition module 804 and the third processing module 805 mentioned above correspond to steps S101 to S105 in the above embodiments. The five modules and the corresponding steps implement the same examples and application scenarios, but are not limited to the content disclosed in the above embodiment 1.

[0109] Optionally, the first processing module includes: a third acquisition module for acquiring a first coordinate vector, wherein the first coordinate vector is a representation vector of a three-dimensional coordinate system; a fourth processing module for performing coordinate transformation processing on the first coordinate vector according to a matrix transformation function to obtain a second coordinate vector, wherein the second coordinate vector is a representation vector of a camera coordinate system; and a fifth processing module for performing projection transformation processing on the second coordinate vector to obtain a third coordinate vector, wherein the third coordinate vector is a representation vector of a two-dimensional coordinate system.

[0110] Optionally, the second processing module includes: a first determining module, used to determine the labels corresponding to multiple 3D building models based on scene attribute information in the model file; a fourth acquiring module, used to acquire the two-dimensional coordinate vector corresponding to the camera position, where the camera position is the viewing position of the current viewpoint; a first calculating module, used to calculate the position coordinate vectors of the labels corresponding to the multiple 3D building models in the two-dimensional coordinate system based on the two-dimensional coordinate vector corresponding to the camera position, to obtain the position coordinate vector of the label corresponding to each 3D building model; a second determining module, used to determine the position of the labels corresponding to the multiple 3D building models based on the position coordinate vector of the label corresponding to each 3D building model; and a sixth processing module, used to display the labels corresponding to the multiple 3D building models at the positions of the labels corresponding to the multiple 3D building models.

[0111] Optionally, the second acquisition module includes: a fifth acquisition module for acquiring operation information, wherein the operation information includes at least the position coordinates of the clicked position of the target control, and the position coordinates are coordinates in a two-dimensional coordinate system; a seventh processing module for inputting the position coordinates into the target ray projector for ray projection processing to obtain a tag set corresponding to the first three-dimensional building model set, wherein the first three-dimensional building model set is a model set composed of three-dimensional building models traversed by the ray emitted by the target ray projector based on the position coordinates; and a third determination module for determining the target tag from the tag set according to the tag matching rules, and determining the target three-dimensional building model according to the target tag.

[0112] Optionally, the first acquisition module includes: an eighth processing module, used to parse and process the model file to obtain scene attribute information; and a ninth processing module, used to call the model rendering function to render the scene attribute information and generate the target electronic sand table.

[0113] Optionally, the control device for the electronic sand table also includes: a tenth processing module, used to initialize the model loader and generate a model builder; and an eleventh processing module, used to process scene attribute information through the model builder to generate scene model camera, scene model lighting, and scene model operation rules for the target electronic sand table. The scene model camera is used to determine the camera position, the scene model lighting is used to display the colors of multiple 3D building models, and the scene model operation rules are used to enable the operation of the target electronic sand table.

[0114] Optionally, the control device of the electronic sand table also includes: a twelfth processing module, used to configure the range of movement values ​​of the target coordinate axis in the three-dimensional coordinate system in the target script, so as to reset the camera position when the coordinates corresponding to the camera position exceed the range of movement values.

[0115] Example 3

[0116] According to another aspect of the present invention, a computer-readable storage medium is also provided, wherein a computer program is stored in the computer-readable storage medium, and the computer program is configured to execute the above-described control method for an electronic sand table when it is run.

[0117] Example 4

[0118] According to another aspect of the present invention, an electronic device is also provided, wherein, Figure 9 This is a schematic diagram of an optional electronic device according to an embodiment of the present invention, such as... Figure 9 As shown, the electronic device includes one or more processors; and a memory for storing one or more programs, which, when executed by one or more processors, enable the one or more processors to run the programs, wherein the programs are configured to execute the control method of the electronic sandbox described above during runtime.

[0119] The devices mentioned in this article can be servers, PCs, tablets, mobile phones, etc.

[0120] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0121] In the above embodiments of the present invention, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0122] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units can be a logical functional division, and in actual implementation, there may be other division methods. For instance, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling, direct coupling, or communication connection may be through some interfaces; the indirect coupling or communication connection between units or modules may be electrical or other forms.

[0123] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0124] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0125] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0126] The above description is only a preferred embodiment of the present invention. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A control method for an electronic sand table, characterized in that, Applications to intelligent assessment platforms for teacher professional competence include: Obtain the model file of the target electronic sand table, and generate the target electronic sand table based on the model file, wherein the target electronic sand table includes multiple three-dimensional building models; The coordinate transformation process is performed on the three-dimensional coordinate system corresponding to the multiple three-dimensional building models to obtain the two-dimensional coordinate system corresponding to the multiple three-dimensional building models. The two-dimensional coordinate system is the screen two-dimensional coordinate system relative to the screen. The three-dimensional building models in the three-dimensional coordinate system are transformed into the screen two-dimensional coordinate system for display. The labels corresponding to the multiple three-dimensional building models are determined, and the labels corresponding to the multiple three-dimensional building models are displayed in the two-dimensional coordinate system corresponding to the multiple three-dimensional building models; Obtain operation information of the target control, and determine the target 3D building model selected by the target object based on the operation information, wherein the operation information is generated in response to the operation instructions triggered by the target object on the multiple 3D building models through the target control; Based on the target 3D building model, target prompt information is generated, wherein the target prompt information corresponds to the target 3D building model, and the target prompt information is used to prompt the target object to conduct a professional ability test in the scene corresponding to the target 3D building model; Determine the labels corresponding to the multiple 3D building models, and display the labels corresponding to the multiple 3D building models in the corresponding 2D coordinate system, including: Based on the scene attribute information in the model file, determine the labels corresponding to the multiple 3D building models; Obtain the two-dimensional coordinate vector corresponding to the camera position, where the camera position is the viewing position of the current viewpoint; Based on the two-dimensional coordinate vector corresponding to the camera position, calculate the position coordinate vector of the label corresponding to each of the multiple three-dimensional building models in the two-dimensional coordinate system to obtain the position coordinate vector of the label corresponding to each three-dimensional building model; The positions of the labels corresponding to the multiple 3D building models are determined based on the position coordinate vectors of the labels corresponding to each 3D building model. The labels corresponding to the multiple 3D building models are displayed at their respective positions.

2. The method according to claim 1, characterized in that, The coordinate transformation process is performed on the three-dimensional coordinate systems corresponding to the multiple three-dimensional building models to obtain the two-dimensional coordinate systems corresponding to the multiple three-dimensional building models, including: Obtain a first coordinate vector, wherein the first coordinate vector is the representation vector of the three-dimensional coordinate system; According to the matrix transformation function, the first coordinate vector is transformed to obtain the second coordinate vector, where the second coordinate vector is the representation vector of the camera coordinate system; The second coordinate vector is subjected to a projection transformation to obtain a third coordinate vector, wherein the third coordinate vector is the representation vector of the two-dimensional coordinate system.

3. The method according to claim 1, characterized in that, Obtaining operation information of the target control, and determining the target 3D building model selected by the target object based on the operation information, including: The operation information is obtained, wherein the operation information includes at least the position coordinates of the click position of the target control, and the position coordinates are coordinates in the two-dimensional coordinate system; The location coordinates are input into the target ray projector for ray projection processing to obtain a tag set of tags corresponding to the first three-dimensional building model set. The first three-dimensional building model set is a model set composed of three-dimensional building models through which the light emitted by the target ray projector based on the location coordinates passes. According to the tag matching rules, the target tag is determined from the tag set, and the target three-dimensional building model is determined based on the target tag.

4. The method according to claim 1, characterized in that, Based on the model file, the target electronic sand table is generated, including: The model file is parsed to obtain scene attribute information; The model rendering function is invoked to render the scene attribute information and generate the target electronic sand table.

5. The method according to claim 4, characterized in that, After parsing the model file to obtain scene attribute information, the method further includes: Initialize the model loader and generate the model builder; The scene creation process is performed on the scene attribute information by the model builder to generate the scene model camera, scene model lighting, and scene model operation rules of the target electronic sand table. The scene model camera is used to determine the camera position, the scene model lighting is used to realize the color display of the multiple three-dimensional building models, and the scene model operation rules are used to realize the operation of the target electronic sand table.

6. The method according to claim 5, characterized in that, Before calling the model rendering function to render the scene attribute information and generate the target electronic sand table, the method further includes: Configure the range of movement values ​​for the target coordinate axes of the three-dimensional coordinate system in the target script so that the camera position can be reset if the coordinates corresponding to the camera position exceed the range of movement values.

7. A control device for an electronic sand table, characterized in that, For performing the method according to any one of claims 1 to 6, comprising: The first acquisition module is used to acquire the model file of the target electronic sand table and generate the target electronic sand table according to the model file, wherein the target electronic sand table includes multiple three-dimensional building models; The first processing module is used to perform coordinate transformation processing on the three-dimensional coordinate system corresponding to the multiple three-dimensional building models to obtain the two-dimensional coordinate system corresponding to the multiple three-dimensional building models. The second processing module is used to determine the labels corresponding to the multiple three-dimensional building models and display the labels corresponding to the multiple three-dimensional building models in the two-dimensional coordinate system corresponding to the multiple three-dimensional building models. The second acquisition module is used to acquire operation information of the target control and determine the target 3D building model selected by the target object based on the operation information, wherein the operation information is generated in response to the operation instructions triggered by the target object on the multiple 3D building models through the target control; The third processing module is used to generate target prompt information based on the target 3D building model, wherein the target prompt information corresponds to the target 3D building model and is used to prompt the target object to conduct a professional ability test in the scene corresponding to the target 3D building model.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, wherein the computer program is configured to execute the control method of the electronic sand table according to any one of claims 1 to 6 when it is run.

9. An electronic device, characterized in that, The electronic device includes one or more processors; A memory for storing one or more programs, which, when executed by one or more processors, cause the one or more processors to be configured to run the programs, wherein the programs are configured to execute the control method of the electronic sand table as described in any one of claims 1 to 6.

Images