Obstacle visualization implementation method and device

By using the coordinates of the mobile device, quadrilateral size and target block position to generate obstacle images, the problem of large amount of data interaction in the prior art is solved, and efficient visualization and stable image refresh of obstacles around the mobile device are realized.

CN119048592APending Publication Date: 2024-11-29SHENZHEN MAMMOTION INNOVATION CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411047949.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-01
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

The existing methods of visualizing obstacles around mobile devices rely on real-time video, resulting in large amounts of data interactions and making it difficult to achieve efficient visualization of obstacles.

Method used

The obstacle image is generated by mobile device coordinates, quadrilateral size, cell size and relative position of at least one target square in the quadrilateral, reducing the amount of data interaction and visualizing the obstacle.

Benefits of technology

Visualization of obstacles around mobile devices through a small amount of data interaction reduces the difficulty of visualization of obstacles, and improves image refresh frequency and processing stability.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119048592A_ABST
    Figure CN119048592A_ABST
Patent Text Reader

Abstract

The invention provides an obstacle visualization implementation method and device, and the method comprises the steps: responding to the received obstacle related data sent by a mobile device, and displaying an obstacle image, the obstacle image comprising a first image block and a second image block; wherein the first image block is used for representing a mobile device, the second image block is used for representing an obstacle, and the obstacle related data comprises a mobile device coordinate, a quadrangle size, a cell size and a relative position of at least one target block in a quadrangle; the quadrangle corresponds to a visible area determined with the mobile device as the center, the quadrangle is composed of a plurality of cells, and the at least one target square block corresponds to the second image block. Therefore, the visualization realization difficulty of the obstacle can be reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the general field of data processing technology, and in particular to a method and device for realizing obstacle visualization. Background Art

[0002] At present, the existing obstacle visualization method around mobile devices is mainly based on real-time video. Users can preview the video image data around the mobile device in real time through the terminal device. However, this method requires the distribution of video streaming servers, and the amount of data interaction is large, making it difficult to visualize obstacles. Summary of the invention

[0003] The present application provides a method and device for realizing obstacle visualization, which can realize obstacle visualization through mobile device coordinates, quadrilateral size, cell size and the relative position of at least one target block in the quadrilateral, thereby reducing the difficulty of realizing obstacle visualization.

[0004] In a first aspect, the present application provides a method for realizing obstacle visualization, which is applied to a terminal device, and the method includes:

[0005] In response to receiving obstacle-related data sent by the mobile device, displaying an obstacle image, the obstacle image including a first image block and a second image block;

[0006] Among them, the first image block is used to represent the mobile device, and the second image block is used to represent the obstacle. The obstacle-related data includes the coordinates of the mobile device, the size of the quadrilateral, the size of the cell, and the relative position of at least one target block in the quadrilateral. The quadrilateral corresponds to the visible area determined with the mobile device as the center. The quadrilateral is composed of multiple cells, and at least one target block corresponds to the second image block.

[0007] It can be seen that in the present application, the received obstacle-related data include the coordinates of the mobile device, the size of the quadrilateral, the size of the cell, and the relative position of at least one target block in the quadrilateral, and an obstacle image is generated in response thereto. Compared with the large amount of data corresponding to the interaction with the existing video image data, the present application can realize the visualization of obstacles around the mobile device through a small amount of data interaction, thereby reducing the difficulty of realizing obstacle visualization.

[0008] In a feasible example, before displaying the obstacle image, the method also includes: determining the vertex coordinates of the quadrilateral based on the mobile device coordinates and the size of the quadrilateral; determining the vertex coordinates of at least one target block based on the mobile device coordinates, the size of the quadrilateral, the cell size and the relative position of at least one target block in the quadrilateral; generating the obstacle image based on the mobile device coordinates, the vertex coordinates of the quadrilateral and the vertex coordinates of at least one target block.

[0009] In the present application, coordinates corresponding to components of an obstacle image are generated according to obstacle-related data, and then an obstacle image is generated based on the coordinates, thereby reducing the difficulty of realizing obstacle visualization.

[0010] In a feasible example, before displaying the obstacle image, the method also includes: receiving obstacle-related data sent by a mobile device according to a preset frequency; wherein the preset frequency is determined based on the computing power corresponding to the terminal device, and the higher the computing power corresponding to the terminal device, the higher the frequency of receiving obstacle-related data.

[0011] In the present application, by adaptively adjusting the frequency at which the terminal device receives obstacle-related data according to the computing power corresponding to the terminal device, the stability of the terminal device in processing obstacle-related data can be ensured on the basis of increasing the refresh frequency corresponding to the obstacle image.

[0012] In a feasible example, if the quadrilateral is a rectangle, the vertex coordinates of the quadrilateral are determined according to the mobile device coordinates and the size of the quadrilateral, including: determining the horizontal axis coordinates in the vertex coordinates of the quadrilateral according to the product of the first side length in the quadrilateral size and the cosine value corresponding to the first angle, the product of the second side length in the quadrilateral size and the sine value corresponding to the first angle, and the horizontal axis coordinates in the mobile device coordinates, the first angle is the angle between the orientation of the mobile device and the vertical axis in the coordinate axis of the mobile device coordinates, the first side length is the length of the side of the quadrilateral corresponding to the orientation of the mobile device, and the second side length is different from the first side length; determining the vertical axis coordinates in the vertex coordinates of the quadrilateral according to the product of the first side length in the quadrilateral size and the sine value corresponding to the first angle, the product of the second side length in the quadrilateral size and the cosine value corresponding to the first angle, and the vertical axis coordinates in the mobile device coordinates.

[0013] In the present application, by introducing the first angle corresponding to the orientation of the mobile device, the mobile device can calculate the vertex coordinates of the rectangle based on the fixed coordinate axes during movement, thereby improving the efficiency of calculating the vertex coordinates of the rectangle.

[0014] In a feasible example, if the quadrilateral is a rectangle, the vertex coordinates of at least one target block are determined according to the mobile device coordinates, the quadrilateral size, the cell size, and the relative position of at least one target block in the quadrilateral, including: determining the row and column position of each target block in the plurality of small blocks included in the quadrilateral according to the first side length in the quadrilateral size, the cell size, and the relative position of at least one target block in the quadrilateral; determining the vertex coordinates of each target block in the plurality of small blocks included in the quadrilateral according to the product of the first side length and the first length in the quadrilateral size and the cosine value corresponding to the first angle, the product of the second side length and the second length in the quadrilateral size and the sine value corresponding to the first angle, and the horizontal axis coordinates in the mobile device coordinates. The horizontal axis coordinate in the vertex coordinates of the target blocks, the first length is the product of the row position and the cell size of each target block, the second length is the product of the column position and the cell size of each target block, the first angle is the angle between the orientation of the mobile device and the vertical axis in the coordinate axis of the mobile device coordinates, the first side length is the length of the side of the quadrilateral corresponding to the orientation of the mobile device, and the second side length is different from the first side length; the vertical axis coordinate in the vertex coordinates of each target block is determined according to the product of the first side length and the first length in the quadrilateral size and the sine value corresponding to the first angle, the product of the second side length and the second length in the quadrilateral size and the cosine value corresponding to the first angle, and the vertical axis coordinate in the mobile device coordinates.

[0015] In the present application, the probability of the orientation of the mobile device is also introduced when calculating the vertex coordinates of the target block, so that the mobile device can also calculate the vertex coordinates of the target block based on the fixed coordinate axes during the movement, thereby improving the efficiency of calculating the vertex coordinates of the target block.

[0016] In a feasible example, an obstacle image is generated based on the coordinates of a mobile device, the vertex coordinates of a quadrilateral, and the vertex coordinates of at least one target block, including: converting the coordinates of the mobile device, the vertex coordinates of a quadrilateral, and the vertex coordinates of at least one target block into longitude and latitude points, respectively; generating a quadrilateral image and a first image block on a map corresponding to the position of the mobile device based on the longitude and latitude points corresponding to the vertex coordinates of the quadrilateral and the coordinates of the mobile device, respectively; generating a second image block on the quadrilateral image based on the longitude and latitude points corresponding to the vertex coordinates of the at least one target block, the pixel values ​​corresponding to the second image block being different from the pixel values ​​corresponding to the quadrilateral image.

[0017] In the present application, by displaying obstacle images on a map, it is helpful for users to determine the actual location of the obstacles.

[0018] In a feasible example, before generating an obstacle image according to the coordinates of the mobile device, the vertex coordinates of the quadrilateral and the vertex coordinates of at least one target block, the method further includes: eliminating the obstacle image in the map displayed on the display interface corresponding to the terminal device.

[0019] In the present application, before each obstacle image is generated, it is necessary to eliminate the obstacle image in the map displayed on the display interface of the terminal device to avoid display errors caused by image overlap.

[0020] In a feasible example, after receiving obstacle-related data sent by a mobile device according to a preset frequency, the method also includes: if the second obstacle-related data is not received within a preset time length after receiving the first obstacle-related data, eliminating the display information on the display interface corresponding to the terminal device, the first obstacle-related data is the obstacle-related data generated before the second obstacle-related data, and the preset time length is greater than the time length corresponding to the preset frequency.

[0021] In the present application, when the terminal device has not received obstacle-related data for a long time, the display information on the display interface corresponding to the terminal device is eliminated, so as to reflect to the user that there are problems in the interaction process of obstacle-related data, thereby improving the stability of generating obstacle images.

[0022] In a second aspect, the present application provides a device for realizing obstacle visualization, which is applied to a terminal device, and includes:

[0023] In response to receiving the obstacle-related data sent by the mobile device according to the receiving unit, the feedback unit is used to display an obstacle image, where the obstacle image includes a first image block and a second image block;

[0024] Among them, the first image block is used to represent the mobile device, and the second image block is used to represent the obstacle. The obstacle-related data includes the coordinates of the mobile device, the size of the quadrilateral, the size of the cell, and the relative position of at least one target block in the quadrilateral. The quadrilateral corresponds to the visible area determined with the mobile device as the center. The quadrilateral is composed of multiple cells, and at least one target block corresponds to the second image block.

[0025] In a third aspect, the present application provides an electronic device comprising a processor, a memory, and a communication interface. The processor, the memory, and the communication interface are interconnected and perform communication with each other. The memory stores executable program code, the communication interface is used for wireless communication, and the processor is used to call the executable program code stored in the memory to execute, for example, some or all of the steps described in any method of the first aspect.

[0026] In a fourth aspect, the present application provides a computer-readable storage medium, in which electronic data is stored. When the electronic data is executed by a processor, it is used to execute the electronic data to implement some or all of the steps described in the first aspect of the present application.

[0027] In a fifth aspect, the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps described in the first aspect of the present application. The computer program product may be a software installation package. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0029] Figure 1 A schematic diagram of the structure of an obstacle visualization implementation system provided in an embodiment of the present application;

[0030] Figure 2 A flowchart of a method for implementing obstacle visualization provided in an embodiment of the present application;

[0031] Figure 3 A schematic diagram of a process for generating an obstacle image provided in an embodiment of the present application;

[0032] Figure 4 A schematic diagram of the structure of a quadrilateral image provided in an embodiment of the present application;

[0033] Figure 5 A schematic diagram of a structure of multiple small blocks provided in an embodiment of the present application;

[0034] Figure 6 A schematic diagram of a display interface provided in an embodiment of the present application;

[0035] Figure 7 A block diagram of the functional units of an obstacle visualization implementation device provided in an embodiment of the present application;

[0036] Figure 8 A block diagram of the functional units of another obstacle visualization implementation device provided in an embodiment of the present application;

[0037] Fig. 9 A structural block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0038] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0039] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps is not limited to the listed steps, but optionally includes steps that are not listed, or optionally includes other steps inherent to these processes, methods, products or devices.

[0040] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0041] See also Figure 1 , Figure 1 A schematic diagram of the structure of an obstacle visualization implementation system provided in an embodiment of the present application is shown in FIG. Figure 1 As shown, the obstacle visualization implementation system 100 includes a mobile device 101 and a terminal device 102 .

[0042] The mobile device 101 refers to a device that can be moved by tires, tracks or rotating paddles, such as a lawn mower robot, a drone and other devices. The mobile device 101 includes a camera or other sensors for scanning the surrounding environment and converting the scanned obstacles into obstacle-related data. The obstacle-related data may specifically include the coordinates of the mobile device 101, the size of a quadrilateral corresponding to a visible area determined with the mobile device 101 as the center, the size of a cell included in the quadrilateral, and the relative position of at least one target block corresponding to an obstacle in the quadrilateral.

[0043] The terminal device 102 is used to receive obstacle-related data sent by the mobile device 101, and after processing the obstacle-related data, generate an obstacle image on the display interface corresponding to the terminal device 102. The terminal device 102 includes but is not limited to a desktop computer, a laptop computer, a tablet computer, a smart phone, etc. The data interaction between the mobile device 101 and the terminal device 102 can be based on an iot link, such as Wi-Fi, Bluetooth, ZigBee, LoRa, NB-IoT, 5G and other wireless communication technologies.

[0044] Specifically, after receiving the obstacle-related data sent by the mobile device 101, the terminal device 102 generates an obstacle image based on the obstacle data and displays it. The obstacle image includes a first image block and a second image block. The first image block is used to represent the mobile device, and the second image block is used to represent the obstacle. The obstacle-related data includes the coordinates of the mobile device, the size of the quadrilateral, the size of the cell, and the relative position of at least one target block in the quadrilateral. The quadrilateral corresponds to the visible area determined with the mobile device as the center. The quadrilateral is composed of multiple cells, and at least one target block corresponds to the second image block. It can be seen that the amount of data exchanged between the terminal device 102 and the mobile device 101 is small, and the visualization of the obstacle can be achieved through this small amount of data, thereby reducing the difficulty of realizing the visualization of the obstacle.

[0045] Based on this, an embodiment of the present application provides a method for realizing obstacle visualization, and the embodiment of the present application is described in detail below with reference to the accompanying drawings.

[0046] See also Figure 2 , Figure 2 A flowchart of a method for realizing obstacle visualization provided in an embodiment of the present application is provided, and the method is applied to the above-mentioned terminal device, such as Figure 2 As shown, the method comprises the following steps:

[0047] Step S201: The terminal device receives obstacle-related data sent by the mobile device.

[0048] Among them, the obstacle-related data include the coordinates of the mobile device, the size of the quadrilateral, the size of the cell, and the relative position of at least one target block in the quadrilateral. The quadrilateral corresponds to the visible area determined with the mobile device as the center, and the quadrilateral is composed of multiple cells. The visible area can be determined based on the camera or other sensors on the mobile device. The coordinates of the mobile device can be determined based on a preset coordinate system, for example, it can be a coordinate system determined by the four directions of southeast, northwest, and northeast as coordinate axes and the position of the terminal device as the origin. It can be understood that the size of the quadrilateral, the size of the cell, etc. should correspond to the units of the coordinate system corresponding to the coordinates of the mobile device.

[0049] In a feasible embodiment, before displaying the obstacle image, the method also includes: receiving obstacle-related data sent by a mobile device according to a preset frequency; wherein the preset frequency is determined based on the computing power corresponding to the terminal device, and the higher the computing power corresponding to the terminal device, the higher the frequency of receiving obstacle-related data.

[0050] Among them, corresponding to the terminal device receiving obstacle-related data sent by the mobile device according to the preset frequency, the mobile device will send obstacle-related data to the terminal device according to the preset frequency. After the terminal device receives the obstacle-related data, it needs to process the obstacle-related data to generate an obstacle image. Then the corresponding terminal device's reception frequency of obstacle-related data (the mobile device's transmission frequency of obstacle-related data) should also correspond to the hardware processing performance of the terminal device. Therefore, this embodiment characterizes the hardware processing performance of the terminal device by the computing power corresponding to the terminal device. The computing power refers to the ability of a computer device or a computing / data center to process information. The level of computing power directly affects the computing speed and efficiency of the device. When the computing power corresponding to the terminal device is higher, it means that the hardware processing performance of the terminal device is higher, then the frequency of the corresponding terminal device receiving obstacle-related data can also be higher, and correspondingly, the frequency of the mobile device sending obstacle-related information to the terminal device is also higher.

[0051] In the present application, by adaptively adjusting the frequency at which the terminal device receives obstacle-related data according to the computing power corresponding to the terminal device, the stability of the terminal device in processing obstacle-related data can be ensured on the basis of increasing the refresh frequency corresponding to the obstacle image.

[0052] Step S202: the terminal device displays an obstacle image in response to receiving obstacle-related data sent by the mobile device.

[0053] The obstacle image includes a first image block and a second image block, the first image block is used to represent the mobile device, and the second image block is used to represent the obstacle. At least one target block in the aforementioned obstacle-related data corresponds to the second image block, and the quadrilateral may refer to a frame corresponding to the obstacle image. The position of the first image block corresponds to the coordinates of the mobile device.

[0054] Below through Figure 3 The obstacle image generation process is described in detail.

[0055] See also Figure 3 , Figure 3 A flowchart of an obstacle image generation process provided in an embodiment of the present application is shown as follows: Figure 3 As shown, including:

[0056] Step S301: The terminal device determines the vertex coordinates of the quadrilateral according to the coordinates of the mobile device and the size of the quadrilateral.

[0057] Among them, the position of the mobile device corresponds to the center of the quadrilateral, so the coordinates of the four vertices of the quadrilateral can be determined by the mobile device coordinates and the size of the quadrilateral. It can be known that the size of the quadrilateral can include all the side lengths and angles of the quadrilateral, and the angle includes not only the angles of the four corners of the quadrilateral, but also the angle of each side of the quadrilateral relative to the coordinate axis of the mobile device coordinates.

[0058] In a feasible embodiment, if the quadrilateral is a rectangle, the vertex coordinates of the quadrilateral are determined according to the mobile device coordinates and the size of the quadrilateral, including: determining the horizontal axis coordinates in the vertex coordinates of the quadrilateral according to the product of the first side length in the quadrilateral size and the cosine value corresponding to the first angle, the product of the second side length in the quadrilateral size and the sine value corresponding to the first angle, and the horizontal axis coordinates in the mobile device coordinates, the first angle is the angle between the orientation of the mobile device and the vertical axis in the coordinate axis of the mobile device coordinates, the first side length is the length of the side of the quadrilateral corresponding to the orientation of the mobile device, and the second side length is different from the first side length; determining the vertical axis coordinates in the vertex coordinates of the quadrilateral according to the product of the first side length in the quadrilateral size and the sine value corresponding to the first angle, the product of the second side length in the quadrilateral size and the cosine value corresponding to the first angle, and the vertical axis coordinates in the mobile device coordinates.

[0059] Among them, when the quadrilateral is a rectangle, it can be known that the four sides of the quadrilateral correspond to each other and the angles of the four corners of the quadrilateral are ninety degrees. If the orientation of the mobile device does not correspond to the longitudinal axis of the coordinate axis at this time, the vertex coordinates of the quadrilateral cannot be directly determined according to the coordinates of the mobile device and the side length of the quadrilateral. At this time, the angle between the orientation of the mobile device and the longitudinal axis of the coordinate axis of the mobile device coordinates is introduced, that is, the first angle. Then the horizontal axis coordinates in the vertex coordinates of the quadrilateral are determined according to the product between the first side length in the quadrilateral size and the cosine value corresponding to the first angle, the product between the second side length in the quadrilateral size and the sine value corresponding to the first angle, and the horizontal axis coordinates in the mobile device coordinates, and the vertical axis coordinates in the vertex coordinates of the quadrilateral are determined according to the product between the first side length in the quadrilateral size and the sine value corresponding to the first angle, the product between the second side length in the quadrilateral size and the cosine value corresponding to the first angle, and the vertical axis coordinates in the mobile device coordinates. It can be understood that, since the quadrilateral corresponds to the visible area determined with the mobile device as the center, the quadrilateral should be symmetrical based on the straight line corresponding to the orientation of the mobile device.

[0060] For example, see Figure 4 , Figure 4 A schematic diagram of the structure of a quadrilateral image provided in an embodiment of the present application is shown in FIG. Figure 4As shown, a rectangle ABCD and a target block EFGH of multiple small blocks in the rectangle ABCD are shown. It can be seen that the rectangle ABCD is symmetrical based on the orientation 402 of the identifier 401 of the mobile device. If the coordinates corresponding to the identifier 401 of the mobile device are determined to be (x, y), the first angle corresponding to the orientation (yaw) 402 is θ, the first side length AD is width, the second side length AB is height, and the coordinates of the four vertices of the rectangle ABCD are A (ax, ay), B (bx, by), C (cx, cy), and D (dx, dy), respectively, then the coordinate calculation formula is as follows:

[0061] Point A: ax=x-width / 2*cosθ+height / 2*sinθ, ay=y+width / 2*sinθ+height / 2*cosθ; Point B: bx=x-width / 2*cosθ-height / 2*sinθ, by=y+width / 2*sinθ-height / 2*cosθ; Point C: cx=x+width / 2*cosθ-height / 2*sinθ, cy=y-width / 2*sinθ-height / 2*cosθ; Point D: dx=x+width / 2*cosθ+height / 2*sinθ, dy=y-width / 2*sinθ+height / 2*cosθ.

[0062] In the present application, by introducing the first angle corresponding to the orientation of the mobile device, the mobile device can calculate the vertex coordinates of the rectangle based on the fixed coordinate axes during movement, thereby improving the efficiency of calculating the vertex coordinates of the rectangle.

[0063] Step S302: The terminal device determines the vertex coordinates of at least one target block according to the coordinates of the mobile device, the size of the quadrilateral, the size of the cell, and the relative position of at least one target block in the quadrilateral.

[0064] Among them, since the coordinates of the mobile device correspond to the center of the quadrilateral, the relative position between at least one target block and the coordinates of the mobile device can be determined according to the size of the quadrilateral, the size of the cell and the relative position of at least one block in the quadrilateral, and then the coordinates of the four vertices of the at least one target block can be obtained.

[0065] Specifically, in a feasible embodiment, if the quadrilateral is a rectangle, the vertex coordinates of at least one target block are determined according to the mobile device coordinates, the quadrilateral size, the cell size, and the relative position of at least one target block in the quadrilateral, including: determining the row and column position of each target block in the plurality of small blocks included in the quadrilateral according to the first side length in the quadrilateral size, the cell size, and the relative position of at least one target block in the quadrilateral; determining the vertex coordinates of at least one target block according to the product of the first side length and the first length in the quadrilateral size and the cosine value corresponding to the first angle, the product of the second side length and the second length in the quadrilateral size and the sine value corresponding to the first angle, and the horizontal axis coordinates in the mobile device coordinates. The horizontal axis coordinate in the vertex coordinates of each target block is determined, the first length is the product of the row position and the cell size of each target block, the second length is the product of the column position and the cell size of each target block, the first angle is the angle between the orientation of the mobile device and the vertical axis in the coordinate axis of the mobile device coordinates, the first side length is the length of the side of the quadrilateral corresponding to the orientation of the mobile device, and the second side length is different from the first side length; the vertical axis coordinate in the vertex coordinates of each target block is determined according to the product of the first side length and the first length in the quadrilateral size and the sine value corresponding to the first angle, the product of the second side length and the second length in the quadrilateral size and the cosine value corresponding to the first angle, and the vertical axis coordinate in the mobile device coordinates.

[0066] The relative position of at least one target block in the quadrilateral may be represented by a subscript of at least one target block. For example, see Figure 5 , Figure 5 A schematic diagram of a structure of multiple small blocks provided in an embodiment of the present application, such as Figure 5 As shown, a rectangle is composed of multiple small squares of a 6×5 structure, and each small square has a corresponding subscript (as shown in the numbers in the figure), which is represented by numbers 1-29 from left to right and from top to bottom. In this embodiment, the number of small squares corresponding to the first side length of the quadrilateral can be determined by the first side length of the quadrilateral size and the unit cell size, such as Figure 5 It includes 6 small squares. At the same time, the row and column positions of the target square can be obtained according to the number of multiple small squares corresponding to the first side length and the subscript of the target square. The specific formula is: the row position of the target square xNum = i / widthNum, the column position of the target square yNum = i%widthNum, where widthNum is used to represent the number of small squares corresponding to the first side length of the quadrilateral.

[0067] exist Figure 5, if there is a target block with a subscript of 3 and the number of small blocks corresponding to the first side length is 6, then according to the formula, the row position of the target block is 0 (the quotient obtained by dividing the subscript of the target block by the number of small blocks corresponding to the first side length is 0, and since the subscript starts counting from 0, 0 represents the first position), and the target formula obtains the column position of the target block as 3 (the remainder obtained by dividing the subscript of the target block by the number of small blocks corresponding to the first side length is 3, and since the subscript starts counting from 0, 0 represents the first position).

[0068] After obtaining the row and column positions of each target block in the plurality of small blocks included in the quadrilateral, and at the same time introducing the orientation of the mobile device, the horizontal axis coordinates in the vertex coordinates of each target block need to be determined according to the product of the first side length and the first length in the quadrilateral size and the cosine value corresponding to the first angle, the product of the second side length and the second length in the quadrilateral size and the sine value corresponding to the first angle, and the horizontal axis coordinates in the mobile device coordinates. And the vertical axis coordinates in the vertex coordinates of each target block need to be determined according to the product of the first side length and the first length in the quadrilateral size and the sine value corresponding to the first angle, the product of the second side length and the second length in the quadrilateral size and the cosine value corresponding to the first angle, and the vertical axis coordinates in the mobile device coordinates. At this time, the first length is the product of the row position and the cell size of each target block, and the second length is the product of the column position and the cell size of each target block.

[0069] For example, if the coordinates of the mobile device are (x, y) and the first angle corresponding to the orientation (yaw) of the mobile device is θ, then Figure 4The calculation formulas for the four vertex coordinates E(Ex, Ey), F(Fx, Fy), G(Gx, Gy), and H(Hx, Hy) of the target block EFGH shown in are as follows. Point E: Ex=x+(xNum*unit-width / 2)*cosθ+(yNum*unit-height / 2)*sinθ, Ey=y-(-width / 2+xNum*unit)*sinθ+(yNum*unit-height / 2)*cosθ; Point F: Fx=x+((xNum+1)*unit-width / 2)*cosθ+(yNum*unit-height / 2)*sinθ, Fy=y-(-width / 2+(xNum+1)*unit)*sinθ+(yNum*unit-height / 2)*cosθ; Point G: Gx=x+ ((xNum+1)*unit-wdith / 2)*cosθ+((yNum+1)*unit-height / 2)*sinθ, Gy=y-(-wdith / 2+(xNum+1)*unit)*sinθ+((yNum+1)*unit-height / 2)*cosθ; H point: Hx=x+(xNum*unit-width / 2)*cosθ+((yNum+1)*unit-height / 2)*sinθ, Hy=y-(-width / 2+xNum*unit)*sinθ+((yNum+1)*unit-height / 2)*cosθ.

[0070] In the present application, the probability of the orientation of the mobile device is also introduced when calculating the vertex coordinates of the target block, so that the mobile device can also calculate the vertex coordinates of the target block based on the fixed coordinate axes during the movement, thereby improving the efficiency of calculating the vertex coordinates of the target block.

[0071] Step S303: The terminal device generates an obstacle image according to the coordinates of the mobile device, the vertex coordinates of the quadrilateral, and the vertex coordinates of at least one target block.

[0072] Among them, at least one target block corresponds to the second image block, so the border or background of the obstacle image can be determined according to the vertex coordinates of the quadrilateral, and the second image block corresponding to the obstacle is generated in the background of the obstacle image based on the coordinates of at least one target block, which is conducive to reflecting the relative position of the obstacle and the mobile device according to the relative position between the second image block and the first image block.

[0073] Specifically, in a feasible embodiment, an obstacle image is generated according to the coordinates of the mobile device, the vertex coordinates of a quadrilateral, and the vertex coordinates of at least one target block, including: converting the coordinates of the mobile device, the vertex coordinates of the quadrilateral, and the vertex coordinates of at least one target block into longitude and latitude points respectively; generating a quadrilateral image and a first image block on a map corresponding to the position of the mobile device based on the longitude and latitude points corresponding to the vertex coordinates of the quadrilateral and the coordinates of the mobile device respectively; generating a second image block on the quadrilateral image based on the longitude and latitude points corresponding to the vertex coordinates of at least one target block, the pixel values ​​corresponding to the second image block being different from the pixel values ​​corresponding to the quadrilateral image.

[0074] Among them, the coordinates of the mobile device, the vertex coordinates of the quadrilateral, and the vertex coordinates of at least one target block are converted into longitude and latitude points respectively. The longitude and latitude of the coordinate origin can be determined based on the real-time kinematic carrier phase difference technology (RTK), and the longitude and latitude points corresponding to the coordinates of the mobile device, the vertex coordinates of the quadrilateral, and the vertex coordinates of at least one target block are determined accordingly. Due to the longitude and latitude corresponding to each point on the map, a quadrilateral image is first generated on the map corresponding to the position of the mobile device based on the longitude and latitude points corresponding to the vertex coordinates of the quadrilateral, which is conducive to the user to determine the actual position corresponding to the visible area of ​​the mobile device. The first image block can be generated when the quadrilateral image is generated, or it can be generated on the map in advance. Then, a second image block is generated on the quadrilateral image based on the longitude and latitude points corresponding to the vertex coordinates of at least one target block, which is convenient for the user to determine the specific position of the obstacle. It can be understood that the pixel value corresponding to the second image block is different from the pixel value corresponding to the quadrilateral image, which is convenient for distinguishing the background and obstacles of the obstacle image. For example, the color corresponding to the quadrilateral image is white, and the color corresponding to the second image block is black.

[0075] For example, see Figure 6 , Figure 6 A schematic diagram of a display interface provided in an embodiment of the present application is shown in FIG. Figure 6 As shown, it includes a display interface of a terminal device, wherein the display interface includes a visible area 601 (quadrilateral graphic) determined on a map background with a mobile device as the center, a second image block 602 (obstacle) composed of at least one target block, and a first image block 603 (mobile device).

[0076] In the present application, by displaying obstacle images on a map, it is helpful for users to determine the actual location of the obstacles.

[0077] In another feasible embodiment, since an obstacle refers to an object that affects the movement of a mobile device, the obstacle can be understood as an object that protrudes relative to the ground on which the mobile device moves. Furthermore, when the mobile device scans the surroundings, it can also scan the height information of the obstacle through a specific sensor. The height refers to the height relative to the ground around the obstacle, and converts it into the height information corresponding to each target block in at least one target block. Therefore, the obstacle-related data can also include the height information of each target block in at least one target block, and when generating an obstacle image based on the vertex coordinates of at least one target block, a three-dimensional image can also be generated based on the height information of each obstacle, so that the user can understand the actual height of the obstacle, thereby facilitating the user to set a corresponding moving path based on the actual height of the obstacle.

[0078] In addition, in a feasible embodiment, before generating an obstacle image based on the coordinates of the mobile device, the vertex coordinates of the quadrilateral, and the vertex coordinates of at least one target block, the method also includes: eliminating the obstacle image in the map displayed on the display interface corresponding to the terminal device.

[0079] Among them, since the obstacle-related data is received according to a preset frequency, the obstacle image generated on the display interface corresponding to the terminal device should also be continuous, that is, it will be continuously refreshed. The obstacle image originally displayed in the map needs to be eliminated before refreshing the obstacle image each time. At the same time, since the obstacle image is displayed on the map, the map will also be refreshed when the mobile device moves. At the same time, the refresh frequency of the map can be set to the refresh frequency of the obstacle image, that is, when the obstacle image is regenerated, the map of the location of the mobile device will also be regenerated.

[0080] In the present application, before each obstacle image is generated, it is necessary to eliminate the obstacle image in the map displayed on the display interface of the terminal device to avoid display errors caused by image overlap.

[0081] In addition, in a feasible embodiment, after receiving obstacle-related data sent by a mobile device according to a preset frequency, the method also includes: if the second obstacle-related data is not received within a preset time length after receiving the first obstacle-related data, then eliminating the display information on the display interface corresponding to the terminal device, the first obstacle-related data is the obstacle-related data generated before the second obstacle-related data, and the preset time length is greater than the time length corresponding to the preset frequency.

[0082] Among them, since the obstacle-related data is received according to the preset frequency, correspondingly, the mobile device sends the obstacle data to the terminal device according to the preset frequency. The terminal device will continuously refresh the obstacle image displayed on the display interface according to the continuously acquired obstacle-related data. Then, when the terminal device has not received the obstacle-related data for a long time, that is, after receiving the first obstacle-related data, the terminal device has not received the second obstacle-related data that should have been received after the first obstacle-related data for a long time, the obstacle image should be stopped from being displayed, that is, the display information on the display interface corresponding to the terminal device should be eliminated to avoid the user from making a misjudgment based on the previously displayed obstacle image. At the same time, stopping the display of the obstacle image is also helpful for the user to know that there is a fault in the terminal device when obtaining obstacle-related information. The display information may include the obstacle image, map or other displayed images.

[0083] In the present application, when the terminal device has not received obstacle-related data for a long time, the display information on the display interface corresponding to the terminal device is eliminated, so as to reflect to the user that there are problems in the interaction process of obstacle-related data, thereby improving the stability of generating obstacle images.

[0084] It can be seen that in the embodiment of the present application, the received obstacle-related data include the coordinates of the mobile device, the size of the quadrilateral, the size of the cell, and the relative position of at least one target block in the quadrilateral, and an obstacle image is generated in response thereto. Compared with the large amount of data corresponding to the interaction with the existing video image data, the present application can realize the visualization of obstacles around the mobile device through a small amount of data interaction, thereby reducing the difficulty of realizing obstacle visualization.

[0085] In accordance with the above-mentioned embodiments, please refer to Figure 7 , Figure 7 The present invention provides a functional unit block diagram of an obstacle visualization implementation device provided in an embodiment of the present invention. The obstacle visualization implementation device may be the above-mentioned terminal device or a part of the terminal device, such as Figure 7 As shown, the obstacle visualization implementation device 70 includes:

[0086] In response to receiving obstacle-related data sent by the mobile device according to the receiving unit 701, the feedback unit 702 is used to display an obstacle image, where the obstacle image includes a first image block and a second image block;

[0087] Among them, the first image block is used to represent the mobile device, and the second image block is used to represent the obstacle. The obstacle-related data includes the coordinates of the mobile device, the size of the quadrilateral, the size of the cell, and the relative position of at least one target block in the quadrilateral. The quadrilateral corresponds to the visible area determined with the mobile device as the center. The quadrilateral is composed of multiple cells, and at least one target block corresponds to the second image block.

[0088] The processing unit 703 is used to determine the vertex coordinates of the quadrilateral according to the mobile device coordinates and the size of the quadrilateral before the feedback unit 702 displays the obstacle image; determine the vertex coordinates of at least one target block according to the mobile device coordinates, the size of the quadrilateral, the cell size and the relative position of at least one target block in the quadrilateral; and generate the obstacle image according to the mobile device coordinates, the vertex coordinates of the quadrilateral and the vertex coordinates of at least one target block.

[0089] In a feasible embodiment, the receiving unit 701 is also used to receive obstacle-related data sent by a mobile device according to a preset frequency; wherein the preset frequency is determined according to the computing power corresponding to the terminal device, and the higher the computing power corresponding to the terminal device, the higher the frequency of receiving obstacle-related data.

[0090] In a feasible embodiment, if the quadrilateral is a rectangle, in terms of determining the vertex coordinates of the quadrilateral according to the mobile device coordinates and the size of the quadrilateral, the processing unit 703 is specifically used to: determine the horizontal axis coordinates in the vertex coordinates of the quadrilateral according to the product of the first side length in the size of the quadrilateral and the cosine value corresponding to the first angle, the product of the second side length in the size of the quadrilateral and the sine value corresponding to the first angle, and the horizontal axis coordinates in the mobile device coordinates, the first angle is the angle between the orientation of the mobile device and the vertical axis in the coordinate axis of the mobile device coordinates, the first side length is the length of the side of the quadrilateral corresponding to the orientation of the mobile device, and the second side length is different from the first side length; determine the vertical axis coordinates in the vertex coordinates of the quadrilateral according to the product of the first side length in the size of the quadrilateral and the sine value corresponding to the first angle, the product of the second side length in the size of the quadrilateral and the cosine value corresponding to the first angle, and the vertical axis coordinates in the mobile device coordinates.

[0091] In a feasible embodiment, if the quadrilateral is a rectangle, in terms of determining the vertex coordinates of at least one target block according to the mobile device coordinates, the quadrilateral size, the cell size, and the relative position of at least one target block in the quadrilateral, the processing unit 703 is specifically used to: determine the row and column position of each target block in the multiple small blocks included in the quadrilateral according to the first side length in the quadrilateral size, the cell size, and the relative position of at least one target block in the quadrilateral; determine the row and column position of each target block in the multiple small blocks included in the quadrilateral according to the first side length and the first length in the quadrilateral size, respectively, and the cosine value corresponding to the first angle, the product of the second side length and the second length in the quadrilateral size, respectively, and the sine value corresponding to the first angle, and the mobile device coordinates. The horizontal axis coordinate determines the horizontal axis coordinate in the vertex coordinates of each target block, the first length is the product between the row position and the cell size of each target block, the second length is the product between the column position and the cell size of each target block, the first angle is the angle between the orientation of the mobile device and the vertical axis in the coordinate axis of the mobile device coordinates, the first side length is the length of the side of the quadrilateral corresponding to the orientation of the mobile device, and the second side length is different from the first side length; the vertical axis coordinate in the vertex coordinates of each target block is determined according to the product between the first side length and the first length in the quadrilateral size and the sine value corresponding to the first angle, the product between the second side length and the second length in the quadrilateral size and the cosine value corresponding to the first angle, and the vertical axis coordinate in the mobile device coordinates.

[0092] In a feasible embodiment, in terms of generating an obstacle image based on the coordinates of the mobile device, the vertex coordinates of the quadrilateral, and the vertex coordinates of at least one target block, the processing unit 703 is specifically used to: convert the coordinates of the mobile device, the vertex coordinates of the quadrilateral, and the vertex coordinates of at least one target block into longitude and latitude points, respectively; generate a quadrilateral image and a first image block on a map corresponding to the position of the mobile device based on the longitude and latitude points corresponding to the vertex coordinates of the quadrilateral and the coordinates of the mobile device, respectively; generate a second image block on the quadrilateral image based on the longitude and latitude points corresponding to the vertex coordinates of the at least one target block, and the pixel values ​​corresponding to the second image block are different from the pixel values ​​corresponding to the quadrilateral image.

[0093] In a feasible embodiment, the processing unit 703 is also used to eliminate the obstacle image in the map displayed on the display interface corresponding to the terminal device before generating the obstacle image based on the mobile device coordinates, the vertex coordinates of the quadrilateral and the vertex coordinates of at least one target block.

[0094] In a feasible embodiment, the processing unit 703 is also used to eliminate the display information on the display interface corresponding to the terminal device if the receiving unit 701 does not receive the second obstacle-related data within a preset time after receiving the first obstacle-related data, the first obstacle-related data is the obstacle-related data generated before the second obstacle-related data, and the preset time is greater than the time corresponding to the preset frequency.

[0095] It can be understood that since the method embodiment and the device embodiment are different presentation forms of the same technical concept, the content of the method embodiment part in this application should be synchronously adapted to the device embodiment part and will not be repeated here.

[0096] In the case of integrated units, such as Figure 8 As shown, Figure 8 This is a block diagram of the functional units of another obstacle visualization implementation device 70 provided in an embodiment of the present application. Figure 8 In the embodiment, the obstacle visualization implementation device 70 includes: a processing module 812 and a communication module 811. The processing module 812 is used to control and manage the actions of the obstacle visualization implementation device 70, such as the steps of the feedback unit 702 and the processing unit 703, and / or to perform other processes of the technology described herein. The communication module 811 is used to support the interaction between the obstacle visualization implementation device 70 and other devices, such as the steps of the receiving unit 701. Figure 8 As shown, the obstacle visualization implementation device 70 may further include a storage module 813 , and the storage module 813 is used to store program codes and data of the obstacle visualization implementation device 70 .

[0097] Among them, the processing module 812 can be a processor or a controller, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements a computing function, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The communication module 811 can be a transceiver, an RF circuit or a communication interface, and the like. The storage module 813 can be a memory.

[0098] All relevant contents of each scene involved in the above method embodiment can be referred to the functional description of the corresponding functional module, which will not be repeated here. Figure 2 The obstacle visualization implementation method shown.

[0099] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When a computer instruction or computer program is loaded or executed on a computer, a process or function according to an embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. Computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired or wireless means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center containing one or more available media sets. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.

[0100] Fig. 9 This is a structural block diagram of an electronic device provided in an embodiment of the present application. Fig. 9 As shown, the electronic device 900 may include one or more of the following components: a processor 901, a memory 902 and a communication interface 903. The processor 901, the memory 902 and the communication interface 903 are interconnected and perform communication work with each other, wherein the memory 902 may store one or more computer programs, and the one or more computer programs may be configured to implement the methods described in the above embodiments when executed by one or more processors 901.

[0101] The processor 901 may include one or more processing cores. The processor 901 uses various interfaces and lines to connect the various parts of the entire electronic device 900, and executes various functions and processes data of the electronic device 900 by running or executing instructions, programs, code sets or instruction sets stored in the memory 902, and calling data stored in the memory 902. Optionally, the processor 901 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 901 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processor (Graphics Processing Unit, GPU) and a modem. It can be understood that the above-mentioned modem may not be integrated into the processor 901, and can be implemented separately through a communication chip.

[0102] The memory 902 may include a random access memory (RAM) or a read-only memory (ROM). The memory 902 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 902 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the electronic device 900 during use, etc.

[0103] It is understandable that the electronic device 900 may include more or fewer structural elements than those in the above structural block diagram, for example, a power module, physical buttons, a WiFi (Wireless Fidelity) module, a speaker, a Bluetooth module, a sensor, etc., which are not limited here.

[0104] The electronic device 900 may be a terminal device or a part of a terminal device.

[0105] An embodiment of the present application provides a computer-readable storage medium, wherein program data is stored in the computer-readable storage medium. When the program data is executed by a processor, it is used to execute part or all of the steps of any obstacle visualization implementation method recorded in the above method embodiments.

[0106] The present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps of any obstacle visualization implementation method described in the above method embodiment. The computer program product may be a software installation package.

[0107] It should be noted that, for the sake of simplicity, for any of the above-mentioned method embodiments of the obstacle visualization implementation method, they are all described as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described action sequence, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the present application.

[0108] Although the present application is described herein in conjunction with various embodiments, in the process of implementing the claimed application, those skilled in the art may understand and implement other variations of the disclosed embodiments by viewing the drawings, the disclosure, and the appended claims. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "one" does not exclude multiple situations. Certain measures are recorded in different dependent claims, but this does not mean that these measures cannot be combined to produce good results.

[0109] A person skilled in the art may understand that all or part of the steps in the various methods of the above-mentioned method for implementing the obstacle visualization method may be completed by instructing the relevant hardware through a program, and the program may be stored in a computer-readable memory, and the memory may include: a flash drive, a read-only memory (English: Read-Only Memory, abbreviated: ROM), a random access memory (English: Random Access Memory, abbreviated: RAM), a disk or an optical disk, etc.

[0110] The embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of a method and device for realizing obstacle visualization of the present application. The description of the above embodiments is only used to help understand the method and its core idea of ​​the present application; at the same time, for general technicians in this field, according to the idea of ​​a method and device for realizing obstacle visualization of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

[0111] The present application is described with reference to the flowcharts and / or block diagrams of the methods, hardware products, and computer program products of the embodiments of the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0112] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0113] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0114] It can be understood that any product that is controlled or configured to execute the processing method of the flowchart described in the method embodiment of the obstacle visualization implementation method of the present application, such as the terminal and computer program product in the above flowchart, belongs to the category of related products described in the present application.

[0115] Obviously, those skilled in the art can make various changes and modifications to the obstacle visualization implementation method and device provided by the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. A method for realizing obstacle visualization, characterized in that: The method is applied to a terminal device, and the method comprises: In response to receiving obstacle-related data sent by a mobile device, displaying an obstacle image, the obstacle image comprising a first image block and a second image block; Among them, the first image block is used to represent the mobile device, the second image block is used to represent the obstacle, the obstacle-related data includes the coordinates of the mobile device, the size of the quadrilateral, the size of the cell and the relative position of at least one target block in the quadrilateral, the quadrilateral corresponds to the visible area determined with the mobile device as the center, the quadrilateral is composed of multiple cells, and the at least one target block corresponds to the second image block.

2. The method according to claim 1, characterized in that: Before displaying the obstacle image, the method further includes: Determine the vertex coordinates of the quadrilateral according to the coordinates of the mobile device and the size of the quadrilateral; Determining vertex coordinates of at least one target block according to the mobile device coordinates, the size of the quadrilateral, the size of the cell, and the relative position of at least one target block in the quadrilateral; An obstacle image is generated according to the coordinates of the mobile device, the vertex coordinates of the quadrilateral, and the vertex coordinates of the at least one target block.

3. The method according to claim 2, characterized in that If the quadrilateral is a rectangle, determining the vertex coordinates of the quadrilateral according to the coordinates of the mobile device and the size of the quadrilateral includes: Determine the horizontal axis coordinates in the vertex coordinates of the quadrilateral according to the product of the first side length in the size of the quadrilateral and the cosine value corresponding to the first angle, the product of the second side length in the size of the quadrilateral and the sine value corresponding to the first angle, and the horizontal axis coordinates in the coordinates of the mobile device, wherein the first angle is the angle between the orientation of the mobile device and the vertical axis in the coordinate axis of the mobile device coordinates, the first side length is the length of the side of the quadrilateral corresponding to the orientation of the mobile device, and the second side length is different from the first side length; The longitudinal axis coordinates in the vertex coordinates of the quadrilateral are determined based on the product of the first side length in the quadrilateral size and the sine value corresponding to the first angle, the product of the second side length in the quadrilateral size and the cosine value corresponding to the first angle, and the longitudinal axis coordinates in the mobile device coordinates.

4. The method according to claim 2 or 3, characterized in that: If the quadrilateral is a rectangle, determining the vertex coordinates of the at least one target block according to the coordinates of the mobile device, the size of the quadrilateral, the size of the cell, and the relative position of the at least one target block in the quadrilateral includes: Determine the row position and column position of each target block in the at least one target block in the plurality of small blocks included in the quadrilateral according to the first side length in the quadrilateral size, the cell size and the relative position of the at least one target block in the quadrilateral; Determine the horizontal axis coordinate in the vertex coordinates of each target block according to the product of the first side length and the first length in the quadrilateral size and the cosine value corresponding to the first angle, the product of the second side length and the second length in the quadrilateral size and the sine value corresponding to the first angle, and the horizontal axis coordinate in the mobile device coordinates, wherein the first length is the product of the row position and the cell size of each target block, the second length is the product of the column position and the cell size of each target block, the first angle is the angle between the orientation of the mobile device and the longitudinal axis in the coordinate axis of the mobile device coordinates, the first side length is the length of the side of the quadrilateral corresponding to the orientation of the mobile device, and the second side length is different from the first side length; The vertical axis coordinate in the vertex coordinates of each target block is determined based on the product of the first side length and the first length in the quadrilateral size and the sine value corresponding to the first angle, the product of the second side length and the second length in the quadrilateral size and the cosine value corresponding to the first angle, and the vertical axis coordinate in the mobile device coordinates.

5. The method according to any one of claims 2 to 4, characterized in that: The generating an obstacle image according to the coordinates of the mobile device, the vertex coordinates of the quadrilateral and the vertex coordinates of the at least one target block comprises: Convert the coordinates of the mobile device, the vertex coordinates of the quadrilateral, and the vertex coordinates of the at least one target block into longitude and latitude points respectively; Generate a quadrilateral image and a first image block on a map corresponding to the position of the mobile device based on the latitude and longitude points corresponding to the vertex coordinates of the quadrilateral and the coordinates of the mobile device; A second image block is generated on the quadrilateral image based on the latitude and longitude points corresponding to the vertex coordinates of the at least one target block, and the pixel values ​​corresponding to the second image block are different from the pixel values ​​corresponding to the quadrilateral image.

6. The method according to any one of claims 2 to 5, characterized in that: Before generating an obstacle image according to the coordinates of the mobile device, the vertex coordinates of the quadrilateral, and the vertex coordinates of the at least one target block, the method further includes: Eliminate the obstacle image in the map displayed on the display interface corresponding to the terminal device.

7. The method according to any one of claims 1 to 6, characterized in that: Before displaying the obstacle image, the method further includes: receiving obstacle-related data sent by the mobile device according to a preset frequency; Among them, the preset frequency is determined according to the computing power corresponding to the terminal device. The higher the computing power corresponding to the terminal device, the higher the receiving frequency of the obstacle-related data.

8. The method according to claim 7, characterized in that After receiving the obstacle-related data sent by the mobile device according to the preset frequency, the method further includes: If the second obstacle-related data is not received within a preset time after the first obstacle-related data is received, the display information on the display interface corresponding to the terminal device is eliminated, the first obstacle-related data is the obstacle-related data generated before the second obstacle-related data, and the preset time is greater than the time corresponding to the preset frequency.

9. An obstacle visualization device, characterized in that: The device is applied to a terminal device, and the device includes: In response to receiving the obstacle-related data sent by the mobile device according to the receiving unit, the feedback unit is used to display an obstacle image, wherein the obstacle image includes a first image block and a second image block; Among them, the first image block is used to represent the mobile device, the second image block is used to represent the obstacle, the obstacle-related data includes the coordinates of the mobile device, the size of the quadrilateral, the size of the cell and the relative position of at least one target block in the quadrilateral, the quadrilateral corresponds to the visible area determined with the mobile device as the center, the quadrilateral is composed of multiple cells, and the at least one target block corresponds to the second image block.

10. An electronic device, characterized in that: The device comprises: A processor, a memory, and a communication interface, wherein the processor, the memory, and the communication interface are connected to each other and perform communication work between them; The memory stores executable program code, and the communication interface is used for wireless communication; The processor is used to call the executable program code stored in the memory to execute the method according to any one of claims 1-8.

11. A computer-readable storage medium, characterized in that: A computer program for electronic data exchange is stored, wherein the computer program enables a computer to execute the method according to any one of claims 1 to 8.