Sensing and sensing integrated method, sensing module, chip and base station
By deploying perception modules on the base station chip, using the combination of NPU cores and DSP cores, the independent problems of communication and perception systems are solved, and the joint scheduling of communication and perception resources is realized, which reduces the delay in information processing and equipment costs. Communication in the 5G era.
Patent Information
- Application Number
- CN202411102867.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-12
- Publication Date
- 2024-12-10
AI Technical Summary
The existing communication and perception systems exist independently, resulting in waste of wireless spectrum and hardware resources, high information processing delays, and the future coincidence of communication spectrum and perception spectrum requires the joint scheduling of communication and perception resources.
Deploy the perception module on the base station chip, including the application part and the computing part, and use the NPU core and the DSP core to determine the initial orientation and distance by obtaining the target UE's identification ID, synchronization signal block identification and maximum time advance, and control the maximum transmission power by obtaining the target UE's identification ID, synchronous signal block identification and maximum time advancement amount, determine the initial orientation and distance, and control the maximum transmission power Transmit communication data and determine the accurate distance based on the initial orientation and initial distance to achieve synesthesia integration.
The joint scheduling of communication and perception resources is realized, the information processing delay is reduced, the number and cost of equipment is reduced, and the system efficiency and flexibility is improved, and it is suitable for millimeter-wave communication in the 5G era.
Smart Images
Figure CN119110243A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of wireless communication technology, and in particular to a synaesthesia integration method, a perception module, a chip, and a base station. Background Art
[0002] At present, communication and perception exist independently. For example, the 4 / 5G communication system is only responsible for communication, the perception system can only measure speed and sense images through the radar system, the camera can collect video images, and the external server can calculate data. Such a separation design wastes wireless spectrum and hardware resources, and the independence of functions will also lead to high information processing delay.
[0003] With the advent of the 5G era, the communication spectrum has moved towards millimeter wave communication. The future communication spectrum will overlap with the traditional perception spectrum, which requires the joint scheduling of communication and perception resources through interawareness integration. Summary of the invention
[0004] In order to solve one of the above-mentioned technical defects, the present application provides a synaesthesia integration method, a perception module, a chip, and a base station.
[0005] In a first aspect, the present application provides a synaesthesia integration method, which is performed by a perception module deployed on a base station chip;
[0006] The chip includes NPU core and DSP core; the perception module includes application part and computing part;
[0007] The application part of the perception module is deployed on the NPU core, and the computing part of the perception module is deployed on the DSP;
[0008] The method includes:
[0009] The application part of the perception module obtains the target UE's identification ID, synchronization signal block identification SSB_index and maximum time advance TA; the UE accesses the base station;
[0010] The calculation part of the perception module determines the initial position of the UE and the initial distance from the base station based on SSB_index and TA;
[0011] The application part of the sensing module controls the UE to transmit communication data at the maximum transmission power;
[0012] The application part of the perception module receives the message sent by the UE after determining that the base station has received the communication data;
[0013] The calculation part of the perception module determines the exact distance based on the message sent by the UE, combined with the initial position and initial distance.
[0014] Optionally, the chip further includes: a shared memory and a TMAC port;
[0015] The application part of the perception module obtains the ID of the target UE and obtains SSB_index and TA from the shared memory based on the ID, including:
[0016] The application part of the perception module obtains SSB_index and TA from the shared memory;
[0017] Among them, SSB_index and TA are obtained by the base station after receiving the identification response message sent by the UE and confirming the existence of the UE information, and are stored in the shared memory by the base station side;
[0018] The identification response message is replied by the UE after the base station sends the identity identification message to the UE;
[0019] The identity recognition message is sent after the base station obtains the background configuration information through the TMAC port, completes the cell establishment, and obtains the background delivery information through the TMAC port based on the task.
[0020] Optionally, the application part of the sensing module controls the UE to transmit communication data at a maximum transmit power, including:
[0021] The application part of the perception module controls the base station to send an MR message so that the UE transmits communication data at the maximum transmission power.
[0022] Optionally, the chip further includes: a shared memory and a GMAC port;
[0023] After determining the exact distance, it also includes:
[0024] The application part of the perception module starts the image acquisition device through the GMAC port to acquire images and stores the acquired images in the shared memory;
[0025] The application part of the perception module obtains the image from the shared memory and confirms the UE based on the image;
[0026] The application part of the perception module determines the surrounding partners of the UE according to the identification of the UE to complete the information reporting.
[0027] Optionally, after determining that the base station receives the communication data, the application part of the perception module receives a message sent by the UE, including:
[0028] After determining that the base station has received the communication data, the application part of the perception module starts the perception antenna and receives the message sent by the UE through the perception antenna.
[0029] In a second aspect of the present application, a perception module is provided, the perception module comprising an application part and a calculation part;
[0030] The perception module is deployed in the base station chip;
[0031] The chip includes NPU core and DSP core;
[0032] The application part is deployed in the NPU core and is used to execute the steps of the calculation part of the perception module as described in the first aspect above;
[0033] The computing part is deployed on the DSP and is used to execute the steps of the computing part of the perception module as described in the first aspect above.
[0034] In a third aspect of the present application, a chip is provided, which has a built-in NPU core, a DSP core, a shared memory, a TMAC port, and a GMAC port;
[0035] The application part of the perception module described in the second aspect above is deployed on the NPU core;
[0036] The DSP core deploys the computational part of the perception module as described in the second aspect above;
[0037] The TMAC port is connected to the background network and is used to obtain background information and background instructions; wherein the obtained background information and background instructions are stored in the shared memory;
[0038] The GMAC port is connected to an image acquisition device for acquiring images; wherein the acquired images are stored in a shared memory;
[0039] Shared memory is used for information exchange among perception modules.
[0040] Optionally, the NPU cores are in two clusters of eight;
[0041] There are multiple DSPs;
[0042] The 5G protocol stack is also deployed on the NPU core;
[0043] DSP also deploys the 5G physical layer.
[0044] Optionally, inter-core communication is used within the chip;
[0045] The NPU core and DSP communicate through the FAPI interface.
[0046] According to a fourth aspect of the present application, a base station is provided, wherein the base station has a chip as described in the third aspect above.
[0047] The present application provides a method for integrating synaesthesia, a perception module, and a base station. The method is executed by a perception module deployed on a base station; the base station includes an NPU core and a DSP core; the perception module includes an application part and a calculation part; the application part of the perception module is deployed on the NPU core, and the calculation part of the perception module is deployed on the DSP; the method includes: the application part of the perception module obtains the identification, SSB_index and TA of the target UE; the calculation part of the perception module determines the initial orientation of the UE and the initial distance from the base station according to the SSB_index and the TA; the application part of the perception module controls the UE to transmit communication data with the maximum transmission power; the application part of the perception module receives a message sent by the UE after determining that the base station has received the communication data; the calculation part of the perception module determines the accurate distance based on the message sent by the UE in combination with the initial orientation and the initial distance, thereby realizing synaesthesia integration. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0049] Figure 1 A schematic diagram of the structure of a base station provided in an embodiment of the present application;
[0050] Figure 2 A synaesthesia integration method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0051] In order to make the technical solutions and advantages in the embodiments of the present application more clearly understood, the exemplary embodiments of the present application are further described in detail below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present application, rather than an exhaustive list of all the embodiments. It should be noted that the embodiments in the present application and the features in the embodiments can be combined with each other without conflict.
[0052] In the process of implementing this application, the inventors found that, at present, communication and perception exist independently. For example, the 4 / 5G communication system is only responsible for communication, and the perception system can only be responsible for speed measurement and induction imaging through the radar system, and the camera performs video image acquisition, etc., and the external server performs data calculation. Such a separation design wastes wireless spectrum and hardware resources, and the independence of functions will also bring about the problem of high information processing delay. In the 5G era, the communication spectrum has moved towards millimeter wave communication. The spectrum of future communications will overlap with the traditional perception spectrum, which requires the joint scheduling of communication and perception resources through the integration of interawareness.
[0053] In response to the above problems, an embodiment of the present application provides a synaesthesia integration method, a perception module, a chip, and a base station. The method is executed by a perception module deployed on a base station chip; the chip includes an NPU core and a DSP core; the perception module includes an application part and a computing part; the application part of the perception module is deployed on the NPU core, and the computing part of the perception module is deployed on the DSP; the method includes: the application part of the perception module obtains the identification, SSB_index and TA of the target UE; the computing part of the perception module determines the initial orientation of the UE and the initial distance from the base station according to the SSB_index and TA; the application part of the perception module controls the UE to transmit communication data at the maximum transmission power; the application part of the perception module receives the message sent by the UE after determining that the base station has received the communication data; the computing part of the perception module determines the accurate distance based on the message sent by the UE, combined with the initial orientation and the initial distance, thereby realizing synaesthesia integration.
[0054] This embodiment provides a synaesthesia integration method, which is executed by a perception module deployed on a base station chip. The perception module includes an application part and a calculation part.
[0055] The base station can be Figure 1 As shown in the figure, the chip has built-in NPU core, DSP, shared memory, TMAC port, and GMAC port. In addition, other modules can be built-in, which are not listed here one by one.
[0056] 1. NPU core
[0057] The application part of the perception module and the 5G protocol stack are deployed on the NPU core.
[0058] The NPU cores can be in two clusters of eight.
[0059] NPU cores use inter-core communication.
[0060] For example, Figure 1 The application part of the perception module is deployed on NPU cluster0, and the 5G protocol stack is deployed on NPU cluster1.
[0061] 2. DSP (Advanced Process Control)
[0062] DSP deploys the computing part of the perception module and the 5G physical layer.
[0063] There are multiple DSPs.
[0064] Inter-core communication is used between DSPs.
[0065] The NPU core and DSP communicate through the FAPI (Front Haul Access Point Interface). The unified interface between the NPU core and DSP can reduce the conversion time.
[0066] 3. Shared Memory
[0067] Shared memory is Figure 1 The SM (Shared Memory) in the sensor module is used for information interaction.
[0068] In other words, the chip can interact with external information through the shared memory SM.
[0069] 4. TMAC port
[0070] The TMAC (Target Media Access Control) port is connected to the background network and is used to communicate with the background, such as obtaining background information and background instructions.
[0071] The acquired background information and background instructions are stored in the shared memory SM.
[0072] In specific applications, background data (such as information, instructions, etc.) is recognized by the 5G protocol stack through the TMAC port, then placed in the shared memory SM, and the perception system is notified to read it.
[0073] 5. GMAC port
[0074] The GMAC (Gigabit Media Access Control) port is connected to the image acquisition device for acquiring images.
[0075] The collected images are stored in the shared memory SM.
[0076] In specific applications, the data collected by the image acquisition device (such as images, etc.) is placed in the shared memory SM through the GMAC port, and the perception system is notified to read and analyze it.
[0077] In addition, inter-core communication is used within the chip.
[0078] The chip completes data transmission through the internal bus interface, without the need for additional docking equipment, such as switches, routers, etc. The interface is stable, and various docking problems caused by network connection will not occur at the application site.
[0079] The integrated synaesthesia method provided in this embodiment can be based on the powerful computing power and core resources of the chip. When the 5G network is provided at the same time, the remaining computing power resources are used to realize the processing of the relevant functional modules of the perception system (such as image acquisition equipment, etc.) and computing power. The functions of each module are transmitted through different high-speed buses to solve the problem of communication between modules. The chip involved in this implementation is small in size, light in weight, and works as soon as it is turned on. It abandons the traditional multi-device solution and has the characteristics of low cost and simple maintenance.
[0080] See also Figure 2 The synaesthesia integration method provided in this embodiment is executed by a perception module. The perception module is deployed in the chip of the base station. Specifically, the perception module is deployed inside the chip to implement perception tasks, such as detecting perception targets / objects, or estimating dynamic parameters, such as ranging, angle measurement, speed measurement, and pattern recognition including perception targets / objects, such as detection, recognition, and classification of target features or behaviors.
[0081] The perception module includes an application part and a computing part. The computing part realizes the computing power of the perception module, such as completing real-time computing and analysis of 5G data and perception device data. It has powerful computing power and high-speed data processing capabilities, and is used for complex scientific computing, data analysis, artificial intelligence training and reasoning and other tasks.
[0082] The chip includes NPU core and DSP. The application part is deployed in the NPU core to execute Figure 2 The steps of the computational part of the perception module in the synaesthesia integration method shown in FIG. The computational part is deployed on the DSP to execute Figure 2 The steps of the computational part of the perception module in the synaesthesia integration method are shown.
[0083] The method provided in this embodiment includes:
[0084] 201. The application part of the perception module obtains the ID (identification), SSB_index (synchronization signal block identifier) and TA (maximum time advance) of the target UE.
[0085] Among them, the UE accesses the base station where the perception module is located.
[0086] For example, the application part of the perception module obtains the ID of the target UE and obtains the SSB_index and TA from the shared memory based on the ID.
[0087] Among them, SSB_index and TA are obtained by the base station after receiving the identification response message sent by the UE and confirming the existence of the UE information, and are stored in the shared memory by the base station side.
[0088] The identification response message is replied by the UE after the base station sends the identity identification message to the UE.
[0089] The identity recognition message is sent after the base station obtains the background configuration information through the TMAC port, completes the cell establishment, and obtains the background delivery information through the TMAC port based on the task.
[0090] 202. The calculation part of the perception module determines the initial position of the UE and the initial distance from the base station according to the SSB_index and the TA.
[0091] 203, the application part of the perception module controls the UE to transmit communication data with the maximum transmission power.
[0092] In specific implementation, the application part of the perception module can control the base station to send an MR message to maximize the TA value of the UE, and then the UE will transmit communication data at the maximum transmission power.
[0093] 204. After determining that the base station has received the communication data, the application part of the perception module receives the message sent by the UE.
[0094] In specific implementation, the application part of the perception module can start the perception antenna after determining that the base station has received the communication data, and receive the message sent by the UE through the perception antenna.
[0095] 205, the calculation part of the perception module determines the accurate distance based on the message sent by the UE and the initial position and initial distance.
[0096] After determining the exact distance, the application part of the perception module can also complete other perception tasks. For example, the image acquisition device is started through the GMAC port to acquire images and the acquired images are stored in the shared memory. The application part of the perception module obtains images from the shared memory and confirms the UE based on the images. The application part of the perception module determines the accomplices around the UE based on the UE's identification to complete the information reporting.
[0097] The following takes the scenario of implementing synaesthesia integration in a base station as an example to illustrate the implementation process of the synaesthesia integration method provided in this embodiment.
[0098] 1. Turn on the base station system.
[0099] 2. The base station completes the background configuration information reading through the TMAC port and completes the cell establishment.
[0100] 3. The base station receives the task and reads the information sent through the TMAC port background.
[0101] 4. The base station sends an identity message (ID request) to all UEs connected to the base station.
[0102] 5. All UEs reply with an ID response message.
[0103] 6. The base station determines whether there is a target UE based on the read identification response message (ID response).
[0104] 7. With the target UE information, tell the SSB_index and TA value of the target UE to the perception module (specifically the application part of the perception module).
[0105] 8. The perception module (specifically the calculation part of the perception module) calculates the approximate direction of the target UE and the distance from the base station based on the SSB_index and TA message.
[0106] 9. The perception module (specifically, the application part of the perception module) notifies the base station to send an MR message and modify the TA value of the target UE to the maximum value, so that the target UE transmits normal communication data at maximum power.
[0107] 10. After receiving the communication data transmitted by the target UE at the maximum power, the base station informs the perception module (specifically the application part of the perception module).
[0108] 11. The perception module (specifically, the application part of the perception module) starts four perception antennas and receives messages sent by the target UE. The calculation part of the perception module calculates the accurate position based on the initial approximate position.
[0109] 12. At this time, the target UE is working normally, and the sensing antenna only receives the message sent by the target UE with maximum power to complete positioning and tracking.
[0110] 13. Start the camera to complete the target information photo collection, and complete the target UE confirmation through the perception module (specifically the calculation part of the perception module).
[0111] 14. The perception module (specifically, the computing part of the perception module) determines whether the target UE is an accomplice based on the UE IDs around the target UE and the previous data.
[0112] 15. Complete the information reporting and complete the next step in the background.
[0113] The existing solutions all work by combining multiple devices, which requires a large number of devices, occupies the owner's space, is costly, and has a large volume. It requires the cooperation of multiple personnel to complete the equipment docking and opening, which is inefficient and has high labor costs. However, the synaesthesia integration method provided in this embodiment can realize all functions without the need for external chips, which is simple to implement and reduces costs.
[0114] The synaesthesia integration method provided in this embodiment can realize 5G communication functions and all perception functions, thereby achieving the effect of rapid network deployment by a single person. For key areas with large personnel flow, the purpose of quickly and easily opening a synaesthesia integration network can be achieved.
[0115] The synaesthesia integration method provided in this embodiment can realize "one machine with multiple uses". The various modules in the device using the synaesthesia integration method provided in this embodiment can not only play their own functions, but also help each other to achieve common improvement, thereby achieving the effect of "1+1>2" or even "1+1+1>3".
[0116] This embodiment provides a method for integrating synaesthesia, which is executed by a perception module deployed on a base station chip; the chip includes an NPU core and a DSP core; the perception module includes an application part and a calculation part; the application part of the perception module is deployed on the NPU core, and the calculation part of the perception module is deployed on the DSP; the method includes: the application part of the perception module obtains the identification, SSB_index and TA of the target UE; the calculation part of the perception module determines the initial orientation of the UE and the initial distance from the base station according to the SSB_index and TA; the application part of the perception module controls the UE to transmit communication data with the maximum transmission power; the application part of the perception module receives the message sent by the UE after determining that the base station has received the communication data; the calculation part of the perception module determines the accurate distance based on the message sent by the UE, combined with the initial orientation and the initial distance, thereby realizing synaesthesia integration.
[0117] Those skilled in the art will appreciate that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the present application can adopt the form of complete hardware embodiments, complete software embodiments, or embodiments in combination with software and hardware. Moreover, the present application can adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code. The scheme in the embodiments of the present application can be implemented in various computer languages, for example, object-oriented programming language Java and literal scripting language JavaScript, etc.
[0118] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0119] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0120] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0121] Although the preferred embodiments of the present application have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present application.
[0122] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.
Claims
1. A synaesthesia integration method, characterized in that: The method is performed by a sensing module deployed on a base station chip; The chip includes an NPU core and a DSP core; the perception module includes an application part and a calculation part; The application part of the perception module is deployed in the NPU core, and the calculation part of the perception module is deployed in the DSP; The method comprises: The application part of the perception module obtains the identification ID, synchronization signal block identification SSB_index and maximum timing advance TA of the target UE; the UE accesses the base station; The calculation part of the sensing module determines the initial position of the UE and the initial distance from the base station according to the SSB_index and the TA; The application part of the sensing module controls the UE to transmit communication data at a maximum transmission power; The application part of the perception module receives a message sent by the UE after determining that the base station has received the communication data; The calculation part of the perception module determines the accurate distance based on the message sent by the UE in combination with the initial position and the initial distance.
2. The method according to claim 1, characterized in that The chip also includes: a shared memory and a TMAC port; The application part of the perception module obtains the identification ID of the target UE, the synchronization signal block identification SSB_index and the maximum timing advance TA, including: The application part of the perception module obtains the ID of the target UE, and obtains SSB_index and TA from the shared memory based on the ID; Among them, SSB_index and TA are obtained by the base station after receiving the identification response message sent by the UE and confirming the existence of the UE information, and are stored in the shared memory by the base station side; The identification response message is replied by the UE after the base station sends the identity identification message to the UE; The identity recognition message is sent after the base station obtains the background configuration information through the TMAC port, completes the cell establishment, and obtains the background sending information through the TMAC port based on the task.
3. The method according to claim 1, characterized in that The application part of the sensing module controls the UE to transmit communication data at a maximum transmission power, including: The application part of the perception module controls the base station to send an MR message so that the UE transmits communication data at the maximum transmission power.
4. The method according to claim 1, characterized in that: The chip also includes: a shared memory and a GMAC port; After determining the accurate distance, the method further includes: The application part of the perception module starts the image acquisition device to acquire images through the GMAC port, and stores the acquired images in the shared memory; The application part of the perception module obtains the image from the shared content and confirms the UE based on the image; The application part of the perception module determines the surrounding partners of the UE according to the identifier of the UE to complete the information reporting.
5. The method according to claim 1, characterized in that The application part of the perception module receives a message sent by the UE after determining that the base station has received the communication data, including: After determining that the base station has received the communication data, the application part of the sensing module starts the sensing antenna and receives the message sent by the UE through the sensing antenna.
6. A perception module, characterized in that: The perception module includes an application part and a calculation part; The sensing module is deployed in a chip of the base station; The chip includes an NPU core and a DSP core; Wherein, the application part is deployed in the NPU core, and is used to execute the steps of the computing part of the perception module as claimed in any one of claims 1 to 5; The computing part is deployed on the DSP and is used to execute the steps of the computing part of the perception module in any one of claims 1 to 5.
7. A chip, characterized in that: The chip has built-in NPU core, DSP core, shared memory, TMAC port and GMAC port; The application part of the perception module as claimed in claim 6 is deployed on the NPU core; The DSP core deploys the computing part of the perception module as claimed in claim 6; The TMAC port is connected to the background network and is used to obtain background information and background instructions; wherein the obtained background information and background instructions are stored in the shared memory; The GMAC port is connected to an image acquisition device for acquiring images; wherein the acquired images are stored in the shared memory; The shared memory is used for the perception module to perform information exchange.
8. The chip according to claim 7, characterized in that: The NPU cores are in two clusters of eight; There are multiple DSPs; A 5G protocol stack is also deployed on the NPU core; The DSP also deploys the 5G physical layer.
9. The chip according to claim 7 or 8, characterized in that: The chip uses inter-core communication inside; The NPU core and DSP communicate through the FAPI interface.
10. A base station, characterized in that: The base station has the chip as claimed in claim 7, 8 or 9.