Collaborative sensing methods, devices, media, products, and wireless communication systems

Abstract

The application relates to the technical field of communication, and proposes a cooperative sensing method, device, medium, product and wireless communication system. In the method, a network device establishes a cooperative sensing candidate pool containing M candidate cooperative sensing terminals in advance, wherein M is a positive integer. Since the M candidate cooperative sensing terminals in the cooperative sensing candidate pool all have cooperative sensing capability, when the network device receives a first request sent by a first terminal device and used for requesting to perform a first sensing task on a second terminal device, the network device can directly select N cooperative sensing terminals from the M candidate cooperative sensing terminals in the cooperative sensing candidate pool to perform the first sensing task, without performing the operation of detecting terminal devices with cooperative sensing capability. In this way, the operation process of cooperative sensing is reduced, the delay of cooperative sensing is reduced, and the efficiency of cooperative sensing is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of communication, and in particular to a cooperative sensing method, device, medium, product and wireless communication system. BACKGROUND

[0002] In a wireless network communication system such as a future 5G or 6G network, more and more scenarios have higher requirements for cooperative sensing, collaborative computing and resource sharing between terminal devices. Especially in a high-speed mobile environment (such as a smart car cluster or a drone formation), some terminal devices cannot independently complete the sensing task due to limitations of location, channel or computing resources, and in this case, the terminal device needs to assist other terminal devices around to complete the sensing task.

[0003] Currently, there are problems of high delay and low efficiency in the terminal device assisting other terminal devices to complete the sensing task. SUMMARY

[0004] Some embodiments of the present application provide a cooperative sensing method, device, medium, product and wireless communication system to solve the problem of high delay and low efficiency in cooperative execution of the sensing task.

[0005] The present application is described below from multiple aspects, and the embodiments and advantages of the following multiple aspects can be mutually referred to.

[0006] In a first aspect, the present application provides a cooperative sensing method applied to a network device, the network device storing a cooperative sensing candidate pool, the cooperative sensing candidate pool including M candidate cooperative sensing terminal devices, wherein M is a positive integer, and the method includes: receiving a first request from a first terminal device, wherein the first request is used to request execution of a first sensing task on a second terminal device; in response to the first request, selecting N cooperative sensing terminal devices from the M candidate cooperative sensing terminal devices, wherein N is a positive integer and N is less than or equal to M; sending first signaling to the N cooperative sensing terminal devices, wherein the first signaling is used to indicate execution of the first sensing task; receiving execution result information of the first sensing task executed by at least one cooperative sensing terminal device from the N cooperative sensing terminal devices; and sending a first sensing result on the second terminal device to the first terminal device according to the received execution result information.

[0007] Since the network device establishes the cooperative sensing candidate pool in advance and stores locally, and each terminal device in the cooperative sensing candidate pool has cooperative sensing capability, when the network device receives the first request sent by the first terminal device for requesting to perform the first sensing task on the second terminal device, the network device can directly select N cooperative sensing terminal devices from the M candidate cooperative sensing terminal devices in the cooperative sensing candidate pool to perform the first sensing task on the second terminal device, without performing the operation of detecting the terminal device having cooperative sensing capability again. In this way, the operation process of cooperative sensing is reduced, thereby reducing the delay of cooperative sensing and improving the efficiency of cooperative sensing.

[0008] In some embodiments, the M candidate cooperative sensing terminal devices are determined from the K terminal devices based on device information reported by the K terminal devices, wherein the device information is reported by the K terminal devices after receiving the second signaling from the network device, and K is a positive integer and greater than or equal to M.

[0009] For example, the second signaling can be the signaling S1 mentioned below.

[0010] When the network device establishes the cooperative sensing candidate pool, the network device can send the second signaling to the K terminal devices to instruct the K terminal devices to report respective device information. Then, the network device can select M terminal devices having cooperative sensing capability from the K terminal devices based on the device information of the K terminal devices, and add the M terminal devices to the cooperative sensing candidate pool as candidate cooperative sensing terminal devices.

[0011] In some embodiments, the second signaling includes a first field for indicating a first cooperative sensing condition required by the network device.

[0012] The network device can convey the first cooperative sensing condition required by the network device to the K terminal devices through the first field of the second signaling, to instruct the K terminal devices to reply to the network device whether the first cooperative sensing condition is met, so as to screen out the M candidate cooperative sensing terminal devices from the K terminal devices by the network device.

[0013] For example, the first field can be the requiredCapabilityLevel field mentioned below.

[0014] In some embodiments, the first cooperative sensing condition includes:

[0015] a sensing accuracy satisfying a sensing accuracy condition; and / or,

[0016] a sensing range greater than or equal to a sensing range threshold; and / or,

[0017] a sensing delay less than or equal to a sensing delay threshold.

[0018] In some embodiments, the second signaling further comprises a second field, a third field, and / or a fourth field, wherein the second field is used to indicate that the device information is reported at the time when the second signaling is received, or the device information is reported according to a first period, or the device information is reported in response to a trigger event; the third field is used to indicate an event type of the trigger event, and the event type is a movement state change event, a power change event, or a signal strength change event; and the fourth field is used to indicate a valid time duration of the terminal device for reporting the device information this time.

[0019] For example, the second field can be the triggerCondition field mentioned below, the third field can be the eventType field mentioned below, and the fourth field can be the reportValidityDuration field mentioned below.

[0020] The network device can indicate, through the second signaling, that the K terminal devices report the device information at the time when the second signaling is received, or report the device information according to a first period, or report the device information in response to a movement state change event, a power change event, or a signal strength change event, and indicate a valid time duration of the K terminal devices for reporting the device information this time. Within the valid time duration, the K terminal devices do not need to repeatedly report, so as to reduce power consumption caused by repeated reporting of the device information.

[0021] In some embodiments, the device information is reported through third signaling, wherein the third signaling comprises a fifth field used to indicate whether a first cooperative sensing condition required by the network device is met.

[0022] For example, the third signaling can be the signaling S2 mentioned below, and the fifth field can be the capabilityComplianceMask field mentioned below.

[0023] After the K terminal devices receive the second signaling of the network device, the K terminal devices can send third signaling to the network device to inform the network device whether the first cooperative sensing condition is met, so that the network device can establish a cooperative sensing candidate pool based on the first cooperative sensing condition.

[0024] In some embodiments, the third signaling further comprises a sixth field, a seventh field, an eighth field, a ninth field, a tenth field, and / or an eleventh field, wherein the sixth field is used to indicate a time interval in which a sensing task can be performed; the seventh field is used to indicate a movement state; the eighth field is used to indicate a movement direction; the ninth field is used to indicate a movement speed; the tenth field is used to indicate an amount of idle resources; and the eleventh field is used to indicate whether the terminal device is configured to allow the sensing task to be performed.

[0025] For example, the sixth field can be the availableSensingWindow field mentioned below, the seventh field can be the mobilityStatus field mentioned below, the eighth field can be the selfHeadingDeg field mentioned below, the ninth field can be the recentSpeedEstimate field mentioned below, the tenth field can be the sensingPowerBudget field mentioned below, and the eleventh field can be the taskIntentFlag field mentioned below.

[0026] After the K terminal devices receive the second signaling from the network device, the K terminal devices can inform the network device of the time interval, the mobility state, the mobility direction, the mobility speed, the amount of idle resources, and / or whether the K terminal devices are configured to allow execution of the sensing task through third signaling, so that the network device establishes the candidate pool of cooperative sensing based on the information.

[0027] In some embodiments, the M candidate cooperative sensing terminal devices satisfy a first cooperative sensing condition required by the network device.

[0028] The network device can select M terminal devices that satisfy the first cooperative sensing condition from the K terminal devices as candidate cooperative sensing terminal devices, that is, select M terminal devices with high sensing accuracy, large sensing range, and / or low sensing delay as candidate cooperative sensing terminal devices.

[0029] In some embodiments, the N cooperative sensing terminal devices satisfy a second cooperative sensing condition, and the second cooperative sensing condition includes that the amount of idle resources is greater than or equal to the amount of resources required by the first sensing task, and the N cooperative sensing terminal devices are configured to allow execution of the sensing task.

[0030] After the network device receives the first signaling for executing the first sensing task on the second terminal device, the network device can select N cooperative sensing terminal devices from the M candidate cooperative sensing terminal devices in the candidate pool of cooperative sensing, the N cooperative sensing terminal devices having an amount of idle resources greater than or equal to the amount of resources required by the first sensing task and being configured to allow execution of the sensing task. The network device selects the N cooperative sensing terminal devices having an amount of idle resources greater than or equal to the amount of resources required by the first sensing task and being configured to allow execution of the sensing task, which can ensure smooth execution of the first sensing task.

[0031] In some embodiments, the first signaling includes a twelfth field for indicating a task type of the first sensing task.

[0032] For example, the first signaling can be the signaling S3 mentioned below, and the twelfth field can be the taskType field mentioned below.

[0033] After the network device selects the N cooperative sensing terminals from the cooperative sensing candidate pool, the network device can inform the N cooperative sensing terminals of the task type of the first sensing task through the first signaling.

[0034] In some embodiments, the task type of the first sensing task includes a location sensing task, a moving trajectory sensing task, a distance sensing task, a moving direction sensing task, a moving speed sensing task, or an acceleration sensing task.

[0035] In some embodiments, the first signaling further includes a thirteenth field, a fourteenth field, a fifteenth field, a sixteenth field, and / or a seventeenth field, wherein the thirteenth field is used to indicate the first identification of the first sensing task; the fourteenth field is used to indicate the valid time length of the first sensing task; the fifteenth field is used to indicate the termination condition of the first sensing task; the sixteenth field is used to indicate the execution time window of the first sensing task; and the seventeenth field is used to indicate the device type, the location, and / or the direction of the second terminal device relative to the network device.

[0036] For example, the thirteenth field can be the sensingTaskID field mentioned below, the fourteenth field can be the ttlMs field mentioned below, the fifteenth field can be the terminationCond field mentioned below, the sixteenth field can be the taskTimeWindow field mentioned below, and the seventeenth field can be the targetObjectInfo field mentioned below.

[0037] After the network device selects the N cooperative sensing terminals from the cooperative sensing candidate pool, the network device can further inform the N cooperative sensing terminals of the first identification, the valid time length, the termination condition, the execution time window, the device type of the second terminal device, the location of the second terminal device, and / or the direction of the second terminal device relative to the network device of the first sensing task through the first signaling, so that the N cooperative sensing terminals execute the first sensing task according to the information.

[0038] In some embodiments, the termination condition includes that the sensing accuracy does not satisfy a sensing accuracy condition and / or the first sensing task is executed completely.

[0039] When the sensing accuracy of the N cooperative sensing terminals does not satisfy the sensing accuracy condition and / or the first sensing task is executed completely during the execution of the first sensing task by the aforementioned N cooperative sensing terminals, the N cooperative sensing terminals terminate the execution of the first sensing task.

[0040] In some embodiments, the perception accuracy condition comprises: a distance perception error is less than a distance perception error threshold; and / or, a speed perception error is less than a speed perception error threshold; and / or, an azimuth angle perception error is less than an azimuth angle perception error threshold; and / or, a pitch angle perception error is less than a pitch angle perception error threshold; and / or, an acceleration perception error is less than an acceleration perception error threshold; and / or, a mobile direction perception deviation angle is less than a mobile direction perception deviation angle threshold.

[0041] In some embodiments, before sending the first perception result of the second terminal device to the first terminal device according to the received execution result information, the method comprises: sending, to a third terminal device in a first area, a fourth signaling at a first time during movement of the second terminal device, wherein the first area is a predicted arrival area of the second terminal device after a first time length, the third terminal device is a candidate cooperative perception terminal outside the N cooperative perception terminals in the cooperative perception candidate pool, and the fourth signaling is used to activate the third terminal device and instruct the third terminal device to keep a low-power consumption state; sending, to the third terminal device, a fifth signaling at a second time, the fifth signaling being used to instruct the third terminal device to perform the first perception task, and the second time is separated from the first time by the first time length; and receiving execution result information of the third terminal device performing the first perception task.

[0042] For example, the fourth signaling can be the signaling S4 mentioned below, and the fifth signaling can be the signaling S5 mentioned below.

[0043] In the scenario where the second terminal device is in a moving state, at the first time, the network device can predict a first area where the second terminal device arrives after a first time length, and send a fourth signaling to a third terminal device in the first area to activate the third terminal device and instruct the third terminal device to keep a low-power consumption state. After the first time length, at the second time, the network device can send a fifth signaling to the third terminal device to instruct the third terminal device to exit the low-power consumption state and perform the first perception task to replace the cooperative perception terminal that loses the perception ability for the second terminal device. After the third terminal device performs the first perception task, the third terminal device sends the execution result of the first perception task to the network device, which is then forwarded to the first terminal device.

[0044] By activating the third terminal device in advance and instructing the third terminal device to be in the low-power-consumption state, the delay of switching the cooperative sensing terminal can be reduced, and interruption of the first sensing task or higher delay can be avoided. In this way, the network device can activate multiple terminal devices in the first area in advance and instruct the multiple terminal devices to be in the low-power-consumption state, to form an interruption risk buffer pool. In this way, when the second terminal device arrives at the first area, the network device can immediately switch the cooperative sensing terminal performing the first sensing task to a terminal device in the interruption risk buffer pool. In this way, the switching speed of the cooperative sensing terminal can be improved, the switching delay can be reduced, and interruption of the cooperative sensing link can be avoided, that is, interruption of the first sensing task can be avoided.

[0045] In some embodiments, the first area is determined based on a predicted moving track of the second terminal device and / or execution result information of the first sensing task, and the execution result information includes a moving speed, a moving direction, an acceleration, and a position of the second terminal device. In some embodiments, the predicted moving track is determined based on a historical moving track of the second terminal device, and the historical moving track is determined based on historical moving track information from the second terminal device.

[0046] In the process of moving of the second device, the network device can obtain the historical track information uploaded by the second terminal device from a traffic platform, a multi-access edge computing (MEC) service platform, or other platforms, or can directly receive the historical track information returned by the second terminal device, and then determine the historical track of the second terminal device based on the historical track information of the second terminal device. Then, after the network device receives the execution result information sent by the at least one cooperative sensing terminal after the first sensing task is performed, the network device predicts the first area that the second terminal device is likely to arrive at after a first time length based on the historical moving track of the second terminal device and / or the moving speed, the moving direction, the acceleration, and the position of the second terminal device in the execution result information.

[0047] In some embodiments, the fourth signaling includes an eighteenth field for indicating entering the low-power-consumption state.

[0048] For example, the eighteenth field can be a preConfigurationFlag field mentioned below.

[0049] The network device can instruct the third terminal device to enter the low-power-consumption state through the eighteenth field of the fourth signaling, so as to reduce power consumption and be ready to perform the first sensing task at any time.

[0050] In some embodiments, the fourth signaling further comprises a nineteenth field, a twentieth field, a twenty-first field, and / or a twenty-second field, wherein the nineteenth field is used to indicate to listen to the fifth signaling; the twentieth field is used to indicate a listening intensity and a listening period; the twenty-first field is used to indicate task configuration information of the first sensing task; and the twenty-second field is used to indicate a second identifier of the fourth signaling.

[0051] For example, the nineteenth field can be the activationPagingIndication field mentioned below, the twentieth field can be the lightListenHint field mentioned below, the twenty-first field can be the preConfiguredTaskContent field mentioned below, and the twenty-second field can be the preConfigurationID field mentioned below.

[0052] In some embodiments, the fifth signaling comprises a twenty-third field used to indicate to perform the first sensing task.

[0053] For example, the twenty-third field can be the activationFlag field mentioned below.

[0054] The network device can indicate the third terminal device to perform the first sensing task through the twenty-third field in the fifth signaling.

[0055] In some embodiments, the fifth signaling further comprises a twenty-fourth field and / or a twenty-fifth field, wherein the twenty-fourth field is used to indicate the second identifier of the fourth signaling; and the twenty-fifth field is used to indicate an execution time window of the first sensing task.

[0056] For example, the twenty-fourth field can be the taskActivationID field mentioned below, and the twenty-fifth field can be the activationTimingHint field mentioned below.

[0057] The network device can send the second identifier of the fourth signaling and the execution time window of the first sensing task to the third terminal device through the fifth signaling, so that the third terminal device can query the task configuration information of the first sensing task in the fourth signaling received before based on the second identifier, and then perform the first sensing task within the execution time window of the first sensing task according to the corresponding resource configured by the task configuration information.

[0058] In some embodiments, the first sensing result comprises a position, a moving track, a distance, a moving direction, a moving speed, and / or an acceleration of the second terminal device.

[0059] After the network device receives the execution result information of the first perception task, the network device determines the position, the moving track, the distance, the moving direction, the moving speed and / or the acceleration of the second terminal device according to the received execution result information of the first perception task, and sends the position, the moving track, the distance, the moving direction, the moving speed and / or the acceleration of the second terminal device to the first terminal device, so that the first terminal device can perceive the state of the second terminal device.

[0060] In a second aspect, the present application provides a cooperative perception method applied to a cooperative perception terminal, the method comprising: receiving a first signaling from a network device, the first signaling being used to instruct to perform a first perception task on a second terminal device, wherein the network device stores a cooperative perception candidate pool, the cooperative perception candidate pool comprising M candidate cooperative perception terminals, M being a positive integer, and the first signaling being sent by the network device after selecting a cooperative perception terminal from the M candidate cooperative perception terminals in response to a first request received from a first terminal device; performing the first perception task in response to the first signaling; and sending execution result information of the first perception task to the network device.

[0061] After the network device receives the first request sent by the first terminal device for performing the first perception task on the second terminal device, the network device can select a corresponding cooperative perception terminal from the M candidate cooperative perception terminals in the pre-established and stored cooperative perception candidate pool in response to the first request, and send a first signaling to the cooperative perception terminal. Then, the cooperative perception terminal performs the first perception task in response to the first signaling, and sends execution result information of the first perception task to the network device after performing the first perception task, and the network device sends the execution result information to the first terminal device.

[0062] The cooperative perception terminal assisting the first terminal device to perceive the second terminal device can improve the perception accuracy of the second terminal device.

[0063] In some embodiments, before receiving the first signaling from the network device, the method comprises: receiving a second signaling from the network device; and sending device information of the cooperative perception terminal device to the network device, the device information being used to instruct the network device to establish the cooperative perception candidate pool.

[0064] Before the cooperative perception terminal receives the first signaling from the network device, when the cooperative perception terminal receives a second signaling from the network device, the cooperative perception terminal can send device information of the cooperative perception terminal to the network device in response to the second signaling, so as to instruct the network device to establish the cooperative perception candidate pool.

[0065] In some embodiments, the second signaling comprises: a first field for indicating a first cooperative sensing condition required by the network device; and the device information is reported through third signaling, wherein the third signaling comprises: a fifth field for indicating whether the cooperative sensing terminal satisfies the first cooperative sensing condition; the first cooperative sensing condition comprises: a sensing accuracy satisfying a sensing accuracy condition; and / or, a sensing range being greater than or equal to a sensing range threshold; and / or, a sensing delay being less than or equal to a sensing delay threshold.

[0066] After the cooperative sensing terminal receives the second signaling sent by the network device and confirms the first cooperative sensing condition required by the network device through the second signaling, the cooperative sensing terminal can report to the network device through the third signaling whether the cooperative sensing terminal satisfies the first cooperative sensing condition, such as whether the sensing accuracy satisfies the sensing accuracy condition, whether the sensing range is greater than or equal to the sensing range threshold, and / or whether the sensing delay is less than or equal to the sensing delay threshold.

[0067] In some embodiments, the third signaling further comprises a sixth field, a seventh field, an eighth field, a ninth field, a tenth field, and / or an eleventh field, wherein the sixth field is for indicating a time interval in which the sensing task can be performed; the seventh field is for indicating a moving state; the eighth field is for indicating a moving direction; the ninth field is for indicating a moving speed; the tenth field is for indicating an amount of idle resources; and the eleventh field is for indicating whether the cooperative sensing terminal is configured to allow the sensing task to be performed.

[0068] After the cooperative sensing terminal receives the second signaling sent by the network device, the cooperative sensing terminal can further report to the network device through the third signaling the information of the time interval in which the sensing task can be performed, the moving state, the moving direction, the moving speed, the amount of idle resources, and whether the cooperative sensing terminal is configured to allow the sensing task to be performed, so as to facilitate the network device to establish a cooperative sensing candidate pool.

[0069] In a third aspect, the present application provides an electronic device, comprising: a memory for storing instructions; and a processor, when the processor executes the instructions in the memory, can make the electronic device perform the cooperative sensing method of any of the embodiments of the first aspect or the second aspect. The beneficial effects achieved by the third aspect can refer to the beneficial effects of the method provided by any of the embodiments of the first aspect or the second aspect, which will not be repeated here.

[0070] In a fourth aspect, the present application provides a computer-readable storage medium, and the computer-readable storage medium stores instructions, which, when executed on a computer, can make the computer perform the cooperative sensing method of any of the embodiments of the first aspect or the second aspect. The beneficial effects achieved by the fourth aspect can refer to the beneficial effects of the method provided by any of the embodiments of the first aspect or the second aspect, which will not be repeated here.

[0071] In a fifth aspect, the present application provides a computer program product, which comprises computer program codes. When the computer program codes are run on a computer, the computer is caused to implement the cooperative sensing method of any of the embodiments of the first aspect or the second aspect. The beneficial effects achieved by the fifth aspect can refer to those provided by the method of any of the embodiments of the first aspect or the second aspect, which will not be repeated here.

[0072] In a sixth aspect, the present application provides a wireless communication system, which comprises a network device and a cooperative sensing terminal. The network device is configured to perform the cooperative sensing method of any of the embodiments of the first aspect. The cooperative sensing terminal is configured to perform the cooperative sensing method of any of the embodiments of the second aspect. The beneficial effects achieved by the sixth aspect can refer to those provided by the method of any of the embodiments of the first aspect or the second aspect, which will not be repeated here.

[0073] In a seventh aspect, the present application provides a chip, which comprises a processor configured to read and execute computer programs stored in a memory to perform the cooperative sensing method of any of the embodiments of the first aspect or the second aspect. The beneficial effects achieved by the seventh aspect can refer to those provided by the method of any of the embodiments of the first aspect or the second aspect, which will not be repeated here.

[0074] In an eighth aspect, the present application provides a first cooperative sensing device, which stores a cooperative sensing candidate pool comprising M candidate cooperative sensing terminals, wherein M is a positive integer. The first cooperative sensing device comprises:

[0075] A first receiving module configured to receive a first request from a first terminal device, wherein the first request is used to request to perform a sensing task on a second terminal device;

[0076] A selecting module configured to select N cooperative sensing terminals from the M candidate cooperative sensing terminals in response to the first request, wherein M and N are both positive integers, and N is less than or equal to M;

[0077] A first sending module configured to send first signaling to the N cooperative sensing terminals, wherein the first signaling is used to instruct to perform the sensing task;

[0078] A second receiving module configured to receive execution result information of the sensing task performed by at least one of the N cooperative sensing terminals;

[0079] A second sending module configured to send a first sensing result of the second terminal device to the first terminal device according to the received execution result information.

[0080] The eighth aspect can achieve the beneficial effects of the method provided by any of the embodiments of the first aspect, which will not be repeated here.

[0081] In a ninth aspect, the present application provides a second cooperative sensing device, comprising:

[0082] a third receiving module configured to receive first signaling from a network device, wherein the network device stores a cooperative sensing candidate pool, the cooperative sensing candidate pool comprising M candidate cooperative sensing terminals, wherein M is a positive integer, and the first signaling is sent by the network device after selecting a cooperative sensing terminal from the M candidate cooperative sensing terminals in response to a first request from a first terminal device, and the first request is used to request execution of a first sensing task on a second terminal device;

[0083] an execution module configured to execute the first sensing task in response to the first signaling;

[0084] a third sending module configured to send execution result information of the first sensing task to the network device.

[0085] The ninth aspect can achieve the beneficial effects of the method provided by any of the embodiments of the second aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0086] Figure 1 According to some embodiments of the present application, a scenario diagram of multi-device cooperative sensing is shown;

[0087] Figure 2 According to some embodiments of the present application, a flowchart of a method for establishing a cooperative sensing candidate pool is shown;

[0088] Figure 3 According to some embodiments of the present application, another scenario diagram of multi-device cooperative sensing is shown;

[0089] Figure 4 According to some embodiments of the present application, a flowchart of a cooperative sensing method is shown;

[0090] Figure 5 According to some embodiments of the present application, a flowchart of another cooperative sensing method is shown;

[0091] Figure 6 According to some embodiments of the present application, a flowchart of another cooperative sensing method is shown;

[0092] Figure 7 According to some embodiments of the present application, another scenario diagram of multi-device cooperative sensing is shown;

[0093] Figure 8According to some embodiments of the present application, another scenario diagram of multi-device cooperative perception is shown.

[0094] Figure 9 According to some embodiments of the present application, another method flow diagram of cooperative perception is shown.

[0095] Figure 10 According to some embodiments of the present application, another scenario diagram of multi-device cooperative perception is shown.

[0096] Figure 11 According to some embodiments of the present application, another scenario diagram of multi-device cooperative perception is shown.

[0097] Figure 12 According to some embodiments of the present application, a structural schematic diagram of an electronic device is shown.

[0098] Figure 13 According to some embodiments of the present application, a structural schematic diagram of a first cooperative perception device is shown.

[0099] Figure 14 According to some embodiments of the present application, a structural schematic diagram of a second cooperative perception device is shown. DETAILED DESCRIPTION

[0100] The technical solutions of the embodiments of the present application will be clearly described below with reference to the drawings of the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments of the present application, other embodiments obtained by those of ordinary skill in the art without creative labor fall within the protection scope of the present application.

[0101] In the description of the present application, unless otherwise specified, " / " means "or", for example, A / B can mean A or B. "And / or" in this document is only a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can mean: A exists alone, A and B exist together, and B exists alone. In addition, "at least one" means one or more, and "multiple" means two or more. "First", "second", etc. do not limit the quantity and execution order, and "first", "second", etc. do not necessarily mean different.

[0102] It should be noted that in the present application, "exemplary" or "for example" is used to mean example, illustration or description. Any embodiment or design scheme described as "exemplary" or "for example" in the present application should not be interpreted as more preferred or more advantageous than other embodiments or design schemes. Rather, the use of "exemplary" or "for example" is intended to present the relevant concept in a specific manner.

[0103] For the convenience of understanding, the terms involved in the present application are explained first as follows.

[0104] (1) Perception

[0105] Perception refers to the state information of a perception target (i.e., an object to be perceived) collected by a sensor of a perception device (i.e., a device with a perception capability), or refers to the state information of the perception target received by the perception device in a wireless communication manner. The state information of the perception target includes, but is not limited to, a moving state, a moving direction, a moving speed, an acceleration, a distance, and / or a position, etc.

[0106] It can be understood that the perception manner includes, but is not limited to, light perception, sound perception, and radio wave perception. The light perception refers to a perception manner of detecting a perception target by using visible light or non-visible light, such as detecting the perception target by using a camera, an infrared sensor, and a laser radar, etc. The sound perception refers to a perception manner of detecting a perception target by using a sound wave, such as detecting the perception target by using an ultrasonic sensor. The radio wave perception refers to a perception manner of detecting a perception target by using a radio wave, such as detecting the perception target by using a millimeter wave radar.

[0107] Embodiments of the present application are applied to a wireless communication system, which can be a third generation (3G) communication system, a long term evolution (LTE) system, a fifth generation (5G) communication system, a hybrid architecture of LTE and 5G, a 5G new radio (5G NR) system, and a new communication system to be appeared in future communication development, etc.

[0108] The wireless communication system can include a network device and a user equipment (UE). The network device can be a device used for providing network communication function on the network side, and is also called a network device or a network element in some cases. The network device can be generally a base station (including a functional unit of the base station or a combination of functional units of the base station) or a core network unit, wherein the core network unit can be a functional unit in the core network, including but not limited to an access and mobility management function (AMF) unit or a session management function (SMF) unit.

[0109] It should be noted that the network device in the embodiments of the present application can be any device that can provide network access services, including but not limited to routers, base stations, high-altitude platforms, satellites, and the like. For example, the network device can be a radio access network (RAN) node, a NodeB, an evolved NodeB (eNB), a next generation NodeB (gNB), a relay station, an access point, a transmitting and receiving point (TRP), a transmitting point (TP), a master station, a secondary station, a multi-mode wireless node, a home base station, a network controller, an access node, an access point, a transmission node, a transceiver node, a baseband unit, a radio remote unit, an active antenna unit, a radio frequency head, a central unit, a distributed unit, a positioning node, and the like, a base station in a mobile communication system (such as 3G / 4G / 5G / 5.5G / 6G or future mobile communication systems), a module or unit that completes part of the function of the base station, a centralized unit (CU) or a distributed unit (DU). The embodiments of the present application do not limit the specific technology and specific device form adopted by the network device.

[0110] In the embodiments provided in the present application, the UE includes but is not limited to a mobile phone, a tablet computer (Pad), a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a vehicle-mounted terminal, a wireless terminal in self driving (such as a wireless terminal in a drone), a wireless terminal in remote medical treatment, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, a wearable terminal device, and the like.

[0111] The present application is applied to various types of multi-device cooperative sensing scenarios, such as mobile sensing task relay cooperative scheduling in urban road traffic scenarios, cross-region cooperative sensing link planning and switching in unmanned aerial vehicle cluster environments, multi-terminal cooperative sensing in rail transportation (such as high-speed rail, subway, etc.) scenarios, and path perception and dynamic relay perception of logistics distribution robots in warehouse parks.

[0112] Figure 1 According to some embodiments of the present application, a scenario graph of multi-device cooperative perception is shown.

[0113] As shown in Figure 1 wireless communication system 10 includes a base station 01, a vehicle terminal of a first vehicle 02, a vehicle terminal of a second vehicle 03, a mobile phone 04 and a vehicle terminal of a third vehicle 05. The vehicle terminal of the first vehicle 02, the vehicle terminal of the second vehicle 03 and the vehicle terminal of the third vehicle 05 and the mobile phone 04 all establish wireless communication connection with the base station 01, and the vehicle terminal of the first vehicle 02, the vehicle terminal of the second vehicle 03 and the vehicle terminal of the third vehicle 05 all establish wireless communication connection with the vehicle terminal of a fourth vehicle 06. No wireless communication connection is established between the mobile phone 04 and the vehicle terminal of the fourth vehicle 06. The perception accuracy of the vehicle terminal of the first vehicle 02 and the vehicle terminal of the second vehicle 03 to the vehicle terminal of the fourth vehicle 06 is low. The perception accuracy of the vehicle terminal of the third vehicle 05 to the vehicle terminal of the fourth vehicle 06 is high. The mobile phone 04 does not have the perception ability to the vehicle terminal of the fourth vehicle 06.

[0114] When the vehicle terminal of the fourth vehicle 06 is the perception target of the vehicle terminal of the second vehicle 03, the vehicle terminal of the second vehicle 03 can send a cooperative perception request to the base station 01 as a perception task initiation terminal. After receiving the cooperative perception request, the base station 01 needs to first select terminal devices with perception ability from the vehicle terminal of the first vehicle 02, the vehicle terminal of the third vehicle 05 and the mobile phone 04 as candidate cooperative perception terminals, such as the vehicle terminal of the first vehicle 02 and the vehicle terminal of the third vehicle 05, and then select the vehicle terminal of the third vehicle 05 with idle resources to the vehicle terminal of the fourth vehicle 06 from the vehicle terminal of the first vehicle 02 and the vehicle terminal of the third vehicle 05 as a cooperative perception terminal, and request the vehicle terminal of the third vehicle 05 to execute the perception task to the vehicle terminal of the fourth vehicle 06. After the vehicle terminal of the third vehicle 05 completes the perception task, the vehicle terminal of the third vehicle 05 can send the execution result of the perception task (such as the position, moving direction, moving speed and / or acceleration of the vehicle terminal of the fourth vehicle 06, etc.) to the vehicle terminal of the second vehicle 03 through the base station 01 to assist the vehicle terminal of the second vehicle 03 to perceive the state of the vehicle terminal of the fourth vehicle 06.

[0115] In the above scenario, the selection process for candidate cooperative sensing terminals introduces a certain delay, thereby reducing the execution efficiency of the sensing task. In view of this, embodiments of this application provide a cooperative sensing method. In this method, a network device (such as base station 01) can pre-establish a cooperative sensing candidate pool. Thus, when the network device receives a cooperative sensing request sent by a first terminal device, the network device can immediately select a cooperative sensing terminal from the candidate cooperative sensing terminals in the pool to assist the first terminal device in performing the sensing task for the second terminal device, without needing to perform the operation of detecting candidate cooperative sensing terminals with cooperative sensing capabilities. This reduces the operational steps of cooperative sensing, thereby reducing the latency of cooperative sensing and improving its efficiency.

[0116] The following section describes the process of establishing the collaborative sensing candidate pool.

[0117] Figure 2 According to some embodiments of this application, a flowchart of a method for establishing a collaborative sensing candidate pool is shown.

[0118] like Figure 2 As shown, the process includes:

[0119] S101: The network device sends signaling S1 to K terminal devices, where signaling S1 is used to instruct the reporting of device information.

[0120] In some embodiments, the network device may periodically send signaling S1 to K terminal devices in the cell, or it may send signaling S1 to K terminal devices in the cell when it receives a request to establish a cooperative awareness candidate pool, so as to instruct the K terminal devices in the cell to report their respective device information.

[0121] For example, such as Figure 3 As shown, base station 01 can send signaling S1 to terminal devices in the cell, such as the vehicle-mounted terminal of the first vehicle 02, the vehicle-mounted terminal of the third vehicle 05, the vehicle-mounted terminal of the fifth vehicle 07, the vehicle-mounted terminal of the sixth vehicle 08, and mobile phone 04, to instruct them to report their respective device information.

[0122] It is understandable that signaling S1 (as the second signaling) can be radio resource control reconfiguration (RRCReconfiguration) signaling or other types of signaling.

[0123] In some embodiments, the signaling S1 comprises a SensingCapabilityRequestConfig field. The SensingCapabilityRequestConfig field is used to indicate the reporting device information.

[0124] In some embodiments, the device information comprises whether a first cooperative sensing condition of network device requirement is met, a time interval in which a sensing task can be performed, a moving state, a moving direction, a moving speed, an amount of idle resources, and whether configured to allow the performance of the sensing task (i.e., whether there is a cooperative sensing willingness), etc.

[0125] It can be understood that the amount of idle resources is the amount of resources in an idle state and available for performing a sensing task. In the embodiments of the present application, the resources available for performing a sensing task include, but are not limited to, communication resources (such as bandwidth resources and signal transmission power, etc.), computing resources (such as processor computing power resources and storage resources, etc.), sensor resources (such as the aforementioned sensor resources for light sensing, sound sensing, and radio wave sensing), and energy resources (such as power), etc.

[0126] In some embodiments, the first cooperative sensing condition comprises at least one of the following:

[0127] (1) The sensing accuracy meets a sensing accuracy condition.

[0128] In some embodiments, the sensing accuracy condition comprises that a distance sensing error is less than a distance sensing error threshold, a speed sensing error is less than a speed sensing error threshold, an azimuth angle sensing error is less than an azimuth angle sensing error threshold, a pitch angle sensing error is less than a pitch angle sensing error threshold, an acceleration sensing error is less than an acceleration sensing error threshold, and / or a moving direction sensing deviation angle is less than a moving direction sensing deviation angle threshold.

[0129] (2) The sensing range is greater than or equal to a sensing range threshold.

[0130] The sensing range can be the detection range of a sensor, or it can also be the signal coverage range of wireless communication. It can be understood that the sensing range threshold can be set according to actual needs, which is not limited herein.

[0131] (3) The sensing delay is less than or equal to a sensing delay threshold.

[0132] The sensing delay is the response delay of the terminal device performing a sensing task. It can be understood that the sensing delay threshold can be set according to actual scene needs, which is not limited herein.

[0133] In some embodiments, the SensingCapabilityRequestConfig field is provided with a requiredCapabilityLevel field (as a first field). In other embodiments, the SensingCapabilityRequestConfig field is further provided with a triggerCondition field (as a second field), an eventType field (as a third field), and / or a reportValidityDuration field (as a fourth field).

[0134] For example, as shown in Table 1 below, the SensingCapabilityRequestConfig field is provided with a requiredCapabilityLevel field, a triggerCondition field, an eventType field, and a reportValidityDuration field.

[0135] The requiredCapabilityLevel field is used to indicate a first cooperative sensing condition required by the network device.

[0136] The triggerCondition field is used to indicate reporting device information at the time of receiving the signaling S1 (that is, immediately reporting device information), or indicating reporting device information according to a first period (such as 5 minutes, 10 minutes, or 25 minutes, etc.), or indicating reporting device information in response to a trigger event.

[0137] The eventType field is used to indicate an event type of the trigger event, such as a mobile state change event, a power change event, or a signal strength change event.

[0138] The reportValidityDuration field is used to indicate a valid duration of the device information reported this time. It can be understood that within the valid duration, the terminal device does not need to repeatedly report device information, so as to reduce the power consumption caused by repeated reporting of device information.

[0139] Table 1

[0140]

[0141] The signaling S1 can make the network device accurately schedule K terminal devices to report sensing capabilities by carrying the fields shown in Table 1, avoid blind broadcasting and redundant reporting, and improve signaling efficiency and effectiveness of the cooperative sensing candidate pool.

[0142] S102: The K terminal devices send a first confirmation signaling to the network device, wherein the first confirmation signaling is used to indicate successful reception of the signaling S1.

[0143] It can be understood that the first confirmation signaling can be radio resource control reconfiguration complete (RRCReconfigurationComplete for short) signaling or can also be other types of signaling.

[0144] In some embodiments, after the K terminal devices successfully receive the signaling S1 sent by the network device, the K terminal devices can send first confirmation signaling to the network device to inform the network device of successful reception of the signaling S1.

[0145] S103: The K terminal devices send signaling S2 to the network device, wherein the signaling S2 includes device information.

[0146] It can be understood that the signaling S2 (as the third signaling) can be RRCReconfiguration signaling or can also be other types of signaling.

[0147] In some embodiments, the triggerCondition field of the signaling S1 received by the K terminal devices indicates reporting device information at the moment of receiving the signaling S1. In this case, the K terminal devices immediately send the signaling S2 to the network device upon receiving the signaling S1.

[0148] For example, as shown in FIG. 2, in the case that the triggerCondition field of the signaling S1 indicates reporting device information at the moment of receiving the signaling S1, the vehicle-mounted terminal of the first vehicle 02, the vehicle-mounted terminal of the third vehicle 05, the vehicle-mounted terminal of the fifth vehicle 07, the vehicle-mounted terminal of the sixth vehicle 08, and the mobile phone 04 immediately report their respective device information to the base station 01 upon receiving the signaling S1. Figure 3

[0149] In other embodiments, the triggerCondition field of the signaling S1 received by the K terminal devices indicates reporting device information according to a first period. In this case, the K terminal devices send the signaling S2 to the network device according to the first period.

[0150] In yet other embodiments, the triggerCondition field of the signaling S1 received by the K terminal devices indicates reporting device information in response to a trigger event:

[0151] ​If the eventType field indicates that the event type of the triggering event is a mobility status change event, the K terminal devices can send signaling S2 to the network device upon detecting a mobility status change event (such as an event of changing from a stationary state to a moving state, an event of changing from a low-speed moving state to a high-speed moving state, or an event of changing from a high-speed moving state to a low-speed moving state, etc.). If the eventType field indicates that the event type of the triggering event is a power change event, the K terminal devices can send signaling S2 to the network device upon detecting a power change event (such as an event of entering a low-power state from a normal power state, or an event of entering a normal power state from a low-power state, etc.). If the eventType field indicates that the event type of the triggering event is a signal strength change event, the K terminal devices can send signaling S2 to the network device upon detecting a signal strength change event (such as an event of changing from a higher state to a lower state of signal strength, or an event of changing from a lower state to a higher state of signal strength, etc.).

[0152] In some embodiments, the signaling S2 includes a sensingAssistanceInfo field for indicating device information.

[0153] In some embodiments, the sensingAssistanceInfo field is further provided with a capabilityComplianceMask field (as a fifth field). In other embodiments, the sensingAssistanceInfo field is further provided with an availableSensingWindow field (as a sixth field), a mobilityStatus field (as a seventh field), a selfHeadingDeg field (as an eighth field), a recentSpeedEstimate field (as a ninth field), a sensingPowerBudget field (as a tenth field), and / or a taskIntentFlag field (as an eleventh field).

[0154] For example, as shown in Table 2, the sensingAssistanceInfo field is provided with the capabilityComplianceMask field, the availableSensingWindow field, the mobilityStatus field, the selfHeadingDeg field, the recentSpeedEstimate field, the sensingPowerBudget field, and the taskIntentFlag field.

[0155] The capabilityComplianceMask field is used to indicate whether the first cooperative sensing condition is met.

[0156] The availableSensingWindow field is used to indicate the time interval in which the sensing task can be performed.

[0157] The mobilityStatus field is used to indicate the mobility state, such as stationary, low speed, or high speed, and is used to evaluate the stability of the terminal device as a cooperative sensing terminal.

[0158] The selfHeadingDeg field is used to indicate the moving direction, and is used to facilitate the network device to determine whether it is suitable to participate in the execution of the sensing task in combination with the area where the sensing target is located.

[0159] The recentSpeedEstimate field is used to indicate the moving speed, and is used to facilitate the network device to determine whether the terminal device is suitable for the current motion scene.

[0160] The sensingPowerBudget field is used to indicate the amount of idle resources, and is used to facilitate the network device to determine whether the amount of idle resources that can be allocated by the terminal device to the sensing task is sufficient to perform the sensing task.

[0161] The taskIntentFlag field is used to indicate whether it is configured to allow the execution of the sensing task, i.e., whether there is a willingness to participate in the execution of the sensing task, and is used to facilitate the network device to perform screening based on the willingness.

[0162] Table 2

[0163]

[0164] It can be understood that the mobility state, moving direction, and moving speed indicated by the mobilityStatus field, selfHeadingDeg field, and recentSpeedEstimate field in sequence are suitable for high-mobility scenarios, and are helpful for the network device to more accurately determine whether the terminal device is suitable as a stable sensing node (i.e., a cooperative sensing terminal), thereby improving the effectiveness of the cooperative sensing candidate pool and the continuity of the cooperative sensing task.

[0165] S104: The network device selects M terminal devices as candidate cooperative sensing terminals from K terminal devices according to the device information reported by the K terminal devices, and establishes a cooperative sensing candidate pool, where K and M are positive integers, and M is less than or equal to K.

[0166] In some embodiments, after the network device receives the device information reported by the K terminal devices, the network device can select M terminal devices that satisfy the first cooperative sensing condition from the K terminal devices as candidate cooperative sensing terminals to add to the cooperative sensing candidate pool, and then store the cooperative sensing candidate pool locally.

[0167] As shown in Figure 3 , the base station 01 determines, according to the device information reported by the on-board terminal of the first vehicle 02, the on-board terminal of the third vehicle 05, the on-board terminal of the fifth vehicle 07, the on-board terminal of the sixth vehicle 08 and the mobile phone 04, that the on-board terminal of the first vehicle 02, the on-board terminal of the third vehicle 05, the on-board terminal of the fifth vehicle 07 and the on-board terminal of the sixth vehicle 08 satisfy the first cooperative sensing condition described above, while the mobile phone 04 does not satisfy the first cooperative sensing condition described above, and adds the on-board terminal of the first vehicle 02, the on-board terminal of the third vehicle 05, the on-board terminal of the fifth vehicle 07 and the on-board terminal of the sixth vehicle 08 as candidate cooperative sensing terminals to the established cooperative sensing candidate pool and stores it locally.

[0168] It can be understood that S102 is an optional step, that is, in other embodiments, S102 can also not be performed.

[0169] It can be understood that after the K terminal devices receive the signaling S1 sent by the network device, the K terminal devices can report sensing range, sensing accuracy, moving direction, moving state, moving speed, acceleration and / or position and other device information to the network device in addition to the device information shown in Table 2, so that the network device can select suitable cooperative sensing terminal devices to perform corresponding sensing tasks according to these information.

[0170] After the network device establishes the cooperative sensing candidate pool, since the candidate cooperative sensing terminals in the cooperative sensing candidate pool all have sensing capabilities, when the network device receives a cooperative sensing request, the network device does not need to detect terminal devices with cooperative sensing capabilities in the cell again, but can directly select suitable cooperative sensing terminals from the candidate cooperative sensing terminals in the cooperative sensing candidate pool to perform corresponding cooperative sensing tasks. In this way, the response speed of the network device can be improved, thereby improving the pointing efficiency of the cooperative sensing task, that is, the execution efficiency of the cooperative sensing task is improved by pre-selecting terminal devices with cooperative sensing capabilities.

[0171] The execution process of the cooperative sensing task is described below.

[0172] Figure 4 According to some embodiments of the present application, a flowchart of a cooperative sensing method is shown.

[0173] As shown in Figure 4 , the flowchart includes:

[0174] S201: The first terminal device sends a first request to the network device, wherein the first request is used to request to perform a first sensing task on a second terminal device.

[0175] In some embodiments, when the first terminal device needs other terminal devices to assist in sensing the second terminal device, the first terminal device can send a first request (i.e. a cooperative sensing request) to the network device as a sensing task initiation terminal to request the network device to call other terminal devices to assist the first terminal device to perform the first sensing task on the second terminal device.

[0176] In some embodiments, the first request can include information such as the moving state, moving direction, position, moving speed and acceleration of the first terminal device.

[0177] For example, as shown in Figure 3 when the vehicle terminal of the second vehicle 03 (as an example of the first terminal device) needs other terminal devices to assist in sensing the vehicle terminal of the fourth vehicle 06 (as an example of the second terminal device), the vehicle terminal of the second vehicle 03 can send a first request to the base station 01 to request the base station 01 to call other terminal devices to assist the vehicle terminal of the second vehicle 03 to perform the first sensing task on the vehicle terminal of the fourth vehicle 06.

[0178] S202: The network device selects N cooperative sensing terminal devices from M candidate cooperative sensing terminal devices in a cooperative sensing candidate pool in response to the first request, wherein N is a positive integer and N is less than or equal to M.

[0179] In some embodiments, after the network device receives the first request sent by the first terminal device, the network device can select N cooperative sensing terminal devices that satisfy the second cooperative sensing condition from the M candidate cooperative sensing terminal devices in the pre-established cooperative sensing candidate pool in response to the first request, for assisting the first terminal device to perform the sensing task on the second terminal device.

[0180] In some embodiments, the second cooperative sensing condition includes that the amount of idle resources is greater than or equal to the amount of resources required by the first sensing task, and is configured to allow the sensing task to be performed.

[0181] In other embodiments, the second cooperative sensing condition can also include that the position of the second terminal device is within the sensing range of the cooperative sensing terminal device.

[0182] For example, as shown in Figure 3As shown, since the on-board terminal of the fourth vehicle 06 is within the sensing range of the on-board terminal of the first vehicle 02 and the on-board terminal of the third vehicle 05, but not within the sensing range of the on-board terminal of the fifth vehicle 07 and the on-board terminal of the sixth vehicle 08, the base station 01 can select the on-board terminal of the first vehicle 02 and the on-board terminal of the third vehicle 05 as the cooperative sensing terminals.

[0183] S203: The network device sends signaling S3 to the N cooperative sensing terminals, where the signaling S3 is used to instruct to perform the first sensing task.

[0184] It can be understood that the signaling S3 can be RRCReconfiguration signaling or can also be other types of signaling.

[0185] In some embodiments, after the network device selects the N cooperative sensing terminals from the M candidate cooperative sensing terminals in the cooperative sensing candidate pool, the network device can send the signaling S3 (as the first signaling) to the N cooperative sensing terminals to instruct the N cooperative sensing terminals to perform the first sensing task.

[0186] Exemplarily, as Figure 3 shown, after the base station 01 selects the on-board terminal of the first vehicle 02 and the on-board terminal of the third vehicle 05 as the cooperative sensing terminals, the base station 01 can send the signaling S3 to the on-board terminal of the first vehicle 02 and the on-board terminal of the third vehicle 05 to instruct the on-board terminal of the first vehicle 02 and the on-board terminal of the third vehicle 05 to perform the first sensing task on the on-board terminal of the fourth vehicle 06.

[0187] In some embodiments, the signaling S3 includes a taskType field (as the twelfth field). In other embodiments, the signaling S3 further includes a sensingTaskID field (as the thirteenth field), a ttlMs field (as the fourteenth field), a terminationCond field (as the fifteenth field), a taskTimeWindow field (as the sixteenth field), and / or a targetObjectInfo field (as the seventeenth field).

[0188] For example, as shown in Table 3 below, the signaling S3 includes the taskType field, the sensingTaskID field, the ttlMs field, the terminationCond field, the taskTimeWindow field, and the targetObjectInfo field.

[0189] The taskType field is used to indicate the task type of the first perception task. The task type includes, but is not limited to, a position perception task, a moving track perception task, a distance perception task, a moving direction perception task, a moving speed perception task, or an acceleration perception task, etc.

[0190] The sensingTaskID field is used to indicate the first identification of the first perception task. It can be understood that the first identification is an identification configured by the network device to the first perception task, which is used to distinguish the perception tasks and avoid confusion of the network device in the case of receiving multiple perception tasks.

[0191] The ttlMs field is used to indicate the valid duration of the first perception task, which is used to indicate that the device releases the resource used to execute the first perception task when the duration of receiving the signaling S3 reaches the valid duration of the first perception task.

[0192] The terminationCond field is used to indicate the termination condition of the first perception task. In some embodiments, the termination condition includes that the perception accuracy does not meet the perception accuracy condition and / or the first perception task is executed completely.

[0193] The taskTimeWindow field is used to indicate the execution time window of the first perception task, that is, the time period from the starting execution time to the ending execution time of the first perception task.

[0194] The targetObjectInfo field is used to indicate the device type, position, and / or direction of the second terminal device relative to the network device, so as to guide the cooperative perception terminal to adjust the perception attention area (such as the area where the second terminal device is located) and the processing strategy.

[0195] Table 3

[0196]

[0197] In some embodiments, as shown in Table 3, the signaling S3 can also include some information related to the perception resource configuration, such as the sampling frequency (the frequency of detecting the perception target, that is, the perception frequency), the aggregation window length at the time of reporting (such as the length of the signaling S3), the data accuracy and size, the delay threshold of the reporting link, and the maximum uplink transmission budget available for the first perception task, etc.

[0198] It can be understood that, by indicating the valid duration of the first perception task through the ttlMs field and indicating the termination condition of the first perception task through the terminationCond field, the cooperative perception terminal can automatically end the execution of the first perception task and release the resource used to execute the first perception task when the first perception task reaches the valid duration and meets the termination condition, so as to realize the cooperative perception with fast decision, fast start, and fast exit.

[0199] S204: The N cooperative sensing terminals send second confirmation signaling to the network device, where the second confirmation signaling is used to indicate that the signaling S3 is successfully received.

[0200] It can be understood that the second confirmation signaling can be RRCReconfigurationComplete signaling or can also be other types of signaling.

[0201] In some embodiments, after the N cooperative sensing terminals receive the signaling S3 sent by the network device, the N cooperative sensing terminals can send second confirmation signaling to the network device to inform the network device that the signaling S3 is successfully received.

[0202] S205: The N cooperative sensing terminals perform the first sensing task.

[0203] In some embodiments, after the N cooperative sensing terminals receive the signaling S3 sent by the network device, the N cooperative sensing terminals perform the first sensing task on the second terminal device within the execution time window of the first sensing task in response to the signaling S3.

[0204] S206: The N cooperative sensing terminals send execution result information of the first sensing task to the network device.

[0205] In some embodiments, after the N cooperative sensing terminals perform the first sensing task, or after the first sensing task meets the aforementioned termination condition, the N cooperative sensing terminals can send execution result information of the first sensing task performed by each of the N cooperative sensing terminals to the network device.

[0206] In some embodiments, the execution result information of the first sensing task includes information such as the moving speed, moving direction, acceleration, and position of the second terminal device.

[0207] Exemplarily, as shown in FIG. 6, the vehicle-mounted terminal of the first vehicle 02 and the vehicle-mounted terminal of the third vehicle 05 send execution result information of the first sensing task performed on the vehicle-mounted terminal of the fourth vehicle 06 to the base station 01. Figure 3

[0208] S207: The network device sends first execution result of the first sensing task to the first terminal device according to the received execution result information.

[0209] After the network device receives the execution result information of the first sensing task sent by at least one cooperative sensing terminal, the network device can send first execution result of the first sensing task to the first terminal device according to the received execution result information of the first sensing task.

[0210] ​The first execution result includes, but is not limited to, the position, moving track, distance, moving direction, moving speed and / or acceleration of the second terminal device.

[0211] As shown in Figure 3 , after the base station 01 receives the execution result information of the first perception task sent by the on-board terminal of the first vehicle 02 and / or the on-board terminal of the third vehicle 05, the base station 01 can send the first execution result of the first perception task to the on-board terminal of the second vehicle 03 according to the received execution result information, such as the position, moving track, distance, moving direction, moving speed and / or acceleration of the on-board terminal of the fourth vehicle 06.

[0212] It can be understood that S204 is an optional step, and in some other embodiments, S204 can also not be executed.

[0213] In the embodiments of the present application, the network device invokes N cooperative perception terminals to assist the first terminal device in perceiving the second terminal device, which can improve the perception accuracy of the second terminal device.

[0214] Figure 5 According to some embodiments of the present application, a flowchart of another cooperative perception method is shown.

[0215] As shown in Figure 5 , the flowchart includes:

[0216] S301: The first terminal device sends a first request to the network device, where the first request is used to request to execute a first perception task on a second terminal device.

[0217] S302: The network device selects N cooperative perception terminals from M candidate cooperative perception terminals in a cooperative perception candidate pool in response to the first request, where N is a positive integer and N is less than or equal to M.

[0218] S303: The network device sends signaling S3 to the N cooperative perception terminals, where the signaling S3 is used to instruct to execute the first perception task.

[0219] S304: The N cooperative perception terminals send second confirmation signaling to the network device, where the second confirmation signaling is used to indicate that the signaling S3 is successfully received.

[0220] S305: The N cooperative perception terminals execute the first perception task.

[0221] S306: The N cooperative perception terminals send execution result information of the executed first perception task to the network device.

[0222] S301-S306 are substantially the same as S201-S206, and will not be described here.

[0223] S307: During the movement of the second terminal device, the network device sends signaling S4 to the third terminal device at the first moment. Signaling S4 is used to activate the third terminal device and instruct the third terminal device to maintain a low power consumption state.

[0224] In some embodiments, the third terminal device is located within a first region, which is the predicted arrival region of the second terminal device after a first duration. The third terminal device is a candidate cooperative sensing terminal other than N cooperative sensing terminals in the cooperative sensing candidate pool.

[0225] In some embodiments, the first region is determined based on the predicted movement trajectory of the second terminal device and / or the execution result information received from at least one collaborative sensing terminal after completing the first sensing task. This execution result information includes the movement speed, direction of movement, acceleration, and position of the second terminal device. The predicted movement trajectory may be determined based on the historical movement trajectory of the second terminal device. The historical movement trajectory of the second terminal device may be determined based on historical trajectory information from the second terminal device.

[0226] Specifically, during the movement of the second device, the network device can obtain historical trajectory information uploaded by the second terminal device from a traffic platform, a multi-access edge computing (MEC) service platform, or other platforms. Alternatively, it can directly receive historical trajectory information returned by the second terminal device and then determine the historical trajectory of the second terminal device based on this information. Then, based on the historical movement trajectory of the second terminal device and / or its current speed, direction, acceleration, and position, the network device predicts the first area the second terminal device may arrive at after a first time period and sends signaling S4 (as a fourth signaling) to the third terminal device within the first area to activate the third terminal and instruct it to maintain a low-power state.

[0227] It is understandable that signaling S4 can be RRCReconfiguration signaling or other types of signaling.

[0228] In some embodiments, signaling S4 includes a preConfigurationFlag field (as the eighteenth field). In other embodiments, signaling S4 also includes an activationPagingIndication field (as the nineteenth field), a lightListenHint field (as the twentieth field), a preConfiguredTaskContent field (as the twenty-first field), and / or a preConfigurationID field (as the twenty-second field).

[0229] For example, as shown in Table 4 below, the signaling S4 includes a preConfigurationFlag field, an activationPagingIndication field, a lightListenHint field, a preConfiguredTaskContent field, and a preConfigurationID field.

[0230] The preConfigurationFlag field is used to indicate entering a low-power state. Also, the signaling is identified as pre-configuration signaling, indicating that the terminal device only receives and does not immediately perform a sensing task.

[0231] The activationPagingIndication field is used to indicate listening to the signaling S5 (as the fifth signaling).

[0232] The lightListenHint field is used to indicate the listening intensity and the listening period.

[0233] The preConfiguredTaskContent field is used to indicate the task configuration information of the first sensing task. In some embodiments, the preConfiguredTaskContent field can contain an encapsulation field of the task configuration information of the first sensing task, which is only unpacked and applied when the terminal device receives the signaling S5.

[0234] The preConfigurationID field is used to indicate the second identification of the signaling S4.

[0235] Table 4

[0236]

[0237] S308: The third terminal device enters a low-power state in response to the signaling S4.

[0238] After the third terminal device receives the signaling S4, the third terminal device enters a low-power state in response to the signaling S4.

[0239] In some embodiments, the third terminal device can configure resources for performing the first sensing task according to the task configuration information of the first sensing task indicated by the preConfiguredTaskContent field of the signaling S4. By pre-configuring the resources of the first sensing task, the response speed of the third terminal device can be improved.

[0240] S309: The network device sends the signaling S5 to the third terminal device at a second time, and the signaling S5 is used to instruct the third terminal device to perform the first sensing task.

[0241] After the network device transmits the signaling S4 to the third terminal device at the first time, the network device transmits the signaling S5 to the third terminal device at a second time, with an interval of a first time length.

[0242] It can be understood that the signaling S5 (as the fifth signaling) can be an RRCReconfiguration signaling or can also be other types of signaling.

[0243] In some embodiments, the signaling S5 includes an activationFlag field (as the twenty-third field). In other embodiments, the signaling S5 further includes a taskActivationID field (as the twenty-fourth field) and / or an activationTimingHint field (as the twenty-fifth field).

[0244] For example, as shown in Table 5 below, the signaling S5 includes the activationFlag field, the taskActivationID field and the activationTimingHint field.

[0245] The activationFlag field is used to indicate execution of the first perception task. In this embodiment, the activationFlag field is a first value, such as a logical value true or a numerical value 1, indicating execution of the first perception task. In other embodiments, the activationFlag field is a second value, such as a logical value false or a numerical value 0, indicating non-execution of the first perception task.

[0246] The taskActivationID field is used to indicate the second identification of the signaling S4.

[0247] The activationTimingHint field is used to indicate an execution time window of the first perception task.

[0248] Table 5

[0249]

[0250] S310: The third terminal device executes the first perception task in response to the signaling S5.

[0251] After the third terminal device receives the signaling S5, the third terminal device parses the signaling S5 to determine the second identifier of the signaling S4 and the execution time window of the first sensing task. Then, the third terminal device queries the previously received signaling S4 based on the second identifier, and parses the encapsulated field contained in the preConfiguredTaskContent field of the signaling S4 to obtain the task configuration information of the first sensing task. Then, the third terminal device configures corresponding resources according to the task configuration information of the first sensing task, and executes the first sensing task in the execution time window of the first sensing task.

[0252] S311: The third terminal device sends the execution result information of the executed first sensing task to the network device.

[0253] After the third terminal device executes the first sensing task, the third terminal device can send the execution result information of the first sensing task to the network device.

[0254] S312: The network device sends the first execution result of the first sensing task to the first terminal device according to the received execution result information.

[0255] S312 is essentially the same as S207, and will not be described here.

[0256] In the embodiments of the present application, in the scenario that the second terminal device is in a mobile state, the network device predicts the first area where the second terminal device will soon arrive, and activates the third terminal device in the first area in advance, and instructs the third terminal device to be in a low-power consumption state. In this way, when the second terminal device arrives at the first area, the network device can directly instruct the third terminal device to exit the low-power consumption state, and take over the first sensing task from the cooperative sensing terminal that loses the sensing ability for the second terminal device.

[0257] According to the above manner, the network device can activate multiple terminal devices in the first area in advance, and instruct the multiple terminal devices to be in a low-power consumption state to form an interruption risk buffer pool. In this way, when the second terminal device arrives at the first area, the network device can immediately switch the cooperative sensing terminal that executes the first sensing task to the terminal device in the interruption risk buffer pool. In this way, the switching speed of the cooperative sensing terminal can be improved, the switching delay can be reduced, and the interruption of the cooperative sensing link can be avoided, that is, the interruption of the first sensing task can be avoided.

[0258] Figure 6 According to some embodiments of the present application, a flowchart of another cooperative sensing method is shown.

[0259] As shown in Figure 6 , the flowchart includes:

[0260] S401: The first terminal device sends a first request to the network device, wherein the first request is used to request the execution of a first sensing task for the second terminal device.

[0261] S402: In response to the first request, the network device selects N cooperative sensing terminals from the M candidate cooperative sensing terminals in the cooperative sensing candidate pool.

[0262] S403: The network device sends signaling S3 to N cooperative sensing terminals, where signaling S3 is used to instruct the execution of the first sensing task.

[0263] S404: N cooperative sensing terminals send a second confirmation signaling to the network device, wherein the second confirmation signaling is used to indicate that the signaling S3 has been successfully received.

[0264] S405: N collaborative sensing terminals perform the first sensing task.

[0265] S406: N collaborative sensing terminals send the execution result information of the first sensing task to the network device.

[0266] S401~S406 are essentially the same as S201~S206, and will not be elaborated further here.

[0267] S407: The network device determines the predicted movement trajectory of the second terminal device.

[0268] After the network device receives the execution result information of the first sensing task sent by at least one of the N collaborative sensing terminals, the network device can obtain the historical trajectory information of the second terminal device, and then predict the movement trajectory of the second terminal device based on the historical trajectory information of the second terminal device and / or the execution result information of the first sensing task (such as the movement direction, movement speed, acceleration and position of the second terminal device), thus obtaining the predicted movement trajectory of the second terminal.

[0269] For example, such as Figure 7 As shown, base station 01 determines the predicted movement trajectory L1 of the vehicle-mounted terminal of the fourth vehicle 06 based on the historical movement trajectory information of the vehicle-mounted terminal of the fourth vehicle 06 and / or the execution result information of the first sensing task (such as the movement direction, movement speed, acceleration and position of the vehicle-mounted terminal of the fourth vehicle 06).

[0270] S408: The network device sends signaling S4 to a third terminal device on the predicted movement trajectory. Signaling S4 is used to activate the third terminal device and instruct the third terminal device to maintain a low power consumption state.

[0271] After the network device determines the predicted moving track of the second terminal device, the network device can send signaling S4 to the third terminal device on the predicted moving track, to activate the third terminal device and instruct the third terminal device to keep a low-power consumption state.

[0272] Exemplarily, as shown in Figure 7 the base station 01 can send signaling S4 to the vehicle-mounted terminal of the fifth vehicle 07 (as an example of the third terminal device) on the predicted moving track L1 of the vehicle-mounted terminal of the fourth vehicle 06, to activate the vehicle-mounted terminal of the fifth vehicle 07 and instruct the vehicle-mounted terminal of the fifth vehicle 07 to keep a low-power consumption state.

[0273] S409: The third terminal device enters a low-power consumption state in response to the signaling S4.

[0274] S410: The third terminal device sends third confirmation signaling to the network device, where the third confirmation signaling is used to indicate that the signaling S4 is successfully received.

[0275] It can be understood that the third confirmation signaling can be RRCReconfigurationComplete signaling or can also be other types of signaling.

[0276] After the third terminal device successfully receives the signaling S4 sent by the network device, the third terminal device can send third confirmation signaling to the network device to inform the network device that the signaling S4 has been successfully received.

[0277] S411: The network device detects whether the third terminal device meets the execution condition of the first perception task.

[0278] If yes, S412 is executed. If no, the execution continues with S411.

[0279] In some embodiments, the execution condition of the first perception task can include that the second terminal device moves into the perception range of the third terminal device.

[0280] Specifically, the network device can detect whether the second terminal device moves into the perception range of the third terminal device. If the second terminal device moves into the perception range of the third terminal device, the network device executes the following S412. If the second terminal device does not move into the perception range of the third terminal device, the network device continues to detect whether the second terminal device moves into the perception range of the third terminal device.

[0281] S412: The network device sends signaling S5 to the third terminal device, where the signaling S5 is used to instruct to execute the first perception task.

[0282] After the network device detects that the second terminal device moves into the sensing range of the third terminal device, the network device can send signaling S5 to the third terminal device to instruct the third terminal device to perform the first sensing task.

[0283] As shown in the figure, Figure 8 When the on-board terminal of the fourth vehicle 06 moves into the sensing range of the on-board terminal of the fifth vehicle 07, the base station 01 can send signaling S5 to the on-board terminal of the fifth vehicle 07 to instruct the on-board terminal of the fifth vehicle 07 to perform the first sensing task.

[0284] S413: The third terminal device sends fourth confirmation signaling to the network device, where the fourth confirmation signaling is used to indicate that the signaling S5 is successfully received.

[0285] It can be understood that the fourth confirmation signaling can be RRCReconfigurationComplete signaling or other types of signaling.

[0286] After the third terminal device successfully receives the signaling S5, the third terminal device can send fourth confirmation signaling to the network device to inform the network device that the signaling S5 has been successfully received.

[0287] S414: The third terminal device parses the signaling S4 to obtain the task configuration information of the first sensing task.

[0288] After the third terminal device receives the signaling S5, the third terminal device can parse the previously received signaling S4 to obtain the configuration information of the first task carried in the preConfiguredTaskContent field of the signaling S4.

[0289] S415: The third terminal device performs the first sensing task based on the task configuration information of the first sensing task.

[0290] After the third terminal device obtains the task configuration information of the first sensing task, the third terminal device can configure corresponding resources to perform the first sensing task according to the task configuration information.

[0291] As shown in the figure, Figure 8 Since the on-board terminal of the fourth vehicle 06 moves out of the sensing range of the on-board terminal of the first vehicle 02, the on-board terminal of the fifth vehicle 07 takes over the on-board terminal of the first vehicle 02 as a cooperative sensing terminal and performs the first sensing task on the on-board terminal of the fourth vehicle 06.

[0292] S416: The third terminal device sends execution result information of the first sensing task to the network device.

[0293] As shown in the figure, Figure 8As shown, after the on-board terminal of the fifth vehicle 07 completes the first sensing task, it sends the execution result information of the first sensing task to the base station 01.

[0294] S417: The network device sends the first execution result of the first sensing task to the first terminal device based on the received execution result information.

[0295] S417 and S312 are essentially the same, and will not be discussed further here.

[0296] It is understood that S404, S410, and S413 are all optional steps, that is, in some other embodiments, S404, S410, and S413 may not be executed.

[0297] In this embodiment, the network device pre-activates a third terminal device on the predicted movement trajectory of the second terminal device and instructs the third terminal device to be in a low-power state, thus enabling the third device to be ready to act as a cooperative sensing terminal at any time. In this way, when the second terminal device moves into the sensing range of the third terminal device, the network device can quickly instruct the third terminal device to perform the first sensing task as a cooperative sensing terminal, thereby avoiding anomalies such as interruption or high latency in the execution of the first sensing task during the movement of the first terminal device.

[0298] Figure 9 According to some embodiments of this application, a flowchart of another collaborative sensing method is shown.

[0299] like Figure 9 As shown, the process includes:

[0300] S501: The first terminal device sends a first request to the network device, wherein the first request is used to request the execution of a first sensing task for the second terminal device.

[0301] S502: In response to the first request, the network device selects N cooperative sensing terminals from the M candidate cooperative sensing terminals in the cooperative sensing candidate pool.

[0302] S503: The network device sends signaling S3 to N cooperative sensing terminals, where signaling S3 is used to instruct the execution of the first sensing task.

[0303] S504: N cooperative sensing terminals send a second confirmation signaling to the network device, wherein the second confirmation signaling is used to indicate that the signaling S3 has been successfully received.

[0304] S505: N collaborative sensing terminals perform the first sensing task.

[0305] S506: N collaborative sensing terminals send the execution result information of the first sensing task to the network device.

[0306] S507: The network device determines the predicted moving track of the second terminal device.

[0307] S501-S507 are substantially the same as S401-S407, and will not be described herein.

[0308] S508: The network device detects that the second terminal device deviates from the predicted moving track.

[0309] After the network device determines the predicted moving track of the second terminal device, the network device determines that the second terminal device deviates from the predicted moving track according to the information of the moving speed, the moving direction, the acceleration and the position of the second terminal device returned by the second terminal device, such as that the angle of the second terminal device deviating from the predicted moving track is greater than a deviation angle threshold, and / or the distance of the second terminal device deviating from the predicted moving track is greater than a deviation distance threshold.

[0310] For example, as shown in FIG. 6, the base station 01 detects that the vehicle terminal of the fourth vehicle 06 moves along the moving track L2 and deviates from the predicted moving track L1. Figure 10

[0311] S509: The network device sends signaling S4 to a third terminal device in the predicted arrival area of the second terminal device, where the signaling S4 is used to activate the third terminal device and instruct the third terminal device to keep a low-power consumption state.

[0312] After the network device detects that the second terminal device deviates from the predicted moving track, the network device can determine the predicted arrival area of the second terminal device after a first time length, i.e., the first area, according to the current moving speed, the moving direction, the acceleration and the position of the second terminal device, and then send the signaling S4 to the third terminal device in the area to activate the third terminal device and instruct the third terminal device to keep a low-power consumption state.

[0313] For example, as shown in FIG. 6, the base station 01 determines the arrival area R1 (as an example of the first area) of the vehicle terminal of the fourth vehicle 06 after a first time length according to the current moving speed, the moving direction, the acceleration and the position of the vehicle terminal of the fourth vehicle 06, and then sends the signaling S4 to the vehicle terminal of the sixth vehicle 08 (as an example of the third terminal device) in the area R1 to activate the vehicle terminal of the sixth vehicle 08 and instruct the vehicle terminal of the sixth vehicle 08 to keep a low-power consumption state. Figure 10 S510: The third terminal device enters a low-power consumption state in response to the signaling S4.

[0314] For example, as shown in FIG. 6, the vehicle terminal of the sixth vehicle 08 enters a low-power consumption state in response to the signaling S4.

[0315] Figure 10

[0316] ​​​S511: The third terminal device sends a third confirmation signaling to the network device, wherein the third confirmation signaling is used to indicate that the signaling S4 has been successfully received.

[0317] S512: The network device detects whether the third terminal device meets the execution conditions of the first sensing task.

[0318] If yes, then execute S513. If no, then continue executing S512.

[0319] S513: The network device sends signaling S5 to the third terminal device. Signaling S5 is used to instruct the execution of the first sensing task.

[0320] For example, such as Figure 11 As shown, when the vehicle-mounted terminal of the fourth vehicle 06 moves along the movement trajectory L2 into the sensing range of the vehicle-mounted terminal of the sixth vehicle 08, the base station 01 can send signaling S5 to the vehicle-mounted terminal of the sixth vehicle 08 to instruct the vehicle-mounted terminal of the sixth vehicle 08 to perform the first sensing task.

[0321] S514: The third terminal device sends a fourth confirmation signaling to the network device, wherein the fourth confirmation signaling is used to indicate that the signaling S5 has been successfully received.

[0322] S515: The third terminal device parses the signaling S4 to obtain the task configuration information of the first sensing task.

[0323] S516: The third terminal device executes the first sensing task based on the task configuration information of the first sensing task.

[0324] For example, such as Figure 11 As shown, the on-board terminal of the sixth vehicle 08 responds to signaling S5 and performs the first sensing task for the on-board terminal of the fourth vehicle 06.

[0325] S517: The third terminal device sends the execution result information of the first sensing task to the network device.

[0326] For example, such as Figure 11 As shown, after the vehicle-mounted terminal of the sixth vehicle 08 completes the first sensing task, it sends the execution result information of the first sensing task to the base station 01.

[0327] S518: The network device sends the first execution result of the first sensing task to the first terminal device based on the received execution result information.

[0328] S518 and S417 are essentially the same, and will not be discussed further here.

[0329] In the embodiments of the present application, when the second terminal device deviates from the predicted moving track, the network device can predict the area that the second terminal device is likely to reach, and then activate the terminal devices in the area in advance and instruct the terminal devices in the area to be in a low-power consumption state. In this way, when the second terminal device reaches the area, the network device can directly instruct the terminal devices in the area to exit the low-power consumption state and perform the first sensing task on the second terminal device as the cooperative sensing terminal. In this way, the switching speed of the cooperative sensing terminal can be improved, so as to avoid abnormal phenomena such as interruption or high delay of the first sensing task.

[0330] It can be understood that, in the flowcharts shown in Figure 6 and Figure 9 , after the third terminal device receives the signaling S4 sent by the network device, the third terminal device can also directly analyze the signaling S4 to obtain the configuration information of the first task carried in the preConfiguredTaskContent field of the signaling S4, and then configure resources (hereinafter referred to as “pre-configuration mechanism”) for performing the first sensing task based on the configuration information. In this way, when the third terminal device receives the signaling S5 sent by the network device, the third terminal device can directly perform the first sensing task in response to the signaling S5, without performing the processes of analyzing the signaling S4 and resource configuration again. In this way, the response speed of the third terminal device can be improved, so as to improve the switching speed of the cooperative sensing terminal, reduce the switching delay of the cooperative sensing terminal, and thus avoid interruption or high delay of the first sensing task.

[0331] Compared with the traditional one-time configuration mode, the pre-configuration mechanism avoids the signaling overhead caused by repeated link establishment and full-amount configuration, which is beneficial to improve the efficiency of switching the cooperative sensing terminal and ensure the continuity of the sensing task in a dynamic environment.

[0332] Figure 12 According to some embodiments of the present application, a structural schematic diagram of an electronic device is shown.

[0333] As shown in Figure 12 , the electronic device 100 includes a processor 110, a mobile communication module 120, a wireless communication module 130, a power supply module 140, an audio module 150, an interface module 160, a camera 170, a memory 180, and a sensor module 190, etc.

[0334] The mobile communication module 120 and the wireless communication module 130 are used for communication with the aforementioned network device.

[0335] The electronic device 100 can be the aforementioned network device, or the aforementioned cooperative sensing terminal.

[0336] In the case that the electronic device 100 is the aforementioned network device, the electronic device 100 can pre-establish the aforementioned collaborative perception candidate pool and store the collaborative perception candidate pool in the memory 180.

[0337] In the case that the electronic device 100 is the aforementioned collaborative perception terminal, the electronic device 100 can perform the aforementioned first perception task on the second terminal device through the audio module 150, the camera 170 and the sensor module 190.

[0338] In some embodiments, the audio module 150 is configured to emit ultrasonic waves to collect the perception information of the second terminal device, such as distance, by using the ultrasonic waves.

[0339] In some embodiments, the sensor module 190 includes a millimeter wave radar, an infrared sensor, and / or an active radar sensor. The electronic device 100 can invoke the millimeter wave radar, the infrared sensor, and / or the active radar of the sensor module 190 to collect the perception information of the second terminal device, such as distance.

[0340] In some embodiments, the electronic device 100 can invoke the camera 170 to take multiple images of the second terminal device, and then determine the state of the second terminal device, such as movement state, movement direction, movement speed, acceleration, and position, based on the multiple images.

[0341] It can be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than illustrated, or combine certain components, or split certain components, or different component arrangements. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0342] The processor 110 can include one or more processing units, for example, can include a processing module or processing circuit of a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), a micro-programmed control unit (MCU), an artificial intelligence (AI) processor, or a field programmable gate array (FPGA), etc. Different processing units can be independent devices or integrated in one or more processors. The processor 110 can be provided with a storage unit for storing instructions and data.

[0343] This application also provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the aforementioned actions. Figure 2 , Figure 4 to Figure 6 as well as Figure 9 The method provided in the embodiments.

[0344] This application also provides a computer program product, including computer program code, which, when run on a computer, causes the computer to perform the aforementioned... Figure 2 , Figure 4 to Figure 6 as well as Figure 9 The method provided in the embodiments.

[0345] This application also provides a wireless communication system, including a network device and a cooperative sensing terminal, wherein the network device is used to perform... Figure 2 , Figure 4 to Figure 6 as well as Figure 9 The method is executed by network devices. The cooperative sensing terminal is used to execute... Figure 2 , Figure 4 to Figure 6 as well as Figure 9 The method is executed by the collaborative sensing terminal.

[0346] This application provides a chip, including a processor, which is used to read and execute a computer program stored in a memory to perform the aforementioned... Figure 2 , Figure 4 to Figure 6 as well as Figure 9 The method provided in the embodiments.

[0347] Figure 13 According to some embodiments of this application, a schematic diagram of the structure of a first cooperative sensing device is shown. The first cooperative sensing device stores a cooperative sensing candidate pool, which includes M candidate cooperative sensing terminals, where M is a positive integer.

[0348] like Figure 13 As shown, the first cooperative sensing device 200 includes:

[0349] The first receiving module 210 is configured to receive a first request from the first terminal device, wherein the first request is used to request the execution of a sensing task for the second terminal device.

[0350] Selection module 220 is used to select N collaborative sensing terminals from M candidate collaborative sensing terminals in response to a first request, where M and N are both positive integers, and N is less than or equal to M.

[0351] The first sending module 230 is used to send a first signaling to N collaborative sensing terminals, wherein the first signaling is used to instruct the execution of a sensing task.

[0352] The second receiving module 240 is configured to receive execution result information of the sensing task performed by at least one of the N cooperative sensing terminals.

[0353] The second sending module 250 is configured to send the first sensing result of the second terminal device to the first terminal device according to the received execution result information.

[0354] Figure 14 According to some embodiments of the present application, a structural diagram of the second cooperative sensing device is shown.

[0355] As shown in Figure 14 The second cooperative sensing device 300 includes:

[0356] The third receiving module 310 is configured to receive first signaling from a network device, wherein the network device stores a cooperative sensing candidate pool, the cooperative sensing candidate pool includes M candidate cooperative sensing terminals, M is a positive integer, the first signaling is sent by the network device after selecting the cooperative sensing terminal from the M candidate cooperative sensing terminals after receiving a first request from the first terminal device, and the first request is used to request to perform the first sensing task on the second terminal device.

[0357] The execution module 320 is configured to perform the first sensing task in response to the first signaling.

[0358] The third sending module 330 is configured to send execution result information of the first sensing task to the network device.

[0359] Embodiments disclosed in the present application can be implemented in hardware, software, firmware or a combination thereof. Embodiments of the present application can be implemented as computer programs or program codes executed on a programmable system, which includes at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device and at least one output device.

[0360] The program code can be applied to input instructions to perform the functions described in the present application and generate output information. The output information can be applied to one or more output devices in a known manner. For the purpose of the present application, the processing system includes any system having a processor such as, for example, a digital signal processor, a microcontroller, an application specific integrated circuit or a microprocessor.

[0361] The program code can be implemented in a high-level programming language or an object-oriented programming language to communicate with the processing system. If necessary, the program code can also be implemented in assembly language or machine language. In fact, the mechanisms described in the present application are not limited to the scope of any specific programming language. In any case, the language can be a compiled language or an interpreted language.

[0362] In some cases, the disclosed embodiments can be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments can also be implemented as instructions carried by or stored on a transitory or non-transitory machine-readable (e.g., computer-readable) medium, which can be read and executed by one or more processors. For example, the instructions can be distributed over the network or by other computer readable media. Thus, a machine-readable medium can include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), including without limitation floppy disks, optical disks, optical fibers, read-only memory, random access memory, erasable programmable read-only memory, electrically erasable programmable read-only memory, magnetic or optical cards, flash memory, or a tangible, machine-readable storage used in the transmission of information over the Internet via electrical, optical, or other forms of propagated signals (e.g., carrier waves, infrared signals, digital signals, etc.). Accordingly, the machine-readable medium includes any type of medium for storing or transmitting electronic instructions or information in a form readable by a machine (e.g., a computer).

[0363] In the drawings, some of the structural or methodological features can be shown in particular arrangements and / or orders. However, it should be understood that such particular arrangements and / or orders can not be required. Instead, these features can be arranged in a different manner and / or order than shown in the illustrative figures, in some embodiments. Additionally, the inclusion of a structural or methodological feature in a particular figure is not meant to imply that such feature is required in all embodiments, and in some embodiments, these features can not be included or can be combined with other features.

[0364] It should be noted that each unit / module mentioned in the device embodiments of the present application is a logical unit / module, in physical, one logical unit / module can be one physical unit / module, also can be a part of one physical unit / module, also can be realized in combination of multiple physical unit / modules, the physical realization of these logical units / modules is not the most important, the combination of the functions realized by these logical units / modules is the key to solve the technical problems proposed in the present application. In addition, in order to highlight the innovative part of the present application, the above-mentioned device embodiments of the present application do not introduce the units / modules which are not closely related to solving the technical problems proposed in the present application, which does not mean that the above-mentioned device embodiments do not have other units / modules.

[0365] It should be noted that in the examples and description of this application, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes the aforementioned element.

[0366] Although this application has been illustrated and described with reference to certain embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made thereto without departing from the scope of this application.

Claims

1. A collaborative sensing method, characterized in that, Applied to network devices, the network devices storing a cooperative sensing candidate pool, the cooperative sensing candidate pool including M candidate cooperative sensing terminals, where M is a positive integer, the method includes: Receive a first request from a first terminal device, wherein the first request is used to request the execution of a first sensing task for a second terminal device; In response to the first request, N collaborative sensing terminals are selected from the M candidate collaborative sensing terminals, where N is a positive integer and N is less than or equal to M; Send a first signaling message to the N collaborative sensing terminals, wherein the first signaling message is used to instruct the execution of the first sensing task; Receive execution result information from at least one of the N collaborative sensing terminals after completing the first sensing task; Based on the received execution result information, the first perception result for the second terminal device is sent to the first terminal device; Before sending the first perception result for the second terminal device to the first terminal device based on the received execution result information, the method includes: During the movement of the second terminal device, at a first moment, a fourth signaling message is sent to the third terminal device in the first area. Wherein, the first area is the predicted arrival area of ​​the second terminal device after the first duration, the third terminal device is a candidate cooperative sensing terminal other than the N cooperative sensing terminals in the cooperative sensing candidate pool, and the fourth signaling is used to activate the third terminal device. At the second moment, a fifth signaling message is sent to the third terminal device, the fifth signaling message being used to instruct the third terminal device to perform the first sensing task, the second moment being the first moment being spaced out by the first duration; Receive execution result information from the third terminal device after it has completed the first sensing task.

2. The collaborative sensing method according to claim 1, characterized in that, The M candidate cooperative sensing terminals are determined from the K terminal devices based on the device information reported by the K terminal devices. The device information is reported by the K terminal devices after receiving the second signaling from the network device, where K is a positive integer and K is greater than or equal to M.

3. The collaborative sensing method according to claim 2, characterized in that, The second signaling includes: The first field is used to indicate the first cooperative awareness condition required by the network device.

4. The collaborative sensing method according to claim 3, characterized in that, The second signaling also includes a second field, a third field, and / or a fourth field, wherein, The second field is used to indicate whether the device information is reported at the moment the second signaling is received, or whether the device information is reported according to the first cycle, or whether the device information is reported in response to a triggering event; The third field is used to indicate the event type of the triggering event, which is a mobility status change event, a battery level change event, or a signal strength change event. The fourth field is used to indicate the effective duration of the reported device information.

5. The collaborative sensing method according to claim 4, characterized in that, The device information is reported via a third signaling message, wherein the third signaling message includes: The fifth field is used to indicate whether the first cooperative awareness condition required by the network device is met.

6. The collaborative sensing method according to claim 5, characterized in that, The third signaling also includes a sixth field, a seventh field, an eighth field, a ninth field, a tenth field, and / or an eleventh field, wherein, The sixth field indicates the time interval within which the perception task can be performed; The seventh field is used to indicate the movement status; The eighth field indicates the direction of movement; The ninth field indicates the movement speed; The tenth field indicates the amount of free resources; The eleventh field indicates whether it is configured to allow the execution of perception tasks.

7. The collaborative sensing method according to claim 5, characterized in that, The M candidate cooperative sensing terminals meet the first cooperative sensing condition required by the network device.

8. The collaborative sensing method according to any one of claims 3 to 7, characterized in that, The first collaborative sensing conditions include: The perception accuracy meets the perception accuracy condition; and / or, The sensing range is greater than or equal to the sensing range threshold; and / or, The perception delay is less than or equal to the perception delay threshold.

9. The collaborative sensing method according to any one of claims 1 to 7, characterized in that, The N cooperative sensing terminals satisfy the second cooperative sensing condition, which includes: The amount of idle resources is greater than or equal to the amount of resources required by the first sensing task, and is configured to allow the execution of the sensing task.

10. The collaborative sensing method according to any one of claims 1 to 7, characterized in that, The first signaling includes: The twelfth field is used to indicate the task type of the first perception task.

11. The collaborative sensing method according to claim 10, characterized in that, The first signaling also includes a thirteenth field, a fourteenth field, a fifteenth field, a sixteenth field, and / or a seventeenth field, wherein, The thirteenth field is used to indicate the first identifier of the first perception task; The fourteenth field is used to indicate the effective duration of the first sensing task; The fifteenth field is used to indicate the termination condition of the first sensing task; The sixteenth field is used to indicate the execution time window of the first sensing task; The seventeenth field is used to indicate the device type, location, and / or orientation of the second terminal device relative to the network device.

12. The collaborative sensing method according to claim 10, characterized in that, The task types include location sensing tasks, movement trajectory sensing tasks, distance sensing tasks, movement direction sensing tasks, movement speed sensing tasks, or acceleration sensing tasks.

13. The collaborative sensing method according to claim 11, characterized in that, The termination conditions include the perception accuracy not meeting the perception accuracy condition and / or the completion of the first perception task.

14. The collaborative sensing method according to claim 8, characterized in that, The sensing accuracy conditions include: The distance perception error is less than the distance perception error threshold; and / or, The speed perception error is less than the speed perception error threshold; and / or, The azimuth sensing error is less than the azimuth sensing error threshold; and / or, Pitch angle sensing error is less than the pitch angle sensing error threshold; and / or, The acceleration sensing error is less than the acceleration sensing error threshold; and / or, The motion direction perception deviation angle is less than the motion direction perception deviation angle threshold.

15. The collaborative sensing method according to any one of claims 1 to 7, characterized in that, The fourth signaling is also used to instruct the third terminal device to maintain low power consumption.

16. The collaborative sensing method according to claim 15, characterized in that, The first region is determined based on the predicted movement trajectory of the second terminal device and / or the execution result information of the first sensing task, wherein the execution result information includes the movement speed, movement direction, acceleration and position of the second terminal device.

17. The collaborative sensing method according to claim 16, characterized in that, The predicted movement trajectory is determined based on the historical movement trajectory of the second terminal device, which is determined based on historical movement trajectory information from the second terminal device.

18. The collaborative sensing method according to claim 15, characterized in that, The fourth signaling includes: The eighteenth field is used to indicate entering a low-power state.

19. The collaborative sensing method according to claim 18, characterized in that, The fourth signaling also includes the nineteenth field, the twentieth field, the twenty-first field, and / or the twenty-second field, wherein, The nineteenth field is used to indicate that the fifth signaling is being monitored; The twentieth field is used to indicate the monitoring intensity and monitoring period; The 21st field is used to indicate the task configuration information of the first sensing task; The twentieth field is used to indicate the second identifier of the fourth signaling.

20. The collaborative sensing method according to claim 15, characterized in that, The fifth signaling includes: The 23rd field is used to indicate the execution of the first perception task.

21. The collaborative sensing method according to claim 20, characterized in that, The fifth signaling also includes a twenty-fourth field and / or a twenty-fifth field, wherein, The 24th field is used to indicate the second identifier of the fourth signaling; The 25th field is used to indicate the execution time window of the first sensing task.

22. The collaborative sensing method according to claim 1, characterized in that, The first sensing result includes the location, movement trajectory, distance, movement direction, movement speed and / or acceleration of the second terminal device.

23. An electronic device, characterized in that, include: Memory, used to store instructions; A processor, when executing instructions in the memory, causes the electronic device to perform the cooperative sensing method according to any one of claims 1 to 22.

24. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores instructions that, when executed on a computer, cause the computer to perform the cooperative sensing method according to any one of claims 1 to 22.

25. A computer program product, characterized in that, It includes computer program code that, when run on a computer, causes the computer to perform the collaborative sensing method according to any one of claims 1 to 22.

Images