Apparatus, method for sensing and identifying an object

Abstract

An apparatus (110) for sensing and identifying an object, method, and computer program are disclosed. The apparatus (110) is configured to: obtain positioning information (310) and identification information (320) related to a user equipment, UE (130), the identification information (320) comprises a UE identity (325); obtain sensing information (510) related to the object (140); determine based on the positioning information (310) and the sensing information (510) whether the UE (130) is associated with the object (140); determine, if the UE (130) is determined to be associated with the object (140), a joint view (700) based on the position information (310), the identification information (320), and sensing information (510); and assign in the joint view (700) an object identity (710) to the object (140), wherein the object identity (710) is based on the UE identity (325).

Description

[0001] APPARATUS, METHOD FOR SENSING AND IDENTIFYING AN OBJECT

[0002] TECHNICAL FIELD

[0003] The invention relates to an apparatus for sensing and identifying an object, corresponding method, correspond computer program, and a corresponding computer readable storage medium.

[0004] BACKGROUND

[0005] Third Generation Partnership Project (3GPP) New Radio (NR) provides positioning aimed at indoor and outdoor use cases, exploiting fifth generation (5G) features such as high bandwidth, massive antenna systems, evolved network architecture which are all helping to facilitate the arrival of massive numbers of Internet-of-Things device types on the scene.

[0006] One use case for NR positioning is Emergency call. In 3GPP Release 16 a study was conducted to evaluate E911 requirements for positioning accuracy (latitude, longitude, and altitude), network availability, reliability and latency. It also looked at synchronization requirements and the level of complexity experienced in meeting the needs of emergency call related to positioning. Specifications followed for a variety of positioning techniques that support regulatory as well as commercial needs.

[0007] The Release 17 specification, 3GPP Technical Specification (TS) 22.261 version (V) 17.12.0 - Service requirements for the 5G system - looked further at the evolving needs of the ‘verticals’ for high accuracy (horizontal and vertical), low latency, network efficiency and device efficiency for commercial use cases and for Industrial loT.

[0008] SUMMARY

[0009] Prior art enables to identify a User Equipment (UE), such as a smartphone or laptop. It can be assumed that the object (e.g. person) carrying the UE is associated with the UE, e.g., being the owner or sole user of the UE. Furthermore, it is possible to sense an object using sensing technology. However, it is not possible to identify a sensed object with motion sensors, radar technology. In particular, it is not possible to identify the object with the sensing technology in the event that the object and the UE are not sharing the same position anymore.

[0010] An object of the invention is to improve tracking of an unidentified object.

[0011] According to a first aspect of the invention, an apparatus for sensing and identifying an object is provided. The apparatus is configured to obtain positioning information and identification information related to a user equipment (UE). The identification information comprises a UE identity. The apparatus is configured to obtain sensing information related to the object. The apparatus is configured to determine based on the positioning information and the sensing information whether the UE is associated with the object. The apparatus is configured to determine, if the UE is determined to be associated with the object, a joint view based on the position information, the identification information, and sensing information. The apparatus is configured to assign in the joint view an object identity to the object. The object identity is based on the UE identity. Hereby is achieved that the sensed object is assigned an object identity corresponding to the UE it is associated with. Thus, the joint view enables to provide sensing and identification of the object associated with the UE.

[0012] According to an embodiment of the first aspect, the apparatus is configured to obtain further sensing information and / or further positioning information. The apparatus is configured to determine an updated joint view based on the obtained further sensing information and / or the obtained further positioning information.

[0013] According to an embodiment of the first aspect, the apparatus is configured to determine a UE motion pattern based on the positioning information.

[0014] According to an embodiment of the first aspect, the apparatus is configured to determine object motion pattern based on the sensing information.

[0015] According to an embodiment of the first aspect, determining whether the UE is associated with the object is based on the UE motion pattern, and / or the object motion pattern. According to an embodiment of the first aspect, determining whether the UE is associated with the object comprises determining whether the positioning information overlaps with the sensing information.

[0016] According to a second aspect of the invention, a method is provided. The method is performed by an apparatus. The method is for sensing and identifying an object. The method comprises obtaining positioning information and identification information related to a user equipment, UE. The identification information comprises a UE identity. The method comprises obtaining sensing information related to the object. The method comprises determining based on the positioning information and the sensing information whether the UE is associated with the object. The method comprises determining, if the UE is determined to be associated with the object, a joint view based on the position information, the identification information, and sensing information. The method comprises assigning in the joint view an object identity to the object, wherein the object identity is based on the UE identity.

[0017] According to an embodiment of the second aspect, the method comprises obtaining further sensing information and / or further positioning information. The method comprises determining an updated joint view based on the obtained further sensing information and / or the obtained further positioning information.

[0018] According to an embodiment of the second aspect, the method comprises determining a UE motion pattern based on the positioning information.

[0019] According to an embodiment of the second aspect, the method comprises determining object motion pattern based on the sensing information.

[0020] According to an embodiment of the second aspect, determining whether the UE is associated with the object is based on the UE motion pattern, and / or the object motion pattern. According to an embodiment of the second aspect, determining whether the UE is associated with the object comprises determining whether the positioning information overlaps with the sensing information.

[0021] According to a third aspect of the invention, a computer program is provided. The computer program comprises instructions, which when executed on an apparatus, causes the apparatus to perform the method according to one or more embodiments of the second embodiment.

[0022] According to a fourth aspect of the invention, a computer readable storage medium is provided. The computer readable storage medium comprises a computer program according to the third aspect of the invention.

[0023] At least one or more embodiments advantageously enable sensing / positioning an object using sensing technologies.

[0024] At least one or more embodiments advantageously enable identifying an object when identifying method is not available.

[0025] At least one or more embodiments advantageously enable to sense through sensing technology an object.

[0026] At least one or more embodiments advantageously enable increased accuracy of the identification of the object, as the identification is based on 3GPP based positioning. Identification of the object is based on a communication identifier communicated between the UE and a network node within the communication network.

[0027] Further objectives of, features of, and advantages with, the invention will become apparent when studying the following detailed disclosure, the drawings, and the appended claims. Those skilled in the art realize that different features of the invention can be combined to create embodiments other than those described in the following.

[0028] BRIEF DESCRIPTION OF THE DRAWINGS The above, as well as additional object, features and advantages of the invention will be better understood through the following and non-limiting detailed description of embodiments of the invention, with reference to the appended drawings, in which:

[0029] Figure 1 shows a communication network.

[0030] Figure 2 shows a method for sensing and identifying an object.

[0031] Figure 3 shows an embodiment of a step of the method.

[0032] Figure 4 shows an embodiment of a positioning and identification view.

[0033] Figure 5 shows an embodiment of a step of the method.

[0034] Figure 6 shows an embodiment of a sensing view.

[0035] Figure 7 shows an embodiment of a joint view.

[0036] Figure 8 shows an embodiment of a step of the method.

[0037] Figure 9 shows an embodiment of an updated view.

[0038] Figure 10 shows a block diagram of the apparatus.

[0039] Figure 11 shows a block diagram of the apparatus.

[0040] Figure 12 shows a block diagram illustrating a virtualization environment.

[0041] All figures are schematic, and generally show parts which are necessary in order to elucidate the invention, wherein other parts may be omitted or merely suggested.

[0042] DETAILED DESCRIPTION The invention will now be described more fully herein with reference to the accompanying drawings, in which certain embodiments are shown. This invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided by way of example so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art.

[0043] In Figure 1 , a communication network 100 is provided. The communication network 100 may be a third generation partnership project (3GPP) cellular network, such as a third generation (3G) cellular network, a fourth generation (4G) cellular network, a fifth generation (5G) cellular network, or any future generation cellular network, such as a sixth generation (6G) cellular network. The communication network 100 may be an Institute of Electronical and Electronics Engineers (IEEE) communication network.

[0044] The communication network 100 comprises an apparatus 110. The apparatus 110 may be a base station, such as a radio base station, a NodeB, an evolved NB, or an NR NodeB- base station. In an embodiment, the apparatus 110 implements Joint Communication and Sensing (JCAS).

[0045] In an embodiment, the communication network 100 comprises a second apparatus 120. The second apparatus 120 may be an apparatus implementing JCAS. Alternatively, or additionally, the second apparatus 120 may be a motion sensor.

[0046] The apparatus 110 and the second apparatus 120 communication through 3GPP connections, wireless fidelity (Wi-Fi) connection, fibre connection, and / or ethernet connection.

[0047] The communication network 100 provides communication services to user equipment, one of which is shown as user equipment (UE) 130.

[0048] The UE 130 may be a communication device used directly by an end-user (e.g., a person). Such communication device may be a hand-held telephone, a tablet, or a laptop computer.

[0049] Alternatively, the UE 130 may be a communication device that is equipped or is carrying a device used directly by the end-user. Such a communication device may be a robot equipped with a device used for communication, or a vehicle equipped with a device used for communication.

[0050] Further, the UE 130 may be associated to an object 140. The object 140 may be an item that is tangible. The object 140 may be, but not limited to, a robot, a person, or a vehicle.

[0051] In Figure 2, a flowchart depicting embodiment of a method 200 is provided. The method 200 is performed by the apparatus 110. The method 200 is for sensing and identifying the object 140.

[0052] The method 200 comprises obtaining 210 positioning information 310 and identification information 320 related to the UE 130. The identification information 320 comprises a UE identity 325. In Figure 3, an embodiment of the step 210 of the method 200 is provided.

[0053] Obtaining 210 the positioning information 310 may be based on known 3GPP positioning methods. For example, the 3GPP positioning methods may be 5G System Location Services (LCS), such as defined in TS 23.273 V17.8.0, positioning, as defined, for example, in 3GPP TS 37.355 V17.7.0, and sidelink as defined, for example in 3GPP TS 38.355 V18.0.0.

[0054] Obtaining 210 the positioning information 310 may comprise receiving, from a set of network nodes in the communication network 100, the positioning information 310. The set of network nodes may be base stations. The apparatus 110 may be part of the set of network nodes. In this embodiment, the set of network nodes calculate the positioning information based on signal transmitted by the UE 130. For example, the set of network nodes may perform triangulation of uplink communication sent by the UE 130 to each of the set of network nodes. For example, the set of network nodes may perform triangulation as defined, for example, in location services in 3GPP Release 99 Features.

[0055] Alternatively, or additionally, obtaining 210 the positioning information 310 may comprise receiving positioning information 310 from the UE 130. In this embodiment, the UE 130 calculates the positioning information 310, such as in location services in 3GPP Release 99 Features. In particular, the UE 130 may be sending uplink communication to the apparatus 110. The uplink communication may be comprising the positioning information 310.

[0056] Alternatively, or additionally, the positioning information 310 may be based on GPS, map information, inertial navigations, and / or fingerprinting.

[0057] The positioning information 310 may comprise a UE location 315 related to the UE 130. In particular, the UE location 315 may correspond to the location of the UE 130 at a certain point in time.

[0058] The UE location 315 may correspond to a first geographical point defined by a latitude and a longitude.

[0059] Alternatively, the UE location 315 corresponds to a first geographical area. The first geographical area may be defined by coordinates (e.g., x coordinates, y coordinates, z coordinates). The first geographical area may be, but not limited to, a room, a building, a floor in the building.

[0060] The positioning information 310 may comprise speed information related to the UE 130. For example, the speed information may be an average speed at which the UE 130 is moving at, or the current speed of the UE 130. Alternatively, or additionally, the positioning information 310 comprises direction information related to the UE 130. For example, the direction information may be the direction within which the UE 130 is moving towards.

[0061] The speed information and / or the direction information may be obtained by performing a doppler analysis of communication signals transmitted by the UE 130. Alternatively, or additionally, the speed information and / or the direction information may be obtained by estimating the travelling speed of the UE 130, as specified in W02024 / 005682.

[0062] In an embodiment, the method 200 comprises determining 215 a UE motion pattern based on the obtained positioning information 310. For example, the UE motion pattern may be determined based on the speed information related to the UE 130 and / or direction information related to the UE 130.

[0063] Obtaining 210 the identification information 320 may comprise obtaining the identification information 320 through communication between the apparatus 110 and the UE 130. Alternatively, or additionally, obtaining 210 comprises receiving identification information 320 from the UE 130. In this embodiment, the UE 130 sends the identification information 320 to the apparatus 110. In particular, the UE 130 sends uplink communication to the apparatus 110. The uplink communication is comprising the identification information 320. For example, the identification information 320 may be comprised in a RRC Connection Request.

[0064] The UE identity 325 may be an identification tag or an identification number. Alternatively, the UE identity 325 may be 3GPP identifier, such as Identifiers as defined, for example, in 3GPP TS 23 501 V18.4.0. For example, the 3GPP identifier may be an International Mobile Subscriber identity (IMSI), a Temporary Mobile subscriber Identity (TMSI), a lobal Unique Temporary Identity (GUTI), an International Mobile Equipment Identity (IMEI), a Subscription Permanent Identifier (SUPI), or a Subscription Concealed Identifier (SUCI). The UE identifier 325 may be an IEEE 802 MAC address.

[0065] Alternatively, or additionally, the UE identity 325 may be a phone number or a name of a person owning the UE 130.

[0066] Thus, the step 210 of the method 200 allows the apparatus 110 to link the identified UE 130 with a position of the UE 130 based on the obtained positioning information 310 and identification information 320.

[0067] The method 200 may comprise determining a positioning and identification view 400. The position and identification view 400 is based on the positioning information 310 obtained in the step 210 of the method 200, as described herein, and the identification information 320 obtained in the step 210 of the method 200, as described herein. In Figure 4, an embodiment of the positioning and identification view 400 is provided. The first geographical area is illustrated by a cross “X” in the positioning and identification view 400.

[0068] The method 200 comprises obtaining 220 sensing information 510 related to the object 140. In Figure 5, an embodiment of the step 220 of the method 200 is provided.

[0069] Obtaining 220 the sensing information 510 may comprise receiving the sensing information 510 from a Joint Communication and Sensing (JCAS) unit in a network node. For example, the network node may be the apparatus 110. For example, JCAS corresponds to spatial sensing of the object 140 within proximity of the network node. Alternatively, the network node is a network node other than the apparatus 110 performing JCAS of the object 140 and sending the sensing information 510 to the apparatus 110.

[0070] Alternatively, or additionally, obtaining 220 the sensing information 510 comprises receiving the sensing information 510 from the second apparatus 120. The second apparatus 120 may be configured to perform function of a radar.

[0071] Alternatively, or additionally, obtaining 220 the sensing information 510 comprises receiving the sensing information 510 from the second apparatus 120. The second apparatus 120 may be configured to perform function of a motion sensor.

[0072] Alternatively, or additionally, obtaining 220 the sensing information 510 comprises receiving the sensing information 510 from the second apparatus 120. The second apparatus 120 may be configured to perform function of a satellite.

[0073] Thus, the sensing information 510 may be based on JCAS, on radar, on motion sensors, and / or on satellite. In particular, no communication between the object 140 and the communication network 100 is required for the object 140 to be sensed.

[0074] The sensing information 510 may comprise an object location 515 related to the object 140. In particular, the object location 515 may correspond to the location of the object 140 at a certain point in time.

[0075] The object location 515 may correspond to a second geographical point defined by a latitude and a longitude.

[0076] Alternatively, the object location 515 corresponds to a second geographical area. The second geographical area may be defined by coordinates (e.g., x coordinates, y coordinates, z coordinates). The second geographical area may be, but not limited to, a room, a building, a floor in the building.

[0077] The sensing information 510 may comprise speed information related to the object 140. For example, the speed information may be an average speed at which the object 140 is moving at, or the current speed of the object 140. Alternatively, or additionally, the sensing information 510 comprises direction information related to the object 140. For example, the direction information may be the direction within which the object 140 is moving towards. The speed information and / or the direction information related to the object 140 may be obtained by estimating travelling speed of the object 140, as specified in W02024 / 005683.

[0078] In an embodiment, the method 200 comprises determining 225 an object motion pattern based on the sensing information 510. For example, the object motion pattern may be determined based on the speed information related to the object 140 and / or direction information related to the object 140.

[0079] The sensing information 510 does not require to comprise an identification of the object 140.

[0080] Thus, the step 220 of the method 200 allows the apparatus 110 to obtain knowledge of the object 140 with a position of the object 140 based on the obtained sensing information 510.

[0081] The method 200 may comprise determining a sensing view 600. The sensing view 600 is based on the sensing information 510 obtained in the step 220 of the method 200, as described herein. In Figure 6, an embodiment of the sensing view 600 is provided. The second geographical area is illustrated by a circle “O” in the sensing view 600.

[0082] The method 200 comprises determining 230 based on the obtained positioning information 310 and the obtained sensing information 510 whether the UE 130 is associated with the object 140. The association of the UE 130 with the object 140 may correspond to a relationship of ownership. For example, in the event the UE 130 is a mobile phone and the object 140 is a person, the association of the UE 130 with the object 140 corresponds to the UE 130 being owned by the object 140. Alternatively, in the same example, the association of the UE 130 with the object 140 may correspond to the UE 130 being carried by the object 140.

[0083] The step of determining 230 whether the UE is associated with the object 140 may comprise determining whether the positioning information 310 overlaps with the sensing information 510. In an embodiment, determining whether the positioning information 310 overlaps with the sensing information 510 comprises determining whether a distance between the UE location and the object location 515 is below or equal to a threshold. The distance between the UE location 315 and the object location 515 may be a geographical distance. The threshold may be expressed in a distance measurement value, for example but not limited to centimetres, decimetres, metres. Alternatively, or additionally, determining whether the positioning information 310 overlaps with the sensing information 510 comprises determining whether the distance between the UE location 315 and the object location 515 is below or equal to the threshold during a time period. Alternatively, or additionally, determining whether the positioning information 310 overlaps with the sensing information 510 comprises determining whether a part of the first geographical area overlaps with a part of the second geographical area. Alternatively, or additionally, determining whether the positioning information 310 overlaps with the sending information 510 comprises determining whether the UE position 315 and the object location 515 are in the same room or on the same floor.

[0084] Alternatively, or additionally, determining whether the UE 130 is associated with the object 140 is based on the UE motion pattern determined in the step 215 of the method 200 as described herein, and / or on the object motion pattern determined in the step 225 of the method 200 as described herein.

[0085] The method 200 comprises determining 240, if the UE 130 is determined to be associated with the object 140, a joint view 700 based on the positioning information 310, the identification information 320, and the sensing information 510. In Figure 7, an embodiment of the joint view 700 is provided. In the illustrated example, the cross “X” from the positioning and identification view 400 is present, as well as the circle “O” from the sensing view 600. In this illustrative example, there is an overlap of the UE position 315 with the object position 515.

[0086] The method 200 comprises assigning 250 in the joint view 700 an object identity 710 to the object 140. The object identity 710 is based on the UE identity 325. In Figure 7, an embodiment of the object identity 710 is provided. The object identity 710 may be the same as the UE identity 325. Thus, in this illustrative example, the joint view 700 enables to provide an identity of the object 140 sensed. In an embodiment, the method 200 comprises obtaining 260 further sensing information 810 and / or further positioning information 820. In Figure 8, an embodiment of the step 260 is provided.

[0087] Obtaining 260 the further sensing information 810 may comprise receiving the further sensing information 810 from a Joint Communication and Sensing (JCAS) unit in a network node. For example, the network node may be the apparatus 110. For example, JCAS corresponds to spatial sensing of the object 140 within proximity of the network node. Alternatively, the network node is a network node other than the apparatus 110 performing JCAS of the object 140 and sending the further sensing information 810 to the apparatus 110.

[0088] Alternatively, or additionally, obtaining 260 the further sending information 810 comprises receiving the further sensing information 810 from the second apparatus 120. The second apparatus 120 may be configured to perform function of a radar.

[0089] Alternatively, or additionally, obtaining 260 the further sensing information 810 comprises receiving the further sensing information 810 from the second apparatus 120. The second apparatus 120 may be configured to perform function of a motion sensor.

[0090] Alternatively, or additionally, obtaining 260 the further sensing information 810 comprises receiving the further sensing information 810 from the second apparatus 120. The second apparatus 120 may be configured to perform function of a satellite. Thus, the further sensing information 810 may be based on JCAS, on radar, on motion sensors, and / or on satellite. In particular, no communication between the object 140 and the communication network 100 is required for the object 140 to be sensed.

[0091] The further sensing information 810 may comprise an updated object location 815 related to the object 140. In particular, the updated object location 815 may correspond to the updated location of the object 140 at a later point in time compared to the location of the object 140 as described in step 220 of the method 200.

[0092] The updated object location 815 may correspond to an updated second geographical point defined by a latitude and a longitude.

[0093] Alternatively, the updated object location 815 corresponds to an updated second geographical area. The updated second geographical area may be defined by coordinates (e.g., x coordinates, y coordinates, z coordinates). The updated second geographical area may be, but not limited to, a room, a building, a floor in the building.

[0094] The further sensing information 810 may comprise updated speed information related to the object 140. For example, the updated speed information may be an updated average speed at which the object 140 is moving at, or the updated current speed of the object 140. Alternatively, or additionally, the further sensing information 810 comprises updated direction information related to the object 140. For example, the updated direction information may be the updated direction within which the object 140 is moving towards.

[0095] The updated speed information and / or the updated direction information related to the object 140 may be obtained by estimating travelling updated speed of the object 140, as specified in W02024 / 005683.

[0096] In an embodiment, the method 200 comprises determining an updated object motion pattern based on the further sensing information 810. For example, the updated object motion patter may be determined based on the updated speed information related to the object 140 and / or the updated direction information related to the object 140.

[0097] The further sensing information 810 does not require to comprise an identification of the object 140.

[0098] Obtaining 260 the further positioning information 820 may be based on known 3GPP positioning methods. For example, the 3GPP positioning methods may be 5G System Location Services (LCS), such as defined in TS 23.273 V17.8.0, positioning, as defined, for example, in 3GPP TS 37.355 V17.7.0, and sidelink as defined, for example in 3GPP TS 38.355 V18.0.0.

[0099] Obtaining 260 the further positioning information 820 may comprise receiving, from the set of network nodes in the communication network 100, the further positioning information 820. The set of network nodes may be base stations. The apparatus 110 may be part of the set of network nodes. In this embodiment, the set of network nodes calculate the further positioning information 820 based on signal transmitted by the UE 130. For example, the set of network nodes may perform triangulation of uplink communication sent by the UE 130 to each of the set of network nodes. For example, the set of network nodes may perform triangulation as defined, for example, in location services in 3GPP Release 99 Features.

[0100] Alternatively, or additionally, obtaining 260 the further positioning information 820 may comprise receiving the further positioning information 820 from the UE 130. In this embodiment, the UE 130 calculates the further positioning information 820, such as in location services in 3GPP Release 99 Features. In particular, the UE 130 sends uplink communication to the apparatus 110. The uplink communication is comprising the positioning information 310.

[0101] Alternatively, or additionally, the further positioning information 820 may be based on GPS, map information, inertial navigations, and / or fingerprinting.

[0102] The further positioning information 820 may comprise an updated UE location 825 related to the UE 130. In particular, the updated UE location 825 may correspond to the updated location of the UE 130 at a later point in time compared to the UE location of the UE as described in step 210 of the method 100.

[0103] The updated UE location 825 may correspond to an updated first geographical point defined by a latitude and a longitude.

[0104] Alternatively, the updated UE location 825 corresponds to an updated first geographical area. The updated first geographical area may be defined by coordinates (e.g., x coordinates, y coordinates, z coordinates). The updated first geographical area may be, but not limited to, a room, a building, a floor in the building.

[0105] The further positioning information 820 may comprise updated speed information related to the UE 130. For example, the updated speed information may be an updated average speed at which the UE 130 is moving at, or the updated current speed of the UE 130. Alternatively, or additionally, the further positioning information 820 comprises updated direction information related to the UE 130. For example, the updated direction information may be the direction within which the UE 130 is moving towards. The updated speed information and / or the updated direction information may be obtained by performing a doppler analysis of communication signals transmitted by the UE 130. Alternatively, or additionally, the updated speed information and / or the updated direction information may be obtained by estimating the travelling speed of the UE 130, as specified in W02024 / 005682. In an embodiment, the method 200 comprises determining an updated UE motion pattern based on the obtained further positioning information 820. For example, the updated UE motion pattern may be determined based on the updated speed information related to the UE 130 and / or the updated direction information related to the UE 130.

[0106] In an embodiment, the method 200 comprises determining 270 an updated joint view 900 based on the obtained further sensing information 810 and / or the obtained further positioning information 820. In particular, the object identity 710 does not change, only the sensing and positioning information are updated over time. In Figure 9, an embodiment of the updated joint view 900 is provided. In this illustrative example, the sensing view 600 and the positioning and identification view 400 are not overlapping anymore. It can be determined that the sensed object 140 has parted ways or left the UE 130. However, since the sensed object 140 has been assigned the object identity 710 in the step 250 of the method 200, the further sensing information 810 enables to establish the identity of the sensed object 140. In the illustrated example of the updated joint view 900, the object 140 has been sensed at the updated object location 815, and the UE 130 is positioned at the updated location 825. The object identity 710 is kept. And thus, it is known that the object 140 is associated with the UE 130.

[0107] Alternatively, or additionally, the determination in step 270 of the updated joint view 900 is based on one or more of: the updated speed information related to the UE 130, the updated direction information related to the UE 130, the updated speed information related to the object 140, or the updated direction information related to the object 140.

[0108] Thus, the object 140 now identified is further sensed while maintaining the object identity. The further sensing of the object 140 may be performed in parallel to the further positioning of the UE 130.

[0109] In an embodiment, the object 140 is sensed as a unique object. Alternatively, or additionally, the object 140 may be first sensed as a first object and then split into a plurality of objects. For example, in the event, the object 140 sensed is a person carrying a smartphone (e.g., UE 130) within a car.

[0110] In the same example, at different time point: - the person is within the car carrying the smartphone, at time t1 ;

[0111] - the person leaves the car carrying the smartphone within himself, at time t2.

[0112] The person and the car are sensed as the same object 140 at time t1 . However, when the person leaves the car, the person and the car are sensed as two objects.

[0113] It is possible that the plurality of objects is associated to the UE 130. In particular, in the same example, the car and the person may share the same identifier (e.g. object identity 710) as there are both associated to the smartphone.

[0114] In an embodiment, the step 210, and / or the step 215 of the method 200 may be performed before, after or in parallel to the step the step 220, and / or the step 225 of the method 200.

[0115] In an embodiment, the step 230, the step 240 and / or the step 250 of the method 200 may be performed in parallel, simultaneously or after the steps 210, the step 215, the step 220, and / or the step 225 of the method 200.

[0116] In an embodiment, the step 260 of the method 200 may be performed before, or simultaneously to the step 270 of the method 200.

[0117] In Figure 10, a block diagram of the apparatus 110 is provided.

[0118] The apparatus 110 comprises a first obtaining unit 1010, a second obtaining unit 1020, a first determining unit 1030, a second determining unit 1040, an assigning unit 1050.

[0119] The first obtaining unit 1010 is configured to cause the apparatus 110 to perform the step 210 of the method 200, as described herein.

[0120] The second obtaining unit 1020 is configured to cause the apparatus 110 to perform the step 220 of the method 200, as described herein.

[0121] The first determining unit 1030 is configured to cause the apparatus 110 to perform the step 230 of the method 200, as described herein.

[0122] The second determining unit 1040 is configured to cause the apparatus 110 to perform the step 240 of the method 200, as described herein. The assigning unit 1050 is configured to cause the apparatus 110 to perform the step 250 of the method 200, as described herein.

[0123] In an embodiment, the apparatus 110 comprises a third determining unit 1015. The third determining unit 1015 is configured to cause the apparatus 110 to perform the step 215 of the method 200, as described herein.

[0124] In an embodiment, the apparatus 110 comprises a fourth determining unit 1025. The fourth determining unit 1025 is configured to cause the apparatus 110 to perform the step 225 of the method 200, as described herein.

[0125] In an embodiment, the apparatus 110 comprises a third obtaining unit 1060. The third obtaining unit 1060 is configured to cause the apparatus 110 to perform the step 260 of the method 200, as described herein.

[0126] In an embodiment, the apparatus 110 comprises a fifth determining unit 1070. The fifth obtaining unit 1070 is configured to cause the apparatus 110 to perform the step 270 of the method 200, as described herein.

[0127] In an embodiment, the first obtaining unit 1010, the second obtaining unit 1020, and the third obtaining unit 1060 are a same obtaining unit.

[0128] In an embodiment, the first determining unit 1030, the second determining unit 1040, the third determining unit 1015, the fourth determining unit 1025, and the fifth determining unit 1070 are a single determining unit.

[0129] The first obtaining unit 1010, the third determining unit 1015, the second obtaining unit 1020, the fourth determining unit 1025, the first determining unit 1030, the second determining unit 1040, the assigning unit 1050, the third obtaining unit 1060, and the fifth determining unit 1070, illustrated in Figure 10, may be implemented as a hardware solution or as a combination of software and hardware, e.g., by one or more of: a processor or a micro-processor and adequate software and memory for storing of the software, a Programmable Logic Device (PLD) or other electronic component(s) or processing circuitry configured to perform the actions described above with regards to the method 200.

[0130] In Figure 11 , an embodiment of the apparatus 110 is provided. The apparatus 110 comprises a processor 1110, and a computer readable storage medium 1120 in the form of a memory 1125. The memory 1125 contains a computer program 1130 comprising instructions executable by the processor 1110 whereby the apparatus 110 is operative to perform the steps of the method 200.

[0131] The (non-transitory) computer readable storage media mentioned above may be an Electrically Erasable Programmable Read-Only Memory (EEPROM), a flash memory, Field Programmable Gate Array, and a hard drive.

[0132] The processor 1110 of Figure 11 may be a single Central Processing Unit (CPU), but could also comprise two or more processing units. For example, the processor 1110 of Figure 11 may include general purpose microprocessors; instructions set processors and / or related chips sets and / or special purpose microprocessors such as Application Specific Circuits (ASICs). The processor 1110 of Figure 11 may also comprise board memory for caching purposes.

[0133] The computer program 1130 of Figure 11 may be carried by a computer program product connected to the processor 1110 of Figure 11. The computer program products may be or comprise a non-transitory computer readable storage medium on which computer program 1130 of Figure 11 is stored. For example, the computer program products may be a flash memory, a Random-Access memory (RAM), a Read- Only Memory (ROM), or an EEPROM, and the computer programs described above could in alternative embodiments be distributed on different computer program products in the form of memories.

[0134] In Figure 12, a block diagram illustrating a virtualization environment QQ500 in which method steps implemented by some embodiments may be virtualized. In the present context, virtualizing means creating virtual versions of apparatus 110 which may include virtualizing hardware platforms, storage devices and networking resources. As used herein, virtualization can be applied to apparatus 110 described herein, or components thereof, and relates to an implementation in which at least a portion of the functionality is implemented as one or more virtual components. Some or all of the method steps described herein may be implemented as virtual components executed by one or more virtual machines (VMs) implemented in one or more virtual environments QQ500 hosted by one or more of hardware nodes, such as a hardware computing device that operates as a network node, UE, core network node, or host. Further, in embodiments in which the virtual node does not require radio connectivity (e.g., a core network node or host), then the node may be entirely virtualized. In some embodiments, the virtualization environment QQ500 includes components defined by the O-RAN Alliance, such as an O-Cloud environment orchestrated by a Service Management and Orchestration Framework via an 0-2 interface.

[0135] Applications QQ502 (which may alternatively be called software instances, virtual appliances, network functions, virtual nodes, virtual network functions, etc.) are run in the virtualization environment QQ500 to implement some of the method steps, features, functions, and / or benefits of some of the embodiments disclosed herein.

[0136] Hardware QQ504 includes processing circuitry, memory that stores software and / or instructions executable by hardware processing circuitry, and / or other hardware devices as described herein, such as a network interface, input / output interface, and so forth. Software may be executed by the processing circuitry to instantiate one or more virtualization layers QQ506 (also referred to as hypervisors or virtual machine monitors (VMMs)), provide VMs QQ508a and QQ508b (one or more of which may be generally referred to as VMs QQ508), and / or perform any of the method steps, functions, features and / or benefits described in relation with some embodiments described herein. The virtualization layer QQ506 may present a virtual operating platform that appears like networking hardware to the VMs QQ508.

[0137] The VMs QQ508 comprise virtual processing, virtual memory, virtual networking or interface and virtual storage, and may be run by a corresponding virtualization layer QQ506. Different embodiments of the instance of a virtual appliance QQ502 may be implemented on one or more of VMs QQ508, and the implementations may be made in different ways. Virtualization of the hardware is in some contexts referred to as network function virtualization (NFV). NFV may be used to consolidate many network equipment types onto industry standard high volume server hardware, physical switches, and physical storage, which can be located in data centers, and customer premise equipment.

[0138] In the context of NFV, a VM QQ508 may be a software implementation of a physical machine that runs programs as if they were executing on a physical, non-virtualized machine. Each of the VMs QQ508, and that part of hardware QQ504 that executes that VM, be it hardware dedicated to that VM and / or hardware shared by that VM with others of the VMs, forms separate virtual network elements. Still in the context of NFV, a virtual network function is responsible for handling specific network functions that run in one or more VMs QQ508 on top of the hardware QQ504 and corresponds to the application QQ502.

[0139] Hardware QQ504 may be implemented in a standalone network node with generic or specific components. Hardware QQ504 may implement some functions via virtualization. Alternatively, hardware QQ504 may be part of a larger cluster of hardware (e.g. such as in a data center or CPE) where many hardware nodes work together and are managed via management and orchestration QQ510, which, among others, oversees lifecycle management of applications QQ502. In some embodiments, hardware QQ504 is coupled to one or more radio units that each include one or more transmitters and one or more receivers that may be coupled to one or more antennas. Radio units may communicate directly with other hardware nodes via one or more appropriate network interfaces and may be used in combination with the virtual components to provide a virtual node with radio capabilities, such as a radio access node or a base station. In some embodiments, some signaling can be provided with the use of a control system QQ512 which may alternatively be used for communication between hardware nodes and radio units.

[0140] As used herein, the term “and / or” includes any and all combinations of one or more of the associated listed terms. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limited of example embodiments. As used herein, the single forms “a”, “an”, and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises”, “comprising”, “has”, “having”, “includes”, and / or “including”, when used herein, specify the presence of stated features, elements, and / or components etc. but not preclude the presence or addition of one or more other features, elements, components, and / or combinations thereof. The disclosure has been described above in reference to embodiments thereof. It should be understood that various modifications, alternatives, and additions can be made by those skilled in the art without departing from the scope of the disclosure. Therefore, the scope of the disclosure is not limited to the above particular embodiments but only defined by the claims as attached.

Claims

CLAIMS1. An apparatus (110) for sensing and identifying an object (140), the apparatus (110) being configured to:- obtain positioning information (310) and identification information (320) related to a user equipment, UE (130), wherein the identification information (320) comprises a UE identity (325);- obtain sensing information (510) related to the object (140);- determine based on the positioning information (310) and the sensing information (510) whether the UE (130) is associated with the object (140);- determine, if the UE (130) is determined to be associated with the object (140), a joint view (700) based on the position information (310), the identification information (320), and sensing information (510); and- assign in the joint view (700) an object identity (710) to the object (140), wherein the object identity (710) is based on the UE identity (325).

2. The apparatus (110) according to claim 1 , is configured to:- obtain further sensing information (810) and / or further positioning information (820);- determ ine an updated joint view (900) based on the obtained further sensing information (810) and / or the obtained further positioning information (820).

3. The apparatus (110) according to any of claims 1 -2, is configured to:- determine a UE motion pattern based on the positioning information (310).

4. The apparatus (110) according to any of claims 1 -3, is configured to:- determine object motion pattern based on the sensing information (510).

5. The apparatus (110) according to any of claims 3-4, wherein determining whether the UE (130) is associated with the object (140) is based on the UE motion pattern, and / or the object motion pattern.

6. The apparatus (110) according to any of claims 1 -5, wherein determining whether the UE (130) is associated with the object (140) comprises determiningwhether the positioning information (310) overlaps with the sensing information (510).

7. A method (200), performed by an apparatus (110), for sensing and identifying an object (140), the method (200) comprising:- obtaining (210) positioning information (310) and identification information (320) related to a user equipment, UE (130), wherein the identification information (320) comprises a UE identity (325);- obtaining (220) sensing information (510) related to the object (140);- determining (230) based on the positioning information (310) and the sensing information (510) whether the UE (130) is associated with the object (140);- determining (240), if the UE (130) is determined to be associated with the object (140), a joint view (700) based on the position information (310), the identification information (320), and sensing information (510); and- assigning (250) in the joint view (700) an object identity (710) to the object (140), wherein the object identity (710) is based on the UE identity (325).

8. The method (200) according to claim 7, comprising:- obtaining (260) further sensing information (810) and / or further positioning information (820);- determining (270) an updated joint view (900) based on the obtained further sensing information (810) and / or the obtained further positioning information (820).

9. The method (200) according to any of claims 7-8, comprising:- determining (215) a UE motion pattern based on the positioning information (310).

10. The method (200) according to any of claims 7-9, comprising:- determining (225) object motion pattern based on the sensing information (510).

11. The method (200) according to any of claims 7-10, wherein determining (230) whether the UE (130) is associated with the object (140) is based on the UE motion pattern, and / or the object motion pattern.

12. The method (200) according to any of claims 7-11 , wherein determining (230) whether the UE (130) is associated with the object (140) comprises determining whether the positioning information (310) overlaps with the sensing information (510).

13. A computer program (1130) comprising instruction, which when executed on an apparatus (110), causes the apparatus (110) to perform the method (200) according to any of claims 7-12.

14. A computer readable storage medium (1120) comprising a computer program (1130) according to claim 13.

Images