Electronic device for confirming location of external electronic device and operating method thereof

Abstract

An electronic device is provided. The electronic device includes a display, a communication circuit, a sensor, and a processor, wherein the processor is configured to identify, through the communication circuit, data packet information associated with an external electronic device, identify a first external electronic device from the external electronic device based on the data packet information, obtain a predicted frame (P-frame) mode during a first time period and a P-frame or a received signal strength indication (RSSI) mode during a second time period based on information associated with a packet size of the first external electronic device in the data packet information, identify a motion vector during the second time period based on the sensor, and provide location information about the first external electronic device based on the P-frame or the RSSI mode during the second time period and the motion vector during the second time period.

Description

Technical Field

[0001] This disclosure relates to an electronic device for identifying the location of an external electronic device and a method of operating the same. Specifically, this disclosure relates to an electronic device and a method of operating the same capable of identifying the location and presence of a hidden camera capturing a user. Background Technology

[0002] Recently, devices capable of capturing images (e.g., cameras) have become miniaturized. Images captured by cameras can be leaked to the outside world in real time via wireless communication. The misuse of miniaturized and high-performance cameras as covert cameras has raised a social problem. However, miniaturized and high-performance covert cameras are difficult to detect.

[0003] Therefore, there is growing interest in devices and applications for detecting hidden cameras and their locations.

[0004] The above information is presented as background information only to aid in understanding this disclosure. No determination is made, and no assertion is made, regarding whether any of the foregoing can be applied to the prior art of this disclosure. Summary of the Invention

[0005] Users can use a hidden camera detector to find hidden cameras. However, users need to own and carry such a device to detect hidden cameras.

[0006] Hidden camera detectors using existing technologies that rely on radio signals suffer from high detection errors due to interference from radio signals from other devices and terrain conditions. When identifying the approximate location of a camera, alternative types of devices can be used that utilize light reflected from the camera lens or electromagnetic waves generated by the camera.

[0007] The aspects of this disclosure address at least the aforementioned problems and / or disadvantages, and provide at least the following advantages. Therefore, one aspect of this disclosure provides an electronic device and a method of operating thereof capable of identifying the location and presence of a hidden camera capturing a user.

[0008] Additional aspects will be set forth in part in the description which follows, and in part will be apparent from the description or may be learned by practicing the embodiments presented.

[0009] According to one aspect of this disclosure, an electronic device is provided. The electronic device includes a display, communication circuitry, at least one sensor, and at least one processor. The at least one processor can be configured to: identify data packet information associated with at least one external electronic device via the communication circuitry; identify a first external electronic device among the at least one external electronic device based on the data packet information; acquire a predicted frame (P-frame) pattern during a first time period based on information in the data packet information associated with the packet size of the first external electronic device, and acquire a P-frame or Received Signal Strength Indication (RSSI) pattern during a second time period; identify a motion vector during the second time period via the at least one sensor; and provide position information about the first external electronic device based on the P-frame or RSSI pattern during the second time period and the motion vector during the second time period.

[0010] According to another aspect of this disclosure, a method for operating an electronic device is provided. The method includes: identifying data packet information associated with at least one external electronic device; identifying a first external electronic device among the at least one external electronic device based on the data packet information; acquiring a P-frame pattern during a first time period based on information in the data packet information associated with the packet size of the first external electronic device, and acquiring a P-frame or RSSI pattern during a second time period; identifying motion vectors during the second time period; and providing position information about the first external electronic device based on the P-frame or RSSI pattern during the second time period and the motion vectors during the second time period.

[0011] Various embodiments of this disclosure can provide an electronic device and a method for operating thereof capable of identifying the location and presence of a hidden camera.

[0012] Other aspects, advantages, and potential features of this disclosure will become apparent to those skilled in the art from the following detailed description taken in conjunction with the accompanying drawings, which disclose various embodiments of this disclosure. Attached Figure Description

[0013] The above and other aspects, features, and advantages of some embodiments of the present disclosure will become apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0014] Figure 1 A system for identifying an external electronic device according to an embodiment of the present disclosure is shown;

[0015] Figure 2 This is a block diagram schematically illustrating an electronic device according to an embodiment of the present disclosure;

[0016] Figure 3A This is a view showing the size of the groups according to an embodiment of the present disclosure;

[0017] Figure 3B This is a view showing the size of the groups according to an embodiment of the present disclosure;

[0018] Figure 4 This is a view showing the change in the size of a P-frame due to user movement according to an embodiment of the present disclosure;

[0019] Figure 5 This is a view illustrating a method for indicating the location of an external electronic device according to an embodiment of the present disclosure;

[0020] Figure 6 This is a flowchart illustrating a method of an electronic device according to an embodiment of the present disclosure;

[0021] Figure 7 This is a view illustrating a method for identifying frames according to an embodiment of the present disclosure;

[0022] Figure 8A This is a view illustrating horizontal movement of a user according to an embodiment of the present disclosure;

[0023] Figure 8B This is a view showing the pattern of p-frames corresponding to user horizontal movement according to an embodiment of the present disclosure;

[0024] Figure 9A This is a view illustrating horizontal movement of a user according to an embodiment of the present disclosure;

[0025] Figure 9B This is a view showing the pattern of p-frames corresponding to user horizontal movement according to an embodiment of the present disclosure;

[0026] Figure 10A This is a view illustrating the vertical movement of a user according to an embodiment of the present disclosure;

[0027] Figure 10B This is a view showing a pattern of p-frames corresponding to the vertical movement of a user according to an embodiment of the present disclosure;

[0028] Figure 11A This is a view illustrating a method for setting a threshold according to an embodiment of the present disclosure;

[0029] Figure 11B The P-frame size and threshold are shown according to embodiments of the present disclosure;

[0030] Figure 11C This is a view illustrating a method for setting a threshold according to an embodiment of the present disclosure;

[0031] Figure 12A This is a view illustrating a method for recognizing user movement according to an embodiment of the present disclosure;

[0032] Figure 12B This is a view illustrating a method for recognizing user movement according to an embodiment of the present disclosure;

[0033] Figure 12C This is a view illustrating a method for recognizing user movement according to an embodiment of the present disclosure;

[0034] Figure 13 This is a view illustrating a method for using P-frame mode and motion vectors according to an embodiment of the present disclosure;

[0035] Figure 14A This is a view illustrating a method for using P-frame mode and motion vectors according to an embodiment of the present disclosure;

[0036] Figure 14B This is a view illustrating a method for indicating a movement path according to an embodiment of the present disclosure;

[0037] Figure 15A This is a view illustrating an operation method of an electronic device according to an embodiment of the present disclosure; and

[0038] Figure 15B This is a view illustrating an operation method of an electronic device according to an embodiment of the present disclosure.

[0039] It should be understood that similar reference numerals are used throughout the accompanying drawings to indicate the same or similar elements, features and structures. Detailed Implementation

[0040] The following description, provided with reference to the accompanying drawings, is intended to aid in a full understanding of the various embodiments of this disclosure as defined by the claims and their equivalents. It includes various specific details to aid understanding, but these will be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of this disclosure. Furthermore, for clarity and brevity, descriptions of well-known functions and structures may be omitted.

[0041] The terms and vocabulary used in the following description and claims are not limited to their literal meaning, but are merely those used by the inventors to enable a clear and concise understanding of this disclosure. Therefore, it will be apparent to those skilled in the art that the following description of various embodiments of this disclosure is provided for illustrative purposes only and is not intended to limit the disclosure, which is defined by the appended claims and their equivalents.

[0042] It should be understood that the forms “a,” “one,” and “the” include plural references unless the context explicitly indicates otherwise. Thus, for example, the reference to “a component surface” includes the reference to one or more such surfaces.

[0043] Figure 1 A system for identifying external electronic devices according to an embodiment of the present disclosure is shown.

[0044] Reference Figure 1 According to embodiments of this disclosure, the system 10 for identifying external electronic devices may include an electronic device 101, a wireless router 110, a first external electronic device 120, a second external electronic device 131, a third external electronic device 133, and a fourth external electronic device 135. The system 10 for identifying external electronic devices may also include multiple wireless routers. The wireless router 110 may be a Wi-Fi access point (AP) or a fifth-generation (5G) fixed wireless access (FWA). The first external electronic device 120, the second external electronic device 131, the third external electronic device 133, and the fourth external electronic device 135 are not limited, as long as they are electronic devices that communicate through the wireless router 110, and the number of external electronic devices is not limited.

[0045] According to embodiments of this disclosure, the first external electronic device 120 may be a capture device and is capable of real-time streaming using a wireless router 110. The first external electronic device 120 may process (e.g., encode) the captured images to transmit consecutive image frames. Image frames may be one of intra-frame (I-frame), predictive frame (P-frame), or bidirectional frame (B-frame). An I-frame is a frame stored as is and may have the largest capacity among I-frames, P-frames, and B-frames. For example, an I-frame may be divided into multiple packets and transmitted depending on its size. A P-frame is a forward-predictive frame and may be a frame that only predicts and stores data for portions that differ from the immediately preceding I-frame. When capturing static space, the portions that differ from the previous I-frame are small, so the P-frame size may be small. In cases where capturing space includes motion, the P-frame size is larger due to the presence of many portions that differ from the previous I-frame, and the larger the moving portion on the screen, the larger the P-frame size may be. A B-frame may be a bidirectional predictive frame that predicts and stores motion between I-frames and P-frames, and between I-frames and P-frames.

[0046] According to embodiments of this disclosure, a plurality of external electronic devices 120, 131, 133 and 135 may receive data packets from or send data packets to a wireless router.

[0047] According to embodiments of this disclosure, electronic device 101 can identify (or collect) data packets sent to / received from wireless router 110 by at least some external electronic devices 120, 131, 133, and 135. For example, electronic device 102 can capture data packets. The captured packets may include identification information about the device (source) sending the packets, identification information about the device (destination) receiving the packets, and information about the size (or length) of the packets.

[0048] Figure 2 This is a block diagram schematically illustrating an electronic device according to an embodiment of the present disclosure.

[0049] refer to Figure 2 According to embodiments of this disclosure, electronic device 200 (e.g., Figure 1 The electronic device 101 may include a processor 210, communication circuitry 220, a sensor 230, a display 240, and a memory 250. In some embodiments of this disclosure, certain components may be implemented as a single integrated circuit. For example, the sensor 230 (e.g., a fingerprint sensor, iris sensor, or illuminance sensor) may be implemented as embedded in the display 240. According to embodiments of this disclosure, Figure 2 At least some components can be implemented to exclude from electronic device 200.

[0050] According to embodiments of this disclosure, processor 210 can execute, for example, software (e.g., a program) to control at least one other component (e.g., a hardware or software component) of electronic device 101 coupled to processor 210, and can perform various data processing or calculations. According to one embodiment of this disclosure, as at least part of data processing or calculation, processor 210 can load commands or data obtained from another component (e.g., sensor 230) in memory 250, process commands or information stored in memory 250, and store resulting data in memory 250. According to embodiments of this disclosure, processor 210 may include a main processor (e.g., a central processing unit (CPU) or application processor (AP)) and an auxiliary processor (e.g., a graphics processing unit (GPU), image signal processor (ISP), sensor hub processor, or communication processor (CP)), which may operate independently of or in conjunction with the main processor. Additionally or optionally, the auxiliary processor may be adapted to consume less power than the main processor or be dedicated to a specific function. According to embodiments of this disclosure, the auxiliary processor may be implemented separately from or as part of the main processor. When the main processor is inactive (e.g., in sleep mode), the auxiliary processor may take over the control of at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display 240 or camera (not shown)), or control them together with the main processor when the main processor is active (e.g., executing an application). According to embodiments of this disclosure, the auxiliary processor (e.g., image signal processor) may be implemented as part of another component (e.g., camera (not shown)) functionally associated with it.

[0051] According to embodiments of this disclosure, the processor 210 can identify data packet information relating to at least one external electronic device via communication circuitry 220. For example, identifying data packet information may mean capturing packets sent / received between a wireless router and at least one electronic device. For example, a data packet may include a header and data. The header may be unencrypted. An unencrypted packet header may include identification information about the device (source) sending the packet, identification information about the device (destination) receiving the packet, and information about the packet size.

[0052] According to embodiments of this disclosure, processor 210 can identify a first external electronic device among at least one external electronic device based on data packet information. Processor 210 can identify identification information regarding the device sending the included packets and identification information regarding the destination of the received packets based on the data packet information. When the identification information regarding the device sending the packets is an external electronic device and / or the identification information regarding the device receiving the packets is identification information regarding a wireless router, this may indicate file uploading.

[0053] According to various embodiments of this disclosure, processor 210 can identify whether a first external device is sending an image to a wireless router based on data packet information. For example, when an image captured by a capture device is being streamed in real time, the uplink packet to downlink packet ratio may be high. Processor 210 can identify at least one external electronic device whose uplink packet to all packet ratio exceeds a certain value as the first external electronic device (i.e., the capture device). When the first external device sends an image directly to a receiver without going through a wireless router, the downlink packet to uplink packet ratio may be high, and processor 210 can identify at least one external electronic device whose downlink data packet to all packet ratio exceeds a certain value as the first external electronic device (i.e., the capture device).

[0054] As another embodiment of this disclosure, the processor 210 can identify whether a first external device (e.g., a capture device) is streaming a captured image in real time based on the periodicity of the transmitted data packet pattern. For example, based on the data packet information transmitted by the first external device, when it is identified that the first external electronic device is periodically and continuously transmitting packets of a preset number or more maximum transmission units, the processor 210 can identify that the image captured by the first external device is being streamed in real time. As another embodiment of this disclosure, the processor 210 can identify the type of the transmitted frame based on the data packet information transmitted by the first external device, and when it is identified that the transmission of I-frames with large data sizes is being periodically performed, it can identify that the first external device is streaming a captured image in real time. Referring below... Figure 3A and Figure 3B Describe in detail the operation of identifying the type of sent frame based on data packet information.

[0055] According to embodiments of this disclosure, processor 210 can identify frames and their corresponding sizes based on data packet information sent / received by a first external electronic device.

[0056] Figure 3A This is a view showing the size of the groups according to an embodiment of the present disclosure.

[0057] refer to Figure 3A Frames can be divided into multiple groups based on their size and transmitted. According to embodiments of this disclosure, when a first external electronic device transmits a captured image, it can successively transmit I-frames, P-frames, and B-frames. Figure 3AAs shown, P-frames and B-frames can be arranged between I-frames and one other I-frame. Depending on the size of each frame, I-frame 301 can be divided into five Maximum Transmission Unit (MTU) packets and packets smaller than one MTU packet and transmitted. P-frame 303 can be divided into three MTU packets and packets smaller than one MTU packet and transmitted. Here, an MTU packet can represent a packet with a transmission size of the Maximum Transmission Unit. As mentioned above, since the size of an I-frame may be larger than the size of other frames, the number of MTU packets corresponding to an I-frame may be greater than the number of MTU packets corresponding to other frames. Furthermore, the sizes of I-frames, P-frames, and B-frames can vary depending on the transmitted image.

[0058] Figure 3B This is a view showing the size of the groups according to an embodiment of the present disclosure.

[0059] refer to Figure 3B According to embodiments of this disclosure, it is shown that when Figure 3A When I-frames are transmitted consecutively after P-frames, the packet size is determined by the sequence number. For example, as... Figure 3B As shown, we can assume the maximum transmission unit (MTU) of a packet is 1.5 kbytes. For example, when an I-frame is 7.8 kbytes in size, it can be divided into five MTU packets and 300-byte packets (a total of six packets) and sent. Similarly, when a P-frame is 4.7 kbytes in size, it can be divided into three MTU packets and 200-byte packets (a total of four packets) and sent. However, when a P-frame is no larger than 1.5 kbytes, it can be sent as a single packet.

[0060] According to embodiments of this disclosure, when one or more MTU packets and packets smaller than the MTU size are consecutive, processor 210 can determine that the first MTU data packet among one or more MTU packets is the first packet of a frame, and the smaller packets are the last packets of that frame. For example, processor 210 can determine that consecutive MTU packets from the first packet to packets smaller than the MTU size correspond to a frame. For example, in Figure 3B In this context, when the packet from sequence number 2000 to sequence number 2004 is an MTU packet, and the size of the packet from sequence number 2005 is smaller than the MTU packet size, the processor 210 can recognize that the packet from sequence number 2000 to sequence number 2005 is a packet for sending one frame. For example, in Figure 3BIn this process, when packets from sequence number 2006 to sequence number 2008 are MTU packets, and the size of packet 2009 is smaller than the MTU packet size, processor 210 can identify that packets from sequence number 2006 to sequence number 2009 are transmitted within one frame. Through this process, processor 210 can identify the sizes of multiple frames. The transmission time difference between packets constituting one frame can be smaller than the transmission time difference between packets constituting another frame. Therefore, regardless of packet size, when the transmission time difference between packets is less than a specific value, processor 210 can determine that it is included in the frame packet set. For example, the frame packet set can represent the packets constituting one frame.

[0061] According to embodiments of this disclosure, processor 210 can detect P-frames in packets transmitted / received by a first external electronic device. For example, processor 210 can estimate whether a corresponding frame is a P-frame based on the size of the set of multiple packets corresponding to a frame. Processor 210 can determine whether a frame is an I-frame or a P-frame based on the frame size. For example, when the frame size exceeds 10 MTU, processor 210 can identify the frame as an I-frame. Processor 210 can remove frames identified as I-frames from multiple frames to detect P-frames. The 10 MTU threshold is exemplary and can be a specified value or a value identified based on the size of the received packets. Simultaneously, processor 210 can exclude frames whose size falls outside a specific range.

[0062] According to embodiments of this disclosure, processor 210 can acquire a P-frame pattern during a first time period. The P-frame pattern can represent the size of a P-frame over time. The first time period can be a period during which the user does not move. For example, processor 210 can provide the user with guidance on maintaining a static state for a set time period via display 240.

[0063] According to embodiments of this disclosure, processor 210 can acquire a first threshold using a P-frame pattern over a first time period. The first threshold may be a value used to determine whether an image captured by a first external electronic device includes motion. For example, processor 210 can calculate a standard normal distribution of P-frame sizes by normalizing the normal distribution of P-frame sizes during the first time period. Processor 210 can use the standard normal distribution to calculate a range that will include a specific ratio of P-frame sizes.

[0064] For example, processor 210 can calculate that 80% of all P-frame sizes are included between an upper limit (e.g., Z + 1.28σ) and a lower limit (e.g., Z - 1.28σ), and determine the upper limit as a first threshold. Specifically, when P-frame size is used as a variable, Z can be a value obtained by subtracting the average (or expected) value of P-frame sizes from the P-frame sizes and dividing by the standard deviation σ of the P-frame sizes.

[0065] According to embodiments of this disclosure, processor 210 can acquire P-frame mode or RSSI mode during a second time period. The second time period can be a time during which the user moves. For example, processor 210 can provide the user with guidance on maintaining movement for a set time period via display 240. For example, the guidance on maintaining movement could be a guide instructing the user to move within the space where the user is located.

[0066] According to embodiments of this disclosure, processor 210 can identify a first external electronic device as a capture device for capturing the space where electronic device 200 is located, based on P-frames or RSSI patterns during a second time period. Processor 210 can use P-frames or RSSI patterns during the second time period to obtain a second threshold. When using P-frame mode, processor 210 can identify P-frames during the second time period that exceed (or are not less than) a first threshold. For example, processor 210 can determine that 90% of the P-frame size exceeds the upper limit of the first threshold (e.g., ...). +1.65σ) is the second threshold. When determining the second threshold, since the variable is the size of the P-frames exceeding the first threshold, the determination of the second threshold... And σ can be used to calculate the first threshold. Unlike σ, when using RSSI mode, processor 210 can determine an upper limit including 90% of the RSSI size (e.g., +1.65σ) is the second threshold.

[0067] The processor 210 can determine that the time period during which the P-frame or RSSI exceeds (or is not less than) a second threshold is the time period during which motion is captured.

[0068] According to embodiments of this disclosure, processor 210 can identify a motion vector for a second time period via sensor 230. Processor 210 can acquire acceleration (including gravity) data about each of the x, y, and z axes from an accelerometer. Processor 210 can acquire rotational speed data about each of the x, y, and z axes from a gyroscope. Processor 210 can identify a motion vector indicating the distance and direction of the user's movement based on the acceleration data and the rotational speed data. Processor 210 can calculate the user's step count based on the acceleration data acquired via the accelerometer, or can receive step count data from an assistive computing device (e.g., a pedometer). Processor 210 can calculate the user's distance traveled proportionally to the number of steps taken.

[0069] According to embodiments of this disclosure, processor 210 can determine whether a first external electronic device has captured the space where a user is currently located based on the correspondence between P-frame or RSSI patterns during a second time period and motion vectors during the second time period. Processor 210 can provide location information about the first external electronic device based on the correspondence between the size variation patterns of P-frames or RSSI measured during the second time period and motion vectors during the second time period. Processor 210 can identify periods during the second time period where the size of P-frames or RSSI exceeds a second threshold. For example, a period exceeding the second threshold may indicate a period of motion capture. The time period of user movement can be identified based on the user's motion vector. If the period exceeding the second threshold coincides with the period of user movement, processor 210 can determine that the first external electronic device has captured the space where the user is located. For example, if there is no user movement during the period exceeding the second threshold, processor 210 can determine that the motion captured by the first external electronic device is not user movement.

[0070] Figure 4 This is a view illustrating the change in P-frame size according to user movement, based on an embodiment of this disclosure.

[0071] For example, when the first external electronic device captures a user, the user's movement away from or towards the first external electronic device can be referred to as vertical movement, and the user's movement to the left or right while maintaining a vertical distance from the first external electronic device can be referred to as horizontal movement.

[0072] refer to Figure 4 When camera 401 captures the right side, the movement of user 403 between ③ 409 and ④ 411 can be called vertical movement, and the movement between ① 405 and ② 407 can be called horizontal movement. In the case of horizontal movement, the length of the user displayed on the screen can be constant, while in the case of vertical movement, the length of the user can change.

[0073] For example, since a P-frame represents the difference between two or more image frames, it can be associated with the one-dimensional length of the user-corresponding object included in any of the two or more image frames. For example, the size of a P-frame can be proportional to the square of the length of the user-corresponding object included in the current image frame, the square of the length of the user-corresponding object included in a previous image frame, or the square of the change between the length of the user-corresponding object included in the current image frame and the length of the user-corresponding object included in a previous image frame. The change in the size of the user-corresponding object included in each image frame when the user moves vertically can be greater than the change in the size of the user-corresponding object included in each image frame when the user moves horizontally. Therefore, the change in the size of the P-frame when the user moves vertically can be greater than the change in the size of the P-frame when the user moves horizontally. For example, as... Figure 4 As shown, the user can move in the order ①(405)→②(407)→③(409)→④(411). The first mode 419 of the P-frame can be a mode corresponding to the path 413 from ①(405) to ②(407). When the user moves from ①(405) to ②(407), a mode can be obtained in which the P-frame size can increase as the user moves closer to the center of the camera, and the P-frame size can have a maximum value when the user is at the center of the camera, and the P-frame size can decrease as the user moves away from the center of the camera. The second mode 421 of the P-frame can be a mode corresponding to the path 415 from ②(407) to ③(409). When the user moves from ②(407) to ③(409), a mode can be obtained in which the P-frame size increases as the vertical distance gets closer. The third mode 423 of the P-frame can be a mode corresponding to the path 417 from ③(409) to ④(411). When the user moves from ③(409) to ④(411), a pattern can be obtained where the P-frame size decreases as the vertical distance increases. Simultaneously, compared to the user moving from ①(405) to ②(407) on path 413, the rate of change of the P-frame size can be greater when the user moves from ②(407) to ③(409) on path 415 or from ③(409) to ④(411) on path 417 (i.e., when the user performs vertical movement rather than horizontal movement). Therefore, the processor 210 can determine the camera position based on the distance and direction of the user's movement, using the motion vector and the change in P-frame size.

[0074] Figure 5 This is a method and view illustrating an embodiment of the present disclosure for indicating the location of an external electronic device.

[0075] refer to Figure 5According to embodiments of this disclosure, processor 210 can provide the user with location information about the camera. Processor 210 can provide information about the orientation of the camera and the vertical distance between the camera and the user. Alternatively, processor 210 can guide the user in using... Figure 5 The camera captures a space and provides it as augmented reality content 500 to display areas 520 corresponding to camera position information in different colors on the captured actual image 510. Furthermore, when the area where the camera is inferred to be present narrows, the areas displayed in different colors can be shown at a reduced size.

[0076] According to embodiments of this disclosure, communication circuit 220 can establish a direct (e.g., wired) communication channel or a wireless communication channel between electronic device 101 and external electronic device, or support communication through the established communication channel. Communication circuit 220 may include one or more communication processors that operate independently of processor 210 (e.g., application processor (AP)) and support direct (e.g., wired) or wireless communication. According to embodiments of this disclosure, communication circuit 220 may include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a Global Navigation Satellite System (GNSS) communication module) or a wired communication module (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). One of these communication modules can communicate with an external electronic device via a first network (e.g., a short-range communication network, such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IRDA)) or a second network (e.g., a long-range communication network, such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN)). These various types of communication modules can be implemented as a single component (e.g., a single chip) or as multiple components (e.g., multiple chips) that are separate from each other. The wireless communication module can use subscriber information (e.g., International Mobile Subscriber Identity (IMSI)) stored in the subscriber identification module to identify and authenticate the electronic device 101 in the communication network (e.g., the first network or the second network).

[0077] According to embodiments of this disclosure, the communication circuit 220 can operate in Wi-Fi mode (or management mode), and the communication circuit 220 operating in Wi-Fi mode can send data to / receive data from external electronic devices. According to embodiments of this disclosure, the communication circuit 220 can operate in monitoring mode, and the communication circuit 220 operating in monitoring mode can identify (or collect) packets communicated by at least one external electronic device using a wireless router (access point (AP)). For example, the communication circuit 220 can establish a specific Wi-Fi channel and identify information about at least some packets communicating on the established Wi-Fi channel. The communication circuit 220 can identify information about the channel while changing the Wi-Fi channel. For example, packet information may include identification information about the device (source) sending the packet and identification information about the device (destination) receiving the packet.

[0078] According to embodiments of this disclosure, sensor 230 can detect the environmental state (e.g., user state) outside electronic device 101 or the operating state (e.g., power or temperature) of electronic device 101, and generate an electrical signal or data value corresponding to the detected state. According to embodiments of this disclosure, sensor 230 may include, for example, a gyroscope, accelerometer, posture sensor, pedometer, magnetometer, atmospheric pressure sensor, grip sensor, proximity sensor, color sensor, infrared (IR) sensor, biosensor, temperature sensor, humidity sensor, or illuminance sensor.

[0079] According to embodiments of this disclosure, sensor 230 (e.g., a gyroscope or accelerometer) can detect the direction and distance of the user's movement. According to embodiments of this disclosure, sensor 230 (e.g., a pedometer) can count the number of steps taken by the user.

[0080] According to embodiments of this disclosure, display 240 can provide visual information to the outside of electronic device 101 (e.g., a user). According to embodiments of this disclosure, display device 140 may include, for example, a display, a holographic device, or a projector, and control circuitry to control a corresponding one of the display, holographic device, and projector. According to embodiments of this disclosure, display device 140 may include touch circuitry adapted to detect touch, or sensor circuitry adapted to measure the intensity of the force caused by a touch (e.g., a pressure sensor).

[0081] According to embodiments of this disclosure, the display 240 may receive display control signals from the processor 210. According to embodiments of this disclosure, the display control signals may include at least one of the following: a command to display a UI to suggest movement to the user, a command to display a UI to indicate that a capturing device has been detected, or a command to display the location of the capturing device.

[0082] According to embodiments of this disclosure, memory 250 may store various data used by at least one component of electronic device 101 (e.g., processor 210 or sensor 230). The various data may include, for example, input or output data of software (e.g., a program) and associated commands. According to embodiments of this disclosure, memory 250 may include volatile or non-volatile memory. Programs may be stored in memory 250 as software and may include, for example, an operating system (OS), middleware, or an application program.

[0083] According to embodiments of this disclosure, memory 250 may store information about the uplink packet-to-link packet ratio to determine if a capture device has been identified, or information about a threshold for the P-frame or RSSI size to determine if motion has been captured.

[0084] Figure 6 This is a flowchart illustrating a method of using an electronic device according to an embodiment of the present disclosure.

[0085] Figure 6 The operations are not restricted by order, and other operations can be performed between two adjacent operations. This can be omitted. Figure 6 At least some of the operations described herein are applicable, and the description herein is equally applicable to all flowcharts. In this disclosure, when electronic device 200 performs a specific operation, the processor 210 of electronic device 200 can perform the specific operation, or the processor 210 can control other hardware to perform the specific operation. In this disclosure, when electronic device 200 performs a specific operation, instructions stored in memory 250 can be executed to enable processor 210 or other hardware to perform the specific operation, and instructions triggering the specific operation can be stored in memory 250. Figure 6 Reference to the embodiments Figure 7 , Figure 8A , Figure 8B , Figure 9A , Figure 9B , Figure 10A and Figure 10B To describe.

[0086] Figure 7 This is a view illustrating a method for identifying frames according to an embodiment of the present disclosure.

[0087] Figure 8A This is a view illustrating horizontal movement of a user according to an embodiment of this disclosure.

[0088] Figure 8B This is a view illustrating a pattern of P-frames corresponding to user horizontal motion according to an embodiment of the present disclosure.

[0089] Figure 9A This is a view illustrating horizontal movement of a user according to an embodiment of this disclosure.

[0090] Figure 9B This is a view illustrating a pattern of P-frames corresponding to user horizontal motion according to an embodiment of the present disclosure.

[0091] Figure 10A This is a view illustrating the vertical movement of a user according to an embodiment of the present disclosure.

[0092] Figure 10B This is a view showing a pattern of P-frames corresponding to the vertical movement of a user according to an embodiment of the present disclosure.

[0093] For reference Figure 6 , Figure 7 , Figure 8A , Figure 8B , Figure 9A , Figure 9B , Figure 10A and Figure 10B According to various embodiments of this disclosure, in operation 601, electronic device 200 (e.g., processor 210) can identify data packet information associated with at least one external electronic device. Electronic device 200 can capture packets transmitted / received between a wireless router and at least one external electronic device. For example, electronic device 200 can collect packets transmitted by at least one external electronic device using a wireless router while operating in monitoring mode. For example, the data packet information may include at least some of the following: identification information about the device sending the packet, identification information about the device receiving the packet, information about the packet size, and information about the time the packet was transmitted.

[0094] According to various embodiments of this disclosure, in operation 603, electronic device 200 can identify a first external electronic device among at least one external electronic device based on data packet information. For example, the first external electronic device may refer to electronic device 200 performing real-time streaming. When the identification information regarding the device sending the packet is an external electronic device and / or the identification information regarding the device receiving the packet is an identification information regarding a wireless router, electronic device 200 can determine that it is an uplink packet. Alternatively, when the identification information regarding the device sending the packet is an identification information regarding a wireless router and / or the identification information regarding the device receiving the packet is an external electronic device, electronic device 200 can determine that the packet is a downlink packet. When the ratio of uplink packets to packets transmitted by a particular external electronic device exceeds a specified value, electronic device 200 can identify the particular external electronic device as the first external electronic device (e.g., the electronic device performing real-time streaming).

[0095] According to various embodiments of this disclosure, in operation 605, electronic device 200 can acquire a P-frame mode during a first time period and a P-frame or RSSI mode during a second time period based on information in the data packet information associated with the packet size of the first external electronic device. Electronic device 200 can identify frames based on data packet information sent / received by the first external electronic device. Frames can be divided into multiple packets and sent according to their size. Multiple packets corresponding to a frame can be referred to as a packet set. Since a frame can be divided into successive MTU packets and packets smaller than an MTU packet according to its size, electronic device 200 can determine that successive MTU packets and packets smaller than an MTU packet constitute a frame. When the transmission time interval between consecutive packets is a specified time or less, electronic device 200 can determine that consecutive packets are a packet set corresponding to a frame. Figure 7 Part (a) can show the time interval between intra-frame packets, and Figure 7 Part (b) can show the time interval between inter-frame packets. For example, as... Figure 7 As shown in part (a), the transmission time interval between adjacent packets included in the packet set corresponding to a frame can be less than 0.02 seconds. The transmission time interval between packets corresponding to different frames can be greater than the transmission time interval between packets corresponding to a single frame, such as... Figure 7 As shown in part (b). Therefore, when the transmission time interval between consecutive packets is a specified time or less, the electronic device 200 can determine that the consecutive packets are a set of packets corresponding to a frame.

[0096] Electronic device 200 can identify P-frames based on the frame size (i.e., the set of packets corresponding to the frame). Electronic device 200 can determine that a frame is a P-frame when its size falls within a specified range. For example, electronic device 200 can determine whether a corresponding frame is a P-frame based on the number of MTU packets in the set of packets identified as a frame. For example, when the number of MTU packets corresponding to the frame is 10 or more, electronic device 200 can determine that the frame is an I-frame. For example, electronic device 200 can remove frames identified as I-frames from multiple frames to detect P-frames. Alternatively, electronic device 200 can manage the range associated with the number of MTU packets corresponding to P-frames and determine whether a frame is a P-frame based on whether the number of MTU packets for a particular frame falls within a specified range.

[0097] Electronic device 200 can acquire P-frame patterns during a first time period. For example, the P-frame pattern can represent the size of P-frames based on time. The first time period can be a period during which the user does not move. During the first time period, electronic device 200 can provide guidance on maintaining a static state via display 240 or speaker (not shown). Electronic device 200 can calculate a threshold for determining whether motion has been captured during a second time period based on the size of the P-frames during the first time period.

[0098] Electronic device 200 can acquire P-frame mode or RSSI mode during the second time period. For example, the second time period can be a period following the first time period, and can be a period of user movement. For example, electronic device 200 can provide the user with guidance on maintaining movement for a set time period via display 240 or speaker (not shown). For example, the guidance on maintaining movement could be a guide for the user to move around the space where the user is located.

[0099] According to various embodiments of this disclosure, in operation 607, electronic device 200 can identify motion vectors during a second time period. Electronic device 200 can identify motion vectors indicating the distance and direction of movement of a user during the second time period based on data detected by an accelerometer and / or gyroscope.

[0100] According to various embodiments of this disclosure, in operation 609, electronic device 200 can provide position information about the first external electronic device based on P-frames or RSSI modes during a second time period and motion vectors during the second time period.

[0101] Electronic device 200 can determine user motion based on P-frame mode. Since the P-frame size can correspond to changes in the size (or length) of the user-corresponding object included in the current image frame and the user-corresponding object included in a previous image frame, electronic device 200 can determine changes in the size of the user-corresponding object based on changes in the P-frame size. When the size of the user-corresponding object increases, electronic device 200 can determine that it is moving closer to the first external electronic device. When the size of the user-corresponding object decreases, electronic device 200 can determine that it is moving away from the first external electronic device.

[0102] refer to Figure 8AWhen user 801 moves horizontally, the change in P-frame size can be relatively smaller than when user 801 moves vertically. Here, the horizontal direction can refer to the direction defined by the capture surface captured by the camera. The vertical direction can refer to the direction perpendicular to the capture surface captured by the camera. However, in practice, the camera may not move perfectly parallel or perfectly perpendicular to its capture plane. In this disclosure, movement in the horizontal direction can mean when the vector component of the direction perpendicular to the capture surface in the user's movement direction is a threshold or less, and movement in the vertical direction can mean when the vector component of the direction perpendicular to the capture surface in the user's movement direction exceeds a threshold; however, those skilled in the art will understand that the description of directions is merely illustrative. For example, when the user... Figure 8A As shown, when moving horizontally, the P-frame mode can display the P-frame size increasing and then decreasing in accordance with the user's movement, as... Figure 8B As shown. Furthermore, due to the relatively small changes in motion, the change in P-frame size (803) is likely to be small.

[0103] For example, such as Figure 9A As shown, the change in P-frame size can be larger when user 805 moves horizontally from a distance closer to the first external electronic device compared to when user 801 moves vertically from a distance away from the first external electronic device. Therefore, when user 805 moves horizontally from a distance closer to the first external electronic device... Figure 9A As shown, when moving horizontally, the P-frame mode can display the P-frame size increasing and then decreasing in accordance with the user's movement, as... Figure 9B As shown. In this case, since the change in motion can be greater than when user 801 moves horizontally from a distance away from the first external electronic device, therefore in Figure 8B In this context, the change 807 within a P-frame can be larger than the change 803 in the size of the P-frame.

[0104] For example, such as Figure 10A As shown, the P-frame size can increase when user 809 moves vertically closer to the first external electronic device. The P-frame pattern can be increased as the user moves closer to the first external electronic device, such as... Figure 10B As shown, because as Figure 10A The size variation of objects corresponding to the user in the captured image shown is greater. The increase in P-frame size 811 can increase as the user moves closer to the first external electronic device.

[0105] Electronic device 200 can determine user motion based on P-frame patterns during a second time period. Electronic device 200 can determine whether the determined user motion corresponds to a motion vector during the second time period. For example, when it is determined based on the motion vector that the user has moved in a first direction and based on the P-frame pattern that the user is moving closer to a first external electronic device, electronic device 200 can determine that the first external electronic device is located in the first direction. Electronic device 200 can display a screen indicating that the first external electronic device is located in the first direction.

[0106] Electronic device 200 can determine user movement based on RSSI patterns. Since the RSSI magnitude can correspond to changes in distance between electronic device 200 and external electronic devices, electronic device 200 can determine the distance between itself and the external electronic devices based on changes in RSSI magnitude. When the RSSI magnitude increases, electronic device 200 can determine that it is moving closer to the first external electronic device. When the RSSI magnitude decreases, electronic device 200 can determine that it is moving further away from the first external electronic device.

[0107] Electronic device 200 (e.g., processor 210) can identify multiple frames associated with a first external electronic device. Electronic device 200 can identify a set of multiple packets corresponding to a frame based on the transmission time interval between packets sent / received by the first external electronic device. The transmission time interval between consecutive packets corresponding to a frame can be less than the transmission time interval between consecutive packets corresponding to different frames. When the transmission time interval between consecutive packets is less than (or not greater than) a specified value, electronic device 200 can determine that the consecutive packets are a set of packets corresponding to a frame.

[0108] According to various embodiments of this disclosure, the electronic device 200 can identify P-frames within a second plurality of frames. The electronic device 200 can identify P-frames based on the size of the second plurality of frames. For example, the electronic device 200 can determine whether a frame is an I-frame or a P-frame based on its size. For example, the electronic device 200 can remove frames identified as I-frames from the second plurality of frames to identify P-frames.

[0109] Figure 11A This is a view illustrating a method for setting a threshold according to an embodiment of the present disclosure.

[0110] Figure 11B The P-frame size and threshold according to an embodiment of this disclosure are shown.

[0111] Figure 11C This is a view illustrating a method for setting a threshold according to an embodiment of the present disclosure.

[0112] refer to Figure 11A , Figure 11B and Figure 11C The electronic device 200 can identify the size of P-frames during periods of user inactivity. The electronic device 200 can calculate the distribution of the identified P-frame sizes as groups. The electronic device 200 can calculate the standard normal distribution of P-frame sizes by standardizing the distribution of P-frame sizes to a normal distribution using the mean and standard deviation of the P-frame sizes. For example, the standard normal distribution of P-frame sizes can be as follows: Figure 11A As shown. Electronic device 200 can calculate the standardized value Z (Z=(Xm) / σ) by subtracting the average value m of the P-frame size X from the P-frame size and dividing by the standard deviation σ of the P-frames. Electronic device 200 can use a standard normal distribution to calculate the probability that the P-frame size falls within a specific range. (Refer to...) Figure 11A The probability that the size of a P-frame falls within the range of Z-1.96σ to Z+1.96σ can be 95%. For example, as... Figure 11A As shown, the probability that the size of a P-frame falls within the range of Z-2.33σ to Z+2.33σ is 98%. For example, as... Figure 11A As shown, the probability 1105 that the size of the P-frame falls within the range of Z-2.58σ to Z+2.58σ can be 99%. The electronic device 200 can set the upper limit Z+2.58σ as a first threshold, where the probability that the size of the P-frame falls within a specific range is 99%. At the same time, the first threshold can be any value used for motion detection, and is not limited to a specific one.

[0113] For example, if a first threshold is set with an upper limit Z+2.58σ that represents a 99% probability that the size of a P-frame falls within a specific range, then when the number of P-frames exceeding the first threshold exceeds a specified value, the electronic device 200 can determine that motion exists. (Refer to...) Figure 11B When there is no motion, the P-frame size 1115 can mostly have a value smaller than the first threshold 1111. For example, when... Figure 11B As shown, when there is motion, the P-frame size 1115 can mostly have a value greater than the first threshold 1111.

[0114] Electronic device 200 can calculate a standard normal distribution for P-frame sizes exceeding (or not less than) a first threshold using the average and standard deviation of the P-frame sizes. Electronic device 200 can then use this standard normal distribution to set a second threshold, where the probability of P-frame sizes exceeding the first threshold falling within a specific range is 90% (Z+1.65σ). The second threshold can be any value used for motion detection, and is not limited to a specific threshold. (See reference...) Figure 11CIn the first time period (e.g., a period when the user does not move), 1125, the size of most (e.g., 99.5%) of the P-frames can be smaller than the first threshold 1121. Furthermore, in the second time period (e.g., periods when the user moves, 1127 and 1129), the size of most (e.g., 95%) of the P-frames can be larger than the second threshold 1123. The electronic device 200 can determine that a moving object was captured by the first external electronic device during times 1131 and 1133 when P-frames with sizes exceeding the second threshold were detected.

[0115] Figure 12A This is a view illustrating a method for recognizing user movement according to an embodiment of the present disclosure.

[0116] Figure 12B This is a view illustrating a method for recognizing user movement according to an embodiment of the present disclosure.

[0117] Figure 12C This is a view illustrating a method for recognizing user movement according to an embodiment of the present disclosure.

[0118] refer to Figure 12A It can be assumed that user 1200, who was once at a first point 1203 at a vertical distance d0 1211 from the first external electronic device 1201, moves d 1207 to a second point 1205 (i.e., moves away). Furthermore, in the image captured by the first external electronic device 1201, the length of the object corresponding to user 1200 can correspond to the vertical distance between user 1200 and the first external electronic device 1201. Additionally, the size of the P-frame can be proportional to the square of the length of the object corresponding to user 1200 in the image captured by the first external electronic device 1201.

[0119] When the user is at the first point 1203, the vertical distance between the first external electronic device 1201 and the user 1200 can be d0 1211, and the length of the object corresponding to the user 1200 in the image captured by the first external electronic device 1201 can be l0. When the user 1200 moves from the first point 1202 to the second point 1205, the actual distance the user moves can be d 1207 (the user's moving speed s * the user's moving time t), but the vertical distance from the user to the first external electronic device can vary by d1 1209. When the user 1200 is at the second point 1205, the vertical distance between the first external electronic device 1201 and the user 1200 can be d0 + d1. In this case, d1 can be calculated as d1 = d * sinx using the angle x 1213 of the direction of the user's actual movement. Therefore, when the user 1200 is at the second point 1205, the length of the object corresponding to the user 1200 in the image captured by the first external electronic device 1201 can be l = (d0 / d0 + d1) * l0. Therefore, the size of a P-frame can be proportional to the square of ((d0*l0) / (d0+s*t*sin x)). In this case, the user's moving speed s, the user's moving time t, and the angle x of the user's actual moving direction can be identified by sensors included in the electronic device 200.

[0120] refer to Figure 12B It can be assumed that user 1200, who was previously located at a first point 1225 at a vertical distance d0 1231 from the first external electronic device 1201, moves d 1227 to a second point 1223 (i.e., moves closer). Furthermore, in the image captured by the first external electronic device 1201, the length of the object corresponding to user 1200 can correspond to the vertical distance between user 1200 and the first external electronic device 1201. Additionally, the size of the P-frame can be proportional to the square of the length of the object corresponding to user 1200 in the image captured by the first external electronic device 1201.

[0121] When the user is at the first point 1225, the vertical distance between the first external electronic device 1201 and the user 1200 can be d0 = 1231, and the length of the object corresponding to the user 1200 in the image captured by the first external electronic device 1201 can be l0. When the user 1200 moves from the first point 1225 to the second point 1223, the actual distance the user moves can be d = 1227 (the user's moving speed s * the user's moving time t), but the vertical distance to the first external electronic device can vary by d1 = 1229. When the user 1200 is at the second point 1223, the vertical distance between the first external electronic device 1201 and the user 1200 can be d0 - d1. In this case, d1 can be calculated as d1 = d * sin x using the angle x 1233 of the direction of the user's actual movement. Therefore, when the user 1200 is at the second point 1223, the length of the object corresponding to the user 1200 in the image captured by the first external electronic device 1201 can be l = (d0 / d0 - d1) * l0. Therefore, the P-frame size can be proportional to the square of ((d0*l0) / (d0-s*t*sin x)). Thus, when user 1200 moves closer to the first external electronic device 1200, the ratio of the P-frame sizes before and after the movement is obtained by dividing the current P-frame size by the previous P-frame size, and can therefore be calculated as ((d0*l0) / (d0-d*sin x))^2 / ((d0*l0) / (d0))^2=d0^2 / (d0-d*sin x)^2.

[0122] refer to Figure 12CIt can be assumed that a user who was previously at a first point 1241, at a vertical distance d0 1251 from the first external electronic device 1201, moves to a second point 1243, and then moves from the second point 1243 to a third point 1245. When user 1200 moves from the first point 1241 to the second point 1243, the slope of the rate of change of the P-frame size can be calculated as a = d0^2 / (d0 - d1 * sin x1)^2. In this case, d0 1251 can be the vertical distance between the first point 1241 and the first external electronic device 1201, d1 1247 can mean the distance between the first point 1242 and the second point 1243, and x1 1253 can mean the direction of movement from the first point 1243 to the second point 1245. When user 1200 moves from point 1243 to point 1245, the slope, which is the rate of change of the P-frame size, can be calculated as b = (d1*sin x1)^2 / (d1*sin x1 - d2*sin x2)^2. In this case, d21249 can represent the distance between point 1243 and point 1245, and x21255 can represent the direction of movement from point 1243 to point 1245. The absolute value of x2 minus x1 can be equal to 180 minus the absolute value of x. Therefore, d0, x1, and x2 can be calculated based on the calculated values ​​of a, b, x, d1, and d2. For example, the three variables d0, x1, and x2 can be calculated by subtracting the absolute value of the values ​​obtained from (Equation 1) a = d0^2 / (d0 - d1*sin x1)^2, (Equation 2) b = (d1*sin x1)^2 / (d1*sin x1 - d2*sin x2)^2, and (Equation 3) x2 - x1, which is 180 minus the absolute value of x. Electronic device 200 can identify information about the orientation of the first external electronic device 1201 and its perpendicular distance from the first point 1241 based on d0, x1, and x2. For example, electronic device 200 can use the calculated values ​​of x2 and x1 to identify the orientation of the first external electronic device relative to a reference direction faced by the user. Since d0 can represent the straight-line distance from the first point 1241 where the user is initially located to the first external electronic device 1201, electronic device 200 can estimate information about the distance based on d0.

[0123] Figure 13 A view showing a method for using P-frame mode and motion vectors according to an embodiment of the present disclosure.

[0124] Reference Figure 13 Part (a) and Figure 13In part (b), according to various embodiments of this disclosure, electronic device 200 can identify information about the time period of user movement based on P-frame patterns. Electronic device 200 can identify the user's motion vector based on data detected by sensors. Electronic device 200 can determine whether a first external electronic device is a device for capturing the user based on whether the time period of user movement corresponds to the user's motion vector. For example, as... Figure 13 As shown in part (a), the electronic device 200 can determine the capture of the user's motion at a first time 1301, a second time 1303, and a third time 1305 based on the P-frame mode. For example, as Figure 13 As shown in part (b), the electronic device 200 can detect motion at a first time 1301, a second time 1303, and a third time 1305. Figure 13 Part (a) and Figure 13 As shown in part (b), when motion is detected by a sensor during user motion capture based on P-frame mode, electronic device 100 can determine that the first external electronic device has captured the user. Simultaneously, even if user motion is identified as captured based on P-frame mode, if no motion is detected by a sensor, electronic device 200 can determine that it is not the device that captured the user.

[0125] Figure 14A This is a view illustrating a method for using P-frame mode and motion vectors according to an embodiment of the present disclosure.

[0126] According to various embodiments of this disclosure, a delay may occur when the first external electronic device 200 uploads an image captured for a user. Therefore, referring to 14A, a delay 1405 may occur between the time 1401 when the electronic device 200 detects motion via a sensor and the time 1403 when the motion is determined to have been captured based on a P-frame pattern. When the difference between the time when the motion is determined to have been captured based on the P-frame pattern and the time when the motion is detected via sensing data is a specified time or less, the electronic device 200 can determine that the P-frame pattern and the motion detection period correspond to each other. Furthermore, to reduce errors caused by the delay in determining the position of the first external electronic device, the electronic device 200 can indicate a movement path to the user.

[0127] Figure 14B This is a view illustrating a method for indicating a movement path according to an embodiment of the present disclosure.

[0128] refer to Figure 14BElectronic device 200 can guide the user to movement path 1413 to move at least once around the space 1411 where the user is located. In this case, electronic device 200 can identify the user's movement speed and / or the time it takes for the user to pass through a position included in the capture area 1419 of the first external electronic device 1419 based on sensing data acquired by sensors. Determining the time of motion capture based on P-frame mode may be later than the time identified based on sensing data due to delay. Electronic device 200 can guide the user to movement path 1415 to move at least once around the space 1411 where the user is located in a direction opposite to the previously guided movement path. Electronic device 200 can determine the position of the first external electronic device 1417 based on the delay time and the user's walking speed calculated based on the sensing data acquired by sensors.

[0129] Figure 15A and Figure 15B This is a view illustrating a method of operation of an electronic device according to various embodiments of the present disclosure. Upon receiving user input for executing an application, the electronic device 200 may display a screen for initiating operation to detect the camera position.

[0130] refer to Figure 15A In part (a), the electronic device 200 can display a notification such as "Press the start button to find the hidden camera." If user input is received to begin detecting the camera's location, the electronic device 200 can provide instructions to remain static for a first time period. For example, as... Figure 15A As shown in section (a), electronic device 200 can display a notification such as "Detection started. Please remain still." Electronic device 200 can identify packet information regarding external electronic devices sending / receiving data packets to / from the wireless router during a first time period. Electronic device 200 can identify the presence of an external electronic device identified as a capturing device based on the packet information. When no external electronic device identified as a capturing device exists, electronic device 200 can indicate that no capturing device exists. For example, as... Figure 15A As shown in section (c), electronic device 200 can display a notification such as "No radio signal suspected to be a hidden camera detected." When an external electronic device identified as a capture device is present, electronic device 200 can indicate the presence of a capture device and guide the user along a movement path. For example, as... Figure 15A As shown in section (d), the electronic device 200 can display a notification such as "A radio signal suspected to be a hidden camera has been detected." For example, as... Figure 15AAs shown in section (e), the electronic device 200 can display a notification such as "Walk along the wall." During a second time period of user movement, the electronic device 200 can identify P-frame patterns based on packet information associated with a first external electronic device suspected of being a capture device. Furthermore, during the second time period, the electronic device 200 can identify motion vectors based on sensing data acquired by sensors. The electronic device 200 can determine whether the first external electronic device is a capture device capturing the user based on whether the P-frame pattern corresponds to a motion vector. If it is determined that the first external electronic device is not a capture device capturing the user, the electronic device 200 can indicate that no capture device exists.

[0131] refer to Figure 15A As shown in section (f), the electronic device 200 can display a notification such as "No device suspected of being a hidden camera detected." Upon determining the presence of a capturing device that is capturing the user, the electronic device 200 can indicate the presence of a capturing device and redirect the movement path. (See reference...) Figure 15B As shown in section (g), electronic device 200 can display a notification such as "A hidden camera has been found." For example, as Figure 15B As shown in section (h), the electronic device 200 can display a notification such as "Move to a nearby wall." (See reference) Figure 15B As shown in part (i), electronic device 200 can display notifications such as "Move along the wall a few times." Electronic device 200 can determine that the first external electronic device is being captured at a closer location as the P-frame size changes. Electronic device 200 can determine the position of the first external electronic device based on the P-frame pattern. For example, electronic device 200 can determine the position of the first external electronic device based on the P-frame pattern acquired during movement, and if the distance between the position of electronic device 200 and the position of the first external electronic device is less than a preset distance, a notification such as "The first camera is nearby. Please carefully check the surrounding objects. After checking, press the complete button" is displayed. Figure 15B As shown in section (j). The electronic device 200 can terminate the application by selecting "Done" based on user input. (See reference...) Figure 15B As shown in part (k), the electronic device 200 can display a notification such as "Camera search complete" and terminate the application.

[0132] According to various embodiments, an electronic device (e.g., electronic device 200) may include a display (e.g., display 240), communication circuitry (e.g., communication circuitry 220), at least one sensor (e.g., sensor 230), and at least one processor (e.g., processor 210). The at least one processor (e.g., processor 210) may be configured to: identify data packet information associated with at least one external electronic device via the communication circuitry; identify a first external electronic device (e.g., first external electronic device 120) among the at least one external electronic device based on the data packet information; acquire a P-frame pattern during a first time period and a P-frame or RSSI pattern during a second time period based on information associated with the packet size of the first external electronic device in the data packet information; identify motion vectors during the second time period via at least one sensor (e.g., sensor 230); and provide position information about the first external electronic device (e.g., first external electronic device 120) based on the P-frame or RSSI pattern during the second time period and the motion vectors during the second time period.

[0133] According to various embodiments of the present disclosure, at least one processor (e.g., processor 210) may be configured to identify, based on data packet information, whether an electronic device (e.g., first external electronic device 120) is performing real-time streaming in at least one external electronic device.

[0134] According to various embodiments of the present disclosure, at least one processor (e.g., processor 210) may be configured to identify a set of multiple packets corresponding to a frame based on information associated with the packet size of a first external electronic device (e.g., first external electronic device 120).

[0135] According to various embodiments of this disclosure, at least one processor (e.g., processor 210) can be configured to identify whether a frame is a P-frame based on the size of a set of multiple groups.

[0136] According to various embodiments of this disclosure, at least one processor (e.g., processor 210) may be configured to identify a set of multiple packets corresponding to a frame based on the time interval when multiple packets are sent / received by a first external electronic device (e.g., first external electronic device 120).

[0137] According to various embodiments of this disclosure, at least one processor (e.g., processor 210) may be configured to identify a first external electronic device (e.g., first external electronic device 120) as a capture device of the space where the capture electronic device (e.g., electronic device 200) is located, based on a P-frame mode during a first time period and a P-frame or RSSI mode during a second time period.

[0138] According to various embodiments of this disclosure, at least one processor (e.g., processor 210) may be configured to display a screen to indicate the user's movement path during a second time period via a display (e.g., display 240).

[0139] According to various embodiments of this disclosure, a P-frame or RSSI mode can indicate the size of a P-frame or RSSI mode based on time.

[0140] According to various embodiments of this disclosure, the location information of the first external electronic device (e.g., the first external electronic device 120) may include information about the distance between the electronic device (e.g., electronic device 200) and the first external electronic device (e.g., the first external electronic device 120) and information about the orientation of the first external electronic device (e.g., the first external electronic device 120).

[0141] According to various embodiments of this disclosure, at least one processor (e.g., processor 210) may be configured to identify a user movement path for at least a portion of the time period if a P-frame or RSSI mode during a second time period satisfies a specified condition during at least a portion of the second time period.

[0142] According to various embodiments of the present disclosure, a method for operating an electronic device (e.g., electronic device 200) may include identifying data packet information associated with at least one external electronic device, identifying a first external electronic device (e.g., first external electronic device 120) among at least one electronic device based on the data packet information, acquiring a P-frame pattern during a first time period and acquiring a P-frame or RSSI pattern during a second time period based on the P-frame or RSSI pattern during the second time period and the motion vector during the second time period, and providing position information about the first external electronic device (e.g., first external electronic device 120) based on the P-frame or RSSI pattern during the second time period and the motion vector during the second time period.

[0143] According to various embodiments of the present disclosure, identifying a first external electronic device (e.g., electronic device 200) may include identifying, based on data packet information, whether an electronic device (e.g., first external electronic device 120) performing real-time streaming is present in at least one external electronic device.

[0144] According to various embodiments of this disclosure, acquiring the P-frame mode during a first time period and acquiring the P-frame mode during a second time period may include identifying a set of multiple packets corresponding to a frame based on information associated with the packet size of a first external electronic device (e.g., first external electronic device 120).

[0145] According to various embodiments of this disclosure, acquiring the P-frame mode during a first time period and acquiring the P-frame mode during a second time period may further include identifying whether a frame is a P-frame based on the size of a set of multiple groups corresponding to a frame.

[0146] According to various embodiments of this disclosure, acquiring the P-frame mode during a first time period and acquiring the P-frame mode during a second time period may include identifying a set of multiple packets corresponding to a frame based on the time interval when multiple packets are sent / received by a first external electronic device (e.g., first external electronic device 120).

[0147] According to various embodiments of this disclosure, the method may further include identifying a first external electronic device (e.g., first external electronic device 120) as a capturing device of the space where a capturing electronic device (e.g., electronic device 200) is located, based on a P-frame pattern during a first time period and a P-frame or RSSI pattern during a second time period.

[0148] According to various embodiments of this disclosure, the method may further include displaying a screen indicating the user's movement line during a second time period.

[0149] According to various embodiments of this disclosure, the P-frame or RSSI mode can indicate the size of the P-frame or RSSI based on time.

[0150] According to various embodiments of this disclosure, the location information of the first external electronic device (e.g., the first external electronic device 120) may include information about the distance between the electronic device (e.g., the electronic device 200) and the first external electronic device (e.g., the first external electronic device 120) and information about the orientation of the first external electronic device (e.g., the first external electronic device 120).

[0151] According to various embodiments of this disclosure, providing location information about a first external electronic device (e.g., electronic device 200) may include: identifying a user movement path for at least a portion of the time period if a P-frame or RSSI pattern during a second time period meets specified conditions during at least a portion of the second time period.

[0152] The electronic device according to various embodiments of this disclosure can be one of a variety of types of electronic devices. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer equipment, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. According to embodiments of this disclosure, the electronic device is not limited to the electronic devices described above.

[0153] It should be understood that the various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features set forth herein to particular embodiments, and include various variations, equivalents, or substitutions of the corresponding embodiments. Regarding the description of the drawings, similar reference numerals may be used to denote similar or related elements. As used herein, each of the phrases such as “A or B,” “at least one of A and B,” “one of A or B,” or “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” may include all possible combinations of items listed together in the corresponding phrase. As used herein, terms such as “first” and “second” may be used simply to distinguish one component from another and do not limit other aspects (e.g., importance or order) of the components. It should be understood that if an element (e.g., a first element) is referred to as “coupled to,” “coupled to,” “connected to,” or “attached to” another element, it means that the element may be coupled to the other element directly (e.g., wired), wirelessly, or via a third element.

[0154] As used herein, the term "module" can include a unit implemented in hardware, software, or firmware, and is used interchangeably with other terms such as "logic," "logic block," "component," or "circuit." A module can be a single integrated component or its smallest unit or part, adapted to perform one or more functions. For example, according to embodiments of this disclosure, a module can be implemented as an application-specific integrated circuit (ASIC).

[0155] The various embodiments described herein can be implemented as software (e.g., program 140), including one or more instructions stored in a machine-readable storage medium (e.g., internal memory 136 or external memory 138). For example, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) can invoke at least one of one or more instructions stored in the storage medium and execute that instruction under the processor's control, with or without one or more other components. This allows the machine to operate according to the invoked at least one instruction to perform at least one function. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-temporary storage medium. Wherein, the term "non-temporary" means only that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between the location where data is semi-permanently stored in the storage medium and the location where data is temporarily stored in the storage medium.

[0156] According to embodiments of this disclosure, methods according to various embodiments of this disclosure may be included and provided in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., an optical disc read-only memory (CD-ROM)), or distributed online (e.g., downloaded or uploaded) through an app store (e.g., the Play Store™), or directly between two user devices (e.g., smartphones). If distributed online, at least a portion of the computer program product may be temporarily generated or at least temporarily stored in a machine-readable storage medium, such as the memory of a manufacturer's server, an app store's server, or a relay server.

[0157] According to various embodiments of this disclosure, each component (e.g., a module or program) of the above-described components may include a single entity or multiple entities. Some of the multiple entities may be arranged separately in different components. According to various embodiments of this disclosure, one or more of the above-described components may be omitted, or one or more other components may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments of this disclosure, the integrated component may still perform one or more functions of each of the multiple components in the same or similar manner as they were performed by the corresponding component of the multiple components before integration. According to various embodiments of this disclosure, operations performed by a module, program, or other component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more operations may be performed in a different order or omitted, or one or more other operations may be added.

[0158] Although this disclosure has been shown and described with reference to its accompanying drawings, those skilled in the art will understand that various changes in form and detail may be made without departing from the spirit and scope of this disclosure as defined by the appended claims and their equivalents.

Claims

1. An electronic device, comprising: monitor; A communication circuit is configured to establish a wireless communication channel between an electronic device and at least one external electronic device; At least one sensor; Memory, storing instructions; as well as At least one processor, The instructions, when executed by at least one processor, cause the electronic device to: Receive signals including data packet information through communication circuits; Identify data packet information associated with at least one external electronic device; The first external electronic device among the at least one external electronic device is identified based on data grouping information; During a first time period when the user is static, a predicted frame P-frame mode is acquired, and during a second time period when the user is dynamic, a second P-frame mode is acquired based on information associated with the data packet size of the first external electronic device in the data packet information, or an RSSI mode is acquired based on the received signal strength indicator RSSI value of the received signal during the second time period. The motion vectors, including the distance and direction of the electronic device's motion during the second time period, are identified by at least one sensor. Calculate the rate of change of frame size in the second P-frame mode or the rate of change of RSSI value in the RSSI mode corresponding to the change of motion vector during the second time period; Based on the numerical correspondence between the motion vector during the second time period and the rate of change of the frame size of the second P-frame mode during the second time period or the rate of change of the RSSI value of the RSSI mode during the second time period, positional information including the straight-line distance and direction to the first external electronic device is determined; and Provides location information about the first external electronic device.

2. The electronic device according to claim 1, wherein, When executed by at least one processor, the instruction also enables the electronic device to identify, based on data packet information, whether there is an electronic device performing real-time streaming among at least one external electronic device.

3. The electronic device according to claim 1, wherein, When executed by at least one processor, the instructions also cause the electronic device to identify a set of multiple packets corresponding to a frame based on information associated with the packet size of the first external electronic device.

4. The electronic device according to claim 3, wherein, When executed by at least one processor, the instruction also causes the electronic device to identify whether a frame is a P-frame based on the size of the set of multiple packets corresponding to a frame.

5. The electronic device according to claim 1, wherein, When executed by at least one processor, the instruction also causes the electronic device to identify a set of multiple packets corresponding to a frame based on the time interval of multiple packets sent or received by the first external electronic device.

6. The electronic device according to claim 1, wherein, When executed by at least one processor, the instruction also causes the electronic device to identify the first external electronic device as a capturing device in the space where the capturing electronic device is located, based on the P-frame mode during the first time period and the second P-frame mode or RSSI mode during the second time period.

7. The electronic device according to claim 1, wherein, When executed by at least one processor, the instruction also causes the electronic device to display a screen to indicate the user's movement path during the second time period.

8. The electronic device according to claim 1, wherein, When executed by at least one processor, the instruction also causes the electronic device to: identify the user's movement path during at least one portion of the second time period based on the RSSI pattern during the second time period meeting specified conditions.

9. A method of operating an electronic device, the method comprising: Receive signals including data packet information through the communication circuits of electronic devices; Identify data packet information associated with at least one external electronic device; The first external electronic device among the at least one external electronic device is identified based on data grouping information; During a first time period when the user is static, a predicted frame P-frame mode is acquired, and during a second time period when the user is dynamic, a second P-frame mode is acquired based on information related to the packet size of the first external electronic device in the data packet information, or an RSSI mode is acquired based on the received signal strength indicator RSSI value of the received signal during the second time period. The motion vector, including the distance and direction of the electronic device's motion during the second time period, is identified by at least one sensor of the electronic device. Calculate the rate of change of frame size in the second P-frame mode or the rate of change of RSSI value in the RSSI mode corresponding to the change of motion vector during the second time period; Based on the numerical correspondence between the motion vector during the second time period and the rate of change of the frame size of the second P-frame mode during the second time period or the rate of change of the RSSI value of the RSSI mode during the second time period, position information including the straight-line distance and direction to the first external electronic device is determined. as well as Provides location information about the first external electronic device.

10. The method according to claim 9, wherein, Identifying the first external electronic device includes identifying, based on data packet information, whether at least one external electronic device is an electronic device performing real-time streaming.

11. The method according to claim 9, wherein, Acquiring the P-frame mode during the first time period and the second P-frame mode during the second time period includes: identifying a set of multiple packets corresponding to a frame based on information associated with the packet size of the first external electronic device.

12. The method according to claim 11, wherein, Acquiring the P-frame mode during the first time period and the second P-frame mode during the second time period also includes: identifying whether a frame is a P-frame based on the size of the set of multiple groups corresponding to a frame.

13. The method according to claim 9, wherein, Acquiring the P-frame mode during the first time period and the second P-frame mode during the second time period includes: identifying a set of multiple packets corresponding to a frame based on the time interval of multiple packets sent or received by the first external electronic device.

14. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor of an electronic device, cause the electronic device to perform the method of any one of claims 9 to 13.

Images