Electronic device for detecting a position and method thereof

Abstract

Disclosed is an electronic device including a sensor module including at least one sensor configured to detect sensing data, wherein the sensing data includes a magnetic signal, movement of the electronic device, acceleration of the electronic device, and / or an angular direction of the electronic device with respect to the ground; a memory configured to store a virtual marker platform; and a processor operatively connected to the sensor module and the memory, wherein the processor is configured to control the electronic device to: receive the sensing data from the sensor module; generate a first virtual marker corresponding to a first location using the sensing data, wherein the first location corresponds to a current location of the electronic device; store the first virtual marker in the memory; detect an arbitrary virtual marker; load the first virtual marker from the memory; and based on the arbitrary virtual marker matching the first virtual marker, request a designated service and / or execute an event designated to be executed by the electronic device at the first location.

Description

Technical Field

[0001] The present disclosure relates to an electronic device for detecting a position and a method thereof. Background Art

[0002] The electronic device may track the location of the electronic device and / or the user using methods such as positioning and / or location calibration to notify the location of the electronic device.

[0003] Positioning and / or location calibration in indoor locations may require centimeter-level accuracy. Therefore, the electronic device may use Bluetooth beacon signals or Wi-Fi signals with higher accuracy than GPS technology to accurately measure the location of the electronic device.

[0004] In addition, the electronic device may provide a service based on a geo-fencing method of determining whether to perform entry and / or exit of a specific point of interest (POI) in order to notify the location of the electronic device at an indoor location. Summary of the Invention

[0005] Technical issues

[0006] In order to perform location detection using positioning and / or position calibration, the electronic device may require an indoor map provided externally or generated by an algorithm included in the electronic device and / or a fingerprint map in which sensor values ​​are measured from multiple points on the map. In the case where the electronic device requires the indoor map and / or fingerprint map in order to perform location detection, a delay may occur during data processing because the electronic device transmits / receives a large amount of data.

[0007] Methods whereby electronic devices use Bluetooth beacon signals to perform location detection may require the installation of additional infrastructure (such as a Bluetooth beacon generator). Preliminary tasks may be required to provide a corresponding processor in order to apply indoor positioning technologies based on Wi-Fi signals (such as 802.11mc or wireless LAN RTT). If indoor location measurement requires the installation of infrastructure or preliminary tasks, it may not be easy to deploy indoor location measurement services.

[0008] In the case of an electronic device using a geo-fencing method, since no coordinates need to be specified, a relatively small amount of data can be used to provide the service. However, if higher precision and accuracy are required, this may require the installation of additional dedicated infrastructure (such as Bluetooth beacons).

[0009] Embodiments of the present disclosure provide a technology for determining whether to enter and / or exit a specific point of interest and for indoor positioning and / or location calibration for measuring a location based on an indoor magnetic field by an electronic device.

[0010] Technical Solution

[0011] According to an example embodiment of the disclosure, an electronic device is provided. The electronic device includes a sensor module including at least one sensor configured to detect sensing data, wherein the sensing data includes a magnetic signal, a movement of the electronic device, an acceleration of the electronic device, and / or an angular direction of the electronic device with respect to a ground; a memory configured to store a virtual marker platform; and a processor operatively connected to the sensor module and the memory, wherein the processor is configured to control the electronic device to receive the sensing data from the sensor module, generate a first virtual marker corresponding to a first location using the sensing data, wherein the first location corresponds to a current location of the electronic device, store the first virtual marker in the memory, detect an arbitrary virtual marker, load the first virtual marker from the memory, and request a designated service and / or perform an event designated to be performed by the electronic device at the first location based on the arbitrary virtual marker matching the first virtual marker.

[0012] According to another example embodiment of the disclosure, a method for detecting a virtual marker corresponding to a location of an electronic device is provided. The method includes receiving sensing data, wherein the sensing data includes a magnetic signal, a movement of the electronic device, an acceleration of the electronic device, and / or an angular direction of the electronic device with respect to a ground, generating a first virtual marker corresponding to a first location using the sensing data, wherein the first location corresponds to a current location of the electronic device, and storing the first virtual marker.

[0013] Advantages of the Invention

[0014] According to various example embodiments of the disclosure, the electronic device can generate a virtual marker at a location corresponding to a location of the electronic device in an indoor place by defining a virtual marker of a corresponding space based on a signal characteristic reflecting a feature of an indoor building structure.

[0015] According to various example embodiments of the disclosure, since the electronic device does not need an additional indoor map and / or a fingerprint map, the amount of data transmitted / received and latency can be reduced.

[0016] According to various example embodiments of the disclosure, when a virtual marker is generated and / or detected, the electronic device does not need to install an additional infrastructure such as a Bluetooth beacon, and thus an indoor location measurement service can be easily conducted.

[0017] According to various example embodiments of the disclosure, a virtual marker can be an object having the same spatial signal characteristic, rather than a simple location coordinate, and thus the electronic device can designate the object by searching. BRIEF DESCRIPTION OF DRAWINGS

[0018] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0019] Figure 1 is a block diagram illustrating an example electronic device in a network environment according to various embodiments;

[0020] Figure 2 is a diagram illustrating an example one-dimensional virtual marker according to an embodiment;

[0021] Figure 3 is a diagram illustrating an example method of setting a virtual marker at a specific location according to an embodiment;

[0022] Figure 4 is a diagram illustrating an example method of setting a virtual marker in a specific path according to an embodiment;

[0023] Figure 5 is a diagram illustrating example sensing values ​​measured on a two-dimensional plane mapped to a two-dimensional virtual marker according to an embodiment;

[0024] Figure 6 is a diagram illustrating example imaging data of a two-dimensional virtual marker generated using magnetic field values ​​measured by an electronic device according to an embodiment;

[0025] Figure 7 is a flow chart illustrating an example framework for virtual badges according to an embodiment;

[0026] Figure 8 is a diagram illustrating example operations of registering, storing, and / or loading a virtual token according to an embodiment;

[0027] Figure 9 is a block diagram illustrating an example virtual badge platform according to an embodiment;

[0028] Figure 10 is a signal flow diagram illustrating an example process of registering a virtual token according to an embodiment;

[0029] Figure 11 is a signal flow diagram illustrating an example process of loading a virtual tag according to an embodiment;

[0030] Figure 12 is a signal flow diagram illustrating example operations of a virtual badge platform detecting a virtual badge according to an embodiment;

[0031] Figure 13 is a flowchart illustrating an example operation of an electronic device generating a first virtual marker and detecting the virtual marker to perform a designated event or request a designated service according to an embodiment; and

[0032] Figure 14is a flowchart illustrating an example operation of an electronic device receiving sensing data and generating and storing a first virtual marker according to an embodiment. DETAILED DESCRIPTION

[0033] Hereinafter, various exemplary embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. However, it should be understood that the present disclosure is not limited to specific embodiments, but includes various modifications, equivalents and / or replacements of various embodiments of the present disclosure.

[0034] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1 , the electronic device 101 in the network environment 100 can communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 can communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a subscriber identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit. For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented as embedded in the display device 160 (eg, a display).

[0035] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component of the electronic device 101 connected to the processor 120 (e.g., a hardware component or a software component), and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may load commands or data received from another component (e.g., sensor module 176 or communication module 190) into the volatile memory 132, process the commands or data stored in the volatile memory 132, and store the resulting data in the non-volatile memory 134. Depending on the embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operationally independent of or combined with the main processor 121. Additionally or alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be specifically used for a designated function. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of the main processor 121 .

[0036] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one component (e.g., the display device 160, the sensor module 176, or the communication module 190) among the components of the electronic device 101, or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., the display device 160, the sensor module 176, or the communication module 190) together with the main processor 121. Depending on the embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., the camera module 180 or the communication module 190) that is functionally related to the auxiliary processor 123.

[0037] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134.

[0038] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0039] The input device 150 may receive commands or data from outside the electronic device 101 (e.g., a user) to be used by other components of the electronic device 101 (e.g., the processor 120). The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).

[0040] The sound output device 155 can output sound signals to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or records, and the receiver can be used for incoming calls. Depending on the embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0041] The display device 160 can visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. Depending on the embodiment, the display device 160 may include a touch circuit adapted to detect a touch or a sensor circuit adapted to measure the strength of the force caused by the touch (e.g., a pressure sensor).

[0042] The audio module 170 can convert sound into an electrical signal, and vice versa. According to an embodiment, the audio module 170 can obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0043] The sensor module 176 can detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a user's state) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. Depending on the embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0044] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). Depending on the embodiment, the interface 177 may include, for example, a High-Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital (SD) card interface, or an audio interface.

[0045] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. Depending on the embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0046] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0047] The camera module 180 may capture still images or moving images. Depending on the embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

[0048] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0049] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0050] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. Depending on the embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0051] Antenna module 197 can transmit or receive signals or power to or from the outside of electronic device 101 (e.g., an external electronic device). Depending on the embodiment, antenna module 197 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a PCB). Depending on the embodiment, antenna module 197 may include multiple antennas. In this case, at least one antenna suitable for the communication scheme used in a communication network (such as first network 198 or second network 199) may be selected from the multiple antennas by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and the external electronic device via the selected at least one antenna. Depending on the embodiment, additional components (e.g., a radio frequency integrated circuit (RFIC)) in addition to the radiating element may also be formed as part of antenna module 197.

[0052] At least some of the above components can be connected to each other via an inter-peripheral communication scheme (e.g., a bus, general-purpose input output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0053] According to an embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 and the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type than the electronic device 101. According to an embodiment, all or some operations to be executed on the electronic device 101 may be executed on one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or execute another function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial response to the request, either by further processing the result or without further processing the result. To this end, for example, cloud computing technology, distributed computing technology, or client-server computing technology may be used.

[0054] Figure 2 is a diagram 200 illustrating an example one-dimensional virtual marker 201 according to an embodiment.

[0055] Reference Figure 2 , the one-dimensional virtual marker 201 may include a sensed value, wherein the sensed value includes one-dimensional linear information in a virtual marker (VM) for displaying information about a specific space and / or location. The one-dimensional virtual marker 201 may be stored in an electronic device (e.g., Figure 1 of the electronic device 101) (e.g., Figure 1 The one-dimensional virtual marker 201 may include, for example but not limited to, a magnetic sensing value 210, an acceleration sensing value 220, a gyroscope sensing value 230, a first wireless communication signal 240, and / or a second wireless communication signal 250.

[0056] In an embodiment, the magnetic sensing value 210 may include the magnitude value of the magnetic field in each direction measured at a specific rate in a specific space and / or position according to a specified sampling rate. With respect to the magnetic sensing value 210, the time for measuring the magnitude value of the magnetic field in each direction may be set according to a specified length. For example, when the sampling rate is 1 Hz and the length is 0.1 seconds, the electronic device 101 may measure the magnitude value of the magnetic field in each direction every second. The measurement of the magnitude value of the magnetic field in each direction may be maintained for 0.1 seconds, and the measurement may be performed once. The electronic device 101 may use a sensor module (e.g., Figure 1 The magnetic field sensor in the sensor module 176) can measure the magnetic field in a specific space and / or position. For example, the sensor module 176 can measure the magnetic field from the first time timestamp 1 to the Nth time timestamp N (N is a natural number). In this case, the magnetic sensing value 210 may include the X-axis direction intensity MagX1 of the magnetic field measured at the first time timestamp 1, the Y-axis direction intensity MagY1 of the magnetic field measured at the first time timestamp 1, and the Z-axis direction intensity MagZ1 of the magnetic field measured at the first time timestamp 1. In addition, the magnetic sensing value 210 may include the X-axis direction intensity MagX1 of the magnetic field measured at the Nth time timestamp N. N , the Y-axis intensity of the magnetic field measured at time stamp N, MagY N and the Z-axis intensity of the magnetic field measured at time stamp N, MagZ N .

[0057] In an embodiment, the acceleration sensing value 220 may include the magnitude value of the acceleration of the electronic device 101 in each direction measured at a specific rate in a specific space and / or position according to a specified sampling rate. With respect to the acceleration sensing value 220, the time for measuring the magnitude value of the acceleration in each direction may be set according to a specified length. The electronic device 101 may use the accelerometer included in the sensor module 176 to measure the acceleration in a specific space and / or position from a first time timestamp 1 to an Nth time timestamp N. For example, the acceleration sensing value 220 may include the X-axis acceleration AccX1 of the electronic device 101 measured at the first time timestamp 1, the Y-axis acceleration AccY1 of the electronic device 101 measured at the first time timestamp 1, and the Z-axis acceleration AccZ1 of the electronic device 101 measured at the first time timestamp 1. For another example, the acceleration sensing value 220 may include the X-axis acceleration AccX1 of the electronic device 101 measured at the Nth time timestamp N. N , the Y-axis acceleration AccY of the electronic device 101 measured at the Nth time stamp N N , and the Z-axis acceleration AccZ of the electronic device 101 measured at the Nth time stamp N N .

[0058] In an embodiment, the gyroscope sensing value 230 may include the value of the angular direction of the electronic device 101 relative to the ground in a specific space and / or location measured according to a specified sampling rate. Regarding the gyroscope sensing value 230, the time for measuring the angular direction value once may be set according to a specified length. The electronic device 101 may use the gyroscope included in the sensor module 176 to measure the value of the angular direction formed with the ground in a specific space and / or location at a first time stamp 1, a second time stamp 2, and a third time stamp 3. For example, the gyroscope sensing value 230 may include the roll value Roll1 of the electronic device 101 measured at the first time stamp 1, the pitch value Pitch1 of the electronic device 101 measured, and the yaw value Yaw1 of the electronic device 101 measured. For another example, the gyroscope sensing value 230 may include the roll value Roll2 of the electronic device 101 measured at the second time stamp 2, the pitch value Pitch2 of the electronic device 101 measured, and the yaw value Yaw2 of the electronic device 101 measured. For another example, the gyro sensing value 230 may include a roll value Roll3 of the electronic device 101 measured at the third time timestamp 3 , a pitch value Pitch3 of the electronic device 101 measured, and a yaw value Yaw3 of the electronic device 101 measured.

[0059] In an embodiment, the first wireless communication signal 240 may be a signal received by a wireless communication module (eg, Figure 1 The first wireless communication signal 240 may include information related to the number of AP signals of a broadband LAN (WLAN). The first wireless communication signal 240 may include information related to the strength of the AP signal measured in a specific space and / or location. For example, the first wireless communication signal 240 may include a first AP signal strength and a second AP signal strength.

[0060] In an embodiment, the second wireless communication signal 250 may be a strength value of a cell signal of cellular communication measured by the wireless communication module 192. The second wireless communication signal 250 may include information related to the number of cells. The second wireless communication signal 250 may include information related to the signal strengths of the first cell to the Nth cell measured in a specific space and / or location. For example, the second wireless communication signal 250 may include the first cell signal strength and the Nth cell signal strength.

[0061] In an embodiment, the processor of the electronic device 101 (eg, Figure 1The processor 120 may include various processing circuits and determine the radius of a specific space for which the one-dimensional virtual marker 201 is to be generated. The processor 120 may use the sensing module 176 to collect sensing values ​​within the radius of the specific space when the electronic device 101 is moved within the radius of the specific space.

[0062] In an embodiment, the processor 120 of the electronic device 101 can realize the image processing by using a camera (e.g., Figure 1 The camera 180 performs, for example but not limited to, image processing to estimate the relative position of the electronic device 101 so as to spatially match the specified space and the sensing value.

[0063] In an embodiment, a one-dimensional virtual marker 201 may be generated using the sensing value, but the embodiments of the present disclosure are not limited thereto, and thus the virtual marker may have a shape of a one-dimensional line, a two-dimensional plane, or a three-dimensional space.

[0064] In an embodiment, the one-dimensional virtual marker 201 may include movement information about the electronic device 101. The movement information may include a sensed value that changes when the electronic device 101 moves, the speed of the electronic device 101, and / or the direction of the electronic device 101. The one-dimensional virtual marker 201 may include characteristics of a designated space. When the electronic device 101 generates a one-dimensional virtual marker 201 indoors, the one-dimensional virtual marker 201 may reflect characteristics related to the shape of the indoor structure and / or the physical properties of objects arranged indoors. For example, the one-dimensional virtual marker 201 may reflect the shape of structures such as indoor steel frames, stairs, and / or walls. For another example, the one-dimensional virtual marker 201 may reflect the material properties of objects such as furniture arranged indoors.

[0065] In an embodiment, the one-dimensional virtual tag 201 may store magnetic field information reflecting indoor structure information. The one-dimensional virtual tag 201 may store acceleration values ​​and / or rotational motion information of the electronic device 101. The one-dimensional virtual tag 201 may store surrounding wireless signal information related to power consumption optimization. For example, the one-dimensional virtual tag 201 may store Wi-Fi signal information and / or cellular signal information. In the one-dimensional virtual tag 201, the first time timestamp 1 to the Nth time timestamp N may be stored as time values ​​set to measure sensing values ​​210, 220, 230, 240, and 250 (such as magnetic field information) in each specified period.

[0066] Figure 3 is a diagram 300 illustrating an example method of setting virtual markers 310 , 320 , and 330 at specific locations according to an embodiment.

[0067] In an embodiment, the virtual tags 310, 320, and 330 may be data corresponding to a specific location. For example, the virtual tags 310, 320, and 330 may be data corresponding to a small area, a detailed location, and / or a short path in a specific location. The virtual tags 310, 320, and 330 may be stored in an electronic device (e.g., Figure 1 of the electronic device 101) (e.g., Figure 1 The virtual markers 310, 320, and 330 may include, for example, but not limited to, magnetic sensing values ​​of a small area, a detailed location, and / or a short path (e.g., Figure 2 Magnetic sensing value 210), acceleration sensing value (for example, Figure 2 220), gyroscope sensing value (eg, Figure 2 gyroscope sensing value 230), a first wireless communication signal (eg, Figure 2 ) and / or a second wireless communication signal (e.g., Figure 2 a second wireless communication signal 250), etc.

[0068] In an embodiment, the magnetic sensing values ​​210, first wireless communication signal 240, and / or second wireless communication signal 250 for a small area, a detailed location, and / or a short path included in virtual markers 310, 320, and 330 may vary depending on the indoor structure. For example, the magnetic sensing values ​​210, first wireless communication signal 240, and / or second wireless communication signal 250 may vary depending on the frame and / or structural material of a building. For another example, the magnetic sensing values ​​210, first wireless communication signal 240, and / or second wireless communication signal 250 may vary depending on the shape and / or material of an object placed indoors.

[0069] In an embodiment, when the virtual markers 310, 320, and 330 correspond to a short path, the short path may have a length of approximately 30 cm to approximately 70 cm. The virtual markers 310, 320, and 330 may be data corresponding to a specific location indoors and / or an object arranged indoors. The virtual markers 310, 320, and 330 may include a first virtual marker 310, a second virtual marker 320, and / or a third virtual marker 330 corresponding to a specific location indoors and / or an object arranged indoors. For example, the user may define the first virtual marker 310 as a location in front of a mirror. For another example, the user may define the second virtual marker 320 as a location on the stairs. For another example, the user may define the third virtual marker 330 as a location in front of a room door.

[0070] Figure 4 is a diagram 400 illustrating an example method of setting virtual markers 410 , 420 , and 430 in a specific path according to an embodiment.

[0071] In an embodiment, the virtual markers 410, 420, and 430 may be data corresponding to a specific location. For example, the virtual markers 410, 420, and 430 may be data corresponding to a long path in a specific location. The virtual markers 410, 420, and 430 may be stored in an electronic device (e.g., Figure 1 of the electronic device 101) (e.g., Figure 1 The virtual markers 410, 420 and 430 may include, for example but not limited to, magnetic sensing values ​​of long paths (e.g., Figure 2 Magnetic sensing value 210), acceleration sensing value (for example, Figure 2 220), gyroscope sensing value (eg, Figure 2 gyroscope sensing value 230), a first wireless communication signal (eg, Figure 2 ) and / or a second wireless communication signal (e.g., Figure 2 a second wireless communication signal 250), etc.

[0072] In an embodiment, the magnetic sensing value 210, acceleration sensing value 220, gyroscope sensing value 230, first wireless communication signal 240, and / or second wireless communication signal 250 of a long path included in virtual markers 410, 420, and 430 may vary depending on the indoor structure. For example, the magnetic sensing value 210, first wireless communication signal 240, and / or second wireless communication signal 250 may vary depending on the shape of the path and / or the structure surrounding the path. For another example, the acceleration sensing value 220 and / or gyroscope sensing value 230 may vary depending on the speed of travel along the path and / or the direction of the electronic device 101 while traveling along the path.

[0073] In an embodiment, when virtual markers 410, 420, and 430 correspond to a long path, the long path may have a length of about 5 meters to about 20 meters. Virtual marker 410 may be data corresponding to a specific indoor traffic route. For example, virtual markers 410, 420, and 430 may be data corresponding to a traffic route starting from a first point 410, passing through a second point 420, and arriving at a third point 430. A user may define virtual markers 410, 420, and 430 as data indicating a continuous travel path, such as a traffic route starting from a starting point 410, passing through an internal path 420 of a building, and arriving at a destination point 430.

[0074] Figure 5 is a diagram 500 illustrating example sensed values ​​510 , 520 , 530 , 540 , and 550 measured on a two-dimensional plane mapped to a two-dimensional virtual marker 502 , according to an embodiment.

[0075] In an embodiment, the magnetic sensing value 510, the acceleration sensing value 520, the gyroscope sensing value 530, the first wireless communication signal 540 and / or the second wireless communication signal 550 may be sensed on a two-dimensional plane. Figure 2 The magnetic sensing value 510, acceleration sensing value 520, gyroscope sensing value 530, first wireless communication signal 540, and / or second wireless communication signal 550 are measured using a method substantially similar to the method of measuring the magnetic sensing value 210, acceleration sensing value 220, gyroscope sensing value 230, first wireless communication signal 240, and / or second wireless communication signal 250. The magnetic sensing value 510, acceleration sensing value 520, gyroscope sensing value 530, first wireless communication signal 540, and / or second wireless communication signal 550 may be included in a cell 501 of a two-dimensional virtual marker. The cell 501 of the two-dimensional virtual marker may be a unit area obtained by dividing a space defined by a specified size in which the two-dimensional virtual marker 502 is formed. The two-dimensional virtual marker 502 may be generated by combining the cells 501 of the two-dimensional virtual marker for each space.

[0076] In an embodiment, the virtual marker is not limited to one dimension and can be extended to a two-dimensional virtual marker 502 and / or a three-dimensional virtual marker. In the case of a two-dimensional virtual marker 502, sensing values ​​510, 520, 530, 540, and 550 (such as magnetic field information) measured in each cell 501 (cell 501 is a unit on a plane in a two-dimensional space) of the two-dimensional virtual marker can be mapped in the space. For example, a processor (e.g., Figure 1 The processor 120 of the electronic device 101 may map the sensed values ​​510, 520, 530, 540, and 550 to correspond to the indoor structure of the measured space. For another example, the processor 120 may map the sensed values ​​510, 520, 530, 540, and 550 to correspond to the average value of each cell 501 of the two-dimensional virtual marker based on the measured traffic line length and / or cell size. The processor 120 of the electronic device 101 may generate a two-dimensional virtual marker 502 by mapping the measured sensed values ​​510, 520, 530, 540, and 550 onto a two-dimensional plane. The two-dimensional virtual marker 502 to which the sensed values ​​510, 520, 530, 540, and 550 measured on the two-dimensional plane are mapped may be digitized and displayed for each cell within the plane.

[0077] Figure 6 is a diagram 600 illustrating example imaging data of two-dimensional virtual markers 610 , 620 , and 630 generated using magnetic field values ​​Mag_X, Mag_Y, and Mag_Z measured by the electronic device 101 , according to an embodiment.

[0078] like Figure 6As shown, the magnetic field values ​​Mag_X, Mag_Y, and Mag_Z measured in the X-axis, Y-axis, and Z-axis directions of the electronic device 101 may have different values ​​depending on the position in the two-dimensional space. Therefore, when the electronic device 101 moves in space, for each direction of travel, a different pattern may be presented for each axis direction. The processor of the electronic device 101 (e.g., Figure 1 The processor 120) can improve not only the detection precision but also the detection accuracy by comparing all values ​​of the three axes (e.g., X, Y, and Z axes), thereby reducing the possibility of false detection of the two-dimensional virtual markers 610, 620, and 630.

[0079] In an embodiment, the processor 120 of the electronic device 101 can use the magnetic field sensor of the sensor module 176 to measure the X-axis magnetic field intensity Mag_X, the Y-axis magnetic field intensity Mag_Y, and the Z-axis magnetic field intensity Mag_Z on a two-dimensional plane (XY plane). The display device of the electronic device 101 (for example, Figure 1 The display device 160 of the electronic device 101 can generate two-dimensional virtual markers 610, 620, and 630 based on the magnetic field value measured by the sensor module 176. For example, the two-dimensional virtual markers 610, 620, and 630 can be used for each of the X, Y, and Z axis components. For example, the electronic device 101 can store the two-dimensional virtual markers 610, 620, and 630 in a memory (e.g., Figure 1 For another example, the electronic device 101 may image the magnetic field value of each of the X, Y, and Z axis components to confirm the two-dimensional virtual markers 610, 620, and 630.

[0080] When using the above virtual tags (e.g. Figure 2 One-dimensional virtual marker 201 and / or Figure 5 When the electronic device 101 provides location-based services, the electronic device 101 can provide indoor location services that do not require additional data (such as indoor maps and / or fingerprint maps) and / or additional infrastructure (such as Bluetooth beacons). The virtual tags 201 and 502 can operate based on signals measured by the electronic device 101 at any indoor location without requiring preliminary tasks and / or infrastructure installation. For example, the pre-generated virtual tags 201 and 502 can be stored in a memory (e.g., Figure 1130). The electronic device 101 may use the sensor module 176 to measure signals. For example, the sensor module 176 may measure the magnetic sensing value 210 and the magnetic sensing value 510, the acceleration sensing value 220 and the acceleration sensing value 520, the gyroscope sensing value 230 and the gyroscope sensing value 530, the first wireless communication signal 240 and the first wireless communication signal 540, and / or the second wireless communication signal 250 and the second wireless communication signal 550. For example, the sensing values ​​210, 220, 230, 240, 250, 510, 520, 530, 540, and 550 may include cellular signals, Wi-Fi signals, magnetic field values, and / or images captured by the camera 180. The processor of the electronic device 101 (e.g., Figure 1 The processor 120) can detect the positions corresponding to the virtual marker 201 and the virtual marker 502 by comparing the virtual marker 201 and the virtual marker 502 stored in the memory 130 with the signal measured by the sensor module 176.

[0081] When the electronic device 101 moves within a fixed range during a fixed time at an arbitrary location, the virtual marker 201 and the virtual marker 502 according to an embodiment can reflect the signal characteristics that change due to the measured signal and / or specific objects arranged indoors by reflecting the characteristics of the indoor structure. The virtual marker 201 and the virtual marker 502 may include movement information related to the movement of the electronic device 101. For example, the virtual marker 201 and the virtual marker 502 may be data including coordinate information corresponding to the movement of the electronic device 101 using a specific space and / or object as a reference index and / or the current position of the electronic device 101 relative to the space and / or object. The processor 120 may provide a service structure for detecting and / or confirming whether an object and / or electronic device arranged in a space corresponding to the virtual marker 201 and the virtual marker 502 enters the space corresponding to the virtual marker 201 and the virtual marker 502.

[0082] Figure 7 is a flow chart 700 illustrating an example framework of the virtual badge 201 and the virtual badge 502 according to an embodiment.

[0083] In an embodiment, the processor 120 of the electronic device 101 may perform a virtual marker generation operation 710. The processor 120 may generate a first virtual marker corresponding to a first location that is the current location of the electronic device 101 using sensing data including, for example but not limited to, a magnetic signal, movement of the electronic device, acceleration of the electronic device, and / or an angular direction formed by the electronic device and the ground.

[0084] In an embodiment, when generating the virtual marker 201 and the virtual marker 502, the processor 120 may determine, for example, the radius of a specific space in which the virtual marker 201 and the virtual marker 502 will be generated. The processor 120 may use the sensor module 176 to collect sensing values ​​within the radius by moving the electronic device 101 within the radius (for example, Figure 2 The sensed values ​​210, 220, 230, 240 and 250 and / or Figure 5 The processor 120 may estimate a first position as the current position of the electronic device 101 using, for example, a camera 180 that supports a spatial matching technique between a determined space and the measured sensing values ​​210, 220, 230, 240, 250, 510, 520, 530, 540, and 550. The electronic device 101 may recognize features in an image obtained using the camera 180. For example, when generating a virtual marker, the processor 120 of the electronic device 101 may identify feature points (e.g., Figure 3 The processor 120 may perform processing to specify an arbitrary reference point in the obtained image. The processor 120 may estimate the distance traveled by the electronic device 101 based on the reference point. The processor 120 may estimate traffic routes (e.g., Figure 4 The electronic device 101 may be moved from one point to another in an indoor location along the traffic route (i.e., a traffic route starting from a starting point 410, passing through an internal path 420 of a building, and reaching a destination 430). The processor 120 may measure the degree of movement at each designated time period. The processor 120 may spatially sort the sensed values ​​associated with the measured degree of movement.

[0085] In an embodiment, the processor 120 of the electronic device 101 may perform a virtual token registration operation 720. The processor 120 may store the first virtual token in a memory (eg, Figure 1 The first virtual tag stored in the memory 130 may be registered in a virtual tag list in the memory 130.

[0086] In an embodiment, the processor 120 of the electronic device 101 may perform a virtual tag loading operation 730. After generating the virtual tag 201 and the virtual tag 502, the processor 120 may store the virtual tag 201 and the virtual tag 502 in the memory 130 and register them in the virtual tag list. The processor 120 may load the virtual tag 201 and the virtual tag 502 so as to detect the registered virtual tag 201 and the virtual tag 502. For example, when executing an application (e.g., Figure 1 When the electronic device 101 requests an application 146 to execute an event corresponding to the registered virtual tags 201 and 502, the electronic device 101 may load the virtual tags 201 and 502. For another example, when it is confirmed that the processor 120 has entered a fixed radius from the location corresponding to the registered virtual tags 201 and 502, the virtual tags 201 and 502 may be loaded. For another example, when a notification regarding a service related to the location for which the virtual tags 201 and 502 have been registered is received, the processor 120 may load a virtual tag to be detected from the memory 130 among the virtual tags registered in the virtual tag list.

[0087] In an embodiment, the processor 120 of the electronic device 101 may perform a surrounding virtual marker detection operation 740. To confirm whether entry into the first location has been performed after registering a virtual marker to be detected, the processor 120 may confirm whether entry within a fixed radius from the first location has been performed.

[0088] In an embodiment, in order to confirm whether entry into a fixed radius from the virtual marker 201 and the virtual marker 502 has been performed, the processor 120 may use a wireless communication signal (such as a cellular signal and / or a Wi-Fi signal) that can be continuously received and does not require additional power consumption to be sent / received. The processor 120 may use the wireless communication circuit 192 to detect whether entry into a fixed radius from the first location has been performed from a relatively wide radius. When it is confirmed that the electronic device 101 has entered within the fixed radius from the first location, the processor 120 may operate at least a portion of the sensors of the sensor module 176 for generating the virtual marker 201 and the virtual marker 502. For example, when the electronic device 101 has entered within the fixed radius from the first location, the processor 120 may operate the sensor required to detect the first virtual marker among the sensors of the sensor module 176.

[0089] In an embodiment, the processor 120 of the electronic device 101 may perform the sensing value processing operation 750. The processor 120 may measure the sensing values ​​210, 220, 230, 240, 250, 510, 520, 530, 540, and 550 within a fixed radius using the sensor module 176.

[0090] In an embodiment, the processor 120 may correct errors in the sensing values ​​210, 220, 230, 240, 250, 510, 520, 530, 540, and 550 that may occur due to the movement of the electronic device 101. The processor 120 may classify and compare information included when the virtual marker 201 and the virtual marker 502 are generated and information measured when the virtual marker 201 and the virtual marker 502 are detected, so as to correct errors in the sensing values ​​210, 220, 230, 240, 250, 510, 520, 530, 540, and 550 that have changed due to the movement of the electronic device 101.

[0091] In an embodiment, the processor 120 of the electronic device 101 may perform a virtual marker detection operation 760. The processor 120 may confirm whether the first position has been performed by comparing the measured sensed value with the sensed data of the first virtual marker. The processor 120 may compare the sensed values ​​210, 220, 230, 240, 250, 510, 520, 530, 540, and 550 corrected after real-time measurement with the sensed data of the generated virtual markers 201 and 502, and may provide a specified service when the sensed value matches the sensed data. For example, the processor 120 may be configured to execute an event designated to be executed by the electronic device 101 at the first position or request a specified service when any virtual marker matches the first virtual marker.

[0092] Figure 8 is a diagram 800 illustrating example operations of registering, storing, and / or loading a virtual badge 810 according to an embodiment.

[0093] In an embodiment, the processor 120 of the electronic device 101 may generate, register, store and / or load a virtual tag 810. The processor 120 may include a virtual tag generation unit (e.g., including a processing circuit and / or an executable program element) 820 and a virtual tag manipulation unit (e.g., including a processing circuit and / or an executable program element) 830. The virtual tag generation unit 820 may perform the virtual tag generation operation 710. The virtual tag manipulation unit 830 may perform the virtual tag registration operation 720 and perform the virtual tag loading operation 730. The memory 130 may include a virtual tag local repository 840. For example, the virtual tag local repository 840 may be a storage space included in the memory 130 of the electronic device 101. The electronic device 101 may be connected to a virtual tag remote repository 850. The virtual tag remote repository 850 may be, for example, a wireless communication module (e.g., Figure 1 wireless communication module 192) of the server (eg, Figure 1 server 103).

[0094] In an embodiment, the processor 120 may register and / or store the generated virtual tag 810 in a virtual tag list. The virtual tag list may exist in a virtual tag local repository 840 and / or a virtual tag remote repository 850.

[0095] In an embodiment, the processor 120 may load a virtual tag 810 registered and / or stored in the virtual tag list. The processor 810 may load the virtual tag 810 from a virtual tag local repository 840 and / or a virtual tag remote repository 850.

[0096] In an embodiment, the virtual tag local repository 840 may transmit the virtual tag 810 to the virtual tag remote repository 850. The virtual tag remote repository 850 may store the transmitted virtual tag 810. The virtual tag 810 stored in the virtual tag remote repository may be shared with an external electronic device. The virtual tag remote repository 850 may perform a first sharing operation to share the registered and / or stored virtual tag 810 with the external electronic device.

[0097] In an embodiment, the processor 120 may download the virtual token registered by the external electronic device and stored in the virtual token remote repository 850. The processor 120 may perform a second sharing for sharing the virtual token registered by the external electronic device.

[0098] Figure 9 is a block diagram 900 illustrating an example virtual badge platform 910 according to an embodiment.

[0099] The virtual tagging platform 910 may store information in a memory (e.g., Figure 1 The virtual tagging platform 910 may include one or more instructions. The processor (e.g., Figure 1 The processor 120 of the processor 120 can load the virtual tag platform 910 from the memory 130 and execute the virtual tag platform 910. The virtual tag platform 910 according to an embodiment may include a receiving unit (e.g., including a receiving circuit) 911, a virtual tag generating unit (e.g., including a generating circuit) 912, a virtual tag detecting unit (e.g., including a detecting circuit) 913, a storage unit 914, and a control unit (e.g., including a control circuit or a processing circuit) 915.

[0100] According to an embodiment, the receiving unit 911 may include various circuits and receive sensing data from the sensor 920. The sensing data may include, for example but not limited to, magnetic signals, electronic devices (e.g., Figure 1 The movement of the electronic device 101), the acceleration of the electronic device 101 and / or the angular direction of the electronic device 101 relative to the ground, etc.

[0101] In an embodiment, the receiving unit 911 may collect sensing data and provide it to the virtual marker generating unit 912 and / or the virtual marker detecting unit 913. The receiving unit 911 may collect data from sensors 920 including magnetic field sensors, accelerometers, and / or gyroscope sensors.

[0102] In an embodiment, the receiving unit 911 may use the movement information about the electronic device 101 to correct the sensing data so as to use the sensing data when generating and / or detecting a virtual marker (e.g., the virtual marker 810). The receiving unit 911 may generate information such as the direction and / or posture of the electronic device 101 from the collected sensing data, and provide the generated information to the virtual marker generating unit 912 and / or the virtual marker detecting unit 913 to provide necessary information and / or effective information for generating and / or detecting the virtual marker 810.

[0103] In an embodiment, the virtual marker generation unit 912 may include various circuits and generate a first virtual marker corresponding to a first location that is the current location of the electronic device 101 using the sensing data. The virtual marker generation unit 912 may receive a request for generating a virtual marker 810 from the control unit 915. The virtual marker generation unit 912 may generate the first virtual marker according to a specified format based on the sensing data (such as magnetic field information provided from the receiving unit 911, movement information about the electronic device 101, and / or an image captured by the augmented reality-supporting camera 180). The virtual marker generation unit 912 may request the control unit 915 to register the generated virtual marker 810.

[0104] In an embodiment, the virtual tag detection unit 913 may include various circuits and detect any virtual tag. The virtual tag detection unit 913 may detect a virtual tag 810 corresponding to the virtual tag 810 requested from the control unit 915. When the virtual tag 810 requested from the control unit 915 is detected, the virtual tag detection unit 913 may transmit a result related to the detected virtual tag 810 to the control unit 915.

[0105] In an embodiment, the storage unit 914 may store the first virtual tag. The storage unit 914 may include a virtual tag local repository 840. The virtual tag local repository 840 may be a physical or logical portion of the memory 130. For example, the virtual tag local repository 840 may be a physically allocated portion of the memory, or may be defined as a logical memory address value. The virtual tag remote repository 850 may be a server external to the electronic device 101 (e.g., Figure 1 server 103).

[0106] In an embodiment, the control unit 915 may include various processing circuits or control circuits, and registers the virtual tag 810 by requesting the virtual tag local repository 840 and / or the virtual tag remote repository 850 to register the virtual tag 840. The control unit 915 may load the stored virtual tag list and / or the stored virtual tag by sending a request to the virtual tag local repository 840 and / or the virtual tag remote repository 850 to load the stored virtual tag list and / or the stored virtual tag.

[0107] In an embodiment, the virtual tag 810 may be registered in the virtual tag local repository 840 and / or the virtual tag remote repository 850 depending on whether the virtual tag 810 is used only in the electronic device 101 that has generated the virtual tag 810 or in an external electronic device. It may be necessary to register the virtual tag 810 in the virtual tag remote repository 850 in order to use the virtual tag 810 also in an external electronic device.

[0108] In an embodiment, the control unit 915 may register the first virtual tag, may detect any virtual tag, and may load the first virtual tag from the storage unit 914. The control unit 915 may control signals and / or pieces of information sent / received in the virtual tag platform 910.

[0109] In an embodiment, the service 930 may include, for example, functionality related to the detection of a virtual marker 810 in the electronic device 101. The service 930 may include an application (e.g., application 146) that is executed at the location where the virtual marker 810 is detected, or functionality (or operations) provided by the application 146. For example, the service 930 may include a fitness application that is configured to be executed at the entrance of a fitness center where the electronic device 101 detects the virtual marker 810. The service 930 may include notifications for notifying of events that occur at the location where the virtual marker 810 is detected. For example, the service 930 may notify the electronic device 101 that it has entered the entrance of a shopping mall via a push notification. The service 930 may include functionality for performing authentication or changing the operation of the application 146 when the virtual marker 810 is detected. For example, when the electronic device 101 arrives at the checkout, the service 930 may change the state of the payment application to a payment ready state and may display instructions for guiding the user to perform authentication.

[0110] In an embodiment, the control unit 915 may provide a service 930 mapped to the location where the virtual marker 810 is detected. For example, when it is detected that the electronic device 101 enters the location where the virtual marker 810 has been generated, the control unit 915 may execute the service 930. For another example, when it is detected that the electronic device 101 enters the location where the virtual marker 810 has been generated, the control unit 915 may send a control signal to the service 930 for requesting execution of a specified event.

[0111] In an embodiment, the virtual tagging platform 910 may not include Figure 9 At least one of the components shown in , may include another component not shown, or may include a combination of multiple components. For example, the storage unit 914 may be a component separate from the virtual tagging platform 910.

[0112] Figure 10 is a signal flow diagram 1000 illustrating an example process of registering virtual tokens 1001 and 1009 according to an embodiment.

[0113] In operation 1003, the control unit 915 according to an embodiment may request the virtual tag local repository 840 to locally register the private tag 1001. In operation 1005, the virtual tag local repository 840 may register the private tag 1001. In operation 1007, the virtual tag local repository 840 may notify the control unit 915 of the registration of the private tag 1001.

[0114] In operation 1011, the control unit 915 according to an embodiment may request the virtual tag local repository 840 to remotely register the shared tag 1009. In operation 1013, the virtual tag local repository 840 may register the shared tag 1009. The virtual tag local repository 840 may transfer the shared tag 1009 to the virtual tag remote repository 850. In operation 1015, the virtual tag remote repository 850 may register the shared tag 1009. In operation 1017, the virtual tag remote repository 850 may notify the virtual tag local repository 840 of the registration of the shared tag 1009. In operation 1019, the virtual tag local repository 840 may notify the control unit 915 of the registration of the shared tag 1009.

[0115] In an embodiment, the private tag 1001 and the shared tag 1009 may include the same data. The private tag 1001 and the shared tag 1009 may be distinguished based on whether the tag is determined to be shared with another electronic device. The shared tag 1009 may be data that can be shared with another electronic device or determined to be shared with another electronic device. The shared tag 1009 may be registered in the virtual tag remote repository 850 for sharing with another electronic device.

[0116] Figure 11 is a signal flow diagram 1100 illustrating an example process of loading a virtual tag 1101 and a virtual tag 1111 according to an embodiment.

[0117] The virtual tags 1101 and 1111 according to an embodiment may include a private tag 1101 and a shared tag 1111 . Figure 11 The private tag 1101 and the shared tag 1111 can be used with Figure 10 The private mark 1001 and the private mark 1009 are substantially the same or similar.

[0118] In operation 1103, the control unit 915 according to an embodiment may request a private tag list from the virtual tag local repository 840. In operation 1105, the virtual tag local repository 840 may transmit the private tag list to the control unit 915. The control unit 915 may confirm whether the private tag list in the virtual tag local repository 840 includes the private tag 1101. In operation 1107, the control unit 915 may request a private tag from the virtual tag local repository 840. In operation 1109, the virtual tag local repository 840 may transmit the private tag to the control unit 915. The control unit 915 may confirm whether the private tag 1101 matches a private tag stored in the virtual tag local repository 840.

[0119] In operation 1113, the control unit 915 according to an embodiment may request a shared tag list from the virtual tag local repository 840. In operation 1115, the virtual tag local repository 840 may request a shared tag list from the virtual tag remote repository 850. In operation 1117, the virtual tag remote repository 850 may transmit the shared tag list to the virtual tag local repository 840. In operation 1119, the virtual tag local repository 840 may transmit the shared tag list to the control unit 915. The control unit 915 may confirm whether the shared tag 1111 is included in the shared tag list of the virtual tag remote repository 850.

[0120] In operation 1121, the control unit 915 according to an embodiment may request a shared tag from the virtual tag local repository 840. In operation 1123, the virtual tag local repository 840 may confirm the local tag list. In operation 1125, the virtual tag local repository 840 may confirm that the shared tag does not exist in the local tag list and may transmit the shared tag request to the virtual tag remote repository 850. In operation 1127, the virtual tag remote repository 850 may transmit the shared tag to the virtual tag local repository 840. In operation 1129, the virtual tag local repository 840 may transmit the shared tag to the control unit 915. The control unit 915 may confirm whether the shared tag 1111 matches the shared tag stored in the virtual tag remote repository 850.

[0121] Figure 12 is a diagram illustrating a virtual tagging platform (e.g., Figure 9 The virtual tag platform 910) detects the virtual tag (e.g., Figure 8 Illustration 1200 of an example operation of a virtual tag 810).

[0122] In an embodiment, in operation 1201 , the service 930 may request the control unit 915 to generate the virtual badge 810 . In operation 1203 , the control unit 915 may request the virtual badge generation unit 912 to generate the virtual badge 810 .

[0123] In an embodiment, at operation 1205, the receiving unit 911 may obtain the sensing data and transmit the sensing data to the virtual marker generating unit 912. The virtual marker generating unit 912 may generate the virtual marker 810. For example, the virtual marker generating unit 912 may generate an indication electronic device (e.g., Figure 1 In operation 1207, the virtual marker generating unit 912 may notify the control unit 915 that the generation of the virtual marker 810 is complete. In operation 1209, the control unit 915 may register the virtual marker 810 in a storage unit (e.g., Figure 9 In operation 1211, the control unit 915 may notify the service 930 that the generation of the virtual marker 810 is completed.

[0124] In an embodiment, at operation 1213, the service 930 may request a list of virtual tags from the control unit 915. At operation 1215, the control unit 915 may request a list of virtual tags from a repository (e.g., Figure 8 The control unit 915 may load the virtual tag list 810 from the virtual tag local repository 840 and / or the virtual tag remote repository 850 of the virtual tag server 810. In operation 1217, the control unit 915 may transmit the virtual tag list to the service 930.

[0125] In an embodiment, at operation 1219, the service 930 may request the control unit 915 to register for virtual badge notifications. The virtual badge notification may include a method for requesting the virtual badge platform (e.g., Figure 9 In operation 1227, when the acquired sensing data corresponds to a virtual tag registered in the virtual tag list, the virtual tag detection unit 913 may notify the control unit 915 of the detection of the virtual tag. In operation 1229, the control unit 915 may notify the service 930 of the registered virtual tag. For example, the control unit 915 may notify the electronic device 101 that it has entered a first position corresponding to a first virtual tag that is a registered virtual tag.

[0126] Figure 13is a diagram showing an electronic device (eg, Figure 1 Flowchart of example operations of an electronic device 101) generating a first virtual tag and detecting the virtual tag to perform a specified event or request a specified service.

[0127] At operation 1310 , the processor 120 of the electronic device according to an embodiment may receive sensing data including a magnetic signal, movement of the electronic device, acceleration of the electronic device, and / or an angular direction of the electronic device relative to the ground.

[0128] For example, services (e.g. Figure 9 The service 930) may request the control unit (e.g., Figure 9 The control unit 915 of the control unit 915) generates a virtual marker for a specific space (such as a position in front of the front door and / or a position in front of the refrigerator). The control unit 915 may request the virtual marker generating unit (e.g., Figure 9 The virtual tag generating unit 912) generates a virtual tag.

[0129] At operation 1320, the processor 120 of the electronic device 101 according to an embodiment may generate a first virtual marker corresponding to a first location using the sensing data, wherein the first location corresponds to the current location of the electronic device 101. The virtual marker generation unit 912 may request the control unit 915 to register the first virtual marker.

[0130] The processor 120 of the electronic device 101 according to an embodiment may register the first virtual token at operation 1330. When the service 930 makes a request, the control unit 915 may request a notification about the registered first virtual token.

[0131] For example, the first virtual marker may be registered to perform a specific service (such as a notification in a reminder application and / or a specific operation in a Bixby routine, for example). The service 930 may request the electronic device 101 to perform a specified operation when entering a corresponding place.

[0132] At operation 1340 , the processor 120 of the electronic device 101 according to an embodiment may detect any virtual marker.

[0133] For example, the control unit 915 that has received the notification request from the service 930 may control the virtual badge detection unit 913 to detect the corresponding virtual badge. The virtual badge detection unit 913 may detect the corresponding virtual badge based on the notification request from the receiving unit (e.g., Figure 9 The receiving unit 911) determines whether the electronic device 101 has entered the first position based on the sensing data received.

[0134] At operation 1350, when any virtual tag matches the first virtual tag, the processor 120 of the electronic device 101 according to an embodiment may execute an event designated to be executed by the electronic device 101 at the first location or request a designated service. When the first virtual tag is detected, the virtual tag detection unit 913 may notify the control unit 915 of the detection. The control unit 915 may execute a designated operation or may notify the service 930 of the detection of the first virtual tag.

[0135] Refer to above Figure 13 The description given relates to the case where a notification event (such as, for example, a reminder and / or a Bixby routine) is executed in response to entering the first location by way of example. However, the embodiment is not limited to this case, and thus the notification event (such as, for example, a reminder and / or a Bixby routine) may be executed in response to entering the first location. Figure 8 Virtual tag 810) identifies the object to perform a specified event.

[0136] In an embodiment, a specific location in a vehicle (such as a car audio system) may be registered as a virtual marker 810. When the electronic device 101 is located at a location where the virtual marker 810 has been registered, a specific application (such as a navigation application or a music application) may be executed.

[0137] In an embodiment, when the service 930 requests the virtual tag 810 to identify a specific space and identify a specific object, the virtual tag platform (e.g., Figure 9 For example, when the service 930 requests the virtual tag 810 to identify a specific space, the control unit 915 may request the receiving unit (e.g., Figure 9 The receiving unit 911 of the control unit 915 collects as much information as possible about the location where the electronic device 101 may pass. For another example, when the service 930 requests the virtual marker 810 to identify a specific object, the control unit 915 can request the receiving unit 911 to collect information about the form surrounding the specific object when generating the virtual marker 810.

[0138] In an embodiment, when the service 930 requests recognition of a specific space during the process of detecting the virtual marker 810, the control unit 915 may request the virtual marker detection unit 913 to detect whether the electronic device 101 passes through the specific space while moving. When the service 930 requests recognition of a specific object during the process of detecting the virtual marker 810, the control unit 915 may request the virtual marker detection unit 913 to detect an intentional action of the user to bring the electronic device 101 into contact with the periphery of the specific object.

[0139] In an embodiment, a virtual tagging platform (e.g., Figure 9Virtual tag platform 910) to implement various services such as advertising in shopping malls (e.g., Figure 9 For example, the location in front of a specific item display shelf in a shopping mall can be registered as a virtual marker (e.g., Figure 8 When any electronic device enters a location where the virtual tag 810 is registered, the service 930 may notify the user of the any electronic device of information about the corresponding item or related marketing information.

[0140] In an embodiment, the service 930 may request a control unit (e.g., Figure 9 The control unit 915) pre-generates a shared tag (eg, Figure 10 In response to the request, the control unit 915 may allow the virtual tag generation unit (eg, Figure 9 The control unit 915 can generate a shared tag 1009 in a virtual tag remote repository (e.g., Figure 8 The shared tag 1009 generated by registration in the virtual tag remote repository 850).

[0141] In an embodiment, any electronic device may download the shared marker 1009. Any electronic device may register a virtual marker list so that the virtual marker detection unit 913 may detect the shared marker 1009. When any electronic device detects the shared marker 1009, the any electronic device may receive a notification indicating that the any electronic device has entered a location where the shared marker 1009 is set. As described above, by an electronic device (e.g., Figure 1 The shared mark 1009 generated by the electronic device 101) can be shared to be detected by any electronic device.

[0142] Figure 14 is a diagram showing an electronic device (eg, Figure 1 The electronic device 101 receives the sensing data and generates and stores a first virtual marker (eg, Figure 8 Flowchart 1400 of example operations of a virtual tag 810).

[0143] At operation 1410 , the processor 120 of the electronic device 101 according to an embodiment may receive sensing data including a magnetic signal, movement of the electronic device 101 , acceleration of the electronic device 101 , and / or an angular direction of the electronic device 101 relative to the ground.

[0144] At operation 1420 , the processor 120 of the electronic device 101 according to an embodiment may generate a first virtual marker 810 corresponding to a first position using the sensing data, wherein the first position corresponds to the current position of the electronic device 101 .

[0145] At operation 1430, the processor 120 of the electronic device 101 according to an embodiment may store the first virtual marker 810. The processor 120 may store the generated first virtual marker 810 in a memory (eg, Figure 1 Memory 130) and / or storage unit (e.g., Figure 9 in storage unit 914).

[0146] According to various exemplary embodiments, electronic devices (eg, Figure 1 The electronic device 101 may include: a sensor module (eg, Figure 1 The sensor module 176 includes at least one sensor configured to detect sensing data including magnetic signals, movement of the electronic device, acceleration of the electronic device, and / or angular direction of the electronic device relative to the ground; a memory (e.g., Figure 1 Memory 130 ) configured to store the virtual tagging platform (e.g., Figure 9 Virtual tagging platform 910); and processor ( Figure 1 a processor 120 operably connected to the sensor module and the memory, wherein the processor can be configured to control the electronic device to perform the following operations: receive sensing data from the sensor module, generate a first virtual tag corresponding to a first location using the sensing data, wherein the first location corresponds to the current location of the electronic device; store the first virtual tag in the memory; detect any virtual tag; load the first virtual tag from the memory; and based on the matching of any virtual tag with the first virtual tag, request a specified service and / or execute an event specified to be executed by the electronic device at the first location.

[0147] In example embodiments, the sensing data may include features caused by an object disposed in the indoor space and / or a structure of the indoor space using a magnetic signal measured when the electronic device 101 moves within a fixed range during a fixed time in the indoor space.

[0148] In example embodiments, the sensing data may include magnetic field values ​​(eg, Figure 2 Magnetic sensing value 210), Wi-Fi value (for example, Figure 2 The first wireless communication signal 240), the cellular value (eg, Figure 2 a second wireless communication signal 250) and / or by a camera of the electronic device (e.g., Figure 1 The image is captured by the camera module 180).

[0149] In an example embodiment, the processor may be configured to generate a first virtual marker for identifying a specific space and / or an object arranged in the specific space using the sensing data.

[0150] In an example embodiment, the processor may be configured to map the sensing data to a specific space and / or an object arranged in the specific space using augmented reality technology based on storing the first virtual marker.

[0151] In example embodiments, the sensing data may include sensing values ​​of an accelerometer and / or a gyro sensor included in the sensor module based on movement of the electronic device (eg, Figure 2 The acceleration sensing value 220 and / or the gyroscope sensing value 230) and / or movement information about the electronic device based on the sensing values.

[0152] In an embodiment, the memory may include a virtual tag local repository (e.g., Figure 8 The processor may be configured to perform a first sharing and a second sharing, wherein the first sharing is used to register the first virtual tag as a shared virtual tag (eg, Figure 10 The second virtual tag is used to share a second virtual tag generated in the external electronic device and registered as a shared virtual tag, and the storage unit can be configured to store data in a virtual tag local repository and / or a server outside the electronic device (for example, Figure 1 The first virtual tag is registered in the server 103) to perform the first sharing and / or the second sharing.

[0153] In example embodiments, the first virtual marker may include one-dimensional, two-dimensional, and / or three-dimensional information and information about the speed at which the electronic device passes through the space.

[0154] In an example embodiment, based on any virtual tag matching the first virtual tag, the processor may be configured to execute a specified event in a virtual tag list stored in the memory and / or may be configured to load the first virtual tag for requesting a specified service.

[0155] In an example embodiment, based on the electronic device being within a fixed radius from the first location, the processor may be configured to turn on the sensor module and may be configured to store features of the first location and / or an object disposed at the first location to detect entry into the first location or approaching the object.

[0156] In example embodiments, the processor may be configured to classify and / or correct errors in sensing values ​​due to rotation and / or movement of the electronic device measured from any virtual marker for comparison with the first virtual marker.

[0157] For detecting a virtual marker (e.g., Figure 2 Virtual Mark 201 and / or Figure 5The method of registering a virtual marker 502) may include: using sensing data including a magnetic signal, movement of the electronic device, acceleration of the electronic device and / or an angular direction of the electronic device relative to the ground to generate a first virtual marker corresponding to a first position as the current position of the electronic device, storing the first virtual marker, loading a virtual marker list including the registered first virtual marker, confirming whether the electronic device is within a fixed radius from the first position, measuring a sensing value within the fixed radius from the first position, and confirming whether the electronic device has entered the first position by comparing the sensing value with the first virtual marker.

[0158] In example embodiments, measuring the sensing value may include correcting an error due to rotation and / or movement of the electronic device.

[0159] In an example embodiment, the method may further include executing an event specified by the electronic device to be executed at the first location and / or requesting a service specified based on the electronic device entering the first location.

[0160] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those described above.

[0161] It should be understood that various embodiments of the present disclosure and the terms used therein are not intended to limit technically described features to particular embodiments and include various changes, equivalents, or replacements for a corresponding embodiment. With regard to the description of the drawings, like reference numerals can be used to refer to like or similar elements. It is to be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. As used herein, each of the phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C," can include any one of the items enumerated together with all possible combinations of the items. As used herein, the terms "first," "second," "third," "fourth," "fifth," "sixth," and the like, do not limit the number or order of the constituent elements. Rather, these terms are used to identify particular elements in a specific example, and these particular elements need not be present in other examples or used in the specific order. It will be understood that if an element is referred to as being "connected to" or "coupled to" another element, it can be directly connected to or coupled to the other element or connected to or coupled to the other element via a third element.

[0162] As used herein, the term "module" can include a unit implemented in hardware, software, or firmware, and can interchangeably be used with other terms, for example, "logic," "logic block," "part," or "circuitry." The module can be a single integral component, or a minimum unit or part thereof, adapted to perform one or more functions. For example, according to an embodiment, the module can be implemented in a form of an application-specific integrated circuit (ASIC).

[0163] The various embodiments described herein can be implemented as software (e.g., program 140) comprising one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) can call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to be operable to perform at least one function according to the called at least one instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The machine-readable storage medium can be provided in the form of a non-transitory storage medium. The term "non-transitory" only means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.

[0164] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disc read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store). TM ) The computer program product may be published online (e.g., downloaded or uploaded) or may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smartphones). If published online, at least part of the computer program product may be temporarily generated or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).

[0165] According to various embodiments, each component (for example, module or program) in the above-mentioned components may include a single entity or multiple entities. According to various embodiments, one or more components in the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (for example, module or program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each component in the multiple components in the same or similar manner as a corresponding component in the multiple components before integration. According to various embodiments, the operations performed by module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operations may be run or omitted in different orders, or one or more other operations may be added.

Claims

1. An electronic device comprising: camera; A sensor module comprising at least one sensor; Memory; as well as Processor, connected to the camera, sensor module and memory, The processor is configured to control the electronic device to perform the following operations: detecting sensing data by a sensor module, wherein the sensing data includes a magnetic signal; Capturing images via a camera; estimating a first location corresponding to a current location of the electronic device based on image processing of the captured image; generating a first virtual marker corresponding to a first position corresponding to a current position of the electronic device using at least the sensing data and the estimated first position, wherein the first virtual marker includes a first plurality of magnetic sensing values ​​of magnetic fields corresponding to the first position for three different axis directions; storing the first virtual token in a memory; detecting whether entry into a fixed radius from a first location has been performed based on a wireless communication signal received by the electronic device when the sensor module is turned off; Upon confirming that the electronic device enters within a fixed radius from the first location: Turn on the sensor module; detecting an arbitrary virtual marker based on sensing data detected by the sensor module, wherein the arbitrary virtual marker includes a second plurality of magnetic sensing values ​​for magnetic fields in the three different axis directions; Correcting errors in the second plurality of magnetic sensing values ​​measured from the arbitrary virtual markers due to rotation and movement of the electronic device, wherein correcting the errors in the second plurality of magnetic sensing values ​​comprises classifying and comparing the first plurality of magnetic sensing values ​​and the second plurality of magnetic sensing values ​​to obtain corrected second plurality of magnetic sensing values; loading a first virtual tag from memory; and Based on the second plurality of corrected magnetic sensing values ​​of the arbitrary virtual marker matching the first plurality of magnetic sensing values ​​of the first virtual marker, a notification event associated with the first location is performed.

2. The electronic device according to claim 1, wherein The sensing data includes features caused by an object disposed in the indoor space and / or a structure of the indoor space using a magnetic signal measured based on the electronic device moving within a fixed range during a fixed time in the indoor space.

3. The electronic device according to claim 1, wherein: The sensing data includes a magnetic field value, a Wi-Fi value, a cellular value, and / or an image captured by a camera of the electronic device.

4. The electronic device according to claim 1, wherein The processor is configured to generate a first virtual marker for identifying a specific space and / or an object arranged in the specific space using the sensing data.

5. The electronic device according to claim 1, wherein The processor is configured to map the sensed data to a specific space and / or an object arranged in the specific space using augmented reality (AR) technology based on storing the first virtual marker.

6. The electronic device according to claim 1, wherein The sensing data includes a sensing value of an accelerometer and / or a gyro sensor included in the sensor module based on movement of the electronic device and / or movement information about the electronic device based on the sensing value.

7. The electronic device according to claim 1, in, The memory includes a virtual tag local repository, wherein the processor is configured to perform a first sharing to register a first virtual token as a shared virtual token and share the first virtual token with an external electronic device, and to perform a second sharing to share a second virtual token generated in the external electronic device and registered as a shared virtual token, and The memory is configured to register the first virtual tag in the virtual tag local repository and / or a server outside the electronic device to perform the first sharing and / or the second sharing.

8. The electronic device according to claim 1, wherein: The first virtual marker includes one-dimensional, two-dimensional and / or three-dimensional information and information about the speed of the electronic device through the space.

9. The electronic device according to claim 1, wherein: Based on the electronic device being within a fixed radius from the first location, the processor is configured to turn on the sensor module and store characteristics of the first location and / or an object disposed in the first location to detect entry into the first location and / or approaching the object.

10. A method for detecting a virtual marker corresponding to a location of an electronic device, the electronic device comprising a sensor module including at least one sensor, the method comprising: detecting sensing data by a sensor module, wherein the sensing data includes a magnetic signal; capturing an image via a camera of an electronic device; estimating a first location corresponding to a current location of the electronic device based on image processing of the captured image; generating a first virtual marker corresponding to a first position corresponding to a current position of the electronic device using the sensing data and the estimated first position, wherein the first virtual marker includes a first plurality of magnetic sensing values ​​of magnetic fields corresponding to the first position for three different axis directions; storing the first virtual token in a memory of the electronic device; detecting whether entry into a fixed radius from a first location has been performed based on a wireless communication signal received by the electronic device when the sensor module is turned off; Upon confirming that the electronic device enters within a fixed radius from the first location: Turn on the sensor module; detecting an arbitrary virtual marker based on sensing data detected by the sensor module, wherein the arbitrary virtual marker includes a second plurality of magnetic sensing values ​​for magnetic fields in the three different axis directions; Correcting errors in the second plurality of magnetic sensing values ​​measured from the arbitrary virtual markers due to rotation and movement of the electronic device, wherein correcting the errors in the second plurality of magnetic sensing values ​​comprises classifying and comparing the first plurality of magnetic sensing values ​​and the second plurality of magnetic sensing values ​​to obtain corrected second plurality of magnetic sensing values; loading a first virtual tag from memory; and Based on the second plurality of corrected magnetic sensing values ​​of the arbitrary virtual marker matching the first plurality of magnetic sensing values ​​of the first virtual marker, a notification event associated with the first location is performed.

11. The method of claim 10, further comprising: loading a virtual tag list including a stored first virtual tag; confirming whether the electronic device is within a fixed radius from the first location; measuring a sensed value within the fixed radius from the first position; as well as Whether the electronic device has entered the first position is confirmed by comparing the sensed value with a first virtual marker.

Images