Electronic device and method including display

The electronic device with a camera sensor and processor ensures visually continuous advertisements by arranging content in the up-and-down direction of the display, addressing the issue of overlapping pedestrian paths in digital signage systems.

KR103044641B1Active Publication Date: 2026-11-06SAMSUNG ELECTRONICS CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
KR1020210096407
Authority / Receiving Office
KR · KR
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-07-22
Publication Date
2026-11-06
Estimated Expiration
2041-07-22

AI Technical Summary

Technical Problem

Existing digital signage systems fail to provide visually continuous advertisements to pedestrians moving in different directions, as existing systems do not effectively handle the superimposition of targeted advertisements when pedestrian paths partially overlap.

Method used

An electronic device comprising a housing, a display, a camera sensor, a wireless communication circuit, and a processor that recognizes objects, determines coordinate values, and arranges content in the up-and-down direction of the display to ensure visually continuous advertisements.

Benefits of technology

The system provides visually continuous content to pedestrians moving in various directions by arranging advertisements in the up-and-down direction of the display, ensuring seamless advertisement delivery even when paths overlap.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 112021084846243-PAT00003_ABST
    Figure 112021084846243-PAT00003_ABST
Patent Text Reader

Abstract

According to various embodiments of the present disclosure, an electronic device comprises a housing, a display, a camera sensor, a wireless communication circuit, and a processor electrically connected to the display, the camera sensor, and the wireless communication circuit. The processor recognizes a first object and a second object through at least one of the camera sensor and the wireless communication circuit, determines a first coordinate value on the display corresponding to the first object and a second coordinate value on the display corresponding to the second object, determines a first area of ​​the display based on the first coordinate value, determines a second area of ​​the display based on the second coordinate value, outputs a first content corresponding to the first object in the first area, outputs a second content corresponding to the second object in the second area, and if the distance between the first coordinate value and the second coordinate value is within a specified range, the first content and the second content can be arranged in the up and down direction of the display.
Need to check novelty before this filing date? Find Prior Art

Description

Technology Field

[0001] Various embodiments of the present disclosure relate to electronic devices and methods including a display. Background Technology

[0002] Digital signage refers to devices that display various content, such as text and video, on screens in public or commercial spaces, and is utilized for advertising or promotional purposes.

[0003] In addition, digital signage is evolving to include not only flat-panel displays but also polyhedral displays capable of displaying content from various angles, such as rectangular prisms or cylinders, in order to reduce visual blind spots.

[0004] In addition, to maximize the advertising effect through digital signage equipped with displays of various forms, targeted advertising technology can be utilized to recognize pedestrians moving through the space surrounding the digital signage and display advertisements suitable for them. The problem to be solved

[0005] When displaying targeted advertisements to pedestrians via a single digital signage system, advertisements can be continuously displayed along the pedestrian's path to provide a continuous stream of advertising to the moving pedestrian. Consequently, pedestrians moving from different directions can receive targeted advertisements that follow their respective paths from different angles via a single digital signage system. However, if the paths of pedestrians moving from different directions partially overlap, there is a problem in that it is difficult to provide visually continuous advertisements to the pedestrians because the targeted advertisements are superimposed on the same area of ​​the display. means of solving the problem

[0006] According to various embodiments of the present disclosure, an electronic device comprises a housing, a display, a camera sensor, a wireless communication circuit, and a processor electrically connected to the display, the camera sensor, and the wireless communication circuit. The processor recognizes a first object and a second object through at least one of the camera sensor and the wireless communication circuit, determines a first coordinate value on the display corresponding to the first object and a second coordinate value on the display corresponding to the second object, determines a first area of ​​the display based on the first coordinate value, determines a second area of ​​the display based on the second coordinate value, outputs a first content corresponding to the first object in the first area, outputs a second content corresponding to the second object in the second area, and if the distance between the first coordinate value and the second coordinate value is within a specified range, the first content and the second content can be arranged in the up and down direction of the display.

[0007] A method of operation of an electronic device including a display and a camera sensor according to various embodiments of the present disclosure may include: recognizing a first object and a second object through the camera sensor; determining a first coordinate value on the display corresponding to the first object and a second coordinate value on the display corresponding to the second object; determining a first area of ​​the display based on the first coordinate value; determining a second area of ​​the display based on the second coordinate value; outputting a first content corresponding to the first object in the first area; outputting a second content corresponding to the second object in the second area; and, when the distance between the first coordinate value and the second coordinate value is within a specified range, arranging the first content and the second content in the up and down direction of the display. Effects of the invention

[0008] According to the various embodiments disclosed in this document, the electronic device can provide visually continuous content to each pedestrian even if the movement paths of pedestrians moving in various directions partially overlap.

[0009] In addition, various effects that can be identified directly or indirectly through this document may be provided. Brief explanation of the drawing

[0010] FIG. 1 is a front perspective view of an electronic device according to one embodiment. FIG. 2 shows a block diagram of an electronic device according to one embodiment. FIG. 3 shows a flowchart of an electronic device providing content according to one embodiment. FIG. 4 shows a display of an electronic device providing content according to one embodiment. FIG. 5 shows a display of an electronic device providing content according to another embodiment. FIG. 6 shows a display of an electronic device providing content according to another embodiment. FIG. 7 shows the arrangement relationship of content output to a display based on the distance between objects according to one embodiment. FIG. 8 illustrates a method for predicting the intersection points of a plurality of objects according to one embodiment. FIG. 9 shows a display of an electronic device providing content according to another embodiment. FIG. 10 is a block diagram of an electronic device in a network environment according to various embodiments. Specific details for implementing the invention

[0011] FIG. 1 is a front perspective view of an electronic device (101) according to one embodiment.

[0012] According to one embodiment, the electronic device (101) may include a housing (110) and a display (120).

[0013] According to one embodiment, the electronic device (101) may include an analog TV, a digital TV, a 3D-TV, a smart TV, an LED (light emitting diode) TV, an OLED (organic light emitting diode) TV, a plasma TV, a quantum dot TV, and / or a monitor.

[0014] In one embodiment, the electronic device (101) may include a digital signage device. The digital signage can perform an outdoor advertising function using a digital information display (DID). The digital signage can function as various advertising boards such as posters, bulletin boards, and signboards, and may refer to a digital bulletin board that provides advertisements through a digital display.

[0015] In one embodiment, the electronic device (101) may include a housing (110). In one example, the housing (110) may form the exterior of the electronic device (101) while protecting various electronic components. In one example, the housing (110) may include a first surface facing a first direction (e.g., the +x direction in FIG. 1) and a second surface facing in the opposite direction to the first surface. In one example, the first surface may be the outer surface of the electronic device (101), and the second surface may be the inner surface of the electronic device (101).

[0016] In one embodiment, the electronic device (101) may include a display (120). In one example, the display (120) may be visible to the outside through at least one surface of the housing (110). For example, the display (120) may be placed on the first surface of the housing (110). The housing (110) may include a recess for receiving the display (120).

[0017] In one embodiment, the display (120) may mean a display in which at least some area can be deformed into a flat or curved surface. For example, the display (120) may include a display having a flat screen, a display having a fixed curvature, a display having multiple curvatures, a flexible display, or a display in which the curvature can be changed by user input.

[0018] In one embodiment, the display (120) may be combined with or adjacent to a touch sensing circuit, a pressure sensor capable of measuring the intensity (pressure) of the touch, and / or a digitizer that detects a magnetic field type stylus pen. In one example, the corners of the display (120) may be formed largely identically to the adjacent outer formation (e.g., a curved surface) of the housing (110).

[0019] The structure of the electronic device (101) described above is merely exemplary, and the embodiments of the present disclosure are not limited thereto. For example, the housing (110) of the electronic device (101) may include various shapes such as a bar shape, a tripod shape including a plurality of bar shapes, or a quadruped shape.

[0020] FIG. 2 is a block diagram of an electronic device (101) according to one embodiment.

[0021] In one embodiment, the electronic device (101) may include a display (120), a camera sensor (220), a wireless communication circuit (240), and a processor (210). In one example, the components of the electronic device (101) shown in FIG. 2 may be replaced with other components, or additional components may be included in the electronic device (101). For example, the electronic device (101) may further include at least one of a distance sensing sensor (230) or a memory (250).

[0022] In one embodiment, the processor (210) may be electrically connected to at least one of a display (120), a camera sensor (220), a distance sensing sensor (230), a wireless communication circuit (240) and / or a memory (250).

[0023] In one embodiment, the processor (210) can execute one or more instructions stored in memory (250). In one example, the electronic device (101) may include a plurality of processors. The processor (210) may include at least one of a circuit for processing data, such as an integrated circuit (IC), an arithmetic logic unit (ALU), a field programmable gate array (FPGA), or a large scale integration (LSI).

[0024] In one embodiment, the display (120) can visually output information to a user through a display (120) based on at least one of an OLED (organic light emitting diodes), an LCD (liquid crystal display), and an LED (light emitting diodes). To enable more intuitive control of the user interface (UI) output through the display (120), the electronic device (101) may include a touch screen panel (TSP) (not shown) placed on the display (120). The touch screen panel can detect the position of an object (e.g., a user's finger or a stylus pen) that touches the display (120) or hovers over the display (120) using at least one of a resistive film, capacitive components, a surface acoustic wave, and infrared.

[0025] In one embodiment, the display (120) can output various content through the screen area.

[0026] In one embodiment, the content output through the display (120) may refer to digital content. In one example, the content may include image data. The image data may include still images or video. In another example, the content may include image data and audio data. The content may be distinguished by content names. For example, the first content and the second content may correspond to content names.

[0027] In one embodiment, the display (120) can divide the area of ​​the display (120) according to a set standard. In one example, the display (120) can visually output different information for each divided area of ​​the display (120).

[0028] In one embodiment, the camera sensor (220) may include a sensor for recognizing objects. For example, the camera sensor (220) may include at least one camera sensor. The camera sensor may include an RGB sensor and / or a dynamic vision sensor (DVS).

[0029] In one embodiment, the RGB sensor may include a plurality of sensors that detect red, green, and / or blue. In one example, the electronic device (101) may obtain information about a subject (or object) through the RGB sensor. The processor (210) may determine the age or gender of the object through the information about the subject (or object).

[0030] In one embodiment, the dynamic vision sensor may include a sensor that transmits information about the movement of an object at a relatively high frame rate only when there is movement of the object being detected.

[0031] In one embodiment, the camera sensor (220) can detect an object (or pedestrian) in the surrounding space of the electronic device (101) and predict the distance to the detected object. In one example, the processor (210) can predict the three-dimensional position of an object in the surrounding space of the electronic device (101) through the camera sensor (220).

[0032] In one embodiment, the distance sensing sensor (230) may include at least one sensor for detecting distance. For example, the distance sensing sensor (230) may include a millimeter wave distance sensing sensor (mmWave radar), a laser distance sensing sensor (LiDAR, light detection and ranging), a direct time of flight (dToF, direct time of flight) sensor, and / or a beacon.

[0033] In one embodiment, the processor (210) may include location information of an object through a distance sensing sensor (230). The location information of the object may include information regarding the distance, angle (degree), and / or speed between the distance sensing sensor (230) and the object.

[0034] In one embodiment, a wireless communication circuit (240) (e.g., communication module (1090) of FIG. 10) may support communication between external electronic devices (e.g., external device (1004) of FIG. 10). For example, the communication circuit (240) may establish wireless communication with the external electronic device according to a defined communication protocol and transmit or receive signals or data using a frequency band that supports said wireless communication. The wireless communication may include at least one of ultra-wideband (UWB) communication, Wi-Fi communication, WiGig communication, Bluetooth (BT) communication, or low-power Bluetooth (BLE) communication.

[0035] In one embodiment, the processor (210) can establish wireless communication with a plurality of external electronic devices (e.g., electronic devices (1002, 1004) of FIG. 10) through a wireless communication circuit (240). In one example, the processor (210) can receive a plurality of signals containing data from a plurality of external electronic devices when the electronic device (101) is located within the effective range of the signals transmitted by the plurality of external electronic devices.

[0036] In one embodiment, the memory (250) may store data related to the electronic device (101). The memory (250) may include volatile memory such as random access memory (RAM) including static random access memory (SRAM) or dynamic random access memory (DRAM), or non-volatile memory such as read-only memory (ROM), magnetoresistive RAM (MRAM), spin-transfer torque MRAM (STT-MRAM), phase-change RAM (PRAM), resistive RAM (RRAM), ferroelectric RAM (FeRAM), as well as flash memory, eMMC (embedded multimedia card), or solid state drive (SSD).

[0037] In one embodiment, the memory (250) may store information for outputting through the display (120). For example, the memory (250) may store at least one content and / or data related to the content (e.g., metadata, file index) to be output through the display (120). Alternatively, the memory (250) may temporarily store at least one data (e.g., sensing data), program and / or at least one instruction (e.g., an algorithm for object recognition) for controlling the electronic device (100) and performing various operations according to various embodiments of the present invention.

[0038] In one example, the wireless communication circuit (240) may receive information from an external device and / or server to be output through the display (120). The information received through the wireless communication circuit (240) may be stored in memory (250). In one example, the information received from the external device and / or server may include at least one of information about advertising content (e.g., information about advertising products), news, weather information, and traffic information.

[0039] FIG. 3 shows a flowchart (300) of an electronic device (101) that provides content according to one embodiment.

[0040] In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0041] According to one embodiment, an electronic device (101) (e.g., processor (210) of FIG. 2) can recognize at least one of a first object (e.g., first object (450) of FIG. 4) or a second object (e.g., second object (460) of FIG. 4) through at least one of a camera sensor (220) and a wireless communication circuit (240) in operation 301.

[0042] Hereinafter, at least one of the first object or the second object may correspond to a concept comprising a single object or a group of multiple objects. In one example, the recognized first object and the second object may include at least one feature of a person (e.g., a part of a person's body).

[0043] In one embodiment, the first object or the second object may include an object located within a certain distance from the electronic device (101). In one example, the first object and the second object may include an object located within the angle of view of the camera sensor (220). In one example, the angle of view of the camera sensor (220) may be determined based on a lens included in the camera sensor (220). In another example, the first object and the second object may correspond to an external electronic device located within the surrounding space of the electronic device (101).

[0044] Hereinafter, the operation of the processor (210) recognizing the first object and the second object through the camera sensor (220) is described.

[0045] In one embodiment, the processor (210) can identify the first object and the second object through an object recognition algorithm stored in memory (250) and sensing data obtained through a camera sensor (220).

[0046] In one embodiment, the processor (210) can acquire sensing data through the camera sensor (220). In one example, the sensing data acquired through the camera sensor (220) may include data regarding the space within the field of view range of the camera sensor (220). In one example, the data regarding the space within the field of view range of the camera sensor (220) may include data regarding the surrounding space where the electronic device (101) is placed.

[0047] In one embodiment, the processor (210) can convert data for a space within the field of view range of the camera sensor (220) into data for a plurality of identification spaces. In one example, the data for the plurality of identification spaces may correspond to data that distinguishes a space within the field of view range of the camera sensor (220) to identify an object.

[0048] In one embodiment, the sensing data obtained through the camera sensor (220) may include information about the structure of the place where the electronic device (101) is located. The information about the place where the electronic device (101) is located may include information about the distance between the electronic device (101) and points within the surrounding structures and objects, and information about the structure (e.g., shape and / or size) of the electronic device (101) through the information about the distance.

[0049] In one embodiment, the processor (210) can identify an object located in the plurality of identification spaces through sensing data acquired through the camera sensor (220) and an object recognition algorithm stored in the memory (250). For example, the plurality of identification spaces may include a first identification space and a second identification space. The processor (210) can identify an object located in the first identification space and / or an object located in the second identification space.

[0050] In one embodiment, the processor (210) can identify multiple objects located within one of the multiple identification spaces. For example, the multiple identification spaces may include a first identification space and a second identification space, and in this case, the processor (210) can identify multiple objects existing within the first identification space among the multiple identification spaces. The processor (210) can identify each object constituting the multiple objects existing within the first identification space. The processor (210) can obtain information about an object representing the multiple objects placed within the first identification space based on the mean value of the distance between each object and the electronic device (101) and the centroid of the total area of ​​the region where each object is located.

[0051] In one embodiment, when multiple objects are identified within one of the multiple identification spaces, the processor (210) can identify the objects based on the mean value of the distance between each object and the electronic device (101) and the centroid of the total area of ​​the region where each object is located. When multiple objects are identified within one of the multiple identification spaces, the processor (210) can identify the multiple objects as a group. For example, when multiple objects are identified within the first identification space among the multiple identification spaces including a first identification space and a second identification space, the processor (210) can identify the electronic device (101) and the multiple objects identified within the first identification space as a first group. The first group can be identified as a first object based on the mean value of the distance between the multiple objects identified within the first identification space and the electronic device (101) and the centroid of the total area of ​​the space where the multiple objects identified within the first identification space are located. In one example, the processor (210) may identify the electronic device (101) and the multiple objects identified within the second identification space as a second group when multiple objects are identified within the second identification space among multiple identification spaces including a first identification space and a second identification space. The second group may be identified as a second group based on the average value of the distance between the multiple objects identified within the second identification space and the electronic device (101), and the centroid of the total area of ​​the space where the multiple objects identified within the second identification space are located.

[0052] In one embodiment, the processor (210) can identify a change in the field of view of the camera sensor (220). In one example, if the location where the electronic device (101) is placed changes, the field of view of the camera sensor (220) may also change. In another example, if the location of the camera sensor (220) changes, the field of view of the camera sensor (220) may also change. In one example, if the processor (210) identifies a change in the field of view of the camera sensor (220), it can update the sensing data obtained through the camera sensor (220).

[0053] In one embodiment, the processor (210) can identify an object located in a plurality of changed identification spaces by utilizing the sensing data of the updated camera sensor (220) and an object recognition algorithm. For example, the plurality of changed identification spaces may include a third identification space and a fourth identification space that are distinct from the first identification space and the second identification space. In one example, the processor (210) can identify an object located in the third identification space and / or an object located in the fourth identification space.

[0054] Hereinafter, the operation of the processor (210) recognizing the first object and the second object through the wireless communication circuit (240) is described.

[0055] In one embodiment, the processor (210) can recognize the first object and the second object through the wireless communication circuit (240).

[0056] In one embodiment, the processor (210) can identify the plurality of external electronic devices corresponding to the plurality of wireless signals as a first object and / or a second object by receiving a plurality of wireless signals from a plurality of external electronic devices within the effective range of the electronic device (101) through a wireless communication circuit (240).

[0057] In one embodiment, the wireless communication circuit (240) may include a circuit for transmitting and receiving wireless signals. In one example, the wireless communication circuit (240) may transmit and receive wireless signals to an external electronic device (e.g., external device (1002, 1004) of FIG. 10). The external electronic device may include a device capable of transmitting wireless signals to the electronic device (101).

[0058] In one embodiment, the wireless communication circuit (240) can perform wireless communication according to at least one communication standard. For example, the wireless communication circuit (240) can transmit and receive wireless signals through at least one of Wi-Fi direct (wireless fidelity direct), infrared communication (IR, infrared ray), and Bluetooth.

[0059] In one embodiment, the processor (210) may receive a wireless signal from an external electronic device through a wireless communication circuit (240). In one example, the external electronic device may include a beacon device. The wireless signal may correspond to a beacon signal. In this case, the electronic device (101) may receive a beacon signal when it is located within the effective range of the beacon signal transmitted by the beacon device. The effective range may be approximately 50m, but is not limited thereto and may be understood to include a technical range that can be understood by a person skilled in the art.

[0060] In one embodiment, a plurality of external electronic devices can transmit a plurality of wireless signals to the electronic device (101) through various communication methods.

[0061] In one embodiment, the processor (210) can receive multiple wireless signals through multiple external electronic devices via a wireless communication circuit (240).

[0062] In one embodiment, a wireless signal received from an external electronic device may include unique information (identifier) ​​of the external electronic device, information regarding the location of the external electronic device and / or information regarding the strength of the wireless signal.

[0063] In one embodiment, the processor (210) can identify an object using map information stored in memory (250) and a wireless signal received by an external electronic device obtained through a wireless communication circuit (240).

[0064] In one embodiment, the map information may include information regarding a plurality of identification spaces related to the space where the electronic device (101) is located. In one example, the map information may be stored in a memory (250) and may be generated by a program stored in the memory (250). In one example, the information regarding a plurality of identification spaces related to the space where the electronic device (101) is located included in the map information may include a first identification space and a second identification space. In one example, each identification space constituting the plurality of identification spaces may correspond to a space that is distinct from one another.

[0065] In one embodiment, the processor (210) can identify a first object and a second object based on the map information and a wireless signal received from an external electronic device. In one example, the processor (210) can obtain information regarding the location of the external electronic device based on the wireless signal received from the external electronic device. In one example, the processor (210) can determine which identification space the external electronic device is placed in within a plurality of identification spaces included in the map information based on the obtained information regarding the location of the external electronic device. For example, a plurality of identification spaces around the electronic device (101) included in the map information may include a first identification space and a second identification space. The processor (210) can identify a first external electronic device located in the first identification space by utilizing the wireless signal obtained from the first external electronic device and the map information. The processor (210) can identify the first external electronic device located in the first identification space as a first object. The processor (210) can identify a second external electronic device located in the second identification space by utilizing the wireless signal obtained from the second external electronic device and the map information. The processor (210) can identify the second external electronic device located in the second identification space as a second object.

[0066] In one embodiment, the processor (210) can obtain a distance value between the external electronic device that transmitted the wireless signal and the electronic device (101) based on information regarding the strength of the wireless signal included in the wireless signal received from the external electronic device. In another embodiment, the processor (210) can measure the strength of the signal transmitted and / or received by the external electronic device. The processor (210) can obtain a distance value between the external electronic device and the electronic device (101) based on the strength of the signal transmitted and / or received by the external electronic device that was directly measured.

[0067] According to one embodiment, an electronic device (101) (e.g., processor (210) of FIG. 2) can determine, in operation 303, a first coordinate value on a display (120) corresponding to a first object (e.g., first object (450) of FIG. 4) and a second coordinate value on a display (120) corresponding to a second object (e.g., second object (460) of FIG. 4).

[0068] In one embodiment, the processor (210) may determine coordinate values ​​on the display (120) corresponding to the identified object in order to output content for the object identified through operation 301 through the display (120). In one example, the first coordinate value and the second coordinate value on the display (120) may correspond to coordinate information on the display (120).

[0069] In one embodiment, the processor (210) may determine a first coordinate value corresponding to the first object on the display (120) based on information about the first object. In one example, the information about the first object may include information about the first object obtained through a camera sensor (220) or a wireless communication circuit (240) via operation 301. In one example, the information about the first object may include information about the location of the first object, information about the appearance of the first object, and eye tracking information about the first object.

[0070] In one embodiment, the processor (210) may determine a second coordinate value corresponding to the second object on the display (120) based on information about the second object. The information about the second object may include information about the location of the second object obtained through the camera sensor (220) or the wireless communication circuit (240) via operation 301. In one example, the information about the second object may include information about the location of the second object, external shape information of the second object, and eye tracking information of the second object.

[0071] In one embodiment, a first coordinate value on the display (120) corresponding to the first object may be determined by utilizing eye-tracking information of the first object. In another embodiment, a first coordinate value corresponding to the first object may be determined based on the height of the first object and position information of the first object.

[0072] In one embodiment, a second coordinate value on the display (120) corresponding to the second object may be determined by utilizing eye-tracking information of the second object. In another embodiment, a second coordinate value corresponding to the second object may be determined based on the height of the second object and position information of the second object.

[0073] In one embodiment, the first coordinate value may be updated based on information regarding the movement of the first object. The second coordinate value may be updated based on information regarding the movement of the second object. In one example, the processor (210) may include information regarding the movement of the first object and information regarding the movement of the second object through the camera sensor (220). In one example, the information regarding the movement of the first object may include the direction of movement and the speed of movement of the first object. The information regarding the movement of the second object may include information regarding the direction of movement and the speed of movement of the second object. For example, if the processor (210) recognizes the direction of movement of the first object as a first direction through the camera sensor (220), the first coordinate value corresponding to the first object may also change accordingly. If the processor (210) recognizes the direction of movement of the second object as a second direction through the camera sensor (220), the second coordinate value corresponding to the second object may also change accordingly.

[0074] According to one embodiment, an electronic device (101) (e.g., processor (210) of FIG. 2) can determine a first area of ​​a display (120) (e.g., first area (410) of FIG. 4) based on the first coordinate value in operation 305.

[0075] According to one embodiment, an electronic device (101) (e.g., processor (210) of FIG. 2) can determine a second area of ​​a display (120) (e.g., second area (420) of FIG. 4) based on the second coordinate value in operation 305.

[0076] In one embodiment, the first area may correspond to an area for outputting first content corresponding to the first object. The second area may correspond to an area for outputting second content corresponding to the second object.

[0077] In one embodiment, the first coordinate value may correspond to the center of the first content to be output through the first area. The second coordinate value may correspond to the center of the second content to be output through the second area.

[0078] In one embodiment, the first region and the second region may be disposed in at least one part of the display (120).

[0079] In one embodiment, the size and / or shape of the first region and the second region may follow the setting information stored in advance in the memory (250). The first region and the second region may be set in various forms.

[0080] In one embodiment, the processor (210) may set a boundary line of the display (120) (e.g., 501 in FIG. 5) to determine the first area and the second area. For example, a boundary line may be set on the screen area of ​​the display (120), and based on the boundary line, one area may be set as the first area and the remaining area as the second area.

[0081] In one embodiment, the boundary line set in the screen area of ​​the display (120) may correspond to a horizontal, vertical, and / or diagonal line. In one example, the angle formed by the boundary line set in the screen area of ​​the display (120) with the horizontal axis of the display (120) (e.g., 701 in FIG. 7) may change in correspondence with the change in the distance between the first coordinate value and the second coordinate value as the distance between the first coordinate value and the second coordinate value changes. For example, if the diagonal boundary line set in the screen area of ​​the display (120) changes into a horizontal boundary line as the distance between the first coordinate value and the second coordinate value changes, the first area and the second area may be distinguished according to the changed boundary line.

[0082] In another example, the first area and the second area may be set in various forms. For example, the first area and the second area may include polygonal areas such as rectangles, ellipses, and squares without separate boundary lines. For example, the first area may be set as a rectangle, and the second area may be set as a rhombus. In one example, the ratio and size of the first area and the second area may be changed by user input. In one example, the first area and the second area of ​​the display (120) are not limited thereto and may be determined in various ways.

[0083] Hereinafter, examples of the first area and the second area for outputting content on the display (120) are described in detail through FIGS. 4 to 6.

[0084] According to one embodiment, an electronic device (101) (e.g., processor (210) of FIG. 2) can output a first content (e.g., first content (431) of FIG. 4) corresponding to a first object (e.g., first object (450) of FIG. 4) to the first area (e.g., first area (410) of FIG. 4) in operation 307.

[0085] According to one embodiment, an electronic device (101) (e.g., processor (210) of FIG. 2) can output a second content (e.g., second content (441) of FIG. 4) corresponding to a second object (e.g., second object (460) of FIG. 4) to a second area (e.g., second area (420) of FIG. 4) in operation 309.

[0086] In one embodiment, the first content output through the first area and the second content output through the second area may refer to digital content. The digital content may include a still image or a video displayed through a display.

[0087] In one embodiment, the first content may correspond to a target advertisement corresponding to the first object. In one example, the second content may correspond to a target advertisement corresponding to the second object.

[0088] In one embodiment, the first content corresponding to the first object may be determined based on location information, time information, and / or first user information. In one example, the processor (210) may receive first user information using the first external electronic device from the first external electronic device through a wireless communication circuit (240).

[0089] In one embodiment, the second content corresponding to the second object may be determined based on location information, time information, and / or second user information of the electronic device (101). In one example, the processor (210) may receive the second user information using the second external electronic device from the second external electronic device through a wireless communication circuit (240).

[0090] In one embodiment, the location information and time information of the electronic device (101) may correspond to the environmental information of the electronic device (101). In one example, the processor (210) may obtain the environmental information of the electronic device (101) through a wireless communication circuit (240) and / or a camera sensor (220).

[0091] In one embodiment, user information may refer to information related to a user using an external electronic device. For example, user information may include at least one of the user's spoken language, the user's gender, the user's age, the type of preferred content, product purchase history, or the user's nationality.

[0092] In one embodiment, the processor (210) can identify content to be output through the display (120) by applying environmental information of the electronic device (101) and user information of an external electronic device to an algorithm related to content identification information stored in memory (250). In one example, the content output through the first area and the second area may be the same content or separate content that is distinguishable from each other.

[0093] According to one embodiment, an electronic device (101) (e.g., processor (210) of FIG. 2) can determine whether the distance between a first coordinate value and a second coordinate value in operation 311 is within a specified range.

[0094] In one embodiment, the processor (210) can determine a value for the distance between the first coordinate value and the second coordinate value. The processor (210) can determine whether it is within a specified range based on the determined distance between the first coordinate value and the second coordinate value.

[0095] In one embodiment, the specified range may mean the distance between the first coordinate value and the second coordinate value when at least a portion of the range of the first area determined based on the first coordinate value overlaps with the second area determined based on the second coordinate value.

[0096] However, it is not limited thereto. In another example, the specified range may be set based on information about the first object and information about the second object obtained in operation 301. For example, the processor (210) can predict the intersection range of the first object and the second object through the information about the first object and the information about the second object as the movement direction of the first object and the movement direction of the second object change. The processor (210) can predict a change value for the distance between the first coordinate value and the second coordinate value based on the intersection range of the first object and the second object. Based on the predicted change value for the distance between the first coordinate value and the second coordinate value, the specified range may be stored in memory (250). In one example, the specified range set based on the predicted intersection point may correspond to a range for preventing overlap between the first content output through the first area and the second content output through the second area.

[0097] Hereinafter, a method for predicting the intersection range of the first object and the second object through the information of the first object and the information of the second object is explained in detail with reference to FIG. 8.

[0098] According to one embodiment, an electronic device (101) (e.g., processor (210) of FIG. 2) can arrange the first content and the second content in an up-and-down direction in a screen area of ​​a display (120) when the distance between the first coordinate value and the second coordinate value in operation 313 corresponds to within a specified range.

[0099] In one embodiment, the processor (210) can arrange a first content corresponding to the first object and a second content corresponding to the second object in the vertical direction of the display (120) when the distance between the first coordinate value and the second coordinate value is within a specified range.

[0100] In one embodiment, the processor (210) can determine a first distance value between the camera sensor (220) (or distance sensor (230)) and the first object and a second distance value between the camera sensor (220) (or distance sensor (230)) and the second object through the camera sensor (220) (or distance sensor (230)) when the distance between the first coordinate value and the second coordinate value is within a specified range.

[0101] In one embodiment, the processor (210) may place one of the first content and the second content in the upper direction of the display (120) and place the remaining one area in the lower direction of the display (120) based on the first distance value and the second distance value. In one example, when the first distance value is greater than the second distance value, the processor (210) may control the display (120) to display the first content above the second content on the screen of the display (120). In another example, when the second distance value is greater than the first distance value, the processor (210) may control the display (120) to display the second content above the first content on the screen of the display (120).

[0102] In one embodiment, the processor (210) can control the display (120) such that at least one of the height at which the first content (431) is output on the display (120) and the height at which the second content (441) is output on the display (120) is gradually changed based on the change in the distance between the first coordinate value and the second coordinate value when the distance between the first coordinate value and the second coordinate value is within a specified range.

[0103] Hereinafter, with reference to FIG. 7, a detailed explanation will be provided regarding controlling the display (120) so that the height at which the first content (431) is output and the height at which the second content (441) is output are gradually changed based on the first coordinate value and the second coordinate value.

[0104] According to one embodiment, the electronic device (101) (e.g., the processor (210) of FIG. 2) may return to operation 303 if the distance between the first coordinate value and the second coordinate value in operation 311 does not fall within a specified range.

[0105] FIG. 4 shows a display (120) of an electronic device (101) that provides content according to one embodiment.

[0106] Referring to state 401 of FIG. 4, the processor (210) can recognize a first object (450) and determine a first coordinate value corresponding to the first object (450). In one example, the first coordinate value may correspond to coordinate information on the display (120).

[0107] In one embodiment, the processor (210) recognizes a second object (460) and can determine a second coordinate value corresponding to the second object (460). In one example, the second coordinate value may correspond to coordinate information on the display (120).

[0108] In one embodiment, the processor (210) can determine a first area (411) for outputting a first content (431) corresponding to a first object (450) based on a first coordinate value.

[0109] In one embodiment, the processor (210) can determine a second area (421) for outputting a second content (441) corresponding to a second object (460) based on a second coordinate value.

[0110] In one embodiment, the first region (411) and the second region (421) are depicted in a rectangular shape, but are not limited thereto, and the shapes of the first region (411) and the second region (421) may include shapes such as circular, elliptical, or trapezoidal.

[0111] Referring to 402 in FIG. 4, as the first object (450) moves, the first area (411) for outputting the first content (431) can be moved to the first area (411-1) by the processor (210). In one example, as the second object (460) moves, the second area (421) for outputting the second content (441) can be moved to the second area (421-1) by the processor (210).

[0112] In one embodiment, when the first object (450) moves in a first movement direction, the processor (210) may update a first coordinate value corresponding to the first object (450) in correspondence with the first movement direction. The processor (210) may determine a first area (411-1) for outputting the first content (431) based on the updated first coordinate value. In one example, the first area (411) in the display (120) may move to the first area (411-1).

[0113] In one embodiment, when the second object (460) moves in a second direction of movement different from the first direction of movement, the processor (210) may update a second coordinate value corresponding to the second object (460) in accordance with the second direction of movement. The processor (210) may determine a second area (421-1) for outputting the second content (441) based on the updated second coordinate value. In one example, the second area (421) of the display (120) may move to the second area (421-1).

[0114] In one embodiment, the distance between the first area (411-1) and the second area (421-1) may be relatively shorter than the distance between the first area (411) and the second area (421).

[0115] Referring to 403 in FIG. 4, the processor (210) can arrange the first content (431) and the second content (441) in the vertical direction of the display (120) if the distance between the first coordinate value corresponding to the first area (411-1) and the second coordinate value corresponding to the second area (421-1) falls within a specified range. Arranging the first content (431) and the second content (441) in the vertical direction of the display (120) means arranging one of the first content (431) and the second content (441) at the bottom relative to the direction in which the display (120) is arranged, and arranging the other one at the top of the other.

[0116] In one embodiment, the processor (210) may place the first content (431) in the lower direction of the second content (441) when the first distance value between the first object (450) and the electronic device (101) is shorter than the second distance value between the second object (460) and the electronic device (101). In this case, by placing the second content (441) in the upper direction of the first content (431), the field of view obstructed by the first object (450) and the first content (431) at the location of the second object (460) is minimized, and the user at the location of the second object (460) can more easily check the second content (441).

[0117] In one embodiment, the processor (210) can control the display (120) such that when the distance between the first coordinate value corresponding to the first area (411-1) and the second coordinate value corresponding to the second area (421-1) is within a specified range, the height of the first content (431) and the height of the second content (441) in the screen area of ​​the display (120) gradually change as the distance between the first coordinate value corresponding to the first area (411-1) and the second coordinate value corresponding to the second area (421-1) changes.

[0118] Referring to 404 in FIG. 4, as the first object (450) moves, the first area (411-2) for outputting the first content (431) can move to the first area (411-3). In one example, as the second object (460) moves, the second area (421-2) for outputting the second content (441) can move to the second area (421-3).

[0119] In one embodiment, when the first object (450) moves in a first movement direction, the processor (210) can update a first coordinate value corresponding to the first object (450) in correspondence with the first movement direction. In one example, when the second object (460) moves in a second movement direction different from the first movement direction, the processor (210) can update a second coordinate value corresponding to the second object (460) in correspondence with the second movement direction. In one example, the processor (210) determines whether the distance between the updated first coordinate value and the updated second coordinate value is within a specified range, and if the distance between the updated first coordinate value and the updated second coordinate value exceeds the specified range, the processor (210) can determine a first area (411-3) for outputting the first content (431) based on the updated first coordinate value. The processor (210) can determine a second area (421-3) for outputting the second content (441) based on the updated second coordinate value.

[0120] In one embodiment, the processor (210) can output a first content (431) through a first area (411-3). The processor (210) can output a second content (441) through a second area (421-3).

[0121] FIG. 5 shows a display (120) of an electronic device (101) that provides content, according to another embodiment.

[0122] Referring to FIG. 5, a boundary line (501) may be set on a screen area of ​​a display (120) to determine a first area (412) for outputting a first content (431) and a second area (422) for outputting a second content (441). In one example, the boundary line (501) set on the screen area of ​​the display (120) may correspond to a horizontal, vertical, and / or diagonal.

[0123] In one embodiment, based on a boundary line set in the screen area of ​​the display (120), one area based on the boundary line may be determined as a first area (412), and the remaining area based on the boundary line may be determined as a second area (422).

[0124] In one embodiment, a boundary line set in the screen area of ​​the display (120) may be determined based on a first coordinate value corresponding to a first object (450) and a second coordinate value corresponding to a second object. For example, the greater the distance between the first coordinate value and the second coordinate value, the greater the angle formed by the boundary line set in the screen area of ​​the display (120) with the horizontal direction of the display (120).

[0125] Hereinafter, the angle formed by the boundary line set in the screen area of ​​the display (120) with the horizontal direction of the display (120) will be explained in detail with reference to FIG. 7.

[0126] Referring to the state 501 of FIG. 5, the processor (210) can recognize a first object (450) and determine a first coordinate value corresponding to the first object (450). The processor (210) can recognize a second object (460) and determine a second coordinate value corresponding to the second object (460).

[0127] In one embodiment, the processor (210) can determine a first area (412) for outputting a first content (431) corresponding to a first object (450) based on a first coordinate value.

[0128] In one embodiment, the processor (210) can determine a second area (422) for outputting a second content (441) corresponding to a second object (460) based on a second coordinate value.

[0129] Referring to 501 in FIG. 5, the processor (210) can set a boundary line (501a) between the first area (412) and the second area (412) in the screen area of ​​the display (120) based on the distance between the first coordinate value and the second coordinate value.

[0130] In one embodiment, the processor (210) can obtain a first distance value between the camera sensor (220) and the first object (450) through the camera sensor (220). The processor (210) can obtain a second distance value between the camera sensor (220) and the second object (460) through the camera sensor (220). In one example, the processor (210) can place content corresponding to an object further away from the electronic device (101) on the top of the display (120). For example, if the first distance value is shorter than the second distance value, the processor (210) can set a boundary line (501a) so that the first content (431) corresponding to the first object (450) can be placed on the bottom side of the display (120) based on the first coordinate value. In another example, when the first distance value is shorter than the second distance value, the processor (210) may set a boundary line on the screen area of ​​the display (120) so that a first area (412) for outputting a first content (431) corresponding to a first object (450) based on the first coordinate value may be placed on the upper side of the display (120).

[0131] Referring to 502 in FIG. 5, as the first object (450) moves, the first area (412) for outputting the first content (431) can be moved to the first area (412-1) by the processor (210). In one example, as the second object (460) moves, the second area (422) for outputting the second content (441) can be moved to the second area (422-1) by the processor (210).

[0132] Referring to 502 in FIG. 5, the first object (450) can move in a first movement direction (401a). The second object (460) can move in a second movement direction (401b) different from the first movement direction. In one example, the processor (210) can detect the movement of the first object (450) and the movement of the second object (460) through a camera sensor (220) (or a distance sensing sensor (240)). When the processor (210) detects the movement of the first object (450) and the movement of the second object (460), the processor (210) can control the shape of the first area (412) and the second area (422) by controlling the boundary lines set on the screen of the display (120). For example, the processor (210) can change the first area (412) and the second area (422) into the first area (412-1) and the second area (422-1), respectively, by controlling the boundary line (501a), which has a first angle formed with the horizontal axis of the display (120) (e.g., 701 in FIG. 7), to a boundary line (501b), which has a second angle formed with the horizontal axis of the display (120) that is smaller than the first angle.

[0133] Referring to 503 in FIG. 5, the processor (210) can arrange the first content (431) and the second content (441) in the vertical direction of the display (120) if the distance between the first coordinate value corresponding to the first area (412-1) and the second coordinate value corresponding to the second area (422-1) falls within a specified range.

[0134] In one embodiment, when the processor (210) determines that the distance between the first coordinate value corresponding to the first area (412-1) and the second coordinate value corresponding to the second area (422-1) is within a specified range, the boundary line (501b) having the second angle of the display (120) can be controlled to a boundary line (501c) corresponding to a horizontal line.

[0135] In one embodiment, the processor (210) can arrange the first content (431) and the second content (441) in the vertical direction within the screen area of ​​the display (120) based on the boundary line (501c) when the distance between the first coordinate value corresponding to the first area (412-1) and the second coordinate value corresponding to the second area (422-1) falls within a specified range.

[0136] In one embodiment, the processor (210) may place the first content (431) in a downward direction relative to the boundary line (501c) when the first distance value between the first object (450) and the electronic device (101) is shorter than the second distance value between the second object (460) and the electronic device (101). In this case, the processor (210) may place the second content (441) in an upward direction relative to the boundary line (501c).

[0137] Referring to 504 in FIG. 5, as the first object (450) moves, the first area (412-2) for outputting the first content (431) can move to the first area (412-3). In one example, as the second object (460) moves, it can move to the second area (422-3) for outputting the second content (441).

[0138] In one embodiment, when the first object (450) moves in a first movement direction (right direction), the processor (210) can update the first coordinate value corresponding to the first object (450) in accordance with the first movement direction. In one example, when the second object (460) moves in a second movement direction (left direction) different from the first movement direction, the processor (210) can update the second coordinate value corresponding to the second object (460) in accordance with the second movement direction. In one example, the processor (210) determines whether the distance between the updated first coordinate value and the updated second coordinate value is within a specified range, and if the distance between the updated first coordinate value and the updated second coordinate value exceeds the specified range, the processor (210) can change the boundary line (501c) set in the screen area of ​​the display (120) to a boundary line (501d). In one example, the angle formed by the boundary line (501d) with the horizontal direction of the display (120) may be greater than the angle formed by the boundary line (501c) with the horizontal direction of the display (120). The processor (210) may control the display (120) to output the first content (431) in the first movement direction (right direction) with respect to the boundary line (501d). The processor (210) may control the display (120) to output the second content (441) in the second movement direction (left direction) with respect to the boundary line (501d).

[0139] FIG. 6 shows a display (120) of an electronic device (101) that provides content, according to another embodiment.

[0140] Referring to 601 in FIG. 6, when the first object (450) and the second object (460) are on a moving walk, the second object (460) can move in the first movement direction (610). The second object (460) can move in the second movement direction (620), which is opposite to the first movement direction (610).

[0141] In one embodiment, the processor (210) can determine an area for outputting content corresponding to an object based on the direction and speed of movement of the moving walkway stored in memory (250).

[0142] In one embodiment, the processor (210) can determine whether the distance between the first coordinate value corresponding to the first object (450) and the second coordinate value corresponding to the second object (460) is within a specified range.

[0143] Referring to 602 and 603 of FIG. 6, if the distance between the first coordinate value and the second coordinate value falls within a specified range, the processor (210) may place the first content (431) corresponding to the first object (450) and the second content (441) corresponding to the second object (460) in the upper and lower directions of the display (120). In this case, if the processor (210) cannot measure the first distance between the electronic device (101) and the first object (450) and the second distance between the electronic device (101) and the second object (460), the processor (210) may place the content corresponding to the object moving in a preset direction in the memory (250) in the lower direction of the display (120). For example, if a command is stored in memory (250) to place content corresponding to an object moving along the first movement direction (610) in the lower direction of the display (120), the processor (210) may place the first content (431) corresponding to the first object (450) in the lower direction of the display (120) when it determines that the first object (450) is moving along the first movement direction (610). When the processor (210) determines that the second object (460) is moving along the second movement direction (620), it may place the second content (441) corresponding to the second object (460) in the upper direction of the display (120).

[0144] FIG. 7 shows the arrangement relationship of content output to a display (120) based on the distance between objects according to one embodiment.

[0145] FIG. 7(a) shows the relationship between the boundary line (501) set in the screen area of ​​the display (120) to determine the first area (412) for outputting the first content and the second area (422) for outputting the second content according to FIG. 5, and the horizontal axis (701) of the display (120).

[0146] In one embodiment, the smaller the distance between the first coordinate value corresponding to the first object (450) and the second coordinate value corresponding to the second object (460), the processor (210) can set a boundary line (501) in which the angle (Oab) formed by the boundary line (501) and the horizontal axis (701) of the display (120) is relatively small. For example, the processor can determine the boundary line (501) between the two areas based on a formula that calculates the angle (Oab) in proportion to the distance between the first coordinate value and the second coordinate value.

[0147] In one example, the processor (210) can determine the angle (Oab) formed by the boundary line (501) and the horizontal axis (701) of the display (120) by considering the system stored in the processor (210).

[0148] FIG. 7(b) shows the height relationship between the first area (411) and the second area (421) when the first area (411) for outputting the first content and the second area (421) for outputting the second content are arranged in the vertical direction on the display (120) according to FIG. 4.

[0149] In one embodiment, the processor (210) may position the first area (411) and the second area (421) such that the height difference (Hab) between the first area (411) and the second area (421) is relatively large as the distance between the first coordinate value corresponding to the first object (450) and the second coordinate value corresponding to the second object (460) becomes smaller. For example, the processor may determine the position to position the first area (411) and the second area (421) based on a formula that calculates the height difference (Hab) inversely proportional to the distance between the first coordinate value and the second coordinate value. In one example, the processor (210) may determine the height difference (Hab) between the first area (411) and the second area (421) by considering a system stored in the processor (210).

[0150] FIG. 8 illustrates a method for predicting the intersection points of a plurality of objects according to one embodiment.

[0151] In one embodiment, the processor (210) can identify objects located in each of a plurality of zones in the surrounding space where the electronic device (101) is located through a camera sensor (220) (or, distance sensing sensor (230)).

[0152] Referring to FIG. 8, the processor (210) can identify a first object (450) and a second object (460) through a camera sensor (e.g., the camera sensor (220) of FIG. 2). In one example, the processor (210) can obtain the speed (Sa) of the first object (450), the speed (Sb) of the second object (460), and the distance value (Dab) of the first object (450) and the second object (460) by using a camera sensor (220) corresponding to the camera sensor or a distance sensor (230) corresponding to the distance sensor in response to the identification of the first object (450) and the second object (460).

[0153] In one embodiment, the processor (210) can determine the time of intersection (t) between the first object (450) and the second object (460) based on the speed (Sa) of the acquired first object (450), the speed (Sb) of the second object (460), and the distance value (Dab) between the first object (450) and the second object (460).

[0154] In one embodiment, the processor (210) can determine the intersection point (I) of the first object (450) and the second object (460) based on the intersection time (t) of the first object (450) and the velocity (Sa) of the first object (450).

[0155] In one embodiment, the processor (210) can obtain the angle (Gai) between the first object (450), the location of the electronic device (101), and the intersection point (I), and the angle (Gbi) between the second object (460), the location of the electronic device (101), and the intersection point (I) using the second cosine law.

[0156] In one embodiment, the processor (210) may set a specified range to determine whether the distance between the first coordinate value and the second coordinate value is within a specified range using the intersection point (I) of the acquired first object (450) and the second object (460), the angle (Gai) between the first object (450), the location of the electronic device (101), and the intersection point (I), and / or the angle (Gbi) between the second object (460), the location of the electronic device (101), and the intersection point (I).

[0157] FIG. 9 shows a display (120) of an electronic device (101) that provides content, according to another embodiment.

[0158] In one embodiment, the electronic device (101) may include a rectangular parallelepiped device. However, it is not limited thereto, and the electronic device (101) may include a polyhedral device.

[0159] In one embodiment, the electronic device (101) may include a plurality of displays (120). In one example, the displays (120) may include a display (120a) and a display (120b). The number of displays (120) is not limited thereto, and the displays (120) may include a third display, a fourth display, and an nth display.

[0160] In one embodiment, among a plurality of displays (120), a display (120a) may be positioned to face a first direction. A display (120b) may be positioned to face a second direction distinct from the first direction.

[0161] Referring to 901 in FIG. 9, the processor (210) can identify a first object (450). In response to the identification of the first object (450), the processor (210) can determine a first coordinate value corresponding to the first object (450). The first coordinate value may correspond to coordinate information on the display (120). In one example, since the first object (450) is placed in the surrounding space where the display (120a) is placed among the plurality of displays (120), the processor (210) can determine a first coordinate value corresponding to the first object (450) on the display (120a).

[0162] Referring to 901 in FIG. 9, the processor (210) can identify a second object (460). In response to the identification of the second object (460), the processor (210) can determine a second coordinate value corresponding to the second object (460). Since the second object (460) is placed in the surrounding space where the display (120b) is placed among the plurality of displays (120), the processor (210) can determine a second coordinate value corresponding to the second object (460) on the display (120b).

[0163] In one embodiment, the processor (210) can determine an output device for outputting a first content (431) corresponding to a first object (450) and a second content (441) corresponding to a second object (460) among a plurality of displays (120) based on determined first coordinate values ​​and second coordinate values.

[0164] In one embodiment, the processor (210) can output a first content (431) corresponding to a first object (450) through the display (120a) based on a first coordinate value determined on the display (120a).

[0165] In one embodiment, the processor (210) can output a second content (441) corresponding to a second object (460) through the display (120b) based on a second coordinate value determined on the display (120b).

[0166] In one embodiment, as the first object (450) and / or the second object (460) move, the first coordinate value corresponding to the first object (450) and / or the second coordinate value corresponding to the second object (460) may change.

[0167] Referring to 902 in FIG. 9, the processor (210) can update the second coordinate value corresponding to the second object (460) as it moves from the area of ​​the display (120b) positioned so that the second object (460) faces the second direction to the area of ​​the display (120a) positioned so that the second object (460) faces the first direction. In one example, the processor (210) can update the second coordinate value determined on the display (120b) to the second coordinate value on the display (120a). In one example, the first object (450) and the second object (460) are located within the area facing the display (120a), so that the first coordinate value corresponding to the first object (450) and the second coordinate value corresponding to the second object (460) can be determined within the same display.

[0168] In one embodiment, the processor (210) may output the first content (431) corresponding to the first object (450) and the second content (441) corresponding to the second object (460) by arranging them in the up and down direction for the same display, based on the first coordinate value and the second coordinate value.

[0169] In one embodiment, the processor (210) can obtain a first distance value between the electronic device (101) and the first object (450) and a second distance value between the electronic device (101) and the second object (460) through a camera sensor (220) (or a distance sensing sensor (230)) when the display for outputting the first content (431) and the second content (441) corresponds to the same display (e.g., display (120a) or display (120b)) among the plurality of displays (120) based on the determined first coordinate value and the second coordinate value.

[0170] In one embodiment, when the display (120) for outputting the first content (431) and the second content (441) is the same as the display (120a), the processor (210) may place the first content (431) in the upper direction of the display (120a) and the second content (441) in the lower direction of the display (120a) when the first distance value is greater than the second distance value. In another example, the processor (210) may place the first content (431) in the lower direction of the display (120a) and the second content (441) in the upper direction of the display (120a) when the first distance value is smaller than the second distance value.

[0171] FIG. 10 is a block diagram of an electronic device (1001) in a network environment (1000) according to various embodiments.

[0172] Referring to FIG. 10, in a network environment (1000), an electronic device (1001) may communicate with an electronic device (1002) through a first network (1098) (e.g., a short-range wireless communication network) or with at least one of an electronic device (1004) or a server (1008) through a second network (1099) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1001) may communicate with the electronic device (1004) through a server (1008). According to one embodiment, the electronic device (1001) may include a processor (1020), memory (1030), input module (1050), sound output module (1055), display module (1060), audio module (1070), sensor module (1076), interface (1077), connection terminal (1078), haptic module (1079), camera module (1080), power management module (1088), battery (1089), communication module (1090), subscriber identification module (1096), or antenna module (1097). In some embodiments, at least one of these components (e.g., connection terminal (1078)) may be omitted from the electronic device (1001), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (1076), camera module (1080), or antenna module (1097)) may be integrated into a single component (e.g., display module (1060)).

[0173] The processor (1020) can, for example, execute software (e.g., program (1040)) to control at least one other component (e.g., hardware or software component) of the electronic device (1001) connected to the processor (1020) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1020) can store commands or data received from other components (e.g., sensor module (1076) or communication module (1090)) in volatile memory (1032), process the commands or data stored in volatile memory (1032), and store the resulting data in non-volatile memory (1034). According to one embodiment, the processor (1020) may include a main processor (1021) (e.g., a central processing unit or an application processor) or an auxiliary processor (1023) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1001) includes a main processor (1021) and an auxiliary processor (1023), the auxiliary processor (1023) may be configured to use lower power than the main processor (1021) or to be specialized for a specified function. The auxiliary processor (1023) may be implemented separately from the main processor (1021) or as part thereof.

[0174] The auxiliary processor (1023) may control at least some of the functions or states associated with at least one component of the electronic device (1001) (e.g., display module (1060), sensor module (1076), or communication module (1090)) on behalf of the main processor (1021) while the main processor (1021) is in an inactive (e.g., sleep) state, or together with the main processor (1021) while the main processor (1021) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1023) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1080) or communication module (1090)). According to one embodiment, the auxiliary processor (1023) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1001) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (1008)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0175] The memory (1030) can store various data used by at least one component of the electronic device (1001) (e.g., processor (1020) or sensor module (1076)). The data may include, for example, input data or output data for software (e.g., program (1040)) and related commands. The memory (1030) may include volatile memory (1032) or non-volatile memory (1034).

[0176] The program (1040) may be stored as software in memory (1030) and may include, for example, an operating system (1042), middleware (1044), or an application (1046).

[0177] The input module (1050) can receive commands or data to be used for a component of the electronic device (1001) (e.g., processor (1020)) from outside the electronic device (1001) (e.g., user). The input module (1050) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0178] The sound output module (1055) can output a sound signal to the outside of the electronic device (1001). The sound output module (1055) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0179] The display module (1060) can visually provide information to the outside of the electronic device (1001) (e.g., a user). The display module (1060) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1060) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0180] The audio module (1070) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1070) can acquire sound through the input module (1050) or output sound through the sound output module (1055) or an external electronic device (e.g., electronic device (1002)) (e.g., speaker or headphones) that is directly or wirelessly connected to the electronic device (1001).

[0181] The sensor module (1076) can detect the operating state of the electronic device (1001) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1076) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0182] The interface (1077) may support one or more specified protocols that can be used for the electronic device (1001) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1002)). According to one embodiment, the interface (1077) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0183] The connection terminal (1078) may include a connector through which the electronic device (1001) can be physically connected to an external electronic device (e.g., electronic device (1002)). According to one embodiment, the connection terminal (1078) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0184] The haptic module (1079) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (1079) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0185] The camera module (1080) can capture still images and video. According to one embodiment, the camera module (1080) may include one or more lenses, image sensors, image signal processors, or flashes.

[0186] The power management module (1088) can manage power supplied to the electronic device (1001). According to one embodiment, the power management module (1088) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0187] The battery (1089) can supply power to at least one component of the electronic device (1001). According to one embodiment, the battery (1089) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0188] The communication module (1090) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1001) and an external electronic device (e.g., electronic device (1002), electronic device (1004), or server (1008)), and the performance of communication through the established communication channel. The communication module (1090) may include one or more communication processors that operate independently of the processor (1020) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1090) may include a wireless communication module (1092) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1094) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1004) through a first network (1098) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1099) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1092) can identify or authenticate the electronic device (1001) within a communication network such as the first network (1098) or the second network (1099) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1096).

[0189] The wireless communication module (1092) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1092) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1092) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (1092) can support various requirements specified in the electronic device (1001), external electronic device (e.g., electronic device (1004)), or network system (e.g., second network (1099)). According to one embodiment, the wireless communication module (1092) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.

[0190] An antenna module (1097) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (1097) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1097) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1098) or a second network (1099), may be selected from the plurality of antennas, for example, by a communication module (1090). A signal or power may be transmitted or received between the communication module (1090) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1097).

[0191] According to various embodiments, the antenna module (1097) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0192] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0193] According to one embodiment, commands or data may be transmitted or received between an electronic device (1001) and an external electronic device (1004) through a server (1008) connected to a second network (1099). Each of the external electronic devices (1002, or 1004) may be the same or a different type of device as the electronic device (1001). According to one embodiment, all or part of the operations performed on the electronic device (1001) may be performed on one or more of the external electronic devices (1002, 1004, or 1008). For example, if the electronic device (1001) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1001) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (1001). The electronic device (1001) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1001) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1004) may include an Internet of Things (IoT) device. The server (1008) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (1004) or server (1008) may be included within the second network (1099). The electronic device (1001) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0194] The electronic device according to the various embodiments disclosed in this document may be a device of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0195] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, each of phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as “first,” “second,” or “first” or “second” may be used simply to distinguish a component from another component and do not limit the components in any other aspect (e.g., importance or order). Where any (e.g., first) component is referred to as “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicationally,” it means that said component may be connected to said other component directly (e.g., wired), wirelessly, or through a third component.

[0196] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0197] Various embodiments of the present document may be implemented as software (e.g., program (1040)) comprising one or more instructions stored in a storage medium (e.g., internal memory (1036) or external memory (1038)) readable by a machine (e.g., electronic device (1001)). For example, a processor (e.g., processor (1020)) of the machine (e.g., electronic device (1001)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0198] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0199] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0201] According to various embodiments, an electronic device comprises a housing, a display, a camera sensor, a wireless communication circuit, and a processor electrically connected to the display, the camera sensor, and the wireless communication circuit. The processor recognizes a first object and a second object through at least one of the camera sensor and the wireless communication circuit, determines a first coordinate value on the display corresponding to the first object and a second coordinate value on the display corresponding to the second object, determines a first area of ​​the display based on the first coordinate value, determines a second area of ​​the display based on the second coordinate value, outputs a first content corresponding to the first object in the first area, outputs a second content corresponding to the second object in the second area, and if the distance between the first coordinate value and the second coordinate value is within a specified range, the first content and the second content can be arranged in the up and down direction of the display.

[0202] According to one embodiment, the processor can identify the movement of the first object and the movement of the second object through the camera sensor, update the first coordinate value in response to the movement of the first object, and update the second coordinate value in response to the movement of the second object.

[0203] According to one embodiment, the processor may determine the first region such that the first coordinate value corresponds to the center of gravity value of the first region, and determine the second region such that the second coordinate value corresponds to the center of gravity value of the second region.

[0204] According to one embodiment, the specified range may include the distance between the first coordinate value and the second coordinate value when at least a portion of the first content overlaps with the second content on the display.

[0205] According to one embodiment, the electronic device further includes a distance sensing sensor, and when the distance between the first coordinate value and the second coordinate value is within a specified range, the processor determines a first distance value for the first object from the distance sensing sensor and a second distance value for the second object from the distance sensing sensor through the distance sensing sensor, and based on the first distance value and the second distance value, one of the first content and the second content may be placed in the upper direction of the display and the other content may be placed in the lower direction of the display.

[0206] According to one embodiment, the processor can control the display to display the first content on the upper side of the second content when the first distance value is greater than the second distance value.

[0207] According to one embodiment, the camera sensor may include at least one of an RGB sensor and a dynamic vision sensor (DVS).

[0208] According to one embodiment, the distance sensing sensor may include at least one of a millimeter wave distance sensing sensor (mmWave radar), a laser distance sensing sensor (LiDAR, light detection and ranging), and a direct time of flight (dToF, direct time of flight).

[0209] According to one embodiment, the wireless communication circuit can transmit and receive a beacon signal.

[0210] According to one embodiment, the processor can predict the intersection point between the first object and the second object based on the speed of the first object, the speed of the second object, and the distance between the first object and the second object through the camera sensor, and determine the specified range based on the intersection point between the first object and the second object.

[0211] According to one embodiment, the processor can control the display such that the height at which the first area is displayed and the height at which the second area is displayed gradually change as the distance between the first coordinate value and the second coordinate value changes.

[0212] According to one embodiment, the processor receives first information of the first external electronic device from the first external electronic device through the wireless communication circuit, receives second information of the second external electronic device from the second external electronic device through the wireless communication circuit, and can recognize the first object and the second object based on the first information and the second information.

[0213] According to one embodiment, the processor can determine the first content based on the first information of the first external electronic device and determine the second content based on the second information of the second external electronic device.

[0214] According to one embodiment, the first information includes unique information of the first external electronic device, user information of the first external electronic device, and information regarding the strength of a signal received from the first external electronic device, and the second information may include unique information of the second external electronic device, user information of the second external electronic device, and information regarding the strength of a signal received from the second external electronic device.

[0215] According to one embodiment, when the distance between the first coordinate value and the second coordinate value is within a specified range, the processor identifies the distance from the electronic device to the first object based on information regarding the strength of a signal received from the first external electronic device, identifies the distance from the electronic device to the second object based on information regarding the strength of a signal received from the second external electronic device, and places an area corresponding to the object that is further from the electronic device among the first area and the second area in the upper direction of the display.

[0216] According to one embodiment, the processor sets a boundary line in a screen area of ​​the display, determines a first area based on the boundary line based on the first coordinate value, determines the remaining area based on the boundary line as the second area of ​​the display based on the second coordinate value, and the angle formed by the boundary line with the horizontal axis of the display can be changed and reset as the distance between the first coordinate value and the second coordinate value changes.

[0217] A method of operation of an electronic device including a display and a camera sensor according to various embodiments may include: recognizing a first object and a second object through the camera sensor; determining a first coordinate value on the display corresponding to the first object and a second coordinate value on the display corresponding to the second object; determining a first area of ​​the display based on the first coordinate value; determining a second area of ​​the display based on the second coordinate value; outputting a first content corresponding to the first object in the first area; outputting a second content corresponding to the second object in the second area; and, when the distance between the first coordinate value and the second coordinate value is within a specified range, arranging the first content and the second content in the up and down direction of the display.

[0218] According to one embodiment, the method may include the operation of obtaining the speed of the first object, the speed of the second object, and the distance between the first object and the second object through the camera sensor, the operation of predicting the intersection point of the first object and the second object based on the speed of the first object, the speed of the second object, and the distance between the first object and the second object, and the operation of determining the specified range based on the intersection point of the first object and the second object.

[0219] According to various embodiments, the electronic device comprises a housing, a plurality of displays,

[0220] The apparatus includes a camera sensor, a plurality of displays, and a processor electrically connected to the camera sensor, wherein the processor recognizes a first object and a second object through the camera sensor, determines a first coordinate value on the plurality of displays corresponding to the first object and a second coordinate value on the plurality of displays corresponding to the second object, determines a first display among the plurality of displays for outputting a first content corresponding to the first object based on the first coordinate value, and determines a second display among the plurality of displays for outputting a second content corresponding to the second object based on the second coordinate value, and if the first display and the second display are the same display, the first content and the second content can be arranged in an up-and-down direction and output on the determined display.

[0221] According to one embodiment, the electronic device further includes a distance sensing sensor, and when the first display and the second display are the same, the processor determines a first distance value for the first object from the distance sensing sensor and a second distance value for the second object from the distance sensing sensor through the distance sensing sensor, and based on the first distance value and the second distance value, one of the first content and the second content may be placed in the upper direction of the determined display and the other content may be placed in the lower direction of the determined display.

Claims

Claim 1 In an electronic device, housing; display; camera sensor; wireless communication circuit; memory for storing instructions; and includes at least one processor, wherein the instructions are executed individually or collectively by the at least one processor, and the electronic device: identifies a plurality of objects located within a predetermined distance from the electronic device within the angle of view of the camera sensor through the camera sensor, or identifies a plurality of wireless signals received from a plurality of external electronic devices through the wireless communication circuit, thereby recognizing a first object and a second object; determines a first coordinate value on the display corresponding to the first object and a second coordinate value on the display corresponding to the second object; determines a first area of ​​the display based on the first coordinate value and determines a second area of ​​the display based on the second coordinate value; outputs a first content corresponding to the first object in the first area and outputs a second content corresponding to the second object in the second area; and if the distance between the first coordinate value and the second coordinate value is within a specified range: determines a first distance value to the first object and a second distance value to the second object, and the first distance value is the An electronic device that places the first content above the second content on the display based on the determination that the first distance value is greater than the second distance value, and places the second content above the first content on the display based on the determination that the first distance value is smaller than the second distance value. Claim 2 An electronic device according to claim 1, wherein the instructions are executed individually or collectively by the at least one processor, so that the electronic device: identifies the movement of the first object and the movement of the second object through the camera sensor, updates the first coordinate value in response to the movement of the first object, and updates the second coordinate value in response to the movement of the second object. Claim 3 An electronic device according to claim 1, wherein the instructions are executed individually or collectively by the at least one processor such that the electronic device determines the first region such that the first coordinate value corresponds to the coordinate value of the centroid for the entire area of ​​the first region, and determines the second region such that the second coordinate value corresponds to the coordinate value of the centroid for the entire area of ​​the second region. Claim 4 An electronic device according to claim 2, wherein the specified range includes the distance between the first coordinate value and the second coordinate value when at least a portion of the first content overlaps with the second content on the display. Claim 5 delete Claim 6 delete Claim 7 An electronic device according to claim 1, wherein the camera sensor comprises at least one of an RGB sensor and a dynamic vision sensor (DVS). Claim 8 delete Claim 9 The electronic device according to claim 1, wherein the wireless communication circuit transmits and receives a beacon signal. Claim 10 An electronic device according to claim 1, wherein the instructions are executed individually or collectively by the at least one processor, such that the electronic device: predicts the intersection point of the first object and the second object based on the speed of the first object, the speed of the second object, and the distance between the first object and the second object through the camera sensor, and determines the specified range based on the intersection point of the first object and the second object. Claim 11 An electronic device according to claim 1, wherein the instructions are executed individually or collectively by the at least one processor, such that the electronic device controls the display such that the height at which the first area is displayed and the height at which the second area is displayed are gradually changed as the distance between the first coordinate value and the second coordinate value changes. Claim 12 An electronic device according to claim 1, wherein the instructions are executed individually or collectively by the at least one processor, such that the electronic device: receives first information of the first external electronic device from the first external electronic device through the wireless communication circuit, receives second information of the second external electronic device from the second external electronic device through the wireless communication circuit, and recognizes the first object and the second object based on the first information and the second information. Claim 13 An electronic device according to claim 12, wherein the instructions are executed individually or collectively by the at least one processor, such that the electronic device: determines the first content based on the first information of the first external electronic device and determines the second content based on the second information of the second external electronic device. Claim 14 An electronic device according to claim 12, wherein the first information includes unique information of the first external electronic device, user information of the first external electronic device, and information regarding the strength of a signal received from the first external electronic device, and the second information includes unique information of the second external electronic device, user information of the second external electronic device, and information regarding the strength of a signal received from the second external electronic device. Claim 15 An electronic device according to claim 14, wherein the instructions are executed individually or collectively by the at least one processor, such that when the distance between the first coordinate value and the second coordinate value is within a specified range, the electronic device identifies the distance from the electronic device to the first object based on information regarding the strength of a signal received from the first external electronic device, identifies the distance from the electronic device to the second object based on information regarding the strength of a signal received from the second external electronic device, and places an area corresponding to the object that is farther from the electronic device among the first area and the second area in the upper direction of the display. Claim 16 An electronic device according to claim 1, wherein the processor sets a boundary line in a screen area of ​​the display, determines one area based on the boundary line as the first area of ​​the display based on the first coordinate value, determines the remaining one area based on the boundary line as the second area of ​​the display based on the second coordinate value, and the angle formed by the boundary line with the horizontal axis of the display is changed and reset as the distance between the first coordinate value and the second coordinate value changes. Claim 17 A method of operation of an electronic device including a display and a camera sensor, comprising: an operation of recognizing a first object and a second object by identifying a plurality of objects located within a predetermined distance from the electronic device within the angle of view of the camera sensor through the camera sensor; an operation of determining a first coordinate value on the display corresponding to the first object and a second coordinate value on the display corresponding to the second object; an operation of determining a first area of ​​the display based on the first coordinate value; an operation of determining a second area of ​​the display based on the second coordinate value; an operation of outputting a first content corresponding to the first object in the first area; an operation of outputting a second content corresponding to the second object in the second area; and, if the distance between the first coordinate value and the second coordinate value is within a specified range: an operation of determining a first distance value to the first object and a second distance value to the second object; and, based on the determination that the first distance value is greater than the second distance value, an operation of placing the first content above the second content on the display. A method comprising the operation of placing the second content above the first content on the display based on the determination that the first distance value is smaller than the second distance value. Claim 18 A method according to claim 17, comprising: an operation of obtaining a value of the speed of the first object, the speed of the second object, and the distance between the first object and the second object through the camera sensor; an operation of predicting an intersection point between the first object and the second object based on the speed of the first object, the speed of the second object, and the distance between the first object and the second object; and an operation of determining the specified range based on the intersection point between the first object and the second object. Claim 19 In an electronic device, a housing, multiple displays; a camera sensor; a memory for storing commands; and includes at least one processor, wherein the instructions are executed individually or collectively by the at least one processor, and the electronic device: recognizes a first object and a second object by identifying a plurality of objects located within a predetermined distance from the electronic device within the angle of view of the camera sensor through the camera sensor, and determines a first coordinate value on the plurality of displays corresponding to the first object and a second coordinate value on the plurality of displays corresponding to the second object, and determines a first display among the plurality of displays for outputting a first content corresponding to the first object based on the first coordinate value, and determines a second display among the plurality of displays for outputting a second content corresponding to the second object based on the second coordinate value, and if the first display and the second display are the same display: determines a first distance value to the first object and a second distance value to the second object, and based on the determination that the first distance value is greater than the second distance value, on the first display, the first content An electronic device that positions the second content above the first content on the first display, based on the determination that the first distance value is smaller than the second distance value. Claim 20 delete

Citation Information

Patent Citations

  • Display Apparatus and Method for Playing Contents thereof

    KR101274362B1

  • Display apparatus and method for operating the same

    KR1020150084302A

  • Method for generating user profile photo, and electronic device

    WO2021000841A1