Content sharing method and device
By determining the spatial position and orientation between devices, the system automatically identifies the target device that the user is pointing at, solving the problems of complex operation and accidental touches in multi-device interaction and enabling convenient content sharing.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2020-08-05
- Publication Date
- 2026-04-14
AI Technical Summary
When users need to manually select the target device to share content during multi-device interaction, there are problems of high operation costs and long selection time, especially when there are many devices and the signal is unstable, which can easily lead to accidental touches.
By acquiring the spatial position of the second device on the first device, the relative distance and direction of the device are determined using ultra-wideband, ultrasonic, lidar, or vision technology. Combined with triangulation and time difference measurement, the device attitude is determined, and the target device pointed at by the user is automatically identified without the user having to select it in the menu bar.
It reduces user operating costs and selection time, and improves the convenience and accuracy of content sharing between devices.
Smart Images

Figure CN121858053A_ABST
Abstract
Description
[0001] This application is a divisional application. The original application has the application number 202010779684.5 and the original application date is August 5, 2020. The entire contents of the original application are incorporated herein by reference. Technical Field
[0002] This application relates to the field of electronic technology, and more particularly to a content sharing method and apparatus thereof. Background Technology
[0003] According to research, over half of users own smartphones, computers, smart TVs, tablets, and smart speakers. Other devices, such as smart audio-visual equipment, routers / Wi-Fi boxes, smart cleaning devices, smart kitchen appliances, and smart lighting systems, may also be present in the home. Users are increasingly able to control or connect to more and more devices. Due to the differences in capabilities (such as screen size and input methods) and content services (applications, software) of various devices, coupled with the need for users to switch environments when completing long-duration or multi-step tasks, a balance exists between productivity and mobility, resulting in different modes of multi-device interaction.
[0004] Content sharing is a common multi-device interaction method that aims to transfer data from one device to another, achieving data sharing. During the sharing process, users need to select a specific device, which can be discovered and selected through menus / lists, maps, or NFC. Other devices available on the same network can be selected on the device itself, and these other devices will appear in the device's menu / list.
[0005] When the number of selectable devices exceeds a certain limit, the target device needs to be selected based on icon and text recognition combined with scrolling. If the device order is related to signal strength, the order of devices in the menu / list will change when the signal is unstable or the user moves, making accidental selection easy. Furthermore, since the system cannot sense when the user wants to interact with a target device, it can only list all scanned devices, increasing the user's operational costs and selection time. Summary of the Invention
[0006] In one aspect, this application provides a content sharing method applied to a first device, the first device including a display screen, the method comprising: obtaining the spatial location of a second device; the first device and the second device can be connected via one of Bluetooth / WIFI / UWB. In this embodiment, when using the first device, a user may have a need to share data (or content to be shared) or obtain data to other devices connected to the first device; in one implementation, the first device can determine the spatial location of the second device using existing technologies such as ultra-wideband (UWB) / ultrasound / laser / vision. For example, relative distance and direction can be established through a bidirectional connection between the first device and the second device (requiring that the first device and the second device have hardware capable of transmitting / receiving wireless positioning signals), and the distance and angle between the first device and other devices can be calculated and determined. In one implementation, triangulation can be performed among multiple devices (the handheld device has hardware capable of transmitting / receiving wireless positioning signals, and there are three or more fixed devices in the space with the same hardware, which can exist independently or depend on other devices with the same hardware installed in the space). The absolute position of the first handheld device can be determined using the time difference of arrival (TODA). When there are enough devices with the ability to transmit / receive wireless positioning signals, the six degrees of freedom (6DoF) attitude of the first handheld device can be determined. The devices can share their respective attitudes, and thus the first device can obtain its own attitude and the attitude of the second device. The first device can then obtain the spatial position of the second device. If the first device is identified as pointing towards the spatial position of the second device, it is instructed to retrieve the content to be shared on the second device. In another implementation, the first device can determine whether it is pointing towards the second device based on the obtained distance and angle between itself and the second device.
[0007] This application embodiment determines which device in space is the second device receiving the content to be shared based on the current direction of the first device, so that the user does not need to select the device to share the content in the menu bar, reducing the user's operation cost and selection time.
[0008] In one possible implementation, the pointing direction of the first device is determined according to a preset main axis of the first device; the main axis of the first device passes through a reference point of the first device. The pointing of the first device can be understood as the direction pointed by the line connecting the user and the end of the first device away from the user when the user is operating the first device, or the direction pointed by the line connecting a reference point on the first device and the end of the first device away from the user. It should be understood that the main axis can be the direction pointed by the line connecting the user and the end of the first device away from the user when the user is operating the first device. Depending on the shape of the first device, the main axis of the first device can have different orientations. Depending on the shape of the first device, the reference point on the first device can be different; for example, the reference point on a mobile phone can be a point in the central area, while the reference point on AR / VR glasses can be a point near the midpoint of the line connecting the centers of the lenses.
[0009] In one possible implementation, the first device is a mobile phone or tablet, and the first device includes a rectangular touchscreen, wherein the angle between the main axis and the longest side of the rectangular touchscreen is within a preset range.
[0010] In one possible implementation, the first device is a virtual reality (VR) / augmented reality (AR) glasses, the first device includes a lens, and the angle between the main axis and the perpendicular line to the plane where the lens is located is within a preset range.
[0011] In one possible implementation, obtaining the content to be shared on the second device includes: displaying a first identifier, the first identifier being used to indicate the content to be shared on the second device; in one implementation, the second device may have multiple pieces of content to be shared stored in different paths, and the content to be shared from the second device to the first device may include photos in a photo directory. After the first device and the second device establish a content-sharing connection, the second device can send all image thumbnails in the photo directory to the first device, and the first device can select one or the first image to display. The first device can display a second area, which may include the first... The first device selects an image from all image thumbnails in the second device's photo directory. Additionally, the first device can display a layered prompt below the image. When the user clicks on the image, the first device expands and displays all image thumbnails in the second device's photo directory. The first device can also display a prompt to collapse the image; when the user clicks this prompt, the first device collapses all image thumbnails in the second device's photo directory, displaying only the initially selected image. A first target operation targeting the first identifier is detected; in response to the first target operation, the content to be shared on the second device is retrieved.
[0012] In one possible implementation, the first identifier is located at the top layer of the display interface of the first device.
[0013] In one possible implementation, the first target operation includes a first drag operation, the starting point of which is located in the area where the first identifier is located.
[0014] In one possible implementation, the method further includes:
[0015] The display shows a first area, which includes a second identifier or the system interface of the first device. The second identifier is used to indicate the content to be shared by the first device, and the end point of the first drag operation is located in the first area.
[0016] In one possible implementation, the first target operation includes a first long press operation and a first tap operation, and detecting the first target operation for the first identifier includes:
[0017] The first long press operation applied to the first identifier was detected;
[0018] In response to the first long press operation, the first content sharing option is displayed;
[0019] The first click operation on the first content sharing option was detected.
[0020] In one possible implementation, obtaining the spatial location of the second device includes: obtaining the spatial locations of multiple devices, wherein the main axis of the first device points to the spatial location of each of the multiple devices; and determining the device among the multiple devices that is closest to the first device as the second device.
[0021] In one possible implementation, the step of obtaining the content to be shared on the second device if the first device points to the spatial location of the second device includes: obtaining the location of the third device; if the main axis of the first device points to both the spatial location of the second device and the spatial location of the third device; then displaying a third identifier and a fourth identifier; the third identifier is used to indicate the second device, and the fourth identifier is used to indicate the third device; detecting a selection operation for the third identifier, and obtaining the content to be shared on the second device. In this embodiment, if the main axis of the first device points to multiple devices, that is, the first device can obtain the spatial locations of multiple devices, and the main axis of the first device points to the spatial location of each of the multiple devices, the main axis of the first device points to two devices (carried by two people respectively), for example, the first device simultaneously points to the spatial location of Xiaoming's phone and the spatial location of Xiaohong's phone. In this scenario, the first device can also obtain the location of the third device (the second device is Xiaohong's phone, and the third device is Xiaoming's phone); if the main axis of the first device points to the spatial location of the second device and the spatial location of the third device, then a third identifier and a fourth identifier are displayed; the third identifier is used to indicate the second device, and the fourth identifier is used to indicate the third device; if a selection operation is detected for the third identifier, the content to be shared on the second device is obtained or the content to be shared by the first device is sent to the second device.
[0022] Secondly, this application provides a content sharing method, which is applied to a first device, the first device including a display screen, the method including: obtaining the spatial location of a second device; if it is identified that the first device is pointing to the spatial location of the second device, instructing to send the content to be shared by the first device to the second device.
[0023] This application embodiment determines which device in space is the second device receiving the content to be shared based on the current direction of the first device, so that the user does not need to select the device to share the content in the menu bar, reducing the user's operation cost and selection time.
[0024] In one possible implementation, the pointing direction of the first device is determined according to a preset main axis of the first device; the main axis of the first device passes through a reference point of the first device.
[0025] In one possible implementation, the first device is a mobile phone or tablet, and the first device includes a rectangular touchscreen, wherein the angle between the main axis and the longest side of the rectangular touchscreen is within a preset range.
[0026] In one possible implementation, the first device is a virtual reality (VR) / augmented reality (AR) glasses, the first device includes a lens, and the angle between the main axis and the perpendicular line to the plane where the lens is located is within a preset range.
[0027] In one possible implementation, sending the content to be shared from the first device to the second device includes:
[0028] A second target operation targeting a second identifier was detected; the second identifier is used to indicate the content to be shared by the first device.
[0029] In response to the second target operation, the content to be shared from the first device is sent to the second device.
[0030] In one possible implementation, the second target operation includes a second drag operation, the starting point of which is located in the area where the second identifier is located.
[0031] In one possible implementation, the method further includes:
[0032] The second area is displayed at the top of the display interface of the first device, and the endpoint of the second drag operation is located in the second area.
[0033] In one possible implementation, the second target operation includes a second long press operation and a second tap operation, and the detection of the second target operation for the second identifier includes:
[0034] A second long press operation acting on the second identifier was detected;
[0035] In response to the second long press, the second content sharing option is displayed;
[0036] A second click operation on the second content sharing option was detected.
[0037] In one possible implementation, obtaining the spatial location of the second device includes:
[0038] The spatial locations of multiple devices are obtained, and the main axis of the first device points to the spatial location of each of the multiple devices;
[0039] The device closest to the first device among the plurality of devices is identified as the second device.
[0040] In one possible implementation, the step of sending the content to be shared by the first device to the second device if the first device points to the spatial location of the second device includes:
[0041] Obtain the location of the third device;
[0042] If the main axis of the first device points to the spatial location of the second device and the spatial location of the third device, then a third identifier and a fourth identifier are displayed; the third identifier is used to indicate the second device, and the fourth identifier is used to indicate the third device.
[0043] Upon detecting a selection operation for the third identifier, the content to be shared from the first device is sent to the second device.
[0044] In one possible implementation, the second device includes a display screen on which the content to be shared by the second device is displayed.
[0045] Thirdly, this application provides a content sharing device, which is applied to a first device, the first device including a display screen, the device comprising:
[0046] The acquisition module is used to acquire the spatial location of the second device;
[0047] The sharing module is used to instruct the user to retrieve the content to be shared on the second device if it is recognized that the first device is pointing to the spatial location of the second device.
[0048] In one possible implementation, the pointing direction of the first device is determined according to a preset main axis of the first device; the main axis of the first device passes through a reference point of the first device.
[0049] In one possible implementation, the first device is a mobile phone or tablet, and the first device includes a rectangular touchscreen, wherein the angle between the main axis and the longest side of the rectangular touchscreen is within a preset range.
[0050] In one possible implementation, the first device is a virtual reality (VR) / augmented reality (AR) glasses, the first device includes a lens, and the angle between the main axis and the perpendicular line to the plane where the lens is located is within a preset range.
[0051] In one possible implementation, the sharing module is configured to: display a first identifier, the first identifier indicating the content to be shared on the second device; detect a first target operation targeting the first identifier; and, in response to the first target operation, acquire the content to be shared on the second device.
[0052] In one possible implementation, the first identifier is located at the top layer of the display interface of the first device.
[0053] In one possible implementation, the first target operation includes a first drag operation, the starting point of which is located in the area where the first identifier is located.
[0054] In one possible implementation, the device further includes:
[0055] A display module is used to display a first area, the first area including a second identifier or the system interface of the first device, the second identifier being used to indicate the content to be shared by the first device, and the end point of the first drag operation being located in the first area.
[0056] In one possible implementation, the first target operation includes a first long press operation and a first click operation, and the sharing module is configured to: detect the first long press operation applied to the first identifier; display a first content sharing option in response to the first long press operation; and detect the first click operation on the first content sharing option.
[0057] In one possible implementation, the sharing module is configured to detect a second target operation targeting a second identifier; the second identifier is configured to indicate the content to be shared by the first device; and in response to the second target operation, to send the content to be shared by the first device to the second device.
[0058] In one possible implementation, the second target operation includes a second drag operation, the starting point of which is located in the area where the second identifier is located.
[0059] In one possible implementation, the display module is configured to display a second area at the top layer of the display interface of the first device, and the endpoint of the second drag operation is located in the second area.
[0060] In one possible implementation, the second target operation includes a second long press operation and a second click operation, wherein the sharing module is configured to detect the second long press operation acting on the second identifier; display a second content sharing option in response to the second long press operation; and detect the second click operation on the second content sharing option.
[0061] In one possible implementation, the acquisition module is used to acquire the spatial positions of multiple devices, and the main axis of the first device points to the spatial position of each of the multiple devices; and to determine the device among the multiple devices that is closest to the first device as the second device.
[0062] In one possible implementation, the sharing module is used to obtain the location of the third device; if the main axis of the first device points to the spatial location of the second device and the spatial location of the third device, then a third identifier and a fourth identifier are displayed; the third identifier is used to indicate the second device, and the fourth identifier is used to indicate the third device; a selection operation for the third identifier is detected, and the content to be shared on the second device is obtained.
[0063] In one possible implementation, the second device includes a display screen on which the content to be shared by the second device is displayed.
[0064] Fourthly, this application provides a content sharing device, which is applied to a first device, the first device including a display screen, the device comprising:
[0065] The acquisition module is used to acquire the spatial location of the second device;
[0066] The sharing module is used to instruct the first device to send the content to be shared to the second device if it is recognized that the first device is pointing to the spatial location of the second device.
[0067] In one possible implementation, the pointing direction of the first device is determined according to a preset main axis of the first device; the main axis of the first device passes through a reference point of the first device.
[0068] In one possible implementation, the first device is a mobile phone or tablet, and the first device includes a rectangular touchscreen, wherein the angle between the main axis and the longest side of the rectangular touchscreen is within a preset range.
[0069] In one possible implementation, the first device is a virtual reality (VR) / augmented reality (AR) glasses, the first device includes a lens, and the angle between the main axis and the perpendicular line to the plane where the lens is located is within a preset range.
[0070] In one possible implementation, the sharing module is configured to: detect a second target operation targeting a second identifier; the second identifier is used to indicate the content to be shared by the first device;
[0071] In response to the second target operation, the content to be shared from the first device is sent to the second device.
[0072] In one possible implementation, the second target operation includes a second drag operation, the starting point of which is located in the area where the second identifier is located.
[0073] In one possible implementation, the device further includes:
[0074] The display module is used to display a second area at the top of the display interface of the first device, and the endpoint of the second drag operation is located in the second area.
[0075] In one possible implementation, the second target operation includes a second long press operation and a second click operation, and the sharing module is configured to: detect the second long press operation acting on the second identifier;
[0076] In response to the second long press, the second content sharing option is displayed;
[0077] A second click operation on the second content sharing option was detected.
[0078] In one possible implementation, the acquisition module is used to acquire the spatial positions of multiple devices, and the main axis of the first device points to the spatial position of each of the multiple devices;
[0079] The device closest to the first device among the plurality of devices is identified as the second device.
[0080] In one possible implementation, the sharing module is used to obtain the location of a third device;
[0081] If the main axis of the first device points to the spatial location of the second device and the spatial location of the third device, then a third identifier and a fourth identifier are displayed; the third identifier is used to indicate the second device, and the fourth identifier is used to indicate the third device.
[0082] Upon detecting a selection operation for the third identifier, the content to be shared from the first device is sent to the second device.
[0083] In one possible implementation, the second device includes a display screen on which the content to be shared by the second device is displayed.
[0084] Fifthly, this application provides a content sharing device, including a processor and a memory coupled together. The memory stores program instructions, which, when executed by the processor, implement the method described in the first aspect. For details regarding the steps in various possible implementations of the first aspect executed by the processor, please refer to the first aspect; further details will not be repeated here.
[0085] Sixthly, this application provides a content sharing device, including a processor coupled to a memory. The memory stores program instructions, which, when executed by the processor, implement the method described in the second aspect above. For details regarding the steps in various possible implementations of the second aspect executed by the processor, please refer to the second aspect; further details will not be elaborated here.
[0086] In a seventh aspect, this application provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method described in the first aspect above.
[0087] Eighthly, this application provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method described in the second aspect above.
[0088] Ninthly, this application provides a circuit system including a processing circuit configured to perform the method described in the first aspect above.
[0089] In a tenth aspect, this application provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method described in the second aspect above.
[0090] In the eleventh aspect, this application provides a computer program that, when run on a computer, causes the computer to perform the method described in the first aspect above.
[0091] In a twelfth aspect, this application provides a computer program that, when run on a computer, causes the computer to perform the method described in the second aspect above.
[0092] In a thirteenth aspect, this application provides a chip system including a processor for supporting a server or threshold acquisition device in implementing the functions involved in the foregoing aspects, such as transmitting or processing data and / or information involved in the foregoing methods. In one possible design, the chip system further includes a memory for storing program instructions and data necessary for the server or communication device. This chip system may be composed of chips or may include chips and other discrete devices.
[0093] This application provides a content sharing method applied to a first device, the first device including a display screen. The method includes: obtaining the spatial location of a second device; if the first device is identified as pointing towards the spatial location of the second device, then instructing the user to obtain content to be shared on the second device. This embodiment determines which device in space is the second device receiving the content to be shared based on the direction pointed by the first device, eliminating the need for the user to select the device to share content from a menu bar, thus reducing the user's operational costs and selection time. Attached Figure Description
[0094] Figure 1 This is a schematic diagram of a system;
[0095] Figure 2 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0096] Figure 3 This is a software structure block diagram of an electronic device according to an embodiment of the present invention;
[0097] Figure 4 A flowchart illustrating a content sharing method provided in an embodiment of this application;
[0098] Figure 5 This application provides a schematic diagram of an interface operation.
[0099] Figure 6 This application provides a schematic diagram of an interface operation.
[0100] Figure 7 This application provides a schematic diagram of an interface operation.
[0101] Figure 8a This application provides a schematic diagram of an interface operation.
[0102] Figure 8b This application provides a schematic diagram of an interface operation.
[0103] Figure 9 This application provides a schematic diagram of an interface operation.
[0104] Figure 10 This application provides a schematic diagram of an interface operation.
[0105] Figure 11 This application provides a schematic diagram of an interface operation.
[0106] Figure 12 This application provides a schematic diagram of an interface operation.
[0107] Figure 13This application provides a schematic diagram of an interface operation.
[0108] Figure 14 This application provides a schematic diagram of an interface operation.
[0109] Figure 15 This application provides a schematic diagram of an interface operation.
[0110] Figure 16 This application provides a schematic diagram of an interface operation.
[0111] Figure 17 This application provides a schematic diagram of an interface operation.
[0112] Figure 18 This application provides a schematic diagram of an interface operation.
[0113] Figure 19 This application provides a schematic diagram of an interface operation.
[0114] Figure 20 This application provides a schematic diagram of an interface operation.
[0115] Figure 21 This application provides a schematic diagram of an interface operation.
[0116] Figure 22 This application provides a schematic diagram of an interface operation.
[0117] Figure 23 This application provides a schematic diagram of an interface operation.
[0118] Figure 24 This application provides a schematic diagram of an interface operation.
[0119] Figure 25 This application provides a schematic diagram of an interface operation.
[0120] Figure 26 This application provides a schematic diagram of an interface operation.
[0121] Figure 27 This application provides a schematic diagram of an interface operation.
[0122] Figure 28 This application provides a schematic diagram of an interface operation.
[0123] Figure 29 This application provides a schematic diagram of an interface operation.
[0124] Figure 30This application provides a schematic diagram of an interface operation.
[0125] Figure 31 This application provides a schematic diagram of an interface operation.
[0126] Figure 32 This application provides a schematic diagram of an interface operation.
[0127] Figure 33 This application provides a schematic diagram of an interface operation.
[0128] Figure 34 This application provides a schematic diagram of an interface operation.
[0129] Figure 35 This application provides a schematic diagram of an interface operation.
[0130] Figure 36 This application provides a schematic diagram of an interface operation.
[0131] Figure 37 This application provides a schematic diagram of an interface operation.
[0132] Figure 38 This application provides a schematic diagram of an interface operation.
[0133] Figure 39 This application provides a schematic diagram of an interface operation.
[0134] Figure 40 This application provides a schematic diagram of an interface operation.
[0135] Figure 41 A schematic diagram of the structure of a content sharing device provided in an embodiment of this application;
[0136] Figure 42 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. Detailed Implementation
[0137] The embodiments of this application will now be described with reference to the accompanying drawings. Those skilled in the art will recognize that, with technological advancements and the emergence of new scenarios, the technical solutions provided in the embodiments of this application are equally applicable to similar technical problems.
[0138] The terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such terms are interchangeable where appropriate; this is merely a way of distinguishing objects with the same attributes in the embodiments of this application. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion, so that a process, method, system, product, or apparatus that comprises a series of elements is not necessarily limited to those elements, but may include other elements not explicitly listed or inherent to those processes, methods, products, or apparatuses.
[0139] Figure 1 This is a schematic diagram of a system 10 according to some exemplary embodiments. The system 10 may include multiple devices. Figure 1 The devices within can communicate with each other. In a non-limiting embodiment, such as... Figure 1 As shown, the system 10 may include multiple smart devices such as mobile phones 11, tablets 12, smart glasses 13, watches 14, speakers 15, smart screens 16, and laptops 17. In addition, the devices in the system 10 may also include media players (such as MP3, MP4, etc.), ultra-mobile personal computers (UMPC), personal digital assistants (PDAs), wireless headphones, smart bracelets, wireless in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, or televisions, etc.
[0140] In a non-limiting embodiment, when the environment of system 10 is a home or similar environment, multiple devices can be located within the same local area network. For example... Figure 1As shown, system 10 may further include router 101, which can be configured as an access point (AP) to provide a signal source for the network. Furthermore, each device in system 10 can connect to router 101 as a station (STA). Router 101 can communicate with each device via wired or wireless networks. For example, devices can establish Wi-Fi links using the Wireless Fidelity (Wi-Fi) protocol to enable communication. Specifically, this can be achieved by establishing peer-to-peer (P2P) connections (or Wi-Fi Direct) or by connecting all devices to the same router 101. In other embodiments, devices can also establish Bluetooth links using the Bluetooth protocol to enable communication; alternatively, devices can communicate via mobile networks or the Internet.
[0141] The first device in this application embodiment can be one of the mobile phone 11, tablet 12, smart glasses 13 or watch 14 in the above system, and the second device and the third device can be any of the devices in the above system.
[0142] Please refer to Figure 2 This is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of this application. The structures of the above-mentioned devices (including the first device, the second device, and the third device) can all be as follows. Figure 2 As shown.
[0143] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0144] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0145] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.
[0146] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.
[0147] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0148] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0149] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.
[0150] The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple I2S buses. The processor 110 can be coupled to the audio module 170 via the I2S bus to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the I2S interface to enable the function of answering phone calls through a Bluetooth headset.
[0151] The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 can be coupled via the PCM bus interface. In some embodiments, the audio module 170 can also transmit audio signals to the wireless communication module 160 via the PCM interface, enabling the function of answering phone calls through a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication.
[0152] The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication. In some embodiments, the UART interface is typically used to connect the processor 120 and the wireless communication module 160. For example, the processor 120 communicates with the Bluetooth module in the wireless communication module 160 via the UART interface to implement Bluetooth functionality. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 via the UART interface to enable music playback through Bluetooth headphones.
[0153] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 120 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.
[0154] The GPIO interface is configurable via software. It can be configured as a control signal or a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 to a camera 193, a display screen 194, a wireless communication module 160, an audio module 170, a sensor module 180, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.
[0155] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, USB Type-C port, etc. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.
[0156] It is understood that the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0157] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.
[0158] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.
[0159] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0160] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.
[0161] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0162] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.
[0163] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0164] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0165] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0166] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0167] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0168] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0169] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0170] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0171] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0172] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0173] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.
[0174] Internal memory 121 can be used to store computer executable program code, which includes instructions. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. Processor 110 executes various functional applications and data processing of electronic device 100 by running instructions stored in internal memory 121 and / or instructions stored in memory located in the processor.
[0175] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0176] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.
[0177] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.
[0178] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.
[0179] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0180] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.
[0181] Figure 3 This is a software structure block diagram of the electronic device 100 according to an embodiment of the present invention.
[0182] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0183] The application layer can include a series of application packages.
[0184] like Figure 3 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.
[0185] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0186] like Figure 3 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0187] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.
[0188] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0189] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0190] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).
[0191] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0192] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.
[0193] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
[0194] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0195] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0196] System libraries can include multiple functional modules. For example, a surface manager, media libraries, and 3D graphics processing libraries (e.g., OpenGL ES).
[0197] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0198] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0199] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0200] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0201] The following example, using a scene of capturing a photograph, illustrates the workflow of the software and hardware of the electronic device 100.
[0202] When touch sensor 180K receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, timestamp of the touch operation, etc.). The raw input event is stored in the kernel layer. The application framework layer retrieves the raw input event from the kernel layer and identifies the control corresponding to the input event. Taking a touch click as an example, where the corresponding control is the camera application icon, the camera application calls the application framework layer's interface to launch the camera application, and then calls the kernel layer to launch the camera driver, capturing still images or videos through camera 193.
[0203] In a non-limiting embodiment, such as Figure 3 As shown, the system library may also include a network manager, which is used to discover devices in system 10. Discovered devices can be selected as notification devices and / or connection devices. In some embodiments, when devices in system 10 are connected to the same AP to form a local area network (LAN), the devices in system 10 are considered peripheral devices, or devices near the user. The network manager of one device in system 10 can discover all other online devices located under the same AP, and all online devices under the same AP (including one device and other devices in system 10) complete the network formation. In some embodiments, if the network manager of one device in system 10 discovers that one or more other online devices within the LAN of the same AP are logged into the account of one device, or that one or more other devices are logged into the account associated with the account logged into one device, then the other devices logged into that account or associated account are trusted devices of that device, or all devices logged into that account or associated account are trusted devices. Networking between devices logged into accounts or associated accounts under the same AP ensures the security and privacy of notifications. In some embodiments, when devices in system 10 communicate via a mobile network or the internet, the network manager can discover that some devices in system 10 are logged into the same or related accounts. When these devices are near the user, they form a network, ensuring the security and privacy of notifications. The related account can be an account authorized by the same user. Specifically, Bluetooth RSSI (Received Signal Strength Indication) or satellite positioning can be used to determine the distance between devices and the distance between the user and each device. The network manager can discover devices in system 10 near the user, increasing the interaction and collaboration capabilities between devices, avoiding the need for the user to manually search for and filter devices in system 10, reducing user operations, and improving efficiency.
[0204] Reference Figure 4 , Figure 4 This is a flowchart illustrating a content sharing method provided in an embodiment of this application, such as... Figure 4 As shown in the figure, the content sharing method provided in the embodiments of this application includes:
[0205] 401. Obtain the spatial location of the second device.
[0206] In this embodiment, the first device can be a mobile phone, a tablet, or AR / VR glasses.
[0207] Next, we will take a mobile phone or tablet as an example for explanation.
[0208] In this embodiment, the first device and the second device can be connected via Bluetooth, Wi-Fi, or UWB. When using the first device, the user may need to share data (or content to be shared) or obtain data from other devices connected to it. In this case, the user can select content-sharing related function controls on the first device.
[0209] In one possible implementation, refer to Figure 5 , Figure 5 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 5 As shown, if a user wants to share a photo to other devices, they can long-press the content to be shared (such as an image) displayed on the first device. The first device can then display controls related to operating the content to be shared, such as... Figure 6 As shown, in response to a user's long-press operation on the content to be shared, the first device can display multiple controls, including but not limited to "Share" controls, "Delete" controls, etc., which the user can click on. In existing implementations, the first device, in response to a click on the "Share" control, displays all devices that can share content for the user to choose from. However, the order in which devices are displayed is usually related to the signal strength of the devices. When the signal is unstable or the user moves, the display order of the devices will change, making it easy to accidentally touch the device during selection. In addition, since the system cannot sense that the user wants to interact with the target device, it can only list all the scanned devices, increasing the user's operating cost and selection time.
[0210] Reference Figure 7 , Figure 7 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 7 As shown, in response to a click on the "Share" control, the first device displays a sharing mode selection interface, which can include regular sharing modes, such as... Figure 7The "Select from connected devices" control shown in the image allows the first device to display all devices that can share content with it. The sharing mode selection interface may also include gesture-based selection of the device's sharing mode, for example... Figure 7 The “Enter Gesture Selection Mode” control shown in the figure allows the user to enter the mode provided in this embodiment, where the user can select the device (such as the second device in this embodiment) to share content by controlling the pointing of the first device.
[0211] In one possible implementation, the first device can display instructions for user operation, prompting the user to point the first device at the device they wish to share data with. These instructions can be text or graphics, such as references... Figure 8a The first device can display the text prompt "Please point to the device you want to share with," and then the user can point the first device to the device where the content needs to be shared (such as the second device in this embodiment). It should be understood that the above text guidance is only illustrative and is not limited in scope.
[0212] It should be understood that, in the embodiments of this application,
[0213] The orientation of the first device can be understood as the direction pointed by the line connecting the user and the end of the first device away from the user when the user is operating the first device, or the direction pointed by the line connecting a reference point on the first device and the end of the first device away from the user. It should be understood that the main axis can be the direction pointed by the line connecting the user and the end of the first device away from the user when the user is operating the first device. Depending on the shape of the first device, the main axis of the first device can have different orientations. Also, depending on the shape of the first device, the reference point on the first device can be different. For example, the reference point on a mobile phone can be a point in the central area, while the reference point on AR / VR glasses can be a point near the midpoint of the line connecting the centers of the lenses.
[0214] In one implementation, the orientation of the first device can be understood as the orientation of the main axis of the first device, wherein the first device includes a rectangular touchscreen, and the angle between the main axis and the longest side of the rectangular touchscreen is within a preset range. (See reference...) Figure 8b , Figure 8b This is an illustration of an operation gesture provided in an embodiment of this application, such as... Figure 8b As shown in the figure, the main axis ( Figure 8b The dashed line in the image can be parallel to the longest side of the rectangular touchscreen or have a small angle between them.
[0215] It should be understood that the main axis can be the direction pointed to by the line connecting the user and the end of the first device away from the user when the user is operating the first device. Depending on the shape of the first device, the main axis of the first device can have different orientations.
[0216] In one possible implementation, if a user wants to and Figure 9 To share content with the smart screen (second device) shown, the first device can be moved until its main axis points to the second device. The first device can obtain the positions of connected devices. When the first device detects that its main axis points to the smart screen (second device), it performs content sharing operations with the second device. In this embodiment, the position of the second device can be represented by the distance and angle between the first and second devices, or by the coordinate position of the second device; it is not limited here.
[0217] The following describes how the first device determines the position of the second device. In one implementation, the first device can determine the position of the second device using existing technologies such as ultra-wideband (UWB), ultrasound, laser, or vision. For example, relative distance and direction can be established through a bidirectional connection between the first and second devices (requiring hardware capable of transmitting / receiving wireless positioning signals on both devices), calculating the distance and angle between the handheld first device and other devices. In another implementation, triangulation can be performed among multiple devices (the handheld device has hardware capable of transmitting / receiving wireless positioning signals, and there are three or more fixed devices in the space with the same hardware capability; this hardware can exist independently or depend on other devices with the same hardware installed in the space), using the time difference of arrival (TODA) to determine the absolute position of the handheld first device. When there are enough devices with the capability to transmit / receive wireless positioning signals, the six degrees of freedom (6DoF) attitude of the handheld first device can be determined. The devices can share their respective attitudes, thus allowing the first device to acquire its own attitude and the attitude of the second device, thereby obtaining the position of the second device.
[0218] In one implementation, the first device can determine whether it is pointing at the second device based on the obtained distance and angle between the first device and the second device.
[0219] It should be understood that when the first device detects that the main axis is pointing to the smart screen (second device), it can perform security checks with the second device. For example, when the first device establishes a connection with the second device for the first time, the original display content of the first device will be blurred / covered, and the user will be prompted to authenticate on the first device. The authentication method can be, but is not limited to, authentication by using fingerprint or facial recognition.
[0220] In this embodiment, after authentication, the first device can display a sharing interface, which may include a first identifier used to indicate the content to be shared by the second device. In one implementation, the content to be shared by the second device may be an image, and the first identifier may be a thumbnail of the image. Specifically, after the first and second devices establish a connection, the second device can select an image that the first device can select and obtain as its content to be shared, and send a thumbnail of the image to the first device. When the first device receives the thumbnail, it can display the received thumbnail (the received thumbnail) in a second area (used to display content related to the content to be shared by the second device) within the display interface. The second area may be at the top of the first device's display screen or in another location, as shown below. Figure 10 , Figure 10 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 10 As shown, the first device displays a second area, which may include a thumbnail of an image of the second device (e.g., a smart screen). The first device may also display an identifier for the second device to indicate that the currently established connection is with the second device (e.g., a smart screen). Figure 10 The logo corresponding to the smart screen is shown in the image.
[0221] In this embodiment, if the device the first device is pointing to is not the device the user wants to share content with, the first device can be moved so that its main axis points to the spatial location of the device where the user wants to share content. (Refer to...) Figure 11 , Figure 11 This is a schematic diagram of a user's gesture operation in an embodiment of this application, such as... Figure 11 As shown in the diagram, in the initial state, the main axis of the first device points towards the smart screen, and at this time, the display interface of the first device can be as follows: Figure 10 As shown, the user then moves the first device so that its main axis points to... Figure 11 The phone carried by a female student (such as Xiaohong) can display the following interface on the primary device: Figure 12 As shown, in this case, the second area displayed on the first device may include a first identifier indicating the content to be shared related to the second device (i.e., Xiaohong's phone).
[0222] In this embodiment of the application, if the main axis of the first device points to multiple devices, that is, the first device can obtain the spatial positions of multiple devices, and the main axis of the first device points to the spatial position of each of the multiple devices, refer to... Figure 13 , Figure 13 This is a schematic diagram of a user's gesture operation in an embodiment of this application, such as... Figure 13As shown, the main axis of the first device points to two devices (carried by two people respectively). For example, the first device points to the spatial location of Xiaoming's phone and the spatial location of Xiaohong's phone at the same time.
[0223] In this scenario, the first device can also obtain the location of the third device (the second device is Xiaohong's phone, and the third device is Xiaoming's phone); if the main axis of the first device points to the spatial location of both the second and third devices, then a third and a fourth identifier are displayed; the third identifier indicates the second device, and the fourth identifier indicates the third device; upon detecting a selection operation targeting the third identifier, the device obtains the content to be shared on the second device or sends the content to be shared from the first device to the second device. (See reference...) Figure 14 , Figure 14 This is a schematic diagram of a user's gesture operation in an embodiment of this application, such as... Figure 14 As shown in the diagram, the first device can then display a third identifier (e.g., Figure 14 "Little Red's device" and the fourth identifier (e.g.) Figure 14 In the context of "Xiaoming's device", the user can select a third identifier, and then the first device can detect the selection operation for the third identifier and establish a connection with the second device (it should be understood that establishing a connection with the second device means that the first device can obtain the content to be shared on the second device or send the content to be shared from the first device to the second device).
[0224] In one possible implementation, if the main axis of the first device points to multiple devices, and the user, after selecting one device as the target device for content sharing with the first device, needs to change the target device for content sharing, they can select the relevant controls for changing the device. For example, refer to... Figure 15 , Figure 15 This is a schematic diagram of a user's gesture operation in an embodiment of this application, such as... Figure 15 As shown in the diagram, the first device has established a sharing connection with Xiaohong's phone. If the user wants to change Xiaohong's phone to Xiaoming's phone, they can click on the corresponding icon for Xiaohong's phone, and refer to... Figure 16 , Figure 16 This is a schematic diagram of a user display interface in an embodiment of this application, such as... Figure 16 As shown, the first device responds to the user's click on the icon corresponding to Xiaohong's phone by displaying icons corresponding to both Xiaohong's and Xiaoming's phones. The user can click on the icon corresponding to Xiaoming's phone, such as... Figure 17 As shown, the first device can respond to the user's click on the corresponding icon on Xiaoming's phone, changing the device to share content with the first device from Xiaohong's phone to Xiaoming's phone.
[0225] In another implementation, the first device may determine the device closest to itself among the plurality of devices as the second device. (See also...) Figure 18 , Figure 18 This is a schematic diagram of a user's gesture operation in an embodiment of this application, such as... Figure 18 As shown, the main axis of the first device points to two devices carried by two users, wherein one user's device (e.g., Xiaoming's) is closer to the first device than the other user's device (e.g., Xiaohong's). The first device can determine the device closest to it among the plurality of devices as the second device, and thus the first device can display as shown... Figure 19 The interface shown.
[0226] In this embodiment, when using the first device, the user may have a need to share data (or content to be shared) or obtain data from other devices connected to the first device. In this case, the user can select function controls related to content sharing on the first device.
[0227] In one possible implementation, refer to Figure 20 , Figure 20 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 20 As shown, users can trigger sharing with the object via the gesture operation described above by clicking the "Gesture Sharing" control on the drop-down menu of the first device's interface.
[0228] In one possible implementation, refer to Figure 21 , Figure 21 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 21 As shown, users can trigger sharing with the object via the gesture operation described above by clicking the "Gesture Sharing" application on the system interface of the first device.
[0229] The first device can respond to the above. Figure 20 or Figure 21 User operations within the system interface display a second area, which may include a first identifier indicating the content to be shared on the second device. In one possible implementation, refer to... Figure 22 , Figure 22 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 22 As shown in the diagram, the first device can display a first area and a second area, wherein the first area includes the system interface of the first device, and the second area includes a first identifier indicating the content to be shared by the second device.
[0230] 402. If the spatial location of the first device pointing to the second device is identified, then instruct the first device to send the content to be shared to the second device.
[0231] The following describes how to send the content to be shared by the first device to the second device based on the interface displayed by the first device.
[0232] First, in response to sending the content to be shared by the first device to the second device, the first device can detect a second target operation targeting a second identifier, wherein the second identifier is used to indicate the content to be shared by the first device; the first device can respond to the second target operation by sending the content to be shared by the first device to the second device.
[0233] In one possible implementation, the second target operation includes a second drag operation, the starting point of which is located in the area where the second identifier is located. The first device may also display a second area at the top layer of the display interface, and the ending point of the second drag operation is located in the second area. Specifically, see [reference needed]. Figure 23 , Figure 23 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 23 As shown, a user can press the image (second identifier) that they want to share to a second device, and then drag the image to the second area. During the dragging process, the first device can display the identifier of the dragged image, which can move along the user's dragging trajectory. After the user drags the image to the second area, they can lift their hand, that is, the end point of the second drag operation is located in the second area, and then the image is shared to the second device.
[0234] In one implementation, as the user drags an image to the second area, the image can be enlarged and displayed as a card. Specifically, if the content is shareable, a long press or pressure reaching a threshold will provide feedback on the first device (including but not limited to visual, auditory, and haptic feedback). The content to be shared floats on the screen as a preview card. In addition to the preview card, different forms of context menus can be added as needed. For details, please refer to... Figure 24 , Figure 24 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 24 As shown, a user can press the image they want to share to a second device (the second icon), after which the first device can zoom in on the image and display it as a card (e.g., ...). Figure 25 As shown in the image).
[0235] In one implementation, after a user drags an image to the second area and raises their hand, the first device can respond to the user's second drag operation by sending the content to be shared by the first device corresponding to the second identifier to the second device.
[0236] In one possible implementation, the second target operation includes a second long press operation and a second click operation. The user can perform a second long press operation on the second identifier. After the long press lasts for a certain period of time, the first device can detect the second long press operation applied to the second identifier. In response to the second long press operation, a second content sharing option is displayed. The user can perform a second click operation on the second content sharing option. The first device can detect the second click operation on the second content sharing option and send the content to be shared from the first device to the second device.
[0237] In one possible implementation, after the first device sends the content to be shared to the second device, the first device may display a prompt or other feedback (such as vibration, flashing lights, sound alerts, etc.) indicating that the content has been sent to the second device. For example, see [reference to...] Figure 26 , Figure 26 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 26 As shown in the image, the second device can display a prompt indicating that the content to be shared has been sent to the second device: "XXX file has been sent to Xiaohong's phone".
[0238] In one possible implementation, after the first device sends the content to be shared to the second device, the second device can display a notification that it has received the content to be shared from the first device. (See also...) Figure 27 , Figure 27 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 27 As shown, the second device can display a notification that it has received the content to be shared from the first device: "File XXX received, saved to the XXXX directory".
[0239] In another implementation, if the spatial location of the second device is identified as being pointed to by the first device, then the content to be shared on the second device is instructed to be retrieved.
[0240] In this embodiment of the application, for obtaining the content to be shared on the second device, the first device may display a first identifier, which is used to indicate the content to be shared on the second device; the first identifier is located at the top layer of the display interface of the first device, and the first device may detect a first target operation on the first identifier; in response to the first target operation, the content to be shared on the second device is obtained.
[0241] In one possible implementation, the first target operation includes a first drag operation, the starting point of which is located in the area where the first identifier is located.
[0242] In one possible implementation, the first device may display a first area, which includes a second identifier or the system interface of the first device. The second identifier indicates the content to be shared by the first device, and the endpoint of the first drag operation is located in the first area. See also... Figure 28 , Figure 28 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 28 As shown, the user can press the image they want to acquire (indicated by a first identifier) and then drag the image to a first area. During the dragging process, the first device can display an identifier of the dragged image, which can move along the user's dragging trajectory. After the user drags the image to the first area, they can lift their hand, meaning the end point of the first dragging operation is located in the first area, and thus the first device can acquire the image.
[0243] In one implementation, as the user drags an image to the first area, the image can be enlarged and displayed as a card. For details, please refer to [link / reference needed]. Figure 29 , Figure 29 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 29 As shown in the image, the user can press the image they want to view (first identifier), and then the first device can zoom in on the image and display it in a card format (e.g., ...). Figure 30 As shown in the image).
[0244] In one implementation, after a user drags an image to the first area and raises their hand, the first device can respond to the user's first drag operation by sending a content retrieval request to the second device. The content retrieval request may carry an indication of the content to be shared corresponding to the first identifier. After receiving the indication, the second device can send the content to be shared corresponding to the first identifier to the first device.
[0245] In one implementation, the first target operation may include a first long press operation and a first click operation. The first device may detect the first long press operation acting on the first identifier; in response to the first long press operation, display a first content sharing option; and detect the first click operation targeting the first content sharing option.
[0246] In one possible implementation, after the first device obtains the content to be shared from the second device, the first device may display a prompt indicating that it has obtained the content to be shared from the second device. (See also...) Figure 31 , Figure 31 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 31 As shown in the diagram, the first device can display a prompt indicating that it has received the content to be shared from the second device: "File XXX has been received and saved to the XXXX directory".
[0247] The following describes how the first device displays the first identifier.
[0248] In one implementation, the second device can have multiple pieces of content to be shared, stored in different paths, for example, refer to Figure 32 , Figure 32 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 32 As shown, the content to be shared from the second device to the first device can include photos from the photo directory. After the first and second devices establish a content-sharing connection, the second device can send thumbnails of all images in the photo directory to the first device. The first device can then select one of these thumbnails or the first one to display, for example, see [reference]. Figure 33 , Figure 33 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 33 As shown, the first device can display a second area, which may include an image selected by the first device from all image thumbnails in the second device's photo directory. Furthermore, the first device can display a cascading tooltip below the image; if the user clicks on the image, the first device can then expand and display all image thumbnails in the second device's photo directory, such as... Figure 33 As shown in the image, users can click on the image, such as Figure 34 As shown, the first device can respond to a user's click on an image by expanding and displaying all image thumbnails in the second device's photo directory. The first device can also display a prompt to collapse the images; if the user clicks this prompt, the first device can respond by collapsing all image thumbnails in the second device's photo directory, displaying only the initially selected image (e.g., as shown). Figure 35 As shown in the image).
[0249] For example, refer to Figure 36 , Figure 36 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 36 As shown, the second device is on the system's display interface. In this case, the first device and the second device establish a connection that allows content sharing. (Refer to...) Figure 37 , Figure 37 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 37As shown, the first device displays a second area, which may include multiple identifiers, each indicating a path on the second device. Under each of these paths, the second device stores at least one piece of content to be shared to the first device, for example... Figure 37 The image shows the "Gallery" icon, the "Memos" icon, and the "File Management" icon. Technically, the second device can acquire content that can be shared to the first device and send the content and an icon indicating its location to the first device. The first device can display the icon indicating the location of the path. It should be understood that the user can click on the icon indicating the location of the path on the first device, and the first device can expand and display the content to be shared corresponding to that path.
[0250] In the embodiments of this application, such as Figure 37 As shown in the image, users can open their local gallery and refer to... Figure 38 , Figure 38 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 38 As shown, users can drag a photo from the gallery to a marker corresponding to a path in the second area (e.g., Figure 38 The image is located in the area indicated by the gallery icon shown in the image library. The first device can then send the image to the second device, which can save the image to its local gallery. Similarly, the user can drag an icon indicating a document from their local storage to an icon corresponding to a path in the second area (e.g., [image library icon]). Figure 38 The first device can send the document to the second device (as indicated by the memo identifier shown in the image) within the designated area, and the second device can then save the document to its local memo folder. Specifically, the first device can send the content to be shared and the path selected by the user to the second device, and the second device can save the received content to be shared to the path selected by the user.
[0251] Reference Figure 39 , Figure 39 This is a schematic diagram of a terminal display interface provided in an embodiment of this application, such as... Figure 39 As shown in the image, the first device can display a prompt indicating that the content to be shared has been sent to the second device: "File XXX has been sent to Xiaoming's gallery."
[0252] In addition, the first device can also be a VR / AR device, such as Figure 40 As shown, the first device may include a lens, and the angle between the principal axis and the perpendicular line to the plane containing the lens is within a preset range. For details on how the VR / AR device acquires the content to be shared from the second device or sends the content to be shared from the first device to the second device, please refer to the above embodiments. Figures 4 to 39 The similarities between the contents shown in the previous text are not repeated here.
[0253] This application provides a content sharing method applied to a first device, the first device including a display screen. The method includes: obtaining the spatial location of a second device; if the first device is identified as pointing towards the spatial location of the second device, then obtaining the content to be shared on the second device. This embodiment determines which device in space is the second device receiving the content to be shared based on the direction pointed by the first device, eliminating the need for the user to select the device to share content from a menu bar, thus reducing the user's operational costs and selection time.
[0254] Reference Figure 41 , Figure 41 This is an illustration of a content sharing device provided in an embodiment of this application, such as... Figure 41 As shown in the figure, an embodiment of this application provides a content sharing device 4100, the device comprising:
[0255] The acquisition module 4101 is used to acquire the spatial location of the second device;
[0256] The sharing module 4102 is used to instruct the user to obtain the content to be shared on the second device if the first device is identified as pointing to the spatial location of the second device.
[0257] In one possible implementation, the pointing direction of the first device is determined according to a preset main axis of the first device; the main axis of the first device passes through a reference point of the first device.
[0258] In one possible implementation, the first device is a mobile phone or tablet, and the first device includes a rectangular touchscreen, wherein the angle between the main axis and the longest side of the rectangular touchscreen is within a preset range.
[0259] In one possible implementation, the first device is a virtual reality (VR) / augmented reality (AR) glasses, the first device includes a lens, and the angle between the main axis and the perpendicular line to the plane where the lens is located is within a preset range.
[0260] In one possible implementation, the sharing module is configured to: display a first identifier, the first identifier indicating the content to be shared on the second device; detect a first target operation targeting the first identifier; and, in response to the first target operation, acquire the content to be shared on the second device.
[0261] In one possible implementation, the first identifier is located at the top layer of the display interface of the first device.
[0262] In one possible implementation, the first target operation includes a first drag operation, the starting point of which is located in the area where the first identifier is located.
[0263] In one possible implementation, the device further includes:
[0264] A display module is used to display a first area, the first area including a second identifier or the system interface of the first device, the second identifier being used to indicate the content to be shared by the first device, and the end point of the first drag operation being located in the first area.
[0265] In one possible implementation, the first target operation includes a first long press operation and a first click operation, and the sharing module is configured to: detect the first long press operation applied to the first identifier; display a first content sharing option in response to the first long press operation; and detect the first click operation on the first content sharing option.
[0266] In one possible implementation, the sharing module is configured to detect a second target operation targeting a second identifier; the second identifier is configured to indicate the content to be shared by the first device; and in response to the second target operation, to send the content to be shared by the first device to the second device.
[0267] In one possible implementation, the second target operation includes a second drag operation, the starting point of which is located in the area where the second identifier is located.
[0268] In one possible implementation, the display module is configured to display a second area at the top layer of the display interface of the first device, and the endpoint of the second drag operation is located in the second area.
[0269] In one possible implementation, the second target operation includes a second long press operation and a second click operation, wherein the sharing module is configured to detect the second long press operation acting on the second identifier; display a second content sharing option in response to the second long press operation; and detect the second click operation on the second content sharing option.
[0270] In one possible implementation, the acquisition module is used to acquire the spatial positions of multiple devices, and the main axis of the first device points to the spatial position of each of the multiple devices; and to determine the device among the multiple devices that is closest to the first device as the second device.
[0271] In one possible implementation, the sharing module is used to obtain the location of the third device; if the main axis of the first device points to the spatial location of the second device and the spatial location of the third device, then a third identifier and a fourth identifier are displayed; the third identifier is used to indicate the second device, and the fourth identifier is used to indicate the third device; a selection operation for the third identifier is detected, and the content to be shared on the second device is obtained.
[0272] In one possible implementation, the second device includes a display screen on which the content to be shared by the second device is displayed.
[0273] This application embodiment also provides a content sharing device, the device comprising:
[0274] The acquisition module is used to acquire the spatial location of the second device;
[0275] The sharing module is used to instruct the first device to send the content to be shared to the second device if it is recognized that the first device is pointing to the spatial location of the second device.
[0276] In one possible implementation, the pointing direction of the first device is determined according to a preset main axis of the first device; the main axis of the first device passes through a reference point of the first device.
[0277] In one possible implementation, the first device is a mobile phone or tablet, and the first device includes a rectangular touchscreen, wherein the angle between the main axis and the longest side of the rectangular touchscreen is within a preset range.
[0278] In one possible implementation, the first device is a virtual reality (VR) / augmented reality (AR) glasses, the first device includes a lens, and the angle between the main axis and the perpendicular line to the plane where the lens is located is within a preset range.
[0279] In one possible implementation, the sharing module is configured to: detect a second target operation targeting a second identifier; the second identifier is used to indicate the content to be shared by the first device;
[0280] In response to the second target operation, the content to be shared from the first device is sent to the second device.
[0281] In one possible implementation, the second target operation includes a second drag operation, the starting point of which is located in the area where the second identifier is located.
[0282] In one possible implementation, the device further includes:
[0283] The display module is used to display a second area at the top of the display interface of the first device, and the endpoint of the second drag operation is located in the second area.
[0284] In one possible implementation, the second target operation includes a second long press operation and a second click operation, and the sharing module is configured to: detect the second long press operation acting on the second identifier;
[0285] In response to the second long press, the second content sharing option is displayed;
[0286] A second click operation on the second content sharing option was detected.
[0287] In one possible implementation, the acquisition module is used to acquire the spatial positions of multiple devices, and the main axis of the first device points to the spatial position of each of the multiple devices;
[0288] The device closest to the first device among the plurality of devices is identified as the second device.
[0289] In one possible implementation, the sharing module is used to obtain the location of a third device;
[0290] If the main axis of the first device points to the spatial location of the second device and the spatial location of the third device, then a third identifier and a fourth identifier are displayed; the third identifier is used to indicate the second device, and the fourth identifier is used to indicate the third device.
[0291] Upon detecting a selection operation for the third identifier, the content to be shared from the first device is sent to the second device.
[0292] In one possible implementation, the second device includes a display screen on which the content to be shared by the second device is displayed.
[0293] This application discloses an electronic device, which can be the first device described in the above embodiments, including a processor, and a memory, input device, output device, and communication module connected to the processor. The input device and output device can be integrated into one device; for example, a touch sensor can be used as an input device, a display screen as an output device, and the touch sensor and display screen can be integrated into a touchscreen.
[0294] At this time, as Figure 42As shown, the above-mentioned electronic device may include: a touch screen 1301, which includes a touch sensor 1306 and a display screen 1307; one or more processors 1302; a memory 1303; a communication module 1308; one or more application programs (not shown); and one or more computer programs 1304. These devices can be connected via one or more communication buses 1305. The one or more computer programs 1304 are stored in the memory 1303 and configured to be executed by the one or more processors 1302. The one or more computer programs 1304 include instructions that can be used to perform the various steps in the above embodiments. All relevant content regarding the steps involved in the above method embodiments can be referenced from the functional descriptions of the corresponding physical devices, and will not be repeated here.
[0295] For example, the processor 1302 described above can specifically be... Figure 2 The processor 110 shown above, and the memory 1303 mentioned above, can specifically be... Figure 2 The internal memory 121 and / or external memory 120 shown above, and the display screen 1307 can specifically be... Figure 2 The touch sensor 1306 on the display screen 194 shown can specifically be... Figure 2 The touch sensor in the sensor module 180 shown above, and the communication module 1308 mentioned above can specifically be... Figure 2 The mobile communication module 150 and / or wireless communication module 160 shown are not limited in this embodiment.
[0296] Specifically, one or more processors 1302 may perform the following steps:
[0297] Obtain the spatial location of the second device; if the first device is identified as pointing to the spatial location of the second device, instruct the acquisition of the content to be shared on the second device.
[0298] Specifically, one or more processors 1302 can control the display screen 1307 to display a first identifier, the first identifier being used to indicate the content to be shared on the second device; detect a first target operation targeting the first identifier; and in response to the first target operation, acquire the content to be shared on the second device.
[0299] Specifically, one or more processors 1302 can control the display screen 1307 to display a first area, the first area including a second identifier or the system interface of the first device, the second identifier being used to indicate the content to be shared by the first device, and the end point of the first drag operation being located in the first area.
[0300] Specifically, one or more processors 1302 can detect the first long press operation applied to the first identifier;
[0301] In response to the first long press operation, the control display screen 1307 displays the first content sharing option;
[0302] The first click operation for the first content sharing option was detected.
[0303] Specifically, one or more processors 1302 can obtain the spatial locations of multiple devices, and the main axis of the first device points to the spatial location of each of the multiple devices;
[0304] The device closest to the first device among the plurality of devices is identified as the second device.
[0305] Specifically, one or more processors 1302 can obtain the location of a third device;
[0306] If the main axis of the first device points to the spatial location of the second device and the spatial location of the third device, then a third identifier and a fourth identifier are displayed; the third identifier is used to indicate the second device, and the fourth identifier is used to indicate the third device.
[0307] A selection operation targeting the third identifier is detected, and the content to be shared on the second device is obtained.
[0308] Specifically, one or more processors 1302 can obtain the spatial location of the second device;
[0309] If the spatial location of the first device is identified as being pointed to by the second device, then the content to be shared by the first device is instructed to be sent to the second device.
[0310] Obtain the spatial location of the second device;
[0311] Specifically, one or more processors 1302 can identify the spatial location of the first device's main axis pointing to the second device; wherein the starting point of the first device's main axis is located in the central region of the first device.
[0312] Specifically, one or more processors 1302 can detect a second target operation targeting a second identifier; the second identifier is used to indicate the content to be shared by the first device;
[0313] In response to the second target operation, the content to be shared from the first device is sent to the second device.
[0314] Specifically, one or more processors 1302 can control the display screen 1307 to display a second area on the top layer of the display interface of the first device, and the end point of the second drag operation is located in the second area.
[0315] Specifically, one or more processors 1302 can detect the second long press operation acting on the second identifier; in response to the second long press operation, control the display screen 1307 to display a second content sharing option;
[0316] A second click operation on the second content sharing option was detected.
[0317] Specifically, one or more processors 1302 can obtain the spatial locations of multiple devices, and the main axis of the first device points to the spatial location of each of the multiple devices;
[0318] The device closest to the first device among the plurality of devices is identified as the second device.
[0319] Specifically, one or more processors 1302 can obtain the location of a third device;
[0320] If the main axis of the first device points to the spatial location of the second device and the spatial location of the third device, then a third identifier and a fourth identifier are displayed; the third identifier is used to indicate the second device, and the fourth identifier is used to indicate the third device.
[0321] Upon detecting a selection operation for the third identifier, the content to be shared from the first device is sent to the second device.
[0322] It should be understood that the embodiments of this invention are extremely diverse, and any of the above steps can be freely combined without violating the laws of nature. This application cannot describe all possible scenarios and implementations in detail. The description of related features can also be applied to other embodiments.
[0323] It should also be noted that the device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. In addition, in the device embodiment drawings provided in this application, the connection relationship between modules indicates that they have a communication connection, which can be implemented as one or more communication buses or signal lines.
[0324] Through the above description of the embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus necessary general-purpose hardware, or it can be implemented by special-purpose hardware including application-specific integrated circuits, special-purpose CPUs, special-purpose memory, special-purpose components, etc. Generally, any function performed by a computer program can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be diverse, such as analog circuits, digital circuits, or special-purpose circuits. However, for this application, software program implementation is more often a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium, such as a computer floppy disk, USB flash drive, mobile hard disk, ROM, RAM, magnetic disk, or optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, training equipment, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0325] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product.
[0326] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, training device, or data center to another website, computer, training device, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium may be any available medium that a computer can store or a data storage device such as a training device or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state drives (SSDs)).
Claims
1. A content sharing method, characterized in that, The method is applied to a first device, the first device including a display screen, and the method includes: Obtain the spatial location of the second device; If the spatial location of the first device is identified as pointing to the second device, then an instruction is given to retrieve the content to be shared on the second device; receiving an identifier indicating the path of the content to be shared sent by the second device, wherein retrieving the content to be shared on the second device includes: Displaying a first identifier, the first identifier being used to indicate the content to be shared by the second device; the displaying of the first identifier includes: displaying multiple identifiers, each identifier indicating a path on the second device, the path being used to indicate that the second device has at least one piece of content to be shared to the first device stored under the path; If a click is detected on one of the icons, the first icon is displayed; A first target operation targeting the first identifier was detected; In response to the first target operation, the content to be shared on the second device is obtained.
2. The method according to claim 1, characterized in that, The pointing direction of the first device is determined according to the preset main axis of the first device; the main axis of the first device passes through the reference point of the first device.
3. The method according to claim 1 or 2, characterized in that, The first device is a mobile phone or tablet, and the first device includes a rectangular touch screen. The angle between the main axis and the longest side of the rectangular touch screen is within a preset range.
4. The method according to claim 1 or 2, characterized in that, The first device is a virtual reality (VR) / augmented reality (AR) glasses. The first device includes a lens, and the angle between the main axis and the perpendicular line to the plane where the lens is located is within a preset range.
5. The method according to any one of claims 1 to 4, characterized in that, The first identifier is located at the top layer of the display interface of the first device.
6. The method according to any one of claims 1 to 4, characterized in that, The first target operation includes a first drag operation, the starting point of which is located in the area where the first identifier is located.
7. The method according to claim 6, characterized in that, The method further includes: The display shows a first area, which includes a second identifier or the system interface of the first device. The second identifier is used to indicate the content to be shared by the first device, and the end point of the first drag operation is located in the first area.
8. The method according to any one of claims 1 to 4, characterized in that, The first target operation includes a first long press operation and a first tap operation. The detection of the first target operation targeting the first identifier includes: The first long press operation applied to the first identifier was detected; In response to the first long press operation, the first content sharing option is displayed; The first click operation for the first content sharing option was detected.
9. The method according to any one of claims 1 to 8, characterized in that, The step of obtaining the spatial location of the second device includes: The spatial locations of multiple devices are obtained, and the main axis of the first device points to the spatial location of each of the multiple devices; The device closest to the first device among the plurality of devices is identified as the second device.
10. The method according to any one of claims 1 to 9, characterized in that, If the first device points to the spatial location of the second device, then the content to be shared on the second device is obtained, including: Obtain the location of the third device; If the main axis of the first device points to the spatial location of the second device and the spatial location of the third device, then a third identifier and a fourth identifier are displayed; the third identifier is used to indicate the second device, and the fourth identifier is used to indicate the third device. A selection operation targeting the third identifier is detected, and the content to be shared on the second device is obtained.
11. An electronic device, characterized in that, The device includes a processor and a memory, wherein the memory is used to store a computer program, the computer program including program instructions that, when the processor executes the program instructions, cause the electronic device to perform the method as described in any one of claims 1 to 10.
12. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program including program instructions that, when requested to be run by a computer, cause the computer to perform the method as described in any one of claims 1 to 10.