Cross-device display method for electronic device and 3D model

Abstract

An electronic device and 3D model cross-device display method is used for achieving cross-device display of a 3D model, for example, the 3D model on one electronic device is displayed through another device, and operating systems of the two devices can be different. For example, the electronic equipment comprises a first 3D application and a cross-operating system interaction module, the cross-operating system interaction module is located in an application program package of the first 3D application or located in an operating system of the electronic equipment, the first 3D application is used for displaying a 3D model on a display screen of the electronic equipment, and the cross-operating system interaction module is used for displaying the 3D model on the display screen of the electronic equipment. The sending module is used for sending a first migration instruction to opposite-end equipment according to the instruction of the first 3D application, the opposite-end equipment is different from an operating system of the electronic equipment, the first migration instruction comprises an interface route, and the interface route is used for indicating the mode that the first 3D application opens the 3D model.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a cross-device display method of an electronic device and a 3D model. Background Art

[0002] With the advancement of technology, there are more and more three-dimensional (3D) applications, such as 3D game applications, 3D car viewing applications, and 3D house viewing applications. Taking the 3D car viewing application as an example, users can view 3D models of various vehicles through the 3D car viewing application, which is more efficient than visiting a 4S store. In some cases, while user A is viewing the 3D model of a vehicle through a mobile phone, user B may also view it together. Multiple people viewing the 3D model through one mobile phone will affect the viewing experience. Summary of the invention

[0003] An embodiment of the present application provides a cross-device display method of an electronic device and a 3D model, which is used to improve the viewing experience of the 3D model.

[0004] In a first aspect, an electronic device is provided, comprising a first 3D application and a cross-operating system interaction module, wherein the cross-operating system interaction module is located in an application package of the first 3D application or in an operating system of the electronic device; the first 3D application is used to display a 3D model on a display screen of the electronic device; the cross-operating system interaction module is used to send a first migration instruction to a peer device according to an instruction of the first 3D application, wherein the operating system of the peer device is different from that of the electronic device, and the first migration instruction includes an interface route, wherein the interface route is used to instruct the first 3D application on a manner of opening the 3D model.

[0005] In the embodiment of the present application, a device can display a 3D model through a peer device, and the operating systems of the two devices can be different. On the one hand, the viewing experience of the 3D model is improved. For example, in a scene where multiple people are watching, a device displays the 3D model through a peer device to avoid the problem of poor experience caused by multiple people watching the 3D model on the same device. Or, when a user uses a small-screen device (such as a mobile phone) to watch a 3D model, the experience is poor due to the small screen. The 3D model on the small-screen device can be displayed through a large-screen device to improve the viewing experience. On the other hand, the embodiment of the present application realizes the flow of 3D models between two devices across operating systems, thus overcoming the limitation that the operating systems of the two devices must be the same to realize the flow of 3D models, and is more practical.

[0006] In one possible design, the cross-operating system interaction module is located in the operating system of the electronic device, and the operating system includes a first interface. When the cross-operating system interaction module is used to send a first migration instruction to a peer device according to an instruction of the first 3D application, the cross-operating system interaction module is specifically used to: receive first indication information sent by the first 3D application through the first interface, the first indication information being used to indicate sending the first migration instruction to the peer device; and send the first migration instruction to the peer device according to the first indication information.

[0007] In the embodiment of the present application, the operating system of the electronic device may provide a first interface for facilitating information transmission between the 3D application and the cross-operating system interaction module in the operating system. In this way, the cross-operating system interaction module may not be integrated in the 3D application, and the difficulty of application development and maintenance is reduced.

[0008] In a possible design, the first indication information includes the first migration instruction. In the embodiment of the present application, the first migration instruction can be carried in the first indication information or the first migration instruction and the first indication information can be two independent information, which is not limited in the embodiment of the present application.

[0009] In a possible design, before the cross-operating system interaction module is used to receive the first indication information and the first migration instruction sent by the first 3D application through the first interface, it is also used to: receive second indication information sent by the first 3D application through the first interface, the second indication information being used to instruct the cross-operating system interaction module to discover devices around the electronic device, discover devices around the electronic device based on the second indication information, and display a device list through the display screen, the device information of the surrounding devices in the device list including the device information of the peer device.

[0010] In the embodiment of the present application, the operating system of the electronic device may provide a first interface for facilitating information transmission between the 3D application and the cross-operating system interaction module in the operating system. In this way, the cross-operating system interaction module may not be integrated in the 3D application, and the difficulty of application development and maintenance is reduced.

[0011] In one possible design, the first 3D application is further used to enlarge, reduce or adjust the posture of the 3D model in response to the first operation; the cross-operating system interaction module is further used to send a second migration instruction to the counterpart device according to the instruction of the first 3D application, and the second migration instruction includes the operation information of the first operation, or the second migration instruction includes the adjusted posture information, magnification or reduction factor of the 3D model.

[0012] In the embodiment of the present application, when a device displays a 3D model through a peer device, two-way control can be achieved, providing a better experience.

[0013] In one possible design, the cross-operating system interaction module is also used to receive a third migration instruction sent by the peer device, the third migration instruction includes operation information of the second operation, or the third migration instruction includes posture information, magnification or reduction factor of the 3D model; the first 3D application is also used to enlarge, reduce or adjust the posture of the 3D model according to the third migration instruction.

[0014] In the embodiment of the present application, when a device displays a 3D model through a peer device, two-way control can be achieved, providing a better experience.

[0015] In a possible design, the first 3D application is further used to: output prompt information, where the prompt information is used to indicate that the electronic device or the first 3D application is in an information migration state.

[0016] In the embodiment of the present application, the 3D application can prompt the user that the user is currently in a state of information flow, and to a certain extent can remind the user of the success or failure of the operation, thereby providing a high user experience.

[0017] In a possible design, the first 3D application is further used to: display a first button on the display screen; and in response to an operation on the first button, instruct the cross-operating system interaction module to send a first migration instruction to the opposite device.

[0018] In an embodiment of the present application, a 3D application may display buttons to facilitate users to display 3D models across devices, which is convenient for operation.

[0019] In a second aspect, an electronic device is also provided, comprising a second 3D application and a cross-operating system interaction module, wherein the cross-operating system interaction module is located in an application package of the second 3D application or in the operating system of the electronic device; the cross-operating system interaction module is used to receive a first migration instruction sent by a peer device, wherein the first migration instruction includes an interface route, wherein the interface route is used to indicate a method for a first 3D application to open a 3D model, wherein the first 3D application corresponds to the second 3D application; and the second 3D application is used to display the 3D model on a display screen of the electronic device according to the interface route.

[0020] In a possible design, the cross-operating system interaction module is located in the operating system of the electronic device, the operating system includes a second interface, and the cross-operating system interaction module is specifically used to send the first migration instruction to the second 3D application through the second interface.

[0021] In one possible design, the cross-operating system interaction module is also used to receive a second migration instruction sent by the peer device, wherein the second migration instruction includes operation information of the first operation, or the second migration instruction includes posture information, magnification factor or reduction factor of the 3D model; the second 3D application is also used to enlarge, reduce or adjust the posture of the 3D model according to the second migration instruction.

[0022] In one possible design, the second 3D application is further used to enlarge, reduce or adjust the posture of the 3D model in response to the second operation; the cross-operating system interaction module is further used to send a third migration instruction to the counterpart device according to the instruction of the second 3D application, and the third migration instruction includes the operation information of the second operation, or the third migration instruction includes the adjusted posture information, magnification or reduction factor of the 3D model.

[0023] In a possible design, the second 3D application is further used to: output prompt information, where the prompt information is used to indicate that the electronic device or the second 3D application is in an information migration state.

[0024] In a third aspect, a cross-device display method of a 3D model is also provided, which is applied to a system, wherein the system includes a first device and a second device, and the first device and the second device have different operating systems, and the method includes:

[0025] The first device displays a first interface of a first application, where the first application is a local application of the first device, and the first interface includes a 3D model;

[0026] In response to a user operation, the first device sends a first migration instruction to the second device, where the first migration instruction includes an interface route, and the interface route is used to indicate a method for the first application to open the 3D model;

[0027] The second device displays a second interface of a second application according to the page routing, the second application is a local application of the second device, the second application corresponds to the first application, and the second interface includes the 3D model.

[0028] In one possible design, the method also includes: the first device enlarges, reduces or adjusts the posture of the 3D model in response to the first operation; the first device sends a second migration instruction to the second device, the second migration instruction includes operation information of the first operation, or the second migration instruction includes the adjusted posture information, magnification or reduction factor of the 3D model.

[0029] In one possible design, the method also includes: the second device receives the second migration instruction; the second device enlarges, reduces or adjusts the posture of the 3D model in the second interface according to the second migration instruction; wherein the 3D model in the second interface has the same posture, magnification or reduction factor as the 3D model in the first interface.

[0030] In a possible design, before the second device displays the second interface of the second application according to the page routing, the method further includes:

[0031] The second device installs the second application.

[0032] In a possible design, the first interface includes a first button, and the first device sends a first migration instruction to the second device in response to a user operation, including:

[0033] In response to the operation on the first button, the first device displays a device list, where the device list includes device information of the second device;

[0034] The first device sends a first migration instruction to the second device in response to a selection operation on the device information of the second device in the device list.

[0035] In one possible design, the method also includes: the first device outputs a first prompt message, the first prompt message being used to indicate that the first device or the first application is currently in an information migration state; and / or the second device outputs a second prompt message, the second prompt message being used to indicate that the second device or the second application is currently in an information migration state.

[0036] In a fourth aspect, a cross-device display method for a 3D model is also provided, which is applied to a first device, and the method includes: the first device displays a first interface of a first application, the first application is a local application of the first device, and the first interface includes a 3D model; the first device sends a first migration instruction to a second device in response to a user operation, the second device has a different operating system from the first device, and the first migration instruction includes an interface route, and the interface route is used to instruct the first application on how to open the 3D model.

[0037] In one possible design, the method also includes: the first device enlarges, reduces or adjusts the posture of the 3D model in response to the first operation; the first device sends a second migration instruction to the second device, the second migration instruction includes operation information of the first operation, or the second migration instruction includes the adjusted posture information, magnification or reduction factor of the 3D model.

[0038] In one possible design, the method also includes: the first device receives a third migration instruction sent by the second device; the third migration instruction includes operation information of the second operation, or the third migration instruction includes posture information, magnification or reduction ratio of the adjusted 3D model, and the first device enlarges, reduces or adjusts the posture of the 3D model according to the third migration instruction; wherein the 3D model in the second interface has the same posture, magnification or reduction ratio as the 3D model in the first interface.

[0039] In one possible design, the first interface includes a first button, and the first device sends a first migration instruction to the second device in response to a user operation, including: the first device displays a device list in response to the operation on the first button, and the device list includes device information of the second device; the first device sends the first migration instruction to the second device in response to a selection operation on the device information of the second device in the device list.

[0040] In one possible design, the method also includes: the first device outputs first prompt information, and the first prompt information is used to indicate that the first device or the first application is currently in an information migration state.

[0041] In the fifth aspect, a cross-device display method of a 3D model is also provided, which is applied to a second device, and the method includes: the second device receives a first migration instruction sent by the first device, the second device has a different operating system from the first device, the first migration instruction includes an interface route, and the interface route is used to indicate how the first application opens the 3D model; the second device displays a second interface of the second application according to the page route, the second application is a local application of the second device, the second application corresponds to the first application, and the second interface includes the 3D model.

[0042] In one possible design, the method also includes: the second device receives a second migration instruction sent by the first device, the second migration instruction includes operation information of the first operation, or the second migration instruction includes posture information, magnification or reduction ratio of the 3D model after adjustment; the second device zooms in, reduces or adjusts the posture of the 3D model in the second interface according to the second migration instruction; wherein the 3D model in the second interface has the same posture, magnification or reduction ratio as the 3D model in the first interface.

[0043] In one possible design, the method also includes: the second device enlarges, reduces or adjusts the posture of the 3D model in response to the second operation; the second device sends a third migration instruction to the first device, and the third migration instruction includes the operation information of the second operation, or the third migration instruction includes the adjusted posture information, magnification or reduction factor of the 3D model.

[0044] In one possible design, before the second device displays the second interface of the second application according to the page routing, the process further includes: the second device installing the second application.

[0045] In one possible design, the method also includes: the second device outputs second prompt information, and the second prompt information is used to indicate that the second device or the second application is currently in an information migration state.

[0046] In a sixth aspect, an electronic device is also provided, including:

[0047] a processor, a memory, and one or more programs;

[0048] Wherein, the one or more programs are stored in the memory, and the one or more programs include instructions, and when the instructions are executed by the processor, the electronic device executes the method steps described in the fourth aspect or the fifth aspect above.

[0049] In a seventh aspect, a system is also provided, comprising:

[0050] a first device and a second device,

[0051] The first device is the electronic device provided by the first aspect above;

[0052] The second device is the electronic device provided by the second aspect above.

[0053] In an eighth aspect, a computer-readable storage medium is also provided, wherein the computer-readable storage medium is used to store a computer program. When the computer program runs on a computer, the computer executes the method described in any one of the third aspect, fourth aspect or fifth aspect above.

[0054] In a ninth aspect, a computer program product is also provided, comprising a computer program, which, when executed on a computer, enables the computer to execute the method described in the third aspect, the fourth aspect or the fifth aspect above.

[0055] In the tenth aspect, a chip is also provided, which is coupled to a memory in an electronic device, and is used to call a computer program stored in the memory and execute the technical solution described in the third aspect, fourth aspect or fifth aspect of the embodiment of the present application. In the embodiment of the present application, "coupling" refers to the direct or indirect combination of two components with each other.

[0056] For the technical effects that can be achieved in the above-mentioned second to tenth aspects, please refer to the description of the technical effects that can be achieved by the corresponding design scheme in the above-mentioned first aspect, and this application will not repeat them here. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 A schematic diagram of a system provided in accordance with an embodiment of the present application;

[0058] Figure 2A A schematic diagram of the hardware structure of an electronic device provided in one embodiment of the present application;

[0059] Figure 2B A schematic diagram of a software structure of an electronic device provided in an embodiment of the present application;

[0060] Figure 3 Another schematic diagram of a system provided in one embodiment of the present application;

[0061] Figure 4A A schematic diagram of transferring a 3D model from a mobile phone to a smart screen provided in one embodiment of the present application;

[0062] Figure 4B A schematic diagram of transferring a 3D model from a mobile phone to a smart screen provided in one embodiment of the present application;

[0063] Figure 4C A schematic diagram of transferring a 3D model from a smart screen to a mobile phone provided in one embodiment of the present application;

[0064] Figure 5 A schematic diagram of the architecture of application A and application B provided in one embodiment of the present application;

[0065] Figure 6 Another schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0066] Below, some terms in the embodiments of the present application are explained to facilitate understanding by those skilled in the art.

[0067] The at least one involved in the embodiments of the present application includes one or more; wherein, more than one means greater than or equal to two. In addition, it should be understood that in the description of this specification, the words "first", "second", etc. are only used for the purpose of distinguishing the description, and cannot be understood as an explicit or implicit relative importance, nor can they be understood as an explicit or implicit order. For example, the first device and the second device do not represent the importance of the two or the order of the two, but are only for distinguishing the description. In the embodiments of the present application, "and / or" is only a description of the association relationship, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the objects associated before and after are in an "or" relationship.

[0068] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the specification. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0069] As used in this specification, the term “when” or “after” may be interpreted to mean “if” or “after” or “in response to determining that” or “in response to detecting that”, depending on the context. Similarly, the phrase “upon determining that” or “if (stated condition or event) is detected” may be interpreted to mean “if determining that” or “in response to determining that” or “upon detecting (stated condition or event)” or “in response to detecting (stated condition or event)”, depending on the context.

[0070] The 3D model cross-device display method provided in the embodiment of the present application is applicable to the system. The system includes a first device and a second device. The first device can be connected to the second device. Both the first device and the second device have a display screen. The first device can display the 3D model displayed on the local display screen through the display screen of the second device. One possible situation is that the display screen size of the first device is small, and the display screen size of the second device is large. For example, the first device can be a mobile phone, a tablet computer, etc.; the second device can be a laptop computer, a Huawei smart screen (hereinafter referred to as the smart screen), etc. In this way, the small-screen device can display the 3D model through a large-screen device to enhance the look and feel of the 3D model. Of course, the embodiment of the present application does not limit the display screen size of the first device and the second device. For example, the display screen size of the first device and the second device is equal. In addition, the embodiment of the present application does not limit the device type of the first device and the second device. In other words, the 3D model cross-device display provided by the embodiment of the present application can be applied to any type of device.

[0071] For ease of understanding, this article mainly uses the example that the first device is a mobile phone and the second device can be a smart screen. Figure 1 , which is a schematic diagram of a system provided in an embodiment of the present application. The system includes a first device and a second device. The first device is a mobile phone, and the second device is a smart screen. The mobile phone can display the 3D model displayed on the local display screen through the smart screen, and the specific implementation process will be described later.

[0072] Figure 2A A schematic diagram showing the hardware structure of an electronic device. The electronic device may be the first device (e.g., a mobile phone) or the second device (e.g., a smart screen) mentioned above. Figure 2AAs shown, the electronic device may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0073] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated into one or more processors. Among them, the controller may be the nerve center and command center of the electronic device. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. A memory may also be set in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

[0074] Among them, the processor 110 can be used to execute the 3D model cross-device display method provided in the embodiment of the present application. Taking the electronic device as a mobile phone as an example, the processor 110 can display the first interface of the first application in the mobile phone through the display screen 194, and the first interface includes a 3D model. The processor 110 receives the operation information of the touch operation sent by the touch sensor 180K (for example, click, double-click, long press, operation time, operation position, etc.), and in response to the touch operation, sends a first migration instruction to the smart screen. The first migration instruction includes an interface route, and the interface route is used to indicate the way in which the first application opens the 3D model. The smart screen has a different operating system from the mobile phone. The smart screen displays the second interface of the second application according to the page route. The second application is a local application of the second device, and the second interface includes the 3D model.

[0075] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0076] It is understandable that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0077] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to electronic devices. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0078] The display screen 194 is used to display the display interface of the application, etc. The display screen 194 includes a display panel. In some embodiments, the electronic device may include one or more display screens 194.

[0079] The internal memory 121 may be used to store computer executable program codes, which include instructions. The processor 110 executes the instructions stored in the internal memory 121 to perform various functional applications and data processing of the electronic device.

[0080] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.

[0081] Understandably, Figure 2A The components shown do not constitute a specific limitation on the electronic device. The electronic device in the embodiment of the present application may include Figure 2A In addition, Figure 2A The combination / connection relationship between the components can also be adjusted and modified.

[0082] Figure 2BSchematic diagram of the software structure of an electronic device provided in an embodiment of the present application. The electronic device may be the first device (e.g., a mobile phone) or the second device (e.g., a smart screen) mentioned above. Figure 2B As shown, the software structure of the electronic device can be a layered structure, and the layered architecture is to divide the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. The layered architecture can be, for example, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application is based on the layered architecture. The system is taken as an example to illustrate the software structure of the electronic device. The system is divided into five layers, from top to bottom: application layer, application framework layer, Android runtime and system library, kernel layer and hardware layer.

[0083] The application layer can include a series of application packages. Figure 2B As shown, the application package may include applications such as camera, gallery, memo, calendar, call, map, navigation, WLAN, Bluetooth, music, short message, etc. Figure 2B The application layer may also include 3D applications, which may be 3D game applications, 3D car viewing applications, 3D house viewing applications, etc. The architecture of 3D applications will be described later.

[0084] The application framework layer provides application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions. Figure 2B As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0085] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0086] The kernel layer is the layer between hardware and software. The kernel layer includes at least wifi driver, display driver, camera driver, audio driver, sensor driver, etc.

[0087] The hardware layer includes one or more hardware, such as various sensors (eg, touch sensors), cameras, displays, and the like.

[0088] Understandably, Figure 2BThe software structure shown does not constitute a specific limitation on the software structure of the electronic device. The software structure of the electronic device in the embodiment of the present application may include Figure 2B More or fewer modules in Figure 2B More or fewer layers, or a layer contains more than Figure 2B More or fewer modules, etc. In addition, Figure 2B The combination / connection relationship between modules can also be adjusted and modified.

[0089] The following uses a mobile phone as an example. Figure 2B The 3D model cross-device display method provided in the embodiment of the present application is described.

[0090] The touch sensor in the hardware layer receives a touch operation, for example, a touch operation is used to open the first interface of the first application (for example, a 3D application) in the mobile phone. The hardware layer reports the input event to the upper layer (for example, the application framework layer), and the input event includes information about the touch operation, such as the operation type, operation time, coordinate position, etc. The application framework layer can determine the object targeted by the input operation, for example, if it is determined that it is an operation on a certain control in the 3D application (a control used to open the first interface), it will report it to the first application in the application layer (for example, the 3D application). In response to the operation on the control, the first application calls the display driver in the kernel layer to display the first interface on the display screen, and the first interface includes a 3D model.

[0091] The touch sensor in the hardware layer receives a touch operation, for example, a touch operation is used to send a migration instruction to the smart screen. The hardware layer reports the input event to the upper layer (for example, the application framework layer). The application framework layer reports the input event to the first application (for example, a 3D application) in the application layer. In response to the touch operation, the first application calls the wifi driver (or Bluetooth driver) in the kernel layer to drive the wifi transmitter (or Bluetooth device) in the hardware layer to send a first migration instruction to the smart screen. The first migration instruction includes an interface route, and the interface route is used to indicate how the first application opens the 3D model. The smart screen displays the second interface of the second application according to the page route. The second application is a local application of the smart screen, and the second interface includes the 3D model.

[0092] Below Figure 1 Taking the system as an example, the 3D model cross-device display method provided by the embodiment of the present application is introduced in combination with the accompanying drawings.

[0093] The mobile phone can include a variety of 3D applications, such as 3D game applications, 3D car viewing applications, and so on. Taking the 3D car viewing application as an example, the 3D car viewing application can display 3D models of various vehicles. Considering that the display screen of the mobile phone is small, the user experience is not very good when viewing the 3D model of the vehicle on the mobile phone display. In order to enhance the look and feel of the 3D model, in an embodiment of the present application, the mobile phone can display the 3D model through a large-screen device (for example, a smart screen).

[0094] It is understandable that if the mobile phone displays the 3D model through the smart screen, it is necessary to establish a connection and communicate with the smart screen. In actual applications, it is inevitable to encounter situations where the operating systems of the mobile phone and the smart screen are different. For example, the user's mobile phone is the Hongmeng operating system, but the smart screen at home is the Android operating system. In this case, the mobile phone needs to migrate information across operating systems to display the 3D model through the smart screen. The so-called cross-operating system information migration can be understood as the information migration between two devices with different operating systems. Optionally, "cross-operating system information migration" may also have other names, such as "cross-platform information migration", which is not limited to the embodiments of the present application.

[0095] The embodiment of the present application provides an information migration method, which can realize information migration across operating systems. For example, if the operating systems of a mobile phone and a smart screen are different, the mobile phone can display the 3D model on the local display screen through the smart screen through the information migration method provided in the embodiment of the present application.

[0096] For the sake of convenience, the operating system of the mobile phone is the first operating system, and the operating system of the smart screen is the second operating system. The first operating system is different from the second operating system, including:

[0097] The first operating system is an Android system, and the second operating system is an IOS system or a Harmony system; or,

[0098] The first operating system is Hongmeng system, and the second operating system is Android system or IOS system; or,

[0099] The first operating system is an iOS system, and the second operating system is an Android system or a Hongmeng system; or,

[0100] The first operating system and the second operating system may also be other future operating systems, such as a real-time operating system (RTOS).

[0101] This article mainly uses the example that the first operating system is Hongmeng system and the second operating system is Android system for explanation. Figure 3, the operating system of the mobile phone is Hongmeng system, and the operating system of the smart screen is Android system. The mobile phone includes application A. The smart screen includes application B. Optionally, application A can be a system application or a third-party application in the mobile phone. Application B can be a system application or a third-party application in the smart screen. Application B is the same application as application A, for example, the same 3D application (for example, a 3D car viewing application).

[0102] Optionally, application B and application A belong to the same application, which can be understood as application B and application A are applications of the same type developed by the same developer. For example, application A and application B are both Huawei Video; or, application A and application B are both Huawei Music; or, application A and application B are both Changlian.

[0103] It should be noted that although Application B and Application A belong to the same application, since the operating system of the mobile phone is different from the operating system of the smart screen, the second application package of Application B is different from the first application package of Application A. For example, the first application package of Application A is adapted to the first operating system of the mobile phone, that is, the first application package of Application A can run in the first operating system of the mobile phone (for example, Hongmeng system). The second application package of Application B is adapted to the second operating system of the smart screen, that is, the second application package of Application B can run in the second operating system of the smart screen (for example, Android system). It should be noted that in the embodiments of the present application, the application package may also have other names, such as installation package.

[0104] Among them, the first application package of application A is adapted to the first operating system of the mobile phone, which may include: the first application package of application A is in the first file format, and the first file format is a file format supported by the first operating system. Taking the first operating system of the mobile phone as the HarmonyOS system as an example, the file formats supported by the HarmonyOS system include the HAP format. Therefore, the first application package of application A can be the HarmonyOS Application Package (HAP), that is, the first application package of application A is a file in the HAP format, and its suffix is ​​.hap.

[0105] Among them, the second application package of application B is adapted to the second operating system of the smart screen, and may include: the second application package of application B is in a second file format, and the second file format is a file format supported by the second operating system. Taking the second operating system of the smart screen as an Android system as an example, the file formats supported by the Android system include the APK format. Therefore, the second application package of application B can be an Android application package (APK), that is, the application package of application B is a file in APK format, and its suffix is ​​.apk.

[0106] In the embodiment of the present application, both application A and application B have the function of information migration across operating systems. One possible implementation method is that the developer compiles the program code of application A and the program code of application B based on the same framework, and the framework can realize the function of information migration across operating systems (about this framework, which will be described later). Figure 5 and Figure 6 Instructions). Among them, the program code of application A is packaged into an application package in hap format. After the mobile phone installs application A, the first operating system of the mobile phone (for example, Hongmeng system) can run the application package of application A. The program code of application B is packaged into an application package in apk format. After the smart screen installs application B, the second operating system of the smart screen (for example, Android system) can run the application package of application B. Therefore, application A in the mobile phone and application B in the smart screen can perform information migration function across operating systems.

[0107] Taking the example that Application A and Application B are the same 3D car viewing application, Application A in the mobile phone can display the 3D model of the vehicle through Application B in the smart screen.

[0108] For example, see Figure 4A (a), the mobile phone displays an interface 301 of application A (for example, a 3D car viewing application). The interface 301 includes a 3D model of a vehicle, and the 3D model is displayed in a first posture. The first posture may be, for example, the default posture of the 3D model when application A opens the interface 301. Optionally, the interface 301 may also include a button 302. When the mobile phone receives an operation on the button 302, the display is as follows: Figure 4A (b) Interface 303. Interface 303 includes a device list. The device list includes device information of surrounding devices discovered by the mobile phone. When the mobile phone receives an operation for selecting the device information of the smart screen in the device list, it establishes a connection with the smart screen. The connection can be, for example, a Bluetooth connection or a WiFi connection. Figure 4A Although not shown in the figure, after the mobile phone and the smart screen are successfully connected, a prompt message can be output on the mobile phone to prompt the user that the mobile phone and the smart screen are successfully connected. Correspondingly, a prompt message can also be output on the smart screen to prompt the user that the smart screen and the mobile phone are successfully connected.

[0109] After the mobile phone is successfully connected to the smart screen, application A in the mobile phone can send an interface route to the smart screen. The interface route is used to indicate the method of opening interface 301. For example, after application A opens the homepage, the method of opening interface 301 from the homepage. After the smart screen receives the interface route, since application B is the same application as application A, application B can open interface 304 in application B according to the interface route. Interface 304 includes a 3D model, and the 3D model is displayed in a first posture, such as Figure 4A(c) The first posture is the default posture of the 3D model when application B opens interface 304 .

[0110] In some examples, the user can adjust the posture of the 3D model on the phone, and the posture of the 3D model on the smart screen will also be adjusted accordingly. For example, see Figure 4B (a), the 3D model is displayed on the mobile phone and the posture of the 3D model is the first posture. The 3D model is displayed on the smart screen and the posture of the 3D model is the first posture. After the mobile phone receives the posture adjustment operation (for example, gesture operation) for the 3D model, the application A in the mobile phone adjusts the posture of the 3D model on the local display screen to the second posture, such as Figure 4B (b). Correspondingly, application B in the smart screen adjusts the posture of the 3D model on the local display screen to the second posture. One possible implementation method is that application A in the mobile phone sends posture information of the second posture to application B in the smart screen, so that application B in the smart screen adjusts the posture of the 3D model on the smart screen to the second posture according to the posture information. Exemplarily, the posture information may include: at least one of roll angle (roll), pitch angle (pitch), and yaw angle (yaw). Another possible implementation method is that application A in the mobile phone sends operation information to application B in the smart screen, and the operation information is used to describe the posture adjustment operation for the 3D model. For example, the operation information may include operation direction, distance, etc. After receiving the operation information, application B in the smart screen adjusts the posture of the 3D model on the local display screen to the second posture based on the operation information.

[0111] In other examples, the user can also adjust the posture of the 3D model on the smart screen, and the posture of the 3D model on the mobile phone will also be adjusted accordingly. For example, see Figure 4C (a), the 3D model is displayed on the mobile phone and the posture of the 3D model is the second posture. The 3D model is displayed on the smart screen and the posture of the 3D model is the second posture. After the smart screen receives the posture adjustment operation (for example, gesture operation) for the 3D model, the application B in the smart screen adjusts the posture of the 3D model on the local display screen to the third posture, such as Figure 4C (b). Correspondingly, Application A in the mobile phone adjusts the posture of the 3D model on the local display screen to the third posture. One possible implementation method is that Application B in the smart screen sends posture information of the third posture to Application A in the mobile phone, so that Application A in the mobile phone adjusts the posture of the 3D model on the mobile phone to the third posture according to the posture information. Another possible implementation method is that Application B in the smart screen sends operation information to Application A in the mobile phone, and the operation information is used to describe the posture adjustment operation for the 3D model received by the smart screen. After receiving the operation information, Application A in the mobile phone adjusts the posture of the 3D model on the local display screen to the third posture based on the operation information.

[0112] In some examples, the user can also enlarge or reduce the 3D model on the mobile phone, and correspondingly, the 3D model on the smart screen will also be enlarged or reduced. One possible implementation is that when application A in the mobile phone receives a zoom-in or zoom-out operation, the 3D model on the local display screen is enlarged or reduced, and the parameters of the magnification or reduction multiple are sent to application B in the smart screen. Application B in the smart screen enlarges the 3D model on the local display screen according to the magnification multiple, or reduces the 3D model on the local display screen according to the reduction multiple. Another possible implementation is that when application A in the mobile phone receives a zoom-in or zoom-out operation, the 3D model on the local display screen is enlarged or reduced, and the operation information of the zoom-in operation or the operation information of the zoom-out operation is sent to application B in the smart screen. Taking the zoom-in operation as an example that two fingers touch the display screen at the same time and the two fingers slide at the same time in a direction away from each other, the operation information of the zoom-in operation may include the sliding direction and sliding distance of the two fingers. Taking the zoom-out operation as an example that two fingers touch the display screen at the same time and the two fingers slide at the same time in a direction close to the object, the operation information of the zoom-out operation may include the sliding direction and sliding distance of the two fingers. Application B in the smart screen enlarges the 3D model on the local display screen based on a zoom-in operation, or reduces the 3D model on the local display screen based on a zoom-out operation.

[0113] In other examples, the user can also enlarge or reduce the 3D model on the smart screen, and correspondingly, the 3D model on the mobile phone will also be enlarged or reduced. One possible implementation is that when application B in the smart screen receives a zoom-in or zoom-out operation, it enlarges or reduces the 3D model on the local display screen, and sends the magnification or reduction multiple to application A in the mobile phone. Application A in the mobile phone enlarges the 3D model on the local display screen according to the magnification multiple, or reduces the 3D model on the local display screen according to the reduction multiple. Another possible implementation is that when application B in the smart screen receives a zoom-in or zoom-out operation, it enlarges or reduces the 3D model on the local display screen, and sends the operation information of the zoom-in operation or the operation information of the zoom-out operation to application A in the mobile phone. For zoom-in and zoom-out operations, please refer to the previous description. Application A in the mobile phone enlarges the 3D model on the local display screen based on the zoom-in operation, or reduces the 3D model on the local display screen based on the zoom-out operation.

[0114] Therefore, in the embodiment of the present application, after the mobile phone displays the 3D model on the local display screen through the smart screen, the mobile phone and the smart screen can be controlled bidirectionally. In other words, the user can control the posture of the 3D model on the smart screen through the mobile phone, and zoom in and out the 3D model on the smart screen, and can also control the posture of the 3D model on the mobile phone through the smart screen, and zoom in and out the 3D model on the mobile phone.

[0115] In the above embodiment, application B has been installed in the smart screen, so application A in the mobile phone and application B in the smart screen can perform information migration across operating systems. In other embodiments, application B may not be installed in the smart screen. Therefore, one possible implementation method is that the smart screen receives the interface route sent by the mobile phone, and the interface route includes the package name of application A. The smart screen can query whether there is an application with the same package name locally. If not, application B is installed, and the package name of application B is the same as that of application A. After the smart screen installs application B, application B opens the corresponding interface based on the interface route.

[0116] As mentioned above, application A and application B are compiled based on the same framework, which can implement information migration function across operating systems. The framework is described below.

[0117] See also Figure 5 , the mobile phone includes application A and a first operating system, such as Hongmeng system. The smart screen includes application B and a second operating system, such as Android system. Application A and application B may include the same framework, which may include three parts: application basic capability operation module, gesture event parsing and encapsulation module, and distributed service module.

[0118] It should be noted that Figure 5 In the mobile phone, the three parts of the framework (application basic capability operation module, gesture event parsing and packaging module, and distributed service module) can all be integrated into application A. Alternatively, at least one part of the three parts of the framework (the at least one part can be called a cross-operating system interaction module) can be built into the first operating system of the mobile phone (for example, Hongmeng system). For example, Figure 5 , the program code of the distributed service module of application A is built into the first operating system of the mobile phone (for example, Hongmeng system), and the program code of the application basic capability operation module and the gesture event parsing and encapsulation module are integrated into the first application package of application A. In this way, the first application package of application A may or may not include the program code of the distributed service module. Optionally, the application basic capability operation module and / or the gesture event parsing and encapsulation module in application A may also be built into the first operating system of the mobile phone.

[0119] Taking the distributed service module in application A as an example, which is built into the first operating system of the mobile phone, and the application basic capability operation module and the gesture event parsing and encapsulation module are integrated into application A, the first operating system includes a first interface, and the first interface is used to realize information transmission between application A and the distributed service module in the first operating system. For example, application A can send indication information 1, indication information 2, a first migration instruction, etc. to the distributed service module through the first interface (see the following description).

[0120] It should be noted that Figure 5 In the smart screen, take the example that the three parts in the framework (application basic capability operation module, gesture event parsing and encapsulation module, distributed service module) are all integrated into application B. In other embodiments, at least one part of the three parts in application B (at least one part can be called a cross-operating system interaction module) can be built into the second operating system (for example, Android system) of the smart screen. For example, the program code of the distributed service module in application B is built into the second operating system of the smart screen. The program code of the application basic capability operation module and the gesture event parsing and encapsulation module are integrated in the second application package of application B. In this way, the program code of the distributed service module may or may not be included in the second application package of application B. Optionally, the application basic capability operation module and / or the gesture event parsing and encapsulation module in application B may also be built into the second operating system of the smart screen.

[0121] Taking the example of the distributed service module in application B being built into the second operating system of the smart screen, and the application basic capability operation module and the gesture event parsing and encapsulation module being integrated into application B, the second operating system includes a second interface, which is used to realize information transmission between application B and the distributed service module in the second operating system.

[0122] The distributed service module includes: device discovery, device migration, device capability query, status management, etc. Among them, device discovery is used to discover surrounding devices. Device capability query is used to query the capabilities of surrounding devices, for example, to query whether surrounding devices have device migration functions. Device migration is used to migrate information to other devices. Status management is used to manage the migration status of the mobile phone, for example, the mobile phone is in a migration state or an unmigrated state. The migration state can be understood as the state in which the mobile phone is currently in information migration with other devices (for example, smart screens). The unmigrated state can be understood as the state in which the mobile phone is not currently in information migration with other devices.

[0123] The gesture event parsing and encapsulation module includes: a control command encapsulation module and a control command parsing module. Among them, the control command encapsulation module is used to calculate the adjusted posture information, magnification or reduction factor of the 3D model according to the operation information of the 3D model (for example, the posture adjustment operation, zoom in or zoom out operation of the 3D model), and encapsulate, encrypt and other processing of the posture information, magnification or reduction factor. Alternatively, the control command encapsulation module is also used to encapsulate, encrypt and other processing of the operation information (for example, the posture adjustment operation, zoom in or zoom out operation of the 3D model). Among them, the control command parsing module is used to receive data from other devices (for example, smart screens) and unseal and decrypt them.

[0124] The application basic capability operation module includes: a system event module, a UI component module, a data binding module, and a data processing module. Among them, the system event module is used to obtain system input, such as input operations received by the touch screen, such as the start and stop operation of the application, the start and stop operation of the information migration function (for example, the operation of button 302), the posture adjustment operation of the 3D model, the zoom-in operation, the zoom-out operation, etc. The UI component module is responsible for building and rendering the 3D model to display the 3D model through the display screen. The data binding module is used to monitor the data source, and when the data of the data source changes, the UI component module is triggered to rebuild and render the 3D model. For example, application A currently displays 3D model 1, and the data source includes information about 3D model 1. When application A closes 3D model 1 and displays 3D model 2, the data source includes information about 3D model 2. The data binding template monitors the data change of the data source and triggers the UI component module to rebuild and render the 3D model. The data processing module is used to compress and encrypt the interface route of application A so that it can be sent to the smart screen. It is understandable that the interface route may change in real time, so the data processing module needs to process the interface route in real time.

[0125] The following is Figure 5 Take the example to explain the process of cross-operating system information migration between application A and application B. This process includes the following steps:

[0126] (1) The system event module in application A in the mobile phone receives a first operation, and the first operation is used to open a first interface in application A. The system event module in application A instructs the UI component module of application A to construct and render a 3D model. The UI component module constructs and renders the 3D model, and displays the first interface on the mobile phone display, where the first interface includes the 3D model. Figure 4A (a), application A may be a 3D car viewing application, the first operation may be an operation for opening interface 301, the first interface may be interface 301, and a 3D model of the vehicle may be displayed in the first interface.

[0127] (2) The system event module in application A receives a second operation, and the second operation is used to start the information migration function of application A. Figure 4A (a), the second operation may be for Figure 4A(a) Operation of button 302. The system event module in application A instructs the distributed service module to discover surrounding devices. For example, the system event module in application A sends indication information 1 to the distributed service module, and indication information 1 is used to instruct the distributed module to discover surrounding devices. The distributed service module discovers surrounding devices, including smart screens, through the device discovery module according to indication information 1. The device discovery module can also display a device list on the display screen, and the device information of the smart screen in the device list.

[0128] (3) The system event module in application A receives a third operation, and the third operation is used to select the information of the smart screen in the device list. Figure 4A (b), the third operation may be for Figure 4A (b) The operation of the information of the smart screen in the device list. The system event module in application A instructs the distributed service module to send a first migration instruction to the smart screen. For example, the system event module in application A sends indication information 2 and a first migration instruction to the distributed service module, and indication information 2 is used to instruct to send a first migration instruction to the smart screen. According to indication information 2, the distributed service module sends the first migration instruction to the smart screen through the device migration module. The first migration instruction includes an interface route, and the interface route includes the way in which application A opens a 3D model. Optionally, the system event module sends the first migration instruction to the distributed service module, which may include: the system event module sends the interface route to the data processing module. The data processing module performs data encapsulation, encryption and other processing on the interface route to obtain the first migration instruction. The data processing module sends the first migration instruction to the distributed service module.

[0129] (4) The state management module in application A records the current state of application A as the device migration state.

[0130] (5) After receiving the first migration instruction, the device migration module of application B in the smart screen sends the first migration instruction to the data processing module of application B. The data processing module unpacks and decrypts the first migration instruction to obtain the interface route. The data processing module sends the interface route to the UI component module of application B. The UI component module in application B displays the second interface according to the interface route, and the second interface includes a 3D model. Figure 4A (c) The second interface may be, for example, interface 304 .

[0131] (6) The state management module in application B records that the current state of application B is the device migration state.

[0132] (7) The system event module in the application A in the mobile phone receives the fourth operation, which is used to enlarge, reduce or adjust the posture of the 3D model. The system event module instructs the UI component module to enlarge, reduce or adjust the posture of the 3D model. The UI component module displays the 3D model after enlargement, reduction or adjustment of the posture through the display screen.

[0133] (8) The system event module in Application A sends the operation information of the fourth operation to the gesture event parsing and encapsulation mode. The control command encapsulation module in the gesture event parsing and encapsulation mode encapsulates, encrypts, and other processes the operation information of the fourth operation to obtain a second migration instruction, or calculates the information of the adjusted 3D model based on the operation information of the fourth operation, and encapsulates, encrypts, and other processes the information to obtain a second migration instruction. Here, the information of the adjusted 3D model includes: the posture information of the adjusted 3D model, the magnification factor of the 3D model, and the reduction factor of the 3D model. The control command encapsulation module sends the second migration instruction to the distributed service module. The distributed service mode sends the second migration instruction to the smart screen through the device migration module.

[0134] (9) After receiving the second migration instruction, the device migration module in application B in the smart screen sends the second migration instruction to the control command parsing module in the gesture event parsing and encapsulation mode. The control command parsing module performs unsealing, decryption and other processing on the second migration instruction. One possible scenario is that the information obtained by the control command parsing module after unsealing and decryption is the operation information of the fourth operation. Another possible scenario is that the information obtained by the control command parsing module after unsealing and decryption is the posture information, magnification or reduction factor of the 3D model. If the information obtained after the unsealing and decryption process is the operation information of the fourth operation, the UI component module of application B adjusts the 3D model on the local display screen according to the operation information of the fourth operation, such as adjusting the posture, zooming in or out. If the information obtained after the unsealing and decryption process is the posture information of the 3D model, the UI component module of application B adjusts the posture of the 3D model on the local display screen according to the posture information of the 3D model. If the information obtained after unsealing and decryption is the magnification or reduction ratio of the 3D model, the UI component module of application B enlarges the 3D model on the local display screen according to the magnification ratio of the 3D model, or reduces the 3D model on the local display screen according to the reduction ratio of the 3D model.

[0135] (7)-(9) in the above text refer to when the user zooms in, out or adjusts the posture of the 3D model on the mobile phone, the smart screen also zooms in, out or adjusts the posture of the 3D model. It can be understood that if the user zooms in, out or adjusts the posture of the 3D model on the smart screen, the mobile phone will also zoom in, out or adjust the posture of the 3D model, and the implementation principle is the same as the above (7)-(9), so it will not be repeated.

[0136] Figure 6 The electronic device 600 is a schematic diagram of the structure of the electronic device 600 provided in the embodiment of the present application. The electronic device 600 may be the first device (e.g., a mobile phone) or the second device (e.g., a smart screen) mentioned above. Figure 6 As shown, the electronic device 600 may include: one or more processors 601; one or more memories 602; a communication interface 603, and one or more computer programs 604, and the above-mentioned devices may be connected via one or more communication buses 605. The one or more computer programs 604 are stored in the above-mentioned memory 602 and are configured to be executed by the one or more processors 601, and the one or more computer programs 604 include instructions. For example, when the electronic device 600 is the first device (e.g., a mobile phone) in the foregoing text, the instruction can be used to execute the relevant steps of the first device (e.g., a mobile phone) in the corresponding embodiment above. When the electronic device 600 is the second device (e.g., a smart screen) in the foregoing text, the instruction can be used to execute the relevant steps of the second device (e.g., a smart screen) in the corresponding embodiment above. The communication interface 603 is used to realize the communication between the electronic device 600 and other devices, for example, the communication interface can be a transceiver.

[0137] In the embodiments provided in the present application above, the method provided in the embodiments of the present application is introduced from the perspective of an electronic device (for example, a mobile phone or a smart screen) as an execution subject. In order to implement the various functions in the method provided in the embodiments of the present application above, the electronic device may include a hardware structure and / or a software module to implement the above functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

[0138] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented by software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk Solid State Disk (SSD)), etc. In the absence of conflict, the solutions of the above embodiments can be used in combination.

[0139] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.

[0140] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0141] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0142] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0143] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

Claims

1. An electronic device, characterized in that: The electronic device includes a first 3D application and a cross-operating system interaction module, and the cross-operating system interaction module is located in an application package of the first 3D application or in an operating system of the electronic device; The first 3D application is used to display a 3D model on a display screen of the electronic device; The cross-operating system interaction module is used to send a first migration instruction to a peer device according to an instruction of the first 3D application, wherein the operating system of the peer device is different from that of the electronic device, and the first migration instruction includes an interface route, and the interface route is used to instruct the first 3D application on how to open the 3D model.

2. The electronic device according to claim 1, characterized in that: The cross-operating system interaction module is located in the operating system of the electronic device, and the operating system includes a first interface; When the cross-operating system interaction module is used to send the first migration instruction to the opposite device according to the instruction of the first 3D application, it is specifically used to: receiving, through the first interface, first indication information sent by the first 3D application, where the first indication information is used to instruct sending the first migration instruction to the opposite device; The first migration instruction is sent to the opposite device according to the first indication information.

3. The electronic device according to claim 2, characterized in that: Before the cross-operating system interaction module is used to receive the first indication information and the first migration instruction sent by the first 3D application through the first interface, the cross-operating system interaction module is further used to: receiving, through the first interface, second indication information sent by the first 3D application, where the second indication information is used to instruct the cross-operating system interaction module to discover devices around the electronic device; According to the second indication information, devices around the electronic device are discovered, and a device list is displayed on the display screen. The device list includes device information of the surrounding devices, including device information of the opposite device.

4. The electronic device according to any one of claims 1 to 3, characterized in that: The first 3D application is further used to enlarge, reduce or adjust the posture of the 3D model in response to the first operation; The cross-operating system interaction module is also used to send a second migration instruction to the opposite device according to the instruction of the first 3D application, and the second migration instruction includes the operation information of the first operation, or the second migration instruction includes the adjusted posture information, magnification or reduction factor of the 3D model.

5. The electronic device according to any one of claims 1 to 4, characterized in that: The cross-operating system interaction module is further used to receive a third migration instruction sent by the opposite device, wherein the third migration instruction includes operation information of the second operation, or the third migration instruction includes posture information, a magnification factor, or a reduction factor of the 3D model; The first 3D application is further used to enlarge, reduce or adjust the posture of the 3D model according to the third migration instruction.

6. The electronic device according to any one of claims 1 to 5, characterized in that: The first 3D application is also used for: Output prompt information, where the prompt information is used to indicate that the electronic device or the first 3D application is in an information migration state.

7. The electronic device according to any one of claims 1 to 6, characterized in that: The first 3D application is also used for: Displaying a first button on the display screen; In response to the operation on the first button, the cross-operating system interaction module is instructed to send a first migration instruction to the opposite device.

8. An electronic device, characterized in that: The electronic device includes a second 3D application and a cross-operating system interaction module, and the cross-operating system interaction module is located in an application package of the second 3D application or in an operating system of the electronic device; The cross-operating system interaction module is used to receive a first migration instruction sent by a peer device, wherein the first migration instruction includes an interface route, and the interface route is used to indicate a method for a first 3D application to open a 3D model, and the first 3D application corresponds to the second 3D application; The second 3D application is used to display the 3D model on the display screen of the electronic device according to the interface routing.

9. The electronic device according to claim 8, characterized in that: The cross-operating system interaction module is located in the operating system of the electronic device, the operating system includes a second interface, and the cross-operating system interaction module is specifically used to: The first migration instruction is sent to the second 3D application through the second interface.

10. The electronic device according to claim 8 or 9, characterized in that: The cross-operating system interaction module is further used to receive a second migration instruction sent by the opposite device, wherein the second migration instruction includes operation information of the first operation, or the second migration instruction includes posture information, a magnification factor, or a reduction factor of the 3D model; The second 3D application is further used to enlarge, reduce or adjust the posture of the 3D model according to the second migration instruction.

11. The electronic device according to any one of claims 8 to 10, characterized in that: The second 3D application is further used to enlarge, reduce or adjust the posture of the 3D model in response to a second operation; The cross-operating system interaction module is also used to send a third migration instruction to the opposite device according to the instruction of the second 3D application, and the third migration instruction includes the operation information of the second operation, or the third migration instruction includes the adjusted posture information, magnification or reduction factor of the 3D model.

12. The electronic device according to any one of claims 8 to 11, characterized in that: The second 3D application is further used for: Output prompt information, where the prompt information is used to indicate that the electronic device or the second 3D application is in an information migration state.

13. A method for displaying a 3D model across devices, characterized in that: Applied to a first device, the method includes: The first device displays a first interface of a first application, where the first application is a local application of the first device, and the first interface includes a 3D model; In response to a user operation, the first device sends a first migration instruction to a second device, the operating system of the second device is different from that of the first device, and the first migration instruction includes an interface route, and the interface route is used to instruct the first application on how to open the 3D model.

14. A method for displaying a 3D model across devices, characterized in that: Applied to the second device, the method includes: The second device receives a first migration instruction sent by the first device, the second device and the first device have different operating systems, the first migration instruction includes an interface route, and the interface route is used to indicate a way for the first application to open the 3D model; The second device displays a second interface of a second application according to the page routing, the second application is a local application of the second device, the second application corresponds to the first application, and the second interface includes the 3D model.

15. An electronic device, characterized in that: include: a processor, a memory, and one or more programs; The one or more programs are stored in the memory, and the one or more programs include instructions, which, when executed by the processor, enable the electronic device to perform the method steps as claimed in claim 13 or 14.

16. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store a computer program, and when the computer program is run on a computer, the computer is caused to execute the method according to claim 13 or 14.

Images