Dual-screen mobile apparatus and control method for dual-screen mobile apparatus

Abstract

A dual-screen mobile device and a control method for the dual-screen mobile device are disclosed. The dual-screen mobile device includes a first and a second body, a first and a second display, a moving mechanism, one or more sensors, and a processor. The moving mechanism is movably connected to the first and second bodies and is used to translate or slide the first or second body. The sensors detect the relative position between the first and second displays. The processor generates prompt information based on the relative position between the first and second displays and the content of the first display, inputs the prompt information to a neural network model, obtains derived information corresponding to the prompt information output by the neural network model, and generates the display content of the second display based on the derived information. This allows for convenient activation of an artificial intelligence assistant and provides sufficient screen size.

Description

[Technical Field]

[0001] This invention relates to a control technology for multiple display screens, and more particularly to a dual-screen mobile device and a control method for a dual-screen mobile device. [Previous Technology]

[0002] Current e-reading devices cannot proactively provide activity suggestions to users when processing various forms of information and analysis results from artificial intelligence (AI). In addition, existing devices often lack sufficient screen space when users need to display auxiliary information such as translations, related data, summaries, or notes generated by AI while reading. [Summary of the Invention]

[0003] The present invention provides a dual-screen mobile device and a control method for the dual-screen mobile device, which has sufficient screen space to provide suitable activity suggestions.

[0004] The dual-screen mobile device of this embodiment includes (but is not limited to) a first body, a first display, a second body, a second display, a moving mechanism, one or more sensors, and a processor. The first display is disposed on the first body. The second display is disposed on the second body. The orientation of the panel of the second display is the same as the orientation of the panel of the second display. The moving mechanism is movably connected to the first body and the second body and is used to translate and slide at least one of the first body or the second body. One or more sensors are disposed on at least one of the first body or the second body and are used to detect the relative position between the first display and the second display. The processor is coupled to the first display, the second display, and one or more sensors. The processor generates prompt information based on the relative position between the first display and the second display and the content of the first display, inputs the prompt information to a neural network model, obtains derived information output by the neural network model corresponding to the prompt information, and generates the display content of the second display based on the derived information.

[0005] The control method for a dual-screen mobile device according to embodiments of the present invention includes (but is not limited to) the following steps: providing a first display, a second display, a moving mechanism, at least one sensor, and a processor, wherein the first display is disposed on a first body, the second display is disposed on a second body, the orientation direction of the panel of the second display is the same as the orientation direction of the panel of the first display, the moving mechanism is movably connected to the first body and the second body and used to translate and slide at least one of the first body or the second body, the at least one sensor is used to detect a relative position between the first display and the second display; generating prompt information based on the relative position between the first display and the second display and the content of the first display; inputting the prompt information to a neural network model and obtaining derived information corresponding to the prompt information output by the neural network model; and generating display content of the second display based on the derived information.

[0006] Based on the above, the dual-screen mobile device and control method for the dual-screen mobile device of the present invention utilize a sliding movable mechanism to change the state of the device, detect the relative position of the two screens through sensors, and intelligently generate the display content of the second screen based on the content of the first screen and the relative position of the two screens through a neural network model. This improves the user's interactive experience and information acquisition efficiency.

[0007] In order to make the above features and advantages of the present invention more apparent and understandable, specific embodiments are described below, and detailed descriptions are given in conjunction with the accompanying drawings.

Implementation Method

[0009] FIG1 is a block diagram of a dual-screen mobile device 100 according to an embodiment of the present invention. Referring to FIG1, the dual-screen mobile device 100 may be a smartphone, tablet computer, laptop computer, e-reader or other electronic device.

[0010] The dual-screen mobile device 100 includes (but is not limited to) a first body 10, a second body 20, a first display 110, a second display 120, a motion mechanism 130, one or more sensors 140, a touch panel 150, and a processor 170.

[0011] Figure 2 is a schematic diagram of a dual-screen mobile device according to an embodiment of the present invention. Referring to Figure 2, a first display 110 is disposed on one side of a first body 10. A second display 120 is disposed on one side of a second body 10. The first body 10 and the second body 20 are approximately the same size, but can still be adjusted according to design requirements. As shown in the lower perspective view of Figure 2, the orientation of the panel (or screen) of the second display 120 is the same as the orientation of the panel of the first display 110. In this way, the user can see both panels simultaneously (as shown in the unfolded scenario in the lower perspective view).

[0012] The first display 110 and the second display 120 may be LCD, LED display, OLED display or electronic paper display.

[0013] The movable mechanism 130 is movably connected to the first body 10 and the second body 20, and is used to translate or slide the first body 10 or the second body 20. Taking Figure 2 as an example, in the closed scenario of the left perspective view, the first body 10 completely covers one side of the second body 10. The panel of the second display 20 is completely covered by the first body 10. At this time, the user cannot see the content displayed on the second display 120, but can see the content displayed on the first display 110. The movable mechanism 130 includes, for example, a slide rail, a guide rail, and / or a slider (which may be integrated into the first body 10 or the second body 20, or may be a separate component). When an external force is applied to the first body 10 and / or the second body 20, the first body 10 can translate or slide relative to the second body 20. That is, the relative position of the first body 10 and the second body 20 is changed, and the relative position of the first display 110 and the second display is changed. Compared with the upper perspective view of Figure 2, the side of the first body 10 shown in the lower perspective view (the right side shown in the figure) is away from the side of the second body 20 (the right side shown in the figure). The panel of the second display 20 is obscured by the first body 10. At this time, the user can see the content displayed on the first display 110 and the second display 120.

[0014] It should be noted that the mechanism and operation method of translation and sliding are not limited to those shown in Figure 2.

[0015] In one embodiment, the sensor 140 is a switch. For example, a microswitch can be triggered by an external force to switch its internal circuitry. In the unforced state (or untriggered state), a closed circuit is formed; while in the force-forced state (or triggered state), an open circuit is formed. When the first body 10 and / or the second body 20 change position, one or more switches may be in a force-forced state or an unforced state. That is, the first body 10 and / or the second body 20 may apply force to one or more switches at a specific position. Therefore, based on the position of the switches, the relative positions of the first body 10 and / or the second body 20 can be determined.

[0016] In another embodiment, sensor 140 is a distance sensor. For example, an infrared sensor, a Hall effect sensor, or a capacitive sensor. The distance sensor is used to detect distance information. This distance information, for example, indicates the distance value of one side of the first body 10 / first display 110 (the right side as shown in FIG2) relative to one side of the second body 20 / second display 120 (the right side as shown in FIG2).

[0017] The touch panel 150 may be a capacitive, resistive, infrared, or surface acoustic wave touch panel. In one embodiment, the touch panel 150 is used to receive user operations and, accordingly, handwriting information. User operations are movements of the stylus 30, hand, or other input tool on or near the touch panel 150, as shown in FIG. 2. Handwriting information is the position, path, and / or text information corresponding to the movement trajectory under user operation.

[0018] The processor 170 is coupled to the first display 110, the second display 120, one or more sensors 140, and the touch panel 150. The processor 170 may be a central processing unit (CPU), a graphics processing unit (GPU), a data processing unit (DPU), a visual processing unit (VPU), a tensor processing unit (DPU), or a neural-network processing unit (NPU), or other programmable general-purpose or special-purpose microprocessors, digital signal processors (DSPs), programmable controllers, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), or other similar components or combinations thereof. In one embodiment, the processor 170 is used to perform all or part of the operations of the dual-screen mobile device 100, and can load and execute one or more software modules, files and / or data stored in a storage device (not shown) to perform one or more methods of the present invention.

[0019] In some embodiments, the dual-screen mobile device 100 may further include a communication transceiver (not shown). For example, a communication transceiver circuit / interface supporting technologies such as Bluetooth, Wi-Fi, mobile network, fiber optic network, Universal Serial Bus (USB), Thunderbolt, or other communication technologies. In one embodiment, the communication transceiver is used to receive data from other devices or transmit data to other devices. For example, connecting to artificial intelligence processing or a cloud server.

[0020] The method described in the embodiments of the present invention will be described below with reference to the apparatus, components and modules shown in Figures 1 and 2. Each step of this method may be adjusted according to the implementation situation, and is not limited thereto.

[0021] FIG3 is a flowchart of a control method according to an embodiment of the present invention. Referring to FIG3, the processor 170 generates prompt information based on the relative position between the first display 110 and the second display 120 and the display content of the first display 110 (step S310). Specifically, as described above regarding the movable mechanism 130, the first display 110 and the second display 120 can be relatively translated and slid, thereby changing the relative position between the first display 110 and the second display 120.

[0022] In one embodiment, the multiple relative positions between the first body 10 / first display 110 and the second body 20 / second display 120 respectively correspond to multiple usage states.

[0023] FIG4A is a schematic diagram of usage state detection according to an embodiment of the present invention. Referring to FIG4A, the sensor 140 includes a first switch 141 and a second switch 142. For example, the first switch 141 is located at the lower right corner of the first display 110 (for example, located on the back of the first body 10), and the second switch 142 is located at the lower left corner of the first display 110 (for example, located on the back of the first body 10).

[0024] When both the first switch 141 and the second switch 142 are triggered, the processor 170 can determine that the relative position (e.g., the closed position) between the first display 110 and the second display 120 corresponds to the first usage state US1, and the panel of the second display 120 is completely covered by the first body 10. At this time, both the first switch 141 and the second switch 142 are triggered (or in a stressed state) by the force exerted by the second body 20 or the second display 120.

[0025] When one of the first switch 141 and the second switch 142 is triggered but the other of the first switch 141 and the second switch 142 is not triggered, the processor 170 can determine that the relative position between the first display 110 and the second display 120 (e.g., a half-open position) corresponds to the second usage state US2. At this time, the panel portion of the second display 120 is covered by the first body 10. That is, a portion of the panel of the second display 120 is exposed. As shown, the second switch 142 is triggered by force applied by the second body 20 or the second display 120 (or is in a force-applied state), but the first switch 141 is not triggered by force applied by the second body 20 or the second display 120 (or is in a non-force-applied state). Compared to the first usage state US1, in the second usage state US2, one side of the first display 110 (the right side shown in the figure) is away from the side of the second display 120 (the right side shown in the figure).

[0026] When neither the first switch 141 nor the second switch 142 is triggered, the processor 170 may determine that the relative position between the first display 110 and the second display 120 (e.g., the fully open position) corresponds to the third usage state US3, and the panel of the second display 120 is not completely obscured by the first body 10. At this time, neither the first switch 141 nor the second switch 142 is triggered (or is in a state without force) due to the force exerted by the second body 20 or the second display 120.

[0027] FIG4B is a schematic diagram of usage state detection according to another embodiment of the present invention. Referring to FIG4B, sensor 140 includes distance sensor 143. For example, distance sensor 143 is disposed at the lower right corner of second display 120 (e.g., on the front of second body 10). Distance sensor 143 is used to detect distance information between first body 10 and second body 20. Distance information is used to indicate the distance value between a first reference position located on first body 10 (e.g., a point on the right side as shown in the figure) and a second reference position located on second body 20 (e.g., the position of distance sensor 143 or a point on the right side as shown in the figure).

[0028] When the distance sensor 143 detects the first distance information D1, the processor 170 can determine that the relative position (e.g., closed position) between the first display 110 and the second display 120 corresponds to the first usage state US1, and the panel of the second display 120 is completely obscured by the first body 10. The first distance information D1 indicates that the distance between the first reference position located on the first body 10 and the second reference position located on the second body 20 is zero or less than a lower limit value (e.g., 1 cm or 8 mm) (but greater than zero).

[0029] When the distance sensor 143 detects the second distance information D2, the processor 170 may determine that the relative position (e.g., half-open position) between the first display 110 and the second display 120 corresponds to the second usage state US2, and the panel portion of the second display 120 is obscured by the first body 10. The distance value indicated by the second distance information D2 is greater than the distance value indicated by the first distance information D1. For example, the distance value indicated by the second distance information D2 is between 1 cm and m cm, where m is the lateral width of the second body 20 or the second display 120 (an error value may be considered).

[0030] When the distance sensor 143 detects the third distance information D3, the processor 170 can determine that the relative position (e.g., fully open position) between the first display 110 and the second display 120 corresponds to the third usage state US3, and the panel of the second display 120 is not completely obscured by the first body 10. The distance value indicated by the third distance information D3 is greater than the distance value indicated by the second distance information D2. For example, the distance value indicated by the third distance information D3 is m centimeters, and m is the lateral width of the second body 20 or the second display 120 (an error value may be considered).

[0031] In one embodiment, the identification code of the usage state (e.g., the first usage state US1, the second usage state US2 and the third usage state US3 shown in FIG4A and FIG4B), the distance value between the first body 10 / first display 110 and the second body 20 / second display 120, the force state of the switch and / or the coordinate value can be used to indicate the relative position between the first display 110 and the second display 120, and to serve as prompt information.

[0032] It should be noted that the technology for detecting and determining the relative position between the first display 110 and the second display 120 is not limited to the above description, and the user can adjust the technical means according to actual needs.

[0033] On the other hand, the processor 170 can capture the display content of the first display 110 (and / or the second display 120). For example, screen capture / screenshot is performed through a screenshot function / process.

[0034] In one embodiment, the processor 170 can convert the captured display content into an image. This image can then be used as a prompt or notification.

[0035] In one embodiment, the processor 170 can convert the captured display content into text content. For example, it can convert the text in the image into a computer-editable text format using Optical Character Recognition (OCR). Alternatively, it can convert handwritten handwriting into a computer-editable text format using Handwritten Text Recognition (HTR). This text content (i.e., the text itself) can then be used as prompt information.

[0036] In one embodiment, the processor 170 can integrate positional information corresponding to the relative positions between the first display 110 and the second display 120 (e.g., identification code of usage state, distance value between the first body 10 / first display 110 and the second body 20 / second display 120, force state of the switch and / or coordinate value) and the display content of the first display 110 (e.g., image or text content) into prompt information. The prompt information is content used to indicate the associated conditions of the derived information output by the neural network model. For example, "Device in first usage state US1, image content is an article, and article content is...". Or, for example, "Device in second usage state US2, image content is handwritten information, and handwritten information is...".

[0037] Referring to Figure 3, the processor 170 inputs prompt information to the neural network model and obtains the derived information corresponding to the prompt information output by the neural network model (step S320). Specifically, the neural network model is, for example, a convolutional neural network (CNN), a recurrent neural network (RNN), a transformer network, a large language model (LLM), or a generative artificial intelligence model. In one embodiment, the processor 170 runs the neural network model independently / offline. In another embodiment, an external device (e.g., a cloud server) runs the neural network model. For example, the processor 170 transmits the prompt information to the cloud server via a transceiver. The cloud server uses the neural network model to generate derived information corresponding to the prompt information.

[0038] The neural network model is trained on a dataset and learns to map input data (e.g., image content and the relative positions between the first display 110 and the second display 120) to corresponding derived information, thereby establishing a correlation between the input data and output information of the neural network model. Input data may be, for example, image and / or text-formatted prompts (e.g., content specifying the association conditions for the output derived information). The dataset consists of known relative positions (e.g., the relative positions of the first display 110 and the second display 120), display content (e.g., screenshots of the first display 110 and / or the second display 120), and labeled application information (e.g., the type of derived information and the conversion content that integrates the display content into the corresponding type). The neural network model can be trained on a large-scale dataset, learning to predict the probability of the next word or symbol in a sequence. After training, the neural network model can receive input data (e.g., an image, the beginning of one or more sentences, one or more questions, one or more descriptions) and, based on the language rules it has learned, progressively generate subsequent text content (e.g., derived information).

[0039] Derivative information, such as information related to meeting arrangements, itineraries, translations, information compilations, events, or information integrations, and not limited thereto.

[0040] The processor 170 can generate the display content of the second display 120 based on the derived information (step S330). Specifically, the text content of the derived information can be presented on the second display 120. However, the layout and style of the display content on the second display may vary depending on the type and / or content of the derived information.

[0041] The following are examples of application scenarios.

[0042] Figure 5A is a schematic diagram of a schedule arrangement scenario according to an embodiment of the present invention. Referring to Figure 5A, in the first usage state US1 shown in Figure 4A or Figure 4B, the first display 110 displays the interface of the handwriting note function (e.g., the interface of a notebook program) (step S510). This interface can receive the user's touch operation through the touch panel 150 and receive the corresponding handwriting information accordingly (step S520). The handwriting information corresponds to the position of one or more trajectory points and / or the path formed based on one or more trajectory points. For example, Figure 5B is a schematic diagram of handwriting information according to an embodiment of the present invention. Referring to Figure 5B, the user writes "Meeting time...", "Location...", and "Members...".

[0043] Next, sensor 140 detects that the relative positions of the first display 110 and the second display 120 correspond to the second usage state US2 as shown in FIG4A or FIG4B. FIG6A is a flowchart of meeting arrangement according to an embodiment of the present invention, and FIG6B is a flowchart of auxiliary prompts according to an embodiment of the present invention. Referring to FIG6A and FIG6B, when the relative positions correspond to the second usage state US2, processor 170 can capture handwritten information on the first display 110 (steps S601 and S611). For example, processor 170 converts the handwritten trajectory into text content and generates handwritten information accordingly (i.e., including corresponding text content, such as "meeting time...", "location...", and "members..."). In addition, processor 170 can generate prompt information based on the second display state US2 and the handwritten information (steps S602 and S612) and input it into the neural network model. The prompt information corresponds to meeting-related information (e.g., "meeting time...", "location...", and "members..."). The neural network model outputs derived information. The information provides guidance on travel arrangements and offers corresponding time options.

[0044] Next, the processor 170 can add meeting events based on meeting-related information (step S603). The processor 170 displays a prompt on the first display 110 asking for scheduling information. For example, "Would you like to schedule a meeting for 3 / 20 at what time into your calendar?". Furthermore, the processor 170 can display an auxiliary function bar AFB in a partial area of ​​the second display 120 based on meeting-related information (steps S613 and S530). The auxiliary function bar AFB corresponds to derived information. For example, the processor 170 provides time options B1 (e.g., three times in the morning) and B2 (e.g., three times in the afternoon) in the exposed display area of ​​the second display 110. The processor 170 can add meeting events in the calendar based on the prompt and confirmation of time option B1 or B2. This meeting event corresponds to, for example, "Meeting Time…", "Location…", and "Members…" and the selected time option B1 or B2.

[0045] Figure 6C is a flowchart of a schedule conflict management system according to an embodiment of the present invention. Referring to Figure 6C, the accessibility column may include a smart time option. The processor 170 may determine whether the time information in the meeting-related information conflicts with the schedule information (step S621). The time information is, for example, the "meeting time..." corresponding to the handwritten information in Figure 5B. The schedule information corresponds to the time period indicated by the meeting event already existing in the schedule. The processor 170 may determine whether the times overlap or are too close together (e.g., within 5 minutes or 10 minutes) as a basis for conflict determination.

[0046] When the time information in the meeting-related information conflicts with the schedule information, the processor 170 can generate suggested time information that does not conflict with the schedule information and present the suggested time information in the smart time option (step S622). For example, when the time information overlaps with or is too close to the schedule information, the processor 170 uses a time that is further away from the schedule information (e.g., 1 hour, 6 hours, or 1 day before / after) as the suggested time information. At this time, the auxiliary function column AFB shown in FIG5A will present this suggested time information.

[0047] Figure 6D is a flowchart of occupancy conflict management according to an embodiment of the present invention. Referring to Figure 6D, the auxiliary function column includes a smart meeting room option. The processor 170 can determine whether the meeting room information in the meeting-related information conflicts with the meeting room occupancy information (step S631). The meeting room information is, for example, the "location..." corresponding to the handwritten information in Figure 5B. The meeting room occupancy information corresponds to the identification information of the meeting room specified by an existing meeting event in the event schedule. The processor 170 can determine whether the meeting room information and the meeting room occupancy information specify the same meeting room identification information at the same time, as a basis for conflict judgment.

[0048] When the meeting room information in the meeting-related information conflicts with the meeting room occupancy information, the processor 170 can generate suggested meeting room information that does not conflict with the meeting room occupancy information and present the suggested meeting room information in the smart meeting room option (step S632). For example, when the meeting room information and the meeting room occupancy information specify the same meeting room identification information at the same time, the processor 170 selects different identification information (i.e., a meeting room that has not yet been occupied) as the suggested meeting room information. At this time, the auxiliary function column AFB shown in FIG5A will present this suggested meeting room information.

[0049] Figure 7 is a flowchart of translation according to an embodiment of the present invention, and Figure 8 is a schematic diagram of a translation scenario according to an embodiment of the present invention. Referring to Figures 7 and 8, in the first usage state US1 shown in Figure 4A or Figure 4B, the first display 110 presents a document or book (step S810). This interface can receive the user's touch operation through the touch panel 150 and receive the corresponding selection information accordingly (step S820). As shown, a section of text content is selected. When the relative position corresponds to the second usage state US2 shown in Figure 4A or Figure 4B, the processor 170 retrieves the article information on the first display 110 (step S710). The article information is, for example, the selection information corresponding to the above touch operation or the content of the entire article. In addition, the processor 170 can generate prompt information based on the second usage state US2 and the article information (step S720) and input it into the neural network model. The prompt information corresponds to the text information (for example, the selection information corresponding to the above touch operation or the content of the entire article). The neural network model outputs derived information. At this time, the derived information corresponds to the translation information of the article information. For example, the selected information or the text content of an entire article corresponding to the above touch operation, translated into one or more languages.

[0050] Next, the processor 170 may display the auxiliary function bar AFB in a partial area of ​​the second display 120 based on the translation information (steps S730 and S830). The auxiliary function bar includes a document suggestion option B3, which is used to provide translation information. For example, the processor 170 provides the document suggestion option B3 (e.g., a four-language option) in the exposed display area of ​​the second display 110. The processor 170 may present a prompt asking for the translation of an article. For example, "Want me to help you with the translation?". The processor 170 may provide translation information in the corresponding language based on the prompt and confirmation of the document suggestion option B3. For example, English translation.

[0051] In another embodiment, the derived information corresponds to the file selection information of the article information. For example, the selection information corresponding to the touch operation or the text content of one or more related documents of the entire meeting minutes page.

[0052] Next, the processor 170 may display the accessibility bar AFB in a partial area of ​​the second display 120 based on the translation information. The accessibility bar includes a document suggestion option B3. At this time, the document suggestion option B3 is used to provide document selection information. For example, the processor 170 provides the document suggestion option B3 (e.g., an option for a document from four countries) in the exposed display area of ​​the second display 110. The processor 170 may present a prompt asking for document selection. For example, "Do you want to open the relevant document?". The processor 170 may open the corresponding document based on the prompt and confirmation of the document suggestion option B3.

[0053] Figure 9 is a flowchart of an activity suggestion according to an embodiment of the present invention, and Figure 10 is a schematic diagram of a note-taking scenario according to an embodiment of the present invention. Referring to Figures 9 and 10, the initial state is the first usage state US1 as shown in Figure 4A or Figure 4B (step S1010). When the relative position is detected to correspond to the third usage state US3 as shown in Figure 4A or Figure 4B, the processor 170 can detect conditional information (steps S910 and S1020). The conditional information includes time, location, daily routine (e.g., personal habits), calendar (e.g., schedule), or a combination thereof. In addition, the processor 170 can generate prompt information based on the third usage state US3 and the conditional information (step S920) and input it into the neural network model. The prompt information corresponds to the content specified by the conditional information. The neural network model outputs derived information. At this time, the derived information corresponds to activity information. For example, reading meeting-related documents or starting meeting notes. The processor 170 can display the activity information on the second display 120 (step S930). For example, in step S1020, the second display 120 is divided into upper and lower display areas to present options corresponding to the two activity information. The processor 170 can confirm the provision of corresponding activity information on the second display 120 based on the options corresponding to the activity information. For example, the notebook program is opened and meeting notes are started (step S1030). Then, the meeting note mode is entered, the first display 110 displays the meeting minutes, and the second display 120 displays the notes that can be written during the meeting (step S1040).

[0054] Figure 11 is a flowchart of article aggregation according to an embodiment of the present invention, and Figure 12 is a schematic diagram of an article aggregation scenario according to an embodiment of the present invention. Referring to Figures 11 and 12, the initial state is the first usage state US1 as shown in Figure 4A or Figure 4B (step S1210). When the relative position is detected to correspond to the third usage state US3 as shown in Figure 4A or Figure 4B, the processor 170 can detect condition information (step S1220). At this time, the condition information includes time and calendar. For example, a meeting scheduled within 1 hour. In addition, the processor 170 can generate prompt information based on the third usage state US3 and the condition information, and input it into the neural network model. The prompt information corresponds to the content specified by the condition information. The neural network model outputs derived information. At this time, the derived information corresponds to activity information. For example, reading meeting-related documents or starting meeting notes. The processor 170 can display the activity information on the second display 120. As in step S1220, the second display 120 is divided into upper and lower display areas and used to present the options corresponding to the two activity information. The processor 170 can confirm the corresponding activity information to be provided on the second display 120 based on the option corresponding to the activity information. For example, the option to read meeting-related documents is selected (step S1230). Next, the dual-screen reading mode is entered, the processor 170 opens the file browsing program, and opens the meeting-related documents. The first display 110 and the second display 120 display the documents (step S1240).

[0055] Furthermore, when the relative position corresponds to the third usage state US3 as shown in FIG. 4A or FIG. 4B, the processor 170 can capture the article information on the first display 110 (steps S1110 and S1220). The article information is, for example, the text content in the document displayed in step S1240. Additionally, the processor 170 can generate prompt information based on the third usage state US3 and the article information (step S1120) and input it to the neural network model. The prompt information corresponds to the text content of the article information. The neural network model outputs derived information. At this time, the derived information corresponds to the aggregated information of the article information. The processor 170 can display the aggregated information on the second display 120 (steps S1130 and S1250). For example, a summary of the document displayed in step S1240. In some embodiments, the second display 120 can display summaries of multiple pages of the document in a column format. Furthermore, when the touch panel 150 receives a user operation corresponding to a summary of a certain page, the processor 170 may display the page or its related paragraphs on the second display 120 (step S1260).

[0056] In another embodiment, the processor 170 can detect conditional information (step S1220). At this time, the conditional information includes the user's daily routine. For example, activities using the device at home at 10 PM. At this time, the first display 110 can display books frequently viewed and read during this period. When a third usage state US3 as shown in FIG4A or FIG4B is detected, the processor 170 can generate prompt information based on the third usage state US3 and the conditional information, and input it into the neural network model. The prompt information corresponds to the content specified by the conditional information. The neural network model outputs derivative information. At this time, the derivative information corresponds to activity information. For example, continuing to read a book or checking tomorrow's schedule. The processor 170 can display the activity information on the second display 120. As in step S1220, the second display 120 is divided into upper and lower display areas to present options corresponding to the two activity information. The processor 170 can confirm the corresponding activity information provided on the second display 120 based on the option corresponding to the activity information. For example, the option to continue reading a book is selected (step S1230). Next, the dual-screen reading mode is entered. The processor 170 opens the file browsing program and opens the meeting-related files. The first display 110 and the second display 120 display the files (step S1240).

[0057] Figure 13 is a flowchart of information integration according to an embodiment of the present invention, and Figure 14 is a schematic diagram of an information integration scenario according to an embodiment of the present invention. Referring to Figures 13 and 14, the processor 170 can display verbatim information on the first display 110 (steps S1310 and S1410). For example, it acquires a speech signal and converts it into an analyzable digital signal, extracts, for example, spectral information, pitch, or other sound features from the digital signal, uses a statistical model to identify the sound of words based on the sound features and predicts possible words, and combines the prediction results of acoustic and language models to generate the final verbatim information. In addition, the processor 170 displays a notebook program on the second display 120 and receives handwritten information through the touch panel 150 (step S1420). The processor 170 can capture the handwritten information on the second display 120 (steps S1320 and S1420). For example, the user writes down meeting minutes and a tree diagram.

[0058] The processor 170 can input verbatim information and handwritten information into the neural network model and obtain the integrated information output by the neural network model (step S1330). For example, the content that integrates the text content of verbatim information and handwritten information. Next, the processor 170 can input the integrated information into the neural network model according to the template type and obtain the new integrated information output by the neural network model. Figure 15 is a schematic diagram of input conversion and template application according to an embodiment of the present invention. Referring to Figure 15, the template type is, for example, General, Risks, Assumptions, Issues, and Dependencies (RAID), Specific, Measurable, Attainable, Relevant, and Time-bound (SMART), or Strengths, Opportunities, Aspirations, and Results (SOAR). At this time, the new integrated information is a format that maps the integrated information to the selected template type.

[0059] In addition to voice input (corresponding to verbatim information) and handwriting input (corresponding to handwriting information), in some embodiments, a photo input form (corresponding to input image) is also provided and used as prompt information for input to the neural network model.

[0060] Next, the processor 170 may display the new integrated information on the first display 110 or the second display 120 (step S1340). For example, the second display 120 may display meeting highlights, digital tables, and mind maps (step S1430). The new integrated information may be further shared with other devices, and the other devices may edit the new integrated information.

[0061] In summary, the dual-screen mobile device and control method for the dual-screen mobile device of the present invention provide a first display and a second display, which can be slidably unfolded relative to each other. The present invention can provide different artificial intelligence (AI) assisted functions depending on the unfolded state of the first and second displays. Users can freely write on the first display, and the system will detect the user's writing content and provide diverse AI information organization and schedule planning. As needed, the AI ​​assistant will access suitable files in the device for the user's reference. The present invention can proactively detect user intentions through AI and provide activity suggestions suitable for the user's current activity. The present invention can recommend activities based on information such as the user's current location, time, frequently used tools, and personal calendar registration data. The present invention can present sufficient suggestion information for different screen sizes. The use of dual screens not only satisfies the original text browsing and editing needs but also meets the requirements for the presentation of generated AI applications.

[0062] Although the present invention has been disclosed above by way of embodiments, it is not intended to limit the present invention. Anyone skilled in the art can make some modifications and refinements without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the appended claims. [Simplified Explanation of the Diagram]

[0008] Figure 1 is a block diagram of a dual-screen mobile device according to an embodiment of the present invention. Figure 2 is a schematic diagram of a dual-screen mobile device according to an embodiment of the present invention. Figure 3 is a flowchart of a control method according to an embodiment of the present invention. Figure 4A is a schematic diagram of usage status detection according to an embodiment of the present invention. Figure 4B is a schematic diagram of usage status detection according to another embodiment of the present invention. Figure 5A is a schematic diagram of a schedule arrangement scenario according to an embodiment of the present invention. Figure 5B is a schematic diagram of handwritten information according to an embodiment of the present invention. Figure 6A is a flowchart of a meeting arrangement according to an embodiment of the present invention. Figure 6B is a flowchart of auxiliary prompts according to an embodiment of the present invention. Figure 6C is a flowchart of schedule conflict management according to an embodiment of the present invention. Figure 6D is a flowchart of occupancy conflict management according to an embodiment of the present invention. Figure 7 is a flowchart of translation according to an embodiment of the present invention. Figure 8 is a schematic diagram of a translation scenario according to an embodiment of the present invention. Figure 9 is a flowchart of activity suggestions according to an embodiment of the present invention. Figure 10 is a schematic diagram of a note-taking scenario according to an embodiment of the present invention. Figure 11 is a flowchart of article compilation according to an embodiment of the present invention. Figure 12 is a schematic diagram of an article compilation scenario according to an embodiment of the present invention. Figure 13 is a flowchart of information integration according to an embodiment of the present invention. Figure 14 is a schematic diagram of an information integration scenario according to an embodiment of the present invention. Figure 15 is a schematic diagram of input conversion and template application according to an embodiment of the present invention.

Claims

1. A dual-screen mobile device, comprising: The first entity; A first display is disposed on the first body; A second entity; A second display, disposed on the second body, wherein the orientation of the panel of the second display is the same as the orientation of the panel of the first display; a movable mechanism, movably connected to the first body and the second body, and used to translate and slide at least one of the first body or the second body; at least one sensor, disposed on at least one of the first body or the second body, and used to detect a relative position between the first display and the second display; and a processor, coupled to the first display, the second display and the at least one sensor, and used to: generate a prompt message based on the relative position between the first display and the second display and the display content of the first display; input the prompt message to a neural network model and obtain derived information output by the neural network model corresponding to the prompt message; and generate display content of the second display based on the derived information, wherein when the relative position corresponds to a first usage state, the panel of the second display is completely obscured by the first body, and when the relative position corresponds to a second usage state, a portion of the panel of the second display is obscured by the first body. When the relative position corresponds to a third usage state, the panel of the second display is not obscured by the first body at all.

2. The dual-screen mobile device as claimed in claim 1, wherein the at least one sensor includes a first switch and a second switch, and the processor is further configured to: determine that the relative position corresponds to a first usage state when both the first switch and the second switch are triggered; determine that the relative position corresponds to a second usage state when one of the first switch and the second switch is triggered but the other of the first switch and the second switch is not triggered; and determine that the relative position corresponds to a third usage state when neither the first switch nor the second switch is triggered.

3. The dual-screen mobile device as claimed in claim 1, wherein the at least one sensor includes a distance sensor, and the processor is further configured to: determine that the relative position corresponds to the first usage state when the distance sensor detects a first distance information; determine that the relative position corresponds to the second usage state when the distance sensor detects a second distance information, wherein the distance value indicated by the second distance information is greater than the distance value indicated by the first distance information; and determine that the relative position corresponds to the third usage state when the distance sensor detects a third distance information, wherein the distance value indicated by the third distance information is greater than the distance value indicated by the second distance information.

4. The dual-screen mobile device as described in claim 1, further comprising: A touch panel is disposed on the first display and is used to receive handwritten information, wherein the processor is further used to: when the relative position corresponds to the second usage state, capture the handwritten information on the first display, and generate the prompt information according to the second usage state and the handwritten information, wherein the prompt information corresponds to a meeting-related information; and add a meeting event according to the meeting-related information.

5. The dual-screen mobile device as described in claim 1, further comprising: A touch panel is disposed on the first display and is used to receive handwritten information, wherein the processor is further used to: when the relative position corresponds to the second usage state, capture the handwritten information on the first display and generate the prompt information according to the second usage state and the handwritten information, wherein the prompt information corresponds to a meeting-related information; and display an auxiliary function bar in a partial area of ​​the second display according to the meeting-related information, wherein the auxiliary function bar corresponds to the derived information.

6. The dual-screen mobile device as claimed in claim 5, wherein the accessibility bar includes a smart time option, and the processor is further configured to: determine whether the time information in the meeting-related information conflicts with a schedule information; and when the time information in the meeting-related information conflicts with the schedule information, generate a suggested time information that does not conflict with the schedule information, and present the suggested time information in the smart time option.

7. The dual-screen mobile device as claimed in claim 5, wherein the accessibility panel includes a smart meeting room option, and the processor is further configured to: determine whether the meeting room information in the meeting-related information conflicts with a meeting room occupancy information; and when the meeting room information in the meeting-related information conflicts with the meeting room occupancy information, generate a suggested meeting room information that does not conflict with the meeting room occupancy information, and present the suggested meeting room information in the smart meeting room option.

8. The dual-screen mobile device as claimed in claim 1, wherein the processor is further configured to: when the relative position corresponds to the second usage state, capture an article information on the first display, and generate the prompt information based on the second usage state and the article information, wherein the prompt information corresponds to a translation of the article information; and display an accessibility bar in a partial area of ​​the second display based on the translation information, wherein the accessibility bar includes a file suggestion option and the file suggestion option is used to provide the translation information.

9. The dual-screen mobile device as claimed in claim 1, wherein the processor is further configured to: when the relative position corresponds to the third usage state, retrieve an article information on the first display and generate the prompt information based on the third usage state and the article information, wherein the prompt information corresponds to a summary of the article information; and display the summary information on the second display.

10. The dual-screen mobile device as claimed in claim 1, wherein the processor is further configured to: detect condition information when the relative position corresponds to the third usage state, and generate the prompt information based on the third usage state and the condition information, wherein the derived information corresponds to activity information, and the condition information includes time, location, schedule, calendar or a combination thereof; and display the activity information on the second display.

11. The dual-screen mobile device as claimed in claim 1, further comprising: A touch panel is disposed on the second display and is used to receive handwritten information, wherein the processor is further used to: display verbatim information on the first display; capture the handwritten information on the second display; input the verbatim information and the handwritten information into the neural network model and obtain integrated information output by the neural network model; input the integrated information into the neural network model according to a template type and obtain new integrated information output by the neural network model; and display the new integrated information on the first display or the second display.

12. A control method for a dual-screen mobile device, comprising: The system provides a first display, a second display, a movable mechanism, at least one sensor, and a processor. The first display is disposed on a first body, and the second display is disposed on a second body. The orientation of the panel of the second display is the same as the orientation of the panel of the first display. The movable mechanism is movably connected to the first body and the second body and is used to translate or slide at least one of the first body or the second body. The at least one sensor is used to detect a relative position between the first display and the second display. The system generates a prompt message based on the relative position between the first display and the second display and the display content of the first display. It also inputs the prompt message to a neural network model and obtains derived information output by the neural network model corresponding to the prompt message. Finally, it generates the display content of the second display based on the derived information. When the relative position corresponds to a first usage state, the panel of the second display is completely obscured by the first body; when the relative position corresponds to a second usage state, the panel of the second display is partially obscured by the first body. When the relative position corresponds to a third usage state, the panel of the second display is not obscured by the first body at all.

13. The control method for a dual-screen mobile device as described in claim 12, wherein the at least one sensor includes a first switch and a second switch, and the control method further includes: When both the first switch and the second switch are triggered, the relative position is determined to correspond to the first usage state; When one of the first switch and the second switch is triggered but the other of the first switch and the second switch is not triggered, the relative position is determined to correspond to the second use state; and when neither the first switch nor the second switch is triggered, the relative position is determined to correspond to the third use state.

14. The control method for a dual-screen mobile device as described in claim 12, wherein the at least one sensor includes a distance sensor, and the control method further includes: When the distance sensor detects a first distance information, it determines that the relative position corresponds to the first usage state; When the distance sensor detects a second distance information, it determines that the relative position corresponds to the second usage state, wherein the distance value indicated by the second distance information is greater than the distance value indicated by the first distance information; and when the distance sensor detects a third distance information, it determines that the relative position corresponds to the third usage state, wherein the distance value indicated by the third distance information is greater than the distance value indicated by the second distance information.

15. The control method for a dual-screen mobile device as described in claim 12, further comprising: A touch panel is provided, wherein the touch panel is disposed on the first display and is used to receive handwritten information; When the relative position corresponds to the second usage state, the handwritten information on the first display is captured, and the prompt information is generated based on the second usage state and the handwritten information, wherein the prompt information corresponds to a meeting-related information; and a meeting event is added based on the meeting-related information.

16. The control method for a dual-screen mobile device as described in claim 12, further comprising: A touch panel is provided, wherein the touch panel is disposed on the first display and is used to receive handwritten information, wherein the processor is further used to: when the relative position corresponds to the second usage state, capture the handwritten information on the first display, and generate prompt information based on the second usage state and the handwritten information, wherein the prompt information corresponds to meeting-related information; and display an auxiliary function bar in a partial area of ​​the second display based on the meeting-related information, wherein the auxiliary function bar corresponds to the derived information.

17. The control method for a dual-screen mobile device as described in claim 16, wherein the accessibility panel includes a smart time option, and the control method further includes: Determine whether the time information in the meeting-related information conflicts with a travel itinerary; And when the time information in the meeting-related information conflicts with the itinerary information, a suggested time information that does not conflict with the itinerary information is generated and presented in the smart time option.

18. The control method for a dual-screen mobile device as described in claim 16, wherein the accessibility menu includes a smart meeting room option, and the control method further includes: Determine whether the meeting room information in the meeting-related information conflicts with the meeting room occupancy information; And when the meeting room information in the meeting-related information conflicts with the meeting room occupancy information, a suggested meeting room information that does not conflict with the meeting room occupancy information is generated and displayed in the smart meeting room option.

19. The control method for a dual-screen mobile device as described in claim 12, further comprising: When the relative position corresponds to the second usage state, an article information on the first display is captured, and the prompt information is generated based on the second usage state and the article information, wherein the derived information corresponds to a translation of the article information; and an auxiliary function bar is displayed in a partial area of ​​the second display based on the translation information, wherein the auxiliary function bar includes a file suggestion option, and the file suggestion option is used to provide the translation information.

20. The control method for a dual-screen mobile device as described in claim 12, further comprising: When the relative position corresponds to the third usage state, an article information on the first display is retrieved, and the prompt information is generated based on the third usage state and the article information, wherein the derived information corresponds to a summary of the article information; and the summary information is displayed on the second display.

21. The control method for a dual-screen mobile device as described in claim 12, further comprising: When the relative position corresponds to the third usage state, a conditional information is detected, and the prompt information is generated based on the third usage state and the conditional information, wherein the derived information corresponds to an activity information, and the conditional information includes time, location, daily routine, calendar, or a combination thereof; and the activity information is displayed on the second display.

22. The control method for a dual-screen mobile device as described in claim 12, further comprising: A touch panel is provided, wherein the touch panel is disposed on the second display and is used to receive handwritten information, and the processor is further used to: display verbatim information on the first display; capture the handwritten information on the second display; input the verbatim information and the handwritten information into the neural network model and obtain integrated information output by the neural network model; input the integrated information into the neural network model according to a template type and obtain new integrated information output by the neural network model; and display the new integrated information on the first display or the second display.

Images