Interaction method and device of multimedia equipment, multimedia equipment and medium

Abstract

The embodiment of the invention provides an interaction method and device of multimedia equipment, the multimedia equipment and a medium, a screen of the multimedia equipment is divided into a plurality of virtual sub-screen areas, and each user operates in the corresponding virtual sub-screen area. The target virtual sub-screen area where the user operation is located is determined based on the position of the touch event, each virtual sub-screen area can independently respond to the touch event, it is ensured that the operation of each user can be recognized and processed by a system even in the scene that multiple persons operate at the same time, touch conflicts among different users are reduced, and the user experience is improved. And the user experience is improved.

Description

Technical Field

[0001] The present application belongs to the field of multimedia touch technology, and specifically relates to an interaction method, device, multimedia device and medium for multimedia devices. Background Art

[0002] Multimedia touch devices have been widely used due to their advantages such as intuitiveness, interactivity, flexibility and environmental friendliness. For example, in teaching scenarios, teachers have improved teaching efficiency and quality by using multimedia touch devices. However, in the teaching process, in addition to teachers' need to use multimedia touch devices, sometimes multiple students come to the stage and use the same multimedia touch device to answer questions at the same time. At this time, the multimedia touch device is required to support multiple people writing at the same time.

[0003] In the prior art, multimedia touch devices generally have two states: writing and erasing. When multiple people are writing at the same time, if someone needs to enable the erasing state, the others need to stop writing.

[0004] However, using the existing technology, multiple people's operations in a multi-person scene affect each other, resulting in a poor user experience. Summary of the invention

[0005] The embodiments of the present application provide a multimedia device interaction method, apparatus, multimedia device and medium to solve the problem in the prior art that operations of multiple people in a multi-person scene affect each other and the user experience is poor.

[0006] In a first aspect, an embodiment of the present application provides an interaction method of a multimedia device, including:

[0007] Based on the touch position of the touch event, determining a target virtual sub-screen area where the touch event is located, wherein the screen of the multimedia device is divided into a plurality of virtual sub-screen areas, and the target virtual sub-screen area is one of the plurality of virtual sub-screen areas;

[0008] The touch event is responded to based on the event state of the target virtual sub-screen area.

[0009] Optionally, responding to the touch event based on the event state of the target virtual sub-screen area includes:

[0010] The touch event is responded to based on the writing state and the erasing state in the target virtual sub-screen area.

[0011] Optionally, responding to the touch event based on the writing state and the erasing state in the target virtual sub-screen area includes:

[0012] The touch event is responded to based on the touch area of ​​the touch event and based on the writing state and the erasing state in the target virtual sub-screen area.

[0013] Optionally, responding to the touch event based on the touch area of ​​the touch event and based on the writing state and the erasing state in the target virtual sub-screen area includes:

[0014] If the touch area of ​​the touch event is smaller than or equal to the preset area, and the target virtual sub-screen area is not in an erased state, responding to the writing behavior;

[0015] If the touch area of ​​the touch event is smaller than or equal to the preset area, and the target virtual sub-screen area is in an erased state, then the touch event is not responded to;

[0016] If the touch area of ​​the touch event is larger than the preset area, and the target virtual sub-screen area is not in an erasing state or a writing state, responding to an erasing action;

[0017] If the touch area of ​​the touch event is larger than the preset area, and the target virtual sub-screen area is in an erasing state or a writing state, the touch event is not responded to.

[0018] Optionally, before determining the target virtual sub-screen area where the touch event is located based on the touch position of the touch event, the method further includes:

[0019] The touch data of the touch event is stored based on the touch pool class, where the touch data includes: a touch position and a touch area.

[0020] Optionally, storing the touch position and touch area of ​​the touch event based on a touch pool class includes:

[0021] When a touch event is triggered, the touch data of the touch event is added to the touch pool class for storage;

[0022] When a touch event is updated, updating touch data corresponding to the touch event;

[0023] When the touch event ends, the touch data of the touch event is deleted from the touch pool class.

[0024] Optionally, before determining the target virtual sub-screen area where the touch event is located based on the touch position of the touch event, the method further includes:

[0025] Acquiring hardware-related data of the screen of the multimedia device;

[0026] Based on the hardware-related data, the screen of the multimedia device is divided into a plurality of virtual sub-screen areas.

[0027] In a second aspect, an embodiment of the present application provides an interactive device for a multimedia device, characterized in that it includes:

[0028] a processing module, configured to determine a target virtual sub-screen area where the touch event is located based on a touch position of the touch event, wherein the screen of the multimedia device is divided into a plurality of virtual sub-screen areas, and the target virtual sub-screen area is one of the plurality of virtual sub-screen areas;

[0029] A response module is used to respond to the touch event based on the event state of the target virtual sub-screen area.

[0030] Optionally, the processing module is further used to obtain hardware-related data of the screen of the multimedia device;

[0031] Based on the hardware-related data, the screen of the multimedia device is divided into a plurality of virtual sub-screen areas.

[0032] Optionally, the response module is further used to respond to the touch event based on the writing state and the erasing state in the target virtual sub-screen area.

[0033] Optionally, the response module is further used to respond to the touch event based on the touch area of ​​the touch event, and based on the writing state and the erasing state in the target virtual sub-screen area.

[0034] Optionally, the response module is specifically used to respond to the touch event based on the touch area of ​​the touch event, and based on the writing state and the erasing state in the target virtual sub-screen area;

[0035] Specifically, it includes: if the touch area of ​​the touch event is less than or equal to a preset area, and the target virtual sub-screen area is not in an erased state, responding to the writing behavior;

[0036] If the touch area of ​​the touch event is smaller than or equal to the preset area, and the target virtual sub-screen area is in an erased state, then the touch event is not responded to;

[0037] If the touch area of ​​the touch event is larger than the preset area, and the target virtual sub-screen area is not in an erasing state or a writing state, responding to an erasing action;

[0038] If the touch area of ​​the touch event is larger than the preset area, and the target virtual sub-screen area is in an erasing state or a writing state, the touch event is not responded to.

[0039] Optionally, the response module is further used to store touch data of the touch event based on a touch pool class, where the touch data includes: a touch position and a touch area.

[0040] Optionally, the processing module is specifically configured to add the touch data of the touch event to the touch pool class for storage when a touch event is triggered;

[0041] When a touch event is updated, updating touch data corresponding to the touch event;

[0042] When the touch event ends, the touch data of the touch event is deleted from the touch pool class.

[0043] In a third aspect, an embodiment of the present application provides a multimedia device comprising: a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the interaction method of the multimedia device as described in any one of the first aspects are implemented.

[0044] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the interactive method of a multimedia device as described in any one of the first aspects are implemented.

[0045] In a fifth aspect, an embodiment of the present application provides a computer program product, which, when executed by a processor of a vehicle or a cloud server, implements the steps of the multimedia device interaction method described in any one of the first aspects.

[0046] The interactive method, apparatus, multimedia device and medium of the multimedia device provided in the embodiments of the present application divide the screen of the multimedia device into multiple virtual sub-screen areas, and each user operates in the corresponding virtual sub-screen area. The target virtual sub-screen area where the user's operation is located is determined based on the position of the touch event. Each virtual sub-screen area can respond to the touch event independently, ensuring that even in the scenario of multiple people operating at the same time, the operation of each user can be recognized and processed by the system, thereby reducing touch conflicts between different users and improving user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A schematic diagram of dividing a virtual sub-screen area provided in an embodiment of the present application;

[0048] Figure 2 A flowchart of an interactive method for a multimedia device provided in an embodiment of the present application;

[0049] Figure 3 A flowchart of another method for interacting with multimedia devices provided in an embodiment of the present application;

[0050] Figure 4 A flowchart of another method for interacting with multimedia devices provided in an embodiment of the present application;

[0051] Figure 5 A schematic diagram of the structure of an interactive device of a multimedia device is provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] The technical solutions in the embodiments of the present application will be clearly described below in conjunction with the drawings in the embodiments of the present application. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of the present application.

[0053] In the related art, multimedia touch devices generally have two states: writing and erasing. When multiple people are writing at the same time, if someone needs to enable the erasing state, others need to stop writing and wait for the erasing to end before continuing to write. This method causes the writing of other users to be interrupted, and the waiting process takes a long time, resulting in low efficiency for multiple people to write at the same time and poor user experience.

[0054] In order to improve the reliability of multi-person writing and gesture erasing methods under multiple screens and enhance the user's interactive experience, the present application provides an interactive method, device, multimedia device and medium for a multimedia device, which can realize simultaneous writing and erasing of multiple people based on the touch position of a touch event and the writing state and erasing state in a target virtual sub-screen area.

[0055] The following embodiments of the present application can be executed by a multimedia device. Figure 1 A schematic diagram of the division of a virtual sub-screen area provided in an embodiment of the present application includes but is not limited to: virtual sub-screen area one, virtual sub-screen area two and virtual sub-screen area three, and the division method can be customized by the user. Figure 2 A flowchart of an interactive method of a multimedia device provided in an embodiment of the present application. Figure 2 As shown:

[0056] S21: Based on the touch position of the touch event, determine a target virtual sub-screen area where the touch event is located.

[0057] Among them, the touch event refers to the writing behavior or erasing behavior triggered when the user touches the screen, and the touch position refers to the position of the contact point when the user touches the screen of the multimedia device. The target virtual sub-screen area refers to the virtual sub-screen area where the touch position of the touch event is located after the screen of the multimedia device is divided into multiple virtual sub-screen areas. Assuming that the screen is divided into virtual sub-screen area 1, virtual sub-screen area 2 and virtual sub-screen area 3, after the user touches the screen, the touch position of the touch point is within virtual sub-screen area 1, then virtual sub-screen area 1 is the target virtual sub-screen area.

[0058] For example, a touch pool class can be defined for obtaining the touch position of a touch event, and the touch pool class can manage information such as touch ID, touch position, touch area, touch status, etc. Specifically, the user's touch behavior can be captured by the touch sensor first to generate an event containing touch position data. Touch position information such as the X and Y coordinates in the screen coordinate system is extracted from the touch event. At the software or operating system level, the physical screen is divided into multiple virtual sub-screen areas. The virtual sub-screen area can correspond to a specific application, function or UI component. Each virtual sub-screen area is defined by recording the upper left corner coordinates and the width and height of the area to define the position and size of each virtual sub-screen area. Traverse all defined virtual sub-screen areas, and for each virtual sub-screen area, check whether the coordinates of the touch position meet the following conditions:

[0059] The X coordinate is greater than or equal to the left border of a virtual sub-screen area and less than the left border plus the area width;

[0060] The Y coordinate is greater than or equal to the lower boundary of a virtual sub-screen area and less than the lower boundary plus the area height.

[0061] If the coordinates of the touch position meet the above conditions, it is considered that the touch event occurs in the currently checked virtual sub-screen area, and the virtual sub-screen area is the target virtual sub-screen area.

[0062] Specifically, assume that there is a multimedia touch device in the classroom with a size of 99 cm wide and 66 cm high. In order to accommodate multiple people writing, the screen is divided into 3 virtual sub-screen areas. The multimedia touch device is equipped with a highly sensitive touch sensor that can capture the touch input of each user. When a user touches the screen, the sensor generates a touch event, including the screen coordinates (X, Y) of the touch point. The software running on the computer built into or connected to the multimedia touch device receives these touch events, monitors the event stream from the touch sensor and receives touch events, extracts the X and Y coordinates of the touch point from each touch event, and determines which virtual sub-screen area the touch point falls in based on the coordinates. If 0<=X<33 and 0<=Y<33, the touch occurs in virtual sub-screen area one; if 33<=X<66 and 0<=Y<33, the touch occurs in virtual sub-screen area two; if 66<=X<99 and 0<=Y<33, the touch occurs in virtual sub-screen area three.

[0063] S22: Responding to the touch event based on the event state of the target virtual sub-screen area.

[0064] The event state of the target virtual sub-screen area includes a writing state and an erasing state, and the touch event includes a writing behavior and an erasing behavior. If the touch event currently required to be executed is a writing behavior, and there is no erasing state in the target virtual sub-screen area, the writing behavior is responded to; if the touch event currently required to be executed is a writing behavior, but there is an erasing state in the target virtual sub-screen area, the touch event ends; if the touch event currently required to be executed is an erasing behavior, and there is no writing state or erasing state in the target virtual sub-screen area, the erasing behavior is responded to; if the touch event currently required to be executed is an erasing behavior, but there is a writing state or an erasing state in the target virtual sub-screen area, the touch event ends.

[0065] For example, 10 students are writing a text on a multimedia touch device in a classroom. The screen of the multimedia touch device is divided into four areas, namely virtual sub-screen area 1, virtual sub-screen area 2, virtual sub-screen area 3 and virtual sub-screen area 4. Students A, B, and C write in virtual sub-screen area 1, students D and E write in virtual sub-screen area 2, students F and G write in virtual sub-screen area 3, and students H, I, and J write in virtual sub-screen area 4. At this time, C needs to write. When the screen is touched, A and B in the virtual sub-screen area one are both in the writing state, so C's writing behavior is responded to; at this time, D needs to write. E in the virtual sub-screen area two is already in the erasing state, so D's writing behavior is not responded to; at this time, F needs to erase. When F touches the screen, G in the virtual sub-screen area three is not in the writing or erasing state, so F's erasing behavior is responded to; at this time, H needs to erase. I and J in the virtual sub-screen area four are already in the writing state, so H's erasing behavior is not responded to.

[0066] In this embodiment, the screen of the multimedia device is divided into multiple virtual sub-screen areas, each user operates in the corresponding virtual sub-screen area, and the target virtual sub-screen area where the user operates is determined based on the position of the touch event. Each virtual sub-screen area can independently respond to the touch event, ensuring that even in the scenario where multiple people operate at the same time, the operation of each user can be recognized and processed by the system, thereby reducing the touch conflict between different users and improving the user experience. Since in the multi-person operation scenario, the touch operation of each user is independent of each other and is not affected by others, the operation efficiency and operation fluency are improved.

[0067] The following describes several specific embodiments of multiple people writing and erasing on the screen of a multimedia device at the same time.

[0068] Figure 3 A flowchart of another interactive method of a multimedia device provided in an embodiment of the present application is shown in FIG. Figure 3 As shown:

[0069] S31: Acquire hardware-related data of the screen of the multimedia device.

[0070] Among them, the hardware-related data specifically includes: the number of screens, the size of each screen, the arrangement rules and other information. For example, first obtain the handle of the desktop window, and then use the enumeration display monitor function to enumerate all connected displays by intersecting with the intersection of the specified clipping rectangle and the visible area of ​​the device context. For each display, use the enumeration display monitor function to obtain the current display settings, including the width and height of the screen. Specifically, use the Get Device Context (Get DC) function to retrieve the handle of the display device context environment of the user area of ​​the specified window or the entire screen, set the parameter of the GetDC function to NULL, retrieve the device context environment of the entire screen, and use it to associate the screen of the entire multimedia device to ensure the accuracy of the enumeration. Use the enumeration display monitor function and pass the device context just obtained as a parameter. The enumeration display monitor function will traverse all connected displays. For each display, the enumeration display monitor function will call a callback function to process the information of each display, that is, collect information about the display, such as the width and height of the screen, resolution, position, DPI setting, etc., and store or process it as needed.

[0071] The handle is a unique identifier of a desktop window, which is a unique integer value used to identify and manage windows in the Windows operating system. For example, when a new window is created, the Windows system assigns a unique handle to the window, and the application can reference the window through the handle to perform operations such as moving, resizing, hiding, and showing.

[0072] S32: Based on the hardware-related data, the screen of the multimedia device is divided into a plurality of virtual sub-screen areas.

[0073] The segmentation logic is determined according to the application scenario and user needs. The segmentation logic includes but is not limited to equal division, free ratio segmentation or segmentation based on a specific template. The parameters of the virtual area are defined in the software, including the type (such as rectangle, circle, etc.), size, position and boundary of the area. In this embodiment, the screen is divided into the following Figure 1The virtual sub-screen area shown. For example, in the process of virtually dividing the screen area of ​​the user interface (UI) layer of the software according to the screen or setting data, the basic properties of the screen, including size, position, content, etc., are first defined, and then the layout manager provided by the UI framework or the position and size are manually calculated to divide the screen into multiple virtual areas. Most UI frameworks provide layout managers to help developers divide the screen area. For example, in Android system development, layout managers such as linear layout manager, relative layout manager and grid layout manager can be used to define the position and size of each area. Among them, the linear layout manager is used to arrange UI elements horizontally or vertically, the relative layout manager arranges UI elements according to relative position relationship, and the grid layout manager is used to create a grid-like layout to divide the screen. If you choose to divide the screen into three horizontally stacked areas, you can use the grid layout manager to set it to 1 row and 3 columns, each column represents a virtual sub-screen area, and you can set the column weight to control the size ratio of each area. The weight determines how each column allocates additional space when the screen size changes. To make the three sub-screens equal in size, you can set the weight of each column to the same value, such as the weight of each column is 1.

[0074] Specifically, suppose there is a multimedia device with a height H of 33 cm and a width W of 99 cm. Take the coordinates of the lower left corner of the screen as (0, 0) as an example. Use the grid layout manager to create a grid layout to divide the screen into one row and three columns, with each row dividing the width into three equal parts. At this time, the height h of each virtual sub-screen area is 33 cm and the width w is 33 cm. The coordinates of the lower left corner of virtual sub-screen area 1 are (0, 0), the left border is 0, and the lower border is virtual; the coordinates of the lower left corner of virtual sub-screen area 2 are (33, 0), the left border is 33, and the lower border is 0; the coordinates of the lower left corner of virtual sub-screen area 3 are (66, 0), the left border is 66, and the lower border is 0. For each virtual sub-screen area, use the layout attributes of the layout manager to define their positions:

[0075] Virtual sub-screen area 1: Set its column layout to 0 and row layout to 0, indicating that it is located in the first column and the first row.

[0076] Virtual sub-screen area 2: Set its column layout to 1 and row layout to 0, indicating that it is located in the second column and the first row.

[0077] Virtual sub-screen area three: Set its column layout to 2 and row layout to 0, indicating that it is located in the third column and the first row.

[0078] The virtual screen division method of the embodiment of the present application is only used as an example, and the virtual sub-screen area is divided into one row and three columns, but in actual application, the user can set the division method according to the needs. Each virtual sub-screen area can be regarded as an independent operation area, and the operation of each virtual sub-screen area does not affect the operation of other virtual sub-screen areas. An event listener can be set for each virtual sub-screen area to ensure that users in different areas do not interfere with each other. Multi-threading or asynchronous programming technology can be used to ensure that the interaction of different areas can be processed in parallel to improve the response speed.

[0079] S33: storing touch data of the touch event based on the touch pool class, wherein the touch data includes: a touch position and a touch area.

[0080] Among them, the touch position is the data that determines the exact location where the user touches the screen, usually expressed as X and Y coordinates in the screen coordinate system. The touch area refers to the size of the area covered by the touch point when the user touches the screen. In some cases, the touch area can be used to identify different gestures or increase the sensitivity of touch interaction. When the user interacts with the touch interface, the system captures touch events through the touch sensor and converts these events into touch data. The captured touch data is encapsulated into a structured format, such as an object or record, for easy processing and transmission.

[0081] The touch data storing the touch event specifically includes:

[0082] When a touch event is triggered, the touch data of the touch event is added to the touch pool class for storage;

[0083] When a touch event is updated, updating touch data corresponding to the touch event;

[0084] When the touch event ends, the touch data of the touch event is deleted from the touch pool class.

[0085] Among them, the touch event trigger refers to the user touching the screen, the touch event update refers to the user's touch point moving on the screen, and the touch event end refers to the user leaving the screen.

[0086] For data storage when a touch event is triggered: When a user interacts with a touch interface (such as a touch screen) and a touch event is generated, the system first needs to capture the touch event. The captured touch event contains a variety of data, namely touch data, including at least touch position, touch area, touch timestamp, etc. The touch data is then added to the touch pool class for storage. The touch pool class may store the touch data in a list, queue, or a specific data structure (such as a hash table). Among them, the touch timestamp is a value that records the exact time when the touch event occurs.

[0087] For data updates when touch events are updated: Since the user's touch behavior may be continuous, such as continuous touching or dragging, this will generate multiple updated touch events within a certain period of time. Whenever an updated touch event is received, it is necessary to identify that this is an update to the existing touch event, find the corresponding touch data in the touch pool, and update these touch data to the latest event information, which may include new positions, changed touch areas, or updated timestamps.

[0088] Data deletion at the end of a touch event: When the user's touch behavior ends, such as when the user's finger leaves the screen, the multimedia device will recognize the end of the touch event. Once the end of the touch event is recognized, the system needs to find the corresponding touch data from the touch pool class and delete it. This deletion operation ensures that the touch pool class does not store outdated information, ensuring that there is sufficient space and processing power to respond to and process new touch input events, thereby maintaining the smoothness of the interface and the immediacy of interaction.

[0089] For example, a touch pool class named TouchPool is defined to store and manage all touch events. In order to quickly access and update touch data, a hash table is selected as the storage structure. The hash table provides fast search, insertion and deletion operations. When a touch event is detected, it is determined that the touch event has started (assuming that the user touches the screen of the multimedia device), a new touch record is created and added to the TouchPool. The touch record includes the location information and touch area of ​​the touch point. When the touch point moves, it can be regarded as a touch event update. At this time, the touch data of the corresponding touch point in the TouchPool is updated. When the touch event ends, the corresponding touch record is removed from the TouchPool.

[0090] There are several methods for judging the end of a touch event: when multiple users are writing in the virtual sub-screen area, multi-touch technology is used. In multi-touch technology, each touch point is assigned a unique touch ID. When the touch point corresponding to the touch ID is lifted, it can be considered that the touch operation of the touch point has ended; or the number of touch points on the screen is tracked. When the number of touch points decreases from N to N-1, it is considered that the touch of a touch point has ended; or by analyzing the moving speed and direction of the touch point, if the speed suddenly drops to zero or the direction changes significantly, it can be judged that the touch event has ended; or the software can judge whether the touch has ended through preset logic. For example, when a touch point does not move within a certain period of time, even if the touch point is still in contact with the screen, it can be considered that the touch has ended; if a pressure-sensitive screen is used, the change in contact area can be monitored to determine whether the touch has ended. When, for example, the touch area suddenly decreases, it may be because the user has lifted his finger, and the touch is judged to have ended.

[0091] Specifically, for example, when a user touches the screen with a finger, a touchstart event is triggered to indicate that a touch event is triggered. The event processing function creates a data object containing the touch point coordinates (10, 20), the touch ID 1, and the event type touchstart. The data object is stored in the hash table of TouchPool, with the touch ID as the key and the touch data object as the value. When the user's finger moves on the screen, touchmove events are continuously triggered, indicating that the touch event is updated. Each time a touchmove event is triggered, the previously stored touch data needs to be updated to reflect the position of the finger. At this time, the TouchPool method is called again. Assume that the user's finger moves to a new position, the new touch point coordinates are: (15, 25), and the touch ID remains unchanged: 1. Use the touch ID as the key to find the corresponding touch data object in the hash table of TouchPool. After finding the object, update its coordinate attributes to the new coordinates (15, 25); when the user lifts his finger and leaves the screen, a touchend event will be triggered to indicate the touch event. The event processing function uses touch ID: 1 to identify the ended touch operation, and uses the touch ID as the key again to find the corresponding touch data object in the hash table of TouchPool. After finding the object, delete the record from the hash table to release resources, indicating that the touch operation has ended.

[0092] S34: Based on the touch position of the touch event, determine the target virtual sub-screen area where the touch event is located.

[0093] First, define the layout of the multimedia device screen and logically divide it into multiple virtual sub-screen areas. According to the touch position of the touch event in TouchPool, it can be determined in which virtual sub-screen area of ​​the multimedia device screen the touch position is, and the virtual sub-screen area is the target virtual sub-screen area.

[0094] For example, when a user's finger touches the screen, the touch sensor detects the touch and generates a touch event, which contains the original data of the touch position, such as the X and Y coordinates in the screen coordinate system. The touch point is determined in which virtual sub-screen area according to the position coordinates of the touch event. Specifically, assume that the screen of a multimedia touch device is divided into three virtual sub-screen areas with a height and width of 33 cm each. The lower left corner coordinates of virtual sub-screen area one are (0, 0), the left border is 0, and the lower border is 0. The lower left corner coordinates of virtual sub-screen area two are (33, 0), the left border is 33, and the lower border is 0. The lower left corner coordinates of virtual sub-screen area three are (66, 0), the left border is 66, and the lower border is 0. At this time, a user touches the screen, and the coordinates obtained by the application are (15, 15). The obtained coordinates X=15, Y=15 satisfy 0<=X<0+33 and 0<=Y<0+33, that is, the boundary conditions of virtual sub-screen one are satisfied. At this time, virtual sub-screen one is the target virtual sub-screen area.

[0095] S35: Responding to the touch event based on the touch area of ​​the touch event and based on the writing state and the erasing state in the target virtual sub-screen area.

[0096] Responding to the touch event includes:

[0097] If the touch area of ​​the touch event is smaller than or equal to the preset area, and the target virtual sub-screen area is not in an erased state, responding to the writing behavior;

[0098] If the touch area of ​​the touch event is smaller than or equal to the preset area, and the target virtual sub-screen area is in an erased state, then the touch event is not responded to;

[0099] If the touch area of ​​the touch event is larger than the preset area, and the target virtual sub-screen area is not in an erasing state or a writing state, responding to an erasing action;

[0100] If the touch area of ​​the touch event is larger than the preset area, and the target virtual sub-screen area is in an erasing state or a writing state, the touch event is not responded to.

[0101] The preset area is used to determine whether the user's touch event is a writing behavior or an erasing behavior. If the touch area is less than or equal to the preset area, the touch event is a writing behavior; if the touch area is greater than the preset area, the touch event is an erasing behavior. When calculating the touch area, the area covered by the touch is calculated based on the starting position and current position of the touch point. If the touch point is a rectangle, the area can be calculated based on the multiplication of the length and width; if it is a circle or an ellipse, the area can be calculated based on the touch radius; if it is an irregular shape, an algorithm can be used to determine the boundary.

[0102] Among them, the writing state means that a user is writing in the virtual sub-screen area, and the erasing state means that a user is erasing in the virtual sub-screen area. To determine whether the target virtual sub-screen area is in the writing state or the erasing state, a state identifier can be defined for each virtual sub-screen area. The state identifier can be a Boolean value or an enumeration type, which is used to represent different states of the area, such as "writing" or "erasing". When the user enters the erasing mode or performs an erasing operation on the virtual sub-screen area, the state identifier of the area is set to "erasing". When a touch event occurs, the system captures the event and extracts the coordinate information of the touch point. According to the coordinates of the touch point, it is determined in which virtual sub-screen area the touch point falls. Once the area where the touch point is located is determined, the state identifier of the area is checked. If the state identifier is "writing", it means that the virtual sub-screen area is in the writing state; if the state identifier is "erasing", it means that the virtual sub-screen area is in the erasing state. Determining whether there is a writing state and an erasing state in the target virtual sub-screen area is to ensure that the writing behavior and the erasing behavior in the same virtual sub-screen area are mutually exclusive, so as to avoid the writing behavior being covered by the erasing behavior.

[0103] For example, when multiple people are writing on the screen of a multimedia touch device in a classroom, they write with their fingers and use palm gestures to call up an eraser to erase. At this time, the area of ​​one-half the size of the average palm can be set equal to the preset area. Usually, the palm size of an adult is 144 to 180 square centimeters. Considering that the palm size of each person varies according to individual factors such as age, gender, height and body shape, it is assumed that the preset area is 60 square centimeters. That is, when the touch area is less than or equal to 60 square centimeters, it is determined as a writing behavior, and when the touch area is greater than 60 square centimeters, it is determined as an erasing behavior.

[0104] Response to writing behavior: Assuming a touch event is captured, the touch ID is 1, the touch position is (10, 10), the touch area is 2 square centimeters, and the touch area is less than 60 square centimeters. It is determined that the touch event is a writing behavior and is located in the virtual sub-screen area 1, and there is no erase state in the current virtual sub-screen area 1. Then respond to the event and display the writing handwriting in the virtual sub-screen area 1, record the touch event and store it in TouchPool.

[0105] The writing behavior is ignored, and a touch event is captured, with a touch ID of 2, a touch position of (45, 10), and a touch area of ​​40 square centimeters. The touch area is less than 60 square centimeters, and the touch event is determined to be a writing behavior and is located in the virtual sub-screen area two. However, at this time, the virtual sub-screen area two already has a touch event with a touch ID of 3 in the erase state, so the device does not respond and does not record this touch event.

[0106] Response to erasing behavior: Assume that the user wants to erase part of the content on the screen and touches the screen with his palm. A touch event is captured with a touch ID of 4, a touch position of (77, 17), and a touch area of ​​80 square centimeters. The touch area is greater than 60 square centimeters. The touch event is determined to be an erasing behavior and is located within virtual sub-screen area three. There is no writing or erasing state within virtual sub-screen area three. In response to the event, the content on the screen is erased according to the touch path. The touch event is recorded and stored in TouchPool.

[0107] Ignore the erasing behavior: Assume that a touch event is captured, the touch ID is 5, the touch position is (22, 26), the touch area is 70 square centimeters, and the touch area is greater than 60 square centimeters. It is determined that the touch event is an erasing behavior and is located in the virtual sub-screen area 1. However, at this time, there is a touch event with touch ID 6 in the virtual sub-screen area 1 that is in the erasing state. The device does not respond and does not record this touch event.

[0108] In this embodiment, by acquiring hardware-related data of the screen of the multimedia device, the screen of the multimedia device is divided into multiple virtual sub-screen areas, and touch data of the touch event is stored based on a touch pool class, the touch data including: a touch position and a touch area, and based on the touch position of the touch event, a target virtual sub-screen area where the touch event is located is determined, and based on the touch area of ​​the touch event and the writing state and erasing state in the target virtual sub-screen area, the touch event is responded to, thereby enabling multiple people to write and erase on the screen of the multimedia device at the same time.

[0109] Figure 4 A flowchart of another method for interacting with multimedia devices provided in an embodiment of the present application is shown below. Figure 4 As shown, a possible implementation of S35 is as follows:

[0110] S351: Determine whether the erasing behavior is performed in the target sub-screen area.

[0111] Touch events are divided into writing behavior and erasing behavior. After determining the target sub-screen area, it is determined whether the touch event to be executed is an erasing behavior, so that the target sub-screen area responds to the writing behavior or the erasing behavior.

[0112] S352: Determine whether the target sub-screen area is already in an erased state.

[0113] Determine that this touch event is a writing behavior. Since writing and erasing behaviors cannot be performed simultaneously in the same virtual sub-screen area, before performing the writing behavior in the target sub-screen area, first determine whether an erasing state already exists in the target sub-screen area. If an erasing state already exists in the target sub-screen area, indicating that other users are already performing an erasing behavior, the touch ends; if no erasing state exists in the target sub-screen area, execute the next step.

[0114] S353: Respond to the writing behavior in the target sub-screen area and record the touch event.

[0115] It is determined that the touch event is a writing behavior, and there is no erase state in the target sub-screen area, the target sub-screen area responds to the writing behavior, and the writing behavior is recorded.

[0116] S354: Determine whether the target sub-screen area is already in a writing state or an erasing state.

[0117] Determine that this touch event is an erasing behavior. Since writing and erasing behaviors cannot be performed simultaneously in the same virtual sub-screen area, and only one erasing behavior can be performed simultaneously, before performing the erasing behavior in the target sub-screen area, first determine whether the target sub-screen area already has a writing state or an erasing state. If the target sub-screen area already has a writing state, it indicates that a user has performed a writing behavior in the target sub-screen area, and the touch control ends; if the target sub-screen area already has an erasing state, it indicates that a user has performed an erasing behavior in the target sub-screen area, and the touch control ends; if the target sub-screen area does not have a writing state or an erasing state, execute the next step.

[0118] S355: The target sub-screen area responds to the erasing behavior and records the touch event.

[0119] It is determined that the touch event is an erasing behavior, and there is no writing state and erasing state in the target sub-screen area, the target sub-screen area responds to the erasing behavior, and the erasing behavior is recorded.

[0120] Further, after steps S353 and S355, execute S356:

[0121] S356: The touch control ends and the touch control data is deleted.

[0122] After the multimedia device recognizes that the touch event is completed, the touch data is deleted.

[0123] In this embodiment, it is determined whether the touch event is a writing behavior or an erasing behavior. If it is determined to be a writing behavior, it is determined whether the erasing state already exists in the target sub-screen area. If the erasing state does not exist in the target sub-screen area, the writing behavior is responded to in the target sub-screen area, and the touch event is recorded. If it is determined to be an erasing behavior, it is determined whether the writing state or the erasing state already exists in the target sub-screen area. If the writing state or the erasing state does not exist in the target sub-screen area, the erasing behavior is responded to in the target sub-screen area, and the touch event is recorded. The touch data is deleted after the touch ends. Thus, it is possible for multiple people to write and erase on the screen of the multimedia device at the same time, thereby improving the user's interactive experience.

[0124] Figure 5 A structural schematic diagram of an interactive device of a multimedia device is provided for an embodiment of the present application, comprising: a processing module 501 and a response module 502, wherein the processing module 501 is used to determine a target virtual sub-screen area where the touch event is located based on the touch position of the touch event, wherein the screen of the multimedia device is divided into multiple virtual sub-screen areas, and the target virtual sub-screen area is one of the multiple virtual sub-screen areas; and the response module 502 is used to respond to the touch event based on the event state of the target virtual sub-screen area.

[0125] Optionally, the processing module 501 is further used to obtain hardware-related data of the screen of the multimedia device;

[0126] Based on the hardware-related data, the screen of the multimedia device is divided into a plurality of virtual sub-screen areas.

[0127] Optionally, the response module 502 is further configured to respond to the touch event based on the writing state and the erasing state in the target virtual sub-screen area.

[0128] Optionally, the response module 502 is further configured to respond to the touch event based on a touch area of ​​the touch event, and based on a writing state and an erasing state in the target virtual sub-screen area.

[0129] Optionally, the response module 502 is specifically used to respond to the touch event based on the touch area of ​​the touch event, and based on the writing state and the erasing state in the target virtual sub-screen area;

[0130] Specifically, it includes: if the touch area of ​​the touch event is less than or equal to a preset area, and the target virtual sub-screen area is not in an erased state, responding to the writing behavior;

[0131] If the touch area of ​​the touch event is smaller than or equal to the preset area, and the target virtual sub-screen area is in an erased state, then the touch event is not responded to;

[0132] If the touch area of ​​the touch event is larger than the preset area, and the target virtual sub-screen area is not in an erasing state or a writing state, responding to an erasing action;

[0133] If the touch area of ​​the touch event is larger than the preset area, and the target virtual sub-screen area is in an erasing state or a writing state, the touch event is not responded to.

[0134] Optionally, the response module is further used to store touch data of the touch event based on a touch pool class, where the touch data includes: a touch position and a touch area.

[0135] Optionally, the processing module 501 is specifically configured to add the touch data of the touch event to the touch pool class for storage when a touch event is triggered;

[0136] When a touch event is updated, updating touch data corresponding to the touch event;

[0137] When the touch event ends, the touch data of the touch event is deleted from the touch pool class.

[0138] The device of this embodiment can be used to execute the technical solutions of the above-mentioned method embodiments. Its implementation principles and technical effects are similar and will not be repeated here.

[0139] The interactive method of the multimedia device in the embodiment of the present application can be used to implement the technical solutions of the above-mentioned method embodiments. Its implementation principles and technical effects are similar and will not be repeated here.

[0140] The embodiment of the present application also provides a multimedia device, the multimedia device comprising a processor and a memory. The memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the following is implemented: Figures 2 to 4 The steps of the interactive method of the multimedia device are shown.

[0141] The embodiment of the present application also provides a computer-readable storage medium, wherein a program or instruction is stored on the computer-readable storage medium, and when the program or instruction is executed by a processor, the following is implemented: Figures 2 to 4 The steps of the interactive method of the multimedia device are shown.

[0142] The present application also provides a computer program product, which, when executed by a processor of a vehicle or a cloud server, implements the following Figures 2 to 4 The steps of the interactive method of the multimedia device are shown.

[0143] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of a computer software product plus a necessary general hardware platform, and of course, can also be implemented by hardware. The computer software product is stored in a storage medium (such as ROM, RAM, disk, CD, etc.), including several instructions to enable a terminal or a network-side device to execute the methods described in each embodiment of the present application.

[0144] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms of implementation methods without departing from the purpose of the present application and the scope of protection of the claims, and these implementation methods are all within the protection of the present application.

Claims

1. An interactive method of a multimedia device, characterized in that: include: Based on the touch position of the touch event, determining a target virtual sub-screen area where the touch event is located, wherein the screen of the multimedia device is divided into a plurality of virtual sub-screen areas, and the target virtual sub-screen area is one of the plurality of virtual sub-screen areas; The touch event is responded to based on the event state of the target virtual sub-screen area.

2. The method according to claim 1, characterized in that The responding to the touch event based on the event state of the target virtual sub-screen area includes: The touch event is responded to based on the writing state and the erasing state in the target virtual sub-screen area.

3. The method according to claim 2, characterized in that The responding to the touch event based on the writing state and the erasing state in the target virtual sub-screen area includes: The touch event is responded to based on the touch area of ​​the touch event and based on the writing state and the erasing state in the target virtual sub-screen area.

4. The method according to claim 3, characterized in that The step of responding to the touch event based on the touch area of ​​the touch event and based on the writing state and the erasing state in the target virtual sub-screen area includes: If the touch area of ​​the touch event is smaller than or equal to the preset area, and the target virtual sub-screen area is not in an erased state, responding to the writing behavior; If the touch area of ​​the touch event is smaller than or equal to the preset area, and the target virtual sub-screen area is in an erased state, then the touch event is not responded to; If the touch area of ​​the touch event is larger than the preset area, and the target virtual sub-screen area is not in an erasing state or a writing state, responding to an erasing action; If the touch area of ​​the touch event is larger than the preset area, and the target virtual sub-screen area is in an erasing state or a writing state, the touch event is not responded to.

5. The method according to any one of claims 1 to 4, characterized in that: Before determining the target virtual sub-screen area where the touch event is located based on the touch position of the touch event, the method further includes: The touch data of the touch event is stored based on the touch pool class, where the touch data includes: a touch position and a touch area.

6. The method according to claim 5, characterized in that The storing of the touch position and the touch area of ​​the touch event based on the touch pool class includes: When a touch event is triggered, the touch data of the touch event is added to the touch pool class for storage; When a touch event is updated, updating touch data corresponding to the touch event; When the touch event ends, the touch data of the touch event is deleted from the touch pool class.

7. The method according to any one of claims 1 to 4, characterized in that: Before determining the target virtual sub-screen area where the touch event is located based on the touch position of the touch event, the method further includes: Acquiring hardware-related data of the screen of the multimedia device; Based on the hardware-related data, the screen of the multimedia device is divided into a plurality of virtual sub-screen areas.

8. An interactive device for a multimedia device, characterized in that: include: a processing module, configured to determine a target virtual sub-screen area where the touch event is located based on a touch position of the touch event, wherein the screen of the multimedia device is divided into a plurality of virtual sub-screen areas, and the target virtual sub-screen area is one of the plurality of virtual sub-screen areas; A response module is used to respond to the touch event based on the event state of the target virtual sub-screen area.

9. A multimedia device, characterized in that: include: A processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the interactive method of the multimedia device as described in any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the interactive method of a multimedia device as described in any one of claims 1 to 7 are implemented.

Images