Scene control method and device, electronic equipment and storage medium

Abstract

The invention discloses a scene control method and device, electronic equipment and a storage medium, and relates to the technical field of electronic equipment. The method comprises the steps that if it is detected that a current scene meets a scene triggering condition of a specified scene, scene arrangement information of the specified scene is determined, the scene arrangement information comprises a plurality of scene services, scene cards, a triggering sequence between the scene services and the scene cards, card issuing equipment corresponding to the scene cards and one or more execution equipment corresponding to the scene services, and the scene cards are used for controlling execution of part or all of the scene services. According to the triggering sequence, the scene cards are displayed through the card output device, and the multiple scene services are executed through the one or more execution devices. According to the scene control method and device, the scene cards are added in the scene linkage to trigger execution of part or all of the multiple scene services, so that the intuition and operability of scene control are improved, and the use experience of a user is improved.

Description

Technical Field

[0001] The present application relates to the technical field of electronic devices, and more specifically, to a scene control method, device, electronic device and storage medium. Background Art

[0002] With the development of science and technology, electronic devices are used more and more widely and have more and more functions. They have become one of the necessities in people's daily life. The popularity of electronic devices has changed the way of life of the public to a certain extent. They can provide users with smart scenes through a single electronic device or the linkage of multiple electronic devices, such as a nap scene in the car, a scene of leaving home, a scene of returning home, etc. However, the intuitiveness and operability of scene control are currently poor, resulting in a poor user experience. Summary of the invention

[0003] In view of the above problems, the present application proposes a scene control method, device, electronic device and storage medium to solve the above problems.

[0004] In the first aspect, an embodiment of the present application provides a scene control method, the method comprising: if it is detected that the current scene meets the scene trigger condition of the specified scene, determining the scene arrangement information of the specified scene, wherein the scene arrangement information includes multiple scene services, scene cards, a triggering order between the multiple scene services and the scene cards, a card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services, the scene card being used to control the execution of part or all of the multiple scene services; according to the triggering order, displaying the scene card through the card output device, and executing the multiple scene services through the one or more execution devices.

[0005] In the second aspect, an embodiment of the present application provides a scene control device, comprising: a scene arrangement information determination module, for determining the scene arrangement information of the specified scene if it is detected that the current scene satisfies the scene trigger condition of the specified scene, wherein the scene arrangement information includes multiple scene services, scene cards, a triggering sequence between the multiple scene services and the scene cards, a card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services, the scene card being used to control the execution of some or all of the multiple scene services; a scene control module, for displaying the scene card through the card output device in accordance with the triggering sequence, and executing the multiple scene services through the one or more execution devices.

[0006] In a third aspect, an embodiment of the present application provides an electronic device, comprising a memory and a processor, wherein the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor executes the above method.

[0007] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a program code is stored, and the program code can be called by a processor to execute the above method.

[0008] The scene control method, device, electronic device and storage medium provided in the embodiments of the present application determine the scene arrangement information of the specified scene if it is detected that the current scene meets the scene trigger condition of the specified scene, wherein the scene arrangement information includes multiple scene services, scene cards, the triggering order between the multiple scene services and the scene cards, the card output device corresponding to the scene card and one or more execution devices corresponding to the multiple scene services, the scene card is used to control the execution of part or all of the multiple scene services, and the scene card is displayed through the card output device according to the triggering order, and the multiple scene services are executed through one or more execution devices, and then the scene card is added to the scene linkage to trigger the execution of part or all of the multiple scene services, thereby improving the intuitiveness and operability of the scene control and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0010] Figure 1 A schematic diagram of a flow chart of a scene control method provided by an embodiment of the present application is shown;

[0011] Figure 2 A schematic diagram of a scene triggering stage provided in an embodiment of the present application is shown;

[0012] Figure 3 A schematic diagram of a flow chart of a scene control method provided by an embodiment of the present application is shown;

[0013] Figure 4 A schematic diagram of a scene card provided in an embodiment of the present application is shown;

[0014] Figure 5 A schematic diagram of a flow chart of a scene control method provided by an embodiment of the present application is shown;

[0015] Figure 6A schematic diagram of a flow chart of a scene control method provided by an embodiment of the present application is shown;

[0016] Figure 7 A schematic diagram of a flow chart of a scene control method provided by an embodiment of the present application is shown;

[0017] Figure 8 A schematic diagram of a flow chart of a scene control method provided by an embodiment of the present application is shown;

[0018] Fig. 9 A schematic diagram of an interface in which a scene provided in an embodiment of the present application is arranged as a scene of taking a nap in a car is shown;

[0019] Fig.10 A schematic diagram of the scene arrangement stage provided by an embodiment of the present application is shown;

[0020] Fig.11 A module block diagram of a scene control device provided by an embodiment of the present application is shown;

[0021] Fig.12 A block diagram of an electronic device according to an embodiment of the present application for executing a scene control method according to an embodiment of the present application is shown;

[0022] Fig.13 A storage unit for storing or carrying program codes for implementing the scene control method according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0023] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

[0024] The popularity of electronic devices has changed the public's lifestyle to a certain extent. Smart scenes can be provided to users through a single electronic device or the linkage of multiple electronic devices. Taking the linkage of multiple electronic devices as an example, when users use the linkage services of multiple electronic devices in a specified scene, they often need to manually set up and operate multiple electronic devices, which brings great inconvenience. Users are eager to obtain seamless service experience on different electronic devices (such as mobile phones, tablets, and car computers) and realize cross-platform integration of information and functions.

[0025] In the design of cross-end collaborative systems (i.e., linkage scenarios of multiple electronic devices), the collaborative scenario triggering form is an important link in realizing the collaboration of multiple electronic devices. The collaborative scenario triggering is usually an automatic trigger based on a specific scenario. This triggering mechanism provides an automated user experience, but it also has the following problems:

[0026] First, the transparency issue: The scene is automatically triggered without user intervention, and the user cannot know in time which services of the electronic device are triggered by the current scene. The whole process lacks transparency;

[0027] Second, the problem of situational interference: automatic triggering of scenarios does not always match the current situation. Due to the lack of complete perception of the situation, inappropriate automatic triggering will affect the normal activities of users in specific scenarios. For example, in the scenario of taking a nap in the car, assuming that the trigger condition is getting in the car between 12:00 and 13:00 on weekdays, the air conditioner will be turned on, the seat will be adjusted, and the smartphone will be turned on for Do Not Disturb. However, if there is an emergency, the user needs to drive to a certain place at noon on a certain weekday. These services triggered after getting in the car will cause serious interference to the user.

[0028] Third, the issue of scenario flexibility: If in some scenarios, users want to execute part of the services of the scenario instead of all the services, then a new scenario needs to be re-arranged.

[0029] Fourth, potential safety hazards: In the automatic trigger mechanism of cross-terminal collaboration between smartphones and car equipment, if special circumstances such as driving scenarios are not fully considered, and there is a lack of reasonable design and restrictions on the triggering timing and content, it is very likely to bring serious safety hazards to drivers and threaten personal safety and road traffic safety.

[0030] In view of the above problems, the inventor has discovered after long-term research and proposed the scene control method, device, electronic device and storage medium provided in the embodiments of the present application, which increases the intuitiveness and operability of scene control and improves the user experience by adding scene cards in scene linkage to trigger the execution of some or all of the multiple scene services. The specific scene control method is described in detail in the subsequent embodiments.

[0031] Among them, cards, as an emerging information presentation and interaction carrier in the field of electronic device interaction, have many significant advantages in single-end or cross-end scene triggering. From the perspective of information presentation, actively pushing scene-related cards at the right time can enable users to clearly understand the available scenes and services, and enhance the intuitiveness and operability of scene control; in terms of interactivity, cards provide a convenient operation entrance, users can operate directly on the card, and the execution of the scene is controlled by the user with one click, without going deep into multi-level menus. In addition, the card has good adaptability and customizability, and it can be adaptively adjusted to ensure that a high-quality user experience can be provided on various electronic devices. For example, the cards on smartphones may focus more on the concise display and quick operation of information, while the cards on car equipment can present key information in a larger icon and more eye-catching display according to the principle of driving safety.

[0032] The embodiments of the present application give full play to the advantages of cards, focus on collaborative scenarios triggered by single-device or cross-device cards, use the card issuance mechanism to improve the efficiency of scene collaboration and user experience, enhance the interactivity and intelligence of scene control, improve the shortcomings of current scene triggering modes in single-end and cross-end systems, and realize accurate and intelligent scene triggering.

[0033] See also Figure 1 , Figure 1 The flowchart of the scene control method provided by an embodiment of the present application is shown. The method is used to increase the scene card in the scene linkage to trigger the execution of some or all of the services in multiple scene services, thereby improving the intuitiveness and operability of scene control and improving the user experience. In a specific embodiment, the scene control method is applied to Fig.11 The scene control device 200 and the electronic device 100 ( Fig.12 ). The following will take an electronic device as an example to illustrate the specific process of this embodiment. Of course, it can be understood that the electronic device used in this embodiment may include a smart phone, a tablet computer, a car device, a wearable device, etc., which is not limited here. Figure 1 The process shown is described in detail, and the scene control method may specifically include the following steps:

[0034] Step S110: If it is detected that the current scene meets the scene trigger condition of the specified scene, the scene arrangement information of the specified scene is determined, wherein the scene arrangement information includes multiple scene services, scene cards, a triggering sequence between the multiple scene services and the scene cards, a card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services, and the scene card is used to control the execution of some or all of the multiple scene services.

[0035] Among them, different designated scenarios involve different numbers of electronic devices. For example, some designated scenarios may only involve the linkage of multiple scenario services in a single electronic device. In this case, smart scenes can be provided to users through only one electronic device; while some designated scenarios may involve the linkage of multiple scenario services in multiple electronic devices. In this case, smart scenes need to be provided to users through the linkage of multiple electronic devices.

[0036] As an example, when the specified scenario only involves the linkage of multiple scenario services in a single electronic device, the multiple scenario services can be provided by the vehicle device, for example, providing scenario services for turning on the air conditioner in the car and adjusting the seat in the car; the multiple scenario services can also be provided by a smart phone, for example, providing scenario services for turning on mobile phone music and turning on mobile phone do not disturb, etc. When the specified scenario involves the linkage of multiple scenario services in multiple electronic devices, the multiple scenario services can be completed by the smart phone and the vehicle device at the same time, for example, the vehicle device provides the scenario services for turning on the air conditioner in the car and adjusting the seat in the car, while the smart phone provides the scenario service for turning on mobile phone do not disturb.

[0037] Of course, electronic devices that can provide scene services may also include many other devices, such as smart TVs, smart air conditioners, smart curtains, tablet computers, etc., which are not limited here.

[0038] Optionally, the designated scene may include a nap scene in the car, a leaving home scene, a returning home scene, a leisure scene indoors, and the like. Taking the designated scene as a nap scene in the car as an example, the multiple scene services included in the nap scene in the car may include: turning on the air conditioner of the vehicle, adjusting the seat of the vehicle, turning on do not disturb on the mobile phone, and other operations. At this time, the electronic devices involved in the designated scene include vehicle equipment and smart phones. This scene involves the linkage of multiple scene services in multiple electronic devices, which is a cross-end scene. Taking the designated scene as a leisure scene indoors as an example, the multiple scene services included in the leisure scene indoors may include: playing light music on the mobile phone, turning on do not disturb on the mobile phone, and other operations. At this time, the electronic devices involved in the designated scene only include smart phones. This scene involves the linkage of multiple scene services of a single electronic device, which is a single-end scene.

[0039] In this embodiment, the specified scene can be obtained through scene arrangement. For example, the specified scene can be arranged by the electronic device when it is set up at the factory, or it can be arranged by the electronic device during use. Accordingly, the specified scene can correspond to scene arrangement information, wherein the scene arrangement information may include the scene triggering condition of the specified scene, multiple scene services included in the specified scene, scene cards included in the specified scene, the triggering sequence between multiple scene services and scene cards, the card issuing device corresponding to the scene card, and one or more execution devices corresponding to multiple scene services.

[0040] As an example, take the specified scene as a nap in the car:

[0041] The scene arrangement information of the nap scene in the car may include a scene triggering condition of: getting on the car between 12:00 and 13:00 on weekdays.

[0042] The scene arrangement information of the nap scene in the car may include multiple scene services such as turning on the air conditioner of the vehicle, adjusting the seat of the vehicle, and turning on the do not disturb function on the mobile phone.

[0043] The scene arrangement information of the nap scene in the car includes a scene card which can be: a carrier for information presentation and interaction, and can be used to control the execution of some or all of the services in multiple scene services.

[0044] The triggering order between the multiple scene services and scene cards included in the scene arrangement information of the nap scene in the car may include: the triggering order of the multiple scene services are all located after the scene card, at this time, the execution of all the scene services is controlled by the scene card, and the number of scene cards is one; or, the triggering order of the scene card is located after some of the multiple scene services and before another part of the scene services. At this time, the execution of some of the scene services is controlled by the scene card, and the number of scene cards is one or more, wherein, when the number of scene cards is multiple, different scene cards among the multiple scene cards can be used to control the execution of different scene services among the multiple scene services.

[0045] The scene arrangement information of the nap scene in the car includes a scene card corresponding to a card issuing device which can be: a device for displaying the scene card and for receiving a user's touch operation on the scene card. The number of the card issuing devices can be one or more. When the number of the card issuing devices is one, the scene card can be displayed in the one card issuing device and the user's touch operation on the scene card can be received in the one card issuing device; when the number of the card issuing devices is multiple, the scene cards can be displayed in the multiple card issuing devices respectively and the user's touch operation on the scene card can be received in any of the multiple card issuing devices. The card issuing device can include the above-mentioned smart phone, car machine device, tablet computer, wearable device, etc., which are not limited here.

[0046] The scene arrangement information of the nap scene in the car includes one or more execution devices corresponding to the scene card, which can be: a device for executing the multiple scene services. Among them, when the specified scene is a single-end scene, it represents that multiple scene services are completed by a single electronic device. At this time, the number of determined execution devices is one. As an example, assuming that multiple scene services include turning on the air conditioner of the vehicle and adjusting the seat of the vehicle, the execution devices of the multiple scene services determined are only the vehicle equipment; when the specified scene is a multi-end scene, it represents that multiple scene services are completed by multiple electronic devices. At this time, the number of determined execution devices is multiple. As an example, assuming that multiple scene services include turning on the air conditioner of the vehicle, adjusting the seat of the vehicle, and turning on the do not disturb function on the mobile phone, the execution devices of the multiple scene services determined include the vehicle equipment and the smart phone.

[0047] It is understandable that the card issuing device and the execution device can be the same device or different devices. As an example, assuming that the execution device of multiple scene services is only the vehicle device, in this case, the card issuing device can be the vehicle device, a smart phone or a tablet computer; assuming that the execution device of multiple scene services is the vehicle device and a smart phone, in this case, the card issuing device can be the vehicle device, a smart phone or a tablet computer.

[0048] In this embodiment, the current scene may be detected, and the detected current scene may be compared with the scene trigger condition of the specified scene to determine whether the detected current scene satisfies the scene trigger condition of the specified scene. If it is detected that the current scene satisfies the scene trigger condition of the specified scene, the scene arrangement information of the specified scene may be determined; if it is detected that the current scene does not satisfy the scene trigger condition of the specified scene, the scene arrangement information of the specified scene may not be determined.

[0049] In some embodiments, the scene trigger conditions of the specified scene may include: time conditions matching a preset time point, geo-fence detecting that a device enters or leaves a specific area, device connection status changes, the user performs a specified operation on a specified device, etc., which are not limited here.

[0050] As an example, assuming that the designated scene is a nap in the car scene, the scene triggering condition of the nap in the car scene is getting on the car between 12:00 and 13:00 on weekdays. Therefore, if it is detected that the user gets on the car between 12:00 and 13:00 on weekdays, it can be determined that the current scene meets the scene triggering conditions of the nap in the car scene, and the scene arrangement information of the nap in the car scene can be determined.

[0051] Among them, in the above example, the vehicle-mounted device can detect whether the user gets on the bus between 12:00 and 13:00 on weekdays, and the vehicle-mounted device can execute the scene control method of the embodiment of the present application. The smart phone can also detect whether the user gets on the bus between 12:00 and 13:00 on weekdays, and the smart phone can execute the scene control method of the embodiment of the present application. That is, the embodiment of the present application adopts a "decentralized" mode for scene collaboration of single-end scenes or multi-end scenes. Each device end has an independent and complete scene execution engine and a card engine (including a card container) adapted thereto. This decentralized architecture mode gives each device autonomy, so that any device has the ability to schedule services for other collaborative devices, which is precisely the core principle for realizing single-end or cross-end card triggering.

[0052] Step S120: displaying the scene card through the card output device and executing the multiple scene services through the one or more execution devices according to the triggering sequence.

[0053] In this embodiment, when the triggering order between multiple scene services and scene cards is determined, and the card output device corresponding to the scene card and one or more execution devices corresponding to the multiple scene services are determined, the scene card can be displayed through the card output device and the multiple scene services can be executed through one or more execution devices according to the triggering order.

[0054] In some embodiments, when determining the triggering order between multiple scene services and scene cards, and determining the card issuing device corresponding to the scene card and one or more execution devices corresponding to the multiple scene services, the scene control mode of the scene card over the multiple scene services can be determined based on the triggering order between the multiple scene services and the scene cards, wherein the scene control mode includes a full control mode or a partial control mode. Based on the scene control mode, the scene card is displayed through the card issuing device, and the multiple scene services are executed through one or more execution devices. Then, by arranging the triggering order of multiple scene services and scene cards, full control or partial control of the multiple scene services can be achieved through the scene card, thereby improving the intuitiveness and operability of the scene control and enhancing the user experience.

[0055] As an implementable approach, see Figure 2 , Figure 2 FIG. 2 shows a schematic diagram of the scene triggering stage provided by an embodiment of the present application. Figure 2As shown, the electronic device used to execute the scene control method of the embodiment of the present application can be built with a parser, a scheduler and a service gateway. Accordingly, the electronic device can obtain the scene description file of the specified scene (such as scene DSL, i.e., domain-specific language, which is a programming language optimized for a specific class of problems and contains higher-level abstractions. DSL uses concepts and rules from professions or fields), and parses the scene DSL through its built-in parser, parses it into a behavior tree model, and loads it into the running memory. When it is detected that the current scene meets the scene triggering conditions of the specified scene, such as the time condition matches the preset time point, the geo-fence detects that the device enters or leaves a specific area, the device connection state changes, and the user performs a specified operation on the specified device, an event code with a unique identifier can be generated and broadcast to the scheduler. The scheduler is responsible for data management and service scheduling. After monitoring the scene triggering event, the scheduling device performs related actions. The service gateway is a key bridge connecting the scheduler and the execution device of the service scene. It provides a call interface with rich functions and unified interface specifications, through which all service resources under the account domain can be called without obstacles. The service gateway routes the scheduling signal to the execution device of the service scenario, and then the execution device of the service scenario continues to schedule the downstream services of the scenario. In addition, when the scheduler detects that the next step of the model is triggered by a scene card, it can route the card-related information to the card-issuing device specified by the user. After the card-issuing device receives the signal and data, the intent engine generates a scene intent. After the intent goes through the service discovery and service decision links, the corresponding scene card service is called. The engine will dynamically implant the scene card information into the card template, and finally the end-side card container will render the scene card, so that the scene card can be displayed on the specified card-issuing device.

[0056] A scene control method provided by an embodiment of the present application determines scene arrangement information of the specified scene if it is detected that the current scene satisfies the scene trigger condition of the specified scene, wherein the scene arrangement information includes multiple scene services, scene cards, a triggering order between the multiple scene services and the scene cards, a card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services. The scene card is used to control the execution of part or all of the multiple scene services. According to the triggering order, the scene card is displayed through the card output device, and the multiple scene services are executed through one or more execution devices. Then, by adding scene cards in the scene linkage to trigger the execution of part or all of the multiple scene services, the intuitiveness and operability of the scene control are improved, and the user experience is improved.

[0057] See also Figure 3 , Figure 3 The following is a flow chart of a scene control method provided by an embodiment of the present application. Figure 3The process shown is described in detail, and the scene control method may specifically include the following steps:

[0058] Step S210: If it is detected that the current scene meets the scene trigger condition of the specified scene, the scene arrangement information of the specified scene is determined, wherein the scene arrangement information includes multiple scene services, scene cards, a triggering sequence between the multiple scene services and the scene cards, a card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services, and the scene card is used to control the execution of some or all of the multiple scene services.

[0059] For the detailed description of step S210, please refer to step S110, which will not be repeated here.

[0060] Step S220: If it is determined based on the triggering sequence that the multiple scene services are all after the scene card, the scene card is displayed through the card output device.

[0061] Optionally, the triggering sequence between multiple scene services and scene cards may include: multiple scene services are after the scene card. At this time, the scene card fully controls the multiple scene services, that is, after the scene event is triggered, the scene card is first displayed through the card output device, and only after the confirmation operation acting on the scene card is detected, the multiple scene services are executed in sequence through one or more execution devices.

[0062] In this embodiment, if it is determined that multiple scene services are behind the scene card based on the triggering sequence between multiple scene services and scene cards, the scene card can be displayed through the card issuing device. That is, if it is determined that multiple scene services are behind the scene card based on the triggering sequence between multiple scene services and scene cards, it can be considered that the scene card needs to be displayed first, and then the scene service is executed after the user confirms, so the scene card can be displayed first through the card issuing device.

[0063] Optionally, if the card issuing device corresponding to the programmed scene card is an electronic device used to execute the scene control method of the embodiment of the present application, the scene card can be directly displayed by the electronic device used to execute the scene control method of the embodiment of the present application; if the card issuing device corresponding to the programmed scene card is not an electronic device used to execute the scene control method of the embodiment of the present application, the card-related information of the scene card can be routed to the card issuing device through the electronic device used to execute the scene control method of the embodiment of the present application, and the scene card can be displayed by the card issuing device.

[0064] Optionally, if the card issuing device corresponding to the programmed scene card is a smart phone, the scene card can be displayed through the smart phone, and when the smart phone displays the scene card, the information of the scene card can be displayed concisely so that the user can operate quickly; if the card issuing device corresponding to the programmed scene card is a vehicle-mounted device, the scene card can be displayed through the vehicle-mounted device, and when the vehicle-mounted device displays the scene card, the information of the scene card can be presented in a larger icon and in a more eye-catching manner to ensure that the user can quickly obtain key information and ensure driving safety.

[0065] In some embodiments, when a scene card is displayed through a card output device, the displayed scene card may include the designated scene to which the scene card belongs, the scene service controlled by the scene card, and a selection control for selecting whether to execute the scene service controlled by the scene card.

[0066] See also Figure 4 , Figure 4 FIG. 1 shows a schematic diagram of a scene card provided in an embodiment of the present application. Figure 4 As shown, the scene card may include the designated scene to which the scene card belongs (taking a nap in the car), the scene service controlled by the scene card (air conditioning, seats, do not disturb), and a selection control for selecting whether to execute the scene service controlled by the scene card (execute immediately).

[0067] Step S230: If a confirmation operation acting on the scene card is detected, the plurality of scene services are executed by the one or more execution devices.

[0068] In this embodiment, in the process of displaying the scene card through the card output device, the operation acting on the scene card can be detected. If a confirmation operation acting on the scene card is detected, it can be considered that the user confirms to execute the multiple scene services controlled by the scene card, so the multiple scene services can be executed through one or more execution devices; if the confirmation operation acting on the scene card is not detected or a negative operation acting on the scene card is detected, it can be considered that the user confirms not to execute the multiple scene services controlled by the scene card, so the multiple scene services can be not executed through one or more execution devices.

[0069] In some embodiments, in the process of displaying scene cards through a card output device, operations acting on scene cards can be detected in real time; operations acting on scene cards can be detected at preset time intervals; operations acting on scene cards can be detected at preset time points; operations acting on scene cards can be detected according to other preset conditions, etc., which are not limited here.

[0070] In some embodiments, the confirmation operation on the scene card may include: if it is detected that the number of clicks of the click operation on the scene card reaches a number threshold, it can be determined that the confirmation operation on the scene card is detected; if it is detected that the pressing duration of the pressing operation on the scene card reaches a duration threshold, it can be determined that the confirmation operation on the scene card is detected; if it is detected that the pressing area of ​​the pressing operation on the scene card reaches an area threshold, it can be determined that the confirmation operation on the scene card is detected; if it is detected that the sliding trajectory of the sliding operation on the scene card satisfies the specified sliding trajectory, it can be determined that the confirmation operation on the scene card is detected, etc., which are not limited here.

[0071] In some embodiments, the scene card includes a selection control for selecting whether to execute the scene service controlled by the scene card, and the confirmation operation acting on the scene card may include: if a click operation acting on the selection control displayed in the scene card is detected, it is determined that a confirmation operation acting on the scene card is detected.

[0072] Optionally, if the execution device corresponding to the multiple scene services arranged is an electronic device used to execute the scene control method of the embodiment of the present application, the multiple scene services can be directly executed by the electronic device used to execute the scene control method of the embodiment of the present application; if the execution device corresponding to the multiple scene services arranged is not an electronic device used to execute the scene control method of the embodiment of the present application, the scheduling signal can be routed to the execution device through the electronic device used to execute the scene control method of the embodiment of the present application to instruct the execution device to execute the corresponding multiple scene services.

[0073] Optionally, if the execution device corresponding to the multiple scene services arranged is a vehicle-mounted device, the multiple scene services can be executed through the vehicle-mounted device. For example, if the multiple scene services include turning on the vehicle air conditioner and adjusting the vehicle seats, the vehicle air conditioner turning on and the vehicle seat adjusting can be executed through the vehicle-mounted device; if the execution devices corresponding to the multiple scene services arranged are a vehicle-mounted device and a smart phone, the multiple scene services can be executed respectively through the vehicle-mounted device and the smart phone. For example, if the multiple scene services include turning on the vehicle air conditioner, adjusting the vehicle seats and turning on the do not disturb mode on the mobile phone, the vehicle air conditioner turning on and the vehicle seat adjusting can be executed through the vehicle-mounted device, and turning on the do not disturb mode can be executed through the smart phone.

[0074] The scene control method provided by an embodiment of the present application determines the scene arrangement information of the specified scene if it is detected that the current scene meets the scene trigger condition of the specified scene, wherein the scene arrangement information includes multiple scene services, scene cards, the triggering order between the multiple scene services and the scene cards, the card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services. The scene card is used to control the execution of part or all of the multiple scene services. If it is determined based on the triggering order that the multiple scene services are after the scene card, the scene card is displayed through the card output device. If a confirmation operation acting on the scene card is detected, the multiple scene services are executed through one or more execution devices. Compared to Figure 1 The scene control method shown in this embodiment also realizes complete control of scene services by scene cards by setting the triggering order of scene services after scene cards, thereby ensuring the operability of scene control and improving the user experience.

[0075] See also Figure 5 , Figure 5 The following is a flow chart of a scene control method provided by an embodiment of the present application. Figure 5 The process shown is described in detail, and the scene control method may specifically include the following steps:

[0076] Step S310: If it is detected that the current scene meets the scene trigger condition of the specified scene, the scene arrangement information of the specified scene is determined, wherein the scene arrangement information includes multiple scene services, scene cards, a triggering sequence between the multiple scene services and the scene cards, a card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services, and the scene card is used to control the execution of some or all of the multiple scene services.

[0077] The specific description of step S310 can be found in step S110 , which will not be repeated here.

[0078] Step S320: If it is determined based on the triggering order that the multiple scene services include a first scene service before the scene card and a second scene service after the scene card, the first scene service is executed by the one or more execution devices.

[0079] Optionally, the triggering sequence between multiple scene services and scene cards may include: some scene services in the multiple scene services are before the scene card, and another part of the scene services are after the scene card. Specifically, the first scene service in the multiple scene services is before the scene card, and the second scene service in the multiple scene services is after the scene card. At this time, the scene card performs partial control over the multiple scene services, that is, after the scene event is triggered, some scene services are executed first and then the scene card appears, and the subsequent services are executed after the user confirms.

[0080] In this embodiment, if it is determined that the first scene service among the multiple scene services is before the scene card and the second scene service among the multiple scene services is after the scene card based on the triggering order between the multiple scene services and the scene card, the first scene service can be executed by one or more execution devices. That is, if it is determined that the first scene service before the scene card is included in the multiple scene services based on the triggering order between the multiple scene services and the scene card, it can be considered that the first scene service needs to be executed first, and the scene card needs to be displayed after the execution is completed. Therefore, the first scene service can be executed first by one or more execution devices.

[0081] Optionally, if the execution device corresponding to the scheduled first scene service is an electronic device used to execute the scene control method of the embodiment of the present application, the first scene service can be directly executed by the electronic device used to execute the scene control method of the embodiment of the present application; if the execution device corresponding to the scheduled first scene service is not an electronic device used to execute the scene control method of the embodiment of the present application, the scheduling signal can be routed to the execution device through the electronic device used to execute the scene control method of the embodiment of the present application to instruct the execution device to execute the corresponding first scene service.

[0082] Optionally, if the execution device corresponding to the arranged first scenario service is a vehicle-mounted device, the first scenario service can be executed through the vehicle-mounted device. For example, if the first scenario service includes turning on the vehicle air conditioner and adjusting the vehicle seats, the vehicle air conditioner turning on and the vehicle seat adjusting can be executed through the vehicle-mounted device; if the execution devices corresponding to the arranged first scenario service are a vehicle-mounted device and a smart phone, the first scenario service can be executed respectively through the vehicle-mounted device and the smart phone. For example, if the first scenario service includes turning on the vehicle air conditioner, adjusting the vehicle seat and turning on the do not disturb mode on the mobile phone, the vehicle air conditioner turning on and the vehicle seat adjusting can be executed through the vehicle-mounted device, and the do not disturb mode can be turned on through the smart phone.

[0083] Step S330: If the first scene service is executed, the scene card is displayed through the card output device.

[0084] In this embodiment, when the first scene service is executed by one or more execution devices, the execution status of the first scene service can be detected, and the execution status of the first scene service can include the first scene service execution completion or the first scene service incomplete execution (including execution failure and execution in progress). Among them, since the triggering sequence of the scene card is between the first scene service and the second scene service, if it is detected that the first scene service is executed, the scene card can be displayed through the card output device.

[0085] Optionally, if the card issuing device corresponding to the programmed scene card is an electronic device used to execute the scene control method of the embodiment of the present application, the scene card can be directly displayed by the electronic device used to execute the scene control method of the embodiment of the present application; if the card issuing device corresponding to the programmed scene card is not an electronic device used to execute the scene control method of the embodiment of the present application, the card-related information of the scene card can be routed to the card issuing device through the electronic device used to execute the scene control method of the embodiment of the present application, and the scene card can be displayed by the card issuing device.

[0086] Optionally, if the card issuing device corresponding to the programmed scene card is a smart phone, the scene card can be displayed through the smart phone, and when the smart phone displays the scene card, the information of the scene card can be displayed concisely so that the user can operate quickly; if the card issuing device corresponding to the programmed scene card is a vehicle-mounted device, the scene card can be displayed through the vehicle-mounted device, and when the vehicle-mounted device displays the scene card, the information of the scene card can be presented in a larger icon and in a more eye-catching manner to ensure that the user can quickly obtain key information and ensure driving safety.

[0087] In some embodiments, when a scene card is displayed through a card output device, the displayed scene card may include the designated scene to which the scene card belongs, the scene service controlled by the scene card, and a selection control for selecting whether to execute the scene service controlled by the scene card.

[0088] Step S340: If a confirmation operation acting on the scene card is detected, the second scene service is executed by the one or more execution devices.

[0089] In this embodiment, in the process of displaying the scene card through the card output device, the operation acting on the scene card can be detected. If a confirmation operation acting on the scene card is detected, it can be considered that the user confirms to execute the second scene service controlled by the scene card, so the second scene service can be executed through one or more execution devices; if the confirmation operation acting on the scene card is not detected or a negative operation acting on the scene card is detected, it can be considered that the user confirms not to execute the second scene service controlled by the scene card, so the second scene service can be not executed through one or more execution devices.

[0090] In some embodiments, in the process of displaying scene cards through a card output device, operations acting on scene cards can be detected in real time; operations acting on scene cards can be detected at preset time intervals; operations acting on scene cards can be detected at preset time points; operations acting on scene cards can be detected according to other preset conditions, etc., which are not limited here.

[0091] In some embodiments, the confirmation operation on the scene card may include: if it is detected that the number of clicks of the click operation on the scene card reaches a number threshold, it can be determined that the confirmation operation on the scene card is detected; if it is detected that the pressing duration of the pressing operation on the scene card reaches a duration threshold, it can be determined that the confirmation operation on the scene card is detected; if it is detected that the pressing area of ​​the pressing operation on the scene card reaches an area threshold, it can be determined that the confirmation operation on the scene card is detected; if it is detected that the sliding trajectory of the sliding operation on the scene card satisfies the specified sliding trajectory, it can be determined that the confirmation operation on the scene card is detected, etc., which are not limited here.

[0092] In some embodiments, the scene card includes a selection control for selecting whether to execute the scene service controlled by the scene card, and the confirmation operation acting on the scene card may include: if a click operation acting on the selection control displayed in the scene card is detected, it is determined that a confirmation operation acting on the scene card is detected.

[0093] Optionally, if the execution device corresponding to the arranged second scene service is an electronic device used to execute the scene control method of the embodiment of the present application, the second scene service can be directly executed by the electronic device used to execute the scene control method of the embodiment of the present application; if the execution device corresponding to the arranged second scene service is not an electronic device used to execute the scene control method of the embodiment of the present application, the scheduling signal can be routed to the execution device through the electronic device used to execute the scene control method of the embodiment of the present application to instruct the execution device to execute the corresponding second scene service.

[0094] Optionally, if the execution device corresponding to the arranged second scene service is a vehicle-mounted device, the second scene service can be executed through the vehicle-mounted device. For example, if the second scene service includes playing music in the vehicle, the vehicle-mounted music can be executed through the vehicle-mounted device; if the execution devices corresponding to the arranged second scene service are a vehicle-mounted device and a smart phone, the second scene service can be executed respectively through the vehicle-mounted device and the smart phone. For example, if multiple scene services include playing music in the vehicle and turning on the alarm on the mobile phone, the vehicle-mounted music can be turned on through the vehicle-mounted device, and the alarm can be turned on through the smart phone.

[0095] A scene control method provided by an embodiment of the present application determines the scene arrangement information of the specified scene if it is detected that the current scene satisfies the scene trigger condition of the specified scene, wherein the scene arrangement information includes multiple scene services, scene cards, the triggering order between the multiple scene services and the scene cards, the card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services. The scene card is used to control the execution of some or all of the multiple scene services. If it is determined based on the triggering order that the multiple scene services include a first scene service before the scene card and a second scene service after the scene card, the first scene service is executed by one or more execution devices. If the execution of the first scene service is completed, the scene card is displayed by the card output device. If a confirmation operation acting on the scene card is detected, the second scene service is executed by one or more execution devices. Compared to Figure 1 The scene control method shown in this embodiment also sets the triggering order of the scene card between multiple scene services to achieve local control of the scene service by the scene card, thereby ensuring the operability of the scene control and improving the user experience.

[0096] See also Figure 6 , Figure 6 The following is a flow chart of a scene control method provided by an embodiment of the present application. Figure 6 The process shown is described in detail, and the scene control method may specifically include the following steps:

[0097] Step S410: If it is detected that the current scene meets the scene trigger condition of the specified scene, the scene arrangement information of the specified scene is determined, wherein the scene arrangement information includes multiple scene services, scene cards, a triggering sequence between the multiple scene services and the scene cards, a card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services, and the scene card is used to control the execution of some or all of the multiple scene services.

[0098] For the detailed description of step S410, please refer to step S110, which will not be repeated here.

[0099] Step S420: Determine the card-related information corresponding to the scene card.

[0100] In this embodiment, the card-related information corresponding to the scene card can be determined. Optionally, the card-related information may include the specified scene corresponding to the scene card, the scene service controlled by the scene card, the card output device corresponding to the scene card, the triggering sequence corresponding to the scene card, etc., which are not limited here.

[0101] Step S430: Synchronize the card-related information to the card issuing device in accordance with the triggering sequence, so that the card-related information is filled into the card template by the card issuing device and displayed after rendering, and execute the multiple scene services by the one or more execution devices.

[0102] In this embodiment, when the card-related information corresponding to the scene card is determined, the card-related information can be synchronized to the card issuing device, so that the card-related information can be filled into the card template through the card issuing device and displayed after rendering. It can be understood that the scene card content finally displayed in this embodiment is dynamically generated by template filling during the scene triggering stage, rather than a pre-designed scene card. Therefore, it can be adaptively displayed for different devices. For example, when the card issuing device is a smart phone, it can focus on the concise display and quick operation of information, and when the card issuing device is a car device, it can present key information in a larger icon and more eye-catching display mode according to the principle of driving safety, thereby improving the display effect of the scene card.

[0103] In some implementations, when the next step is determined to be a scene card trigger according to the trigger sequence, the card-related information corresponding to the scene card can be determined, and the card-related information can be routed to the card-issuing device specified by the user. After the card-issuing device receives the signal and data, the intent engine generates a scene intent, and after the intent goes through the service discovery and service decision links, the corresponding scene card service is called. The engine will dynamically implant the scene card information into the card template, and finally the end-side card container will render the scene card, so as to display the scene card on the card-issuing device.

[0104] In some implementations, when displaying a scene card through a card output device, the scene card can support a click event. After the user clicks the scene card, the card engine can pass the card click event with the scene card's unique ID to the host application, which is the execution engine here. After receiving the event, the engine can actively report the scene card click event code, and the scheduler will continue to call the downstream service after listening to it, so as to realize the scene card triggering the execution of the collaborative scene service.

[0105] The scene control method provided by an embodiment of the present application determines the scene arrangement information of the specified scene if it is detected that the current scene meets the scene trigger condition of the specified scene, wherein the scene arrangement information includes multiple scene services, scene cards, the triggering order between the multiple scene services and the scene cards, the card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services. The scene card is used to control the execution of some or all of the multiple scene services, determine the card-related information corresponding to the scene card, synchronize the card-related information to the card output device in the triggering order, so that the card-related information is filled into the card template through the card output device and displayed after rendering, and execute multiple scene services through one or more execution devices. Compared to Figure 1 In the scene control method shown in the embodiment, the scene card content is dynamically generated by filling in the template during the scene triggering stage to ensure the versatility and adaptability of the display of the scene card.

[0106] See also Figure 7 , Figure 7 The following is a flow chart of a scene control method provided by an embodiment of the present application. Figure 7 The process shown is described in detail, and the scene control method may specifically include the following steps:

[0107] Step S510: If it is detected that the current scene meets the scene trigger condition of the specified scene, the scene arrangement information of the specified scene is determined, wherein the scene arrangement information includes multiple scene services, scene cards, a triggering sequence between the multiple scene services and the scene cards, a card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services, and the scene card is used to control the execution of some or all of the multiple scene services.

[0108] Step S520: displaying the scene card through the card output device and executing the multiple scene services through the one or more execution devices according to the triggering sequence.

[0109] For the detailed description of step S510 to step S520, please refer to step S110 to step S120, which will not be repeated here.

[0110] Step S530: If the scene card meets the exit display condition, the scene card is canceled from being displayed on the card output device.

[0111] Among them, during the operation of the collaborative scene, since the triggering of the scene has specific timeliness requirements, the scene card closely related to it should also be equipped with a complete and efficient exit mechanism, and the life cycle of the scene card corresponds to the life cycle of the scene intention. When the scene intention exits, it is passed through layers and finally reaches the card rendering engine, causing the corresponding scene card to be cancelled, that is, the display is canceled.

[0112] In this embodiment, an exit display condition may be pre-set and stored, and the exit display condition is used as a basis for judging whether the scene card is exited. Therefore, in this embodiment, during the process of displaying the scene card through the card output device, it may be judged whether the scene card satisfies the exit display condition. If it is determined that the scene card satisfies the exit display condition, the scene card may be cancelled on the card output device; if it is determined that the scene card does not satisfy the exit display condition, the scene card may be kept displayed on the card output device.

[0113] In some embodiments, if it is determined that the scene card meets the exit display conditions, the scene card can be directly canceled on the card issuing device; or, if it is determined that the scene card meets the exit display conditions, the scene card can be canceled after the card issuing device outputs a prompt message to prompt the user that the scene card has been canceled. Optionally, the prompt message may include voice prompt information, vibration prompt information, etc., which is not limited here.

[0114] As an implementable method, the display time of the scene card on the card issuing device can be determined. If the display time exceeds the time threshold, the scene card can be canceled on the card issuing device. That is, a timeout exit mechanism can be set. A default time threshold (such as 1200 seconds) is set inside the intent engine. In addition, during the scene arrangement stage, users can accurately set the time threshold for specific scenes within a reasonable time range allowed by the system (such as between 300 seconds and 3600 seconds) based on the characteristics of the specific scene and their own usage habits. When the intent engine generates an intent, a timer can be configured for the intent. When the timer time exceeds the time threshold, the intent engine generates a scene exit intent.

[0115] Among them, when the scene card is initially displayed through the card issuing device, the display duration of the scene card can be counted, and the counted display duration can be compared with the duration threshold to determine whether the display duration exceeds the duration threshold. If the counted display duration exceeds the duration threshold, it can be determined that the scene card has triggered the timeout exit mechanism, and the scene card can be canceled on the card issuing device; if the counted display duration does not exceed the duration threshold, it can be determined that the scene card has not triggered the timeout exit mechanism, and the scene card can be kept displayed on the card issuing device, and the display duration of the scene card can continue to be counted until the counted display duration exceeds the duration threshold, and the scene card is canceled on the card issuing device.

[0116] In the process of counting the display time of the scene card, if a confirmation operation on the scene card is detected, the scene service controlled by the scene card can be executed by one or more execution devices, the display time of the scene card can be stopped, and the scene card can be canceled on the card output device.

[0117] As an implementable method, if it is detected that the current scene changes from satisfying the scene trigger conditions to not satisfying the scene trigger conditions, the scene card will be cancelled on the card issuing device. That is, an exit mechanism can be set when the conditions are not met. Within the time range of the scene operation, the system can continuously monitor the scene exit conditions. When the input device is disconnected (such as Bluetooth connection interruption, WiFi connection loss, etc.), leaves the geographic fence (geo-fence accuracy can reach 10 meters), etc., the intention engine's intention reasoning is quickly triggered. After a series of logical judgments, the exit intention is generated in time to ensure that the scene can be exited in time when the conditions are no longer met.

[0118] Wherein, when the scene card is displayed by the card issuing device, the current scene can continue to be monitored, and the monitored current scene can be compared with the scene trigger condition of the specified scene to determine whether the current scene continues to meet the scene trigger condition of the specified scene. Wherein, if the comparison result indicates that during the process of displaying the scene card by the card issuing device, the current scene changes from the scene trigger condition that meets the specified scene to the scene trigger condition that does not meet the specified scene, then it can be determined that the scene card has triggered the condition that does not meet the exit mechanism, and the scene card can be canceled from the card issuing device; if the comparison result indicates that during the process of displaying the scene card by the storage card device, the current scene always keeps meeting the scene trigger condition of the specified slave scene, then the current scene can continue to be monitored until it is detected that the current scene changes from the scene trigger condition that meets the specified scene to the scene trigger condition that does not meet the specified scene, and then the scene card is canceled from the card issuing device.

[0119] In the process of monitoring the current scene, if a confirmation operation acting on the scene card is detected, the scene service controlled by the scene card can be executed by one or more execution devices, the monitoring of the current scene can be stopped, and the scene card can be canceled on the card output device.

[0120] As an implementable method, the number of times a scene card is touched during display in a card output device can be determined. If the number of touches reaches a threshold, the scene card is canceled on the card output device. That is, an exit mechanism can be set when the upper limit of the trigger times is exceeded. The system sets an upper limit of the scene trigger times for each scene card. This parameter can also be configured in the scene arrangement interface (e.g., a range of 1 to 10 times). When the number of times a user triggers a scene card reaches this preset upper limit, the scene exit intention is triggered.

[0121] In the process of displaying the scene card through the card issuing device, the number of times the scene card is touched can be counted, and the counted number of times touched can be compared with the number threshold to determine whether the number of times touched reaches the number threshold. If the counted number of times touched reaches the number threshold, it can be determined that the scene card has triggered the exit mechanism for exceeding the upper limit of the triggering number, and the scene card can be canceled on the card issuing device; if the counted number of times touched does not reach the number threshold, it can be determined that the scene card has not triggered the exit mechanism for exceeding the upper limit of the triggering number, and the scene card can be kept displayed on the card issuing device, and the number of times the scene card is touched can continue to be counted until the counted number of times touched reaches the number threshold, and the scene card is canceled on the card issuing device.

[0122] In the process of counting the number of times a scene card is touched, if a confirmation operation acting on the scene card is detected, the scene service controlled by the scene card can be executed by one or more execution devices, the counting of the number of times the scene card is touched can be stopped, and the scene card can be canceled from being displayed on the card output device.

[0123] The scene control method provided by an embodiment of the present application determines the scene arrangement information of the specified scene if it is detected that the current scene meets the scene triggering condition of the specified scene, wherein the scene arrangement information includes multiple scene services, scene cards, the triggering order between the multiple scene services and the scene cards, the card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services. The scene card is used to control the execution of part or all of the multiple scene services. According to the triggering order, the scene card is displayed through the card output device, and the multiple scene services are executed through one or more execution devices. If the scene card meets the exit display condition, the scene card is canceled on the card output device. Compared with Figure 1 The scene control method shown in the figure, this embodiment also provides a complete scene card exit mechanism to ensure the rationality and display effect of the scene card display.

[0124] See also Figure 8 , Figure 8 The following is a flow chart of a scene control method provided by an embodiment of the present application. Figure 8 The process shown is described in detail, and the scene control method may specifically include the following steps:

[0125] Step S610: In response to a scene arrangement event for the designated scene, a scene arrangement interface is displayed.

[0126] Among them, the embodiments of the present application can support users to arrange scenes. Optionally, it can support users to arrange scenes through smart phones, support users to arrange scenes through tablet computers, support users to arrange scenes through car equipment, etc., which are not limited here. That is, users can use the unified scene arrangement interface on multiple different devices to operate, and specify the collaborative working mode of each device in different scenes according to their own needs.

[0127] In this embodiment, the user may trigger a scene arrangement event for a specified scene, and accordingly, the electronic device may display a scene arrangement interface in response to the scene arrangement event for the specified scene.

[0128] In some embodiments, a scene arrangement event for a specified scene can be triggered by a touch operation on a scene arrangement icon; a scene arrangement event for a specified scene can be triggered by voice; a scene arrangement event for a specified scene can be triggered by a specific touch method on an electronic device, etc., which are not limited here.

[0129] In some implementations, the scene arrangement interface may be displayed in full screen, in partial screen, in a floating window, etc., which is not limited here.

[0130] Step S620: In response to a scene arrangement operation performed on the scene arrangement interface, the scene arrangement information is obtained, and the designated scene is obtained based on the scene arrangement information.

[0131] In this embodiment, during the process of displaying the scene arrangement interface, the operation acting on the scene arrangement interface can be detected. If the scene arrangement operation acting on the scene arrangement interface is detected, the scene arrangement information generated based on the scene arrangement operation can be obtained in response to the scene arrangement operation acting on the scene arrangement interface, and the specified scene can be obtained based on the scene arrangement information.

[0132] In some embodiments, during the process of displaying the scene arrangement interface, operations acting on the scene arrangement interface can be detected in real time, operations acting on the scene arrangement interface can be detected at preset time intervals, operations acting on the scene arrangement interface can be detected at preset time points, operations on the scene arrangement interface can also be detected according to other preset conditions, etc., which are not limited here.

[0133] As an implementable method, the scene arrangement interface may include an event resource pool and a service resource pool. Based on this, in response to a selection operation on the event resource pool, the scene triggering condition of the specified scene can be determined from the event resource pool, in response to a selection operation on the service resource pool, multiple scene services can be determined from the service resource pool, and one or more execution devices corresponding to the multiple scene services can be determined, in response to a card configuration operation on the scene arrangement interface, the scene card, the triggering sequence between the scene card and the multiple scene services, and the card output device corresponding to the scene card can be determined, based on the scene triggering condition, multiple scene services, scene cards, the triggering sequence between the multiple scene services and the scene card, the card output device corresponding to the scene card, and the one or more execution devices corresponding to the multiple scene services, the scene arrangement information can be obtained, and the specified scene can be obtained based on the scene arrangement information.

[0134] See also Fig. 9 , Fig. 9 The following is a schematic diagram showing an interface in which the scene arrangement provided by the embodiment of the present application is a scene of taking a nap in a car. Fig. 9 As shown, on this interface, you can arrange the scene trigger conditions, arrange the card output device and exit conditions of the scene card, arrange the scene services, arrange the trigger sequence between scene cards and scene services, etc., so as to complete the arrangement of the nap scene in the car.

[0135] Step S630: Generate a scene description file for the specified scene based on the scene arrangement information.

[0136] In this embodiment, when the scenario arrangement information is obtained, a scenario description file of the specified scenario can be generated based on the scenario arrangement information, wherein the scenario description file can elaborate on the capability call logic relationship of the specified scenario, including the service execution order, service device mapping relationship, etc. Optionally, the scenario description file can be a scenario DSL.

[0137] In some implementations, when the scene choreography information is obtained and the user confirms the scene choreography information, the UI data can be returned to the client-side choreography engine, and the DSL generator can generate a scene DSL, i.e., a scene description file, based on the scene choreography information returned by the UI control.

[0138] Step S640: Upload the scene description file and the target account to the cloud to instruct the cloud to synchronize the scene description file to multiple user devices that log in to the target account.

[0139] In this embodiment, when the scenario description file is obtained, the scenario description file and the target account can be uploaded to the cloud to instruct the cloud to synchronize the scenario description file to multiple user devices that log in to the target account. The multiple user devices include the card issuing device and the execution device.

[0140] Optionally, the target account may be used to uniquely identify the user. For example, the target account may be the user's phone number, the user's ID number, etc., which is not limited here.

[0141] In some embodiments, when a scene description file is obtained, the target account logged in by the electronic device performing scene arrangement can be obtained, and the scene description file and the target account can be uploaded to the cloud together. The cloud acts as a hub for scene synchronization and synchronizes the scene description file to each user device through the account domain (target account). Specifically, the user can use the target account to log in to the arrangement engine on different user devices, and then each user device can register device information with the cloud. The cloud can synchronize the scene description file to each user device logged in under the same account to ensure that the scene arrangement content of each user device is consistent.

[0142] In some embodiments, when the scene description file is obtained, the scene description file can be verified. If the verification passes, the scene description file and the target account are uploaded to the cloud to instruct the cloud to synchronize the scene description file to multiple user devices that log in to the target account.

[0143] As an implementable method, when a scene description file is obtained, the scene description file can be verified by pre-set rules. For example, for the scene description file, the scene card therein can be checked to see whether the card issuing device matches the calling service, whether the parameters are legal, etc. If the verification is passed, the scene description file and the target account are uploaded to the cloud to instruct the cloud to synchronize the scene description file to multiple user devices that log in to the target account; if the verification fails, the verification fails, and the feedback is fed back to the scene arrangement interface for modification by the user. Optionally, whether the parameter is legal can include: whether the type of the set value and the range of the value are legal.

[0144] Among them, see Fig.10 , Fig.10 FIG. 1 shows a schematic diagram of the scene arrangement stage provided by an embodiment of the present application. Fig.10As shown, the system of the electronic device can pre-integrate the trigger events and service events supported by each device to form an event resource pool and a service resource pool. As an example, the event resource pool includes trigger events based on device connection, trigger events based on time, trigger events based on geographic fences, and trigger events based on user operations; the service resource pool includes mobile phone services, car services, tablet services, and other services. Then, in the scene arrangement stage, it can be presented to the user in a visual form on the scene arrangement interface, and then the user can use the scene arrangement interface to perform scene arrangement operations and specify the collaborative working mode of each device in different scenes according to their own needs. In addition, the key configurations of the scene card, such as the card output device, the card exit conditions, etc., are also specified on the arrangement interface. By controlling the triggering order of the scene card UI module and the scene service UI module, the scene card can achieve complete or partial control of the scene trigger.

[0145] After the user confirms the content of the orchestration scene, the UI data can be sent back to the end-side orchestration engine. The DSL generator generates DSL based on the scene information sent back by the UI control. The DSL here is a defined scene description file that details the logical relationship of the scene's capability call, including the service execution order, service device mapping relationship, etc. Among them, the scene card can have a unique ID, which is to bind the user and the scene one-to-one. The logical order of the orchestration corresponds to the actual DSL content. Local control and full control are essentially achieved through the location of the scene card generated in the DSL.

[0146] After the DSL is generated, it can be verified by pre-set rules. For scene cards, check whether the card-issuing device matches the calling service, whether the parameters are legal, etc. If the verification fails, it will be fed back to the orchestration interface for modification by the user. If the verification passes, the scene DSL will be uploaded to the cloud scene warehouse, and the scene warehouse will manage the scene DSL under the same account in a unified manner. Users use the same account to log in to the orchestration engine on different devices. Each device will register device information with the cloud side, and the cloud will synchronize the scene DSL to each user device under the same account domain to ensure that the scene orchestration content of each user device is consistent.

[0147] Step S650: If it is detected that the current scene meets the scene trigger condition of the specified scene, the scene arrangement information of the specified scene is determined, wherein the scene arrangement information includes multiple scene services, scene cards, a triggering sequence between the multiple scene services and the scene cards, a card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services, and the scene card is used to control the execution of some or all of the multiple scene services.

[0148] Step S660: Displaying the scene card through the card output device and executing the multiple scene services through the one or more execution devices according to the triggering sequence.

[0149] For the detailed description of step S650 to step S660, please refer to step S110 to step S120, which will not be repeated here.

[0150] The scene control method provided in an embodiment of the present application displays a scene arrangement interface in response to a scene arrangement event for a specified scene, obtains scene arrangement information in response to a scene arrangement operation acting on the scene arrangement interface, obtains a specified scene based on the scene arrangement information, generates a scene description file for the specified scene based on the scene arrangement information, uploads the scene description file and the target account to the cloud, and instructs the cloud to synchronize the scene description file to multiple user devices that log in to the target account. If it is detected that the current scene meets the scene trigger condition of the specified scene, the scene arrangement information of the specified scene is determined, wherein the scene arrangement information includes multiple scene services, scene cards, a triggering sequence between multiple scene services and scene cards, a card issuing device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services. The scene card is used to control the execution of some or all of the multiple scene services. According to the triggering sequence, the scene card is displayed through the card issuing device, and the multiple scene services are executed through one or more execution devices. Compared to Figure 1 The scene control method shown in this embodiment also supports the arrangement of scenes on the device side to improve the user's verification experience, and also supports uploading the arranged scenes to the cloud, using the account mechanism to achieve cross-end scene synchronization, and ensure smooth interaction of cross-end scenes.

[0151] See also Fig.11 , Fig.11 The module block diagram of the scene control device provided by an embodiment of the present application is shown below. Fig.11 The scene control device 200 includes a scene arrangement information determination module 210 and a scene control module 220, wherein:

[0152] The scene arrangement information determination module 210 is used to determine the scene arrangement information of the specified scene if it is detected that the current scene meets the scene trigger condition of the specified scene, wherein the scene arrangement information includes multiple scene services, scene cards, the triggering sequence between the multiple scene services and the scene cards, the card output devices corresponding to the scene cards, and one or more execution devices corresponding to the multiple scene services, and the scene card is used to control the execution of some or all of the multiple scene services.

[0153] The scene control module 220 is used to display the scene card through the card output device according to the trigger sequence, and execute the multiple scene services through the one or more execution devices.

[0154] Furthermore, the scene control module 220 includes: a first scene card display submodule and a first scene service execution submodule, wherein:

[0155] The first scene card display submodule is used to display the scene card through the card output device if it is determined based on the triggering sequence that the multiple scene services are all after the scene card.

[0156] The first scene service execution submodule is configured to execute the plurality of scene services through the one or more execution devices if a confirmation operation acting on the scene card is detected.

[0157] Furthermore, the scene control module 220 includes: a second scene service execution submodule, a second scene card display submodule and a third scene service execution submodule, wherein:

[0158] The second scene service execution submodule is used to execute the first scene service through the one or more execution devices if it is determined based on the triggering order that the multiple scene services include a first scene service before the scene card and a second scene service after the scene card.

[0159] The second scene card display submodule is used to display the scene card through the card output device if the first scene service is executed.

[0160] The third scene service execution submodule is configured to execute the second scene service through the one or more execution devices if a confirmation operation acting on the scene card is detected.

[0161] Furthermore, the scene control module 220 includes: a card-related information determination submodule and a card-related information synchronization submodule, wherein:

[0162] The card-related information determination submodule is used to determine the card-related information corresponding to the scene card.

[0163] Furthermore, the card-related information determination submodule includes: a scene service determination unit and a card-related information determination unit, wherein:

[0164] The scene service determination unit is used to determine the scene service controlled by the scene card to be executed among the multiple scene services.

[0165] The card-related information determining unit is used to determine the card-related information corresponding to the scene card based on the scene service whose execution is controlled by the scene card.

[0166] The card-related information synchronization submodule is used to synchronize the card-related information to the card issuing device, so that the card-related information is filled into the card template through the card issuing device and displayed after rendering.

[0167] Furthermore, the scene control device 200 further includes: a scene card cancellation display module, wherein:

[0168] The scene card display cancellation module is used to cancel the display of the scene card on the card output device if the scene card meets the exit display condition.

[0169] Furthermore, the scene card display cancellation module includes: a display duration determination submodule and a first scene card display cancellation submodule, wherein:

[0170] The display duration determination submodule is used to determine the display duration of the scene card on the card output device.

[0171] The first scene card display cancellation submodule is used to cancel the display of the scene card on the card output device if the display duration exceeds a duration threshold.

[0172] Furthermore, the scene card display cancellation module includes: a second scene card display cancellation submodule, wherein:

[0173] The second scene card display cancellation submodule is used to cancel the display of the scene card on the card output device if it is detected that the current scene changes from satisfying the scene trigger condition to not satisfying the scene trigger condition.

[0174] Furthermore, the scene card display cancellation module includes: a touch count determination submodule and a third scene card display cancellation submodule, wherein:

[0175] The touch count determination submodule is used to determine the touch count of the scene card during the process of displaying the scene card in the card output device.

[0176] The third scene card display cancellation submodule is used to cancel the display of the scene card on the card output device if the number of touch times reaches a threshold.

[0177] Furthermore, the scene control device 200 further includes: a scene arrangement interface display module and a specified scene acquisition module, wherein:

[0178] The scene arrangement interface display module is used to display the scene arrangement interface in response to the scene arrangement event for the specified scene.

[0179] The designated scene obtaining module is used to respond to the scene arrangement operation acting on the scene arrangement interface, obtain the scene arrangement information, and obtain the designated scene based on the scene arrangement information.

[0180] Furthermore, the scene arrangement interface includes an event resource pool and a service resource pool, and the specified scene acquisition module includes: a scene trigger condition determination submodule, a scene service determination submodule, a scene card determination submodule and a specified scene acquisition submodule, wherein:

[0181] The scene trigger condition determination submodule is used to respond to the selection operation acting on the event resource pool and determine the scene trigger condition of the specified scene from the event resource pool.

[0182] The scene service determination submodule is used to respond to the selection operation acting on the service resource pool, determine the multiple scene services from the service resource pool, and determine one or more execution devices corresponding to the multiple scene services.

[0183] The scene card determination submodule is used to respond to the card configuration operation acting on the scene arrangement interface, determine the scene card, the triggering sequence between the scene card and the multiple service scenes, and the card output device corresponding to the scene card.

[0184] The designated scene acquisition submodule is used to obtain the scene arrangement information based on the scene triggering conditions, the multiple scene services, the scene cards, the triggering sequence between the multiple scene services and the scene cards, the card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services, and obtain the designated scene based on the scene arrangement information.

[0185] Furthermore, the scene control device 200 further comprises: a scene description file generation module and a mixed scene synchronization module, wherein:

[0186] A scene description file generation module is used to generate a scene description file of the specified scene based on the scene arrangement information.

[0187] The scene synchronization module is used to upload the scene description file and the target account to the cloud, so as to instruct the cloud to synchronize the scene description file to multiple user devices that log in to the target account.

[0188] Furthermore, the scene synchronization module includes: a verification submodule and a scene synchronization submodule, wherein:

[0189] The verification submodule is used to verify the scene description file.

[0190] The scene synchronization submodule is used to upload the scene description file and the target account to the cloud if the verification is passed, so as to instruct the cloud to synchronize the scene description file to multiple user devices that log in to the target account.

[0191] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0192] In several embodiments provided in the present application, the coupling between modules may be electrical, mechanical or other forms of coupling.

[0193] In addition, each functional module in each embodiment of the present application can be integrated into a processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or software functional modules.

[0194] See also Fig.12 , which shows a structural block diagram of an electronic device 100 provided in an embodiment of the present application. The electronic device 100 may be an electronic device capable of running applications, such as a smart phone, a tablet computer, an e-book, etc. The electronic device 100 in the present application may include one or more of the following components: a processor 110, a memory 120, and one or more applications, wherein the one or more applications may be stored in the memory 120 and configured to be executed by one or more processors 110, and the one or more programs are configured to execute the method described in the aforementioned method embodiment.

[0195] Among them, the processor 110 may include one or more processing cores. The processor 110 uses various interfaces and lines to connect various parts of the entire electronic device 100, and executes various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets or instruction sets stored in the memory 120, and calling data stored in the memory 120. Optionally, the processor 110 can be implemented in at least one hardware form of digital signal processing (Digital Signal Processing, DSP), field programmable gate array (Field-Programmable Gate Array, FPGA), and programmable logic array (Programmable Logic Array, PLA). The processor 110 can integrate one or a combination of a central processing unit (Central Processing Unit, CPU), a graphics processing unit (Graphics Processing Unit, GPU) and a modem. Among them, the CPU mainly processes the operating system, user interface and application programs; the GPU is responsible for rendering and drawing the content to be displayed; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 110, but may be implemented separately through a communication chip.

[0196] The memory 120 may include a random access memory (RAM) or a read-only memory (ROM). The memory 120 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store data (such as a phone book, audio and video data, chat record data) created by the electronic device 100 during use.

[0197] See also Fig.13 , which shows a structural block diagram of a computer-readable storage medium provided in an embodiment of the present application. The computer-readable medium 300 stores program codes, which can be called by a processor to execute the method described in the above method embodiment.

[0198] The computer readable storage medium 300 may be an electronic memory such as a flash memory, an EEPROM (electrically erasable programmable read-only memory), an EPROM, a hard disk, or a ROM. Optionally, the computer readable storage medium 300 includes a non-transitory computer-readable storage medium. The computer readable storage medium 300 has storage space for program code 310 that performs any method steps in the above method. These program codes can be read from or written to one or more computer program products. The program code 310 can be compressed, for example, in an appropriate form.

[0199] In summary, the scene control method, device, electronic device and storage medium provided in the embodiments of the present application determine the scene arrangement information of the specified scene if it is detected that the current scene meets the scene trigger condition of the specified scene, wherein the scene arrangement information includes multiple scene services, scene cards, the triggering order between the multiple scene services and the scene cards, the card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services. The scene card is used to control the execution of part or all of the multiple scene services. According to the triggering order, the scene card is displayed through the card output device, and the multiple scene services are executed through one or more execution devices. Then, by adding scene cards in the scene linkage to trigger the execution of part or all of the multiple scene services, the intuitiveness and operability of the scene control are improved, and the user experience is improved.

[0200] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A scene control method, characterized in that: The method comprises: If it is detected that the current scene meets the scene triggering condition of the specified scene, the scene arrangement information of the specified scene is determined, wherein the scene arrangement information includes multiple scene services, scene cards, the triggering sequence between the multiple scene services and the scene cards, the card output devices corresponding to the scene cards, and one or more execution devices corresponding to the multiple scene services, and the scene cards are used to control the execution of some or all of the multiple scene services; According to the triggering sequence, the scene card is displayed by the card output device, and the multiple scene services are executed by the one or more execution devices.

2. The method according to claim 1, characterized in that The displaying of the scene card by the card output device according to the triggering sequence, and the execution of the multiple scene services by the one or more execution devices include: If it is determined based on the triggering sequence that the multiple scene services are all after the scene card, displaying the scene card through the card output device; If a confirmation operation acting on the scene card is detected, the multiple scene services are executed by the one or more execution devices.

3. The method according to claim 1, characterized in that The displaying of the scene card by the card output device according to the triggering sequence, and the execution of the multiple scene services by the one or more execution devices include: If it is determined based on the triggering order that the plurality of scene services include a first scene service before the scene card and a second scene service after the scene card, executing the first scene service through the one or more execution devices; If the first scene service is executed, the scene card is displayed through the card issuing device; If a confirmation operation acting on the scene card is detected, the second scene service is executed by the one or more execution devices.

4. The method according to claim 1, characterized in that: The displaying of the scene card by the card output device includes: Determine the card-related information corresponding to the scene card; The card-related information is synchronized to the card-issuing device, so that the card-related information is filled into the card template through the card-issuing device and displayed after rendering.

5. The method according to any one of claims 1 to 4, characterized in that: After the scene card is displayed by the card output device, the method further includes: If the scene card meets the exit display condition, the scene card is canceled from display on the card output device.

6. The method according to claim 5, characterized in that If the scene card satisfies the exit display condition, canceling the display of the scene card on the card output device includes: Determine the display time of the scene card on the card output device; If the display duration exceeds the duration threshold, the scene card is canceled from display on the card output device.

7. The method according to claim 5, characterized in that If the scene card satisfies the exit display condition, canceling the display of the scene card on the card output device includes: If it is detected that the current scene changes from satisfying the scene trigger condition to not satisfying the scene trigger condition, the scene card is canceled from being displayed on the card output device.

8. The method according to claim 5, characterized in that If the scene card satisfies the exit display condition, canceling the display of the scene card on the card output device includes: Determine the number of times the scene card is touched during display in the card output device; If the number of touches reaches a threshold, the scene card is canceled from being displayed on the card output device.

9. The method according to any one of claims 1 to 4, characterized in that: If it is detected that the current scene meets the scene triggering condition of the specified scene, before determining the scene arrangement information of the specified scene, the method further includes: In response to a scene arrangement event for the designated scene, displaying a scene arrangement interface; In response to a scene arrangement operation acting on the scene arrangement interface, the scene arrangement information is obtained, and the designated scene is obtained based on the scene arrangement information.

10. The method according to claim 9, characterized in that The method further comprises: Based on the scene arrangement information, generating a scene description file of the specified scene; The scene description file and the target account are uploaded to the cloud to instruct the cloud to synchronize the scene description file to multiple user devices that log in to the target account.

11. The method according to claim 10, characterized in that The uploading of the scene description file and the target account to the cloud to instruct the cloud to synchronize the scene description file to multiple user devices logged in to the target account includes: Verifying the scene description file; If the verification passes, the scene description file and the target account are uploaded to the cloud to instruct the cloud to synchronize the scene description file to multiple user devices that log in to the target account.

12. The method according to claim 9, characterized in that The scene arrangement interface includes an event resource pool and a service resource pool, and the response to the scene arrangement operation acting on the scene arrangement interface, obtaining the scene arrangement information, and obtaining the specified scene based on the scene arrangement information, includes: In response to a selection operation acting on the event resource pool, determining a scene triggering condition of the specified scene from the event resource pool; In response to a selection operation acting on the service resource pool, determining the plurality of scenario services from the service resource pool, and determining one or more execution devices corresponding to the plurality of scenario services; In response to a card configuration operation acting on the scene arrangement interface, determining the scene card, a triggering sequence between the scene card and the plurality of scene services, and a card output device corresponding to the scene card; Based on the scene trigger conditions, the multiple scene services, the scene cards, the triggering order between the multiple scene services and the scene cards, the card output device corresponding to the scene card, and one or more execution devices corresponding to the multiple scene services, the scene arrangement information is obtained, and the specified scene is obtained based on the scene arrangement information.

13. A scene control device, characterized in that: The device comprises: A scene arrangement information determination module, configured to determine the scene arrangement information of the specified scene if it is detected that the current scene satisfies the scene triggering condition of the specified scene, wherein the scene arrangement information includes a plurality of scene services, a scene card, a triggering sequence between the plurality of scene services and the scene card, a card output device corresponding to the scene card, and one or more execution devices corresponding to the plurality of scene services, and the scene card is used to control the execution of some or all of the plurality of scene services; The scene control module is used to display the scene card through the card output device according to the trigger sequence, and execute the multiple scene services through the one or more execution devices.

14. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory is coupled to the processor, the memory stores instructions, and when the instructions are executed by the processor, the processor executes the method according to any one of claims 1 to 12.

15. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores program codes, and the program codes can be called by a processor to execute the method according to any one of claims 1 to 12.

Images