Vehicle-Road Collaboration Information Processing Method, Device, and Terminal Device

Abstract

The present disclosure provides a vehicle-road collaboration information processing method, apparatus, and terminal device, wherein the method comprises: receiving a plurality of event information transmitted by an information sensor device; and, when at least two of the plurality of event information are driving decision homogeneity events, merging and processing the at least two target events to generate a composite event; wherein the driving decision homogeneity events are events having a preset influence relationship.

Description

Technology Field

[0001] The present invention claims priority to a Chinese patent application filed in China on June 22, 2021, with application number No. 202110690562.3, all of which are incorporated by reference into the present invention.

[0002] The present invention relates to the field of communication technology, and in particular to a vehicle-road collaboration information processing method, device, and terminal device. Background Technology

[0003] Vehicle to Everything (V2X) is an information and communication technology that connects vehicles with surrounding objects. Through V2X, vehicles can organically connect important traffic elements and enable them to acquire more information than a single vehicle can detect. After acquiring this information, the vehicle typically displays it on a Human Machine Interface (HMI) system to help the driver fully control their surrounding environment.

[0004] However, as vehicle-road collaboration systems develop, the amount of information acquired through V2X increases, leading to a mismatch between the information processing methods of the application layer and the user's decision-making capabilities; processing methods such as relevance and priority ignore the relationships between events; and information presentation processing methods lack sufficient personalization. The prior art discloses an event data determination method, comprising the steps of: sampling a first data stream within a first time window of a first sensor of a vehicle-mounted system mounted on a vehicle; extracting internal activity data from the first data stream; determining an internal event based on the internal activity data; sampling a second data stream within a second time window of a second sensor of a vehicle-mounted system; extracting external activity data from the second data stream; determining an external event based on the external activity data; associating the external event with the internal event to generate combined event data; and automatically classifying the combined event data to generate event labels.The prior art also discloses a method for deriving information related to real-time dynamic events by road infrastructure for controlling, coordinating, and merging information from at least one observation object, which is an independent vehicle or mobile device. The method comprises the steps of: receiving event information from one or a plurality of observation objects by a road infrastructure server of the road infrastructure; each of the observation objects providing the event information of the observation object as an event information frame comprising an event data record including several attributes and a unique identifier referencing the event data record; collecting and analyzing the event information frame received from the observation object and processing the event information frame to generate a combined event information frame comprising composite event information, a unique identifier referencing the composite event information, and a control command for coordinating communication with the observation object; and distributing the combined event information frame within a distribution domain. Additionally, a road vehicle-mounted system is described. The problem to be solved

[0005] Embodiments of the present invention provide a vehicle-road collaboration information processing method, device, and terminal device for solving the problem of mismatch with the driver's decision-making process caused by the inability to perform deep processing due to the large amount of information acquired through V2X in related technologies. means of solving the problem

[0006] An embodiment of the present invention for solving the above technical problem provides the following technical solution.

[0007] An embodiment of the present invention is an information processing method applied to a terminal device, wherein

[0008] A step of receiving a plurality of event information transmitted by an information sensor device; and

[0009] If at least two of the plurality of event information are all driving decision homogeneity events, the method includes the step of merging and processing the at least two target events to generate a composite event.

[0010] The above driving decision homogeneity event is an event with a preset influence relationship.

[0011] Provides a method for processing information.

[0012] Optionally, the above method,

[0013] It further includes the step of presenting the above-mentioned complex event according to a preset presentation method;

[0014] The above presentation method includes at least one of voice presentation, text notification, and icon presentation.

[0015] Optionally, if at least two of the plurality of event informations are all driving decision homogeneity events, prior to the step of merging the at least two target events to generate a composite event, the method comprises:

[0016] A step of determining at least two first events among the plurality of event information received sequentially according to a preset time range; and

[0017] The method further includes the step of determining at least two target events among at least two first events according to a preset validity period range.

[0018] Determining at least two first events among the plurality of event information received sequentially according to the above preset time range may be understood as determining at least two first events from the plurality of event information received sequentially within the preset time range.

[0019] Optionally, the above-mentioned preset influence relationship is,

[0020] A causal relationship indicating that the first target event is the cause of the second target event;

[0021] An influence amplification relationship indicating that the result of the second target event is reinforced after the first target event occurs;

[0022] An influence weakening relationship indicating that the result of the second target event is weakened after the first target event occurs;

[0023] A time series relationship indicating that the second target event occurs after the first target event; and

[0024] It includes at least one of a new event occurrence facilitation relationship indicating that a third target event occurs due to a first target event and a second target event.

[0025] Optionally, the step of generating a composite event by merging the at least two target events is:

[0026] It includes the step of generating the composite event by merging the composite event according to a preset composite event template;

[0027] The above-mentioned preset composite event template includes a trigger event among the at least two target events, a condition event among the at least two target events, action information generated according to the at least two target events, and presentation action information for presenting the at least two target events;

[0028] The above-mentioned pre-configured composite event template further includes time information and location information of the above-mentioned condition event;

[0029] The above-mentioned behavior information includes at least one of voice broadcast information and icon information.

[0030] Optionally, the step of presenting the complex event according to the above-mentioned preset presentation method is,

[0031] A step of filtering the composite event according to preset filtering conditions; and

[0032] It further includes a step of presenting a filtered composite event according to the above-mentioned preset presentation method.

[0033] Optionally, the step of presenting the complex event according to the above-mentioned preset presentation method is,

[0034] The method further includes the step of broadcasting the complex event to a first terminal located within a preset distance range of the terminal device.

[0035] Optionally, the above method,

[0036] When the vehicle is in autonomous driving mode, a step of generating a driving control strategy according to the above complex event;

[0037] According to the above driving control strategy, the method further includes a step of controlling the vehicle to drive autonomously.

[0038] An embodiment of the present invention further provides a terminal device comprising a processor, a memory, and a program or instruction stored in the memory and executable by the processor, wherein when the program or instruction is executed by the processor, a step of any one of the information processing methods described above is implemented.

[0039] An embodiment of the present invention is an information processing device applied to a terminal device, and

[0040] A receiving module that receives multiple event information transmitted by an information sensor device; and

[0041] A composite event generation module that generates a composite event by merging at least two target events among the plurality of event information when both target events are driving decision homogeneity events;

[0042] The above driving decision homogeneity event further provides an information processing device that is an event with a preset influence relationship.

[0043] Optionally, the device,

[0044] It further includes a presentation module that presents the above-mentioned complex event according to a preset presentation method;

[0045] The above presentation method includes at least one of voice presentation, text notification, and icon presentation.

[0046] Optionally, the device,

[0047] A first determination module that determines at least two first events among the plurality of event information received sequentially according to a preset time range; and

[0048] It further includes a second determination module that determines at least two target events among at least two first events according to a preset validity period range.

[0049] Determining at least two first events among the plurality of event information received sequentially according to the above preset time range may be understood as determining at least two first events from the plurality of event information received sequentially within the preset time range.

[0050] Optionally, the above-mentioned preset influence relationship is,

[0051] A causal relationship indicating that the first target event is the cause of the second target event;

[0052] An influence amplification relationship indicating that the result of the second target event is reinforced after the first target event occurs;

[0053] An influence weakening relationship indicating that the result of the second target event is weakened after the first target event occurs;

[0054] A time series relationship indicating that the second target event occurs after the first target event; and

[0055] It includes at least one of a new event occurrence facilitation relationship indicating that a third target event occurs due to a first target event and a second target event.

[0056] Optionally, the above composite event generation module,

[0057] It includes a composite event generation unit that generates the composite event by merging and processing the composite event according to a preset composite event template;

[0058] The above-mentioned preset composite event template includes a trigger event among the at least two target events, a condition event among the at least two target events, action information generated according to the at least two target events, and presentation action information for presenting the at least two target events;

[0059] The above-mentioned pre-configured composite event template further includes time information and location information of the above-mentioned condition event;

[0060] The above-mentioned behavior information includes at least one of voice broadcast information and icon information.

[0061] Optionally, the above-mentioned module also,

[0062] Filter the above composite event according to preset filtering conditions;

[0063] Based on the above-mentioned preset presentation method, filtered composite events are presented.

[0064] Optionally, the above-mentioned module also,

[0065] The complex event is broadcast to a first terminal located within a preset distance range of the above terminal device.

[0066] Optionally, the device,

[0067] A driving strategy generation module that generates a driving control strategy according to the above complex event when the vehicle is in autonomous driving mode; and

[0068] The vehicle further includes a control module that controls the vehicle to drive autonomously according to the above driving control strategy.

[0069] An embodiment of the present invention further provides a readable storage medium in which a program or instruction is stored, and in which, when the program or instruction is executed by a processor, a step of any one of the information processing methods described above is implemented. Effects of the invention

[0070] The beneficial effects of the present invention are as follows.

[0071] According to the means of the present invention, a plurality of event information transmitted by an information sensor device is received, and when at least two of the plurality of event information are driving decision homogeneity events, the at least two target events are merged and processed to generate a composite event. Since the driving decision homogeneity events are events with a preset influence relationship, the efficiency of receiving V2X information is improved, and event contradictions are processed using the correlation of events, thereby preventing the problem of mismatch between the occurrence of a plurality of events and the driver decision process. Brief explanation of the drawing

[0072] FIG. 1 illustrates a flowchart 1 of an information processing method provided in an embodiment of the present invention. Figure 2 illustrates a schematic diagram of the structure of a system in a V2X scenario provided in an embodiment of the present invention. FIG. 3 illustrates flowchart 2 of an information processing method provided in an embodiment of the present invention. FIG. 4 illustrates a specific flowchart 1 of an information processing method provided in an embodiment of the present invention. FIG. 5 illustrates a schematic diagram of a time window provided in an embodiment of the present invention. FIG. 6 illustrates a schematic diagram of a driving decision path provided in an embodiment of the present invention. FIG. 7 illustrates a specific flowchart 2 of an information processing method provided in an embodiment of the present invention. FIG. 8 illustrates a schematic diagram of the structure of a terminal device provided in an embodiment of the present invention. FIG. 9 illustrates a schematic diagram of the structure of an information processing device provided in an embodiment of the present invention. Specific details for implementing the invention

[0073] Hereinafter, in order to clarify the purpose, technical solution, and advantages of the present invention, the present invention will be described in detail together with drawings and specific embodiments.

[0074] The present invention provides an information processing method, an apparatus, and a terminal device regarding the problem of mismatch with the driver's decision-making process caused by the inability to perform deep processing due to the large amount of information acquired through V2X in related technologies.

[0075] As illustrated in FIG. 1, an embodiment of the present invention provides an information processing method applied to a terminal device, which includes the following steps.

[0076] Step 101: Receive multiple event information transmitted by an information sensor device.

[0077] Referring to Fig. 2, the system applied to the V2X scenario is basically equipped with vehicle-mounted devices, road-side devices, a Global Positioning System (GPS), and sensing devices, and the devices communicate with the vehicle main controller through Ethernet communication, Controller Area Network (CAN) communication, serial communication, Universal Serial Bus (USB) communication, V2X communication, etc., and one or more of the devices process multiple event information and then transmit it to the vehicle main controller.

[0078] In an embodiment of the present invention, the information sensing device may be one or a plurality of the above devices.

[0079] Multiple event information refers to two or more event information.

[0080] The terminal device may be a vehicle-mounted device such as a vehicle main controller or a vehicle-mounted terminal, or may be another device or device of the vehicle capable of information processing, and the terminal device may be an electronic device equipped with a motion processing system such as a mobile phone, tablet PC, or wearable device, or may be another electronic device equipped with a display screen and a processor, or may be a V2X-enabled software development kit or a rule engine of the cloud.

[0081] Step 102: If at least two of the plurality of event information are both driving decision homogeneity events, the at least two target events are merged to generate a composite event;

[0082] The above driving decision homogeneity event is an event with a preset influence relationship.

[0083] In an embodiment of the present invention, a predetermined engine rule is established to identify whether there is a predetermined relationship between event information and event information regarding driving decision-making, such as whether there is driving decision homogeneity within a predetermined spatiotemporal window. If two or more target events among the event information are determined to be driving decision homogeneity events, the target events are merged to generate a composite event, and subsequently, the user performs decision processing on the composite event according to the user's decision-making ability.

[0084] It must be explained that for users, processing multiple events within a very short period of time often leads to confusion. First, it takes time to understand the events, and furthermore, since decision-making is complex, presenting multiple events simultaneously or sequentially increases the user's decision-making burden. Accordingly, an embodiment of the present invention receives multiple event information transmitted by an information sensor device, and if at least two of the multiple event information are driving decision homogeneity events, the at least two target events are merged and processed to generate a composite event. Here, since the driving decision homogeneity events are events with a preset influence relationship, the efficiency of receiving V2X information is improved, and event contradictions are processed using the correlation of events, thereby preventing the problem of mismatch between the occurrence of multiple events and the driver's decision-making process.

[0085] Optionally, the above method,

[0086] It further includes the step of presenting the above-mentioned complex event according to a preset presentation method;

[0087] The above presentation method includes at least one of voice presentation, text notification, and icon presentation.

[0088] In an embodiment of the present invention, a new presentation method is also provided to present complex events, thereby serving as a visual aid to the user's decision-making.

[0089] Hereinafter, an information processing method provided in an embodiment of the present invention will be described with reference to FIG. 3. A terminal device receives a plurality of event information transmitted by an information sensor device and, based on performing simple processing on the event information, determines whether there is a relationship between the events. If it is determined that there is a predetermined relationship between the events (e.g., homogeneity of driving decision-making), the events are merged and processed through a rule engine to generate a composite event. In the case of a composite event setting rule, it determines whether a new presentation method is required to achieve a visual aid effect according to the user's decision-making ability.

[0090] Hereinafter, an information processing method provided in an embodiment of the present invention will be described in detail with reference to FIG. 4.

[0091] A total of n event information, such as event 1 information, event 2 information... ...event n information, is received by a terminal device, and it is determined whether event 1 and event 2 are in the same spatiotemporal window, that is, whether event 1 and event 2 occur effectively within the same preset time period, and whether the location of occurrence is within the preset location range. If it is determined that event 1 and event 2 occur in the same spatiotemporal window, according to a preset homogeneous event grouping list, it is queried to see if event 1 and event 2 exist simultaneously in the homogeneous event grouping list. If they exist simultaneously, event 1 and event 2 are considered to be homogeneous events, and event 1 and event 2 are merged to create a composite event. A composite event presentation strategy is queried, and the event is presented according to the presentation strategy.

[0092] Optionally, the method, prior to the step of merging and processing the at least two target events to generate a composite event when at least two of the plurality of event information are both driving decision homogeneity events,

[0093] A step of determining at least two first events among the plurality of event information received sequentially according to a preset time range; and

[0094] The method further includes the step of determining at least two target events among at least two first events according to a preset validity period range.

[0095] Here, determining at least two first events among the plurality of event information received sequentially according to a preset time range may be understood as determining at least two first events from the plurality of event information received sequentially within a preset time range.

[0096] The preset time range can be understood as a time sliding window of preset length, and among the multiple event information, at least two events located within the time sliding window are determined as at least two first events.

[0097] What needs to be explained is that decision homogeneity means that a user reaches a unique driving decision after viewing two or more pieces of information, and driving decision homogeneity has determination conditions such as two or more events occurring simultaneously (within a preset time period) and all of these times being within the validity period; and two or more events influencing each other.

[0098] It should be explained that there is no restriction on the specific type of pre-set validity period range here, for example, the pre-set validity period range may mean a pre-set time range, and the specific method of determining at least two target events according to the pre-set validity period range can be referred to in the description below.

[0099] Each first event is assigned a time stamp, and if the time stamp of a specific first event is located within a preset time range, the first event can be determined as a target event.

[0100] For example, theoretically, any two or more traffic events may all occur simultaneously. Simultaneous occurrence means that information on two or more events is received by a terminal within a predetermined time range. As illustrated in FIG. 5, four events (Event 1, Event 2, Event 3, Event 4) occur sequentially. The solid box indicates the event validity period range (which can be understood as a timestamp corresponding to the event), and the dotted box indicates the event occurrence time range (which can be understood as a preset time range). At Time 2, Event 1 and Event 2 meet the conditions for simultaneous occurrence, and at Time 3, Event 1, Event 2, and Event 3 meet the conditions for simultaneous occurrence. At Time 4, only Event 2, Event 3, and Event 4 meet the conditions for simultaneous occurrence. Event 1, Event 2, and Event 3 were simultaneous events in the past, but at Time 4, Event 1 can no longer be considered a simultaneous event because Event 1 has already lost its effect.

[0101] Also, for example, the preset validity period range may mean the preset buffer area range, and the preset buffer area range may be understood as a preset range centered on the vehicle, and the specific determination method for determining at least two target events according to the preset validity period range may be described below.

[0102] Calculate the spatial range of influence of a specific first event, i.e., a spatially sustained spatial coverage, and determine the spatial range of influence of the first event according to the starting position corresponding to the occurrence of the first event and the ending position corresponding to the end of the first event; if the spatial range of influence is located within a preset buffer area, it is determined that the first event is included within the preset buffer area, i.e., the first event can be determined as a target event.

[0103] Optionally, the above-mentioned preset influence relationship is,

[0104] A causal relationship indicating that the first target event is the cause of the second target event;

[0105] An influence amplification relationship indicating that the result of the second target event is reinforced after the first target event occurs;

[0106] An influence weakening relationship indicating that the result of the second target event is weakened after the first target event occurs;

[0107] A time series relationship indicating that the second target event occurs after the first target event; and

[0108] It includes at least one of a new event occurrence facilitation relationship indicating that a third target event occurs due to a first target event and a second target event.

[0109] It needs to be explained that the reason for the existence of decision homogeneity in two or more events is that these events influence each other, and these influence relationships include causal relationships, influence amplification relationships, influence weakening relationships, time series relationships, and relationships that promote the occurrence of new events.

[0110] Below, the above influence relationship is explained and interpreted using Event 1 and Event 2 as examples.

[0111] Causation: Event 1 is the cause of Event 2;

[0112] Influence Expansion Relationship: After Event 1 occurs, the result of Event 2 is amplified;

[0113] Weakening of influence relationship: After Event 1 occurs, the result of Event 2 is weakened;

[0114] Time series relationship: After Event 1 occurs, Event 2 generally occurs afterward;

[0115] New Event Promoting Relationship: Event 1 and Event 2 inevitably lead to the occurrence of a new event.

[0116] It needs to be explained that event impact is identified through prior knowledge. Therefore, event impact can be identified through surveys or aggregated analysis of a historical event library.

[0117] Optionally, the step of merging and processing the at least two target events to generate a composite event is,

[0118] It includes the step of generating the composite event by merging the composite event according to a preset composite event template;

[0119] The above-mentioned preset composite event template includes a trigger event among the at least two target events, a condition event among the at least two target events, action information generated according to the at least two target events, and presentation action information for presenting the at least two target events;

[0120] The above-mentioned pre-configured composite event template further includes time information and location information of the above-mentioned condition event;

[0121] The above-mentioned behavior information includes at least one of voice broadcast information and icon information.

[0122] In an embodiment of the present invention, among two events belonging to a homogeneity event, a trigger event and a condition event among the two events, and action information and presentation action information generated according to the two events are determined, and if other event information exists, merging processing may be selected.

[0123] Hereinafter, two events are given as examples in which a red light notification is received and slippery road information is received within 1 minute, respectively, and the generated composite event can be defined according to the template presented in Table 1 below.

[0124] Complex Event Template Table Trigger event condition action Definition of the act of presentation etc Receive red light notifications Receive slippery road information within 1 minute Create red light + slippery event Within the validity period of the red light event, the slippery road information broadcast is stopped and changed to a red light broadcast. The icon is replaced with Red Light + Slippery. Even if there are other events between the red light and the slippery event, the above merging is still valid.

[0125] It needs to be explained that each composite event can be defined according to the above template. In the above template, a time window and a location window are defined, and the time window and location window are for association detection. When the composite event definitions are gathered, a merge validation rule library is formed.

[0126] In conventional technology, after a single event is received, the single event is understood, a possible action is determined, and the action is taken accordingly; simultaneously, if another single event is received, this single event is understood separately, and a possible action is determined. As such, when the amount of acquired events is large, the acquired event information and the driving decision-making process become mismatched.

[0127] After the complex event definition is completed, the decision path is as shown in Fig. 6.

[0128] After Event 1 is received, during the process of understanding the event, if Event 2 is received, Event 1 and Event 2 are merged to create a composite event, integrated and understood, and an action to be taken is determined and an action is taken.

[0129] Optionally, the step of presenting the complex event according to the above-mentioned preset presentation method is,

[0130] A step of filtering the composite event according to preset filtering conditions; and

[0131] It includes a step of presenting a filtered composite event according to the above-mentioned preset presentation method.

[0132] In an embodiment of the present invention, in the process of presenting a composite event, a filtering condition may be added, and the two or more events are presented only when none of the two or more events among the composite event can be filtered by a specific filtering condition.

[0133] What needs to be further explained is that regarding the influence relationship between different events, there is a definition of the presentation behavior of different complex events, and the definition of the presentation behavior is explained using the above-mentioned Event 1 and Event 2 as examples.

[0134] Causation: Stop the broadcast of Event 1 (not interrupt), broadcast Event 2, and ensure that the icon of Event 2 indicates an association with Event 1;

[0135] Expansion of influence relationship: Stop broadcasting Event 1 (not interrupt), broadcast Event 2, enhance Event 2 icon, and add Event 1;

[0136] Weakening Effect Relationship: If Event 1 broadcast is not completed, delay Event 2 broadcast, shorten Event 2 broadcast time, and merge the two event icons;

[0137] Time series relationship: Change to the broadcast of Event 1 and Event 2, merge the audio, and merge Event 2 and Event 1;

[0138] New event triggering relationship: Stop broadcasting Event 1 (not interrupt), broadcast Event 2, enhance Event 2 icon, add Event 1, and add a new event prompt.

[0139] Optionally, the step of presenting the complex event according to the above-mentioned preset presentation method is,

[0140] It includes the step of broadcasting the complex event to a first terminal located within a preset distance range of the terminal device.

[0141] In an embodiment of the present invention, after a complex event is generated, the complex event may be broadcast toward a first terminal (e.g., a vehicle-mounted device) located within a preset distance range of the terminal device and communicating with the terminal device, and as the first terminal moves or the distance from the terminal device changes, the first terminal may be updated and the complex event may be transmitted to the updated first terminal.

[0142] Below, the flow of the information processing method will be explained in detail with reference to FIG. 7.

[0143] First, event information transmitted by an information sensor device is received, and the event information is interpreted and cached while simultaneously acquiring the surrounding vehicle status. Raw event information is determined from the cached event information, and data mapping is performed on the raw event. Duplicate removal is performed on the event information based on the event's Identity Document (ID). When new event information is received, correlation detection is performed between the new event information and the raw event information. If a correlation is detected, a merge validity determination is performed. If it is determined that a merge can be performed, the events are merged into a composite event, and the highly relevant event is presented. If no correlation is detected, a new event and a high-priority event are determined and presented. Simultaneously with the generation of the composite event, the Most Probable Path (MPP) and time distance between the surrounding vehicles and the terminal are determined based on the surrounding vehicle status. The composite event is broadcast to surrounding vehicles based on the MPP and time distances, and the vehicles requiring the broadcast of the composite event are updated according to changes in the real-time distance of the surrounding vehicles. For complex events, further determination of loss of validity must be performed, and if it is determined that the validity has been lost, presentation and broadcasting are stopped.

[0144] Optionally, the above method,

[0145] When the vehicle is in autonomous driving mode, a step of generating a driving control strategy according to the above complex event; and

[0146] According to the above driving control strategy, the method further includes a step of controlling the vehicle to drive autonomously.

[0147] In an embodiment of the present invention, when the vehicle is in an autonomous driving mode, a driving strategy is generated according to a complex event, and autonomous driving is performed according to the driving strategy.

[0148] It needs to be explained that, for a complex event, an embodiment of the present invention defines a decision rule template including the design of a time window, the design of a location window, and the logical relationship of the event, defines complex event attributes according to the association of the complex event at a decision node, defines presentation behavior according to the complex event attributes, and ensures that decision homogeneity information is processed through merging when it reaches the user.

[0149] As vehicle-road collaboration systems evolve, complex events resulting from single events will become increasingly common. Consequently, user demands for information presentation will also rise. By optimizing information processing using complex events, not only is a new experience provided in information presentation, but new input methods are also offered for driving decision-making.

[0150] Embodiments of the present invention improve information absorption efficiency and decision-making efficiency; handle contradictions using event associations; and improve the diversity and personalization of information presentation.

[0151] As illustrated in FIG. 8, an embodiment of the present invention further provides a terminal device comprising a processor (800); and a memory (810) connected to the processor (800) via a bus interface, wherein the memory (810) stores programs and data used when the processor (800) performs operations, and the processor (800) calls and executes the programs and data stored in the memory (810).

[0152] Here, the terminal device further includes a transceiver (820), and the transceiver (820) is connected to a bus interface to receive and transmit data under the control of a processor (800); and the processor (800) reads a program in memory (810).

[0153] Specifically, the transceiver (820) receives a plurality of event information transmitted by an information sensor device;

[0154] The processor (800) generates a composite event by merging the at least two target events among the plurality of event information when both target events are driving decision homogeneity events;

[0155] The above driving decision homogeneity event is an event with a preset influence relationship.

[0156] Optionally, the processor (800) also presents the composite event according to a preset presentation method; said presentation method includes at least one of voice presentation, text notification, and icon presentation.

[0157] Optionally, the processor (800) also determines at least two first events among the plurality of event information received sequentially according to a preset time range; and determines at least two target events among the at least two first events according to a preset validity period range. In other words, it may be understood that the processor (800) also determines at least two first events from the plurality of event information received sequentially within a preset time range; and determines at least two target events among the at least two first events according to a preset validity period range.

[0158] Optionally, the above-mentioned preset influence relationship is,

[0159] A causal relationship indicating that the first target event is the cause of the second target event;

[0160] An influence amplification relationship indicating that the result of the second target event is reinforced after the first target event occurs;

[0161] An influence weakening relationship indicating that the result of the second target event is weakened after the first target event occurs;

[0162] A time series relationship indicating that the second target event occurs after the first target event; and

[0163] It includes at least one of a new event occurrence facilitation relationship indicating that a third target event occurs due to a first target event and a second target event.

[0164] Optionally, the processor (800) specifically merges and processes the composite events according to a preset composite event template to generate the composite events;

[0165] The above-mentioned preset composite event template includes a trigger event among the at least two target events, a condition event among the at least two target events, action information generated according to the at least two target events, and presentation action information for presenting the at least two target events;

[0166] The above-mentioned pre-configured composite event template further includes time information and location information of the above-mentioned condition event;

[0167] The above-mentioned behavior information includes at least one of voice broadcast information and icon information.

[0168] Optionally, the processor (800) also specifically filters the composite event according to preset filtering conditions; and presents the filtered composite event according to preset presentation methods.

[0169] Optionally, the processor (800) also specifically broadcasts the composite event to a first terminal located within a preset distance range of the terminal device.

[0170] Optionally, the processor (800) also specifically generates a driving control strategy according to the complex event when the vehicle is in autonomous driving mode; and controls the vehicle to drive autonomously according to the driving control strategy.

[0171] Here, in FIG. 8, the bus architecture may include any number of interconnected buses and bridges, specifically, various circuits of one or more processors represented by the processor (800) and memory represented by the memory (810) are connected. The bus architecture may also connect various other circuits such as peripheral devices, voltage regulators, and power management circuits, and since all such details are known in the art, a description thereof is omitted in this specification. The bus interface provides an interface. The transceiver (820) may be a plurality of elements, that is, it includes a transmitter and a receiver that provide a unit for communicating with various other devices in a transmission medium. For different terminals, the user interface (830) may be an interface that can connect necessary devices externally or internally, and the connected devices include, but are not limited to, keypads, display devices, speakers, microphones, control bars, etc. The processor (800) is responsible for managing and handling the bus architecture and normal processing, and data used when the processor (800) executes operations may be stored in the memory (810).

[0172] As illustrated in FIG. 9, an embodiment of the present invention further provides an information processing device applied to a terminal device, and this,

[0173] A receiving module (901) for receiving multiple event information transmitted by an information sensor device; and

[0174] A composite event generation module (902) that generates a composite event by merging the at least two target events when at least two of the above multiple event information are driving decision homogeneity events, and

[0175] The above driving decision homogeneity event is an event with a preset influence relationship.

[0176] An embodiment of the present invention receives a plurality of event information transmitted by an information sensor device, and when at least two of the plurality of event information are driving decision homogeneity events, the at least two target events are merged and processed to generate a composite event. Here, since the driving decision homogeneity events are events with a preset influence relationship, the efficiency of receiving V2X information is improved, and event contradictions are processed using the correlation of events, thereby preventing the problem of mismatch between the occurrence of a plurality of events and the driver decision process.

[0177] Optionally, the device,

[0178] It further includes a presentation module that presents the above-mentioned complex event according to a preset presentation method;

[0179] The above presentation method includes at least one of voice presentation, text notification, and icon presentation.

[0180] Optionally, the device,

[0181] A first determination module that determines at least two first events among the plurality of event information received sequentially according to a preset time range; and

[0182] It further includes a second determination module that determines at least two target events among at least two first events according to a preset validity period range.

[0183] In other words, the device further includes: a first determination module that determines at least two first events from a plurality of event information received sequentially within a preset time range; and a second determination module that determines at least two target events among the at least two first events according to a preset validity period range.

[0184] Optionally, the above-mentioned preset influence relationship is,

[0185] A causal relationship indicating that the first target event is the cause of the second target event;

[0186] An influence amplification relationship indicating that the result of the second target event is reinforced after the first target event occurs;

[0187] An influence weakening relationship indicating that the result of the second target event is weakened after the first target event occurs;

[0188] A time series relationship indicating that the second target event occurs after the first target event; and

[0189] It includes at least one of a new event occurrence facilitation relationship indicating that a third target event occurs due to a first target event and a second target event.

[0190] Optionally, the composite event generation module (902) is,

[0191] It includes a composite event generation unit that generates the composite event by merging and processing the composite event according to a preset composite event template;

[0192] The above-mentioned preset composite event template includes a trigger event among the at least two target events, a condition event among the at least two target events, action information generated according to the at least two target events, and presentation action information for presenting the at least two target events;

[0193] The above-mentioned pre-configured composite event template further includes time information and location information of the above-mentioned condition event;

[0194] The above-mentioned behavior information includes at least one of voice broadcast information and icon information.

[0195] Optionally, the above-mentioned module also,

[0196] Filter the above composite event according to preset filtering conditions;

[0197] Based on the above-mentioned preset presentation method, filtered composite events are presented.

[0198] Optionally, the above-mentioned module also,

[0199] The complex event is broadcast to a first terminal located within a preset distance range of the above terminal device.

[0200] Optionally, the device,

[0201] A driving strategy generation module that generates a driving control strategy according to the above complex event when the vehicle is in autonomous driving mode; and

[0202] The vehicle further includes a control module that controls the vehicle to drive autonomously according to the above driving control strategy.

[0203] It must be explained that since the information processing device provided in the embodiment of the present invention is a device capable of performing the information processing method, all embodiments of the information processing method are applied to the device and can achieve the same or similar technical effects.

[0204] It must be explained that the compartments of each module described above are merely compartments of logical function; in actual implementation, all or part of them may be integrated into a single physical entity, or they may be physically separated. All such modules may be implemented in a form where software is called through a processing element; all may be implemented in a hardware form; or some modules may be implemented in a form where software is called through a processing element, and some modules may be implemented in a hardware form. For example, the first decision module may be a separately installed processing element, may be integrated into a specific chip of the device, or may be stored in the memory of the device in the form of program code, or may be called by a specific processing element of the device to perform the function of the decision module. The implementation of other modules is similar. Furthermore, all or part of these modules may be integrated in one place or implemented independently. The processing element described herein may be a single integrated circuit having signal processing capabilities. In the implementation process, each step of the method or each module may be completed through an integrated logic circuit of hardware among the processor elements or through instructions in the form of software.

[0205] For example, each module, unit, sub-unit, or sub-module may be one or more integrated circuits configured to implement the above method, such as one or more Application Specific Integrated Circuits (ASICs), one or more digital signal processors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs). Additionally, when the specific module is implemented in a form that schedules program code through a processing element, the processing element may be a general-purpose process such as a Central Processing Unit (CPU) or a processor capable of calling other program code. Furthermore, such modules may be integrated in one place and implemented in the form of a system-on-a-chip (SOC).

[0206] Terms such as “first,” “second,” etc. in the specification and claims of the present invention are intended to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that data used in this manner may be exchanged as appropriate, so that embodiments of the present invention described herein may be implemented in an order other than those shown or described herein. Furthermore, the terms “include” and “comprising,” and any variations thereof, are intended to include non-exclusive inclusions, and, for example, a process, method, system, product, or apparatus comprising a series of steps or units is not necessarily limited to the steps or units explicitly listed, but may include other steps or units that are not explicitly listed or are unique to such process, method, product, or apparatus. In addition, “and / or” as used in the specification and claims means at least one of the connected objects, for example, A and / or B and / or C means including seven cases: A alone, B alone, C alone, A and B both, B and C both, A and C both, and A, B, and C all. Similarly, “at least one of A and B” in this specification and claims should be understood as “only A exists, only B exists, or both A and B exist.”

[0207] An embodiment of the present invention further provides a readable storage medium in which a program or command is stored, and in which, when the program or command is executed by a processor, a step of an information processing method according to any one of the above is implemented.

[0208] Furthermore, it should be noted that in the apparatus and method of the present invention, each component or each step may be disassembled and / or reassembled. Such disassembly and / or reassembly should be regarded as equivalent means of the present invention. Additionally, steps for performing the series of processes may naturally be performed in chronological order according to the order described, but are not required to be performed in chronological order, and some steps may be performed in parallel or independently of each other. A person skilled in the art will understand that all or any step or component of the method and apparatus of the present invention may be implemented in hardware, firmware, software, or a combination thereof on any computing device (including processors, storage media, etc.) or network of computing devices, and that a person skilled in the art can implement this using their basic programming skills after reading the description of the present invention.

[0209] Accordingly, the object of the present invention may be realized by executing a single program or a group of programs on any computing device. The computing device may be a known general-purpose device. Accordingly, the object of the present invention may be realized through a program product containing program code that implements the method or device. In other words, such a program product also constitutes the present invention, and a storage medium in which such a program product is stored also constitutes the present invention. It is obvious that the storage medium may be any known storage medium or any storage medium to be developed in the future. Furthermore, it should be noted that in the device and method of the present invention, each component or each step may be disassembled and / or reassembled. Such disassembly and / or reassembly should be considered as an equivalent means of the present invention. Additionally, the steps for performing the series of processes may naturally be performed in chronological order according to the order described, but do not necessarily need to be performed in chronological order, and some steps may be performed in parallel or independently of each other.

[0210] The above is merely a preferred embodiment of the present invention, and a person skilled in the art can make various improvements or modifications without departing from the principles of the present invention, and all such improvements and modifications are included within the scope of protection of the present invention.

Claims

Claim 1 An information processing method applied to a terminal device, comprising: a step of receiving a plurality of event information transmitted by an information sensor device; and a step of generating a composite event by merging the at least two target events when at least two of the plurality of event information are driving decision homogeneity events; wherein the step of generating a composite event by merging the at least two target events comprises a step of generating the composite event by merging the composite events according to a preset composite event template; wherein the preset composite event template comprises a trigger event among the at least two target events, a condition event among the at least two target events, action information generated according to the at least two target events, and presentation action information for presenting the at least two target events; wherein the preset composite event template further comprises time information and location information of the condition event; and wherein the presentation action information comprises at least one of voice broadcast information and icon information; and wherein the driving decision homogeneity event is an event having a preset influence relationship. Claim 2 The information processing method according to claim 1 further comprises the step of presenting the complex event according to a preset presentation method; wherein the presentation method includes at least one of voice presentation, text notification, and icon presentation. Claim 3 An information processing method according to claim 1, wherein, when at least two target events among the plurality of event information are all driving decision homogeneity events, prior to the step of merging and processing the at least two target events to generate a composite event, the method further comprises: a step of determining at least two first events from the plurality of event information received sequentially within a preset time range; and a step of determining at least two target events among the at least two first events according to a preset validity period range. Claim 4 The information processing method according to claim 1, wherein the above-mentioned pre-set influence relationship comprises at least one of: a causal relationship indicating that the first target event is the cause of the occurrence of the second target event; an influence amplification relationship indicating that the result of the second target event is strengthened after the first target event occurs; an influence weakening relationship indicating that the result of the second target event is weakened after the first target event occurs; a time series relationship indicating that the second target event occurs after the first target event; and a new event occurrence promotion relationship indicating that the third target event occurs due to the first target event and the second target event. Claim 5 In paragraph 2, the step of presenting the composite event according to the preset presentation method comprises: a step of filtering the composite event according to a preset filtering condition; and a step of presenting the filtered composite event according to the preset presentation method. Claim 6 In paragraph 2, the step of presenting the complex event according to the above-mentioned preset presentation method comprises the step of broadcasting the complex event to a first terminal located within a preset distance range of the terminal device. Claim 7 An information processing method according to claim 1, further comprising: a step of generating a driving control strategy according to the complex event when the vehicle is in an autonomous driving mode; and a step of controlling the vehicle to drive autonomously according to the driving control strategy. Claim 8 A terminal device comprising a processor, a memory, and a program or instruction stored in the memory and executable by the processor, wherein when the program or instruction is executed by the processor, the step of an information processing method according to any one of claims 1 to 7 is implemented. Claim 9 An information processing device applied to a terminal device, comprising: a receiving module that receives a plurality of event information transmitted by an information sensor device; and a composite event generating module that generates a composite event by merging at least two target events when at least two of the plurality of event information are driving decision homogeneity events; wherein generating a composite event by merging at least two target events includes generating the composite event by merging the composite events according to a preset composite event template; wherein the preset composite event template includes a trigger event among the at least two target events, a condition event among the at least two target events, action information generated according to the at least two target events, and presentation action information for presenting the at least two target events; wherein the preset composite event template further includes time information and location information of the condition event; and wherein the presentation action information includes at least one of voice broadcast information and icon information; and wherein the driving decision homogeneity event is an event having a preset influence relationship. Claim 10 In claim 9, the information processing device further comprises a presentation module that presents the complex event according to a preset presentation method; said presentation method comprising at least one of voice presentation, text notification, and icon presentation. Claim 11 A readable storage medium in which a program or command is stored, wherein, when said program or command is executed by a processor, a step of an information processing method according to any one of claims 1 to 7 is implemented. Claim 12 delete

Images