Seat allocation method and device, electronic equipment and storage medium

By analyzing the emotional state of passengers, intelligently allocating seats in public transportation, the problem of unreasonable seats caused by random allocation is solved, the accuracy and efficiency of seat allocation is improved, and the passenger experience is improved.

CN119005586APending Publication Date: 2024-11-22CHINA FAW CO LTD +1
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411022922.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-29
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The passenger seat allocation in existing public transportation means is random, resulting in unreasonable seat allocation and affecting the passenger's riding experience.

Method used

By obtaining a video frame sequence of passenger facial image information, the passenger's emotional state, including emotional activity and mood fluctuations, is analyzing each passenger's emotional state based on these data.

Benefits of technology

It improves the accuracy and efficiency of seat allocation, reduces passenger waiting time, and improves the riding experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119005586A_ABST
    Figure CN119005586A_ABST
Patent Text Reader

Abstract

The invention discloses a seat allocation method and device, electronic equipment and a storage medium, and relates to the technical field of intelligent allocation. The method comprises the following steps: under the condition that a passenger starts to queue up to get on, acquiring a video frame sequence which is acquired by an image acquisition device and comprises passenger face image information; analyzing the emotional state of each passenger based on a video frame sequence including passenger face image information to obtain the emotional activeness and emotional fluctuation of each passenger; according to the emotional activeness and emotional fluctuation degree of each passenger, allocating an optimal seat to each passenger to obtain a seat allocation result; and according to a seat distribution result, prompting each passenger to sit at the corresponding optimal seat. According to the scheme, the most reasonable seat is arranged for each passenger by analyzing the emotional state of the passenger, so that the accuracy of seat distribution is improved; in addition, seat distribution is completed in the process that passengers queue up to get on the bus, and the seat distribution efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of intelligent allocation technology, and in particular to a seat allocation method, device, electronic device and storage medium. Background Art

[0002] With the promotion and popularization of the concept of green travel, taking public transportation as an environmentally friendly, economical and efficient way of travel is gradually becoming an important choice in people's daily lives. When passengers choose to travel by public transportation, seats need to be allocated to them.

[0003] At present, passengers' seats are usually allocated randomly. However, this method has certain shortcomings: the seat allocation result is unreasonable, and the best seat cannot be allocated to each passenger, which leads to poor passenger experience. Summary of the invention

[0004] The invention provides a seat allocation method, device, electronic equipment and storage medium.

[0005] According to another aspect of the present invention, there is provided a seat allocation method, comprising:

[0006] When passengers start to queue up to board the bus, a video frame sequence including facial image information of the passengers collected by the image collector is obtained;

[0007] Analyzing the emotional state of each passenger based on the video frame sequence including the passenger's facial image information to obtain the emotional activity and emotional fluctuation of each passenger;

[0008] Allocate the best seat to each passenger according to the emotional activity and emotional volatility of each passenger, and obtain a seat allocation result;

[0009] According to the seat allocation result, each passenger is prompted to sit at the corresponding best seat.

[0010] According to another aspect of the present invention, there is provided a seat allocation device, comprising:

[0011] A video frame acquisition module, used to acquire a video frame sequence including facial image information of the passenger acquired by the image collector when the passenger starts to queue up to board the bus;

[0012] An emotion analysis module, used to analyze the emotional state of each passenger based on a video frame sequence including facial image information of the passenger, and obtain the emotional activity and emotional fluctuation of each passenger;

[0013] A seat allocation module, used to allocate the best seat to each passenger according to the emotional activity and emotional fluctuation of each passenger, and obtain a seat allocation result;

[0014] The prompting module is used to prompt each passenger to sit at the corresponding best seat according to the seat allocation result.

[0015] According to another aspect of the present invention, there is provided an electronic device, the electronic device comprising:

[0016] at least one processor; and

[0017] a memory communicatively connected to the at least one processor; wherein,

[0018] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the seat allocation method described in the embodiment of the present invention.

[0019] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the seat allocation method described in the embodiment of the present invention when executed.

[0020] The technical solution of the embodiment of the present invention analyzes the emotional state of passengers and arranges the most reasonable seat for each passenger, thereby improving the accuracy of seat allocation. In addition, seat allocation is completed while passengers are queuing to board the bus, which not only improves the efficiency of seat allocation but also reduces the waiting time of passengers.

[0021] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0023] Figure 1 is a flowchart of a seat allocation method provided according to an embodiment of the present invention;

[0024] Figure 2 is a flowchart of a seat allocation method provided according to an embodiment of the present invention;

[0025] Figure 3 is a flowchart of a seat allocation method provided according to an embodiment of the present invention;

[0026] Figure 4 is a structural schematic diagram of a seat allocation device provided according to an embodiment of the present invention;

[0027] Figure 5 It is a schematic diagram of the structure of an electronic device for implementing the seat allocation method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0028] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0029] Embodiment 1

[0030] Figure 1 A flowchart of a seat allocation method is provided for an embodiment of the present invention. This embodiment can be applied to a scenario in which seats are intelligently allocated to passengers, typically a scenario in which seats are arranged for passengers when they need to take public transportation to a tourist attraction. The method can be executed by a seat allocation device, which can be implemented in the form of hardware and / or software. The seat allocation device can be configured in an electronic device, such as a server device.

[0031] like Figure 1 As shown, the seat allocation method includes:

[0032] S101. When passengers start queuing up to board a bus, a video frame sequence including passenger facial image information acquired by an image collector is acquired.

[0033] In the embodiment of the present invention, the passengers can be selected as tourists in a tour group. When passengers sign up for a tour group, because the accommodation is far away from the scenic spot, or the distance between different scenic spots is far, the passengers need to take a means of transportation from the accommodation to the scenic spot, or take a means of transportation from one scenic spot to another, wherein the means of transportation can be selected from various vehicles, such as buses, trains, high-speed railways, etc. When passengers start to line up to get on the bus, the image collector (such as various cameras) carried by the vehicle can automatically collect videos including facial image information of passengers, so that the execution subject of the scheme of the present invention can timely obtain a video frame sequence including facial image information of passengers from the image collector, wherein the video frame sequence is composed of multiple continuous video frames.

[0034] It should be noted that the collection of videos including passenger facial image information by the image collector is authorized by the passenger. For example, when the passenger signs up for a group tour, the passenger's facial information collection content is informed to the passenger so that the passenger can authorize it. Moreover, the collection, storage, use, processing, transmission, provision and disclosure of passenger personal information (such as facial information) involved in the scheme of the present invention are in compliance with the provisions of relevant laws and regulations and do not violate public order and good customs.

[0035] In an embodiment of the present invention, after obtaining a video frame sequence including passenger facial information, each video frame in the video frame sequence can be preprocessed in advance, wherein the preprocessing includes image cropping, enhancement, normalization, etc. Optionally, image cropping refers to removing unnecessary parts from the acquired video frame and retaining only the parts of interest, such as deleting the invalid background in the video frame and retaining the part including the passenger's facial image information; image enhancement refers to improving the visual effect of the video frame by a series of technical means to make the video frame clearer and easier to analyze. Common image enhancement methods include histogram equalization, contrast stretching, smoothing filtering, sharpening filtering, etc.; image normalization refers to a process of performing a series of standard processing transformations on each video frame to transform it into a fixed standard form. The purpose of normalization is mainly to eliminate redundant information and inconsistency in the video frame and improve the efficiency and accuracy of video frame processing. It can be understood that by preprocessing the acquired video frame sequence, the accuracy of the subsequent emotional state analysis based on the video frame sequence can be guaranteed, thereby ensuring the accuracy of the seat allocation for the passenger.

[0036] S102: Analyze the emotional state of each passenger based on the video frame sequence including passenger facial image information to obtain the emotional activity and emotional fluctuation of each passenger.

[0037] In the embodiment of the present invention, the emotional state of each passenger needs to be analyzed. Optionally, face recognition technology can be used to perform face detection on each video frame to obtain multiple face detection results, and the face detection results include the face information of the detected passengers; according to the face detection results and the face information uploaded by each passenger in advance, the passengers corresponding to each face detection result are determined, for example, the similarity between each face detection result and the face information of different passengers is calculated, and the passengers corresponding to each face detection result are determined according to the calculation results; for any passenger, the face detection results of the passenger in different video frames are analyzed and compared, and then the emotional activity and emotional fluctuation of the passenger are determined. Among them, the emotional activity is used to characterize whether the facial expression of the passenger changes frequently during the queue for boarding, and whether the facial expression changes frequently reflects the emotional activity and interaction needs of the passenger; the emotional fluctuation is used to characterize the magnitude of the change in the facial expression of the passenger during the queue for boarding, and the magnitude of the change in the facial expression reflects the stability of the passenger's emotions. Since the emotional activity and emotional fluctuation of different passengers are different, the passengers have different needs for seats, so seats can be allocated to passengers according to the emotional activity and emotional fluctuation.

[0038] S103, allocating the best seat to each passenger according to the emotional activity and emotional fluctuation of each passenger, and obtaining a seat allocation result.

[0039] In an embodiment of the present invention, in an optional implementation, the best seat can be allocated to each passenger according to a predetermined seat allocation strategy, combined with the emotional activity and emotional volatility of each passenger; wherein the seat allocation strategy may include the correspondence between different emotional activity and emotional volatility and the best seat. In another optional implementation, a seat allocation model can be pre-trained, which can be a deep learning model or a neural network model, and then the emotional activity and emotional volatility of each passenger are used as model inputs, and the best seat for each passenger is determined according to the model output. In this way, a seat allocation result including the best seat corresponding to each passenger can be obtained.

[0040] S104: prompting each passenger to sit at the corresponding best seat according to the seat allocation result.

[0041] In an embodiment of the present invention, after obtaining the seat allocation result, the seat allocation result can be sent to the on-board voice broadcasting device for broadcasting, so as to prompt each passenger to sit at the corresponding best seat; the seat allocation result can also be sent to the on-board large screen for display, so that the passengers on the bus can sit according to the seat allocation result displayed on the large screen; the seat allocation result can also be sent to the tour guide's handheld device, and then the tour guide will guide each passenger to sit at the corresponding best seat; in addition, the seat allocation result can also be sent directly to each passenger's respective handheld device, so that each passenger can find the corresponding best position to sit according to the seat allocation result displayed on his or her own handheld device.

[0042] The embodiment of the present invention analyzes the emotional state of passengers and arranges the most reasonable seat for each passenger, thereby improving the accuracy of seat allocation. In addition, seat allocation is completed while passengers are queuing to get on the bus, which not only improves the efficiency of seat allocation but also reduces the waiting time of passengers.

[0043] Embodiment 2

[0044] Figure 2 The present invention provides a flowchart of a seat allocation method. The present invention describes in detail the specific process of determining the emotional activity and emotional fluctuation of passengers. Figure 2 , the method comprises the following steps:

[0045] S201. When passengers start queuing up to board a bus, a video frame sequence including facial image information of the passengers acquired by an image collector is acquired.

[0046] After obtaining the video frame sequence in step S201, the emotional state of each passenger is analyzed based on the video frame sequence including the passenger's facial image information. The specific process of obtaining the emotional activity and emotional fluctuation of each passenger can be seen in steps S202-S205.

[0047] S202: Perform face detection on each video frame in the video frame sequence to determine the face region of each passenger in each video frame.

[0048] Optionally, for each video frame in the video frame sequence, a pre-trained face detection model is used to determine the face region in each video frame. It is understandable that if a video frame includes face image information of multiple passengers, then multiple face regions can be obtained for one video frame. In addition, after obtaining the face region, the passenger corresponding to each face region can be determined based on the face information in the face region and the face information uploaded in advance by the passenger.

[0049] S203: In each of the face regions, determine facial key points and pixel positions of the facial key points.

[0050] Optionally, for the face area in each video frame, a facial key point detection algorithm can be used to identify the facial key points of each face area and determine the pixel position of each facial key point. In the embodiment of the present invention, the facial key points are exemplarily the left eye pupil position point, the left eye corner position point, the left eye right eye corner position point, ..., due to the large number of facial key points, they are not listed here one by one. Optionally, in the embodiment of the present invention, the number of facial key points is 68.

[0051] On the basis of the above, the passenger's emotional activity can be determined according to step S204, and the passenger's emotional fluctuation can be determined according to step S205.

[0052] S204: Determine the emotional activity of each passenger according to changes in facial key points of each passenger between adjacent video frames.

[0053] In an optional implementation, for any facial key point of any passenger, the pixel distance between any two adjacent video frames of the facial key point is determined according to the pixel position of the facial key point in different video frames; the determined pixel distances are averaged, and the obtained pixel distance average is used as the emotional activity of the passenger. Exemplarily, the emotional activity of each passenger can be calculated according to the following formula:

[0054]

[0055] Among them, A represents the emotional activity of the passenger; P i,j represents the pixel position of the jth facial key point of the passenger in the i-th frame; P i-1,j represents the pixel position of the jth facial key point of the passenger in the i-1th frame; N represents the number of video frames included in the video frame sequence; 68 represents the total number of facial key points detected in the face area of ​​the passenger.

[0056] S205 . For any of the passengers, determine the degree of emotional fluctuation of the passenger according to the pixel positions of the facial key points of the passenger in the video frame sequence and the default pixel positions of the facial key points.

[0057] The default pixel position of the facial key point refers to the pixel position of the facial key point when the passenger is in a stable emotional state. In an optional implementation, for any passenger, the passenger's emotional fluctuation degree is determined based on the pixel position of the facial key point of the passenger in the video frame sequence and the default pixel position of the facial key point, including: for any facial key point of any passenger, according to the pixel position of the facial key point in each video frame and the default pixel position of the facial key point, the pixel distance is determined; in response to the pixel distance being greater than the pixel distance threshold associated with the facial key point, the distance difference is determined; the obtained distance differences are accumulated, and the accumulated result is used as the emotional fluctuation degree.

[0058] For example, the passenger's emotional fluctuation can be calculated according to the following formula:

[0059]

[0060] Wherein, B represents the emotional fluctuation of a passenger; N represents the number of video frames included in the video frame sequence; 68 represents the total number of facial key points detected in the face area of ​​the passenger; P i,j represents the pixel position of the jth facial key point of the passenger in the i-th frame; P normal,j represents the default pixel position of the jth facial key point; R j represents the pixel distance threshold associated with the jth facial key point, which is used to measure the maximum value of the facial key point position beyond the normal range. It can be understood that the pixel distance thresholds associated with different facial key points are different.

[0061] S206. Allocate an optimal seat to each passenger according to the emotional activity and emotional fluctuation of each passenger, and obtain a seat allocation result.

[0062] S207: prompting each passenger to sit at the corresponding best seat according to the seat allocation result.

[0063] The process of steps S206-S207 can refer to the above embodiment and will not be described in detail here.

[0064] In the embodiment of the present invention, the passenger's emotional activity is judged by calculating the average distance of the changes in facial key points between adjacent frames, and the passenger's emotional fluctuation is judged by calculating the total distance of key points beyond the normal range. This can improve the accuracy of the calculated emotional activity and emotional fluctuation, thereby ensuring the accuracy of subsequent allocation of the best seat to the passenger based on the emotional activity and emotional fluctuation.

[0065] Embodiment 3

[0066] Figure 3The present invention provides a flowchart of a seat allocation method. The present invention describes in detail the specific process of allocating the best seat to each passenger based on the emotional activity and emotional fluctuation of each passenger. Figure 3 , the method comprises the following steps:

[0067] S301. When passengers start queuing up to board a bus, a video frame sequence including passenger facial image information acquired by an image collector is obtained.

[0068] S302: Analyze the emotional state of each passenger based on the video frame sequence including the passenger's facial image information to obtain the emotional activity and emotional fluctuation of each passenger.

[0069] Optionally, first, face detection is performed on each video frame in the video frame sequence to determine the face area of ​​each passenger in each video frame; in each face area, the facial key points and the pixel positions of the facial key points are determined. Further, for any facial key point of any passenger, the pixel distance of the facial key point between any two adjacent video frames is determined according to the pixel position of the facial key point in different video frames; the determined pixel distances are averaged, and the obtained pixel distance average is used as the passenger's emotional activity. Further, for any facial key point of any passenger, the pixel distance is determined according to the pixel position of the facial key point in each video frame and the default pixel position of the facial key point; in response to the pixel distance being greater than the pixel distance threshold associated with the facial key point, the distance difference is determined; the obtained distance difference is accumulated, and the accumulated result is used as the emotional fluctuation. For a more specific calculation method, please refer to the calculation formula of the above embodiment.

[0070] After obtaining the emotional activity and emotional volatility of each passenger, the process of allocating the best seat to each passenger according to the emotional activity and emotional volatility of each passenger can refer to steps S303-S304.

[0071] S303: Determine the orientation attribute and area attribute of the best seat for each passenger according to the emotional activity and emotional fluctuation of each passenger.

[0072] Among them, the orientation attributes include outside position and inside position; the inside position usually refers to the seat close to the center line of the vehicle or the inside of the window, and the outside position refers to the seat close to the aisle or the outside of the vehicle; the area attributes include the front area, the middle area, and the back area. The division of area attributes can be pre-divided into three areas based on the size of the space in the car and the distribution of seats, and can be equally divided. For example, if the vehicle has 9 rows of seats from front to back, the first three rows can be used as the front area, the middle three rows can be used as the middle area, and the back three rows can be used as the back area.

[0073] In a specific implementation, passengers with high emotional activity indicate that their facial expressions change frequently while queuing to board the bus, showing high emotional activity and interaction needs. Such passengers can be arranged in outer seats to facilitate their communication and activities while also reducing interference with other passengers. Therefore, in response to the passenger's emotional activity being greater than or equal to a preset activity threshold, the orientation attribute of the passenger's best seat is determined to be an outer seat.

[0074] Passengers with low emotional activity indicate that they have less facial expression changes during the boarding queue, showing lower emotional activity and interaction needs. Such passengers can be arranged in the inner seats to provide a relatively quiet and stable environment to meet their needs. Therefore, in response to the passenger's emotional activity being less than the preset activity threshold, the orientation attribute of the passenger's best seat is determined to be the inner seat.

[0075] Passengers with large emotional fluctuations indicate that they have large emotional changes during the queue for boarding, and may show strong emotional reactions and instability. Such passengers can be arranged in the front row, so that the crew can pay attention to and take care of them in time to ensure their safety and comfort. Therefore, in response to the passenger's emotional fluctuation being greater than the preset first fluctuation threshold, the area attribute of the passenger's best seat is determined to be the front row area.

[0076] Passengers with small emotional fluctuations indicate that they have small emotional changes during the queue for boarding, showing a relatively stable and relaxed emotional state. Such passengers can be arranged in the back row to provide a relatively independent and quiet environment, which is suitable for passengers who take long-distance rides and need to rest. Therefore, in response to the passenger's emotional fluctuation being less than the preset second fluctuation threshold, the area attribute of the passenger's best seat is determined to be the back row area.

[0077] Passengers with moderate emotional fluctuations indicate that they have moderate emotional changes during the queue for boarding, showing a relatively stable emotional state. Such passengers can be arranged in the middle row to provide moderate attention and comfort to meet the needs of most ordinary passengers. Therefore, in response to the passenger's emotional fluctuation being between the second fluctuation threshold and the first fluctuation threshold, the area attribute of the passenger's best seat is determined to be the middle area. It can be understood that the first fluctuation threshold is greater than the second fluctuation threshold.

[0078] S304: Select the best seat for the passenger from the remaining seats in the vehicle according to the orientation attribute and the area attribute.

[0079] After obtaining the orientation attribute and area attribute of the best seat for each passenger in step S303, the best seat can be directly selected for the passenger from the remaining seats in the vehicle according to the orientation attribute and area attribute. For example, a passenger's orientation attribute is an external seat, and the area attribute is a front row area, so a random seat can be selected from the external seats in the first few rows. In addition, if the orientation attribute and area attribute of two passengers are the same, the magnitude of the emotional fluctuation of the two passengers is compared, and the best seat of the passenger with a large emotional fluctuation can be arranged in front of the best seat of the passenger with a slightly smaller emotional fluctuation.

[0080] S305: prompt each passenger to sit at the corresponding best seat according to the seat allocation result.

[0081] The embodiment of the present invention analyzes the emotional state of passengers and arranges the most reasonable seat for each passenger, thereby improving the accuracy of seat allocation. In addition, seat allocation is completed while passengers are queuing to get on the bus, which not only improves the efficiency of seat allocation but also reduces the waiting time of passengers.

[0082] Embodiment 4

[0083] Figure 4 The present invention provides a schematic diagram of a seat allocation device. This embodiment is applicable to the scenario of intelligently allocating seats to passengers. Figure 4 As shown, the seat allocation device includes:

[0084] The video frame acquisition module 401 is used to acquire a video frame sequence including facial image information of the passenger acquired by the image collector when the passenger starts to queue up to board the bus;

[0085] The emotion analysis module 402 is used to analyze the emotional state of each passenger based on the video frame sequence including the passenger's facial image information, and obtain the emotional activity and emotional fluctuation of each passenger;

[0086] The seat allocation module 403 is used to allocate the best seat to each passenger according to the emotional activity and emotional fluctuation of each passenger to obtain a seat allocation result;

[0087] The prompting module 404 is used to prompt each passenger to sit at the corresponding best seat according to the seat allocation result.

[0088] In an optional implementation, the sentiment analysis module 402 includes:

[0089] A first face detection unit, configured to perform face detection on each video frame in the video frame sequence, and determine a face region of each passenger in each video frame;

[0090] A first facial key point detection unit, used for determining facial key points in each of the face regions;

[0091] The emotional activity determination unit is used to determine the emotional activity of each passenger according to the changes of facial key points of each passenger between adjacent video frames.

[0092] In an optional implementation, the emotional activity determination unit is specifically used to:

[0093] For any facial key point of any of the passengers, determine the pixel distance of the facial key point between any two adjacent video frames according to the pixel position of the facial key point in different video frames;

[0094] The determined pixel distances are averaged, and the obtained pixel distance average is used as the emotional activity of the passenger.

[0095] In an optional implementation, the sentiment analysis module 402 includes:

[0096] A second face region detection unit, configured to perform face detection on each video frame in the video frame sequence, and determine a face region of each passenger in each video frame;

[0097] A second facial key point detection unit, used to determine facial key points and pixel positions of the facial key points in each of the face regions;

[0098] The emotion fluctuation determination unit is used to determine the emotion fluctuation of any of the passengers according to the pixel positions of the facial key points of the passenger in the video frame sequence and the default pixel positions of the facial key points; wherein the default pixel positions of the facial key points refer to the pixel positions of the facial key points when the passenger is in a stable emotional state.

[0099] In an optional implementation, the emotion fluctuation determination unit is specifically used to:

[0100] For any facial key point of any of the passengers, determine the pixel distance according to the pixel position of the facial key point in each video frame and the default pixel position of the facial key point;

[0101] In response to the pixel distance being greater than a pixel distance threshold associated with the facial keypoint, determining a distance difference;

[0102] The obtained distance differences are accumulated, and the accumulated result is used as the emotion fluctuation degree.

[0103] In an optional implementation, the seat allocation module 403 includes:

[0104] An attribute determination unit, used to determine the orientation attribute and area attribute of the best seat for each passenger according to the emotional activity and emotional fluctuation of each passenger; wherein the orientation attribute includes an outer position and an inner position; and the area attribute includes a front row area, a middle area, and a back row area;

[0105] An allocating unit is used to select the best seat for the passenger from the remaining seats in the vehicle according to the orientation attribute and the area attribute.

[0106] In an optional implementation manner, the attribute determination unit is specifically used to:

[0107] In response to the emotional activity being greater than or equal to a preset activity threshold, determining that the orientation attribute of the best seat for the passenger is the outer seat;

[0108] In response to the emotional activity being less than a preset activity threshold, determining that the best seat orientation attribute for the passenger is the inner seat;

[0109] In response to the emotion fluctuation being greater than a preset first fluctuation threshold, determining that the area attribute of the best seat for the passenger is the front row area;

[0110] In response to the emotion fluctuation being less than a preset second fluctuation threshold, determining that the area attribute of the best seat for the passenger is the back row area;

[0111] In response to the emotion fluctuation being between the second fluctuation threshold and the first fluctuation threshold, determining the zone attribute of the best seat for the passenger to be the middle zone.

[0112] The seat allocation device provided in the embodiment of the present invention can execute the seat allocation method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0113] Embodiment 5

[0114] Figure 5 A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to be a controller device in a new energy vehicle. The components shown herein, their connections and relationships, and their functions are only examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0115] like Figure 5As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0116] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0117] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as executing the seat allocation method.

[0118] In some embodiments, the seat allocation method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the seat allocation method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the seat allocation method in any other appropriate manner (e.g., by means of firmware).

[0119] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0120] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general purpose computer, a special purpose computer or other programmable seat allocation device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0121] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0122] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0123] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0124] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0125] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0126] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A seat allocation method, It is characterized in that include: When passengers start to queue up to board the bus, a video frame sequence including facial image information of the passengers collected by the image collector is obtained; Analyzing the emotional state of each passenger based on the video frame sequence including the passenger's facial image information to obtain the emotional activity and emotional fluctuation of each passenger; Allocate the best seat to each passenger according to the emotional activity and emotional volatility of each passenger, and obtain a seat allocation result; According to the seat allocation result, each passenger is prompted to sit at the corresponding best seat.

2. The method according to claim 1, It is characterized in that The analyzing the emotional state of each passenger based on the video frame sequence including the passenger's facial image information to obtain the emotional activity of each passenger includes: Performing face detection on each video frame in the video frame sequence to determine the face area of ​​each passenger in each video frame; In each of the face regions, determining facial key points and pixel positions of the facial key points; The emotional activity of each passenger is determined according to the changes of facial key points of each passenger between adjacent video frames.

3. The method according to claim 2, It is characterized in that Determining the emotional activity of each passenger according to the changes of facial key points of each passenger between adjacent video frames includes: For any facial key point of any of the passengers, determine the pixel distance of the facial key point between any two adjacent video frames according to the pixel position of the facial key point in different video frames; The determined pixel distances are averaged, and the obtained pixel distance average is used as the emotional activity of the passenger.

4. The method according to claim 1, It is characterized in that The step of analyzing the emotional state of each passenger based on the video frame sequence including the passenger's facial image information to obtain the emotional fluctuation degree of each passenger includes: Performing face detection on each video frame in the video frame sequence to determine the face area of ​​each passenger in each video frame; In each of the face regions, determining facial key points and pixel positions of the facial key points; For any of the passengers, the degree of emotional fluctuation of the passenger is determined based on the pixel positions of the passenger's facial key points in the video frame sequence and the default pixel positions of the facial key points; wherein the default pixel positions of the facial key points refer to the pixel positions of the facial key points when the passenger is in a stable emotional state.

5. The method according to claim 4, It is characterized in that For any of the passengers, determining the passenger's emotional fluctuation degree according to the pixel positions of the passenger's facial key points in the video frame sequence and the default pixel positions of the facial key points includes: For any facial key point of any of the passengers, determine the pixel distance according to the pixel position of the facial key point in each video frame and the default pixel position of the facial key point; In response to the pixel distance being greater than a pixel distance threshold associated with the facial keypoint, determining a distance difference; The obtained distance differences are accumulated, and the accumulated result is used as the emotion fluctuation degree.

6. The method according to claim 1, It is characterized in that The step of allocating the best seat to each passenger according to the emotional activity and emotional fluctuation of each passenger comprises: Determine the orientation attribute and area attribute of the best seat for each passenger according to the emotional activity and emotional fluctuation of each passenger; wherein the orientation attribute includes an outer position and an inner position; and the area attribute includes a front row area, a middle area, and a back row area; According to the orientation attribute and the area attribute, the best seat is selected for the passenger from the remaining seats in the vehicle.

7. The method according to claim 6, It is characterized in that Determining the orientation attribute and area attribute of the best seat for each passenger according to the emotional activity and emotional fluctuation of each passenger includes: In response to the emotional activity being greater than or equal to a preset activity threshold, determining that the orientation attribute of the best seat for the passenger is the outer seat; In response to the emotional activity being less than a preset activity threshold, determining that the best seat orientation attribute for the passenger is the inner seat; In response to the emotion fluctuation being greater than a preset first fluctuation threshold, determining that the area attribute of the best seat for the passenger is the front row area; In response to the emotion fluctuation being less than a preset second fluctuation threshold, determining that the area attribute of the best seat for the passenger is the back row area; In response to the emotion fluctuation being between the second fluctuation threshold and the first fluctuation threshold, determining the zone attribute of the best seat for the passenger to be the middle zone.

8. A seat allocation device, It is characterized in that include: A video frame acquisition module, used to acquire a video frame sequence including facial image information of the passenger acquired by the image collector when the passenger starts to queue up to board the bus; An emotion analysis module, used to analyze the emotional state of each passenger based on a video frame sequence including facial image information of the passenger, and obtain the emotional activity and emotional fluctuation of each passenger; A seat allocation module, used to allocate the best seat to each passenger according to the emotional activity and emotional fluctuation of each passenger, and obtain a seat allocation result; The prompting module is used to prompt each passenger to sit at the corresponding best seat according to the seat allocation result.

9. An electronic device, It is characterized in that include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the method according to any one of claims 1 to 7 when executed.