86 results about "Face orientation" patented technology

The invention provides a three-dimensional picture display method and system based on indoor space positioning, and the method comprises the steps: obtaining a plurality of head position pixel coordinates through a first camera, and obtaining a plurality of face position pixel coordinates through a second camera; performing coordinate matching according to matrix parameters, each head position pixel coordinate, each face position pixel coordinate and face orientation information, and generating position information of the target user; converting the position information into a preset Cartesian coordinate system, and generating corresponding coordinate conversion position information; generating an optimal viewpoint position of the target user through a preset positioning server according to the coordinate conversion position information; generating an initial three-dimensional picture through a three-dimensional rendering engine according to the coordinate conversion position information; and adjusting the initial three-dimensional picture according to the optimal viewpoint position and the coordinate conversion position information, generating a final three-dimensional picture and displaying the final three-dimensional picture, thereby improving the visual experience and interaction effect of a user.

An information processing method includes: by using a processor, acquiring at least one index selected from an index group that includes an amount of variation in a face position of a user, an amount of variation in a face orientation of the user, an amount of variation in a gaze direction of the user, and an eye closure percentage of the user, and determining, based on the at least one acquired index, whether or not the user is in a divergent thinking state.

The invention provides an immersive projection man-machine interaction method and system, and the method comprises the steps: constructing a closed projection space which comprises a plurality of walls, a bottom surface and a top, deploying a main image collection device at the center of the top, achieving the positioning of the head space of a user, and arranging auxiliary image collection devices at a plurality of corners of the combination part of the adjacent walls. Based on the real-time image data acquired by the main device, the intelligent recognition technology is adopted to analyze the three-dimensional coordinates of the center of the head circle of the user, the face orientation angle is calculated in combination with the facial feature data acquired by the auxiliary device, and the dynamic mapping model of the user interaction intention is determined by fusing the space coordinates and the orientation angle. According to the method, a main-auxiliary cooperative visual positioning framework is adopted, space perception limitation under a single visual angle is avoided, two-dimensional real-time tracking of a user position and a sight line direction is realized, an accurately matched interactive animation is generated at a corresponding position of a projection space according to a dynamic analysis result, and the user experience is improved. And the real-time response capability and behavior intention capture accuracy of human-computer interaction in an immersive environment are improved.

The invention discloses a multi-camera-position-based face information acquisition method and device, equipment and a medium, and relates to the field of face recognition, and the method comprises the steps: collecting a fixed-focus picture image through a fixed-focus camera, and recognizing a head region and a face region in the fixed-focus picture image; determining the overlapping degree of the head area and the face area, and judging whether the overlapping degree meets a first preset condition or not; if the overlapping degree meets a first preset condition, determining head posture information in the head region, so as to determine a current face orientation based on the head posture information, and judging whether the current face orientation meets a second preset condition or not; and if the current face orientation meets a second preset condition, executing a zoom operation through the zoom camera so as to amplify a face picture in the head area and collect a corresponding first zoom picture image, and obtaining corresponding face information from the first zoom picture image.

The invention discloses a mobile phone playing behavior judgment method based on mobile phone target detection and head posture analysis, and belongs to the technical field of computer vision and behavior recognition. In order to solve the problems that the false detection rate is high and the use intention of a mobile phone cannot be distinguished due to dependence on single target detection in the prior art, the invention provides a solution for fusing correlation analysis of a head posture and a mobile phone position. The method comprises the following steps: acquiring images in real time through a camera, detecting and tracking personnel by utilizing a YOLOv5 model, and positioning a mobile phone area and a human face sub-image in a personnel detection frame; estimating a head posture angle (a yaw angle and a pitch angle) based on the face key points, and calculating an included angle between a face orientation direction and a mobile phone center connecting line; and setting a dynamic threshold value, and judging whether to play the mobile phone or not by combining multi-frame time sequence verification. The method significantly reduces the false drop rate, is suitable for ships, industry, education and other scenes, and is high in expandability. By quantifying the behavior intention and efficient model deployment, the accuracy and real-time performance of safety supervision are effectively improved.

The invention relates to the field of vehicle control, and particularly discloses a vehicle control method and device and a vehicle, and the method comprises the steps: obtaining an ultra-wideband pulse signal sent by a target head-mounted device and inertial measurement unit data in response to the detection that the target head-mounted device is in a wearing state; based on the ultra-wideband pulse signal and inertial measurement unit data, face position information of the user is determined, and the face position information comprises a head three-dimensional coordinate, a face orientation and a pitching angle; and based on the face position information, generating a control instruction to adjust at least one controllable device in the vehicle. Through the multi-source data of the target head-mounted device, the accuracy of the face position information is ensured, so that the accuracy and the response speed of the control instruction are improved. And the vehicle equipment is intelligently controlled based on the face position information, so that the operation convenience and the driving experience of the user are improved.

This face orientation estimation device comprises: an image acquisition unit (11) that acquires a face image of an occupant of a vehicle; a feature point detection unit (12) that detects a plurality of facial feature points including eyes, nose, and mouth from the face image; an attribute estimation unit (14) that estimates a skeletal attribute of the occupant on the basis of the face image; a three-dimensional model selection unit (15) that, on the basis of the skeletal attribute of the occupant, selects an estimation three-dimensional model from among a plurality of three-dimensional models representing human faces that correspond to different skeletal attributes; a face orientation estimation unit (16) that estimates the face orientation of the occupant on the basis of the plurality of facial feature points detected by the feature point detection unit (12) and the estimation three-dimensional model selected by the three-dimensional model selection unit (15); and a three-dimensional model adjustment unit (17) that, on the basis of a face orientation estimation result relating to the face orientation of the occupant estimated by the face orientation estimation unit (16) and information about the plurality of facial feature points detected by the feature point detection unit (12), adjusts the positions of the model facial feature points in the estimation three-dimensional model that correspond to the facial feature points.

An information processing apparatus includes: a distance measuring sensor which measures a distance to an object; a memory which temporarily stores distance information indicative of the distance measured by the distance measuring sensor; and a processor which executes processing based on the distance information. The processor performs person detection processing to detect a person present within a first distance range using the distance measuring sensor, and face direction determination processing to determine a face orientation of the person when the person is detected within the first distance range by the person detection processing. In the face direction determination processing, when the person detected by the person detection processing is within a second distance range closer than the first distance range, the processor determines a face orientation of the person using the distance measuring sensor.

There is provided a method for providing a target position for a robotic speaker in an environment. The method includes receiving sensor information from one or more sensors related to the environment, obtaining at least one of initiation gesture information, position information, and face direction information based on the sensor information, the face direction information related to one or more users present in the environment, obtaining the target position of the robotic speaker in the environment by performing a calibration process based on the at least one of initiation gesture information, position information, or face direction information and one or more and acoustic properties of the environment, and positioning the robotic speaker at the target position.

The invention relates to the field of online learning monitoring, and discloses an online learning attention monitoring method based on real-time multi-modal feature fusion, and the method comprises the following steps: S1, starting a camera to collect a facial image of a student; s2, calculating the distance from the face of the student to the screen; s3, resolving a horizontal eyeball staring vector, a longitudinal eyeball staring vector and an eye opening and closing degree; s4, resolving to obtain a final horizontal eyeball staring vector and a final longitudinal eyeball staring vector; s5, obtaining a lecture attending state index based on a resolving result; and S6, according to the class attending state index, giving a prompt and a praise, and recording. According to the invention, the eye movement tracking and face orientation technology is combined, the eyeball staring vector and the face orientation vector are calculated, and the attention state of the student is accurately monitored. The attention change is objectively evaluated in real time, compared with traditional questionnaires or subjective evaluation, the problem of lack of objectivity and real-time performance is solved, the attention of students is timely fed back, and the learning effect is improved.

The invention provides a display method and device, equipment, a storage medium and a program product. The method comprises the steps that the current face orientation of a first object in the real world is determined; determining a current watching coordinate of the first object in a pre-constructed digital twin world; acquiring a first image from the digital twin world according to the current face orientation and the current viewing coordinate; the first image comprises environment information shielded by a first object watched by the first object in the real world; and displaying the first image as a background of the main body element while displaying the preset main body element through the display surface.

Methods and devices for performing face swapping in images are disclosed. The method includes acquiring a destination and source image; detecting an individual's face in both images by generating a first bounding box with a set of pixels representing the face in the destination image and a second bounding box with a set of pixels representing the face in the source image. The method compares the face orientations between the two images. If the orientation difference exceeds a threshold, an enlarged first bounding box and second bounding box are generated, containing enlarged sets of pixels. A modified image is then generated based on the destination image and the enlarged pixels from the source image. The modified image is then displayed on a device.

The present application provides a voice wake-up method and an electronic device, which relates to the field of terminal artificial intelligence. Among them, the method includes: by using the ambient sounds collected by each device, on the one hand, the relative positions of the user and multiple devices in space can be located to construct a position map; on the other hand, the main device with an image acquisition module among the multiple devices can be used to collect the face orientation of the user. In this way, by combining the position map and the face orientation of the user collected by the main device, the device that the user wants to wake up can be determined. This method helps to improve the accuracy of device wake-up in a multi-device scenario, and the application effect is relatively good.

An information presentation method includes: an information collection step (S12) for collecting at least one of information relating to at least one of a face orientation and a line-of-sight orientation of a subject (99) and information relating to a posture of the subject (99); an action analysis step (S12) for analyzing the action of the subject (99) on the basis of the collected information; a presentation image determination step (S15) for determining a presentation image for presenting to the subject (99) on the basis of the analysis result of the operation, the presentation image being an image acquired from a camera (20) provided at a position different from the viewpoint of the subject (99) and being an image having a range selected from within the range that can be captured by the camera (20); and a presentation step (S17) for presenting the determined presentation image to the subject (99) via a display device (60).

The invention relates to the technical field of education informatization, and discloses a classroom teaching quality evaluation method and system based on big data, and the method comprises the steps: obtaining the eye watching orientation information of a student, the face direction information of the student, the classroom problem information and the total classroom number; obtaining a concentration degree parameter according to the eye gazing azimuth information and the face direction information; according to the concentration degree parameter, a particle swarm optimization algorithm is adopted for optimization to obtain an optimal concentration degree coefficient; training by adopting a random forest algorithm according to the classroom question information to obtain a correct rate coefficient and a question proportion coefficient; according to the correct rate coefficient and the problem proportion coefficient, calculating to obtain a normalized correct rate coefficient and a normalized problem proportion coefficient; according to the total classroom number, the optimal concentration degree coefficient, the classroom problem information, the normalized correct rate coefficient and the problem proportion coefficient, classroom quality evaluation parameters are obtained through calculation; and finally, matching with a preset evaluation threshold parameter to obtain a classroom teaching quality evaluation result. According to the method, the classroom teaching quality can be correctly evaluated.

An information processing apparatus includes: a first chassis; a second chassis; a hinge coupling the first chassis and the second chassis to bend in a direction facing a first surface of the first chassis and a second surface of the second chassis while the first surface and the second surface are open; a sensor detecting orientations of the first chassis and the second chassis; an imaging unit provided on either one of the first surface and the second surface; a first processor controlling the operating state of a system by executing a program of the system; a second processor detecting a face and an orientation of the face from an image captured by the imaging unit; and a third processor controlling the operating state of the system based on the detected orientations of the first chassis and the second chassis and the orientation of the face.

The invention provides a three-dimensional head model reconstruction method based on a single-visual-angle face image, and relates to the field of three-dimensional head model reconstruction, and the method specifically comprises the following steps: obtaining a single-visual-angle input front face image of a person to be reconstructed, and employing a posture estimation model to estimate a camera posture parameter of the front face orientation in the input image; according to the front face image and the camera pose parameter corresponding to the front face image, estimating images of the head at other angles by adopting a three-dimensional diffusion model; a three-dimensional generative adversarial network is adopted to decode and represent potential vectors of the head model, and the front face image, the images at other angles and corresponding camera parameters are used as supervised iterative optimization potential vectors; and rendering a three-dimensional head image at any angle based on the optimized potential vector, and extracting a corresponding three-dimensional head geometric model. According to the technical scheme, the problem that in the prior art, a high-quality three-dimensional head model which keeps space consistency at any angle cannot be generated only by using a single-view-angle picture as input is solved.

An information processing apparatus includes: a distance measuring sensor which measures a distance to an object; a memory which temporarily stores distance information indicative of the distance measured by the distance measuring sensor; and a processor which executes processing based on the distance information. The processor performs person detection processing to detect a person present within a first distance range using the distance measuring sensor, and face direction determination processing to determine a face orientation of the person when the person is detected within the first distance range by the person detection processing. In the face direction determination processing, when the person detected by the person detection processing is within a second distance range closer than the first distance range, the processor determines a face orientation of the person using the distance measuring sensor.

The invention provides an image processing method and related equipment, relates to the field of artificial intelligence, and is used for controlling details of a human face in an image when a portrait customization task is executed so as to meet the requirement of a user for customization of the details of the human face. In the method, a first device obtains a first image and a second image, the first image comprises a first face, the second image is an image of a 3D face model with target attributes, and the target attributes comprise shadow, face expression or face orientation; the first device obtains an encoding result through an encoder according to the first image and the second image, and the encoding result is fused with features of the first image and the second image; the first device obtains a third image through a generation model according to the coding result, the third image comprises a second face with the target attribute, and the second face and the first face correspond to the same person.

The embodiment of the invention relates to a touch coordinate recognition method and device, terminal equipment and a storage medium, the method can be applied to the terminal equipment, the method comprises the steps that a first image and a second image are acquired, the first image comprises hand image content, and the second image comprises face image content; fingertip coordinate identification is carried out on the first image, and a touch coordinate corresponding to a fingertip is obtained; face recognition is carried out on the second image to obtain a face recognition result, and the face recognition result is used for representing the face orientation; and if it is determined that the face faces the screen of the terminal device, not responding to the touch coordinates. According to the touch coordinate recognition method and device, the terminal equipment and the storage medium, the situation that the terminal equipment responds to the mistaken touch operation of the user can be reduced, and the mistaken touch prevention capacity of the terminal equipment is improved.

An image processing method, an image processing device, and a storage medium. The image processing method includes: obtaining facial key points and a face orientation of a face in an input image; obtaining a nose bridge line of the face based on the facial key points; obtaining at least one adjusted nose bridge line based on the face orientation and the nose bridge line; and performing a deformation process on the face in the input image according to the nose bridge line before adjustment and the at least one adjusted nose bridge line to achieve nose augmentation. The image processing method can achieve the effect of nose augmentation and beauty for the face in the image.

An information processing apparatus includes: a memory which temporarily stores image data of an image captured by an imaging unit; and a processor which processes the image data stored in the memory. The processor performs: face detection processing to process the image data of the image stored in the memory in order to detect a face area with a face captured therein and an orientation of the face from the image, and brightness control processing to control screen brightness of a display unit based on the orientation of the face detected by the face detection processing.

The present application provides a line-of-sight calibration system that improves the accuracy of line-of-sight calibration in a wide area including a region deviating from the optical axis of a camera. The present application is provided with: a first display portion provided at the central portion in the vehicle width direction in front of the driver's seat, a second display portion provided on the front face of the driver's seat, a camera portion provided on the outer edge upper portion of the first display portion, a display image control portion that controls the display image displayed by the first display portion and the second display portion, a calibration data generation portion that detects the face orientation and line-of-sight direction when the driver D visually recognizes the first display portion and the face orientation and line-of-sight direction when the driver D visually recognizes the second display portion based on the image captured by the camera portion and generates calibration data, and a calibration portion that calibrates the line-of-sight direction corresponding to the face orientation that becomes the reference in the case of visually recognizing the first display portion and the line-of-sight direction corresponding to the face orientation that becomes the reference in the case of visually recognizing the second display portion based on the calibration data generated.

The application provides a personnel mobile phone playing behavior detection method and device in a bright kitchen and bright stove scene, and belongs to the technical field of machine vision, the method comprises the following steps: detecting human body key points and target objects in a single frame image; based on the human body skeleton joint point information and the target object information, the distance between the face and the target object, the similarity of the human body posture and the target posture, and the deviation degree between the face orientation and the target object are determined; based on the distance, the similarity and the deviation degree, it is determined whether the personnel behavior is a mobile phone playing behavior. The application detects human body key points and target objects based on a single frame image, improves the system running efficiency, determines whether the personnel behavior is a mobile phone playing behavior by combining the distance, the similarity and the deviation degree, solves the problems of poor generalization performance and poor robustness, detects human body key points, and improves the recognition accuracy of situations such as crouching and side face.

A driver state detection device includes: a recognizer configured to recognize at least one of a gaze and a face direction of a driver of a mobile object; a determiner configured to determine whether a monitoring direction of the driver is appropriate on the basis of a result of recognition from the recognizer; and a lighting controller configured to perform lighting control of a direction indicator of the mobile object according to the driver's operation of an operator for lighting the direction indicator and to perform control such that lighting is maintained even when the operator returns to a neutral position. The determiner makes it more difficult to determine that the monitoring direction of the driver is not appropriate in comparison with before the operator is operated until the operator returns to the neutral position and a predetermined condition is satisfied.

The invention discloses an image generation method and device, a medium and equipment, and relates to the technical field of artificial intelligence, and the method comprises the steps: obtaining an original object image, a target face orientation feature and a target image indication text; determining a first image feature and a second image feature corresponding to the original object image and an indication text feature corresponding to the target image indication text; fusing the first image feature, the second image feature and the indication text feature to obtain a first fusion feature; fusing the target face orientation feature and the second image feature to obtain a second fusion feature; and inputting the first fusion feature and the second fusion feature into an image generation model, so that the image generation model performs image generation processing by taking the first fusion feature and the second fusion feature as control conditions to obtain a target object image corresponding to the target object. According to the invention, the image with the specified emotion and face orientation can be generated according to the image generation demand, and the personalized expression of the image is enriched.

A search system and the like is capable of accurately retrieving a captured image of a hairstyle specified by a user. The search system includes: a head region extraction unit that extracts a head region of a person from a captured image; an orientation estimation unit that estimates a face orientation of the person from the head region; a mask image generation unit that generates a mask image in which a hair region and a remaining region in the head region are distinguished from each other; a hairstyle identification unit that identifies a hairstyle of the person from the mask image using a result of the estimation of the face orientation; an operation accepting unit that accepts an operation of specifying a hairstyle by a user; and a captured image extraction unit that extracts a captured image based on the hairstyle specified in the operation and the identified hairstyle.

An occupant state determination device (1) of the present disclosure includes a face detection unit (12), a feature detection unit (13), a reference posture estimation unit (14), a region determination unit (151) that performs region determination as to whether at least one of a face orientation and a head position of the occupant or a displacement amount of the at least one of the face orientation and the head position of the occupant from a reference posture is one of a first region, a second region, and a third region set in a real space, a posture collapse determination unit (152) that performs posture collapse type determination, a face change degree detection unit (153) that detects a change degree of the occupant's face, an error detection determination unit (154),which determines whether the posture of the occupant is a posture collapse type based on the detection result of the facial change degree detection unit (153), and a problem posture determination unit (155) which determines whether a problem posture of the driver exists based on at least one of the area determination result, the posture collapse type determination result, and the detection error determination result.

The application discloses an automatic calibration method and device, a vehicle, a medium, equipment and a program product, and belongs to the field of data processing. The method comprises the following steps: converting the position coordinates of the nose tip point and the pupil center point of a face in a camera coordinate system into the coordinates of the nose tip point and the pupil center point of the face in an image coordinate, establishing a corresponding face orientation coordinate system and a line of sight orientation coordinate system, and obtaining a second face orientation and a second line of sight orientation in the corresponding coordinate system; and calibrating at least one of a face reference orientation and a line of sight reference orientation in the camera coordinate system by using at least one of a first face orientation and a first line of sight orientation of a predetermined number of frames of images and at least one of a second face orientation and a second line of sight orientation corresponding to the first face orientation and the first line of sight orientation. The application can achieve the purpose of automatically calibrating a driver at the initial stage of starting the vehicle, improve calibration efficiency, and calibrate a suitable coordinate system for different drivers.

This visual target estimation device comprises an angle acquisition unit that, on the basis of face image data obtained by capturing images of the face of the driver of a vehicle using a camera, acquires at least two angles from among a first face orientation angle based on the face orientation when facing the camera, a second face orientation angle based on the face orientation when facing a prescribed direction other than the camera, a first gaze angle based on the gaze when facing the camera, and a second gaze angle based on the gaze when facing the prescribed direction other than the camera, and an estimation unit. The estimation unit estimates the driver's visual target on the basis of at least: a first probability distribution and a second probability distribution which indicate the probability of the driver gazing at each of a plurality of prescribed visual targets for each first face orientation angle and each second face orientation angle, respectively; a third probability distribution and a fourth probability distribution which indicate the gaze probability for each first gaze angle and each second gaze angle, respectively; or a first probability coefficient calculated based on the first or second probability distribution and a second probability coefficient calculated based on the third or fourth probability distribution.