Video device control method and control apparatus
By sensing user status information and generating control policies, the video equipment is automatically controlled, and the cumbersome problems of users needing manual operations in the prior art are solved, which improves the user experience.
Patent Information
- Application Number
- PCT/CN2024/087997
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-12
- Filing Date
- 2024-04-16
- Publication Date
- 2024-11-21
AI Technical Summary
In the prior art, users need to manually operate mobile video devices to control other video devices in the Internet of Things platform, which is complicated and inconvenient to users.
By sensing the user's current status information, a corresponding control policy is obtained, and the current status of the video device is controlled according to the policy, remote or close-range control is realized without manual operation.
It greatly improves the user experience, simplifies the control process of video equipment, and reduces operational complexity.
Smart Images

Figure CN2024087997_21112024_PF_FP_ABST
Abstract
Description
Video equipment control method and control device Technical Field
[0001] The present disclosure belongs to the field of computer technology, and particularly relates to a control method and a control device for a video device. Background Art
[0002] With the widespread adoption of IoT technology, various IoT video devices are connected to IoT platforms. Users can use their mobile video devices to control other devices on the IoT platform and access data transmitted by these devices. However, connecting to the IoT platform and controlling IoT devices through mobile video devices requires manual operation, which is cumbersome and inconvenient.
[0003] Summary of the Invention
[0004] The present disclosure aims to solve at least one of the technical problems existing in the prior art, and provides a control method and a control device for a video device.
[0005] In a first aspect, an embodiment of the present disclosure provides a method for controlling a video device, wherein the method for controlling a video device includes:
[0006] Using the first user device, sensing current status information of the user;
[0007] Obtaining a corresponding control strategy based on the current status information of the user;
[0008] According to the control strategy, the current state of the video device is controlled.
[0009] Optionally, the step of controlling the current state of the video device according to the control strategy further includes:
[0010] Using the video device, obtaining a current image around the video device;
[0011] Processing a current image around the video device to generate a display image;
[0012] The display image is displayed using the first user device or the second user device.
[0013] Optionally, using the first user device to sense the current status information of the user, the method further includes:
[0014] Using the video device, acquiring an initial image around the video device;
[0015] determining an initial state of the video device according to an initial image surrounding the video device;
[0016] Using the first user equipment, sensing initial state information of the user;
[0017] A corresponding control strategy is determined according to the initial state of the video device and the initial state information of the user.
[0018] Optionally, before the using the video device to obtain an initial image around the video device, the method further includes:
[0019] registering the first user device, the second user device, and the video device to a server;
[0020] The server is used to establish a connection between the first user device, the second user device, and the video device.
[0021] Optionally, processing the image around the video device to generate a display image includes:
[0022] Acquire video frame data of images around the video device;
[0023] Matching at least one three-dimensional model according to the video frame data;
[0024] outputting at least one three-dimensional image based on the three-dimensional model;
[0025] Sampling the at least one three-dimensional image and outputting a plurality of sampled three-dimensional images;
[0026] Performing cloud rendering on the multiple sampled three-dimensional images and outputting cloud rendering results;
[0027] The cloud rendering result, the video frame data, and the three-dimensional image are fused and calculated to output an extended reality display image.
[0028] Optionally, the video frame data includes: video frame rate and video frame size.
[0029] Optionally, when the number of the video device is one and the number of lenses of the video device is multiple, controlling the current state of the video device according to the control strategy includes:
[0030] Dividing the user's status information into a plurality of status intervals according to the number of the lenses in the video device;
[0031] Dividing the control strategy into corresponding multiple control intervals according to the multiple state intervals;
[0032] According to the multiple control intervals, the current states of the corresponding multiple lenses are controlled respectively.
[0033] Optionally, when there are multiple video devices and each of the video devices has one lens, controlling the current state of the video device according to the control strategy includes:
[0034] Dividing the user's status information into a plurality of status intervals according to the number of the video devices;
[0035] Dividing the control strategy into corresponding multiple control intervals according to the multiple state intervals;
[0036] According to the multiple control intervals, the current states of the lenses in the corresponding multiple video devices are controlled respectively.
[0037] Optionally, both the first user equipment and the second user equipment include: an extended reality display device, and the display area of the second user equipment is larger than the display area of the first user equipment.
[0038] Optionally, the user's status information includes: head turning angle, head turning speed, head raising / lowering angle, head raising / lowering speed, pupil distance, and pupil size;
[0039] The state of the video device includes: a first rotation angle, a first rotation speed, a second rotation angle, a second rotation speed, a focal length, and a magnification of a lens of the video device;
[0040] The first rotation angle and the second rotation angle are respectively the rotation angle and rotation speed of the lens in the first direction; the second rotation angle and the second rotation speed are respectively the rotation angle and rotation speed of the lens in the second direction; the first direction is the same as the direction in which the user turns his head, and the second direction is the same as the direction in which the user raises / lowers his head.
[0041] Optionally, the displaying the display image by using the first user device or the second user device further includes:
[0042] The control strategy is adjusted according to the current state of the video device and the current state information of the user.
[0043] In a second aspect, an embodiment of the present disclosure provides a control device for a video device, wherein the control device for the video device includes:
[0044] a sensing module configured to sense current status information of a user using the first user device;
[0045] A first acquisition module is configured to acquire a corresponding control strategy according to the current state information of the user;
[0046] The control module is configured to control the current state of the video device according to the control strategy.
[0047] Optionally, the control device of the video device further includes:
[0048] A second acquisition module is configured to acquire a current image around the video device using the video device;
[0049] a display image generating module configured to process a current image around the video device to generate a display image;
[0050] The display module is configured to display the display image using the first user device or the second user device.
[0051] In a third aspect, an embodiment of the present disclosure provides an electronic device, comprising:
[0052] at least one processor; and
[0053] a memory communicatively connected to the at least one processor; wherein,
[0054] The memory stores one or more computer programs that can be executed by the at least one processor, and the one or more computer programs are executed by the at least one processor to enable the at least one processor to perform the control method of the video device provided above.
[0055] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which implements the control method of the video device provided above when executed by a processor. BRIEF DESCRIPTION OF THE DRAWINGS
[0056] FIG1 is a schematic diagram of a scenario of an exemplary method for controlling a video device.
[0057] FIG2 is a flow chart of a method for controlling a video device according to an embodiment of the present disclosure.
[0058] FIG3 is a flow chart of another method for controlling a video device provided by an embodiment of the present disclosure.
[0059] FIG4 is a flow chart of another method for controlling a video device provided by an embodiment of the present disclosure.
[0060] FIG5 is a flow chart of another method for controlling a video device provided in an embodiment of the present disclosure.
[0061] FIG6 a is an application scenario of the first method for controlling a video device provided by an embodiment of the present disclosure.
[0062] FIG6 b is an application scenario of the second method for controlling a video device provided by an embodiment of the present disclosure.
[0063] FIG7 is an application scenario of the third method for controlling a video device provided by an embodiment of the present disclosure.
[0064] FIG8 is an application scenario of the fourth method for controlling a video device provided by an embodiment of the present disclosure.
[0065] FIG9 is an application scenario of the fifth method for controlling a video device provided by an embodiment of the present disclosure.
[0066] FIG10 is an application scenario of the sixth method for controlling a video device provided by an embodiment of the present disclosure.
[0067] FIG11 is a schematic structural diagram of a control device for a video device provided by an embodiment of the present disclosure.
[0068] FIG12 is a schematic structural diagram of an electronic device provided in some embodiments of the present disclosure. DETAILED DESCRIPTION
[0069] In order to enable those skilled in the art to better understand the technical solutions of the present disclosure, the present disclosure is further described in detail below with reference to the accompanying drawings and specific implementation methods.
[0070] Unless otherwise defined, the technical or scientific terms used in this disclosure should have the usual meanings understood by people with ordinary skills in the field to which this disclosure belongs. The words "first", "second" and similar words used in this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, words such as "one", "an" or "the" do not indicate a quantity limitation, but rather indicate the existence of at least one. Words such as "include" or "comprise" mean that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Words such as "connect" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the object being described changes, the relative positional relationship may also change accordingly.
[0071] It should be noted that in the subsequent description of the embodiments of this disclosure, the video device may be an in-vehicle video device, specifically a driving recorder with multi-angle adjustment capabilities. Users can remotely connect to and control the in-vehicle video device through an extended reality display device and obtain real-time data from the in-vehicle video device, achieving the same visual experience as the driver or co-pilot.
[0072] On the other hand, the on-board video equipment can also upload real-time vehicle data to the server, such as vibration, speed, acceleration, wind speed and other information, and feed the above real-time data back to the extended reality display device so that users can understand the status of the vehicle in real time.
[0073] Of course, the video device can also be a video device for drones, specifically a drone camera, which also has the function of multi-angle adjustment. It is understandable that the video device can also be a device for other scenes, which will not be listed one by one.
[0074] FIG1 is a schematic diagram of a scenario of an exemplary method for controlling a video device. As shown in FIG1 , multiple video devices are connected to a server of an Internet of Things platform, wherein a mobile terminal device can serve as a user's control terminal device. Specifically, the mobile terminal device can be a mobile phone, a tablet computer, a smart wearable device, etc. Terminal device 1, terminal device 2, and terminal device 3 establish a connection with the mobile terminal device through the server and perform various actions under the instructions sent by the mobile terminal device. Terminal device 1, terminal device 2, and terminal device 3 can be devices of the same type, for example, all three are video devices, or terminal device 1 can be a video device, terminal device 2 can be an audio device, and terminal device 3 can be an air conditioning device. It is understandable that the types of the various terminal devices are not limited to the above types, and can also be other types of devices, which are not listed here one by one.
[0075] For example, if terminal devices 1, 2, and 3 are all video devices, when a user needs to control the lens rotation or focal length of one of the video devices, they need to swipe on the screen of a mobile terminal device such as a mobile phone, or enter relevant text or voice. The entire control process requires manual operation, which is particularly cumbersome for users who are not familiar with mobile terminal devices such as mobile phones, causing considerable inconvenience and affecting the user experience.
[0076] In order to solve at least one of the above technical problems, the embodiment of the present disclosure provides a control method and control device for a video device. The control method and control device for the video device provided by the embodiment of the present disclosure will be further described in detail below in conjunction with the accompanying drawings and specific implementation methods.
[0077] In a first aspect, an embodiment of the present disclosure provides a method for controlling a video device. FIG2 is a flow chart of the method for controlling a video device provided by an embodiment of the present disclosure. As shown in FIG2 , the method for controlling a video device includes the following steps S201 to S203 .
[0078] S201: Utilize a first user device to sense current status information of a user.
[0079] In the above step S201, the first user device can be used as a control end device. The first user device is provided with a sensor, which has a sensing function and can sense the user's status information in real time, such as the user's head turning angle, head turning speed, head raising / lowering angle, head raising / lowering speed, pupil distance, pupil size and other information.
[0080] S202: Obtain a corresponding control strategy based on the user's current status information.
[0081] In the above step S202, a mapping relationship can be established between the user's current status information and the status of the video device, and stored in advance to form a control strategy. For example, the user's head turning angle is the same as the horizontal rotation angle of the video device, the user's head turning speed is the same as the horizontal rotation speed of the video device, the user's head raising / lowering angle is the same as the vertical rotation angle of the video device, and the user's head raising / lowering speed is the same as the vertical rotation speed of the video device. It can be understood that the setting of the control strategy is related to the user status that can be recognized by the first user device, and is not limited to the above-mentioned various states. It should be noted that the above-mentioned various mapping relationships are only used as a specific example, and the user's status information parameters and the video device status parameters can also be different, and the two have a certain positive correlation.
[0082] S203: Control the current state of the video device according to the control strategy.
[0083] In step S203, a table lookup can be used to select a control strategy corresponding to the user's current status information to control the video device to perform corresponding actions, thereby achieving control of the video device. It should be noted that the control process here can be a close-range control process within the same local area network or a remote control process.
[0084] In the control method of the video device provided by the embodiment of the present disclosure, the user only needs to complete the corresponding action as needed. The first user device can actively sense the status information of the user when completing the corresponding action, and control the status of the video device according to the control strategy corresponding to the pre-stored user status information and the status of the video device. During the entire control process, the user does not need to perform manual operations, and does not need to actively slide or input text, voice, etc., which facilitates the user to perform close or remote control of the video device in the Internet of Things platform, thereby greatly improving the user experience.
[0085] FIG3 is a flow chart of another method for controlling a video device provided by an embodiment of the present disclosure. As shown in FIG3 , in step S203 , the current state of the video device is controlled according to the control strategy, and then the following steps S204 to S206 are included.
[0086] Step S204: using the video device to obtain a current image around the video device.
[0087] In the above step S204, the video device has an image acquisition function and can acquire images of the environment surrounding the video device.
[0088] Step S205: Process the current image around the video device to generate a display image.
[0089] In the above step S205, the specifications and parameters of the image around the video device may not necessarily meet the display requirements in the first user device or the second user device. For example, the image around the video device is a flat image, and the display requirement in the first user device or the second user device is a three-dimensional image. The image needs to be processed so that the displayed information meets the display requirements of the first user device or the second user device.
[0090] Step S206: Display the display image using the first user device or the second user device.
[0091] In the above step S206, both the first user device and the second user device can be extended reality (XR) display devices, such as virtual reality (VR) display devices, augmented reality (AR) display devices or mixed reality (MR) display devices, and can display images around the video device according to the display information. The display area of the second user device is larger than the display panel of the first user device. The smaller display area of the first user device can only be displayed to the user personally, and the larger display area of the second user device can be displayed to multiple people, which can further improve the user experience.
[0092] FIG4 is a flow chart of another method for controlling a video device provided by an embodiment of the present disclosure. As shown in FIG4 , in step S201 , the current status information of the user is sensed by using the first user device, which also includes the following steps S401 to S404 .
[0093] S401: Using a video device, obtain an initial image around the video device.
[0094] In the above step S401, the video device has an image acquisition function and can acquire an image of the environment surrounding the video device. Before the first user device is used to control the video device, the image acquired by the video device can be defined as an initial image.
[0095] S402: Determine the initial state of the video device according to the initial image around the video device.
[0096] In step S402, the state of the video device corresponding to the initial image, before the first user device is used to control the video device, can be defined as an initial state. The initial state of the video device can be that the horizontal and vertical rotation angles of the lens are 0 degrees and the device is in a stationary state. Furthermore, the focal length and magnification are at their initial states.
[0097] S403: Utilize the first user equipment to sense the initial status information of the user.
[0098] In step S403, the user's state information corresponding to the initial state of the video device, when setting the tracking range before the first user device controls the video device, can be defined as initial state information. The user's initial state information can be that the horizontal and vertical rotation angles of the head are 0 degrees, and the user is in a stationary state. Furthermore, the user's pupils and interpupillary distance are in their initial states.
[0099] S404: Determine a corresponding control strategy according to the initial state of the video device and the initial state information of the user.
[0100] In the above step S404, the corresponding relationship between the status of the video device and the status of the user can be shown in the following table.
[0101] FIG5 is a flow chart of another method for controlling a video device provided by an embodiment of the present disclosure. As shown in FIG5 , in step S401 , an initial image around the video device is acquired by using the video device, which also includes the following steps S501 to S502 .
[0102] S501: Register a first user device, a second user device, and a video device to a server.
[0103] S502: Using the server, establish a connection between the first user device, the second user device, and the video device.
[0104] In the above steps S501 to S502, the first user device, the second user device and the video device may establish a connection through the server to perform data transmission.
[0105] The control method of the video device provided by the embodiment of the present disclosure will be further described in detail below in combination with specific application scenarios.
[0106] Figure 6a is an application scenario of the control method of the first video device provided in an embodiment of the present disclosure, and Figure 6b is an application scenario of the control method of the second video device provided in an embodiment of the present disclosure. As shown in Figures 6a and 6b, the first user device can be a head-mounted display device, and the video device can be a car driving recorder having a lens.
[0107] As shown in FIG6 a , the head-mounted display device and the vehicle driving recorder may be devices from different manufacturers. Both may be registered with a first server and a second server respectively, and a connection may be established through the first server and the second server for data transmission.
[0108] As shown in FIG6 b , the head-mounted display device and the vehicle driving recorder may be devices from the same manufacturer. Both may be registered with the same server and establish a connection through the server for data transmission.
[0109] The following description will be made using the application scenario shown in FIG6 a as an example. It is understood that the control method in the application scenario shown in FIG6 b is similar thereto and will not be described in detail.
[0110] As shown in Figure 6a, the head-mounted display device can sense user status information, including head rotation angle, head rotation speed, head raising / lowering angle, head raising / lowering speed, pupil distance, and pupil size, and transmit this user status information to the first server. The head-mounted display device can transmit data to the vehicle's driving recorder via the first and second servers. Based on the user's status information, the second server selects a pre-stored control strategy, generates control instructions, and transmits the control instructions to the vehicle's driving recorder.
[0111] A car dashcam can adjust its state under control of control commands. The dashcam's state includes the camera's first rotation angle, first rotation speed, second rotation angle, second rotation speed, focal length, and magnification. The first rotation angle and second rotation speed represent the lens's rotation angle and rotation speed in the first direction, respectively; the second rotation angle and second rotation speed represent the lens's rotation angle and rotation speed in the second direction, respectively. The first direction corresponds to the user's head rotation direction, and the second direction corresponds to the user's head raising / lowering direction.
[0112] In a specific example, the video device may be a car dashcam with a lens, and the first user device may be a head-mounted display device. The head-mounted display device has both sensing and display functions. When a user turns their head to the left at a certain speed, the head-mounted display device can sense status information such as the user's head turning angle and speed, and send this status information to a server. The dashcam obtains status information such as the user's head turning angle and speed from the server, and the camera of the dashcam also rotates to the left at the same speed based on the user's head turning angle and speed, enabling user control of the dashcam. In this way, even if the user is in the office, without any operation, they can follow other people's cars and experience different views, gaining the same experience as the driver or co-pilot.
[0113] At the same time, the head-mounted display device worn by the user also has a display function. The images captured by the car's driving recorder lens can be displayed on the screen of the head-mounted display device to achieve an immersive control experience and further improve the user experience.
[0114] Because the images captured by a car's dashcam are two-dimensional, while the head-mounted display screen needs to display three-dimensional images, the two-dimensional images need to be processed. Specifically, the process involves acquiring video frame data of images surrounding the video device; matching at least one three-dimensional model based on the video frame data; outputting at least one three-dimensional image based on the three-dimensional model; sampling the at least one three-dimensional image to output multiple sampled three-dimensional images; performing cloud-based rendering on the multiple sampled three-dimensional images to output the cloud-based rendering results; and performing a fusion calculation of the cloud-based rendering results, the video frame data, and the three-dimensional image to output a virtual reality image.
[0115] Specifically, video frame data includes: video frame rate and video frame size. Fusion computing refers to fusing one or more video sequences of images captured by a video device's lens representing a scene or model with a related virtual scene to generate a new virtual scene or model of the scene. Video fusion computing is divided into three levels: preprocessing, information fusion, and application. Preprocessing techniques are mainly used to perform geometric correction, noise removal, color and brightness adjustment, and registration on video images. Video image registration refers to finding the maximum correlation between the video image and the three-dimensional virtual scene to eliminate information differences in space, phase, and resolution, achieving more realistic fusion and more accurate information. The information fusion layer refers to the fusion of video images. Video image fusion can be categorized into pixel-level, feature-level, and decision-level fusion, from low to high intelligence levels.
[0116] Figure 7 is an application scenario of the third method for controlling a video device provided in an embodiment of the present disclosure. As shown in Figure 7, the first user device may be a head-mounted display device, and the video device may be a car driving recorder having multiple lenses.
[0117] As shown in FIG7 , the head-mounted display device and the car driving recorder can be devices from the same manufacturer. Both can be registered with the same server and establish a connection through the server for data transmission.
[0118] As shown in FIG7 , the head-mounted display device can sense user status information, including head rotation angle, head rotation speed, head raising / lowering angle, head raising / lowering speed, pupil distance, and pupil size, and transmit the user status information to the first server. The head-mounted display device can transmit data to the vehicle driving recorder via the server.
[0119] The server can select a pre-stored control strategy according to the user's status information, form a control instruction, and send the control instruction to the car driving recorder.
[0120] A car dashcam can adjust its state under control of control commands. The dashcam's state includes the camera's first rotation angle, first rotation speed, second rotation angle, second rotation speed, focal length, and magnification. The first rotation angle and second rotation speed represent the lens's rotation angle and rotation speed in the first direction, respectively; the second rotation angle and second rotation speed represent the lens's rotation angle and rotation speed in the second direction, respectively. The first direction corresponds to the user's head rotation direction, and the second direction corresponds to the user's head raising / lowering direction.
[0121] In a specific example, the video device may be a car dashcam with multiple lenses, and the first user device may be a head-mounted display device. The head-mounted display device has both sensing and display functions. When a user turns their head to the left at a certain speed, the head-mounted display device can sense status information such as the user's head turning angle and speed, and send this status information to a server. The dashcam obtains status information such as the user's head turning angle and speed from the server, and the various lenses of the dashcam rotate to the left at the same speed based on the user's head turning angle and speed, enabling user control of the dashcam. In this way, even if the user is in the office, without any operation, they can follow other people's cars and experience different views, embodying the same feelings as the driver or co-pilot.
[0122] At the same time, the virtual reality display device worn by the user also has a display function. The images captured by the car's driving recorder lens can be displayed on the screen of the head-mounted display device to achieve an immersive control experience and further improve the user experience.
[0123] Because a car dashcam has multiple lenses, the user's status information can be divided into multiple status intervals based on the number of lenses in the car dashcam. For example, three lenses correspond to three status intervals. Accordingly, the control strategy is divided into multiple corresponding control intervals based on the multiple status intervals. The statuses of the corresponding multiple lenses are controlled separately according to the multiple control intervals.
[0124] Specifically, when the user can turn his head within a 360-degree circumference, where each 120-degree head rotation angle is an interval. When the user's head rotation angle is between 0 and 120 degrees, the first lens in the car driving recorder can be controlled to rotate at the same rotation speed as the user's head rotation speed. When the user's head rotation angle is between 121 and 240 degrees, the second lens in the car driving recorder can be controlled to rotate at the same rotation speed as the user's head rotation speed. When the user's head rotation angle is between 241 and 360 degrees, the second lens in the car driving recorder can be controlled to rotate at the same rotation speed as the user's head rotation speed.
[0125] FIG8 illustrates an application scenario of the fourth method for controlling a video device provided by an embodiment of the present disclosure. As shown in FIG8 , the first user device and the second user device can be independent of each other. The first user device can be a smart wearable device with a sensing function, and the second user device can be a large-screen display device with a display function. The display area of the large-screen display device is larger than that of the smart wearable device, and the video device can be a car driving recorder with a single lens.
[0126] The method for controlling the video device through the first user device can be the same as the control method in the scenario shown in Figure 6b. The difference is that the first user device and the second user device in Figure 8 are two independent devices. The first user device can be a smart wearable device with sensing capabilities, and the second user device can be a large-screen display device with display capabilities. The large-screen display device can display two-dimensional images or three-dimensional images, and it establishes a connection with the car's driving recorder through the server.
[0127] In a specific example, the video device can be a car dashcam with a camera, the first user device can be a smart wearable device with sensing capabilities, and the second user device can be a large-screen display device with display capabilities. When a user turns their head to the left at a certain speed, the smart wearable device can sense the user's head rotation angle, speed, and other status information and send this information to a server. The dashcam receives the user's head rotation angle and speed status information from the server, and the camera of the dashcam rotates to the left at the same speed based on the user's head rotation angle and speed, enabling user control of the dashcam. This way, even if the user is in the office, without any operation, they can follow others' cars and experience different views, embodying the same feelings as the driver or co-pilot.
[0128] At the same time, the large-screen display device has a display function. The images captured by the camera of the car driving recorder can be displayed on the screen of the large-screen display device to achieve simultaneous sharing by multiple people, further improving the user experience.
[0129] FIG9 illustrates an application scenario of the fifth method for controlling a video device provided by an embodiment of the present disclosure. As shown in FIG9 , the first user device and the second user device can be independent devices. The first user device can be a smart wearable device with a sensing function, and the second user device can be a large-screen display device with a display function. The display area of the large-screen display device is larger than that of the smart wearable device, and the video device can be a car driving recorder with a single lens.
[0130] The method of controlling the video device through the first user device can be the same as the control method in the scenario shown in Figure 8. The difference is that the first user device and the second user device in Figure 9 are two independent devices. The first user device can be a smart wearable device with a sensing function, and the second user device can be a large-screen display device with a display function. Among them, the display area of the large-screen display device is larger than the display area of the smart wearable device, and the video device can be a car driving recorder, which has a lens. The smart wearable device and the large-screen display device establish a connection with the virtual reality display device through a wireless protocol, and the control method thereof can refer to the control method of the scenario shown in Figure 8 above.
[0131] Figure 10 is an application scenario of the sixth method for controlling a video device provided in an embodiment of the present disclosure. As shown in Figure 10, the first user device may be a head-mounted display device, and the video device may be a plurality of car driving recorders, each of which has multiple lenses.
[0132] The manner of controlling the video device through the first user device may be the same as the control manner in the scenario shown in Figure 7. The difference is that the video device in Figure 10 is a plurality of car driving recorders, each of which has a plurality of lenses.
[0133] Since there are multiple car dashcams, each with a camera, the user's status information can be divided into multiple status intervals based on the number of car dashcams. For example, three car dashcams correspond to three status intervals. Accordingly, the control strategy is divided into multiple corresponding control intervals based on the multiple status intervals. Based on the multiple control intervals, the status of the cameras in the corresponding multiple video devices is controlled respectively.
[0134] Specifically, when the user can turn his head within a 360-degree circumference, where each 120-degree head rotation angle is an interval. When the user's head rotation angle is between 0 and 120 degrees, the lens in the first car driving recorder can be controlled to rotate at the same rotation speed as the user's head rotation speed. When the user's head rotation angle is between 121 and 240 degrees, the lens in the second car driving recorder can be controlled to rotate at the same rotation speed as the user's head rotation speed. When the user's head rotation angle is between 241 and 360 degrees, the lens in the third car driving recorder can be controlled to rotate at the same rotation speed as the user's head rotation speed.
[0135] In some embodiments, step S206, performing display using the first user device or the second user device according to the display image, further includes: adjusting the control strategy according to the current state of the video device and the current state information of the user.
[0136] The user's status and the status of the video device can be compared in real time to observe whether the status of the video device meets the user's needs. When there is a certain deviation between the two, the control strategy can be adjusted to make the status of the video device meet the user's needs and further improve the user experience.
[0137] On the second aspect, an embodiment of the present disclosure provides a control device for a video device. Figure 11 is a structural schematic diagram of a control device for a video device provided by an embodiment of the present disclosure. As shown in Figure 11, the control device for the video device includes: a sensing module 111, a first acquisition module 112, a control module 113, a second acquisition module 114, a display image generation module 115, and a display module 116.
[0138] The sensing module 111 is configured to sense the user's current status information using the first user device. The first acquisition module 112 is configured to acquire a corresponding control policy based on the user's current status information. The control module 113 is configured to control the current status of the video device according to the control policy. The second acquisition module 114 is configured to acquire the current image around the video device using the video device. The display image generation module 115 is configured to process the current image around the video device and generate a display image. The display module 116 is configured to display the display image using the first user device or the second user device.
[0139] Each module in the control device of the video device provided in the embodiment of the present disclosure can respectively execute each step in the above-mentioned control method of the video device. For specific related descriptions, please refer to the description of the control method of the video device in any of the above-mentioned embodiments, which will not be repeated here.
[0140] In the third aspect, an embodiment of the present disclosure provides an electronic device. Figure 12 is a structural diagram of the electronic device provided in some embodiments of the present disclosure. As shown in Figure 12, the electronic device includes: one or more processors 121; a memory 122, on which one or more programs are stored. When the one or more programs are executed by one or more processors, the one or more processors implement the control method of the video device provided in any of the above embodiments; one or more I / O interfaces 123, connected between the processor and the memory, and configured to realize information interaction between the processor and the memory.
[0141] Among them, the processor 121 is a device with data processing capabilities, including but not limited to a central processing unit (CPU); the memory 122 is a device with data storage capabilities, including but not limited to random access memory (RAM, more specifically SDRAM, DDR, etc.), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), and flash memory (FLASH); the I / O interface (read-write interface) 123 is connected between the processor 121 and the memory 122, and can realize information interaction between the processor 121 and the memory 122, including but not limited to a data bus (Bus), etc.
[0142] In some embodiments, the processor 121 , the memory 122 , and the I / O interface 123 are connected to each other via a bus, and further connected to other components of the computing device.
[0143] In a fourth aspect, this embodiment provides a computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the method for controlling a video device provided by any of the above embodiments.
[0144] It will be appreciated by those skilled in the art that all or some of the steps, systems, and functional modules / units in the methods disclosed above may be implemented as software, firmware, hardware, and appropriate combinations thereof. In hardware implementations, the division between the functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed by several physical components in cooperation. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include a computer storage medium (or non-transitory medium) and a communication medium (or temporary medium). As is well known to those skilled in the art, the term computer storage medium includes volatile and non-volatile, removable, and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those skilled in the art that communication media typically embodies computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media.
[0145] It is understood that the above embodiments are merely exemplary embodiments for illustrating the principles of the present disclosure, and the present disclosure is not limited thereto. Those skilled in the art may make various modifications and improvements without departing from the spirit and substance of the present disclosure, and such modifications and improvements are also considered to be within the scope of protection of the present disclosure.
Claims
1. A method for controlling a video device, wherein: The control method of the video device comprises: Using the first user device, sensing current status information of the user; According to the current status information of the user, obtaining a corresponding control strategy; According to the control strategy, the current state of the video device is controlled.
2. The method for controlling a video device according to claim 1, wherein: According to the control strategy, the current state of the video device is controlled, and then the following steps are further included: Using the video device, obtaining a current image around the video device; Processing a current image around the video device to generate a display image; According to the display image, the display is performed using the first user device or the second user device.
3. The method for controlling a video device according to claim 2, wherein: Using the first user device, sensing the current state information of the user, the method also includes: Using the video device, acquiring an initial image around the video device; Determining an initial state of the video device according to an initial image around the video device; Using the first user equipment, sensing initial state information of the user; A corresponding control strategy is determined according to the initial state of the video device and the initial state information of the user.
4. The method for controlling a video device according to claim 3, wherein: The step of obtaining an initial image around the video device by using the video device further includes: registering the first user device, the second user device and the video device to a server; The server is used to establish a connection between the first user device, the second user device, and the video device.
5. The method for controlling a video device according to claim 2, wherein: The step of processing the image around the video device to generate a display image includes: Acquire video frame data of images around the video device; Matching at least one three-dimensional model according to the video frame data; outputting at least one three-dimensional image according to the three-dimensional model; Sampling the at least one three-dimensional image and outputting a plurality of sampled three-dimensional images; Performing cloud rendering on the multiple sampled three-dimensional images and outputting cloud rendering results; The cloud rendering result, the video frame data, and the three-dimensional image are fused and calculated to output an extended reality display image.
6. The method for controlling a video device according to claim 5, wherein: The video frame data includes: video frame rate and video frame size.
7. The method for controlling a video device according to claim 2, wherein: When the number of the video device is one and the number of lenses of the video device is multiple, controlling the current state of the video device according to the control strategy includes: Dividing the user's status information into a plurality of status intervals according to the number of the lenses in the video device; According to the multiple state intervals, the control strategy is divided into corresponding multiple control intervals; According to the plurality of control intervals, current states of the corresponding plurality of lenses are controlled respectively.
8. The method for controlling a video device according to claim 2, wherein: When there are multiple video devices and each of the video devices has one lens, controlling the current state of the video device according to the control strategy includes: Dividing the user's status information into a plurality of status intervals according to the number of the video devices; According to the multiple state intervals, the control strategy is divided into corresponding multiple control intervals; According to the multiple control intervals, the current states of the lenses in the corresponding multiple video devices are controlled respectively.
9. The method for controlling a video device according to claim 2, wherein: The first user device and the second user device both include an extended reality display device, and a display area of the second user device is larger than a display area of the first user device.
10. The method for controlling a video device according to claim 2, wherein: The user's status information includes: head turning angle, head turning speed, head raising / lowering angle, head raising / lowering speed, pupil distance, and pupil size; The state of the video device includes: a first rotation angle, a first rotation speed, a second rotation angle, a second rotation speed, a focal length, and a magnification of a lens of the video device; The first rotation angle and the second rotation angle are respectively the rotation angle and the rotation speed of the lens in the first direction; the second rotation angle and the second rotation speed are respectively the rotation angle and the rotation speed of the lens in the second direction; the first direction is the same as the direction in which the user turns his head, and the second direction is the same as the direction in which the user raises / lowers his head.
11. The method for controlling a video device according to claim 2, wherein: The method further comprises: performing display by using the first user device or the second user device according to the display image; and then: The control strategy is adjusted according to the current state of the video device and the current state information of the user.
12. A control device for a video device, wherein: The control device of the video device comprises: A sensing module, configured to sense current status information of a user using a first user device; A first acquisition module is configured to acquire a corresponding control strategy according to the current state information of the user; The control module is configured to control the current state of the video device according to the control strategy.
13. The video equipment control device according to claim 12, wherein: The control device of the video device also includes: A second acquisition module is configured to acquire a current image around the video device using the video device; A display image generation module, configured to process a current image around the video device to generate a display image; The display module is configured to display the display image using the first user device or the second user device.
14. An electronic device, wherein: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores one or more computer programs executable by the at least one processor, and the one or more computer programs are executed by the at least one processor to enable the at least one processor to execute the control method of the video device according to any one of claims 1 to 13.
15. A computer-readable storage medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the computer program implements the control method of the video device according to any one of claims 1 to 13.
Citation Information
Patent Citations
Method, device and system for processing video image in VR live broadcast
CN109613984A
Display method and device, terminal device and storage medium
CN110825333A
Head-mounted display and scene display method thereof and storage medium
CN111175972A
Cockpit system based on mixed reality, and scene construction method
CN112150885A
Video equipment control method and control device
CN116567310A
