Wall-Facing Intelligent Publicity of Humanoid Robot Multi-Modal Perception Fusion Related Patents

According to the Qichacha APP, the patent for the "Multi-modal Perception Fusion Method for Humanoid Robot Based on Dynamic Sparsification Activation" by Beijing MI-WALL Intelligent Technology Co., Ltd. was recently published. The patent abstract displayed on Qichacha shows that the method includes: obtaining multi-modal data streams of the robot, generating modal availability mapping based on the real-time running status of the robot; dynamically selecting perception modalities to be activated using a sparse gating strategy and constructing an active modal set based on the selection results; evaluating the active modal set using the Kalman filtering algorithm to obtain an evaluation set and identify modal switch states; when a modal switch is identified, constructing an evaluation window based on task complexity and progress changes, dynamically adjusting the robot's state space dimensions within the evaluation window to obtain a multi-modal state set; generating robot task execution instructions based on the multi-modal state set and controlling the robot's behavior actions, resolving the problem of mismatched robot state space dimensions caused by modal switches when using the sparse gating strategy to dynamically select activated perception modalities.