New method detects objects from motion alone, revolutionizing robotics applications.
The article introduces a new method for detecting objects using only two short videos: one showing the object in motion and one without the object. By training the object detector to recognize object motion in the first video and ignore the second video, the model learns to locate objects without specific annotations. This approach allows the model to detect objects in single images after training. The researchers tested their method in three robotics scenarios involving observing moving objects, watching object manipulation demonstrations, and physically interacting with objects.