All major robotics and VLA papers, ranked and benchmarked in a single place [P]

All major robotics and VLA papers, ranked and benchmarked in a single place [P]

Hi folks,

There is now a dedicated Robotics page on Papers with Code that lists the major benchmarks, trending papers with linked code, and open-source artifacts.

Find it here: https://paperswithcode.co/tasks/robotics

https://preview.redd.it/wvhcgu1q1fdh1.png?width=3034&format=png&auto=webp&s=9a43021f7b8e1b840b09f55bb8aee0c4b2d54215

Major benchmarks that most papers report evaluations on are:

LIBERO, as well as its subsets like LIBERO-Long and LIBERO-Spatial

SimplerEnv WidowX

RoboTwin

and more. Currently, we have about 110 entries on each benchmark.

Each benchmark's progress is visualized over time:

https://preview.redd.it/myl3ysvv2fdh1.png?width=2880&format=png&auto=webp&s=3fae2b73d592f2c7ddd3118ec2c5a0d5c5e93b65

We also show which models are open source and which aren't.

Let me know which others I missed. I'd be happy to add them.

Also happy to hear any feedback, new tasks, or features to add!

Kind regards,

Niels

ML Engineer @ HF

submitted by /u/NielsRogge
[comments]

Similar Posts

Leave a Reply

Your email address will not be published. Required fields are marked *