Skip to content

BitVLA: evaluating a VLA policy on real robots #5

Description

@Noietch

Hi maintainers,

I came across ustcwhy/BitVLA and noticed that it focuses on “Official implementation for BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulation”. That is close to a problem we are working on with EVA-CLIENT, a unified framework for real-robot deployment, evaluation, and LeRobot data collection.

If this direction looks relevant, you can take a look at EVA-CLIENT here: https://github.com/Noietch/EVA-CLIENT

For ustcwhy/BitVLA, the policy could be exposed through an EVA backend and evaluated across prompts or checkpoints on compatible hardware. A small first experiment could be to wrap one checkpoint as a policy backend and run a small prompt/task sweep. We would be happy to prepare a minimal adapter or example around your current interfaces, rather than asking you to change the project architecture.

If this is useful, I would be glad to compare notes or help with a small integration. If it is not relevant, no worries—and we will not follow up.

Best,
EVA-CLIENT Team

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions