cronusvla_0.5B_bridge_rt_1 / final_result_of_SimplerEnv.log
lihao3
Add model checkpoint
5a77b67
***Pick coke can results***
--------------------
horizontal sim variant avg success {'CronusVLA': 0.9288888888888889}
vertical sim variant avg success {'CronusVLA': 0.9644444444444444}
standing sim variant avg success {'CronusVLA': 0.9466666666666667}
avg_orientation_sim_variant_results [0.9466666666666667]
--------------------
Orientation horizontal, ckpt CronusVLA all robot arm visual matching success: [0.88, 0.88, 0.88, 0.96]
Orientation vertical, ckpt CronusVLA all robot arm visual matching success: [1.0, 1.0, 1.0, 1.0]
Orientation standing, ckpt CronusVLA all robot arm visual matching success: [1.0, 0.96, 0.96, 1.0]
horizontal visual matching sim success {'CronusVLA': 0.9}
vertical visual matching sim success {'CronusVLA': 1.0}
standing visual matching sim success {'CronusVLA': 0.98}
avg_orientation_sim_visual_matching_results [0.96]
********************
***Move Near results***
--------------------
sim variant avg success {'CronusVLA': 0.78}
--------------------
Ckpt CronusVLA all robot arm visual matching success: [0.92, 0.92, 0.92, 0.96]
sim visual matching success {'CronusVLA': 0.93}
********************
***Drawer results***
--------------------
open sim variant avg success {'CronusVLA': 0.2328042328042328}
close sim variant avg success {'CronusVLA': 0.5026455026455026}
avg_sim_variant_results [0.3677248677248677]
--------------------
Drawer task open, ckpt CronusVLA all robot arm visual matching success: [0.4722222222222222, 0.4722222222222222, 0.4444444444444444, 0.48148148148148145]
Drawer task close, ckpt CronusVLA all robot arm visual matching success: [0.638888888888889, 0.5277777777777778, 0.47222222222222227, 0.5185185185185185]
open visual matching sim success {'CronusVLA': 0.46296296296296297}
close visual matching sim success {'CronusVLA': 0.5462962962962963}
avg_sim_visual_matching_results [0.5046296296296297]
********************
***Drawer results***
--------------------
put_apple_into_top_drawer sim variant avg success {'CronusVLA': 0.21714285714285714}
avg_sim_variant_results [0.21714285714285714]
--------------------
Drawer task put_apple_into_top_drawer, ckpt CronusVLA all robot arm visual matching success: [0.42592592592592593, 0.4444444444444444, 0.48148148148148145, 0.5185185185185185]
put_apple_into_top_drawer visual matching sim success {'CronusVLA': 0.42592592592592593}
avg_sim_visual_matching_results [0.42592592592592593]
********************
***Bridge Put On Env results***
********** Results for put_spoon_on_tablecloth **********
sim visual matching partial success {'CronusVLA': 0.5416666666666666}
sim visual matching success {'CronusVLA': 0.4583333333333333}
********************
********** Results for put_carrot_on_plate **********
sim visual matching partial success {'CronusVLA': 0.5416666666666666}
sim visual matching success {'CronusVLA': 0.3333333333333333}
********************
********** Results for stack_green_block_on_yellow_block **********
sim visual matching partial success {'CronusVLA': 0.5833333333333334}
sim visual matching success {'CronusVLA': 0.0}
********************
********** Results for put_eggplant_in_basket **********
sim visual matching partial success {'CronusVLA': 0.7916666666666666}
sim visual matching success {'CronusVLA': 0.7916666666666666}
********************
google_var:
94.7
78.0
36.8
21.7
google_matching
96.0
93.0
50.5
42.6
widowx_matching
45.8
33.3
0.0
79.2