Literature
Display
← All papers

COLLAGE: Adaptive Fusion-based Retrieval for Augmented Policy Learning

Sateesh Kumar · Shivin Dass · Georgios Pavlakos · Roberto Martín-Martín

· CoRL 2025 ↗

Robotics8 min text · CondensedOriginal paper ↗
Contents

Overview

This edition follows the complete eighteen-page arXiv v2, including the appendix’s task definitions, standard deviations, retrieval-budget control and implementation details. The work studies few-shot imitation learning through task-specific data selection.

At a glance

COLLAGE augments five target demonstrations with data retrieved independently through visual, motion, shape and language similarity. It trains a reference policy on each retrieved subset, scores how well that policy explains the target actions, and converts those scores into sampling weights for final policy training.

Average LIBERO-10 success is 50.5%, versus 45.4% for the reproduced visual-retrieval baseline. Across six physical tasks, it completes 41 of 90 trials, versus 26 of 90 for visual retrieval. These are average improvements; some individual tasks favor a simpler baseline. The project page provides further resources.

1 Introduction

A large prior dataset may contain transferable skills and conflicting examples. Single-modality retrieval can confuse shared appearance with shared goals, or similar motion with the correct object interaction. Figure 1 illustrates this with book opening and bowl stirring.

COLLAGE combines retrieved subsets after retrieval, using target-action likelihood under separately trained reference policies as a proxy for training utility. This removes the need for policy rollouts to estimate weights, but still requires training those reference policies and a final task policy.

Complete original Figure 1.
Figure 1: Different tasks benefit from retrieval based on different modalities. For the target task “Open the book” (left), retrieval based on visual similarity tends to return relevant demonstrations where a robot opens a book, whereas retrieval based on motion similarity often returns demonstrations with similar motions but different semantics, such as unfolding a cloth. On the other hand, for the target task “Stir the bowl” (right), retrieval based on motion similarity is more effective, returning demonstrations that involve stirring motions, while visual similarity tends to retrieve examples that feature a bowl but involve different actions, such as placing an object inside the bowl.

2 Related Work

Earlier few-shot methods retrieve by state/action, optical-flow, language or visual similarity. STRAP retrieves visual sub-trajectories; COLLAGE retains that matching structure while combining multiple retrieval signals. Concurrent DataMIL learns data utility through a different supervised approach and could supply another candidate subset.

Zero-shot replay methods seek demonstrations directly executable in the target setting; COLLAGE instead learns from retrieved data plus target demonstrations. Its late fusion combines datasets, not raw sensor representations. The weights resemble importance-based sampling, but are likelihood-derived heuristics rather than a demonstrated unbiased density-ratio correction.

3 Collage

Given a small target dataset and a much larger prior corpus, retrieve a separate subset for every modality, estimate one relevance weight per subset, and train a language-conditioned policy from their weighted mixture plus the target examples.

Observations may include RGB, depth and robot state. The framework accepts different feature encoders and retrieval granularities, although the experiments instantiate four specific modalities and one policy family.

Complete original Figure 2.
Figure 2: Overview of our proposed COLLAGE approach. Left: Given a set of target demonstrations 𝒟𝑡𝑎𝑟𝑔𝑒𝑡\mathcal{D}_{\mathit{target}}, each modality ff selects a set of retrieved trajectories 𝒟𝑟𝑒𝑡𝑟𝑖𝑒𝑣𝑒𝑑f\mathcal{D}_{\mathit{retrieved}}^{f} from a prior dataset 𝒟𝑝𝑟𝑖𝑜𝑟\mathcal{D}_{\mathit{prior}}. Center: We use the retrieved trajectories for each modality to train a reference policy πreff\pi_{\text{ref}_{f}}. For each reference policy, we compute the log-likelihood log⁡πreff​(at|st)\log\pi_{\text{ref}_{f}}(a_{t}|s_{t}) of each state sts_{t} of the target dataset. With this, COLLAGE estimates adaptively the importance wfw_{f} of each modality. Right: We train our final policy using the retrieved examples of each modality. We perform importance sampling, such that the sampling probability for each retrieved set is equal to wfw_{f}.

3.1 Retrieval Across Multiple Modalities

Split each target trajectory at pauses in end-effector motion. For each modality, embed the observations and construct a pairwise feature-distance matrix between a target segment and each prior trajectory. Subsequence dynamic time warping matches the complete target segment to a contiguous portion of the longer demonstration.

Retrieve the K lowest-cost matches independently for each modality, retaining their original language instructions. Most modalities use sub-trajectories; language retrieval selects whole demonstrations and adjusts their sampled data budget.

3.2 Estimating the Weights for Retrieved datasets

Train one behavior-cloning reference policy solely on each modality’s retrieved subset. Sum its log-likelihood of state/action/instruction triples from the target demonstrations, then apply a temperature-scaled softmax across modalities. Higher target likelihood gives the corresponding subset a higher final sampling probability.

The score measures action fit on the available examples, not directly measured rollout success or a calibrated probability of dataset usefulness. The target demonstrations are subsequently reused in final training; appendix details average scores across late reference-policy checkpoints.

Equations 1–2
πreff=arg⁡minθ​ℒBC​(θ,𝒟𝑟𝑒𝑡𝑟𝑖𝑒𝑣𝑒𝑑f).\displaystyle\pi_{\text{ref}_{f}}=\arg\min_{\theta}\mathcal{L}_{\text{BC}}\left(\theta;\mathcal{D}_{\mathit{retrieved}}^{f}\right). (1)
Sf=∑(s,a,ℓ)∈𝒟𝑡𝑎𝑟𝑔𝑒𝑡log⁡πreff​(a∣s,ℓ)\displaystyle S_{f}=\sum_{(s,a,\ell)\in\mathcal{D}_{\mathit{target}}}\log\pi_{\text{ref}_{f}}(a\mid s,\ell) (2)

3.3 Retrieval Augmented Policy Learning

The final transformer consumes a history of observations and a task instruction, then predicts an action chunk through a Gaussian-mixture head. Training minimizes negative action log-likelihood with L2 parameter regularization.

For each modality, form an augmented set containing its retrieved data and the target demonstrations. Sample among these augmented sets with the estimated modality weights. Thus adaptation changes the training distribution, not an online retrieval or mixture-of-policies decision at execution time.

Equation 3
ℒ(θ)=𝔼(st−h:t,at:t+h,ℓ)∼𝒟[−logπθ(at:t+h∣st−h:t,ℓ)]+λ∥θ∥22\mathcal{L}(\theta)=\mathbb{E}_{(s_{t-h:t},\ a_{t:t+h},\ \ell)\sim\mathcal{D}}\left[-\log\,\pi_{\theta}(a_{t:t+h}\mid s_{t-h:t},\ \ell)\right]+\lambda\|\theta\|_{2}^{2} (3)

3.4 Feature Modalities for Data Retrieval

Visual retrieval uses DINOv2 image embeddings. Motion retrieval computes GMFlow optical flow over a policy-related temporal offset, trains a compact encoder–decoder to reconstruct it, and retrieves using the learned latent. Motion features therefore require prior-corpus pretraining.

Shape retrieval converts foreground depth into point clouds and embeds them with pretrained PointNet++. Language retrieval compares instruction embeddings. These complementary signals can recover similar actions despite visual differences, or distinguish goals among visually similar scenes. Their usefulness still depends on retrieval quality and available sensors/annotations.

4 Experiments

Experiments test ten simulated LIBERO tasks and six physical manipulation tasks, asking whether multimodal retrieval, transfer from a separately collected corpus and adaptive weighting improve few-shot policy learning.

Complete original Figure 3.
Figure 3: Real-world tasks and corresponding retrieved examples from DROID. Our real-world setting (top) is visually very different from DROID (bottom), yet we are able to retrieve meaningful and helpful demonstrations for each task. In many cases our target task does not align perfectly with DROID examples, but we are still able to retrieve a relevant demonstration (e.g., wipe-cloth demonstration for the related scrub-plate task), or return a partial motion of a more complicated task (e.g., pick-up-spoon is relevant for the pick-up-spatula segment of the pick-up-spatula-stir task).

4.1 Experimental Setup

Simulation uses five target demonstrations per LIBERO-10 task and 4,500 prior demonstrations from LIBERO-90. Physical experiments use a Franka Panda, five demonstrations per task, and 30,000 language-annotated successful DROID episodes randomly selected from 50,000 successes.

The six physical tasks place a pen in a cup, pick up an umbrella, stir with a spatula, put chips into a box, stack blocks and scrub a plate. DROID differs visibly from the target setup and can contribute related partial behaviors even without an exact task match.

Baselines include target-only behavior cloning, all-data multitask learning, state/action and flow retrieval, published STRAP results, reproduced visual retrieval, the other individual modalities and uniform fusion. Simulation reports three seeds and 50 trials; physical evaluation uses 15 trials per task and method.

4.2 Results

COLLAGE reaches 50.5% mean simulated success, versus 45.4% reproduced visual retrieval, 45.6% published STRAP, 44.8% shape retrieval and 46.9% uniform fusion. Its 5.1-point gain over reproduced visual retrieval is 11.2% relative; the gain over the strongest tabulated published baseline is about 10.7%. All averages include Moka-Moka, where every method scores zero.

Adaptive weighting beats uniform fusion on seven of nine nonzero tasks, not all tasks as the main prose claims. It trails uniform fusion on Mug-Mug and Mug-Pudding, and trails single modalities on several tasks. Book success improves 66.0→89.3 versus reproduced visual retrieval, a 23.3-percentage-point increase.

Physical successes are 6/15 pen, 6/15 umbrella, 9/15 stirring, 7/15 chips, 6/15 blocks and 7/15 scrubbing. The 41/90 total is about 45.6%, versus visual retrieval’s 26/90 (28.9%); rounded table percentages yield the headline 57.4% relative gain. COLLAGE loses to visual/motion retrieval on chips and ties shape on blocks.

The source says target-only BC averages 0.5/15 physical successes, but its table totals 6/90: one success per task on average. Task-specific weights illustrate selectivity, not a universal correspondence between a modality’s isolated success and its learned weight. Original tables retain all reported values.

Tasks Mug-M Book Cheese Soup-Sa Mug-Mi Soup-C Bowl Stove Mug-P Avg.
BC 36.036.0 44.744.7 47.347.3 17.317.3 25.325.3 19.319.3 72.072.0 73.373.3 12.712.7 34.834.8
MT 31.331.3 89.3\mathbf{89.3} 33.333.3 15.315.3 21.021.0 23.323.3 66.766.7 68.068.0 9.39.3 35.835.8
BR [13] 32.732.7 38.038.0 33.333.3 29.329.3 16.316.3 28.028.0 74.774.7 63.363.3 6.76.7 32.232.2
FR [14] 28.728.7 58.058.0 29.329.3 17.317.3 21.321.3 23.323.3 83.383.3 71.371.3 16.716.7 34.934.9
STRAP [15] 57.3\mathbf{57.3} 85.385.3 29.329.3 16.716.7 29.329.3 42.7\mathbf{42.7} 91.391.3 85.3\mathbf{85.3} 18.7¯\underline{18.7} 45.645.6
Motion 48.048.0 66.766.7 60.760.7 25.325.3 28.028.0 30.030.0 48.048.0 73.373.3 15.315.3 39.539.5
Language 34.734.7 61.361.3 66.066.0 32.032.0 20.720.7 31.331.3 93.393.3 58.058.0 13.313.3 41.141.1
Shape 54.054.0 77.377.3 68.7\mathbf{68.7} 28.728.7 20.720.7 28.728.7 94.094.0 63.363.3 12.712.7 44.844.8
Visual  [15] 40.740.7 66.066.0 66.766.7 30.030.0 31.331.3 29.329.3 95.395.3 73.373.3 21.3\mathbf{21.3} 45.445.4
NA-Fusion 54.054.0 86.786.7 55.355.3 42.742.7 24.724.7 28.728.7 94.794.7 67.367.3 14.714.7 46.946.9
Collage 51.351.3 89.3\mathbf{89.3} 67.367.3 53.3\mathbf{53.3} 32.7\mathbf{32.7} 33.333.3 96.0\mathbf{96.0} 68.768.7 13.313.3 50.5\mathbf{50.5}
Table 1: Performance comparison on the LIBERO-10 benchmark. We compare Collage with various baselines (first two groups) and with ablations of our approach (third group). Bold indicates the best performance, and underline indicates the second-best performance. All sub-trajectory method results are reported with K=100K=100 sub-trajectories. Results are averaged over 33 seeds and 5050 trials. The last column reports the average across all 1010 tasks in LIBERO-10, including the Moka-Moka task, for which all methods achieve a success rate of 00. Individual success rates are reported only for the remaining 99 tasks.
Method Pen Umb Stir Chips Lego Scrub Avg.
BC 0/150/15 2/152/15 1/151/15 3/153/15 0/150/15 0/150/15 6.76.7
MT 0/150/15 0/150/15 0/150/15 1/151/15 2/152/15 0/150/15 3.33.3
Visual [15] 4/154/15 4/154/15 3/153/15 𝟗/𝟏𝟓\mathbf{9/15} 5/155/15 1/151/15 28.928.9
Motion 0/150/15 0/150/15 4/154/15 𝟗/𝟏𝟓\mathbf{9/15} 1/151/15 1/151/15 16.716.7
Shape 0/150/15 3/153/15 3/153/15 6/156/15 𝟔/𝟏𝟓\mathbf{6/15} 0/150/15 20.020.0
Language 4/154/15 4/154/15 5/155/15 4/154/15 2/152/15 6/156/15 27.727.7
Collage 𝟔/𝟏𝟓\mathbf{6/15} 𝟔/𝟏𝟓\mathbf{6/15} 𝟗/𝟏𝟓\mathbf{9/15} 7/157/15 𝟔/𝟏𝟓\mathbf{6/15} 𝟕/𝟏𝟓\mathbf{7/15} 45.5\mathbf{45.5}
Table 2: Real-world results. We perform 15 trials for each method and we report the number of successful episodes for each task. The last column refers to the average percentage of success. Bold indicates the best performance.
Task wVisualw^{\text{Visual}} wMotionw^{\text{Motion}} wShapew^{\text{Shape}} wLanguagew^{\text{Language}}
LIBERO-10
Cheese 0.280.28 0.180.18 0.460.46 0.070.07
Soup-C 0.110.11 0.520.52 0.220.22 0.140.14
DROID
Lego 0.60.6 0.020.02 0.280.28 0.10.1
Pen 0.300.30 0.240.24 0.100.10 0.360.36
Table 3: Importance weights for various tasks. We report the weights for each modality for simulation (LIBERO-10) and real-world (DROID) tasks.

5 Conclusion

Late fusion of independently retrieved demonstration subsets improves mean few-shot policy performance in these simulation and physical experiments. The useful contribution is task-specific training-data weighting, with evidence that complementary cues can outperform a larger single-modality retrieval set.

6 Limitations

If every modality retrieves irrelevant examples, reweighting cannot supply missing skills. Four reference policies add compute, and target-action fit is only a proxy for subsequent policy performance. The authors propose cheaper reference-policy approximations or utility predictors as future work.

The evaluated tasks use one physical robot and small trial counts. Simulation includes seed variability, but the paper provides no analogous physical repeated-seed study or broad cross-embodiment evaluation. Average gains should not be presented as uniform task-level dominance.

Acknowledgments

The authors acknowledge manuscript feedback and discussions, NSF IIS-2504906 and gifts from Adobe/Google for Georgios Pavlakos, and DARPA TIAMAT HR0011-24-9-0428 for Roberto Martín-Martín.

Appendix A Appendix

The appendix retains complete task mappings, per-seed variability, equal-size retrieval comparisons, modality-weight diagnostics and implementation details for both environments.

A.1 Details of Simulated Experiments

Table 4 expands task abbreviations; Table 5 includes all ten tasks and their standard deviations. Table 6 controls retrieved-set size: visual-only K=400 reaches 46.9% versus COLLAGE’s 50.5%, with roughly 25,000 training sequences in each. COLLAGE uses 100 segments per modality, totaling 400; the table caption’s shorthand should not imply 400 per modality.

Simulation retrieval uses agent-view 128×128 images. DINOv2 averages patch and classification-token embeddings into 768 dimensions. GMFlow uses a five-frame offset; a convolutional/transformer autoencoder compresses flow through a 512-dimensional token to a 256-dimensional latent. Shape features are 256-dimensional PointNet++ embeddings pretrained on ModelNet40, with simulator-provided depth and foreground masks.

The language pipeline specifies text-embedding-ada-002, cosine similarity above 0.90 and a budget matched to visual retrieval, distributed across selected demonstrations. Reference 49 instead names text-similarity-ada-001; the implementation description and bibliography disagree.

Segmentation uses the sum of absolute end-effector coordinate differences with threshold 5×10⁻³. The text says it merges sub-trajectories longer than 20 to address over-segmentation, an unclear heuristic that should be checked in code. BR/FR retrieve state/action pairs with temporal padding; their printed padding indices are also ambiguous.

Final policies use agent and wrist views, batch size 32, 60,000 steps, five target demonstrations and temperature 2. Seeds are 1234, 42 and 4325. The authors distinguish published STRAP from their visual reproduction and attribute task-level discrepancies to training stochasticity.

Figure 4 preserves all task-specific modality weights. Figure 5 shows that appearance may retrieve the right scene but wrong goal, while motion/language recover the goal elsewhere. For Mug-Microwave, language receives only 0.05 weight. These are explanatory examples, not isolated causal tests. Original implementation links remain available: FlowRetrieval, STRAP retrieval, STRAP policy training and Robomimic.

Abbr. (Tab. 1) Abbr. (Tab. 5, Fig. 4) Task Name in LIBERO-10
Mug-M Mug-Mug LIVING ROOM SCENE5 put the white mug on the left plate and put the yellow and white mug on the right plate
Book Book-Caddy STUDY SCENE1 pick up the book and place it in the back compartment of the caddy
Cheese Cheese-Butter LIVING ROOM SCENE2 put both the cream cheese box and the butter in the basket
Soup-Sa Soup-Sauce LIVING ROOM SCENE2 put both the alphabet soup and the tomato sauce in the basket
Soup-C Soup-Cheese LIVING ROOM SCENE1 put both the alphabet soup and the cream cheese box in the basket
Stove Stove-Moka KITCHEN SCENE3 turn on the stove and put the moka pot on it
Mug-Mi Mug-Micro KITCHEN SCENE6 put the yellow and white mug in the microwave and close it
Mug-P Mug-Pudding LIVING ROOM SCENE6 put the white mug on the plate and put the chocolate pudding to the right of the plate
Bowl Bowl-Cabinet KITCHEN SCENE4 put the black bowl in the bottom drawer of the cabinet and close it
Table 4: Mapping between abbreviations in Tables 1 and 5 and the full task names.
Mug-Mug Book-Caddy Cheese-Butter Soup-Sauce Mug-Micro
BC 36.00±4.3236.00\pm 4.32 44.67±3.4044.67\pm 3.40 47.33±9.2947.33\pm 9.29 17.33±3.4017.33\pm 3.40 25.33±8.0625.33\pm 8.06
MT 31.33±3.0631.33\pm 3.06 89.33±5.8989.33\pm 5.89 33.33±5.5433.33\pm 5.54 15.33±3.4615.33\pm 3.46 23.33±6.4823.33\pm 6.48
BR [13] 32.67±1.1532.67\pm 1.15 38.00±2.038.00\pm 2.0 33.33±1.1533.33\pm 1.15 29.33±3.0629.33\pm 3.06 16.33±3.2716.33\pm 3.27
FR[14] 28.67±4.1928.67\pm 4.19 58.00±3.2758.00\pm 3.27 29.33±4.6229.33\pm 4.62 17.33±3.4017.33\pm 3.40 21.33±3.0621.33\pm 3.06
STRAP [15] 57.33±7.757.33\pm 7.7 85.33±2.885.33\pm 2.8 29.33±11.329.33\pm 11.3 16.67±2.016.67\pm 2.0 29.33±2.729.33\pm 2.7
Motion 48.00±4.2448.00\pm 4.24 66.67±20.866.67\pm 20.8 60.67±2.8660.67\pm 2.86 25.33±4.1125.33\pm 4.11 28.00±9.9328.00\pm 9.93
Language 34.67±3.4034.67\pm 3.40 61.33±6.6061.33\pm 6.60 66.00±9.0966.00\pm 9.09 32.00±8.4832.00\pm 8.48 20.67±1.8920.67\pm 1.89
Shape 54.00±5.8954.00\pm 5.89 77.33±2.4977.33\pm 2.49 68.67±15.4368.67\pm 15.43 28.67±5.7428.67\pm 5.74 20.67±4.7120.67\pm 4.71
Visual [15] 40.67±3.0640.67\pm 3.06 66.00±3.4666.00\pm 3.46 66.67±8.0866.67\pm 8.08 30.00±3.4630.00\pm 3.46 31.33±7.5731.33\pm 7.57
NA-Fusion 54.00±5.6654.00\pm 5.66 86.67±4.9986.67\pm 4.99 55.33±5.2555.33\pm 5.25 42.67±5.2542.67\pm 5.25 24.67±2.4924.67\pm 2.49
Collage 51.33±9.851.33\pm 9.8 89.33±4.9989.33\pm 4.99 67.33±10.4967.33\pm 10.49 53.33±8.3853.33\pm 8.38 32.67±5.3032.67\pm 5.30
Soup-Cheese Moka-Moka Bowl-Cabinet Stove-Moka Mug-Pudding
BC 19.33±2.4919.33\pm 2.49 00.00±0.0000.00\pm 0.00 72.00±2.8272.00\pm 2.82 73.33±4.9873.33\pm 4.98 12.67±5.7312.67\pm 5.73
MT 23.33±3.0623.33\pm 3.06 00.00±0.0000.00\pm 0.00 66.67±4.1966.67\pm 4.19 68.00±3.2768.00\pm 3.27 9.33±3.069.33\pm 3.06
BR [13] 28.00±4.6228.00\pm 4.62 00.00±0.0000.00\pm 0.00 74.67±3.7774.67\pm 3.77 63.33±3.0663.33\pm 3.06 6.67±3.406.67\pm 3.40
FR [14] 23.33±4.1923.33\pm 4.19 00.00±0.0000.00\pm 0.00 83.33±3.0683.33\pm 3.06 71.33±3.4071.33\pm 3.40 16.67±3.0616.67\pm 3.06
STRAP [15] 42.67±7.242.67\pm 7.2 00.00±0.0000.00\pm 0.00 91.33±2.291.33\pm 2.2 85.33±2.285.33\pm 2.2 18.67±1.418.67\pm 1.4
Motion 30.00±7.1130.00\pm 7.11 00.00±0.0000.00\pm 0.00 48.00±4.2448.00\pm 4.24 73.33±3.0073.33\pm 3.00 15.33±3.415.33\pm 3.4
Language 31.33±7.7231.33\pm 7.72 00.00±0.0000.00\pm 0.00 93.33±3.493.33\pm 3.4 58.00±13.9558.00\pm 13.95 13.33±2.4913.33\pm 2.49
Shape 28.67±5.2428.67\pm 5.24 00.00±0.0000.00\pm 0.00 94.00±1.6394.00\pm 1.63 63.33±19.4863.33\pm 19.48 12.67±9.4312.67\pm 9.43
Visual [15] 29.33±4.629.33\pm 4.6 00.00±0.0000.00\pm 0.00 95.33±2.4995.33\pm 2.49 73.33±3.2673.33\pm 3.26 21.33±2.4921.33\pm 2.49
NA-Fusion 28.67±5.7328.67\pm 5.73 00.00±0.0000.00\pm 0.00 94.67±4.1194.67\pm 4.11 67.33±19.9667.33\pm 19.96 14.67±4.1114.67\pm 4.11
Collage 33.33±3.3933.33\pm 3.39 00.00±0.0000.00\pm 0.00 96.00±2.6296.00\pm 2.62 68.67±16.3668.67\pm 16.36 13.33±5.7313.33\pm 5.73
Table 5: Performance across 10 LIBERO-10 tasks with standard deviation reported across 3 seeds.
Tasks Mug-M Book Cheese Soup-Sa Mug-Mi Soup-C Bowl Stove-Mo Mug-P Avg.
Visual (K=400K=400) 34.734.7 64.764.7 72.0\mathbf{72.0} 50.750.7 2626 28.728.7 95.395.3 74.7\mathbf{74.7} 16.7\mathbf{16.7} 46.946.9
Collage 51.3\mathbf{51.3} 89.3\mathbf{89.3} 67.367.3 53.3\mathbf{53.3} 32.7\mathbf{32.7} 33.3\mathbf{33.3} 96.0\mathbf{96.0} 68.768.7 13.313.3 50.5\mathbf{50.5}
Table 6: Comparison between Visual similarity only and Collage while using identical retrieval set size on the LIBERO-10 benchmark. Both methods retrieve around 25​k25k sequences with number of retrieved sub-trajectories, K=400K=400. Results averaged over 33 seeds. Best result in bold.
Refer to caption
Figure 4: Modality importance weights predicted by Collage for all tasks in the LIBERO-10 benchmark.
Complete original Figure 5.
Figure 5: Visualization of the types of demonstrations retrieved from LIBERO-90 for two LIBERO-10 target tasks: book-back-comp-scene1 (top) and mug-microwave-scene6 (bottom). Each pie chart corresponds to a retrieval modality and shows the proportion of retrieved sub-trajectories originating from different LIBERO-90 tasks. Tasks contributing less than 10%10\% of the retrieved data are grouped under “others”.

A.2 Details of Real World Experiments

Real-world shape retrieval reconstructs depth from DROID’s ZED stereo videos through the ZED API, obtains foreground masks with DECOLA, then applies PointNet++. The three camera-view embeddings are averaged for retrieval; trained policies also use all three views.

Physical settings use K=100, segmentation threshold 2×10⁻³, temperature 10 and 50,000 final-policy training steps. The larger temperature softens weights under the greater prior/target mismatch. Other settings follow the simulation pipeline and DROID collection/rollout setup.

A.3 Weight Estimation Implementation Details

Each reference policy trains for 100 epochs. Evaluate summed target-action log-likelihood at epochs 60, 70, 80, 90 and 100, then average the five scores before softmax. Early checkpoints are omitted for high variance; the authors avoid longer reference training because of overfitting.

Each reference policy takes about 40 minutes, with all four trained in parallel; scoring adds about 1.5 minutes. The final policy takes about two hours. The wall-time overhead assumes that parallel capacity and does not quantify total retrieval/feature-pretraining cost or full compute-hours.

Equations 4–5
Sf(e)\displaystyle S_{f}^{(e)} =∑(s,a,ℓ)∈𝒟targetlog⁡πreff(e)​(a∣s,ℓ).\displaystyle=\sum_{(s,a,\ell)\in\mathcal{D}_{\mathrm{target}}}\log\pi_{\mathrm{ref}_{f}}^{(e)}\bigl(a\mid s,\ell\bigr). (4)
Sf\displaystyle S_{f} =15​∑e∈{60,70,80,90,100}Sf(e).\displaystyle=\frac{1}{5}\sum_{e\in\{60,70,80,90,100\}}S_{f}^{(e)}. (5)

A.4 Subsequence Dynamic Time Warping (S-DTW)

DTW minimizes accumulated local costs along a monotone, continuous alignment path, using the previous horizontal, vertical or diagonal cost. Subsequence DTW relaxes endpoint alignment so the entire short query can match a contiguous interval of the longer reference trajectory.

The appendix retains the recurrence and objective definitions, then applies them to modality embeddings and selects the lowest-cost prior segments. It specifies squared Euclidean feature distance, while the main method writes unsquared Euclidean distance; this reproduction discrepancy is preserved and flagged. Correct subsequence boundary initialization is required rather than ordinary full-sequence endpoint constraints.

Equations
DTW​(X,Y)=min⁡∑k=1LP⁡C⁡(xik,yjk),\text{DTW}(X,Y)=\min_{P}\sum_{k=1}^{L}C(x_{i_{k}},y_{j_{k}}),
D⁡(i,j)=C⁡(xi,yj)+min⁡{D⁡(i−1,j),D⁡(i,j−1),D⁡(i−1,j−1)},D(i,j)=C(x_{i},y_{j})+\min\left\{D(i{-}1,j),\ D(i,j{-}1),\ D(i{-}1,j{-}1)\right\},
S-DTW(X,Y)=min1≤s≤e≤mDTW(X,Ys:e),\text{S-DTW}(X,Y)=\min_{1\leq s\leq e\leq m}\text{DTW}(X,Y_{s:e}),
C⁡(i,j)=‖ℱf​(oi)−ℱf​(oj′)‖22.C(i,j)=\left\|\mathcal{F}_{f}(o_{i})-\mathcal{F}_{f}(o^{\prime}_{j})\right\|_{2}^{2}.
Concept demonstration

Open image ↗