Multi-Episode Access Status
Current status: access to the gated full ropedia-ai/xperience-10m dataset is
granted, and a metadata-only Hugging Face audit has been completed. A selected
128-episode pilot has produced a verified diagnostic Qwen3-Omni LoRA package
with held-out evaluation. The result is useful as a pipeline and error-analysis
baseline, not as a strong final model.
This file records the public data-access status and pilot requirements. It does not include local-machine aliases, private paths, SSH hosts, or token locations.
Selection Plan
| Item | Value |
|---|---|
| Dataset | ropedia-ai/xperience-10m |
| Minimum pilot gate | 32 complete leaf episodes |
| Strategy | stratified round-robin across top-level session UUIDs |
| Metadata-audited visible complete episodes | 12,102 |
| Metadata-audited complete sessions | 802 |
| Current selected pilot | 128 source-balanced episodes |
| Recommended split | 96 train / 16 val / 16 test |
| Recommended estimated download | 277.71 GiB excluding visualization.rrd |
| Representative 32-episode estimate | ~70.5 GiB at median episode size |
| Smallest one-per-session 32-episode estimate | 35.35 GiB |
| Excluded file | visualization.rrd |
Current Stage
The current Qwen3-Omni artifacts include a verified validation-monitored diagnostic held-out run: 96/16/16 selected train/val/test episodes, 3,808 exported windows, 2,848 train examples, 512 validation examples, and 448 held-out test predictions from 14 exported test episodes. Training used eight distributed accelerator processes for one epoch with LoRA rank 16 and recorded a final train loss of 0.4130 plus a validation loss of 0.0331. The result verifies the multi-episode pipeline and gives a real error-analysis baseline; it is still not a strong final model.
A stronger model-quality pilot should be claimed only after:
- selected valid episodes are available locally,
- the manifest builder confirms complete held-out episode splits,
- training finishes with recorded metadata and progress logs,
- evaluation runs on held-out test episodes,
- predictions, metrics, confusion matrices, and a run report are committed.
- JSON validity and action/subtask metrics improve beyond the current diagnostic baseline.
Current diagnostic metrics:
- JSON validity: 87.50%
- action macro-F1: 0.0027
- subtask accuracy: 0.0067
- transition accuracy: 0.8504
- next-action accuracy: 0.0246
- contact accuracy: 0.6451
- object micro-F1: 0.2230
The public data access summary is:
results/omni_finetune/DATA_ACCESS_STATUS.md
The current metadata-only full dataset audit is:
results/omni_finetune/FULL_DATASET_METADATA_AUDIT.md
The current 128-episode source-balanced download plan is:
results/omni_finetune/XPERIENCE10M_128_EPISODE_SELECTION.md
The current verified diagnostic package is:
docs/data/omni_finetune_verified_result.json
results/omni_finetune/verified_public/
The older machine-generated source discovery report remains a pre-access local planning record:
results/omni_finetune/DATA_BLOCKER_REPORT.md