Update README.md
Browse files
README.md
CHANGED
|
@@ -1,5 +1,72 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: other
|
| 3 |
-
license_name: license
|
| 4 |
-
license_link: LICENSE
|
| 5 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: other
|
| 3 |
+
license_name: license
|
| 4 |
+
license_link: LICENSE
|
| 5 |
+
---
|
| 6 |
+
<div align="center">
|
| 7 |
+
<h1>WildCross: A Cross-Modal Large Scale Benchmark for Place Recognition and Metric Depth Estimation in Natural Environments</h1>
|
| 8 |
+
|
| 9 |
+
[**Joshua Knights**](https://scholar.google.com/citations?user=RxbGr2EAAAAJ&hl=en)<sup>1,2</sup> 路 **Joseph Reid**<sup>1</sup> 路 [**Mark Cox**](https://scholar.google.com/citations?user=Bk3UD4EAAAAJ&hl=en)<sup>1</sup>
|
| 10 |
+
<br>
|
| 11 |
+
[**Kaushik Roy**](https://bit0123.github.io/)<sup>1</sup> 路 [**David Hall**](https://scholar.google.com/citations?user=dosODoQAAAAJ&hl=en)<sup>1</sup> 路 [**Peyman Moghadam**](https://scholar.google.com.au/citations?user=QAVcuWUAAAAJ&hl=en)<sup>1,2</sup>
|
| 12 |
+
|
| 13 |
+
<sup>1</sup>DATA61, CSIRO   <sup>2</sup>Queensland University of Technology
|
| 14 |
+
<br>
|
| 15 |
+
|
| 16 |
+
<a href=""><img src='https://img.shields.io/badge/arXiv-WildCross-red' alt='Paper PDF'></a>
|
| 17 |
+
<a href=''><img src='https://img.shields.io/badge/Project_Page-WildCross-green' alt='Project Page'></a>
|
| 18 |
+
<a href='https://huggingface.co/CSIRORobotics/WildCross'><img src='https://img.shields.io/badge/Dataset_Download-WildCross-blue'></a>
|
| 19 |
+
</div>
|
| 20 |
+
|
| 21 |
+
This repository contains the pre-trained checkpoints for a variety of tasks on the WildCross benchmark
|
| 22 |
+
|
| 23 |
+

|
| 24 |
+
|
| 25 |
+
If you find this repository useful or use the WildCross dataset in your work, please cite us using the following:
|
| 26 |
+
```
|
| 27 |
+
@misc{knights2025wildcross,
|
| 28 |
+
title={{WildCross: A Cross-Modal Large Scale Benchmark for Place Recognition and Metric Depth Estimation in Natural Environments}},
|
| 29 |
+
author={Joshua Knights, Joseph Reid, Mark Cox, Kaushik Roy, David Hall, Peyman Moghadam},
|
| 30 |
+
year={2025},
|
| 31 |
+
eprint={xxxxxxxxx},
|
| 32 |
+
archivePrefix={arXiv},
|
| 33 |
+
primaryClass={cs.CV},
|
| 34 |
+
url={https://arxiv.org/abs/xxxxxxxxxx},
|
| 35 |
+
}
|
| 36 |
+
|
| 37 |
+
|
| 38 |
+
```
|
| 39 |
+
|
| 40 |
+
## Download Instructions
|
| 41 |
+
Our dataset can be downloaded through the [**CSIRO Data Access Portal**](''). Detailed instructions for downloading the dataset can be found in the README file provided on the data access portal page.
|
| 42 |
+
|
| 43 |
+
|
| 44 |
+
## Training and Benchmarking
|
| 45 |
+
Here we provide pre-trained checkpoints for a variety of tasks on WildCross.
|
| 46 |
+
|
| 47 |
+
**Visual Place Recognition**
|
| 48 |
+
### Checkpoints
|
| 49 |
+
| Model | Checkpoint Folder|
|
| 50 |
+
|------------|------------|
|
| 51 |
+
| NetVlad | [Link](https://huggingface.co/CSIRORobotics/WildCross/tree/main/VPR/NetVLAD) |
|
| 52 |
+
| MixVPR | [Link](https://huggingface.co/CSIRORobotics/WildCross/tree/main/VPR/MixVPR) |
|
| 53 |
+
| SALAD | [Link](https://huggingface.co/CSIRORobotics/WildCross/tree/main/VPR/SALAD) |
|
| 54 |
+
| BoQ | [Link](https://huggingface.co/CSIRORobotics/WildCross/tree/main/VPR/BoQ) |
|
| 55 |
+
|
| 56 |
+
**Cross Modal Place Recognition**
|
| 57 |
+
### Checkpoints
|
| 58 |
+
| Model | Checkpoint Folder|
|
| 59 |
+
|------------|------------|
|
| 60 |
+
| Lip-Loc (ResNet50) | [Link](https://huggingface.co/CSIRORobotics/WildCross/tree/main/crossmodal/resnet50) |
|
| 61 |
+
| Lip-Loc (Dino-v2) | [Link](https://huggingface.co/CSIRORobotics/WildCross/tree/main/crossmodal/dinov2) |
|
| 62 |
+
| Lip-Loc (Dino-v3) | [Link](https://huggingface.co/CSIRORobotics/WildCross/tree/main/crossmodal/dinov3) |
|
| 63 |
+
|
| 64 |
+
**Metric Depth Estimation**
|
| 65 |
+
### Checkpoints
|
| 66 |
+
| Model | Checkpoint Folder|
|
| 67 |
+
|------------|------------|
|
| 68 |
+
| DepthAnythingV2-vits | [Link](https://huggingface.co/CSIRORobotics/WildCross/resolve/main/DepthAnythingV2/finetuned/vits.pth) |
|
| 69 |
+
| DepthAnythingV2-vitb | [Link](https://huggingface.co/CSIRORobotics/WildCross/resolve/main/DepthAnythingV2/finetuned/vitb.pth) |
|
| 70 |
+
| DepthAnythingV2-vitl | [Link](https://huggingface.co/CSIRORobotics/WildCross/resolve/main/DepthAnythingV2/finetuned/vitl.pth) |
|
| 71 |
+
|
| 72 |
+
For instructions on how to use these checkpoints for training or evaluation, further instructions can be found on the [WildCross GitHub repository]().
|