Bridging the
2 About Me 2022: PhD (KAIST, South Korea)
3 Introduction Note: past and current works from our group start with
4 The image is from https://bridging-navigation.github.io/website/
5 ▸ Complex
6 Robot Navigation Applications: (Map-based)
7 Lifelong Robot Navigation
8 Map Maps
9 Memory May
10 Why Memory? A robot is now an
11 Language Instruction and Interactive Navigation Embodied agent:
12 Embodied agent uses Robotic Memory for
13 Using ChatGPT, generated by myself. Human-robot Interactive Navigation –
14 Using ChatGPT, generated by myself. Human-robot Interactive Navigation –
15 Human-robot Interactive Navigation – Key Challenges
16 Sol 1: LT-Mem (Best Paper / Best Student Paper Award Finalist)
17 Human-robot Interactive Navigation – Key Challenges
18 Sol 2) MR.ScaleMaster
19 Lifelong Navigation Memory Construction and Management
20 Recap: Robot Mapping Geometrically faithful representations
21 Recap: Robot Mapping Toward higher-level scene understanding
22 The history of 3D Reconstruction Building Rome in a day, ICCV 2019
23 LiDAR-based 3D Reconstruction: 1.
24 LiDAR-based 3D Reconstruction: 1.
25 LiDAR-based 3D Reconstruction: 1.
26 LiDAR-based 3D Reconstruction: 1.
27 LiDAR-based 3D Reconstruction: 1.
28 Lifelong Mapping (LT-mapper) A Modular Framework for
29 Lifelong Mapping (LT-mapper) P
30 Lifelong Mapping (LT-mapper) Tri-map system
31 Lifelong Mapping (LT-mapper) — Limitations
32 Lifelong Mapping ( ELite
33 Lifelong Mapping ( ELite
34 Lifelong Mapping — Lessons Learned
35 Lifelong Mapping — Lessons Learned
36 Lifelong Mapping — Lessons Learned
37 Lifelong Mapping — Lessons Learned
38 Lifelong Mapping — Lessons Learned
39 Geometric foundation model (GFM) for Visual SLAM Dust3r: Geometric 3d vision made easy, CVPR 2024
40 How to use GFMs for multi-robots unknown each other? Many GFMs recently
41 How to use GFMs for multi-robots unknown each other? Problem definition
42 How to use GFMs for multi-robots unknown each other? Scale
43 How to use GFMs for multi-robots unknown each other? Scale
44 How to use GFMs for multi-robots unknown each other? Scale
45 How to use GFMs for multi-robots unknown each other? Scale
46 MR.ScaleMaster ▸
47 MR.ScaleMaster ▸
48 MR.ScaleMaster ▸
49 MR.ScaleMaster ▸
50 MR.ScaleMaster : A good perception system for reasoner
51 LT-Mem: Lifelong Memory Management System Results
52 LT-mem: Lifelong Memory Management System Lifelong scene understanding
53 Existing works: Lifelong Spatial Mapping
54 Existing works: Memory for scene understanding
55 Existing works vs. LT-Mem Capability
56 LT-mem: The proposed pipeline ▸ LT-Mem: Volatility-Aware
57 LT-mem: Lifelong Memory Management System Lifelong Memory Management
58 LT-mem: Lifelong Memory Management System Perception stage
59 LT-mem: Lifelong Memory Management System Tri-memory system
60 LT-mem: Lifelong Memory Management System Volatility-aware memory updates
61 LT-mem: Lifelong Memory Management System ▸ LT-Mem: Volatility-Aware
62 LT-mem: Lifelong Memory Management System Lifelong scene understanding: The example
63 LT-mem: Lifelong Memory Management System Volatility-aware memory updates
64 LT-mem: Lifelong Memory Management System Volatility-aware memory updates
65 LT-mem: Lifelong Memory Management System Volatility-aware memory updates
66 LT-mem: Lifelong Memory Management System Long-term Navigation VQA (LT-VQA dataset)
67 LT-mem: Lifelong Memory Management System Long-term Navigation VQA (LT-VQA dataset)
68 LT-mem: Lifelong Memory Management System Long-term Navigation VQA (LT-VQA dataset)
69 LT-mem: Lifelong Memory Management System Both effective and efficient.
70 Future directions and Ongoing Projects
71 What We’ve Built So Far :
72 Understanding Human-like Instructions
73 Human-like instructions?
74 Human-like instructions?
75 NaViRrator :
76 NaViRrator :
77 Multi-hop Bidirectional Interactions for Disambiguation
78 Thanks to the all Researchers and Collaborators! You!

All slides