Tianyi Xiao

Tianyi Xiao

Ph.D. candidate and lecturer in ETH Zürich.

Projects

VR/AR

3DSM-MVP

2025

3D Sketch Mapping Minimum Viable Product (3DSM-MVP) is an open-sourced spatial cognition research tool, providing table calibration, reference images, 2D/3D sketching, colors (green, blue, red), export, eraser, and redo/undo functions.

AR 3D Sketch Mapping Minimum Viable Product
📄 Readme 📦 PC Version

Preset Layers VResin

2025

An enhanced version of VResin that allows users to import pre-set images and automatically generates 3D layers for drawing.

VR 3D Sketch Mapping Preset Layers Image Import Tangible Interface
📦 APK 📦 PC Version 📄 Readme 🎥 Video

Sketch2Terrain

2025

Sketch2Terrain is an intuitive generative-3D-sketch-mapping system combining freehand sketching with generative Artificial Intelligence that radically changes sketch map creation and representation using Augmented Reality.

AR Generative AI 3D Sketch Mapping Complex Terrain Spatial Cognition
📄 Paper 🎥 Video 💻 Code 📊 Dataset

VResin

2024

VResin enables users to externalize spatial memory of multi-layer buildings into 3D sketch maps using a layer-by-layer interface.

VR 3D Sketch Mapping Spatial Cognition Multilayer Building Tangible Interface
📄 Paper 🎥 Video

HoloSpot

2022

HoloSpot is a course project in the Mixed Reality course provided by Computer Vision and Geometry Group at ETH Zürich. HoloSpot provides 3 different methods (gesture, spatial anchor, and joystick) to control the Boston Dynamics Spot in HoloLens 2.

MR Human-robot Interaction Boston Dynamics Spot HoloLens 2
🎥 Video 💻 Code

Agent-based Modelling

MotionSim+

2022

MotionSim+ is a pedestrian simulation app that can simulate physical-distancing moving behaviors during COVID-19.

Pedestrian Simulation ABM Spatial Analysis Risk Assessment
📄 Paper

AutoDesign

2022

AutoDesign is a multi-agent app for urban amenities relocation based on walkability optimization. This intelligent system helps urban planners automatically relocate facilities to improve neighborhood walkability and accessibility.

Urban Design ABM Spatial Analysis Walkability Optimization
📄 Intro 🎥 Video