Jacob Gong

Jacob Gong

CS Researcher at Columbia University

I am a Computer Science student at Columbia University, working as a Research Assistant at the Creative Machine Lab. My research interests span robotics, computer vision, and GPU simulation, with a focus on soft robot co-design, world models, and 3D reconstruction.

News

  • Aug 2025 Started as Research Assistant at Creative Machine Lab, Columbia University
  • Aug 2025 Joined Columbia University as a BA student in Computer Science
  • Jan 2025 Joined Distributed and Mobile Sensing Computing Group at CityU HK
  • Aug 2023 Started BS in Computer Science at City University of Hong Kong

Projects

Task-Agnostic Robot Self-Modeling

A pipeline to reconstruct robot URDFs from 2D video using vision foundation models and 3D reconstruction.

Computer Vision Robotics 3D Reconstruction

Voxel-Based Soft Robot Co-Design

Two GPU-accelerated frameworks for joint morphology-control co-optimization of voxel-based soft robots.

Robotics GPU Simulation Evolutionary Optimization

DriftWorld — World Model Framework for Robot Manipulation

A unified framework comparing four generative architectures (VAE, DDPM, Flow Matching, Drifting Models) for learning robot world models. Flow Matching at 5 Euler steps achieves the best rollout stability.

Generative Models Robotics World Models DiT
View all projects →

Publications

Coming soon.

Recent Posts

Welcome to My Blog

March 21, 2026

Welcome! This is my personal blog where I plan to share thoughts on my research in robotics, generative models, computer vision, and GPU simulation, as well as interesting things I...

View all posts →

Awards & Coursework

Awards

  • Dean's List — All Semesters — City University of Hong Kong
  • iGPA 3.90/4.0 (Top 7%) — City University of Hong Kong

Selected Coursework

  • Advanced Programming
  • Project in MECH ENG
  • Computational Probability Modeling
  • Advanced Algorithms
  • Software Design
  • Machine Learning