From Eye to AI: Digital Phantoms for Medical Imaging

Course homepage • syllabus, schedule, assignments, and resources

Download Syllabus (PDF) Join Class Slack/Discord Office Hours

Quick Facts

Instructor

Professor Joe Xing (contact@joexing.me)

Time & Location

Fridays / Zoom

Office Hours

Wed 10:00–11:00 (by appointment)

Prerequisites

Introduction to Programming (C Sharp, Python) ;Algebra & Geometry; Introduction to Machine Learning / Data Science (recommended, not mandatory)

Announcements

Sept 19, 2025
HW1 released: Use simple Python code to reconstruct CT medical images, test reconstruction algorithms using the Shepp Logan digital phantoms. Due Sept 26, 2025.
Sept 26, 2025
HW2 released: Using the Eye–Brain test repo we discussed in class, implement a MonoBehaviour script called EyeController and BrainController that separately controls two existing GameObjects (e.g., Eye and Brain) under each set of EyeBrain GameObject (just random pick one from three). The controller should move those two GameObjects (eye and brain) according to simple rules. You can define your own rules of motion, linear motion, spinning, rotation, so on and so forth. Due October 3, 2025.
Sept 19, 2025
Lecture 1 slides released: Download
Sept 26, 2025
Lecture 2 slides released: Download
October 9, 2025
Lecture 3 slides released: Download
October 9, 2025
Lecture 4 slides released: Download

Course Syllabus & Quick Overview

WeekTopicTeaching elementsSlides
W1 Introduction & Course Overview Welcome, course objectives, expected outcomes Why digital phantoms matter in medicine and AI Intro to Unity3D and tour of the 3D environment HW1 out
W2 Unity3D Basics Setting up projects and Unity interface Importing 3D assets and basic rendering Hands-on: create your first 3D object! HW1 due; HW2 out
W3 Anatomy Meets 3D Introduction to eye anatomy (focus on structures we’ll model) How to translate anatomy data into 3D models Demo: simple 3D eye structure in Unity HW2 due;
W4 Coding in Unity3D Introduction to C# scripting in Unity3D, design patterns such as object pooling, factory, etc. Generic class, multiple inheritance / interfaces. HW4 out

Assignments & Projects

Due Sept 26, 23:59, 2025

HW1 — Shepp Logan phantom

Reconstruct medical images using Shepp Logan digital phantom.

Download

Due Oct 3, 23:59, 2025

HW2 — Unity3D Setup

Implement monobehavior script component to game objects to control the eye motion.

Download

Due Oct 17, 23:59, 2025

HW4 — Unity3D Coding

Implement your own object pool to spawn and recycle game objects.

Download

Resources

Contact & Policies

Email: contact@joexing.me • Response within 48 hrs

Accessibility & accommodations honored. Academic integrity required; cite all sources.