I lead the Creative and Applied AI Tools (CAAT) group within NVIDIA Toronto AI Lab, with the focus on 1) application of AI to creative tools and research to enable such applications, 2) efforts to accelerate 3D Deep Learning research. Our goal is both to develop new research, and release cutting-edge technology that fuels practical tools for researchers and artists.

News
Aug 2024
Kaolin Library hosts a hands-on lab at SIGGRAPH, Thursday, Aug 1.
Dive Into 3D Deep Learning, Physics Simulation and Interactive 3D Prototyping!
Jul 2024
Kaolin Library releases physics simulation, easy diff. rendering and much more.
Kudos Clement, Vismay Modi and team!
Jul 2024
Our Diffusion Texture Painting paper at SIGGRAPH gets featured on Two Minute Papers.
Kudos Anita & team!
Aug 2023
Our AI Material Demo won Best-In-Show at SIGGRAPH Real-Time Live!
Kudos Hassan & team!
Creative Tool Demos & Prototypes
Diffusion Texture Painting
at SIGGRAPH Asia Real-Time Live!
2023
watch
code
*note: my name cut off from slide
AI Materials, "Best-in-Show"
at SIGGRAPH Real-Time Live!
2023
watch
AI Animal Explorer
NVIDIA Omniverse Extension
2022
watch
Playful Palette
at Adobe MAX Sneaks
2017
watch
NVIDIA Kaolin Library for Interactive 3D AI Research
Kaolin Library Overview
Mix-and-match tools for your interactive research
GitHub
docs & installation
Physics Simulation for All
Simulate any 3D input in a few lines
v0.16.0
about
try now
Differentiable PBR Shader
One liner to render USD, obj, gltf
v0.16.0
about
try now
Simple 3D Mesh Management
Simplify mesh management in PyTorch
v0.15.0
about
watch
try now
Interactive Jupyter 3D Viewer
Prototype apps for any renderer
v0.15.0
about
watch
try now
Talks
Computer Graphics and AI: A New Perspective
Panel with industry researchers
2023
Creative Tools in the Age of AI
Talk at the Sketching for Human Expressivity Workshop
2022
3D Art Meetup: The Future of AI
Discussion with game industry
2021
Designing Playful and Intelligent Creative Tools
Doctorate thesis award talk
2021
Publications
Diffusion Texture Painting
A. Hu, N. Desai, H. Abu Alhaija, S. Wook Kim, M. Shugrina SIGGRAPH 2024
In the Press:
Designing Intelligent Tools for Creative People
M. Shugrina IEEE Computer Graphics and Applications 2023
Neural Brushstroke Engine: Learning a Latent Style Space of Interactive Drawing Tools
M. Shugrina, C. Li and S. Fidler SIGGRAPH Asia (TOG) 2022
XDGAN: Multi-Modal 3D Shape Generation in 2D Space
H. Abu Alhaija, A. Dirik, A. Knörig, S. Fidler and M. Shugrina BMVC 2022
ATISS: Autoregressive Transformers for Indoor Scene Synthesis
D. Paschalidou, A. Kar, M. Shugrina, K. Kreis, A. Geiger and S. Fidler NeurIPS 2021
3DStyleNet: Creating 3D Shapes with Geometric and Texture Style Variations
K. Yin, J. Gao, M. Shugrina, S. Khamis and S. Fidler ICCV 2021
Nonlinear Color Triads for Approximation, Learning and Direct Manipulation of Color Distributions
M. Shugrina, A. Kar, S. Fidler and K. Singh SIGGRAPH 2020
Live Demo
Neural Turtle Graphics for Modeling City Road Layouts
Hang Chu, D. Li, D. Acuna, A. Kar, M. Shugrina, X. Wei, M. Liu, A. Torralba, S. Fidler ICCV 2019
Creative Flow+ Dataset
M. Shugrina, Z. Liang, A. Kar, J. Li, A. Singh, K. Singh and S. Fidler CVPR 2019
Color Builder: a Direct Manipulation Interface for Versatile Color Theme Authoring
M. Shugrina, W. Zhang, F. Chevalier, S. Fidler and K. Singh CHI 2019
Live Demo
Generating Playful Palettes from Images
S. DiVerdi, J. Lu, J. Echevarria and M. Shugrina Expressive 2019
Playful Palette: An Interactive Parametric Color Mixer for Artists
M. Shugrina, J. Lu, and S. DiVerdi SIGGRAPH 2017
In the Press:
Fab Forms: Customizable Objects for Fabrication with Validity and Geometry Caching
M. Shugrina, A. Shamir, and W. Matusik SIGGRAPH 2015
In the Press:
Large Scale Language Modeling in Automatic Speech Recognition
C. Chelba, D. Bikel, M. Shugrina, P. Nguyen, and S. Kumar Google Technical Report 2012
Formatting Time-aligned ASR Transcripts for Readability
M. Shugrina NAACL HLT 2010
An Audio Indexing System for Election Video Material
C. Alberti, M. Bacchiani, A. Bezman, C. Chelba, A. Drofa, H. Liao, P. Moreno, T. Power, A. Sahuguet, M. Shugrina, O. Siohan ICASSP 2009
Empathic Painting: Interactive Stylization through Observed Emotional State
M. Shugrina, M. Betke, and J. Collomosse NPAR 2006
In the Press:
Doctorate Work
My thesis The Design of Playful and Intelligent Creative Tools is here. Digital technology offers an unprecedented ability to craft our own creative media, and machine intelligence holds boundless potential for empowering creativity. How does one approach design when nearly anything is possible? This thesis addresses the problem of building new creative tools, with intelligence in the interactive loop, without losing sight of the human creators and their needs. Work collected here has been published as first author paper in the top-tier venues of three major domains, including twice at SIGGRAPH (graphics), CVPR (computer vision), and CHI (human computer interaction).
Go to colorsandbox.com for demos of my work on color.