Ashwath Shetty (New Cursor Powered website Coming Soon)
I'm an incoming PhD student at UdeM and MILA under Noam Aigermann working on Neural Geometry Processing
Before this, I was a visiting researcher under Prof Soren Pirk at Kiel University where I worked on time independent diffusion models and discrete prompt inversion, and prior I spend some
time doing XAI the Computer Vision and Machine Learning Department, and full body avatars at the Visual Computing and AI Department, at the Max Planck Insitute in Saarbrücken,
where I did my masters thesis on virtual avatars (the animation in my profile picture is my thesis :). Previosly I worked as Research Assistant under Avinash Sharma on 3D Performance Capture at the CVIT Lab in IIIT Hyderabad. I got my Bachelor degree from beautiful MIT Manipal Karnataka, and did my bachelors thesis at IIT Bombay under Ganesh Ramakrishnan.
Hobbies and free time activities:Running, Meditation, Hiking, Martial Arts, Wind instruments (Bamboo Flute and Harmonica), Irish Dancing, Chess (I'm just average in all of them :))
I'm primarily interested in computer vision, machine learning, optimization, geometry processing and the intersection of these fields. Most of my previous research has covered diverse aspects of modelling humans in motion in a photorealistic and efficient way, however I am eager to learn more about robust representation learning, interpretibility, and neuroscience. If you have any projects where you think I could be useful or could learn from, feel free to reach out.
Investigated prompt-stealing attacks on diffusion models, revealing a noise-generation vulnerability (CWE-339) that enables seed recovery. Introduced SeedSnitch for seed brute-forcing and PromptPirate, a genetic algorithm-based optimization method that achieves 8-11% improvement in LPIPS similarity over state-of-the-art prompt stealing methods.
Proposed a method, for deocclusion for Head Mounted Displays, and integration with Virtual Reality
Selected Experience (See CV for more)
Research Assistant at the Kiel University ( supervised by Soren Pirk) (Jan 2025-August 2025)
Time independent diffusion models Worked on a new forward and backward process for diffusion models, that don't take time as a conditioning signal
Discrete prompt inversion Worked a discrete prompt inversion method for Prompt Stealing
Research Assistant at the CVML Department, Max Planck Insitute for Informatics ( supervised by Jonas Fischer) (March 2024 -December 2024)
Sparse Compositional interpretibility Understanding the link between sparsity
and interpretability, and using a sparse network to read off a networks decision making process
Research Assistant at the VCAI Department, Max Planck Insitute for Informatics ( supervised by Marc Habermann and Christian Theobalt) (July 2022-Jan 2024)
Holoported Characters Built an animatable human representation, that takes an sparse images and 3D pose, and can render humans in arbitrary viewpoints at 4K resolution (Selected as one of the inaugaral VIA centre projects)
Research Assistant at the Centre for Visual Information Technology, IIIT Hyderabad ( supervised by Avinash Sharma) (July 2020-Jan 2022)
3D SMPL+D Registration
Setup a multi stage pipeline for fitting SMPL followed by SMPL+D to a 3D human scan. (Sample Results)
Face Deocclusion
Research on Face Deocclusion and Reconstruction, from videos
Some other cool projects
Data generation pipeline from stylgan and styleflow (Sample Results), Event Camera based SMPL Tracking
Research Intern at DreamVu ( supervised by Avinash Sharma and Anoop Namboodiri) (July 2022-Present)
3D Dance Capture Worked on TSDF fusion mesh details, with deep learning models for faces (Sample Results)
Online Courses and Summer Schools
I enjoy learning, so I do spend a lot of my time doing online courses in random and sometimes relevant topics.
Certified: (Link to Certificates) Algorithms (Stanford), Probabilistic Graphical Models (Stanford), Deep Learning (deeplearning.ai), Tensorflow in Practice (deeplearning.ai), Machine Learning(Stanford), Advanced Machine Learning (HSE), Reinforcement Learning (UAlberta), Programming Languages (UWash)
Online Audit: Calculus (MIT), Math for CS (MIT), Linear Algebra (MIT), CNNs for Vision (Stanford), NLP with Deep Learning (Stanford), Learning from Data (Caltech), Interactive Computer Graphics (Udacity), Computer Vision (Udacity\&Gtech), Practical DL for coders (fast.ai), Deep Learning (NYU)
Summer Schools: Easter European Machine Learning, ACM Graph Theory and Graph Algorithms
I feel with the amount of information out there, anyone with a laptop and good interent connection can learn whatever they want to, I owe a lot of skillset to online courses and material, and one of my goals is to teach and contribute to a MOOC (If I can help in any way please reach out)
Feel free to steal this website's source code. Do not scrape the HTML from this page itself, as it includes analytics tags that you do not want on your own website — use the github code instead. Also, consider using Leonid Keselman's Jekyll fork of this page.