Anirban Ray

Anirban Ray

PhD Researcher | PMRF Fellow

Indian Institute of Technology, Delhi

World Modelling · SE(3) Equivariance · Deep Learning

Education B.Tech (IIT Dhanbad) · PhD (IIT Delhi)
Fellowship Prime Minister's Research Fellowship (PMRF)

About

I am a PhD researcher at IIT Delhi, working on World Modelling and SE(3) Equivariant Learning for molecular generation and simulation. I am honored to be a Prime Minister's Research Fellow (PMRF), India's most prestigious PhD fellowship.

My research focuses on developing scalable approaches to learning equivariance in molecular systems. Traditional architectures that hardcode equivariance struggle to scale to larger molecules like proteins or handle complex molecular tasks. My work explores learning equivariance from randomly rotated molecules using world modelling techniques, training models with over 170 million parameters.

Thesis Work

Learning SE(3) Equivariance in Molecular Generation with World Modelling

Challenge: Hardcoding equivariance into architectures limits scalability to larger molecules (like proteins) and complex molecular tasks. Learning equivariance from randomly rotated molecules is essential.

Approach: I develop a solution using point cloud representations of molecules voxelized with Gaussian noise. The system employs:

  • VQ-VAE for latent space generation
  • Denoising Autoencoder (DAE) as a world model to invert rotations and learn the data manifold through one-step denoising

Scale: Successfully trained a 170 million parameter model for this task, demonstrating the approach's scalability and effectiveness.

World Modelling SE(3) Equivariance VQ-VAE Molecular Generation Deep Learning

Selected Projects

Latent Diffusion Models for Image Generation

COL775 · Prof. Parag Singla · IIT Delhi

Developed a two-stage architecture: (1) Encoder-decoder with slot attention producing 11 slots trained on CLEVERTex dataset, (2) Diffusion model with U-Net architecture using cross-attention with slots for conditional image generation.

Diffusion Models Slot Attention U-Net

Seq2Seq Translation: Text to Math Expression

COL775 · Prof. Parag Singla · IIT Delhi

Implemented sequence-to-sequence translation with attention mechanisms, comparing GloVe and BERT embeddings. LSTM decoder used for generating mathematical expressions from natural language text.

Seq2Seq Attention LSTM BERT

Indian Bird Species Classification

COL775 · Prof. Parag Singla · IIT Delhi

Built ResNet architecture (VGG16-inspired) for bird species classification. Explored various normalization techniques (Batch, Group, Layer, Instance, Batch-Instance) and generated attention maps using Grad-CAM for explainability.

ResNet Normalization Grad-CAM Computer Vision

Experience

July 2023 - Present

PhD Researcher · PMRF Fellow

Indian Institute of Technology, Delhi

CGPA: 8.10/10.0

Research in World Modelling and SE(3) Equivariant Learning for molecular systems.

Coursework
  • Machine Learning (ELL784)
  • Machine Learning Practical (AIP701)
  • Deep Learning (COL775)
  • Computer Vision (AIL861)
  • Optimization (CRL734)
  • Signal Theory (ELL711)
  • Detection and Estimation (ELL719)
  • Biomedical Data Analysis (BML738)
  • Mathematical Foundations for Minds (AIL701)
Sept 2022 - Dec 2022

Associate Software Engineer

Uzio

  • Full-cycle software development from requirement gathering to deployment
  • Unit testing and code quality assurance for SaaS platform features
  • Collaborated with product and tech teams for iterative improvements
  • Pushed code to production versions of SaaS software
July 2018 - May 2022

Bachelor of Technology

Indian Institute of Technology (ISM), Dhanbad

CGPA: 8.40/10.0

Achievements

🏆

Prime Minister's Research Fellowship (PMRF)

Awarded India's most prestigious PhD fellowship worth over $70,000 USD for 5 years at IIT Delhi. Recognizes exceptional research potential and academic excellence.

💎

Copper Scholarship

Received the Copper Club Scholarship worth $10,000 USD to fund undergraduate studies at IIT Dhanbad.

🎯

JEE Advanced & Mains

Secured 99.8+ percentile among 1.3 million students in India's most competitive engineering entrance examination to gain admission to IIT Dhanbad.

🌏

Nepal AI School

Presented world modelling research at Nepal AI School, sharing insights on SE(3) equivariant learning with the international AI research community.

Get in Touch

I'm always interested in discussing research collaborations, innovative projects, or opportunities in deep learning and molecular modelling.

Location

IIT Delhi, New Delhi, India