Research Topics

My research spans across computer vision, deep learning, multi-modal learning, and AI for science, health, and society.

Computer Vision

Image relighting, image synthesis, 3D reconstruction, scene understanding, human analysis, object detection, context modeling.
View Publications
  1. Preview for Neural Gaffer: Relighting Any Object via Diffusion

    Neural Gaffer: Relighting Any Object via Diffusion

    Haian Jin , Yuan Li , Fujun Luan , Yuanbo Xiangli , Sai Bi , Kai Zhang , Zexiang Xu , Jin Sun and Noah Snavely
    Conference on Neural Information Processing Systems (NeurIPS) (2024)
    Code arXiv
  2. Preview for Black-box Backdoor Defense via Zero-shot Image Purification

    Black-box Backdoor Defense via Zero-shot Image Purification

    Yucheng Shi , Mengnan Du , Xuansheng Wu , Zihan Guan , Jin Sun and Ninghao Liu
    Conference on Neural Information Processing Systems (NeurIPS) (2023)
    Code arXiv
  3. Preview for What’s in a Decade? Transforming Faces Through Time

    What’s in a Decade? Transforming Faces Through Time

    Eric Ming Chen , Jin Sun , Apoorv Khandelwal , Dani Lischinski , Noah Snavely and Hadar Averbuch-Elor
    Eurograhics (2023)
    arXiv

  4. Towers of babel: Combining images, language, and 3d geometry for learning multimodal vision

    Xiaoshi Wu , Hadar Averbuch-Elor , Jin Sun and Noah Snavely
    Proceedings of the IEEE/CVF International Conference on Computer Vision (2021)

  5. Visual chirality

    Zhiqiu Lin , Jin Sun , Abe Davis and Noah Snavely
    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (2020)

  6. Leveraging vision reconstruction pipelines for satellite imagery

    Kai Zhang , Noah Snavely and Jin Sun
    Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops (2019)

Multi-Modal Learning

Cross-modal retrieval and generation, multi-modal representation learning, VLMs and LLMs.
View Publications
  1. Preview for On the opportunities and challenges of foundation models for geospatial artificial intelligence

    On the opportunities and challenges of foundation models for geospatial artificial intelligence

    Gengchen Mai , Weiming Huang , Jin Sun , Suhang Song , Deepak Mishra , Ninghao Liu , Song Gao , Tianming Liu , Gao Cong , Yingjie Hu and others
    ACM Transactions on Spatial Algorithms and Systems (2024)
    arXiv

AI for Science, Health, and Society

View Publications
  1. Preview for On the opportunities and challenges of foundation models for geospatial artificial intelligence

    On the opportunities and challenges of foundation models for geospatial artificial intelligence

    Gengchen Mai , Weiming Huang , Jin Sun , Suhang Song , Deepak Mishra , Ninghao Liu , Song Gao , Tianming Liu , Gao Cong , Yingjie Hu and others
    ACM Transactions on Spatial Algorithms and Systems (2024)
    arXiv

  2. PeanutNeRF: 3D Radiance Field for Peanuts

    Farah Saeed , Jin Sun , Peggy Ozias-Akins , Ye Juliet Chu and Changying Charlie Li
    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (2023)