Publications

Dolphins: Multi-modal Language Model for Driving
Yingzi Ma, Yulong Cao, Jiachen Sun, Marco Pavone, Chaowei Xiao
ECCV 2024
Leveraging Hierarchical Feature Sharing for Efficient Dataset Condensation
Haizhong Zheng, Jiachen Sun, Shutong Wu, Bhavya Kaikhura, Zhuoqing Mao, Chaowei Xiao, Atul Prakash
ECCV 2024
AdaShield: Safeguarding Multimodal Large Language Models from Structure-based Attack via Adaptive Shield Prompting
Yu Wang, Xiaogeng Liu, Yu Li, Muhao Chen, Chaowei Xiao
ECCV 2024
RealGen: Retrieval Augmented Generation for Controllable Traffic Scenarios
Wenhao Ding, Yulong Cao, Ding Zhao, Chaowei Xiao, Marco Pavone
ECCV 2024
On the exploitability of reinforcement learning with human feedback for large language models
Jiongxiao Wang, Junlin Wu, Muhao Chen, Yevgeniy Vorobeychik, Chaowei Xiao
ACL 2024
Position Paper: TrustLLM: Trustworthiness in Large Language Models
Yue Huang, Lichao Sun, Haoran Wang, Siyuan Wu, Qihui Zhang, Yuan Li, Chujie Gao, Yixin Huang, Wenhan Lyu, Yixuan Zhang, Xiner Li, Hanchi Sun, Zhengliang Liu, Yixin Liu, Yijue Wang, Zhikun Zhang, Bertie Vidgen, Bhavya Kailkhura, Caiming Xiong, Chaowei Xiao et al.
ICML 2024
PerAda: Parameter-Efficient Federated Learning Personalization with Generalization Guarantees
Chulin Xie, De-An Huang, Wenda Chu, Daguang Xu, Chaowei Xiao, Bo Li, Anima Anandkumar
CVPR 2024
Do Not Listen To Me: Understanding and Exploring Jailbreak Prompts of Large Language Models
Zhiyuan Yu, Xiaogeng Liu, Shuning Liang, Zach Cameron, Chaowei Xiao, Ning Zhang
USENIX Security 2024
ChatGPT as an Attack Tool: Stealthy Textual Backdoor Attack via Blackbox Generative Model Trigger
Jiazhao Li, Yijin Yang, Zhuofeng Wu, V.G. Vinod Vydiswaran, Chaowei Xiao
NAACL 2024
Instructional fingerprinting of large language models.
Jiashu Xu, Fei Wang, Mingyu Derek Ma, Pang Wei Koh, Chaowei Xiao, Muhao Chen.
NAACL 2024
Instructions as Backdoors: Backdoor Vulnerabilities of Instruction Tuning for Large Language Models
Jiashu Xu, Fei Wang, Mingyu Derek Ma, Chaowei Xiao, Muhao Chen
NAACL 2024
From Shortcuts to Triggers: Backdoor Defense with Denoised PoE
Qin Liu, Fei Wang, Chaowei Xiao, Muhao Chen
NAACL 2024
Cognitive Overload: Jailbreaking Large Language Models with Overloaded Logical Thinking
Nan Xu, Fei Wang, Ben Zhou, Bangzheng Li, Chaowei Xiao, Muhao Chen
NAACL Findings 2024
Reinforcement Learning with Human Feedback for Realistic Traffic Simulation
Yulong Cao, Boris Ivanovic, Chaowei Xiao, Marco Pavone
ICRA 2024
Prismer: A Vision-Language Model with Multi-Task Experts
Shikun Liu, Linxi Fan, Edward Johns, Zhiding Yu, Chaowei Xiao, Anima Anandkumar
TLMR 2024
Voyager: An open-ended embodied agent with large language models
Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, Anima Anandkumar
TLMR 2024

* denotes equal contribution
AutoDAN: Generating Stealthy Jailbreak Prompts on Aligned Large Language Models.
Xiaogeng Liu, Nan Xu, Muhao Chen, Chaowei Xiao.
ICLR 2024
ChatGPT-powered Conversational Drug Editing Using Retrieval and Domain Feedback
Shengchao Liu, Jiongxiao Wang, Yijin Yang, Chengpeng Wang, Ling Liu, Hongyu Guo, Chaowei Xiao
ICLR 2024
CALICO: Self-Supervised Camera-LiDAR Contrastive Pre-training for BEV Perception
Jiachen Sun, Haizhong Zheng, Qingzhao Zhang, Atul Prakash, Z. Morley Mao, Chaowei Xiao
ICLR 2024
Multi-modal molecule structure-text model for text-based retrieval and editing
Shengchao Liu, Weili Nie, Chengpeng Wang, Jiarui Lu, Zhuoran Qiao, Ling Liu, Jian Tang, Chaowei Xiao, Animashree Anandkumar
Nature Machine Intelligence
On the exploitability of instruction tuning.
Manli Shu, Jiongxiao Wang, Chen Zhu, Jonas Geiping, Chaowei Xiao†, Tom Goldstein†.
NeurIPS 2023

† denotes corresponding author.
Shall we pretrain autoregressive language models with retrieval? a comprehensive study.
Boxin Wang, Wei Ping, Peng Xu, Lawrence McAfee, Zihan Liu, Mohammad Shoeybi, Yi Dong, Oleksii Kuchaiev, Bo Li, Chaowei Xiao, Anima Anandkumar, Bryan Catanzaro
EMNLP 2023
Re-ViLM: Retrieval-Augmented Visual Language Model for Zero and Few-Shot Image Captioning.
Zhuolin Yang, Wei Ping, Zihan Liu, Vijay Korthikanti, Weili Nie, De-An Huang, Linxi Fan, Zhiding Yu, Shiyi Lan, Bo Li, Ming-Yu Liu, Yuke Zhu, Mohammad Shoeybi, Bryan Catanzaro, Chaowei Xiao†, Anima Anandkumar†.
EMNLP 2023

† denotes corresponding author.
HiCL: Hierarchical Contrastive Learning of Unsupervised Sentence Embeddings
Zhuofeng Wu, Chaowei Xiao, V.G. Vinod Vydiswaran
EMNLP 2023
CodeIPPrompt: Intellectual Property Infringement Assessment of Code Language Models.
Zhiyuan Yu, Yuhao Wu, Ning Zhang, Chenguang Wang, Yevgeniy Vorobeychik, Chaowei Xiao.
ICML 2023
A Critical Revisit of Adversarial Robustness in 3D Point Cloud Recognition with Diffusion-Driven Purification
Jiachen Sun, Jiongxiao Wang, Weili Nie, Zhiding Yu, Zhuoqing Mao, Chaowei Xiao.
ICML 2023
Defending against Insertion-based Textual Backdoor Attacks via Attribution
Jiazhao Li, Zhuofeng Wu, Wei Ping, Chaowei Xiao, V.G. Vinod Vydiswaran
ACL Finding 2023
Detecting Backdoors During the Inference Stage Based on Corruption Robustness Consistency
Xiaogeng Liu, Shengshan Hu, Haoyu Wang, Minghui Li, Hai Jin, Dengpan Ye, Libing Wu, Chaowei Xiao
CVPR 2023
VoxFormer: Sparse Voxel Transformer for Camera-based 3D Semantic Scene Completion
Yiming Li, Zhiding Yu, Chris Choy, Chaowei Xiao, Jose M. Alvarez, Sanja Fidler, Chen Feng, Anima Anandkumar
CVPR 2023
DiffSmooth: Certifiably Robust Learning via Diffusion Models and Local Smoothing
Jiawei Zhang, , Zhongzhu Chen, Huan Zhang, Chaowei Xiao, Bo Li.
USENIX Security Symposium, 2023
DensePure: Understanding Diffusion Models towards Adversarial Robustness.
Chaowei Xiao*, Zhongzhu Chen*, Kun Jin*, Jiongxiao Wang*, Weili Nie, Mingyan Liu, Anima Anandkumar, Bo Li, Dawn Song
ICLR 2023

* denotes equal contribution
Defending against Adversarial Audio via Diffusion Model
Shutong Wu, Jiongxiao Wang, Wei Ping, Weili Nie, Chaowei Xiao
ICLR 2023
Retrieval-based Controllable Molecule Generation
Zichao Wang, Weili Nie, Zhuoran Qiao, Chaowei Xiao , Richard Baraniuk, Anima Anandkumar
ICLR 2023 (spotlight).
SMACK: Semantically Meaningful Adversarial Audio Attack
Zhiyuan Yu, Yuanhaur Chang, Ning Zhang, Chaowei Xiao
USENIX Security 2023
GenSLMs: Genome-scale language models reveal SARS-CoV-2 evolutionary dynamics.
Maxim Zvyagin*, Alexander Brace*, Kyle Hippe*, Yuntian Deng*, Bin Zhang, Cindy Orozco Bohorquez, Austin Clyde, Bharat Kale, Danilo Perez-Rivera, Heng Ma, Carla M. Mann, Michael Irvin, J. Gregory Pauloski, Logan Ward, Valerie Hayot, Murali Emani, Sam Foreman, Zhen Xie, Diangen Lin, Maulik Shukla, Weili Nie, Josh Romero, Christian Dallago, Arash Vahdat, Chaowei Xiao, Thomas Gibbs, Ian Foster, James J. Davis, Michael E. Papka, Thomas Brettin, Rick Stevens, Anima Anandkumar, Venkatram Vishwanath, Arvind Ramanathan.
ACM Gordon Bell Special Covid Prize

* denotes equal contribution
Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Models
Manli Shu, Weili Nie, De-An Huang, Zhiding Yu, Tom Goldstein, Anima Anandkumar, Chaowei Xiao
NeurIPS 2022
Exploring the Limits of Domain-Adaptive Training for Detoxifying Large-Scale Language Models
Boxin Wang†, Wei Ping†, Chaowei Xiao†, Peng Xu, Mostofa Patwary, Mohammad Shoeybi, Bo Li, Anima Anandkumar, Bryan Catanzaro
NeurIPS 2022

† denotes corresponding author.
Robust Trajectory Prediction against Adversarial Attacks
Yulong Cao, Danfei Xu, Xinshuo Weng, Z. Morley Mao, Anima Anandkumar, Chaowei Xiao, Marco Pavone
CORL 2022
Diffusion Models for Adversarial Purification
Weili Nie, Brandon Guo, Yujia Huang,Chaowei Xiao, Arash Vahdat, Anima Anandkumar.
ICML 2022
Understanding the robustness in vision transformers
Daquan Zhou, Zhiding Yu, Enze Xie, Chaowei Xiao, Anima Anandkumar, Jiashi Feng, Jose M Alvarez
ICML 2022
AdvDO: Realistic Adversarial Attacks for Trajectory Prediction
Yulong Cao, Chaowei Xiao, Anima Anandkumar, Danfei Xu, Marco Pavone
ECCV 2022
SecretGen: Privacy Recovery on Pre-trained Models
Zhuowen Yuan, Fan Wu, Yunhui Long, Chaowei Xiao, and Bo Li
ECCV 2022
Taxonomy of Machine Learning Safety: A Survey and Primer
Sina Mohseni, Zhiding Yu, Chaowei Xiao, and Jay Yadawa, Haotao Wang, and Zhangyang Wang
ACM Computing Survey
RelViT: Concept-guided vision transformer for visual relational reasoning
Xiaojian Ma, Weili Nie, Zhiding Yu, Huaizu Jiang, Chaowei Xiao, Yuke Zhu, Song-Chun Zhu, Anima Anandkumar
ICLR 2022
Behavior Privacy Preserving in RF Sensing
Jianwei Liu, Chaowei Xiao, Kaiyan Cui, Jinsong Han, Xian Xu, Kui Ren
IEEE Transactions on Dependable and Secure Computing
Physical-World Attack towards WiFi-based Behavior Recognition
Jianwei Liu, Yinghui He, Chaowei Xiao, Jinsong Han, Le Cheng, Kui Ren
INFOCOM 2022
Characterizing Attacks on Deep Reinforcement Learning
Xinlei Pan*, Chaowei Xiao*, Warren He, Jian Peng, Mingjie Sun, Jinfeng Yi, Mingyan Liu, Bo Li, Dawn Song
AAMAS 2022

* denotes equal contribution
Adversarially Robust 3D Point Cloud Recognition Using Self-Supervisions
Jiachen Sun, Yulong Cao, Christopher Choy, Zhiding Yu, Anima Anandkumar, Z. Morley Mao, Chaowei Xiao
NeurIPS 2021
AugMax: Adversarial Composition of Random Augmentations for Robust Training.
Haotao Wang,Chaowei Xiao, Jean Kossaifi, Zhiding Yu, Animashree Anandkumar, Zhangyang Wang.
NeurIPS 2021
Efficient Transformers for Language and Vision
Chen Zhu, Wei Ping, Chaowei Xiao, Mohammad Shoeybi, Tom Goldstein, Anima Anandkumar, Bryan Catanzaro
NeurIPS 2021
Can Shape Structure Features Improve Model Robustness under Diverse Adversarial Settings?
Mingjie Sun*, Chaowei Xiao*, Zichao Li*, Haonan Qiu, Mingyan Liu, Bo Li
ICCV 2021

* denotes equal contribution
Application-driven Privacy-preserving Data Publishing with Correlated Attributes
Aria Rezaei, Chaowei Xiao, Bo Li, Jie Gao
EWSN 2021
Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attacks.
Yulong Cao*, Ningfei Wang*,Chaowei Xiao*, Dawei Yang*, Jin Fang, RuigangYang, Qi Alfred Chen, Mingyan Liu, Bo Li.
IEEE Symposium on Security and Privacy (IEEE S&P) 2021

* denotes equal contribution
Robust Deep Reinforcement Learning against Adversarial Perturbations on State Observations
Huan Zhang, Hongge Chen, Chaowei Xiao, Bo Li, Mingyan Liu, Duane Boning, Cho-Jui Hsieh
NeurIPS 2020
SemanticAdv: Generating Adversarial Examples via Attribute-conditional Image Editing
Haonan Qiu*, Chaowei Xiao*, Lei Yang*, Xinchen Yan, Honglak Lee, Bo Li
ECCV 2020

* denotes equal contribution
Towards Stable and Efficient Training of Verifiably Robust Neural Networks
Huan Zhang, Hongge Chen, Chaowei Xiao, Sven Gowal, Robert Stanforth, Bo Li, Duane Boning, Cho-Jui Hsieh
ICLR 2020
MeshAdv: Adversarial Meshes for Visual Recognition
Chaowei Xiao*, Dawei Yang*, Bo Li, Jia Deng, Mingyan Liu
CVPR 2019 (oral)

* denotes equal contribution
AdvIT: Characterizing Adversarial Frames in Videos Based on Temporal Information
Chaowei Xiao, Ruizhi Deng, Bo Li, Taesung Lee, Benjamin Edwards, Jinfeng Yi, Dawn Song, Mingyan Liu, Ian Molloy
ICCV 2019
Adversarial Sensor Attack on LIDAR-based Perception in Autonomous Driving
Yulong Cao, Chaowei Xiao, Benjamin Cyr, Yimeng Zhou, Won Park, Sara Rampazzi, Qi Alfred Chen, Kevin Fu, Z. Morley Mao
CCS 2019
Improving Robustness of ML Classifiers against Realizable Evasion Attacks Using Conserved Features
Liang Tong, Bo Li, Chen Hajaj, Chaowei Xiao, Ning Zhang, Yevgeniy Vorobeychik
USENIX Security 2019
Performing Co-Membership Attacks Against Deep Generative Models
Kin Sum Liu, Chaowei Xiao, Bo Li, Jie Gao
ICDM 2019
Characterize Adversarial Examples Based on Spatial Consistency Information for Semantic Segmentation
Chaowei Xiao, Ruizhi Deng, Bo Li, Fisher Yu, Mingyan Liu, Dawn Song
ECCV 2018
Spatially Transformed Adversarial Examples
Chaowei Xiao*, Jun-Yan Zhu*, Bo Li, Warren He, Mingyan Liu and Dawn Song
ICLR, 2018

* denotes equal contribution
Generating Adversarial Examples with Adversarial Networks
Chaowei Xiao, Bo Li, Jun-Yan Zhu, Warren He, Mingyan Liu and Dawn Song
IJCAI, 2018.
From Patching Delays to Infection Symptoms: Using Risk Profiles for an Early Discovery of Vulnerabilities Exploited in the Wild
Chaowei Xiao, Armin Sarabi, Yang Liu, Bo Li, Tudor Dumitra, Mingyan Liu
Usenix Security 2018
Robust Physical-World Attacks on Machine Learning Models
Kevin Eykholt*, Ivan Evtimov*, Earlence Fernandes, Bo Li, Amir Rahmati, Chaowei Xiao, Atul Prakash, Tadayoshi Kohno and Dawn Song
CVPR, 2018
Automatic Radio Map Adaptation for Indoor Localization using Smartphones
Chenshu Wu, Zheng Yang, Chaowei Xiao
TMC 2017
Static Power of Mobile Devices: Self-updating Radio Maps for Wireless Indoor Localization
Chenshu Wu, Zheng Yang, Chaowei Xiao, Chaofan Yang, Yunhao Liu, Mingyan Liu
INFOCOM 2015
Tagoram: Real-time Tracking of Mobile RFID Tags to High Precision Using COTS Devices
Lei Yang, Yekui Chen, Xiangyang Li, Chaowei Xiao, Mo Li, Yunhao Liu
MobiCom 2014 (Best Paper Award)