SHAO Qian

SHAO Qian

Fifth-year PhD candidate

Posts by Collection

footprint

publications

Preference-Aware Delivery Planning for Last-Mile Logistics

Published in Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems(AAMAS), 2023

Address the challenge of optimizing last-mile logistics delivery routes, proposing a hierarchical route optimizer with learnable parameters that integrates optimization and machine learning to bridge the gap between optimized routes and practitioner-preferred routes, which often arise from differing priorities

Recommended citation: Shao, Qian, and Shih-Fen Cheng. "Preference-Aware Delivery Planning for Last-Mile Logistics." Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems. 2023
Download Paper

Imitating Cost Constrained Behaviors in Reinforcement Learning

Published in Conference, 2024

This research explores imitation learning in scenarios where expert behavior is influenced by both rewards and constraints, introducing methods such as Lagrangian, meta-gradient, and cost violation-based approaches to address trajectory cost constraints, with empirical results showing that the meta-gradient-based approach outperforms existing methods in accurately imitating cost-constrained behaviors.

Recommended citation: Shao, Qian, Pradeep Varakantham, and Shih-Fen Cheng. "Imitating Cost-Constrained Behaviors in Reinforcement Learning." Proceedings of the International Conference on Automated Planning and Scheduling. Vol. 34. 2024.
Download Paper