Treffer: Efficient Latency Optimization in Batch Processing Server Systems for Multi-User Co-Inference
Title:
Efficient Latency Optimization in Batch Processing Server Systems for Multi-User Co-Inference
Authors:
Source:
2024 IEEE/CIC International Conference on Communications in China (ICCC Workshops) Communications in China (ICCC Workshops), 2024 IEEE/CIC International Conference on. :475-480 Aug, 2024
Relation:
2024 IEEE/CIC International Conference on Communications in China (ICCC Workshops)
Database:
IEEE Xplore Digital Library