Jian Liao PRO

imjliao's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in PointerHQ/Qwen2.5-VL-72B-Instruct-Pointer-AWQ 11 months ago

Can the AWQ quantized model run on a single A100? I tried to running with vllm on single A100, but failed.

3

#1 opened 11 months ago by

Albertstone

New activity in Benasd/Qwen2.5-VL-72B-Instruct-AWQ 11 months ago

failed with 4 gpu

3

#2 opened 11 months ago by

asarray

New activity in Qwen/Qwen2.5-VL-72B-Instruct-AWQ 11 months ago

Lanuch model with vllm --tensor-parallel (Error: input_size_per_partition not divisible by min_thread_k)

8

#2 opened 11 months ago by

prstg

New activity in Benasd/Qwen2.5-VL-7B-Instruct-AWQ 11 months ago

72B AWQ Quantization

#1 opened 11 months ago by

imjliao

New activity in bytedance-research/UI-TARS 11 months ago

Which model is the demo running?

5

#1 opened 11 months ago by

iitzco

commented a paper over 2 years ago

Clinical Text Summarization: Adapting Large Language Models Can Outperform Human Experts

Paper • 2309.07430 • Published Sep 14, 2023 • 27 •

4