Spaces:

ButterM40
/

local-inference

Sleeping

App Files Files Community

local-inference / server.py

Commit History

Optimize build: lazy model loading + CPU torch wheel

b9ed0c9

ButterM40 commited on Nov 10, 2025

Add per-token alternatives + hover tooltip UI

5a6a589

ButterM40 commited on Nov 10, 2025

Add accelerate dependency and optimize model loading for memory constraints

b781094

ButterM40 commited on Nov 1, 2025

Add accelerate dependency and optimize model loading for memory constraints

c75f720

ButterM40 commited on Nov 1, 2025

Final_Working

84fc33b

Diego Adame commited on Oct 30, 2025

Changes for Render

47ef678

Diego Adame commited on Oct 30, 2025

Complete Code

1eaa5ce

Diego Adame commited on Oct 30, 2025