JustFit: Running Large LLMs Locally on Laptops with 200K Context

Researchers have developed 'JustFit,' a new inference runtime that enables large language models (LLMs) with massive context windows to run efficiently on standard laptops, expanding local AI capabilities.