Free token new way to run local ai on limited hardware

Comment using cache like mechanisms and streaming local ai becomes faster in smaller more limited hardware, such as traditional gaming pc setups.