Needle: 26M model handles function calls, runs on CPU
Needle is a 26M parameter model built for function calling. Beats 270M+ rivals on benchmarks, runs on CPU without a GPU. Route tool dispatch locally and skip the API call.
1 article tagged #edge-ml
Needle is a 26M parameter model built for function calling. Beats 270M+ rivals on benchmarks, runs on CPU without a GPU. Route tool dispatch locally and skip the API call.