Discussion about this post

User's avatar
Neural Foundry's avatar

Solid roundup covering alot of ground. The FunctionGemma release is underrated, 270M params running locally is a huge shift from cloud-only assistants. I messed around with similar edge models last year and the latency improvment was noticeable but accuracy was still iffy. If Google's nailed the accuracy+speed tradeoff at that size, it could change how we think about on-device AI capabilities.

Expand full comment

No posts

Ready for more?