I think it's good etiquette to ask the user if they want to download the model or any assets larger than the average page size, in case they have limited bandwidth.
This is very good. Super snappy and gives me what I'm looking for. Great write-up too.
How much more would it cost to use a multilingual tokeniser? I realise this is somewhat pointless for an English blog, but services like Uber Eats have something like that going on (server-side of course, and they may just be translating queries).
This is a very exciting field to make stuff in! I also experimented with a completely client side wallpaper search xD,a while back.
In case some one is interested here is it : https://web-inky-ten-60.vercel.app/
I think it's good etiquette to ask the user if they want to download the model or any assets larger than the average page size, in case they have limited bandwidth.
This is very good. Super snappy and gives me what I'm looking for. Great write-up too.
How much more would it cost to use a multilingual tokeniser? I realise this is somewhat pointless for an English blog, but services like Uber Eats have something like that going on (server-side of course, and they may just be translating queries).
Every browser should have an embedding API to avoid having to worry about the plumbing and data transfer.