Will on-device models catch up with the cloud giants?

I'd bet on boring, reliable assistants over flashy ones.

We underestimate how fast habits change once something is good enough.

This thread went in a direction I love. Keep it coming!

Is there a guide for on-device models? I couldn't find one.

@Lea_Fontaine What's your setup for on-device models? Mic, model, settings?

Update: solved it. Thanks all 🙌

This is the way 🚀

Following up: your tips worked. Marking this as done ✅

@Rhys_Pemberton It's funny how on-device models went from 'nice to have' to 'can't live without' for me. 😄

The hard part isn't the AI, it's trust.

Honestly I think on-device models is a solution looking for a problem 🤷

Does on-device models work offline, or does it need the cloud?

My two cents on on-device models: start simple, add complexity later. 😅

Following up: your tips worked. Marking this as done ✅

@Rhys_Pemberton Really helpful, thank you!

@oliviaT Clean explanation. I'll try on-device models tonight and report back.

Remember when we said touchscreens were a fad? 😉

@keremD Underrated post.

@Talha_C94 I tried on-device models and went back to the keyboard. Typing is still faster for me.

💯