The rushed launch of Apple Intelligence was a debacle, reminding Apple it should focus on readiness rather than quickly appeasing shareholders.
The rushed launch of Apple Intelligence was a debacle, reminding Apple it should focus on readiness rather than quickly appeasing shareholders.
Nailed it. I’ve tried taking notification contexts and generally seeing how hard it is. Their foundational model, I think is 4bit quantized, 3billion parameter model.
So I loaded up llama, phi, and picollm to run some unscientific tests. Honestly they had way better results than I expected. Phi and llama handled notification summaries (I modeled the context window, nothing official) and both performed great. I have no idea wtf AFM is doing, but it’s awful.