Microsoft recently introduced Phi-3 family of models that is at the same time highly performant but also small enough to run on your phone without internet.