Why is this an issue?
The GlideRecord Client side method may request several Records (that's right, the whole record, big Objects with all fields values) to the server, following the addQuery condition. It may cause slowness to your Client Side action.
Is there a need to get all fields values from a Record? There isn't, right? Usually just one or very few fields are necessary.
It behaves very similiar to g_form.getReference(). Please look at Avoid using g_form.getReference() article for more details.
Besides that, client side GlideRecord does not work on scopped applications.
Best practices
Best way to call from Server data is using GlideAjax API. Sometimes calling REST APIs can be a good way to acomplish this task as well.