Whether it improves or reduces employees’ accuracy and efficiency depends on how the employee uses their tools. They should be trusted to pick tools that help them do their job more effectively.
The point is that this is all happening in a cloud. One that is probably located in the US. Not a good thing for a non-US government to send potentially confidential or even secret data to.
It doesn’t have to, you can run LLMs locally. We do at my org, and we only have a few dozen people using it, and it’s running on relatively modest hardware (Mac Mini for smaller models, Mac Studio for larger models).
Yeah, shitty toy ones. This here is about productivity, not about a hobby. And not even real state-of-the-art models were able to actually give a productivity advantage.
Our self-hosted ones are quite good and get the job done. We use them a lot for research, and it seems to do a better job than most search engines. We also link it to internal docs and it works pretty well for that too.
If you run a smaller model at home because you have limited RAM, yeah, you’ll have less effective models. We can’t run the top models on our hardware, but we can run much larger models than most hobbyists. We’ve compared against the larger commercial models, and they work well, if little slowly.
I don’t see where a government would need a chatbot. Anyways, chances are that half the staff was already using some form of LLM before this trial.
Why wouldn’t they want one? If it’s a tool their employees want, they should provide it.
Tools that decrease accuracy should not be provided to government employees
Whether it improves or reduces employees’ accuracy and efficiency depends on how the employee uses their tools. They should be trusted to pick tools that help them do their job more effectively.
Not if you’re defying safety regulations.
The employees should know what’s within regulations and what’s not.
The point is that this is all happening in a cloud. One that is probably located in the US. Not a good thing for a non-US government to send potentially confidential or even secret data to.
It doesn’t have to, you can run LLMs locally. We do at my org, and we only have a few dozen people using it, and it’s running on relatively modest hardware (Mac Mini for smaller models, Mac Studio for larger models).
Yeah, shitty toy ones. This here is about productivity, not about a hobby. And not even real state-of-the-art models were able to actually give a productivity advantage.
Our self-hosted ones are quite good and get the job done. We use them a lot for research, and it seems to do a better job than most search engines. We also link it to internal docs and it works pretty well for that too.
If you run a smaller model at home because you have limited RAM, yeah, you’ll have less effective models. We can’t run the top models on our hardware, but we can run much larger models than most hobbyists. We’ve compared against the larger commercial models, and they work well, if little slowly.
Yeah… You do it, but do you think the UK government does?
My point is they could if they were concerned about data leaks.