It has been fascinating to observe responses to the recent UK government guidance on AI in education. The reactions showcase how institutional dynamics and existing pressures can transform guidance into perceived mandates. Schools, already stretched thin by accountability pressures, testing demands, and resource constraints, naturally tend to seek certainty. Being told to "think carefully" can feel overwhelming when what you really want is clear direction, even if you might choose not to follow it.
I really like some of the advantages that a local solution would offer, Nick. I wonder what the overhead and negatives would be compared a private cloud based solution.
Well, if it were plugged in to solar (which would be my preference), then no energy overhead and it means that you could be sure about the energy issue around your LLM which is not the same as a private cloud as it would still be in a huge data centre. There would still be challenges (hardware costs with a good GPU, back up somewhere and security) but these are not insurmountable, especially if the values driving the choice are clear.
I really like some of the advantages that a local solution would offer, Nick. I wonder what the overhead and negatives would be compared a private cloud based solution.
Well, if it were plugged in to solar (which would be my preference), then no energy overhead and it means that you could be sure about the energy issue around your LLM which is not the same as a private cloud as it would still be in a huge data centre. There would still be challenges (hardware costs with a good GPU, back up somewhere and security) but these are not insurmountable, especially if the values driving the choice are clear.