Mesh LLM: Distributed AI Computing on Iroh

Mesh LLM presents a novel approach to running large language models by distributing their computational workload across a network of machines. This system utilizes iroh, a peer-to-peer data transfer and networking stack, to facilitate seamless communication and data sharing between the distributed components. The goal is to overcome the significant hardware demands of modern LLMs, making them more accessible and scalable. By distributing the processing, Mesh LLM aims to improve efficiency and reduce the reliance on single, powerful GPUs. This architecture allows for more flexible deployment scenarios, potentially enabling LLMs to run on a wider range of hardware, from cloud instances to edge devices, by pooling resources.