Anthropic researchers ran a 26-billion-parameter model across 15 inexpensive TV boxes. Splitting the layers overcame the memory limit of one device, but answers came slowly at 0.39 tokens per second. A failed box could be replaced after rebuilding the working memory its layers needed. #AI #Anthropic