There have been quite a few attempts at it, such as https://aicrypto.ai/, https://vast.ai/, and https://www.reddit.com/r/gpumining/comments/86ofw2/rent_out_your_gpu_compute_to_ai_researchers_and/. However none of them seems to have gone anywhere.
Why?
The reddit thread says "double what he was making by mining Ethereum, and in return he would let me train my neural networks on his computer at significantly less than what I would have had to pay AWS." That is pretty significant but I'm kinda surprised it that much less than AWS, does AWS have a really high markup?
Is model parallelization solved yet? Especially Without high speed connectivity?