Chose the $200 local AI server over a cloud API, refund only after day 12

I had to pick between renting a GPU cluster at $0.80 an hour or buying a used RTX 3060 setup from a guy in Seattle. Went with the local box because my dataset had 40,000 patient notes and I didn't trust sending them off. It took 9 hours to train my model versus about 4 on the cloud, but now I can rerun it whenever for free. Has anyone else gotten burned on cloud egress fees that make the local route look way cheaper?

0 comments

0 Comments

No comments yet

Be the first to share your thoughts on this discussion.