Interesting, the main things I've read for SMB Direct are from Microsoft, for their Windows Server implementation.
But with Apple's recent introduction of RDMA over Thunderbolt, that got my hopes up I could use it for storage, not only moving LLMs, but also for video file storage, where editing from one Mac to another (or over Ethernet, if that's supported) could be much faster, with lower latency.
Why not? SMB is no slouch. Microsoft has taken network storage performance very seriously for a long time now. Back in the day, Microsoft and others (NetApp, for instance,) worked hard to extend and optimize SMB and deliver efficient, high throughput file servers. I haven't kept up with the state of the art recently, but I know there have been long stretches where SMB consistently led the field in benchmark testing. It also doesn't hurt that Microsoft has a lot of pull with hardware manufacturers to see their native protocols remain tier 1 concerns at all times.
Interesting, the main things I've read for SMB Direct are from Microsoft, for their Windows Server implementation.
But with Apple's recent introduction of RDMA over Thunderbolt, that got my hopes up I could use it for storage, not only moving LLMs, but also for video file storage, where editing from one Mac to another (or over Ethernet, if that's supported) could be much faster, with lower latency.
What is the performance impact of soft RDMA over SMB this way, vs the traditional SMB on the IP stack?
I was sure SMB3 was Super Mario Bros 3.
What, um... Are... Are people using samba to sync model weights between cluster nodes...?
Why not? SMB is no slouch. Microsoft has taken network storage performance very seriously for a long time now. Back in the day, Microsoft and others (NetApp, for instance,) worked hard to extend and optimize SMB and deliver efficient, high throughput file servers. I haven't kept up with the state of the art recently, but I know there have been long stretches where SMB consistently led the field in benchmark testing. It also doesn't hurt that Microsoft has a lot of pull with hardware manufacturers to see their native protocols remain tier 1 concerns at all times.
Dunno but I have used samba to load model weights from my NAS