Speculative Speculative Decoding (SSD)

(arxiv.org)

24 points | by E-Reverance 2 hours ago ago

1 comments

saagarjha 12 minutes ago ago

Yo dawg I heard you liked speculation so we speculated your speculating