SubQ: Sub-quadratic LLM built for 12M-token context

2 comments

• scrodde 9 hours ago ago

  Cool, any benchmark numbers?

• bohnohboh a day ago ago

  12 MILLION! Is it good though?