Show HN: Low-latency local LLM runner via OpenJDK Panama FFM (Java 22)

2 comments

• exabrial a day ago ago

  This is pretty impressive.

  [-]
  • KingJoker a day ago ago

    Thanks! It was a fun challenge getting an AI agent to pair with me while adhering to strict c-struct padding and memory alignment.

    Let me know if anything sticks out you'd like to discuss deeper!