13 points | by seandotexe 13 hours ago ago
4 comments
Nice, thanks!
edit: in the docs, the command to install the npm package seems to be wrong (crawlie doesn't exist), it should be: npm i -g @spronta/crawlie
Nice
That's nice! I like that it also checks for the llms.txt. It seems to me that no SEO agency is aware of this simple but powerful file.
Thank you!! Lots more to come
Honestly, the industry is half-torn on whether llms.txt does anything... we're in such a new world. But the same ol' SEO tricks still apply for AI engines for sure.
Nice, thanks!
edit: in the docs, the command to install the npm package seems to be wrong (crawlie doesn't exist), it should be: npm i -g @spronta/crawlie
Nice
That's nice! I like that it also checks for the llms.txt. It seems to me that no SEO agency is aware of this simple but powerful file.
Thank you!! Lots more to come
Honestly, the industry is half-torn on whether llms.txt does anything... we're in such a new world. But the same ol' SEO tricks still apply for AI engines for sure.