> "Two business school professors, curious about A.I. books and whether anyone actually likes them, gathered data about 10 million books published on Amazon over the last five years. They found that the number of e-books published per month had tripled since the release of ChatGPT, to more than 300,000 at the end of last year, from around 100,000 in 2022. (Amazon said that its internal metrics did not show that level of growth, but would not share its figures.). Because romance sells, the professors thought it would be the genre most susceptible to A.I. intervention, but instead it was nonfiction — a term that should probably be used loosely in this context. While A.I.-assisted books received lower customer ratings than human-made ones, they deemed A.I.’s entry into the market a positive development, because the books were selling, if modestly. As economists, they told me, they’re less concerned with literary quality or customer satisfaction than revenue growth and market expansion."
One of the writers, Bill Johns, age 70, a retired cyber security consultant:
> "Mr. Johns now has 445 books for sale on Amazon. He orders a paperback copy of each one and keeps them on four rotating white bookshelves that are crowded awkwardly next to a couch in his living room. They all feature a photo of him in a serious dark suit — which is A.I. generated. “It was either that or put on a suit and take selfies,” he said."
In fairness, we haven't heard in these economists' own words what their position is and it's possible that it's more nuanced than the author gives them credit for. (There's the quote about Fifty Shades but that's making a more defensible point and doesn't get into the "customer satisfaction" thing.)
Sure, and I feel something for the authors who are in it to write a high-quality novel.
For the authors who are in it for the game, writing bottom of the barrel airport checkout line garbage, they were already trying to game people’s attention and they lost to a robot.
KDP now has a limit of 10 books per week to limit it unless you can convince them you're a legitimate publisher, and e.g. Draft2Digital does not submit ebooks to Amazon any more for the same reason. But you can still offer paperbacks via any number of third party providers that will be available via Amazon.
This is <sarcasm>good</sarcasm>. It should eventually make writing not a viably profitable career for anyone also. How the heck will people ever stand out and not just be grey goo? How will anyone know what is good versus garbage?
We are going to go back to human-only networks for filtering the garbage into a trusted set of recommendations. Maybe where the only music you can trust are local artists you can see live. Or where the books you read are from a friend-of-a-friend who knows the author. Maybe the world of tomorrow looks more like the world we left behind.
I think 100% of the books I've read in the last year have been recommendations from friends. This is kind of annoying as I'd like to be able to give them recommendations in return, but ... limited time.
I wish that I could doomscroll literature instead of short videos, but the economics apparently don't work out.
Knowing that some songs are by local artists who I could go see live doesn't tell me very much about the quality of the music, unfortunately. My friends recommending the music does though, assuming we have similar taste.
Would publishers be willing to go to the level of pulling a Milli Vanilli where they hire people to make appearances as the author? Or would a litmus test to see if an author has attended any book signings be valid?
I think the appropriate solution here is a generous, well-advertised refund policy.
People aren't allowed to (not even defame) write about others? Amazon doesn't allow certain books? No, but I imagine most people who actually buy this kind of book (if anyone does) are expecting higher quality.
And on the off chance they're satisfied, everyone wins. Even the author, since apparently the biography is very flattering of her.
It's a very common thing. A very unscientific quick search in Google Books led me to the oldest example I could find in a minute or two being a mention in The Dublin Review in 1844 reviewing a book on the correspondence of Edmund Burke talking about the loss of material that would have been indispensable for an authorised biography. It's very unlikely to be remotely the oldest use of the term.
And that mention also gets to why authors often seek authorisation and why subjects often authorise them: Authors gain access to the subject and/or often their material, while the subject or their estates gains some control over how they are portrayed.
I know what you mean, but there is a reasonable distinction to be made especially for living persons. An "authorized" biography would be something like what Isaacson does, where they get exclusive access, anecdotes, and importantly confirmation or denial of certain facts or stories.
An "unauthorized" biography is not necessarily suspect but it is kind of a subgenre. Consider the difference between Isaacson's Musk biography and the work done by Kate and Ryan for Character Limit (https://www.amazon.com/Character-Limit-Elon-Destroyed-Twitte...) - not exactly a biography but the legwork is fundamentally different, reportorial or even adversarial where the narrative gets challenged, as opposed to accepted by the "authorized" Isaacson.
If a biography is authorized, then you can interview the subject, and in some cases those interviews provide a lot of the material. Walter Isaacson's biography of Steve Jobs was like this, for example.
In addition to the direct interview, there are other advantages of authorization that often allow the author a much deeper access to research the subject:
- Access to records, correspondence, and journals in the subject's possession
- explicit endorsement from the subject encourages their family, friends and colleagues to work with the author.
- Opportunities for the subject themselves to fact-check and contextualize the research.
That must be balanced against the fact that authorization also often provides the subject an opportunity to review the content, giving them a hand in crafting the narrative and/or suppressing unflattering details.
I don’t really get the appeal of using A.I. to write books. It’s a useful research and editorial tool that still requires thoughtful operation. But have it do the writing? It’s too shallow.
I use it to check the spelling and grammas of everything I post on my comedy newsletter[0]. As an ESL speaker, I do need some help with those areas. But the edits it typically recommends are just awful. Hyphen and em dash galore. A/B comparison and analogies that mimic the term “load-bearing”. I have to be extra careful to not let any of that slop slip through. At this point, I’m looking to work with a human editor. The AI is clearly showing not being up to par for it. At least in my experience.
> Donald Rowland, a Suffolk author of nearly 200 books - written under more than 30 pseudonyms - has made a living out of his romantic fiction. Donald churns out more novels than anybody else in the county. He specialises in old-fashioned romance, his heroes and heroines are morally beyond reproach, there is no sex in his novels. The reason for his prolific output is simple - Donald is paid just fifty pounds per book.
I'd love it if marketplaces just banned AI books entirely. I see zero value in it. If I want AI text I can just go to AI it and it'll print out a books worth of text anyway; if I'm searching for a book I want something written by a human. I have zero interest in giving money to grifters and spammers.
Incidentally, I feel like Cartoon Network predicted our current dystopian future like over a decade ago with one of their joke infomercials: https://www.youtube.com/watch?v=XQLdhVpLBVE . (It's funny at least!) Thought coins and hiding from bots.
People are allowed to reject things and we've seen the public around the world overwhelming reject LLMs, what SV + VC doesn't like are being told no (shocker). Honestly believe they would rather destroy the planet than be forced to help others, which tracks seeing what you hear coming out of the mouths of these supposed "leaders" (deeply anti-human + anti-democratic sentiment).
It's no wonder they are worried for their lives. The majority of the planet rightfully hate their guts.
Right now, most people are more than happy slurping in the slop. The push back is only in niche corners of the interwebs. Even the obvious issues with slop like "count the fingers" level of issues are being used for entertainment and embraced rather than rejection. So there's no real pressure to fix things with the slop generators. So many people are oblivious to the content they are consuming is slop or not bothered by it if they are told it is slop. So I'm really not buying your premise that "we've seen the public around the world overwhelming reject LLMs"
Given that everything in the book is public information, it's hard to argue that any of this is strictly _illegal_, given the First Amendment. But it's definitely distasteful to write a book about a living individual without their consent (even though this does happen all the time; technically Wikipedia does this too).
Though that does raise an interesting point: what's the difference between writing a book about someone and asking ChatGPT "Tell me the biography of X"? It's the historical meaning and prestige of saying "I wrote a book", even though with Amazon, anyone can write a book and self-publish it.
> Eamon Duede, a philosopher of science at Purdue University and one of the authors of a paper called “Why Slop Matters,” said A.I. brought joy to people who wanted to create something that very few other people would find interesting — like images of their friends in historical scenes.
> “People get an enormous amount of enjoyment and satisfaction out of creating stuff if it’s low effort,” he said. People who want to be creative, but might not be very good at it, can turn to A.I. and find “a bunch of barriers removed.”
I think there needs to be a different frame with which to analyze this scenario. Yes, it's distasteful to sell a book about a living person without their consent. But who are we to deny people the enjoyment of entertaining themselves by researching, brainstorming, and publishing a document/report/book, whatever you want to call it?
I'm glad the author mentioned it in the article, but it's definitely a different world now.
AI still images don't require a time investment from the viewer. Text and video slop is literally wasting hours of life from those who don't realize what they are consuming is devoid of redeeming value.
> But it's definitely distasteful to write a book about a living individual without their consent (even though this does happen all the time; technically Wikipedia does this too).
I do wonder about what would happen if the LLM were to hallucinate negative facts about the person.
Like, if some asshat vibe-wrote a biography about me that claimed that I once kicked a sack full of puppies as a child, would I be able to sue the "author" for defamation? At least, would it even be worth it to pursue?
Couldn't find a discussion yet on Wikipedia about how slop books with ISBNs and publishers are more authoritative sources than primary sources by the letter of its rules, but I expect there'll be one by the time I finish popping a bag of popcorn
Unsurprisingly, Wikipedia does not take this position, and is in fact pretty skeptical of self-published and especially AI-generated work. Its guidelines do say that "books published by respected publishing houses" are more likely to be reliable sources, but that's obviously different from having an ISBN, and of course such books are not AI-generated.
The primary sources thing is a different matter; primary and secondary sources serve different purposes.
Brave search is returning secondary sources, not primary sources, for several serious real life topics in the last weeks it seems.. I mean Law and Medicine.. what is that about?
I expect I'll get a lot of hate for this, and potentially deservedly so, but I've been doing something similar since late last year when Opus came out.
> Because romance sells, the professors thought it would be the genre most susceptible to A.I. intervention, but instead it was nonfiction...
I've been working mostly in erotica but have shifted to some nonfiction series lately.
I stopped for a while, but Fable and GPT 5.6 Sol have reinvigorated me.
I use Claude Code and other CLIs to manage the process, create first drafts, covers, research, etc. I heavily edit most things before I publish it.
The first question is probably one of profitability. So far I have made a little over $40, compared to probably $800 in AI subscription fees. So from that point of view it's been an absolute disaster.
If anyone is curious, I'd be happy to talk about any of it.
It started as a bit of curiosity: Can AI write good fiction? Can I create a process that produces better fiction? Will Anthropic even let me write porn? How do different models do?
It was another outlet to explore using AI outside of my 9-5 programming. I've experimented with building custom agents to write stories, custom memory storage methods, custom workflows, etc. I've also used AI to write content management systems and experiment with that.
Like with software, even if "slop", there's a particular joy to having an idea come to life very very quickly. I can start with a premise, a character, a few scene ideas, and get a workable draft.
For some of my ideas (outside of erotica), there are no books that I can find that cover what I'm interested in. So in another sense it's like using AI to do research for my own enjoyment, but I'm also tightening it up and publishing it.
> What sense of ownership/pride do you feel when you consider one of your works as "done"?
It's diminished compared to things I've done completely by myself. But it's non-zero and it's positive. I've actually shipped products rather than sitting on them, and there's joy and pride in that.
But I do still put a lot of work into it, both on the software side managing it, but also manually hand-editing it. I rewrite things until it doesn't feel like AI to me, even if I also use AI to make some of those edits.
> What would you do differently, if you were back at the starting block and had a budget of $800 to spend on writing nonfiction?
The lessons are very similar to other lessons on here.
Like with game development, don't spend your time on the engine. I'd spend less time building scaffolding and structure software.
I'd also be more patient and wait for weekly resets instead of bumping up to the higher tier.
I'd also stick to fewer projects more closely until completion -- I have a queue of about 80 some books to go through before I can publish them.
https://archive.ph/6Kz6H
> "Two business school professors, curious about A.I. books and whether anyone actually likes them, gathered data about 10 million books published on Amazon over the last five years. They found that the number of e-books published per month had tripled since the release of ChatGPT, to more than 300,000 at the end of last year, from around 100,000 in 2022. (Amazon said that its internal metrics did not show that level of growth, but would not share its figures.). Because romance sells, the professors thought it would be the genre most susceptible to A.I. intervention, but instead it was nonfiction — a term that should probably be used loosely in this context. While A.I.-assisted books received lower customer ratings than human-made ones, they deemed A.I.’s entry into the market a positive development, because the books were selling, if modestly. As economists, they told me, they’re less concerned with literary quality or customer satisfaction than revenue growth and market expansion."
One of the writers, Bill Johns, age 70, a retired cyber security consultant:
> "Mr. Johns now has 445 books for sale on Amazon. He orders a paperback copy of each one and keeps them on four rotating white bookshelves that are crowded awkwardly next to a couch in his living room. They all feature a photo of him in a serious dark suit — which is A.I. generated. “It was either that or put on a suit and take selfies,” he said."
> As economists, they told me, they’re less concerned with literary quality or customer satisfaction than revenue growth and market expansion.
As a human, I am concerned with these economists.
In fairness, we haven't heard in these economists' own words what their position is and it's possible that it's more nuanced than the author gives them credit for. (There's the quote about Fifty Shades but that's making a more defensible point and doesn't get into the "customer satisfaction" thing.)
I think they’re saying if AI text is causing people to buy (and presumably read) more, that’s a good thing.
As in, if these marginal readers actually prefer AI texts, what does that say about human writing?
It tells you that human attention can be gamed.
Sure, and I feel something for the authors who are in it to write a high-quality novel.
For the authors who are in it for the game, writing bottom of the barrel airport checkout line garbage, they were already trying to game people’s attention and they lost to a robot.
Don't be. They are maximizing economy, at the cost of everything else. If anything, they are _perfect_ economists.
Economics has long recognized the distinction between GDP and value creation, but not everyone in a field is going to produce the best work.
Intangibles and unpaid work get ignored not because they cannot be included but because doing so is harder.
KDP now has a limit of 10 books per week to limit it unless you can convince them you're a legitimate publisher, and e.g. Draft2Digital does not submit ebooks to Amazon any more for the same reason. But you can still offer paperbacks via any number of third party providers that will be available via Amazon.
> One of the writers, Bill Johns, age 70, a retired cyber security consultant
This is crazy to me. You're 70! Just be retired and fuck off, stop actively making the world a worse place!
This is <sarcasm>good</sarcasm>. It should eventually make writing not a viably profitable career for anyone also. How the heck will people ever stand out and not just be grey goo? How will anyone know what is good versus garbage?
We are going to go back to human-only networks for filtering the garbage into a trusted set of recommendations. Maybe where the only music you can trust are local artists you can see live. Or where the books you read are from a friend-of-a-friend who knows the author. Maybe the world of tomorrow looks more like the world we left behind.
I think 100% of the books I've read in the last year have been recommendations from friends. This is kind of annoying as I'd like to be able to give them recommendations in return, but ... limited time.
I wish that I could doomscroll literature instead of short videos, but the economics apparently don't work out.
Knowing that some songs are by local artists who I could go see live doesn't tell me very much about the quality of the music, unfortunately. My friends recommending the music does though, assuming we have similar taste.
So the algorithmic system could potentially destroy itself.
Neat!
Would publishers be willing to go to the level of pulling a Milli Vanilli where they hire people to make appearances as the author? Or would a litmus test to see if an author has attended any book signings be valid?
https://en.wikipedia.org/wiki/JT_LeRoy#Exposure
That sounds like a cost of doing business so the question is whether using this method increases profit more than any other.
I think the appropriate solution here is a generous, well-advertised refund policy.
People aren't allowed to (not even defame) write about others? Amazon doesn't allow certain books? No, but I imagine most people who actually buy this kind of book (if anyone does) are expecting higher quality.
And on the off chance they're satisfied, everyone wins. Even the author, since apparently the biography is very flattering of her.
Honest question, but since when were biographies ever _authorized_? I would assume you would simply inform the subject out of politeness if at all.
It's a very common thing. A very unscientific quick search in Google Books led me to the oldest example I could find in a minute or two being a mention in The Dublin Review in 1844 reviewing a book on the correspondence of Edmund Burke talking about the loss of material that would have been indispensable for an authorised biography. It's very unlikely to be remotely the oldest use of the term.
And that mention also gets to why authors often seek authorisation and why subjects often authorise them: Authors gain access to the subject and/or often their material, while the subject or their estates gains some control over how they are portrayed.
I know what you mean, but there is a reasonable distinction to be made especially for living persons. An "authorized" biography would be something like what Isaacson does, where they get exclusive access, anecdotes, and importantly confirmation or denial of certain facts or stories.
An "unauthorized" biography is not necessarily suspect but it is kind of a subgenre. Consider the difference between Isaacson's Musk biography and the work done by Kate and Ryan for Character Limit (https://www.amazon.com/Character-Limit-Elon-Destroyed-Twitte...) - not exactly a biography but the legwork is fundamentally different, reportorial or even adversarial where the narrative gets challenged, as opposed to accepted by the "authorized" Isaacson.
Authorized/unauthorized simply describes whether the subject works with the author or not. It's just the common terminology for it.
Technically, a wikipedia page of a [living] person is an unauthorized biography!
But we'd like to think the crowdsourced editing process gives it some more trustworthiness than a random person self-publishing a book
If a biography is authorized, then you can interview the subject, and in some cases those interviews provide a lot of the material. Walter Isaacson's biography of Steve Jobs was like this, for example.
In addition to the direct interview, there are other advantages of authorization that often allow the author a much deeper access to research the subject:
- Access to records, correspondence, and journals in the subject's possession
- explicit endorsement from the subject encourages their family, friends and colleagues to work with the author.
- Opportunities for the subject themselves to fact-check and contextualize the research.
That must be balanced against the fact that authorization also often provides the subject an opportunity to review the content, giving them a hand in crafting the narrative and/or suppressing unflattering details.
I don’t really get the appeal of using A.I. to write books. It’s a useful research and editorial tool that still requires thoughtful operation. But have it do the writing? It’s too shallow.
I use it to check the spelling and grammas of everything I post on my comedy newsletter[0]. As an ESL speaker, I do need some help with those areas. But the edits it typically recommends are just awful. Hyphen and em dash galore. A/B comparison and analogies that mimic the term “load-bearing”. I have to be extra careful to not let any of that slop slip through. At this point, I’m looking to work with a human editor. The AI is clearly showing not being up to par for it. At least in my experience.
[0] https://open.substack.com/pub/yelluwcomedy/p/the-free-and-wi...
I stumbled across this recently - back in the 70s publishing houses were paying people to churn out book.
https://www.youtube.com/watch?v=3nlbfZGFKuI
> Donald Rowland, a Suffolk author of nearly 200 books - written under more than 30 pseudonyms - has made a living out of his romantic fiction. Donald churns out more novels than anybody else in the county. He specialises in old-fashioned romance, his heroes and heroines are morally beyond reproach, there is no sex in his novels. The reason for his prolific output is simple - Donald is paid just fifty pounds per book.
I'd love it if marketplaces just banned AI books entirely. I see zero value in it. If I want AI text I can just go to AI it and it'll print out a books worth of text anyway; if I'm searching for a book I want something written by a human. I have zero interest in giving money to grifters and spammers.
Incidentally, I feel like Cartoon Network predicted our current dystopian future like over a decade ago with one of their joke infomercials: https://www.youtube.com/watch?v=XQLdhVpLBVE . (It's funny at least!) Thought coins and hiding from bots.
If sloppy digital pollution is the state of things to come, I fear for our species.
People are allowed to reject things and we've seen the public around the world overwhelming reject LLMs, what SV + VC doesn't like are being told no (shocker). Honestly believe they would rather destroy the planet than be forced to help others, which tracks seeing what you hear coming out of the mouths of these supposed "leaders" (deeply anti-human + anti-democratic sentiment).
It's no wonder they are worried for their lives. The majority of the planet rightfully hate their guts.
> and we've seen the public around the world overwhelming reject LLMs
Have we?
Where do you see people rejecting them?
Right now, most people are more than happy slurping in the slop. The push back is only in niche corners of the interwebs. Even the obvious issues with slop like "count the fingers" level of issues are being used for entertainment and embraced rather than rejection. So there's no real pressure to fix things with the slop generators. So many people are oblivious to the content they are consuming is slop or not bothered by it if they are told it is slop. So I'm really not buying your premise that "we've seen the public around the world overwhelming reject LLMs"
Given that everything in the book is public information, it's hard to argue that any of this is strictly _illegal_, given the First Amendment. But it's definitely distasteful to write a book about a living individual without their consent (even though this does happen all the time; technically Wikipedia does this too).
Though that does raise an interesting point: what's the difference between writing a book about someone and asking ChatGPT "Tell me the biography of X"? It's the historical meaning and prestige of saying "I wrote a book", even though with Amazon, anyone can write a book and self-publish it.
> Eamon Duede, a philosopher of science at Purdue University and one of the authors of a paper called “Why Slop Matters,” said A.I. brought joy to people who wanted to create something that very few other people would find interesting — like images of their friends in historical scenes.
> “People get an enormous amount of enjoyment and satisfaction out of creating stuff if it’s low effort,” he said. People who want to be creative, but might not be very good at it, can turn to A.I. and find “a bunch of barriers removed.”
I think there needs to be a different frame with which to analyze this scenario. Yes, it's distasteful to sell a book about a living person without their consent. But who are we to deny people the enjoyment of entertaining themselves by researching, brainstorming, and publishing a document/report/book, whatever you want to call it?
I'm glad the author mentioned it in the article, but it's definitely a different world now.
AI still images don't require a time investment from the viewer. Text and video slop is literally wasting hours of life from those who don't realize what they are consuming is devoid of redeeming value.
> But it's definitely distasteful to write a book about a living individual without their consent (even though this does happen all the time; technically Wikipedia does this too).
I do wonder about what would happen if the LLM were to hallucinate negative facts about the person.
Like, if some asshat vibe-wrote a biography about me that claimed that I once kicked a sack full of puppies as a child, would I be able to sue the "author" for defamation? At least, would it even be worth it to pursue?
What if we all collectively decided to AI-slop our own auto-biographies here?
It won't stop the Slop-pocalypse, but at least, then, we're funneling some of that money back to ourselves.
If a person's going to buy some vibe-coded slop about me, at least let it be my vibe-coded slop about me.
Couldn't find a discussion yet on Wikipedia about how slop books with ISBNs and publishers are more authoritative sources than primary sources by the letter of its rules, but I expect there'll be one by the time I finish popping a bag of popcorn
Unsurprisingly, Wikipedia does not take this position, and is in fact pretty skeptical of self-published and especially AI-generated work. Its guidelines do say that "books published by respected publishing houses" are more likely to be reliable sources, but that's obviously different from having an ISBN, and of course such books are not AI-generated.
The primary sources thing is a different matter; primary and secondary sources serve different purposes.
Brave search is returning secondary sources, not primary sources, for several serious real life topics in the last weeks it seems.. I mean Law and Medicine.. what is that about?
Anything written by AI should, at the very least, be filed under fiction.
I expect I'll get a lot of hate for this, and potentially deservedly so, but I've been doing something similar since late last year when Opus came out.
> Because romance sells, the professors thought it would be the genre most susceptible to A.I. intervention, but instead it was nonfiction...
I've been working mostly in erotica but have shifted to some nonfiction series lately.
I stopped for a while, but Fable and GPT 5.6 Sol have reinvigorated me.
I use Claude Code and other CLIs to manage the process, create first drafts, covers, research, etc. I heavily edit most things before I publish it.
The first question is probably one of profitability. So far I have made a little over $40, compared to probably $800 in AI subscription fees. So from that point of view it's been an absolute disaster.
If anyone is curious, I'd be happy to talk about any of it.
Why?
What internal drive moves you forward?
What sense of ownership/pride do you feel when you consider one of your works as "done"?
What would you do differently, if you were back at the starting block and had a budget of $800 to spend on writing nonfiction?
It started as a bit of curiosity: Can AI write good fiction? Can I create a process that produces better fiction? Will Anthropic even let me write porn? How do different models do?
It was another outlet to explore using AI outside of my 9-5 programming. I've experimented with building custom agents to write stories, custom memory storage methods, custom workflows, etc. I've also used AI to write content management systems and experiment with that.
Like with software, even if "slop", there's a particular joy to having an idea come to life very very quickly. I can start with a premise, a character, a few scene ideas, and get a workable draft.
For some of my ideas (outside of erotica), there are no books that I can find that cover what I'm interested in. So in another sense it's like using AI to do research for my own enjoyment, but I'm also tightening it up and publishing it.
> What sense of ownership/pride do you feel when you consider one of your works as "done"?
It's diminished compared to things I've done completely by myself. But it's non-zero and it's positive. I've actually shipped products rather than sitting on them, and there's joy and pride in that.
But I do still put a lot of work into it, both on the software side managing it, but also manually hand-editing it. I rewrite things until it doesn't feel like AI to me, even if I also use AI to make some of those edits.
> What would you do differently, if you were back at the starting block and had a budget of $800 to spend on writing nonfiction?
The lessons are very similar to other lessons on here.
Like with game development, don't spend your time on the engine. I'd spend less time building scaffolding and structure software.
I'd also be more patient and wait for weekly resets instead of bumping up to the higher tier.
I'd also stick to fewer projects more closely until completion -- I have a queue of about 80 some books to go through before I can publish them.
How much fact checking do you do on the research AI does?
I have the same problem in this project as I do at work: how do you verify the output?
Human review is the bottleneck at my office. I think software will be more and more AI written but also more and more AI validated.
For my nonfiction series, I have attempted adversarial agent fact checking, and I rerun it with newer models as they come out.
So: little human review of citations. I didn't expect this thread to shine on me favorably, but perhaps it's interesting to some.