Hey so I looked at your website and you say you're KidSafe COPPA certified, yet on their website it only mentions you as KidSafe listed? Any reason for the discrepancy?
Although cool, I can see how this product will just inhibit instead of enabling creativity and play in kids. Instead of having to draw something to see it, refining the drawing over minutes or hours, the kid will just lazily ask for some half formed idea, and see it materialize from thin air. That's just sad
Yeah. It's bad enough if kids prompting this stuff online is the new form that creativity is going to take. But this way, it's generating electronic crap that will end up in landfills as well.
Does a human review every sticker before it's ever shown to a child? If not, it's only a matter of time before the AI spits out something accidentally horrific.
> No internet open browsing or open chat features.
> AI toys shouldn’t need to go online or talk to strangers to work. Offline AI keeps playtime private and focused on creativity.
> No recording or long-term data storage.
> If it’s recording, it should be clear and temporary. Kids deserve creative freedom without hidden mics or mystery data trails.
> No eavesdropping or “always-on” listening
> Devices designed for kids should never listen all the time. AI should wake up only when it’s invited to.
> Clear parental visibility and control.
> Parents should easily see what the toy does, no confusing settings, no buried permissions.
> Built-in content filters and guardrails.
> AI should automatically block or reword inappropriate prompts and make sure results stay age-appropriate and kind."
Obviously the thing users here know, and "kid-safe" product after product has proven, is that safety filters for LLMs are generally fake. Perhaps they can exist some day, but a breakthrough like that isn't gonna come from an application-layer startup like this. Trillion dollar companies have been trying and failing for years.
All the other guardrails are fine but basically pointless if your model has any social media data in its dataset.
I'm sure you are correct about being able to do some clever prompting or tricks to get it to print inappropriate stickers, but I believe in this case it may be OK.
If you consider a threat model where the threat is printing inappropriate stickers, who are the threat actors? Children who are attempting to circumvent the controls and print inappropriate stickers? If they already know about topics that they shouldn't be printing and are trying to get it to print, I think they probably don't truly _Need_ the guardrails at that point.
In the same way many small businesses don't (most likely can't even afford to) opt to put security controls in place that are only relevant to blocking nation state attackers, this device really only needs enough controls in place to prevent a child from accidentally getting an inappropriate output.
It's just a toy for kids to print stickers with, and as soon as the user is old enough to know or want to see more adult content they can just go get it on a computer.
> Stickerbox is our attempt to make modern AI kid-safe, playful, and tangible. We’d love to hear what you think!
How is it made to be "kid-safe"?
> Our model includes strict safety filters that block inappropriate content before it ever appears, ensuring that every creation stays fun, imaginative, and age-appropriate.
How do you filter the output of a generative AI like this?
Filter the input? If it's trained on all kid-friendly material and you have guardrails on the inputs what's going to come out. I believe Apple has done this pretty successfully on their image gen stuff that was clearly aimed at kids. Granted the outputs are... very boring, but they seem to never give back anything inappropriate.
Make sure your materials safety/CPC stuff is done correctly (see other comments [0].) For the content safety concerns, I assume you're using OpenAI's Moderation endpoint (or similar). If not, you need to be.
Assuming you've got those solved: I could see this being something that's rented out for parties the way people do with photo booths. Imagine having Stickerbox on a media cart with a battery and rolling it around a children's hospital floor.
Pursuing either of those avenues will (rightly) require you have both of the concerns I listed solved, of course.
don't mean to steal your customers, but can I just buy good thermal sticker paper somewhere that would work with a regular receipt printer? That would be fun for side nonsense, with or without AI.
When I was more youthful I remember getting the avery sticker sheets for a school election, but a roll where someone could do one at a time would be more useful for random stuff.
Looks really cool, but unfortunately I can not use it because thermal printing paper is coated with endocrine-disrupting chemicals like Bisphenol-A (BPA) or its substitute, Bisphenol-S (BPS), which can be absorbed through skin contact, potentially leading to metabolic, reproductive, or cancerous issues. It’s basically a very fine plastic dust. Though risk depends on exposure duration and amount, it’s not something I would feel comfortable with kids.
I can't find the CPC certificate for this product. Children's toys are heavily regulated in the US and based on the thermal paper, the lack of display of their authorization to sell, the fly by night nature of a drop shipping website like this ...
I don't think this is a legal product to market towards children in the US
and that's without even mentioning the LLM usage
real glad my nibblings all got real art supplies when they were little. that fosters real creativity and the lot of them can draw better than any of the examples on the sales page, and they're still little kids. and there's no subscription, no EULA, their supplies are legal and safe to use, etc.
Hey so I looked at your website and you say you're KidSafe COPPA certified, yet on their website it only mentions you as KidSafe listed? Any reason for the discrepancy?
https://www.kidsafeseal.com/certifiedproducts/stickerbox_dev...
Also, do you guys have CPSC CPC certificate? I couldn't find anything to that effect.
> We wanted to let kids combine the power of their ideas with AI tools
Why? Kids can combine the power of their ideas with crayons, markers, and pencils.
This is the best answer.
Although cool, I can see how this product will just inhibit instead of enabling creativity and play in kids. Instead of having to draw something to see it, refining the drawing over minutes or hours, the kid will just lazily ask for some half formed idea, and see it materialize from thin air. That's just sad
Agree with all of that apart from "although cool". Why is it 'cool'? It's 'cool' only in the way Elon Musk and his retracting door handles are 'cool'.
Some kids might not have arms though? So this helps with that bit, but I'm not sure what they would do with the stickers.
Yeah. It's bad enough if kids prompting this stuff online is the new form that creativity is going to take. But this way, it's generating electronic crap that will end up in landfills as well.
More options is better. I think it's possible for a niche to exist for AI creative tools like this.
I'm struggling to find the creative part in having an AI print stickers for a child. Seems like the entire creative part is skipped over.
Does a human review every sticker before it's ever shown to a child? If not, it's only a matter of time before the AI spits out something accidentally horrific.
I searched their site for any information on "how" they can claim it's safe for kids. This is what I could find: https://stickerbox.com/blogs/all/ai-for-kids-a-parent-s-guid...
> No internet open browsing or open chat features. > AI toys shouldn’t need to go online or talk to strangers to work. Offline AI keeps playtime private and focused on creativity.
> No recording or long-term data storage. > If it’s recording, it should be clear and temporary. Kids deserve creative freedom without hidden mics or mystery data trails.
> No eavesdropping or “always-on” listening > Devices designed for kids should never listen all the time. AI should wake up only when it’s invited to.
> Clear parental visibility and control. > Parents should easily see what the toy does, no confusing settings, no buried permissions.
> Built-in content filters and guardrails. > AI should automatically block or reword inappropriate prompts and make sure results stay age-appropriate and kind."
Obviously the thing users here know, and "kid-safe" product after product has proven, is that safety filters for LLMs are generally fake. Perhaps they can exist some day, but a breakthrough like that isn't gonna come from an application-layer startup like this. Trillion dollar companies have been trying and failing for years.
All the other guardrails are fine but basically pointless if your model has any social media data in its dataset.
> AI toys shouldn’t need to go online or talk to strangers to work.
Interesting they fail their own checklist in that article.
> Here’s a parent checklist for safe AI play:
> [...] AI toys shouldn’t need to go online
From the FAQ:
> Can I use Stickerbox without Wi-Fi?
> You will need Wi-Fi or a hotspot connection to connect and generate new stickers.
I'm sure you are correct about being able to do some clever prompting or tricks to get it to print inappropriate stickers, but I believe in this case it may be OK.
If you consider a threat model where the threat is printing inappropriate stickers, who are the threat actors? Children who are attempting to circumvent the controls and print inappropriate stickers? If they already know about topics that they shouldn't be printing and are trying to get it to print, I think they probably don't truly _Need_ the guardrails at that point.
In the same way many small businesses don't (most likely can't even afford to) opt to put security controls in place that are only relevant to blocking nation state attackers, this device really only needs enough controls in place to prevent a child from accidentally getting an inappropriate output.
It's just a toy for kids to print stickers with, and as soon as the user is old enough to know or want to see more adult content they can just go get it on a computer.
It's [...] not a place where kids can wander into unknown content.
When LLMs are involved, I don't find the guardrails as hard as they are making out.
If AI were built for kids, what would it look like?
Exactly like this and it's heartbreaking.
> Stickerbox is our attempt to make modern AI kid-safe, playful, and tangible. We’d love to hear what you think!
How is it made to be "kid-safe"?
> Our model includes strict safety filters that block inappropriate content before it ever appears, ensuring that every creation stays fun, imaginative, and age-appropriate.
How do you filter the output of a generative AI like this?
Filter the input? If it's trained on all kid-friendly material and you have guardrails on the inputs what's going to come out. I believe Apple has done this pretty successfully on their image gen stuff that was clearly aimed at kids. Granted the outputs are... very boring, but they seem to never give back anything inappropriate.
Cynically, my guess is it's just through the system prompt.
I’m sure they just dump the image into another LLM to gauge “safety” and pretend it’s good enough.
The biggest problem is that when this company goes out of business in 5 years that it'll become a paperweight.
I'm still bitter at Logitech for screwing up Squeezebox.
Congrats on the launch.
Make sure your materials safety/CPC stuff is done correctly (see other comments [0].) For the content safety concerns, I assume you're using OpenAI's Moderation endpoint (or similar). If not, you need to be.
Assuming you've got those solved: I could see this being something that's rented out for parties the way people do with photo booths. Imagine having Stickerbox on a media cart with a battery and rolling it around a children's hospital floor.
Pursuing either of those avenues will (rightly) require you have both of the concerns I listed solved, of course.
[0]: https://news.ycombinator.com/item?id=46331271
When Google and OpenAI struggle to filter their own models to be age appropriate, what makes you think you have been able to crack the problem?
wow the haters are out today! Happy Holidays All! Congratulations to Bob & Arun on the launch!
This post has the highest % of unflagged comments in violation of the HN guidelines I've seen in a long time.
All the constructive/neutral comments are downvoted, too, giving them even more visibility.
don't mean to steal your customers, but can I just buy good thermal sticker paper somewhere that would work with a regular receipt printer? That would be fun for side nonsense, with or without AI.
When I was more youthful I remember getting the avery sticker sheets for a school election, but a roll where someone could do one at a time would be more useful for random stuff.
500 BPA/BPS-free 4"x3" thermal labels for $16 or less: https://www.amazon.com/Thermal-Labels-Shipping-Multipurpose-...
Any of a variety of 4" thermal shipping label printers without AI, generally ranging from $30 to $75: https://www.amazon.com/Phomemo-Bluetooth-241BT-Wireless-Comp...
Everything about this is marked up to hell to pay for the generative AI end.
Wow, a product that exists entirely to deprive children of the ability to develop artistic creativity.
It's rare that I see a launch on HN that I could call abjectly evil, but this is certainly it.
Looks really cool, but unfortunately I can not use it because thermal printing paper is coated with endocrine-disrupting chemicals like Bisphenol-A (BPA) or its substitute, Bisphenol-S (BPS), which can be absorbed through skin contact, potentially leading to metabolic, reproductive, or cancerous issues. It’s basically a very fine plastic dust. Though risk depends on exposure duration and amount, it’s not something I would feel comfortable with kids.
https://pmc.ncbi.nlm.nih.gov/articles/PMC5453537/
The site claims to have BPA and BPS free printing paper
Page claims “No-BPA and no-BPS printing paper”
Did you miss the part where they explicitly said they did “ sourcing safe BPA/BPS free thermal paper” ?
I can't find the CPC certificate for this product. Children's toys are heavily regulated in the US and based on the thermal paper, the lack of display of their authorization to sell, the fly by night nature of a drop shipping website like this ...
I don't think this is a legal product to market towards children in the US
and that's without even mentioning the LLM usage
real glad my nibblings all got real art supplies when they were little. that fosters real creativity and the lot of them can draw better than any of the examples on the sales page, and they're still little kids. and there's no subscription, no EULA, their supplies are legal and safe to use, etc.
This product is actual trash