Image analysis would be better. I just wanted to test it quickly with different models (Gemini, GPT 4o, etc.) using an AI testing framework I am building
Instead of AI looking at your code and browser and writing Playwright scripts, AI is directly controlling browser and asserting over tests. Do we have to wait for on-prem multimodal low latency AI for this to be viable?
And nice "smoke test" and making me curious about your product.
Yes, Google gemini flash and other models are reasonably fast but on-prem multimodal models will make these dramatically better. We are prepping for that future by being local-first including a desktop app.
Alternative version: check for dings on my phone from every news outlet sending a notification about it.
What was your motivation to use AI for this instead of simple image analysis?
Writing prompts is much simpler than image analysis plus they make a AI test framework thingy
Image analysis would be better. I just wanted to test it quickly with different models (Gemini, GPT 4o, etc.) using an AI testing framework I am building
AI’s cool
AI is for cool fools
Test should be passing now
It passed right when the smoke started coming out - https://github.com/donobu-inc/donobu-papal-election-tests/bl...
Instead of AI looking at your code and browser and writing Playwright scripts, AI is directly controlling browser and asserting over tests. Do we have to wait for on-prem multimodal low latency AI for this to be viable?
And nice "smoke test" and making me curious about your product.
Yes, Google gemini flash and other models are reasonably fast but on-prem multimodal models will make these dramatically better. We are prepping for that future by being local-first including a desktop app.
How much did you end up spending on API credits for Flash 2.0?
$0.29 over the past 2 days
[dead]