This is great! I love the approach to privacy and security to make sure I can access my financial information on the go without having a third party have the credentials. The ability to use a local LLM on top of that is super helpful
Thanks, that is exactly why I built it. The hardest part was getting useful analysis out of a small local model. Most of the work ended up being in the harness around it rather than the model itself. As local models keep getting better, the analysis should too. This goes into more detail on the approach: https://maali.app/engineering/making-a-small-model-feel-fron...
This is great! I love the approach to privacy and security to make sure I can access my financial information on the go without having a third party have the credentials. The ability to use a local LLM on top of that is super helpful
Thanks, that is exactly why I built it. The hardest part was getting useful analysis out of a small local model. Most of the work ended up being in the harness around it rather than the model itself. As local models keep getting better, the analysis should too. This goes into more detail on the approach: https://maali.app/engineering/making-a-small-model-feel-fron...