Private AI, on your hardware
The model lives next to the ledger. Not in someone's cloud.
Finanly's model layer runs on your own machine behind an internal-only gateway. No public AI API ever sees a transaction, a customer or a balance — and the model never posts an entry.
- Runs on your own hardware
- Tenant isolation by Postgres RLS
- Every irreversible action audited
- Statements parity-gated hourly
Private AI isn't a setting. It's an architecture: an internal gateway, a local model, a semantic plan the ledger verifies before anything is answered.
Boundary
Internal-only by design. Audited by default.
The AI gateway is not reachable from the internet. core-api calls it with a short-lived JWT scoped to the gateway audience and the active tenant; the gateway serves the private model on the same host.
- Endpoints for BI ask, vendor enrichment, compliance narrative and chat — all tenant-scoped
- Postgres row-level security plus application RBAC under every query
- Append-only audit log for every irreversible action
Grounding
Answers are plans, not prose.
The model produces a semantic plan JSON. core-api validates it against the governed Cube model and executes it. Three tools — chart of accounts, cube measures, period resolver — mean it cannot invent an account, a field or a date.
- Fails closed on ambiguity
- Every figure links to its rows
Where the model works
Four jobs, one private model layer.
Ask your books
Conversational BI over the semantic layer, with drill-down.
Categorization
Third tier of the auto-categorizer, after exact and similarity matches.
Vendor enrichment
Counterparty names normalized and classified into governed groups.
Compliance narrative
Audit-report narratives for organic traceability, grounded in lot and certificate data.
FAQ
Straight answers
Which model, exactly?
Today: an open-weights general-purpose model served privately on your hardware behind the internal gateway (we name it in conversation, not in marketing). In development: Finanly's own finance-tuned model, which drops into the same gateway. Either way it only proposes — core-api validates plans and humans approve postings.
Is there a cloud fallback?
Not in Finanly's gateway. We don't advertise one because we don't ship one. If the local model is down, AI features report unavailable; nothing is silently routed elsewhere.
What does the model actually see?
For Ask: your question plus the governed vocabulary (accounts, measures, dimensions) — it plans, it doesn't read the ledger. For categorization: the transaction text and your chart of accounts. Everything stays on the host, scoped to the active tenant by a short-lived JWT.
Where does data live?
In Postgres on the host you run Finanly on — one Docker Compose stack with core-api, the AI gateway, connectors and the jobs worker. Integration secrets are encrypted at rest (AES-GCM) and only decrypted inside the connector that owns them.
How is one tenant kept away from another?
Postgres row-level security is forced on every tenant-scoped table, the runtime refuses to start with a database role that could bypass it, and application RBAC sits above. The AI gateway receives a token bound to a single tenant per call.
Is Finanly SOC 2 certified?
No — not today, and we won't imply otherwise. The controls that matter (RLS, encrypted secrets, append-only audit, internal-only AI) are in place and documented; certification is a roadmap item.
What hardware does the model need?
A host with a GPU that can serve a mid-sized open-weights model, or a CPU box if you accept slower answers. Talk to us about the host that fits your volume.
Is every AI action logged?
Every irreversible action is written to an append-only audit log enforced by a database trigger. AI drafts themselves are suggestions, not actions — nothing changes until a human accepts.
Can I run it entirely offline?
The AI layer, yes. Connectors need to reach the services they sync (Mercury, Plaid, Shopify…); the model, the gateway and the ledger never need an outbound connection.
Keep the model where the ledger is.
Private beta. Tell us where to send your access, and which company you close first.