How does this compare in terms of latency, cost, and effectiveness to jsonformer? https://github.com/1rgs/jsonformer. - Source: Hacker News / 11 months ago

I'm not sure how this is different than: https://github.com/1rgs/jsonformer or https://github.com/mkuchnik/relm or https://github.com/Shopify/torch-grammar Overall there are a ton of these logit based guidance systems, the reason they don't get tons of traction is the SOTA models are behind REST APIs that don't enable this fine-grained approach. Those... - Source: Hacker News / 11 months ago

You're correct with interpreting how the model works wrt it returning tokens one at a time. The model returns one token, and the entire context window gets shifted right by one to for account it when generating the next one. As for model performance at different context sizes, it's seems a bit complicated. From what I understand, even if models are tweaked (for example using the superHOT RoPE hack or sparse... - Source: Hacker News / 11 months ago

From here, we just need to continue generating tokens until we get to a closing quote. This approach was borrowed from Jsonformer which uses a similar approach to induce LLMs to generate structured output. Continuing to do so for each property using Replit's code LLM gives the following output:. - Source: dev.to / 12 months ago

Https://github.com/1rgs/jsonformer or https://github.com/microsoft/guidance may help get better results, but I ended up with a bit more of a custom solution. Source: 12 months ago

I think my app still can't beat chatpdf.com. :(. Source: 12 months ago

Quoting directly from the FAQ popup on chatpdf.com:. Source: about 1 year ago

Try using chatpdf.com I don't really use documents that much. Source: about 1 year ago

I've asked ChatGPT to create excel formulas for me, that's the extent of my experience here. As far as analyzing an actual spreadsheet data, I believe the beta OpenAI tool, code interpreter, can do that. I don't have access to that, however. I have more experience with PDFs. There are several plug-ins for interacting with PDFs if you are a ChatGPT plus subscriber. For free, you can open a PDF in the Microsoft... Source: about 1 year ago

ChatPdf: Free version supports 120 pages/PDF, 10 MB/PDF, 3 PDFs/day, and 50 questions/day. Source: about 1 year ago