[TO DO] Create unit tests for prompts from the prompt-library

[Sing-Li]

Use jest or ava to create unit tests for prompts --> driving direct-to-LLM calls to validate the prompts. Say - running each prompt against 10 receipts and if it passes 7 out of 10 then consider the prompt validated.

The receipt used should be fetched from our Hugging Face dataset of receipts.

Won't be possible to integrate with Github CI (not in 2025 anyways).

[Sing-Li]

Awesome contribution @thepiyush-303 ! Let's collaborate to make this one of the very first automated prompt unit tests around. Pls see in-line comments.

[priyanshuharshbodhi1]

Hey @Sing-Li , can we maintain a Notion Page for the development of this app. Which will be updates on each PR merge. It should contain which features are under building phase. Like a quick developing architecture overview. It should also contain which folder/files does which function in the pipeline.

[Sing-Li]

We can enable wiki on this repository. We can keep notes on the wiki until ti matures a bit - then we can transpose some of those pages into a doc tree that will become a permenant part of the repository. Thanks for bringing this up!

Please start creating note pages here -- https://github.com/RocketChat/Apps.Receipts.Processor/wiki