First summarize the text scrapped text from xml tree of urls using gemini.
then generate QA from sumarised text.
Performance of Gemini was way way better than GPT-4.
Fitering was done based on Heuristics after rigrous analysis because llms were not always accurate.
summary_prompt_template= """
You'r legal expert… See the full description on the dataset page: https://huggingface.co/datasets/Guggu/CANADA_ACT_REGULATION_QA.