Skip to content

Commit ca1112b

Browse files
committed
fix: follow wikipedia's robot policy
1 parent 31016ed commit ca1112b

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

backend/caviardeul/services/articles.py

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -57,6 +57,10 @@ async def get_article_html_from_wikipedia(page_id: str) -> tuple[str, str]:
5757
"origin": "*",
5858
"page": page_id,
5959
},
60+
headers={
61+
"User-Agent": "Caviardeul/1.0 (https://caviardeul.fr; [email protected])",
62+
"Accept-Encoding": "gzip",
63+
},
6064
)
6165
if response.status_code != 200:
6266
raise ArticleFetchError(f"Unexected response from API: {response.status_code}")

0 commit comments

Comments
 (0)