Skip to content

Conversation

@lukeroantreeONS
Copy link
Contributor

📌 Pull Request Template

Please complete all sections

✨ Summary

Adds functionality to synthetic_responses module to have an LLM predict demographic characteristics based on survey response.
Intended use-case is for identifying where bias may manifest within other LLM interactions.

📜 Changes Introduced

  • feat(synthetic_responses): adds construct_demographic_prediction_prompt() method
  • feat(synthetic_responses): adds predict_demographic_info() method
  • refactor(scripts): splits the synthetic-responses example script into two; one for answering follow-ups, one for predicting demographic information

✅ Checklist

Please confirm you've completed these checks before requesting a review.

  • Code is formatted using Black
  • Imports are sorted using isort
  • Code passes linting with Ruff, Pylint, and Mypy
  • Security checks pass using Bandit
  • API and Unit tests are written and pass using pytest
  • Terraform files (if applicable) follow best practices and have been validated (terraform fmt & terraform validate)
  • DocStrings follow Google-style and are added as per Pylint recommendations
  • Documentation has been updated if needed

🔍 How to Test

run the sic vector store and survey assist API locally,
run the two example scripts in scripts/synthetic_responses/

@lukeroantreeONS lukeroantreeONS marked this pull request as draft July 10, 2025 16:29
Base automatically changed from SA-184_synthetic_follow_ups to main July 23, 2025 13:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants