Skip to content

Add token cost editing/adding via the UI #719

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
ceicke wants to merge 1 commit into from
Closed

Add token cost editing/adding via the UI #719

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 12 additions & 1 deletion app/controllers/settings/language_models_controller.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -63,6 +63,17 @@ def set_system_language_model
end

def language_model_params
params.require(:language_model).permit(:api_name, :name, :best, :supports_images, :supports_tools, :api_service_id, :supports_system_message, :supports_pdf)
params.require(:language_model).permit(
:api_name,
:name,
:best,
:supports_images,
:supports_tools,
:api_service_id,
:supports_system_message,
:supports_pdf,
:input_token_cost_cents,
:output_token_cost_cents
)
end
end
26 changes: 26 additions & 0 deletions app/views/settings/language_models/_form.html.erb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -76,6 +76,32 @@
<%= form.label :supports_pdf, t('app.settings.language_models.form.supports_pdf') %>
</div>

<div class="my-5">
<%= form.label :input_token_cost_cents, t('app.settings.language_models.form.input_token_cost_cents') %>
<div class="mt-2 flex items-center gap-2">
<%= form.number_field :input_token_cost_cents,
step: :any,
min: 0,
class: "block shadow rounded-md border border-gray-200 outline-none px-3 py-2 w-full dark:text-black"
%>
<span class="text-sm text-gray-600 dark:text-gray-300 whitespace-nowrap"><%= t('app.settings.language_models.form.token_cost_unit') %></span>
</div>
<p class="text-sm text-gray-600 dark:text-gray-300 mt-1"><%= t('app.settings.language_models.form.token_cost_hint') %></p>
</div>

<div class="my-5">
<%= form.label :output_token_cost_cents, t('app.settings.language_models.form.output_token_cost_cents') %>
<div class="mt-2 flex items-center gap-2">
<%= form.number_field :output_token_cost_cents,
step: :any,
min: 0,
class: "block shadow rounded-md border border-gray-200 outline-none px-3 py-2 w-full dark:text-black"
%>
<span class="text-sm text-gray-600 dark:text-gray-300 whitespace-nowrap"><%= t('app.settings.language_models.form.token_cost_unit') %></span>
</div>
<p class="text-sm text-gray-600 dark:text-gray-300 mt-1"><%= t('app.settings.language_models.form.token_cost_hint') %></p>
</div>

<%= form.submit t('app.settings.language_models.form.save'),
class: %|
inline-block font-bold
Expand Down
4 changes: 4 additions & 0 deletions config/locales/de.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,6 +75,10 @@ de:
supports_tools: "Unterstützt Tools (Function Calling)?"
supports_system_message: "Unterstützt Systemnachricht (Anweisungen)?"
supports_pdf: "Unterstützt PDFs?"
input_token_cost_cents: "Kosten pro Eingabetoken (USD/Token)"
output_token_cost_cents: "Kosten pro Ausgabetoken (USD/Token)"
token_cost_unit: "USD/Token"
token_cost_hint: "Kosten pro Token in USD (z. B. 0,000002 für 0,002 $ pro 1T). Leer lassen, um keine Kosten zu erfassen."
test: "Test"
save: "Speichern"
saving: "Speichere..."
Expand Down
4 changes: 4 additions & 0 deletions config/locales/en.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -104,6 +104,10 @@ en:
supports_tools: "Supports Tools (Function Calling)?"
supports_system_message: "Supports System Message (Instructions)?"
supports_pdf: "Supports PDFs?"
input_token_cost_cents: "Input token cost (USD/token)"
output_token_cost_cents: "Output token cost (USD/token)"
token_cost_unit: "USD/token"
token_cost_hint: "Cost per single token in USD (e.g. 0.000002 for $0.002 per 1K). Leave blank to skip cost tracking."
test: "Test"
save: "Save"
saving: "Saving..."
Expand Down
5 changes: 3 additions & 2 deletions test/controllers/settings/language_models_controller_test.rb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ class Settings::LanguageModelsControllerTest < ActionDispatch::IntegrationTest

assert_redirected_to settings_language_models_url
assert_equal "Saved", flash[:notice]
assert_equal params, LanguageModel.last.slice(:api_name, :api_service_id, :name, :supports_images)
assert_equal params.slice(:api_name, :api_service_id, :name, :supports_images), LanguageModel.last.slice(:api_name, :api_service_id, :name, :supports_images)
assert_equal @user, LanguageModel.last.user
end

Expand Down Expand Up @@ -149,7 +149,8 @@ class Settings::LanguageModelsControllerTest < ActionDispatch::IntegrationTest

assert_redirected_to settings_language_models_url
assert_equal "Saved", flash[:notice]
assert_equal params, @language_model.reload.slice(:api_name, :name, :supports_images)
@language_model.reload
assert_equal params.slice("api_name", "name", "supports_images"), @language_model.slice(:api_name, :name, :supports_images)
end

test "update should update best language model" do
Expand Down