-
Notifications
You must be signed in to change notification settings - Fork 5
chore: Bump orchestrator version to 0.10.0 #5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Mateus Devino <[email protected]>
Bumps [openssl](https://github.com/sfackler/rust-openssl) from 0.10.71 to 0.10.72. - [Release notes](https://github.com/sfackler/rust-openssl/releases) - [Commits](rust-openssl/rust-openssl@openssl-v0.10.71...openssl-v0.10.72) --- updated-dependencies: - dependency-name: openssl dependency-version: 0.10.72 dependency-type: indirect ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Mateus Devino <[email protected]>
Bumps [tokio](https://github.com/tokio-rs/tokio) from 1.44.1 to 1.44.2. - [Release notes](https://github.com/tokio-rs/tokio/releases) - [Commits](tokio-rs/tokio@tokio-1.44.1...tokio-1.44.2) --- updated-dependencies: - dependency-name: tokio dependency-version: 1.44.2 dependency-type: direct:production ... Signed-off-by: dependabot[bot] <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
* Add single detector tests for streaming_content_detection Signed-off-by: Mateus Devino <[email protected]> * Add single detector tests for streaming_classification_with_gen Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
Signed-off-by: declark1 <[email protected]> Co-authored-by: Evaline Ju <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
* 🔥 Remove whole doc chunking from chunker client Signed-off-by: Evaline Ju <[email protected]> * 🔥 Remove unused imports Signed-off-by: Evaline Ju <[email protected]> --------- Signed-off-by: Evaline Ju <[email protected]>
* Validate guardrails for chat_completions unary Signed-off-by: Mateus Devino <[email protected]> * Validate guardrails for chat_detection Signed-off-by: Mateus Devino <[email protected]> * Validate guardrails for classification_with_text_gen Signed-off-by: Mateus Devino <[email protected]> * Add non-existing detector tests for chat_completions Signed-off-by: Mateus Devino <[email protected]> * Add non-existing detector tests for chat_detection Signed-off-by: Mateus Devino <[email protected]> * Validate guardrails for context_docs_detection Signed-off-by: Mateus Devino <[email protected]> * Validate guardrails for detection_on_generation Signed-off-by: Mateus Devino <[email protected]> * Make non existing detector a constant Signed-off-by: Mateus Devino <[email protected]> * Validate guardrails for generation_with_detection Signed-off-by: Mateus Devino <[email protected]> * Validate guardrails for text_content_detection Signed-off-by: Mateus Devino <[email protected]> * Add guardrails validation for streaming_classification_with_gen Signed-off-by: Mateus Devino <[email protected]> * Add guardrails validation for streaming_content_detection Signed-off-by: Mateus Devino <[email protected]> * Update logs Signed-off-by: Mateus Devino <[email protected]> * Update src/utils.rs Co-authored-by: Dan Clark <[email protected]> Signed-off-by: Mateus Devino <[email protected]> * Update src/utils.rs Co-authored-by: Dan Clark <[email protected]> Signed-off-by: Mateus Devino <[email protected]> * Update src/utils.rs Co-authored-by: Dan Clark <[email protected]> Signed-off-by: Mateus Devino <[email protected]> * Update src/utils.rs Co-authored-by: Dan Clark <[email protected]> Signed-off-by: Mateus Devino <[email protected]> * Update src/utils.rs Co-authored-by: Dan Clark <[email protected]> Signed-off-by: Mateus Devino <[email protected]> * Apply changes requested Signed-off-by: Mateus Devino <[email protected]> * Remove unneded conditionals Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]> Signed-off-by: Mateus Devino <[email protected]> Co-authored-by: Dan Clark <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
Signed-off-by: declark1 <[email protected]> Co-authored-by: Mateus Devino <[email protected]>
* Remove duplicate chat_completions test file Signed-off-by: Mateus Devino <[email protected]> * Build mocktail from main Signed-off-by: Mateus Devino <[email protected]> * Drop unnecessary clone and vec! calls for mocks Signed-off-by: Mateus Devino <[email protected]> * Clone duplicate mocks Signed-off-by: Mateus Devino <[email protected]> * Build mocktail from latest main Signed-off-by: Mateus Devino <[email protected]> * Add orchestrator error 500 helper Signed-off-by: Mateus Devino <[email protected]> * More orchestrator error helper functions Signed-off-by: Mateus Devino <[email protected]> * Update tests/common/errors.rs Co-authored-by: Evaline Ju <[email protected]> Signed-off-by: Mateus Devino <[email protected]> * Move imports below copyright notice Signed-off-by: Mateus Devino <[email protected]> * Remove get_ prefix from helper functions Signed-off-by: Mateus Devino <[email protected]> * Replace generics with &str Signed-off-by: Mateus Devino <[email protected]> * Make helper functions part of OrchestratorError Signed-off-by: Mateus Devino <[email protected]> * Remove unneeded constants Signed-off-by: Mateus Devino <[email protected]> * Rename chunker error Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]> Signed-off-by: Mateus Devino <[email protected]> Co-authored-by: Evaline Ju <[email protected]>
Signed-off-by: declark1 <[email protected]>
* To support s390x Signed-off-by: Sanketha CR [email protected] Signed-off-by: Sanketha <[email protected]> * Update Dockerfile Updated Docker file removed elif block and updated with else condition Co-authored-by: Dan Clark <[email protected]> Signed-off-by: Sanketha-Cr <[email protected]> --------- Signed-off-by: Sanketha <[email protected]> Signed-off-by: Sanketha-Cr <[email protected]> Co-authored-by: root <[email protected]> Co-authored-by: Dan Clark <[email protected]>
* ✨✅ Initial chat completions batcher Signed-off-by: Evaline Ju <[email protected]> * ♻️✅ Chat completions batcher with out-of-order chunks Signed-off-by: Evaline Ju <[email protected]> * ✅ Different choice chunks test Signed-off-by: Evaline Ju <[email protected]> * 🧪 Detection batch test Signed-off-by: Evaline Ju <[email protected]> * 🧪 Switch chunk ordering Signed-off-by: Evaline Ju <[email protected]> * 🧪 Reverse chunk order to non-edge case Signed-off-by: Evaline Ju <[email protected]> * 💡 Add unit tests comments on edge case Signed-off-by: Evaline Ju <[email protected]> * 🎨💡 Clean up debug Signed-off-by: Evaline Ju <[email protected]> * 🔀 Merge with main Signed-off-by: Evaline Ju <[email protected]> * Update src/orchestrator/types/detection_batcher/chat_completion.rs Co-authored-by: Dan Clark <[email protected]> Signed-off-by: Evaline Ju <[email protected]> * 🏷️ Add ChoiceIndex type Signed-off-by: Evaline Ju <[email protected]> * ♻️ Use ChoiceIndex Co-authored-by: Dan Clark <[email protected]> Signed-off-by: Evaline Ju <[email protected]> * ✅ Update tests with ChoiceIndex Signed-off-by: Evaline Ju <[email protected]> --------- Signed-off-by: Evaline Ju <[email protected]> Co-authored-by: Dan Clark <[email protected]>
* 🥅 Handle unsupported media type errors Signed-off-by: Evaline Ju <[email protected]> * ♻️ Use mutable headers Signed-off-by: Evaline Ju <[email protected]> * ♻️ Use HeaderValue Signed-off-by: Evaline Ju <[email protected]> --------- Signed-off-by: Evaline Ju <[email protected]>
…endpoint (foundation-model-stack#388) * 🐛🔧 Allow input detection on text generation Signed-off-by: Evaline Ju <[email protected]> * ✅ Valid whole doc input detection test Signed-off-by: Evaline Ju <[email protected]> --------- Signed-off-by: Evaline Ju <[email protected]>
Signed-off-by: declark1 <[email protected]>
…tack#390) Signed-off-by: declark1 <[email protected]>
…ation-model-stack#392) * Implement re-try logic for TestOrchestratorServer port binding Signed-off-by: Mateus Devino <[email protected]> * Match ioError specifically Signed-off-by: Mateus Devino <[email protected]> * Apply changes requested on PR Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
* Drop Batch associated type from DetectionBatcher and generics, drop detector_id from DetectionStream, integrate single detection stream optimization Signed-off-by: declark1 <[email protected]> * Update DetectionBatchStream docstring Signed-off-by: declark1 <[email protected]> --------- Signed-off-by: declark1 <[email protected]>
…el-stack#383) * Add content validation Signed-off-by: Mateus Devino <[email protected]> * Add no_detectors tests for chat completions Signed-off-by: Mateus Devino <[email protected]> * Add empty content message test for chat completions Signed-off-by: Mateus Devino <[email protected]> * Add comments about changing validation Signed-off-by: Mateus Devino <[email protected]> * Update chat completions passthrough tests for empty message Signed-off-by: Mateus Devino <[email protected]> * Add further validation for empty content Signed-off-by: Mateus Devino <[email protected]> * Test case: passthrough with last message as an array Signed-off-by: Mateus Devino <[email protected]> * Prevent content array on last message when input detector is present Signed-off-by: Mateus Devino <[email protected]> * nit: combine if clauses Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
evaline-ju
approved these changes
Jun 5, 2025
evaline-ju
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
m-misiura
approved these changes
Jun 9, 2025
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.