CHORE: Sync with upstream #7
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: declark1 <[email protected]>
Signed-off-by: declark1 <[email protected]>
* Update packages with cargo update Signed-off-by: Mateus Devino <[email protected]> * Upgrade opentelemetry crates Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
* 🔧 Add resolution strategy to grpc client Signed-off-by: Evaline Ju <[email protected]> * 🚧 Add retry logic for gRPC calls Signed-off-by: gkumbhat <[email protected]> * 🔧 Configurable max retries Signed-off-by: Evaline Ju <[email protected]> * 🐛 Fix off by 1 error for maximum retries Signed-off-by: gkumbhat <[email protected]> * ✨ Add retry function for streaming generation and tokenization Signed-off-by: gkumbhat <[email protected]> * 📦 Replace ginepro with custom folks to add endpoint configuration Signed-off-by: gkumbhat <[email protected]> * 🔧 Enable keep alive for gRPC Signed-off-by: gkumbhat <[email protected]> * 🚚🎨 Rename config variable and simplify resolution strategy code Signed-off-by: gkumbhat <[email protected]> --------- Signed-off-by: Evaline Ju <[email protected]> Signed-off-by: gkumbhat <[email protected]> Co-authored-by: Evaline Ju <[email protected]>
* wip: upgrade tonic Signed-off-by: Mateus Devino <[email protected]> * Update ginepro Signed-off-by: Mateus Devino <[email protected]> * Fix ginepro revision Signed-off-by: Mateus Devino <[email protected]> * Remove ginepro version Signed-off-by: Mateus Devino <[email protected]> * Update ginepro's fork Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
…ion-model-stack#399) * Added Dockerfile.x86, Dockerfiles390x and removed Dockerfile Signed-off-by: root <[email protected]> Signed-off-by: Sanketha CR <[email protected]> * Added missing enviroment in x86 Dockerfile Signed-off-by: Sanketha CR <[email protected]> * Renamed Dockerfile.x86 with Dockerfile.amd64 Signed-off-by: Sanketha CR <[email protected]> --------- Signed-off-by: root <[email protected]> Signed-off-by: Sanketha CR <[email protected]> Co-authored-by: root <[email protected]>
…#410) Signed-off-by: declark1 <[email protected]>
Signed-off-by: declark1 <[email protected]>
* Update OTel packages to 0.30.0 nad otel-tracing to 0.31.0 Signed-off-by: Mateus Devino <[email protected]> * Remove unneeded TraceError Signed-off-by: Mateus Devino <[email protected]> * Remove TracingError custom enum Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
Signed-off-by: declark1 <[email protected]>
…tack#413) Signed-off-by: declark1 <[email protected]>
…tions (foundation-model-stack#414) Signed-off-by: Mateus Devino <[email protected]>
* Upgrade dependencies Signed-off-by: Mateus Devino <[email protected]> * Manage rustls-webpki breaking changes Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
Signed-off-by: Evaline Ju <[email protected]>
Signed-off-by: Gaurav Kumbhat <[email protected]>
…tack/Add-Mateus-as-maintainer Add Mateus in CODEOWNERS
* Move test to previous stage on Dockerfile Signed-off-by: Mateus Devino <[email protected]> * Update dockerfiles Signed-off-by: Mateus Devino <[email protected]> * Remove linting and formatting stages from dockerfile Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
* Update Dockerfile.s390x Copy test resources required for executing unit tests Signed-off-by: Sanketha-Cr <[email protected]> * Update Dockerfile.amd64 Copy test resources required for executing unit tests Signed-off-by: Sanketha-Cr <[email protected]> * Update Dockerfile.amd64 Copy test resources required for executing unit tests Signed-off-by: Sanketha-Cr <[email protected]> * Update Dockerfile.amd64 Added space in the comments Signed-off-by: Sanketha-Cr <[email protected]> * Update Dockerfile.s390x Added spaces for comments Signed-off-by: Sanketha-Cr <[email protected]> --------- Signed-off-by: Sanketha-Cr <[email protected]>
* Add Dockerfile.ppc64le Signed-off-by: Varad Ahirwadkar <[email protected]> * Update Dockerfile.ppc64le Update comment Signed-off-by: Dan Clark <[email protected]> --------- Signed-off-by: Varad Ahirwadkar <[email protected]> Signed-off-by: Dan Clark <[email protected]> Co-authored-by: Dan Clark <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
…oundation-model-stack#427) Signed-off-by: declark1 <[email protected]>
* Update non-breaking dependencies Signed-off-by: Mateus Devino <[email protected]> * Update Rust to 1.88.0 Signed-off-by: Mateus Devino <[email protected]> * Apply linting and formatting Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
…dation-model-stack#431) Signed-off-by: declark1 <[email protected]>
…dation-model-stack#432) Signed-off-by: declark1 <[email protected]>
Signed-off-by: Evaline Ju <[email protected]>
…-model-stack#434) Signed-off-by: Evaline Ju <[email protected]>
…n-model-stack#435) * 📝 Update section titles Signed-off-by: Evaline Ju <[email protected]> * 📝🚧 Add completions-detection endpoint Signed-off-by: Evaline Ju <[email protected]> * ✨ Completions detections Signed-off-by: Evaline Ju <[email protected]> --------- Signed-off-by: Evaline Ju <[email protected]>
* Update handle_streaming error handling logic, add OpenAiErrorMessage Signed-off-by: declark1 <[email protected]> * Update From<orchestrator::Error> for Error implementation Signed-off-by: declark1 <[email protected]> --------- Signed-off-by: declark1 <[email protected]>
Signed-off-by: declark1 <[email protected]>
) * Rename chat_completions config to openai Signed-off-by: Mateus Devino <[email protected]> * Add chat_completions alias to config Signed-off-by: Mateus Devino <[email protected]> * Address renaming change requests Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
…l-stack#446) * wip: completions skeleton Signed-off-by: Mateus Devino <[email protected]> * wip: completions unary first draft Signed-off-by: Mateus Devino <[email protected]> * Completions v1 Signed-off-by: Mateus Devino <[email protected]> * test: no_detectors() Signed-off-by: Mateus Devino <[email protected]> * test: no_detections() Signed-off-by: Mateus Devino <[email protected]> * test: input_detections() Signed-off-by: Mateus Devino <[email protected]> * test: input_client_error() Signed-off-by: Mateus Devino <[email protected]> * test: output_client_error() Signed-off-by: Mateus Devino <[email protected]> * test: orchestrator_validation_error() Signed-off-by: Mateus Devino <[email protected]> * Rename chat-related stuff Signed-off-by: Mateus Devino <[email protected]> * Rename openai mock server Signed-off-by: Mateus Devino <[email protected]> * Rename completions symbols Signed-off-by: Mateus Devino <[email protected]> * Drop stream logic place holder Signed-off-by: Mateus Devino <[email protected]> * Address changes requested Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
…dation-model-stack#448) * Tokenize logic for completions input detections Signed-off-by: Mateus Devino <[email protected]> * Fix completions input_detection tests Signed-off-by: Mateus Devino <[email protected]> * Add messages to TokenizeRequest Signed-off-by: Mateus Devino <[email protected]> * Remove From impl for Usage Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
* Upgrade dependencies Signed-off-by: Mateus Devino <[email protected]> * Update package version to 0.12.0 Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
…ack#417) * Rename tests/chat_completions_detection to chat_completions_unary Signed-off-by: declark1 <[email protected]> * Add tests/chat_completions_streaming with initial test and sse helper function Signed-off-by: declark1 <[email protected]> * Derive PartialEq for ChatCompletionChunkChoice and ChatCompletionDelta Signed-off-by: declark1 <[email protected]> * Derive Default for ContentAnalysisResponse Signed-off-by: declark1 <[email protected]> * Update tests/test_config.yaml: rename chat_generation to chat_completions Signed-off-by: declark1 <[email protected]> * Update tests/test_config.yaml: add pii_detector_sentence Signed-off-by: declark1 <[email protected]> * Add output_detectors_n2 test Signed-off-by: declark1 <[email protected]> * wip Signed-off-by: declark1 <[email protected]> * Add output_detectors_n1_logprobs test, update other tests Signed-off-by: declark1 <[email protected]> * Update output_detectors_n1 test Signed-off-by: declark1 <[email protected]> * Add whole_doc_output_detectors test Signed-off-by: declark1 <[email protected]> * rebase Signed-off-by: declark1 <[email protected]> * Update test names Signed-off-by: declark1 <[email protected]> * Update existing tests, add output_detectors_and_whole_doc_output_detectors test Signed-off-by: declark1 <[email protected]> * Add output_detectors_with_usage test Signed-off-by: declark1 <[email protected]> * Add input_detectors test Signed-off-by: declark1 <[email protected]> * Move sse helper to common Signed-off-by: declark1 <[email protected]> * Add openai_bad_request_error test, derive PartialEq for ChatCompletionChunk Signed-off-by: declark1 <[email protected]> * Add chunker_internal_server_error test Signed-off-by: declark1 <[email protected]> * Add detector_internal_server_error test Signed-off-by: declark1 <[email protected]> * Add openai_stream_error test Signed-off-by: declark1 <[email protected]> * Fix formatting Signed-off-by: declark1 <[email protected]> * Rename chat_completions mock servers to openai Signed-off-by: declark1 <[email protected]> * Use CHAT_COMPLETIONS_ENDPOINT Signed-off-by: declark1 <[email protected]> * Use ORCHESTRATOR_CONFIG_FILE_PATH Signed-off-by: declark1 <[email protected]> * Use ORCHESTRATOR_CHAT_COMPLETIONS_DETECTION_ENDPOINT Signed-off-by: declark1 <[email protected]> * Use CHUNKER_UNARY_ENDPOINT Signed-off-by: declark1 <[email protected]> * Use CHUNKER_STREAMING_ENDPOINT Signed-off-by: declark1 <[email protected]> * Add detector id constants for consistency Signed-off-by: declark1 <[email protected]> * Use CHUNKER_MODEL_ID_HEADER_NAME Signed-off-by: declark1 <[email protected]> * Use TEXT_CONTENTS_DETECTOR_ENDPOINT Signed-off-by: declark1 <[email protected]> * Only assert error code for openai_bad_request_error Signed-off-by: declark1 <[email protected]> --------- Signed-off-by: declark1 <[email protected]>
* Allow int/string stop_reasons Signed-off-by: Rob Geada <[email protected]> * Move tests, run cargo format Signed-off-by: Rob Geada <[email protected]> --------- Signed-off-by: Rob Geada <[email protected]>
…ctors (foundation-model-stack#455) * Upgrade mocktail to 0.3.0, use MockServer::new_grpc Signed-off-by: declark1 <[email protected]> * Use MockServer::new_http Signed-off-by: declark1 <[email protected]> --------- Signed-off-by: declark1 <[email protected]>
…undation-model-stack#456) * Move usage to ChatCompletionState, update condition to set final usage state, add output_detectors_with_continuous_usage_stats test Signed-off-by: declark1 <[email protected]> * Add CompletionState, drop ChatCompletionState and update existing usage Signed-off-by: declark1 <[email protected]> --------- Signed-off-by: declark1 <[email protected]>
…tack#458) Signed-off-by: declark1 <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
Signed-off-by: declark1 <[email protected]>
* 👷 Use UBI base for builder Signed-off-by: Evaline Ju <[email protected]> * ♻️ Use current toolchain Signed-off-by: Evaline Ju <[email protected]> Co-authored-by: Mateus Devino <[email protected]> * 👷 UBI base for ppc64le and s390x archs Signed-off-by: Evaline Ju <[email protected]> * 👷 Disable subscription-manager plugin Co-authored-by: Mateus Devino <[email protected]> Signed-off-by: Evaline Ju <[email protected]> --------- Signed-off-by: Evaline Ju <[email protected]> Co-authored-by: Mateus Devino <[email protected]> Co-authored-by: Mateus Devino <[email protected]>
…stack#462) * Refactor to single DetectorClient Signed-off-by: declark1 <[email protected]> * Drop unneeded cfg_attr Co-authored-by: Mateus Devino <[email protected]> Signed-off-by: Dan Clark <[email protected]> * Drop unneeded client method Signed-off-by: declark1 <[email protected]> --------- Signed-off-by: declark1 <[email protected]> Signed-off-by: Dan Clark <[email protected]> Co-authored-by: Mateus Devino <[email protected]>
…model-stack#463) * Update DetectorConfig to support specifying multiple detector types, update validate_detectors Signed-off-by: declark1 <[email protected]> * Add test_validate_detectors unit test Signed-off-by: declark1 <[email protected]> * Update example config.yaml comments Signed-off-by: declark1 <[email protected]> * Make validate_detectors signature more flexible Signed-off-by: declark1 <[email protected]> * Fix formatting Signed-off-by: declark1 <[email protected]> --------- Signed-off-by: declark1 <[email protected]>
* Upgrade dependencies Signed-off-by: Mateus Devino <[email protected]> * Update crate version to 0.13.0 Signed-off-by: Mateus Devino <[email protected]> --------- Signed-off-by: Mateus Devino <[email protected]>
…l-stack#466) Signed-off-by: declark1 <[email protected]>
…tions (foundation-model-stack#468) * chat_completions: get prompt tokens for completion with input detections Signed-off-by: declark1 <[email protected]> * completions (streaming): get prompt tokens for completion with input detections Signed-off-by: declark1 <[email protected]> * update chat completions input_detectors tests Signed-off-by: declark1 <[email protected]> * Update comments Signed-off-by: declark1 <[email protected]> --------- Signed-off-by: declark1 <[email protected]>
Signed-off-by: Varad Ahirwadkar <[email protected]>
…rs to apply masks (foundation-model-stack#470) Signed-off-by: declark1 <[email protected]>
Signed-off-by: declark1 <[email protected]>
Signed-off-by: Mateus Devino <[email protected]>
This comment was marked as off-topic.
This comment was marked as off-topic.
![sourcery-ai[bot]](https://avatars.githubusercontent.com/in/48477?s=60&v=4){kind=small}
This comment was marked as off-topic.
This comment was marked as off-topic.
Sorry, something went wrong.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
7 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.