Skip to content

Conversation

@pan-x-c
Copy link
Collaborator

@pan-x-c pan-x-c commented Nov 19, 2025

Description

As the title says

Checklist

Please check the following items before code is ready to be reviewed.

  • Code has passed all tests
  • Docstrings have been added/updated in Google Style
  • Documentation has been updated
  • Code is ready for review

@gemini-code-assist
Copy link
Contributor

Summary of Changes

Hello @pan-x-c, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request focuses on improving the extensibility and modularity of the buffer reading and task scheduling components. It introduces a registry-based system for buffer readers, allowing for dynamic instantiation, and refactors the task scheduler hierarchy to support more flexible scheduling strategies. These changes aim to simplify future additions and maintenance of different buffer and task management mechanisms.

Highlights

  • Buffer Reader Registry: A new READER registry has been introduced to dynamically select buffer reader implementations based on their StorageType. This replaces a conditional if/elif structure with a more extensible pattern.
  • Refactored get_buffer_reader: The get_buffer_reader function in trinity/buffer/buffer.py has been updated to leverage the new READER registry, simplifying its logic and making it easier to add new reader types in the future.
  • Unified File Reader: A new FileReader class has been added, which acts as a unified interface for both ExperienceFileReader and TaskFileReader, streamlining the handling of file-based buffer reading.
  • Task Scheduler Refactoring: The task scheduler logic has been refactored with the introduction of TasksetSchedulerBase and SimpleTasksetScheduler, enhancing modularity and providing a base for future scheduler implementations.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors the buffer reader creation to use a registry pattern, which is a great improvement for extensibility and code clarity. The introduction of TasksetSchedulerBase and SimpleTasksetScheduler also helps to simplify the logic for single-taskset scenarios.

However, I've found a couple of issues in the new SimpleTasksetScheduler implementation that need to be addressed: a critical bug in read_async that will cause a runtime error, and an issue in state_dict that prevents correct checkpointing and resuming. Please see my detailed comments below.

@pan-x-c pan-x-c changed the title [WIP] Make buffer reader registerable Make buffer reader registerable Nov 20, 2025
@pan-x-c
Copy link
Collaborator Author

pan-x-c commented Nov 20, 2025

/unittest-module-buffer

@github-actions
Copy link

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
37 37 0 0 0 0 2m 17s

Tests

Test Name Status Flaky Duration
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_experience_pipeline 29.0s
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_pass_rate_calculation 16.2s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_experience_buffer 3.8s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_0_sft 6.1s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_1_dpo 6.7s
tests/buffer/file_test.py::TestFileBuffer::test_file_reader 455ms
tests/buffer/file_test.py::TestFileBuffer::test_file_writer 4.3s
tests/buffer/formatter_test.py::TestFormatter::test_dpo_messages_formatter 530ms
tests/buffer/formatter_test.py::TestFormatter::test_dpo_plaintext_formatter 474ms
tests/buffer/formatter_test.py::TestFormatter::test_multi_modal_sft_formatter 793ms
tests/buffer/formatter_test.py::TestFormatter::test_sft_messages_formatter 1.0s
tests/buffer/formatter_test.py::TestFormatter::test_sft_plaintext_formatter 719ms
tests/buffer/formatter_test.py::TestFormatter::test_task_formatter 219ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_buffer_reuse 9.1s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_capacity 5.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_reuse_count_control 7.1s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_0_queue 5.8s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_1_priority_queue 5.8s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_capacity 6.9s
tests/buffer/reader_test.py::TestBufferReader::test_buffer_reader_registration 813ms
tests/buffer/reward_shaping_mapper_test.py::TestRewardShapingMapper::test_basic_usage 6ms
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_exp_buffer_read_write 4.1s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_task_buffer_read_write 4.7s
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_0 88ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_1 68ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_2 108ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_3 108ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_4 107ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_5 111ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_6 129ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_simple 49ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_0_file 69ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_1_sql 4.2s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_2_file 48ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_3_sql 4.2s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_4_file 49ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_5_sql 4.4s

Github Test Reporter by CTRF 💚

@pan-x-c
Copy link
Collaborator Author

pan-x-c commented Nov 20, 2025

/unittest-all

@github-actions
Copy link

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
181 173 5 3 0 0 1h 41m

Failed Tests

Failed Tests ❌ Fail Message
❌ tests/explorer/explorer_test.py::TestExplorerCountdownEval::test_explorer The test failed in the call phase due to an assertion error
❌ tests/trainer/trainer_test.py::TestTrainerCountdown_0_fsdp::test_trainer The test failed in the call phase due to an assertion error
❌ tests/trainer/trainer_test.py::TestTrainerCountdown_1_megatron::test_trainer The test failed in the call phase due to an assertion error
❌ tests/trainer/trainer_test.py::TestTrainerToolsSFT::test_trainer_tools The test failed in the call phase due to an assertion error
❌ tests/trainer/trainer_test.py::TestTrainerLoRA::test_trainer The test failed in the call phase due to an assertion error

Skipped

Tests Status
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter skipped ⏭️
tests/trainer/trainer_test.py::TestMultiModalGRPO::test_trainer skipped ⏭️
tests/trainer/trainer_test.py::TestMultiModalSFT::test_trainer skipped ⏭️

Tests

Test Name Status Flaky Duration
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_batch_level_std_grpo 40ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_batch_level_step_wise_grpo_advantage 2ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_duplicate_grpo 5ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_advantage 3ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_correct_bias 2ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_reward_std 1ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_step_wise_grpo_advantage 2ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_step_wise_grpo_with_std_threshold 2ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_dpo_policy_loss 2ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_gspo_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_mix_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_opmd_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_ppo_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_sft_policy_loss 1ms
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_experience_pipeline 21.1s
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_pass_rate_calculation 15.8s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_experience_buffer 4.2s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_0_sft 6.2s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_1_dpo 6.7s
tests/buffer/file_test.py::TestFileBuffer::test_file_reader 155ms
tests/buffer/file_test.py::TestFileBuffer::test_file_writer 4.6s
tests/buffer/formatter_test.py::TestFormatter::test_dpo_messages_formatter 521ms
tests/buffer/formatter_test.py::TestFormatter::test_dpo_plaintext_formatter 459ms
tests/buffer/formatter_test.py::TestFormatter::test_multi_modal_sft_formatter 789ms
tests/buffer/formatter_test.py::TestFormatter::test_sft_messages_formatter 963ms
tests/buffer/formatter_test.py::TestFormatter::test_sft_plaintext_formatter 704ms
tests/buffer/formatter_test.py::TestFormatter::test_task_formatter 218ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_buffer_reuse 9.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_capacity 5.1s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_reuse_count_control 6.8s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_0_queue 6.0s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_1_priority_queue 5.8s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_capacity 6.5s
tests/buffer/reader_test.py::TestBufferReader::test_buffer_reader_registration 614ms
tests/buffer/reward_shaping_mapper_test.py::TestRewardShapingMapper::test_basic_usage 6ms
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_exp_buffer_read_write 3.9s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_task_buffer_read_write 4.7s
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_0 87ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_1 69ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_2 107ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_3 108ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_4 107ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_5 112ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_6 129ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_simple 56ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_0_file 68ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_1_sql 4.1s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_2_file 48ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_3_sql 3.9s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_4_file 49ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_5_sql 4.7s
tests/cli/launcher_test.py::TestLauncherMain::test_debug_mode 46.1s
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_command 7.0s
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_in_dlc 1.5s
tests/cli/launcher_test.py::TestLauncherMain::test_main_studio_command 315ms
tests/cli/launcher_test.py::TestLauncherMain::test_multi_stage_run 1.7s
tests/common/config_test.py::TestConfig::test_all_examples_are_valid 32.9s
tests/common/config_test.py::TestConfig::test_chat_template_path 91ms
tests/common/config_test.py::TestConfig::test_config_flatten 39ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid 191ms
tests/common/config_test.py::TestConfig::test_default_workflow 90ms
tests/common/config_test.py::TestConfig::test_load_default_config 4.8s
tests/common/config_test.py::TestConfig::test_max_token_len_per_gpu_set_correctly 92ms
tests/common/config_test.py::TestConfig::test_optimizer_config_propagation 91ms
tests/common/config_test.py::TestConfig::test_update_config_from_ray_cluster 155ms
tests/common/experience_test.py::TestEID::test_eid_properties 1ms
tests/common/experience_test.py::TestExperience::test_action_mask_and_logprobs_type 1ms
tests/common/experience_test.py::TestExperience::test_assertions 1ms
tests/common/experience_test.py::TestExperience::test_dpo_experience 1ms
tests/common/experience_test.py::TestExperience::test_gather 1ms
tests/common/experience_test.py::TestExperience::test_hf_datasets_conversion 15ms
tests/common/experience_test.py::TestExperience::test_multi_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_serialize_deserialize 1ms
tests/common/experience_test.py::TestExperience::test_single_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_to_dict 1ms
tests/common/experience_test.py::TestExperienceConversion::test_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_dpo_experience_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_gather_experiences_with_custom_fields 1ms
tests/common/experience_test.py::TestExperienceConversion::test_multiturn_experience_batch_converstion 1ms
tests/common/vllm_test.py::ModelWrapperTest_0::test_generate 44.0s
tests/common/vllm_test.py::ModelWrapperTest_1::test_generate 31.6s
tests/common/vllm_test.py::ModelWrapperTest_2::test_generate 44.6s
tests/common/vllm_test.py::TestModelLen_0::test_model_len 17.1s
tests/common/vllm_test.py::TestModelLen_1::test_model_len 17.0s
tests/common/vllm_test.py::TestAPIServer::test_api 22.8s
tests/common/vllm_test.py::TestLogprobs::test_logprobs 19.3s
tests/common/vllm_test.py::TestAsyncAPIServer::test_api_async 22.5s
tests/common/vllm_test.py::TestTokenizer::test_action_mask 248ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask_with_tools 233ms
tests/common/vllm_test.py::TestAPIServerToolCall_0_deepseek_r1::test_api_tool_calls 20.3s
tests/common/vllm_test.py::TestAPIServerToolCall_1::test_api_tool_calls 17.8s
tests/common/vllm_test.py::TestSuperLongGeneration::test_generate 3m 24s
tests/explorer/explorer_test.py::TestExplorerCountdownEval::test_explorer 42.4s
tests/explorer/explorer_test.py::TestExplorerGSM8KRULERNoEval::test_explorer 1m 41s
tests/explorer/explorer_test.py::TestExplorerGSM8k::test_explorer 3m 38s
tests/explorer/explorer_test.py::ServeTest::test_serve 1m 20s
tests/explorer/scheduler_test.py::SchedulerTest::test_async_workflow 12.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_concurrent_operations 12.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_results 30.5s
tests/explorer/scheduler_test.py::SchedulerTest::test_multi_step_execution 13.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_non_repeatable_workflow 12.4s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_all_methods 22.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_restart_after_stop 24.1s
tests/explorer/scheduler_test.py::SchedulerTest::test_split_tasks 15.5s
tests/explorer/scheduler_test.py::SchedulerTest::test_stepwise_experience_eid 12.6s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all 15.1s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all_timeout_with_multi_batch 21.0s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_0 2ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_1 602ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_0 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_1 1.0s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_raise_error 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_stop_at_max_env_steps 1.0s
tests/explorer/workflow_test.py::WorkflowTest::test_gsm8k_workflow 16ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_boxed_workflow 24ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_complex_workflow 269ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_eval_workflow 3ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_fraction_workflow 17ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_workflow 10ms
tests/explorer/workflow_test.py::WorkflowTest::test_rm_gallery_workflow 81ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_1 101ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_1 201ms
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_0::test_multi_turn_workflow 14.5s
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_1::test_multi_turn_workflow 14.7s
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter ⏭️ 1ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner 298ms
tests/manager/synchronizer_test.py::TestSynchronizerExit::test_synchronizer 1m 5s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_0::test_synchronizer 1m 46s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_1::test_synchronizer 1m 53s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_2::test_synchronizer 2m 38s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_3::test_synchronizer 2m 37s
tests/manager/synchronizer_test.py::TestNCCLBasedSynchronizer_0::test_synchronizer 1m 51s
tests/manager/synchronizer_test.py::TestNCCLBasedSynchronizer_1::test_synchronizer 1m 52s
tests/service/data_juicer_test.py::TestDataJuicer::test_config 1.3s
tests/service/data_juicer_test.py::TestDataJuicer::test_server_start 21.6s
tests/service/data_juicer_test.py::TestDataJuicerExperiencePipeline::test_data_juicer_operators 31.4s
tests/service/data_juicer_test.py::TestDataJuicerTaskPipeline::test_data_juicer_task_pipeline 14.5s
tests/trainer/trainer_test.py::TestTrainerCountdown_0_fsdp::test_trainer 1m 2s
tests/trainer/trainer_test.py::TestTrainerCountdown_1_megatron::test_trainer 1m 4s
tests/trainer/trainer_test.py::TestStepAheadAsyncRL::test_trainer 1m 33s
tests/trainer/trainer_test.py::TestTrainerGSM8K_0_fsdp::test_trainer 1m 22s
tests/trainer/trainer_test.py::TestTrainerGSM8K_1_fsdp2::test_trainer 1m 25s
tests/trainer/trainer_test.py::TestTrainerGSM8K_2_fsdp::test_trainer 1m 29s
tests/trainer/trainer_test.py::TestTrainerGSM8K_3_fsdp2::test_trainer 1m 37s
tests/trainer/trainer_test.py::TestTrainerSFTWarmupGSM8K::test_trainer 2m 34s
tests/trainer/trainer_test.py::TestTrainerDPO::test_trainer 1m 5s
tests/trainer/trainer_test.py::TestTrainerSFT::test_trainer 1m 2s
tests/trainer/trainer_test.py::TestTrainerToolsSFT::test_trainer_tools 30m 53s
tests/trainer/trainer_test.py::TestFullyAsyncMode_0_fsdp::test_fully_async_mode 1m 55s
tests/trainer/trainer_test.py::TestFullyAsyncMode_1_fsdp::test_fully_async_mode 1m 54s
tests/trainer/trainer_test.py::TestFullyAsyncMode_2_megatron::test_fully_async_mode 3m 2s
tests/trainer/trainer_test.py::TestTrainerCheckpointSave_0_fsdp::test_trainer 2m 18s
tests/trainer/trainer_test.py::TestTrainerCheckpointSave_1_megatron::test_trainer 5m 53s
tests/trainer/trainer_test.py::TestTrainerMIX::test_trainer 1m 25s
tests/trainer/trainer_test.py::TestMultiModalGRPO::test_trainer ⏭️ 810ms
tests/trainer/trainer_test.py::TestMultiModalSFT::test_trainer ⏭️ 808ms
tests/trainer/trainer_test.py::TestTrainerLoRA::test_trainer 1m 20s
tests/utils/eval_utils_test.py::TestComputeScore::test_both_boxed_and_equivalent 17ms
tests/utils/eval_utils_test.py::TestComputeScore::test_both_boxed_and_not_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_empty_ground_truth 2ms
tests/utils/eval_utils_test.py::TestComputeScore::test_empty_solution_string 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_multiple_boxed_answers_in_solution 2ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_boxed_truth_raw_and_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_boxed_truth_raw_and_not_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_not_boxed 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_raw_and_ground_truth_boxed_equivalent 1ms
tests/utils/eval_utils_test.py::TestMathEvalUtils::test_extract_answer 4ms
tests/utils/eval_utils_test.py::TestMathEvalUtils::test_verify_math_answer 83ms
tests/utils/eval_utils_test.py::TestEvalUtils::test_is_equiv 6ms
tests/utils/log_test.py::LogTest::test_actor_log 5.0s
tests/utils/log_test.py::LogTest::test_group_by_node 4.9s
tests/utils/log_test.py::LogTest::test_no_actor_log 902ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_local_0__workspace_tests_utils_plugins 93ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_local_1_tests_utils_plugins 91ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_remote_0__workspace_tests_utils_plugins 21.6s
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_remote_1_tests_utils_plugins 22.1s
tests/utils/plugin_test.py::TestPluginLoader::test_passing_custom_class_0__workspace_tests_utils_plugins 11.9s
tests/utils/plugin_test.py::TestPluginLoader::test_passing_custom_class_1_tests_utils_plugins 12.6s

Github Test Reporter by CTRF 💚

@pan-x-c
Copy link
Collaborator Author

pan-x-c commented Nov 20, 2025

/unittest-all

@github-actions
Copy link

Summary

Tests 📝 Passed ✅ Failed ❌ Skipped ⏭️ Other ❓ Flaky 🍂 Duration ⏱️
181 178 0 3 0 0 1h 19m

Skipped

Tests Status
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter skipped ⏭️
tests/trainer/trainer_test.py::TestMultiModalGRPO::test_trainer skipped ⏭️
tests/trainer/trainer_test.py::TestMultiModalSFT::test_trainer skipped ⏭️

Tests

Test Name Status Flaky Duration
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_batch_level_std_grpo 40ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_batch_level_step_wise_grpo_advantage 2ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_duplicate_grpo 5ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_advantage 3ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_correct_bias 2ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_grpo_reward_std 1ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_step_wise_grpo_advantage 2ms
tests/algorithm/advantage_fn_test.py::TestGroupedAdvantageFn::test_step_wise_grpo_with_std_threshold 2ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_dpo_policy_loss 2ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_gspo_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_mix_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_opmd_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_ppo_policy_loss 1ms
tests/algorithm/policy_loss_test.py::VerlPolicyLossTest::test_sft_policy_loss 1ms
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_experience_pipeline 20.6s
tests/buffer/experience_pipeline_test.py::TestExperiencePipeline::test_pass_rate_calculation 16.3s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_experience_buffer 4.0s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_0_sft 5.9s
tests/buffer/experience_storage_test.py::ExperienceStorageTest::test_sql_storage_1_dpo 6.4s
tests/buffer/file_test.py::TestFileBuffer::test_file_reader 156ms
tests/buffer/file_test.py::TestFileBuffer::test_file_writer 4.7s
tests/buffer/formatter_test.py::TestFormatter::test_dpo_messages_formatter 556ms
tests/buffer/formatter_test.py::TestFormatter::test_dpo_plaintext_formatter 482ms
tests/buffer/formatter_test.py::TestFormatter::test_multi_modal_sft_formatter 783ms
tests/buffer/formatter_test.py::TestFormatter::test_sft_messages_formatter 982ms
tests/buffer/formatter_test.py::TestFormatter::test_sft_plaintext_formatter 718ms
tests/buffer/formatter_test.py::TestFormatter::test_task_formatter 218ms
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_buffer_reuse 8.9s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_capacity 5.1s
tests/buffer/queue_test.py::TestQueueBuffer::test_priority_queue_reuse_count_control 6.9s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_0_queue 6.2s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_1_priority_queue 5.9s
tests/buffer/queue_test.py::TestQueueBuffer::test_queue_buffer_capacity 6.4s
tests/buffer/reader_test.py::TestBufferReader::test_buffer_reader_registration 613ms
tests/buffer/reward_shaping_mapper_test.py::TestRewardShapingMapper::test_basic_usage 5ms
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_exp_buffer_read_write 3.9s
tests/buffer/sql_test.py::TestSQLBuffer::test_sql_task_buffer_read_write 4.5s
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_0 88ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_1 69ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_2 108ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_3 108ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_4 107ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_5 112ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_6 128ms
tests/buffer/task_scheduler_test.py::TestTaskScheduler::test_task_scheduler_simple 56ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_0_file 68ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_1_sql 3.9s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_2_file 48ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_3_sql 3.9s
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_4_file 49ms
tests/buffer/task_storage_test.py::TaskStorageTest::test_read_task_5_sql 4.7s
tests/cli/launcher_test.py::TestLauncherMain::test_debug_mode 45.8s
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_command 7.1s
tests/cli/launcher_test.py::TestLauncherMain::test_main_run_in_dlc 1.5s
tests/cli/launcher_test.py::TestLauncherMain::test_main_studio_command 327ms
tests/cli/launcher_test.py::TestLauncherMain::test_multi_stage_run 1.7s
tests/common/config_test.py::TestConfig::test_all_examples_are_valid 33.1s
tests/common/config_test.py::TestConfig::test_chat_template_path 92ms
tests/common/config_test.py::TestConfig::test_config_flatten 39ms
tests/common/config_test.py::TestConfig::test_continue_from_checkpoint_is_valid 191ms
tests/common/config_test.py::TestConfig::test_default_workflow 91ms
tests/common/config_test.py::TestConfig::test_load_default_config 3.4s
tests/common/config_test.py::TestConfig::test_max_token_len_per_gpu_set_correctly 94ms
tests/common/config_test.py::TestConfig::test_optimizer_config_propagation 92ms
tests/common/config_test.py::TestConfig::test_update_config_from_ray_cluster 356ms
tests/common/experience_test.py::TestEID::test_eid_properties 1ms
tests/common/experience_test.py::TestExperience::test_action_mask_and_logprobs_type 1ms
tests/common/experience_test.py::TestExperience::test_assertions 1ms
tests/common/experience_test.py::TestExperience::test_dpo_experience 1ms
tests/common/experience_test.py::TestExperience::test_gather 1ms
tests/common/experience_test.py::TestExperience::test_hf_datasets_conversion 15ms
tests/common/experience_test.py::TestExperience::test_multi_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_serialize_deserialize 1ms
tests/common/experience_test.py::TestExperience::test_single_turn_experience 1ms
tests/common/experience_test.py::TestExperience::test_to_dict 1ms
tests/common/experience_test.py::TestExperienceConversion::test_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_dpo_experience_batch_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_experience_model_experience_conversion 1ms
tests/common/experience_test.py::TestExperienceConversion::test_gather_experiences_with_custom_fields 1ms
tests/common/experience_test.py::TestExperienceConversion::test_multiturn_experience_batch_converstion 1ms
tests/common/vllm_test.py::ModelWrapperTest_0::test_generate 52.5s
tests/common/vllm_test.py::ModelWrapperTest_1::test_generate 32.4s
tests/common/vllm_test.py::ModelWrapperTest_2::test_generate 44.1s
tests/common/vllm_test.py::TestModelLen_0::test_model_len 16.9s
tests/common/vllm_test.py::TestModelLen_1::test_model_len 17.1s
tests/common/vllm_test.py::TestAPIServer::test_api 22.9s
tests/common/vllm_test.py::TestLogprobs::test_logprobs 18.8s
tests/common/vllm_test.py::TestAsyncAPIServer::test_api_async 22.9s
tests/common/vllm_test.py::TestTokenizer::test_action_mask 236ms
tests/common/vllm_test.py::TestTokenizer::test_action_mask_with_tools 229ms
tests/common/vllm_test.py::TestAPIServerToolCall_0_deepseek_r1::test_api_tool_calls 19.7s
tests/common/vllm_test.py::TestAPIServerToolCall_1::test_api_tool_calls 17.8s
tests/common/vllm_test.py::TestSuperLongGeneration::test_generate 3m 23s
tests/explorer/explorer_test.py::TestExplorerCountdownEval::test_explorer 1m 17s
tests/explorer/explorer_test.py::TestExplorerGSM8KRULERNoEval::test_explorer 1m 35s
tests/explorer/explorer_test.py::TestExplorerGSM8k::test_explorer 3m 38s
tests/explorer/explorer_test.py::ServeTest::test_serve 1m 22s
tests/explorer/scheduler_test.py::SchedulerTest::test_async_workflow 12.4s
tests/explorer/scheduler_test.py::SchedulerTest::test_concurrent_operations 12.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_get_results 30.9s
tests/explorer/scheduler_test.py::SchedulerTest::test_multi_step_execution 13.1s
tests/explorer/scheduler_test.py::SchedulerTest::test_non_repeatable_workflow 12.6s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_all_methods 22.3s
tests/explorer/scheduler_test.py::SchedulerTest::test_scheduler_restart_after_stop 24.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_split_tasks 15.7s
tests/explorer/scheduler_test.py::SchedulerTest::test_stepwise_experience_eid 12.4s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all 15.2s
tests/explorer/scheduler_test.py::SchedulerTest::test_wait_all_timeout_with_multi_batch 20.9s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_0 2ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_reward_propagation_workflow_1 602ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_0 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_step_wise_reward_workflow_1 1.0s
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_raise_error 1ms
tests/explorer/step_wise_workflow_test.py::WorkflowTest::test_workflows_stop_at_max_env_steps 1.0s
tests/explorer/workflow_test.py::WorkflowTest::test_gsm8k_workflow 16ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_boxed_workflow 24ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_complex_workflow 266ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_eval_workflow 3ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_fraction_workflow 17ms
tests/explorer/workflow_test.py::WorkflowTest::test_math_workflow 10ms
tests/explorer/workflow_test.py::WorkflowTest::test_rm_gallery_workflow 79ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_repeatable_1 101ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_0 1ms
tests/explorer/workflow_test.py::WorkflowTest::test_workflow_resettable_1 201ms
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_0::test_multi_turn_workflow 14.4s
tests/explorer/workflow_test.py::MultiTurnWorkflowTest_1::test_multi_turn_workflow 14.7s
tests/explorer/workflow_test.py::TestAgentScopeWorkflowAdapter::test_adapter ⏭️ 1ms
tests/explorer/workflow_test.py::TestWorkflowRunner::test_workflow_runner 298ms
tests/manager/synchronizer_test.py::TestSynchronizerExit::test_synchronizer 1m 6s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_0::test_synchronizer 1m 50s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_1::test_synchronizer 1m 53s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_2::test_synchronizer 2m 36s
tests/manager/synchronizer_test.py::TestStateDictBasedSynchronizer_3::test_synchronizer 2m 39s
tests/manager/synchronizer_test.py::TestNCCLBasedSynchronizer_0::test_synchronizer 1m 50s
tests/manager/synchronizer_test.py::TestNCCLBasedSynchronizer_1::test_synchronizer 1m 50s
tests/service/data_juicer_test.py::TestDataJuicer::test_config 1.3s
tests/service/data_juicer_test.py::TestDataJuicer::test_server_start 21.6s
tests/service/data_juicer_test.py::TestDataJuicerExperiencePipeline::test_data_juicer_operators 31.5s
tests/service/data_juicer_test.py::TestDataJuicerTaskPipeline::test_data_juicer_task_pipeline 14.5s
tests/trainer/trainer_test.py::TestTrainerCountdown_0_fsdp::test_trainer 2m 43s
tests/trainer/trainer_test.py::TestTrainerCountdown_1_megatron::test_trainer 4m 55s
tests/trainer/trainer_test.py::TestStepAheadAsyncRL::test_trainer 1m 23s
tests/trainer/trainer_test.py::TestTrainerGSM8K_0_fsdp::test_trainer 1m 24s
tests/trainer/trainer_test.py::TestTrainerGSM8K_1_fsdp2::test_trainer 1m 24s
tests/trainer/trainer_test.py::TestTrainerGSM8K_2_fsdp::test_trainer 1m 29s
tests/trainer/trainer_test.py::TestTrainerGSM8K_3_fsdp2::test_trainer 1m 36s
tests/trainer/trainer_test.py::TestTrainerSFTWarmupGSM8K::test_trainer 2m 32s
tests/trainer/trainer_test.py::TestTrainerDPO::test_trainer 1m 5s
tests/trainer/trainer_test.py::TestTrainerSFT::test_trainer 1m 2s
tests/trainer/trainer_test.py::TestTrainerToolsSFT::test_trainer_tools 1m 2s
tests/trainer/trainer_test.py::TestFullyAsyncMode_0_fsdp::test_fully_async_mode 1m 56s
tests/trainer/trainer_test.py::TestFullyAsyncMode_1_fsdp::test_fully_async_mode 2m
tests/trainer/trainer_test.py::TestFullyAsyncMode_2_megatron::test_fully_async_mode 2m 53s
tests/trainer/trainer_test.py::TestTrainerCheckpointSave_0_fsdp::test_trainer 2m 17s
tests/trainer/trainer_test.py::TestTrainerCheckpointSave_1_megatron::test_trainer 5m 43s
tests/trainer/trainer_test.py::TestTrainerMIX::test_trainer 1m 28s
tests/trainer/trainer_test.py::TestMultiModalGRPO::test_trainer ⏭️ 811ms
tests/trainer/trainer_test.py::TestMultiModalSFT::test_trainer ⏭️ 808ms
tests/trainer/trainer_test.py::TestTrainerLoRA::test_trainer 3m 17s
tests/utils/eval_utils_test.py::TestComputeScore::test_both_boxed_and_equivalent 15ms
tests/utils/eval_utils_test.py::TestComputeScore::test_both_boxed_and_not_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_empty_ground_truth 2ms
tests/utils/eval_utils_test.py::TestComputeScore::test_empty_solution_string 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_multiple_boxed_answers_in_solution 2ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_boxed_truth_raw_and_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_boxed_truth_raw_and_not_equivalent 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_not_boxed 1ms
tests/utils/eval_utils_test.py::TestComputeScore::test_solution_raw_and_ground_truth_boxed_equivalent 1ms
tests/utils/eval_utils_test.py::TestMathEvalUtils::test_extract_answer 4ms
tests/utils/eval_utils_test.py::TestMathEvalUtils::test_verify_math_answer 76ms
tests/utils/eval_utils_test.py::TestEvalUtils::test_is_equiv 6ms
tests/utils/log_test.py::LogTest::test_actor_log 5.0s
tests/utils/log_test.py::LogTest::test_group_by_node 4.9s
tests/utils/log_test.py::LogTest::test_no_actor_log 904ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_local_0__workspace_tests_utils_plugins 108ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_local_1_tests_utils_plugins 624ms
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_remote_0__workspace_tests_utils_plugins 22.1s
tests/utils/plugin_test.py::TestPluginLoader::test_load_plugins_remote_1_tests_utils_plugins 22.2s
tests/utils/plugin_test.py::TestPluginLoader::test_passing_custom_class_0__workspace_tests_utils_plugins 12.0s
tests/utils/plugin_test.py::TestPluginLoader::test_passing_custom_class_1_tests_utils_plugins 11.7s

Github Test Reporter by CTRF 💚

@hiyuchang
Copy link
Collaborator

/gemini review

Copy link
Contributor

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request refactors the buffer reader creation to use a registry pattern, which is a great improvement for extensibility. The code is cleaner and easier to maintain. I've added a few comments with suggestions to further improve the implementation, mainly around making stubbed methods more explicit, reducing code duplication, and simplifying class hierarchies. Overall, this is a solid contribution.

@pan-x-c pan-x-c merged commit 980cffc into modelscope:main Nov 20, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants