mixseek-orchestrator-config

MixSeek Orchestrator Configuration Generation

Overview

Generates the MixSeek-Core orchestrator configuration file (orchestrator.toml). It defines settings for the TUMIX (TUrnament-style MIXture of experts) framework, which runs multiple teams in parallel, goes through evaluation by evaluators, and selects the best answer.

Prerequisites

• The workspace is initialized (seemixseek-workspace-init)
• One or more team configuration files exist (seemixseek-team-config)
• Evaluation settings exist (seemixseek-evaluator-config, optional)

Usage

Step 1: Requirements Interview

Confirm the following with the user:

1. Teams to compete: Which team configurations to use
2. Round settings: How many rounds to run (default: 2-5 rounds)
3. Timeout settings: Time limit per team

Step 2: Check Existing Team Configurations

Check the team configurations in the workspace:

ls $MIXSEEK_WORKSPACE/configs/agents/team-*.toml

Step 3: Generate the Configuration File

Generate the configuration file based on the following template:

[orchestrator]
timeout_per_team_seconds = 600
max_rounds = 5
min_rounds = 2

[[orchestrator.teams]]
config = "configs/agents/team-a.toml"

[[orchestrator.teams]]
config = "configs/agents/team-b.toml"

Step 4: Save the File

Save the generated configuration to the following path:

$MIXSEEK_WORKSPACE/configs/orchestrator.toml
# または
$MIXSEEK_WORKSPACE/configs/orchestrator-<name>.toml

Step 5: Validate the Configuration File (Required)

Be sure to run validation after generation.

uv run python skills/mixseek-config-validate/scripts/validate-config.py \
    $MIXSEEK_WORKSPACE/configs/orchestrator.toml --type orchestrator

If validation succeeds, report the results to the user. If it fails, check the error details and fix the configuration.

What is TUMIX (Tournament-style Mixture of Experts)?

This is a core feature of MixSeek-Core and operates according to the following flow:

1. Submission Phase: Each team executes the task in parallel and generates an answer (Submission)
2. Evaluation Phase: Evaluators score each Submission
3. Judgment Phase: A judge determines the final winner
4. Tournament: Repeat the above for multiple rounds and select the best result

Configuration Items

Round Settings

Item	Description	Default	Range
max_rounds	Maximum number of rounds	5	1-10
min_rounds	Minimum number of rounds	2	1 or greater

Note: min_rounds <= max_rounds must be true.

Timeout Settings

Item	Description	Default	Range
timeout_per_team_seconds	Per-team timeout	300	10-3600
submission_timeout_seconds	Submission generation timeout	300	-
judgment_timeout_seconds	Judgment processing timeout	60	-

Example

2-Team Competition Settings

User: 2つのチームで競わせる設定を作って

Agent: オーケストレーター設定を提案します。

       既存のチーム設定を確認しました:
       - configs/agents/team-web-research.toml
       - configs/agents/team-analysis.toml

       設定:
       - 最大ラウンド数: 5
       - 最小ラウンド数: 2
       - チームタイムアウト: 600秒

       この構成でよろしいですか？

User: はい

Agent: 設定ファイルを生成しました:
       orchestrator.toml

       実行コマンド:
       mixseek exec --config orchestrator.toml

Example of Generated Configuration File

# MixSeek Orchestrator Configuration
# Generated by mixseek-orchestrator-config skill

[orchestrator]
# ラウンド設定
max_rounds = 5
min_rounds = 2

# タイムアウト設定
timeout_per_team_seconds = 600
submission_timeout_seconds = 300
judgment_timeout_seconds = 60

# 競合チーム設定
[[orchestrator.teams]]
config = "configs/agents/team-web-research.toml"

[[orchestrator.teams]]
config = "configs/agents/team-analysis.toml"

Competition Settings for 3 or More Teams

[orchestrator]
max_rounds = 3
min_rounds = 2
timeout_per_team_seconds = 900

[[orchestrator.teams]]
config = "configs/agents/team-creative.toml"

[[orchestrator.teams]]
config = "configs/agents/team-analytical.toml"

[[orchestrator.teams]]
config = "configs/agents/team-practical.toml"

How to Run

CLI commands

# 基本実行
mixseek exec --config orchestrator.toml

# 詳細ログ付き
mixseek exec --config orchestrator.toml --log-level debug

# Logfire観測付き
mixseek exec --config orchestrator.toml --logfire

Execution from UI

# UI起動
mixseek ui

# 「実行」ページでorchestrator.tomlを選択して実行

Troubleshooting

Team configuration file not found

Error: Team config not found: configs/agents/team-xxx.toml

How to resolve:

1. Check that the file path is correct
2. $MIXSEEK_WORKSPACESpecify as a relative path from
3. mixseek-team-configCreate a team configuration with the skill

Round configuration error

Error: min_rounds must be <= max_rounds

How to resolve:

• min_roundsをmax_roundsConfigure below

Timeout error

Error: Team execution timed out

How to resolve:

1. timeout_per_team_secondsIncrease
2. Team'stimeout_secondsCheck the settings
3. Reduce the number of Member Agents

Integration with evaluation and judgment settings

The orchestrator integrates with the following configuration files:

• evaluator.toml: Submission scoring settings
• judgment.toml: Final judgment settings

These aremixseek-evaluator-configcan be generated with the skill.

References

• TOML schema details: references/TOML-SCHEMA.md
• Team configuration: skills/mixseek-team-config/
• Evaluation settings: skills/mixseek-evaluator-config/