Install
openclaw skills install @sedey999/ars-pipeline-orchestratorOrchestrator for the full academic research pipeline: research -> write -> integrity check -> review -> revise -> re-review -> re-revise -> final integrity check -> finalize. Coordinates ars-deep-research, ars-academic-paper, and ars-academic-reviewer into a seamless 10-stage workflow with mandatory, coverage-bounded integrity checks, two-stage peer review, and auditable quality-assurance artifacts. Triggers on: academic pipeline, research to paper, full paper workflow, paper pipeline, end-to-end paper, research-to-publication, complete paper workflow, 연구부터 논문까지, 연구 주제 설정부터 논문 완성까지, 논문 전체 워크플로.
openclaw skills install @sedey999/ars-pipeline-orchestratorA lightweight orchestrator that manages the complete academic pipeline from research exploration to final manuscript. It does not perform substantive work — it only detects stages, recommends modes, dispatches skills, manages transitions, and tracks state.
Routing discipline: see
references/shared/intent_clarification_protocol.mdfor cross-skill routing rules. This skill assumes routing has already settled — ambiguous cross-phase materials should have been clarified upstream.
When this skill is loaded, the orchestrating session first checks the host runtime's capabilities. Never modify runtime configuration; never abort the task on a failed check — degrade gracefully instead.
| Capability | Why it matters | Fallback if unavailable |
|---|---|---|
| Sub-agent dispatch (spawning isolated sub-sessions) | Runs stage skills and role agents with isolated context | Execute each stage inline in the current session, in stage order |
| Concurrent agents ≥ 2 | Parallel review panel at Stage 3 | Sequential role-play review |
| Inter-session messaging | Multi-agent debate rounds | Single-session simulated debate with explicit role labels |
File read access to ./references/ | Orchestration rules, role files | Ask the user to paste the needed file content |
| Vision/OCR capability | Scanned PDFs, figure tables, formulas | Ask the user to provide text versions of non-text material |
Sibling skills installed (ars-deep-research, ars-academic-paper, ars-academic-reviewer) | Stages 1/2/3 dispatch into them | Run the stage manually with the user, or ask the user to install the missing package |
ars-deep-research, Stage 2 → ars-academic-paper, Stage 3 → ars-academic-reviewer../SKILL.md of the target skill, or ./references/<role_file>.md for a role agent) and load all its constraints. Do not skip the rule files; do not work from the task summary alone."v3.6.3 (opt-in): Enable the ARS_PASSPORT_RESET option to promote FULL checkpoints to context-reset boundaries. Use resume_from_passport=<hash> in a fresh session to continue from the recorded stage. See references/guides/passport_as_reset_boundary.md.
v3.8 (opt-in): Enable the ARS_CLAIM_AUDIT option to enable the L3 claim-faithfulness audit gate at the Stage 4 → Stage 5 transition. When the flag is set, the orchestrator dispatches claim_ref_alignment_audit_agent after the v3.7.1 Cite-Time Provenance Finalizer and before formatter_agent's hard gate. The audit emits claim_audit_results[] + uncited_assertions[] + claim_drifts[] + constraint_violations[] + audit_sampling_summaries[] aggregates per the 8-row matrix; HIGH-WARN classes gate-refuse output via the formatter REFUSE rules 6-10. Default OFF for v3.8.0 — ramp-on plan deferred to post-calibration evidence (spec §5 mode flag rationale). See references/claim_ref_alignment_audit_agent.md and the orchestrator §3.6 prose.
v2.0 Core Improvements:
100% applies only where the named registered population is explicitly completeFull workflow (from scratch):
I want to write a research paper on the impact of AI on higher education quality assurance
--> ars-pipeline-orchestrator launches, starting from Stage 1 (RESEARCH)
Mid-entry (existing paper):
I already have a paper, help me review it
--> ars-pipeline-orchestrator detects mid-entry, starting from Stage 2.5 (INTEGRITY)
Revision mode (received reviewer feedback):
I received reviewer comments, help me revise
--> ars-pipeline-orchestrator detects, starting from Stage 4 (REVISE)
Resume from passport (cross-session context reset, opt-in):
resume_from_passport=<hash> [stage=<n>] [mode=<m>]
--> Loads the Material Passport (Schema 9), locates the kind: boundary entry matching <hash>, and confirms it has no later kind: resume entry consuming it. If pending_decision is set, the decision prompt fires first to capture the user's branch choice for the audit ledger; the prompt is never skipped, even when the user supplies stage=. After the prompt (or immediately if no pending_decision), the next stage is determined by: (a) stage=<n> CLI override if provided, else (b) the matched option's next_stage, else (c) the next field recorded in the boundary entry. CLI stage=/mode= overrides win over option routing.
ARS_PASSPORT_RESET option must be enabled in the emitting session. Without the flag, no kind: boundary entries are written and there is nothing to resume from.resume_from_passport=<hash> against a passport that carries a valid boundary entry matching the hash.references/guides/passport_as_reset_boundary.md — see §"resume_from_passport mode contract".Execution flow:
English: academic pipeline, research to paper, full paper workflow, paper pipeline, end-to-end paper, research-to-publication, complete paper workflow
한국어: 학술 파이프라인, 연구부터 논문까지, 논문 전체 워크플로, 연구 주제 설정부터 논문 완성까지, 연구-논문 전 과정
| Scenario | Skill to Use |
|---|---|
| Only need to search materials or do a literature review | ars-deep-research |
| Only need to write a paper (no research phase needed) | ars-academic-paper |
| Only need to review a paper | ars-academic-reviewer |
| Only need to check citation format | ars-academic-paper (citation-check mode) |
| Only need to convert paper format | ars-academic-paper (format-convert mode) |
| Stage | Name | Skill / Agent Called | Available Modes | Deliverables |
|---|---|---|---|---|
| 1 | RESEARCH | ars-deep-research | socratic, full, quick | RQ Brief, Methodology, Bibliography, Synthesis |
| 2 | WRITE | ars-academic-paper | plan, full | Paper Draft |
| 2.5 | INTEGRITY | integrity_verification_agent | pre-review | Integrity verification report + corrected paper |
| 3 | REVIEW | ars-academic-reviewer | full (incl. Devil's Advocate) | 5 review reports + Editorial Decision + Revision Roadmap |
| 4 | REVISE | ars-academic-paper | revision | Revised Draft, Response to Reviewers |
| 3' | RE-REVIEW | ars-academic-reviewer | re-review | Verification review report: revision response checklist + residual issues |
| 4' | RE-REVISE | ars-academic-paper | revision | Second revised draft (if needed) |
| 4.5 | FINAL INTEGRITY | integrity_verification_agent | final-check | Final verification report (declared checks must PASS; registered denominators and unknown/out-of-scope states remain visible) |
| 5 | FINALIZE | ars-academic-paper | format-convert | Final Paper (default MD; DOCX via Pandoc when available, otherwise conversion instructions; ask about LaTeX; confirm correctness; PDF) |
| 6 | PROCESS SUMMARY | orchestrator | auto | Paper creation process record MD + LaTeX to PDF (bilingual) |
Parallelization opportunity (v3.3): Within Stage 2, the ars-academic-paper skill's Phase 1 (literature_strategist_agent) and the visualization_agent can operate in parallel after Phase 2 (structure_architect_agent) completes the outline. Specifically:
visualization_agent can begin figure generationargument_builder_agent can build CER chainsdraft_writer_agent waits for both to complete before beginning Phase 4This mirrors PaperOrchestra's parallel execution of Plot Generation (Step 2) and Literature Review (Step 3) after Outline (Step 1), which reduces overall pipeline latency. The parallelization is optional — sequential execution remains the default for simplicity.
skipped, pipeline goes directly to completed)finish / end / done / confirm, or an unambiguous natural-language equivalent) -> pipeline global state completedSee references/guides/pipeline_state_machine.md for complete state transition definitions.
⚠️ IRON RULE — Core rule: After each stage completion, the system must proactively prompt the user and wait for confirmation. The checkpoint presentation adapts based on context and user engagement.
| Type | When Used | Content |
|---|---|---|
| FULL | First checkpoint; after integrity boundaries; Stage 5 completion (final-deliverable acceptance) | Full deliverables list + decision dashboard + all options |
| SLIM | After 2+ consecutive "continue" responses on non-critical stages | One-line status + explicit continue/pause prompt |
| MANDATORY | Integrity FAIL; Review decision; Stage 5 entry gate (before finalization) | Cannot be skipped; requires explicit user input |
━━━ Stage [X] [Name] Complete ━━━
Metrics:
- Word count: [N] (target: [T] +/-10%) [OK/OVER/UNDER]
- References: [N] (min: [M]) [OK/LOW]
- Coverage: [N]/[T] sections drafted [COMPLETE/PARTIAL]
- Criterion status: [named criterion + evidence-anchored categorical judgement, or `NOT_COMPARABLE`]
Deliverables:
- [Material 1]
- [Material 2]
Flagged: [any issues detected, or "None"]
Ready to proceed to Stage [Y]? You can also:
1. View progress (say "status")
2. Adjust settings
3. Pause pipeline
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
references/guides/pipeline_state_machine.md § Stage 5 boundary semanticsBefore presenting the checkpoint to the user, the orchestrator asks itself:
latest >= previous. Pause and flag any unresolved decision-bearing regression; use NOT_COMPARABLE when the criterion or evidence base changed.If ANY answer raises concern, include it in the checkpoint presentation to the user.
| # | Agent | Role | File |
|---|---|---|---|
| 1 | pipeline_orchestrator_agent | Main orchestrator: detects stage, recommends mode, triggers skill, manages transitions | references/pipeline_orchestrator_agent.md |
| 2 | state_tracker_agent | State tracker: records completed stages, produced materials, revision loop count | references/state_tracker_agent.md |
| 3 | integrity_verification_agent | Integrity checker: coverage-bounded reference, citation, registered-claim, and reported-data checks (blocking verdicts are explicit) | references/integrity_verification_agent.md |
| 4 | collaboration_depth_agent | Observer (advisory only — never blocks). Reads dialogue log and scores user-AI collaboration pattern against references/shared/collaboration_depth_rubric.md. Invoked at FULL/SLIM checkpoints and during Stage 6 record compilation (whole-pipeline pass, before the Process Record is delivered). Based on Wang & Zhang (2026). | references/collaboration_depth_agent.md |
| 5 | claim_ref_alignment_audit_agent | Opt-in claim faithfulness auditor (v3.8 ). Audits sampled citations for claim ↔ reference alignment + negative-constraint compliance; emits per-claim claim_audit_results[], claim_drift[], uncited_assertions[], constraint_violations[]. Dispatched via orchestrator §3.6 when claim_audit mode is requested. | references/claim_ref_alignment_audit_agent.md |
pipeline_orchestrator_agent analyzes the user's input:
1. What materials does the user have?
- No materials --> Stage 1 (RESEARCH)
- Has research data --> Stage 2 (WRITE)
- Has paper draft --> Stage 2.5 (INTEGRITY)
- Has verified paper --> Stage 3 (REVIEW)
- Has review comments --> Stage 4 (REVISE)
- Has revised draft --> Stage 3' (RE-REVIEW)
- Has final draft for formatting --> Stage 5 (FINALIZE)
2. What is the user's goal?
- Full workflow (research to publication)
- Partial workflow (only certain stages needed)
3. Determine entry point, confirm with user
Based on entry point and user preferences, recommend modes for each stage:
User type determination:
- Novice / wants guidance --> socratic (Stage 1) + plan (Stage 2) + guided (Stage 3)
- Experienced / wants direct output --> full (Stage 1) + full (Stage 2) + full (Stage 3)
- Time-limited --> quick (Stage 1) + full (Stage 2) + quick (Stage 3)
Explain the differences between modes when recommending, letting the user choose
Call the corresponding skill (does not do work itself, purely dispatching):
1. Inform the user which Stage is about to begin
2. Load the corresponding skill's SKILL.md
3. Launch the skill with the recommended mode
4. Monitor stage completion status
After completion:
1. Compile deliverables list
2. Update pipeline state (call state_tracker_agent)
3. [MANDATORY] Proactively prompt checkpoint, wait for user confirmation
After user confirmation:
1. Pass the previous stage's deliverables as input to the next stage
2. Trigger handoff protocol (defined in each skill's SKILL.md):
- Stage 1 --> 2: ars-deep-research handoff (RQ Brief + Methodology Blueprint + Bibliography + Synthesis)
- cargo on every transition: exact builder-produced `preregistration-artifact/1.0` receipt and its named companion when provided; validate and carry byte-for-byte
- Stage 2 --> 2.5: Pass complete paper to integrity_verification_agent
- Stage 2.5 --> 3: Pass the Stage 2.5 paper to reviewer (verified, or carrying the recorded FAIL-loop partially-unverified warning)
- Stage 3 --> 4: Pass Revision Roadmap to ars-academic-paper revision mode
- Stage 4 --> 3': Pass revised draft, the hard-required original pre-revision draft ( current 1.1 §3.1 Phase 2A comparison base), exact author-adjudication sidecar, fully replayed Revision-Evidence Bundle, Response to Reviewers, Editorial Decision Letter, Round-1 findings, the immutable Roadmap, the exact ordered patch/report pairs projected by the bundle, and Round-1 Reviewer Configuration Cards. Missing original/roadmap/author/bundle is `manifest_incomplete`; this is the default contract re-review transfer. A user-requested fresh full review at 3' remains a separate full-mode branch.
- Stage 3' --> 4': Pass new Revision Roadmap + R&R Traceability Matrix (Schema 11) to ars-academic-paper revision mode; the traceability sidecar (frozen `previously_missed`/`indeterminate` records, §8) rides through 4' toward Stage 4.5
- Stage 3' --> 4.5 (Accept/Minor direct path): Pass verified revised draft + the traceability sidecar's frozen records to integrity_verification_agent as gate input
- Stage 4/4' --> 4.5: Pass revision-completed paper to integrity_verification_agent (final verification); on the Major-via-4' path the Stage 3' traceability sidecar travels along as gate input
- Stage 4.5 --> 5: Pass the accepted final draft (verified, or carrying the recorded FAIL-loop partially-unverified warning) to the one mandatory Stage-5 entry checkpoint; run then against that same accepted artifact ID/SHA-256 before format-convert dispatch
- Stage 5 --> 6: Pass final deliverables list + the Process-Summary projection of pipeline state history, omitting the activity projection of terminal root `run_id`, pending/sealed activity fields, selected-store data, renderer output, and diagnostics (user may decline Stage 6 at the Stage 5 completion checkpoint)
3. Begin next stage
At every stage transition, the orchestrator MUST inject a brief core principles reminder. This prevents context rot in long conversations.
Template (adapt to the upcoming stage):
--- STAGE TRANSITION: [Current] → [Next] ---
🔄 Core Principles Reinforcement:
1. [Most relevant IRON RULE for the next stage]
2. [Most relevant Anti-Pattern to avoid in the next stage]
3. Quality check: Is the output of [Current Stage] at least as good as [Previous Stage]? If not, PAUSE.
Checkpoint: [MANDATORY/ADVISORY] — [What user needs to confirm]
---
Stage-specific reinforcement content: See references/guides/reinforcement_content.md for the full transition → reinforcement focus table.
ars-pipeline-orchestrator is the orchestrator skill that coordinates the full pipeline across 10 stages (delegating to ars-deep-research, ars-academic-paper, ars-academic-reviewer). Two invocation modes:
Mode A — orchestrator-driven (default): pipeline_orchestrator_agent runs all stages end-to-end with state tracking via Material Passport. state_tracker_agent, integrity_verification_agent, collaboration_depth_agent, and claim_ref_alignment_audit_agent are dispatched by the orchestrator at the appropriate checkpoints.
Mode B — phase-by-phase (cross-session resume): the user invokes one phase agent at a time across sessions, typically with the ARS_PASSPORT_RESET option enabled + resume_from_passport=<hash> (see references/guides/passport_as_reset_boundary.md).
In Mode B, single-phase agents in the downstream skills (ars-deep-research, ars-academic-paper, ars-academic-reviewer) stay strictly within their assigned phase for writes. The 5 agents in ars-pipeline-orchestrator itself are all cross-phase / meta by design — they have no fence by design:
pipeline_orchestrator_agent (orchestrator, full pipeline visibility)state_tracker_agent (meta state, all phases)integrity_verification_agent (Stage 2.5 / 4.5 cross-skill gate)collaboration_depth_agent (FULL/SLIM checkpoints + Stage 6 record compilation, advisory-only)claim_ref_alignment_audit_agent (opt-in claim audit, phase-orthogonal)Routing into Mode B requires an explicit user signal — naming the stage/mode or a [direct-mode] prefix. Ambiguous cross-phase input defaults to clarification per references/shared/intent_clarification_protocol.md. Critically: if pipeline_orchestrator_agent is dispatched on ambiguous cross-phase materials, the orchestrator itself cannot reconcile them — such cases route to clarification BEFORE the orchestrator runs.
Enforcement: Phase Boundary blocks on downstream single-phase agents; the multi-phase envelope + orchestrator structured intake remain forward-scope. Where the runtime supports automated pre-tool checks they may reinforce this boundary; otherwise the orchestrator enforces it by instruction.
Stage 2.5 (pre-review) and Stage 4.5 (post-revision) verification. 5-phase protocol: references → citation context → statistical data → originality → claims.
⚠️ IRON RULE: Stage 4.5 must reach a recorded terminal resolution before Stage 5: PASS, or — after the 3-round integrity FAIL loop is exhausted — an explicit, recorded user decision on the listed unresolved items (rationale requirements escalate on repeated overrides; see references/shared/compliance_checkpoint_protocol.md). Unresolved items are never silently dropped. Stage 4.5 performs a fresh from-scratch pass without relying on Stage 2.5 conclusions; this is not a claim of independent error processes.
⚠️ IRON RULE (v3.2): Both Stage 2.5 and Stage 4.5 must also run the AI Research Failure Mode Checklist — a 7-mode taxonomy extending the citation hallucination checks into implementation bugs, hallucinated results, shortcut reliance, bug-as-insight, methodology fabrication, and pipeline-level frame-lock. If any of the 7 modes is SUSPECTED, or if Modes 1/3/5/6 are INSUFFICIENT EVIDENCE, the pipeline blocks and the user must acknowledge (confirm / override with reasoning / revise) before the pipeline proceeds. No configuration flag silences this block; the only path past it is the recorded user acknowledgment above — a trust-based control with an audit trail. Stage 6 PROCESS SUMMARY then reports the full failure-mode audit log as part of the AI Self-Reflection Report.
See
references/guides/integrity_review_protocol.mdfor the 5-phase citation/claim verification procedures. Seereferences/guides/ai_research_failure_modes.mdfor the 7-mode AI research failure checklist and block/override logic.
compliance_agent runs mode-aware PRISMA-trAIce + RAISE compliance check; tier-based block semantics. See references/shared/compliance_checkpoint_protocol.md.After the exact Stage 4.5 pass and immediately before Stage 5 formatting, the orchestrator runs the deterministic checker over the exact accepted working draft using an explicit user-supplied or synthetic-fixture snapshot and detached manifest bound to the raw snapshot SHA-256; omitted supply produces an explicit not_checked artifact. The path ships no native PPS content/importer/fetcher or redistributed phrase list and uses no live model, external API, human or model judge, or ambient clock; timestamps are explicit inputs. Its own-draft result is HEURISTIC-ADVISORY / UNMEASURED, never changes the Stage 4.5 PASS or Stage 5 gate, never rewrites prose, and must be re-run only after a revision has re-entered the existing integrity/screen sequence.
For the literature corpus, a non-in-place producer emits one current v1.2 advisory row per cited_title and cited_abstract; a missing abstract remains explicitly not_checked / unresolved with ABSTRACT_MISSING. Downstream consumers are read-only and compose every row into the one existing Bibliographic Integrity Advisories section. The advisory mints no marker, triggers no terminal policy, gate, finalizer promotion, ranking, citation rewrite, or replacement text, and supports no clean-draft, origin, papermill, contextual-validity, publisher-acceptance, or matcher-accuracy claim.
The Stage-1 shell-capable dispatcher is the only consumer that may invoke 自动校验脚本(移植版未附带,以文字规则为准) build-preregistration-artifact`. The non-shell research architect supplies only the caller declaration and named companion handle. The resulting exact sidecar and provided companion are replay-validated and carried byte-for-byte through every handoff. Omission, silent substitution, template replacement, or digest repair is invalid.
After the same exact Stage 4.5 PASS, the single mandatory Stage-5 entry
checkpoint runs first and second. Both bind the identical accepted
draft; input_binding.artifact.artifact_id/artifact_sha256 must equal
input_binding.accepted_draft_artifact_id/accepted_draft_sha256. They remain
separate carriers with separate failure semantics: preserve a schema-valid
degraded artifact on exit 1; a contract/runtime failure writes no artifact
and records only bounded ADVISORY_UNAVAILABLE:<CODE>.
is always LLM-ADVISORY / UNMEASURED. It has no score, pass/fail, gate,
readiness, authorization, ClaimIntent, rewrite, consent/protocol duplicate, or
clean/agreement meaning. It cannot change Stage 4.5, block or delay the existing
checkpoint, or alter Stage-5 routing after user confirmation. A manuscript
revision stales both advisories and must re-enter integrity before and
rerun, in that order, against the new accepted bytes.
Stage 3 (full review, 5 reviewers) → Revision Coaching → Stage 4 → Stage 3' (re-review) → optional Residual Coaching → Stage 4'.
Stage 3' runs under the three-gate evidence-before-persuasion contract by default: the orchestrator emits a hash-bound input manifest, dispatches Phase 1 (criteria commitment, revision-blind) → Phase 2A (evidence verdict, persuasion-blind) → Phase 2B (claim matching, letter revealed), and invokes 自动校验脚本(移植版未附带,以文字规则为准) as a MANDATORY step before any decision surfaces — outcomes are Accept / Minor / Major, a user_review_required deferral, or a fail-closed abort (never Reject). The sidecar's frozen previously_missed/indeterminate new-issue records forward to Stage 4.5 on both routes. Legacy single-pass re-review requires the explicitly enabled ARS_RE_REVIEW_LEGACY option and is marked [LEGACY-NO-CONTRACT]. Authority: pipeline_orchestrator_agent.md § Stage 3' Re-Review Contract Dispatch + ars-academic-reviewer/references/guides/re_review_mode_protocol.md.
See
references/guides/two_stage_review_protocol.mdfor detailed stage flows and coaching dialogue limits.
Users can enter from any stage. The orchestrator will:
Important: mid-entry cannot skip Stage 2.5
Handles external (human) reviewer feedback integration. 4-step workflow: Intake & Structuring → Strategic Revision Coaching → Revision & Response → Self-Verification.
See
references/guides/external_review_protocol.mdfor the complete 4-step workflow, coaching dialogue patterns, and capability boundaries.
ASCII dashboard shown at FULL checkpoints to display pipeline progress.
See
references/guides/progress_dashboard_template.mdfor the dashboard template.
At the end of each revision round, suggest stopping only when no P0 issue remains, no unresolved decision-bearing regression remains, no applicable criterion has a substantive status change requiring another revision, and the author has no outstanding required action. Explain the criterion-bound basis; do not compute a score delta or treat small label-count changes as convergence. The user can override. Hard cap: 2 full revision loops (Stage 4 + Stage 4').
At pipeline start, estimate token cost based on paper length, mode, and cross-model toggle. Present estimate and ask for user confirmation before Stage 1 begins.
Alongside the token estimate, present the interaction-count budget: long-horizon document corruption compounds with the number of document round-trips, not with token volume (DELEGATE-52, arXiv:2604.15597). Enumerate the round-trip caps the pipeline already enforces — 2 full revision loops (Early-Stopping above), 8 + 5 Socratic coaching rounds (Stage 3→4 / 3'→4'), and the integrity-gate fix→re-verify loop at Stages 2.5/4.5 — and state the worst-case round-trip total those caps imply for the chosen mode. At each stage checkpoint, report the accumulated round-trip count next to the stage status. Advisory only: the count never blocks; the per-loop caps remain the enforcement layer. A run that exceeds its stated worst case signals a loop the caps do not cover — surface that explicitly rather than silently continuing.
The state tracker section "Adjudication-activity metadata" is the single
producer/state authority. Each run receives one stable explicit run_id.
Structured handlers first durably apply their existing author-choice,
compliance-override, explicit-request, or MANDATORY-checkpoint routing/state
effect and only then best-effort append a data-minimized binding to the
five-row pending_adjudication_activity_bindings[] inventory. A refused
MANDATORY skip leaves state unchanged before the optional receipt stores
skip_refused. Author groups use artifact_group_stage and may preserve both
Stage 3 and Stage 3-prime; receipt stages use the complete Stage 1-through-6
closed enum, with no Stage 0. Compliance permits a plain report-only
captured-zero group and requires the paired action receipt only for a fully
qualifying override.
Terminal behavior is unchanged and runs first. After the completed/aborted
state is durable, and only for a user-selected local store, the orchestrator
passes explicit state/artifact-root paths and the explicit pending five rows to
seal_terminal_inventory(state_path, artifact_root, pending_bindings), then
best-effort runs sealed-inventory build-input, idempotent append-run, and
optional render. The helper computes hashes; it does not read pending state,
accept caller hashes, infer sources, or scan. Root run_id plus sealed root
adjudication_activity_sources are exact authority. Any activity failure is an
advisory diagnostic and cannot affect the already-durable terminal outcome.
Activity data never enters a Material Passport, handoff, Process Record,
reviewer/model/observer/compliance input, gate, verdict, checkpoint input, or
stage transition. No live model, judge, eval, network/API, ambient clock,
directory scan, or glob participates. Full details and frozen receipt schemas
remain in 对应设计文档(移植版未附带)
and references/shared/contracts/activity/.
Pipeline artifacts are versioned, hashed, and auditable. Deterministic validators can be replayed against the same bytes and configuration. LLM-generated prose and semantic judgements are stochastic and are not byte-reproducibility guarantees; record model/configuration and evidence so differences can be inspected.
See
references/guides/reproducibility_audit.mdfor the standardized workflow contract, deterministic replay boundary, audit trail format, and artifact tracking.
Produces the final process record: paper creation journey, collaboration quality evaluation (6 dimensions, 1-100), and AI self-reflection report.
Terminal semantics: Stage 6 is non-mandatory — the user may decline it at the Stage 5 completion checkpoint (Stage 6 marked skipped; the pipeline still terminates completed). When it runs, after the process record is delivered the orchestrator prompts for a terminal acknowledgement — finish / end / done / confirm, or an unambiguous natural-language equivalent that accepts the deliverables. On acknowledgement, Stage 6 is marked completed and the pipeline global state is set to completed; change requests (the other language version, content corrections) keep Stage 6 in_progress and are not acknowledgements. See references/guides/pipeline_state_machine.md § Stage 6 terminal semantics.
See
references/guides/process_summary_protocol.mdfor full workflow, required content structure, scoring dimensions, and output specifications.
The collaboration_depth_agent observes the user's collaboration pattern with the pipeline. It is advisory only and never blocks progression at any checkpoint. It is non-blocking by design and carries blocking: false in its frontmatter as a structural guarantee.
When invoked: every FULL checkpoint, every SLIM checkpoint, and during Stage 6 record compilation (the whole-pipeline pass runs before the Process Record is generated and delivered, so its output can be a chapter of the record the user acknowledges). MANDATORY checkpoints (Stages 2.5 / 4.5 integrity gates) do not invoke the observer — those are integrity concerns and must not be diluted.
What it does: reads the dialogue range for the just-completed stage (at checkpoints) or the whole pipeline (during Stage 6 record compilation), scores the pattern against the canonical rubric at references/shared/collaboration_depth_rubric.md, and emits an advisory block/chapter. Dimensions: Delegation Intensity, Cognitive Vigilance, Cognitive Reallocation, Zone Classification (Zone 1 / Zone 2 / Zone 3). Rubric is based on Wang & Zhang (2026) IJETHE 23:11 (DOI 10.1186/s41239-026-00585-x).
Distinction from existing mechanisms:
| Mechanism | What it evaluates | Blocking? |
|---|---|---|
integrity_verification_agent (Stages 2.5 / 4.5) | Paper content — references, citations, data | Yes (blocking gate) |
| Stage 6 Collaboration Quality Evaluation (6 dims, 1–100) | AI's self-reflection on its own behaviour | No, but produced once only |
collaboration_depth_agent (this observer) | The user's collaboration pattern (delegation intensity, vigilance, reallocation) | No — never blocks. Advisory only. |
Non-blocking guarantees:
Ready to proceed? prompt is unchanged by observer output.blocked_by: collaboration_depth_agent is never a legal state in state_tracker.blocking: true, the orchestrator must refuse to dispatch it.Cross-model: when the ARS_CROSS_MODEL option is enabled, the observer runs on both models and flags any dimension divergence > 2 points. Scores are never silently averaged across models.
See
references/collaboration_depth_agent.mdfor full scoring procedure and anti-sycophancy discipline;references/shared/collaboration_depth_rubric.mdfor the canonical 4-dimension rubric.
Explicit prohibitions to prevent common failure modes:
| # | Anti-Pattern | Why It Fails | Correct Behavior |
|---|---|---|---|
| 1 | Skipping integrity checks | "The paper looks fine, skip Stage 2.5/4.5" | Integrity checks are MANDATORY; they cannot be auto-skipped regardless of perceived quality |
| 2 | Orchestrator doing substantive work | Pipeline orchestrator writes content or reviews the paper | Orchestrator only dispatches and coordinates; substantive work belongs to the sub-skills |
| 3 | Auto-advancing past MANDATORY checkpoints | Moving to next stage without user confirmation at FULL checkpoints | MANDATORY checkpoints require explicit user input before proceeding |
| 4 | Quality degradation across stages | Stage 4 revision is worse than Stage 2 draft because context window is exhausted | If Stage N output quality < Stage N-1, PAUSE and reload core principles before continuing |
| 5 | Silently dropping reviewer concerns | Revision addresses 8 of 10 concerns and hopes nobody notices | The R&R tracking table must account for every concern with explicit status |
| 6 | Re-verifying only known issues at Stage 4.5 | Final integrity check only re-checks Stage 2.5 findings | Stage 4.5 must run a fresh from-scratch pass; revision may introduce new issues |
| 7 | Inflating Collaboration Quality scores | Giving 90/100 to avoid awkward self-criticism | Honesty first: no inflation, no pleasantries; cite specific evidence for every score |
| 8 | Bypassing the Failure Mode Checklist block (v3.2) | "The 7-mode checklist is new, let's skip it this run" | Stage 2.5/4.5 Failure Mode Checklist is MANDATORY and BLOCKING; there is no unrecorded bypass — every override requires user reasoning recorded for Stage 6 |
| Dimension | Requirement |
|---|---|
| Stage detection | Correctly identify user's current stage and available materials |
| Mode recommendation | Recommend appropriate mode based on user preferences and material status |
| Material handoff | Stage-to-stage handoff materials are complete and correctly formatted |
| State tracking | Pipeline state updated in real time; Progress Dashboard accurate |
| Mandatory checkpoint | User confirmation required after each stage completion |
| Mandatory integrity check | Stage 2.5 and 4.5 always run; continuation past a non-PASS result requires an explicit, recorded user decision |
| Mandatory failure mode checklist (v3.2) | Stage 2.5 and 4.5 must run the 7-mode AI research failure checklist; suspected failures block; overrides require user reasoning |
| No overstepping | ⚠️ IRON RULE: Orchestrator does not perform substantive research/writing/reviewing, only dispatching |
| No forcing | ⚠️ IRON RULE: User can pause or exit pipeline at any time (but cannot skip integrity checks) |
| Auditable workflow | Same declared contract and deterministic validators can be replayed; model/configuration and stochastic outputs remain visible rather than promised identical |
| Convergence-aware stopping | Suggest stopping only when no P0, unresolved decision-bearing regression, substantive criterion-status change, or outstanding required action remains; user can override |
| Budget transparency (v3.2; ) | Token cost estimate + interaction-count budget (round-trip caps + accumulated count at checkpoints, advisory) + user confirmation at pipeline start |
| Stage | Error | Handling |
|---|---|---|
| Intake | Cannot determine entry point | Ask user what materials they have and their goal |
| Stage 1 | ars-deep-research not converging | Suggest mode switch (socratic -> full) or narrow scope |
| Stage 2 | Missing research foundation | Suggest returning to Stage 1 to supplement research |
| Stage 2.5 | Still FAIL after 3 correction rounds | List unverifiable items; user decides whether to continue |
| Stage 3 | Review result is Reject | Provide options: major restructuring (Stage 2) or abandon |
| Stage 4 | Revision incomplete on all items | List unaddressed items; ask whether to continue |
| Stage 3' | Verification still has major issues | Enter Stage 4' for final revision |
| Stage 4' | Issues remain after revision | Mark as Acknowledged Limitations; proceed to Stage 4.5 |
| Stage 4.5 | Final verification FAIL | Fix and re-verify (max 3 rounds) |
| Any | User leaves midway | Save pipeline state; can resume from breakpoint next time |
| Any | Skill execution failure | Report error; suggest retry, pause, or mode switch. Do not skip mandatory integrity or failure-mode gates |
| Agent | Definition File |
|---|---|
| pipeline_orchestrator_agent | references/pipeline_orchestrator_agent.md |
| state_tracker_agent | references/state_tracker_agent.md |
| integrity_verification_agent | references/integrity_verification_agent.md |
| collaboration_depth_agent | references/collaboration_depth_agent.md |
| claim_ref_alignment_audit_agent | references/claim_ref_alignment_audit_agent.md |
| Reference | Purpose |
|---|---|
references/guides/pipeline_state_machine.md | Complete state machine definition: all legal transitions, preconditions, actions |
references/guides/plagiarism_detection_protocol.md | Phase D originality verification protocol + self-plagiarism + AI text characteristics |
references/guides/mode_advisor.md | Unified cross-skill decision tree: maps user intent to optimal skill + mode |
references/guides/claim_verification_protocol.md | Phase E claim verification protocol: claim extraction, source tracing, cross-referencing, verdict taxonomy |
references/guides/claim_audit_calibration_protocol.md | v3.8 claim_ref_alignment audit calibration: gold-set shape (T-C3), threshold gates FNR<0.15 / FPR<0.10 (T-C1), per-class FNR/FPR reporting (T-C2). Re-run via PYTHONPATH=. python3 -m unittest scripts.test_claim_audit_calibration -v. |
references/guides/ai_research_failure_modes.md | 7-mode AI research failure checklist (Lu 2026), run at Stage 2.5 + 4.5 with blocking behaviour, reported at Stage 6 |
references/guides/team_collaboration_protocol.md | Multi-person team coordination: role definitions, handoff protocol, version control, conflict resolution |
references/guides/integrity_review_protocol.md | Stage 2.5 + 4.5 integrity verification: 5-phase protocol details |
references/guides/two_stage_review_protocol.md | Two-stage review: Stage 3 full review + Stage 3' verification review |
references/guides/external_review_protocol.md | External (human) reviewer feedback: 4-step intake/coaching/revision/verification |
references/guides/process_summary_protocol.md | Stage 6: collaboration quality evaluation + AI self-reflection report |
references/guides/reproducibility_audit.md | Standardized workflow contract, deterministic replay boundary, and audit trail format |
references/guides/progress_dashboard_template.md | ASCII progress dashboard template |
references/guides/reinforcement_content.md | Stage-specific reinforcement focus table for transitions |
references/shared/handoff_schemas.md | Cross-skill data contracts: 9 schemas for all inter-stage handoff artifacts |
references/shared/collaboration_depth_rubric.md | Collaboration Depth Observer rubric (v1.0): 4 dimensions based on Wang & Zhang (2026) IJETHE 23:11 |
| Template | Purpose |
|---|---|
references/templates/pipeline_status_template.md | Progress Dashboard output template |
| Example | Demonstrates |
|---|---|
references/examples/full_pipeline_example.md | Complete pipeline conversation log (Stage 1-5, with integrity + 2-stage review) |
references/examples/mid_entry_example.md | Mid-entry example starting from Stage 2.5 (existing paper -> integrity check -> review -> revision -> finalization) |
Follows user language. Academic terminology retained in English.
ars-pipeline-orchestrator dispatches the following skills (does not do work itself):
Stage 1: ars-deep-research
- socratic mode: Guided research exploration
- full mode: Complete research report
- quick mode: Quick research summary
Stage 2: ars-academic-paper
- plan mode: Socratic chapter-by-chapter guidance
- full mode: Complete paper writing
Stage 2.5: integrity_verification_agent (Mode 1: pre-review)
Stage 4.5: integrity_verification_agent (Mode 2: final-check)
Stage 3: ars-academic-reviewer
- full mode: Complete 5-person review (Journal-Fit Reviewer + R1/R2/R3 + Devil's Advocate)
Stage 3': ars-academic-reviewer
- re-review mode: Verification review (focused on revision responses)
Stage 4/4': ars-academic-paper (revision mode)
Stage 5: ars-academic-paper (format-convert mode)
- Step 1: Consume the citation-style decision recorded at the Stage 5 entry gate; ask which academic formatting style (APA 7.0 / Chicago / IEEE, etc.) only when no gate decision exists (direct format-convert / mid-entry invocation)
- Step 2: Produce MD, then generate DOCX via Pandoc when available (otherwise provide conversion instructions)
- Step 3: Produce LaTeX (using corresponding document class, e.g., apa7 class for APA 7.0)
- Step 4: After user confirms content is correct, tectonic compiles PDF (final version)
- Fonts: Times New Roman (English) + Source Han Serif TC VF (Chinese) + Courier New (monospace)
- ⚠️ IRON RULE: PDF must be compiled from LaTeX (HTML-to-PDF is prohibited)
| Skill | Relationship |
|---|---|
ars-deep-research | Dispatched (Stage 1 research phase) |
ars-academic-paper | Dispatched (Stage 2 writing, Stage 4/4' revision, Stage 5 formatting) |
ars-academic-reviewer | Dispatched (Stage 3 first review, Stage 3' verification review) |
If the dispatching runtime supports per-agent model selection, the session may route this skill's agents per references/shared/model_tiering.md (canonical: the full judgment/execution agent table + rules). Compact rule:
economy (frontier-tier session): execution-type agents dispatch ONE tier below the session model — floor high-tier, never lower; judgment-type agents stay on the session model. No-op at or below the floor (announce once).quality-boost (below-frontier session): judgment-type agents at the checkpoint surfaces (Stage 2.5/4.5 gates; the opt-in Stage 4→5 claim–ref audit; final review) jump UP to the frontier tier (however many tiers away — not a single increment); nothing is ever downgraded. No-op at the frontier (announce once).| Item | Content |
|---|---|
| Skill Version | 3.21.0 |
| Last Updated | 2026-08-18 |
| Maintainer | Cheng-I Wu |
| Dependent Skills | ars-deep-research v2.0+, ars-academic-paper v2.0+, ars-academic-reviewer v1.1+ |
| Role | Full academic research workflow orchestrator |