Ab Test Calculator

A/B测试计算器。样本量计算、统计显著性检验、实验时长预估、结果报告、贝叶斯分析。AB test calculator with sample size, significance testing, duration estimation, reports.

Security Scan

The skill is internally consistent with an A/B test calculator: it runs local shell scripts to compute sample sizes, significance, Bayesian estimates and generate reports; it requests no credentials and does not call remote endpoints.

Purpose & Capability

Name/description match the delivered functionality. The scripts implement sample-size, significance, duration, report and Bayesian calculations as advertised. No unrelated binaries or credentials are requested.

Instruction Scope

SKILL.md instructs running scripts/abtest.sh and all shown commands operate locally on provided numeric arguments. The scripts do not read secrets or call external endpoints. Note: there is an additional helper script (scripts/script.sh) with a broader CLI surface that is not referenced in SKILL.md; it persists data under a data directory (see persistence_privilege).

Install Mechanism

This is an instruction-only skill with bundled shell scripts and no install spec or network downloads. No code is fetched from external URLs during install.

Credentials

No required environment variables or credentials are declared. The helper script respects AB_TEST_CALCULATOR_DIR and XDG_DATA_HOME/HOME for storage location — optional and reasonable for a CLI that persists data.

Persistence & Privilege

One bundled helper (scripts/script.sh) creates and writes files under $AB_TEST_CALCULATOR_DIR or default ${XDG_DATA_HOME:-$HOME/.local/share}/ab-test-calculator (data.log, history.log). This is local disk persistence and consistent with a CLI tool, but SKILL.md doesn't explicitly mention persistent storage. There is no evidence of attempts to modify other skills or system config.

Assessment

This skill appears to do exactly what it advertises: local A/B test math and reporting. Before installing/running: 1) Review the scripts if you want to be cautious — they are plain Bash and easy to read. 2) Be aware scripts/script.sh will create a data directory (by default ~/.local/share/ab-test-calculator) and append logs/data; set AB_TEST_CALCULATOR_DIR if you prefer another location or run in an isolated environment. 3) The statistics use simple approximations (e.g., an approximate p-value formula); treat results as guidance and double-check critical analyses with a trusted stats package. 4) No network calls or secret access are present, so there is no credential exposure risk from this skill as provided.

A/B Test Calculator Skill

A/B测试统计计算器 — 科学决策，数据驱动。

Commands

Run via: bash scripts/abtest.sh <command> [args...]

Command	Description
calculate	计算两组的统计显著性
sample	计算所需最小样本量
significance	检验p值和置信区间
duration	预估实验所需天数
report	生成完整A/B测试报告
bayesian	贝叶斯方法分析胜率

Usage Examples

# 计算显著性（访客数 转化数）
bash scripts/abtest.sh calculate 1000 50 1000 65

# 计算样本量（基线转化率 最小可检测提升 显著性水平）
bash scripts/abtest.sh sample 0.05 0.02 0.95

# 预估实验时长（日均流量 所需样本量）
bash scripts/abtest.sh duration 5000 16000

# 贝叶斯分析
bash scripts/abtest.sh bayesian 1000 50 1000 65

# 生成报告
bash scripts/abtest.sh report 1000 50 1000 65 "按钮颜色测试"

---

💬 Feedback & Feature Requests: https://bytesagain.com/feedback Powered by BytesAgain | bytesagain.com