Benjamin Taoson赖建铭

作品与研究Work & Research

数字 AIDigital AI

从企业智能体与内容生产,到领域微调、奖励建模、强化学习与多模态评测。每个案例说明我解决的问题、实现中的取舍与结果。Enterprise agents and media production, domain fine-tuning, reward modeling, reinforcement learning, and multimodal evaluation. Each case explains the problem, implementation decisions, and results.

商业分析智能体Business analysis agent

工程案例Engineering case study

AI BA · 企业经营分析AI BA · Business Analytics

围绕 147 万条公开交易明细,将业务语义、多智能体调查、确定性分析与经营报告串成完整工作流。Connect business semantics, multi-agent investigation, deterministic analysis, and reports over 1.47 million public transaction rows.

10 个内部基准案例、同一批分析输出:Driver Recall@K 从 90% 到 100%,比较固有评分与查询感知选择。 Ten internal benchmark cases with the same workstream outputs: Driver Recall@K is 90% for intrinsic scoring and 100% for query-aware selection.
+10 pp驱动召回率 · 同输出、10 案例消融Driver recall · same outputs, 10 cases

Driver Recall@K 从 90% 到 100%;只比较同一批分析结果的选择策略,不能解释为营收提升。Driver Recall@K rises from 90% to 100% when selecting from the same analysis outputs. This is a selection-policy comparison, not a revenue increase.

大模型后训练LLM post-training

研究实验Research experiment

Reward Modeling LabReward Modeling Lab

在单张 A10 上完成 8B 奖励模型 QLoRA 训练,再用长度匹配、反长度挑战与排序评估检验高分来自哪里。Train an 8B reward model on one A10, then test its gains with length-controlled challenges and ranking audits.

8B 奖励模型 QLoRA 训练与长度捷径审计的概念示意图。 Concept diagram of 8B reward-model QLoRA training and length-shortcut audits.
8B · QLoRA单卡训练与长度捷径审计Single-GPU training and shortcut audits

内容生产与长视频再生产Media production and video repurposing

内容生产工程原型Media production prototype

多模态内容生产智能体Multimodal Content Creation Agent

以转写和时间戳为依据筛选长视频片段,连接质量门、人工审核、FFmpeg 导出与阶段恢复;同时保留生成式内容生产链路。Ground long-video clips in transcripts and timestamps, then connect quality gates, human review, FFmpeg exports, and recovery alongside a generative media pipeline.

实现与交付Implementation & delivery

FastAPI 任务接口、PostgreSQL Checkpoint、FFmpeg 导出/批量 ZIP、供应商适配器、MinIO 恢复与确定性测试。FastAPI task endpoints, PostgreSQL checkpoints, FFmpeg exports and batch ZIPs, provider adapters, MinIO recovery, and deterministic tests.

53 tests多模态范围 CI · 包含真实 FFmpeg 媒体检查Multimodal-slice CI · includes real FFmpeg media checks

媒体测试使用本地生成样例,ASR 与规划使用固定替身;不是实际模型质量或业务收益的验证。Media tests use generated fixtures with recorded ASR/planner doubles; they do not establish model quality or business impact.

领域 SFT 与 LLMOpsDomain SFT and LLMOps

领域微调工程Domain fine-tuning engineering

金融大模型微调Financial LLM Fine-tuning

连接源级数据隔离、assistant-only 两阶段 LoRA 训练、质量评测和 vLLM 双版本部署。Connect source-level data isolation, assistant-only two-stage LoRA training, quality evaluation, and dual-version vLLM serving.

实现与交付Implementation & delivery

数据治理与泄漏审计脚本、两阶段 LoRA 训练入口、合并与 vLLM 双版本服务、评审器和汇总快照。Data-governance and leakage-audit scripts, a two-stage LoRA trainer, model merging and dual-version vLLM serving, a quality judge, and an aggregate snapshot.

SFT · LoRA源级隔离与两阶段训练链路Source-level isolation and a two-stage training workflow

Agent 强化学习Agent reinforcement learning

RL 工程原型RL engineering prototype

Agentic-RLAgentic-RL

实现无答案泄漏的 SQL 环境、Agent Lightning/veRL GRPO 接口,以及权重变化与固定预算对照验收。Implement a Gold-isolated SQL environment, Agent Lightning/veRL GRPO integration, and checks for weight changes and fixed-budget controls.

实现与交付Implementation & delivery

只读 SQLite 环境、真实框架配置接口、Checkpoint 导出、张量变化检查、配对统计及证据门禁。A read-only SQLite environment, upstream-framework configuration integration, checkpoint export, tensor-delta checks, paired statistics, and an evidence gate.

GRPO · RLVR工程链路已实现 · GPU 结果待验证Workflow implemented · GPU results pending

多模态模型评估Multimodal evaluation

多模态研究Multimodal research

RewardLensRewardLens

固定问题和候选回答,只改变视觉证据;用 8 个模型、4 类因素检验静态分数相近时的干预行为差异。Hold questions and responses fixed, edit visual evidence, and compare intervention behavior across eight judges and four factors.

Attribute 条件下,两模型独立静态准确率均为 80.5%;Phi-3.5-Vision 的 RA 为 84.95%,LLaVA-OneVision-7B 为 100%。RA 使用各模型自己的原图正确子集。 On Attribute, both judges have 80.5% independent static accuracy; RA is 84.95% for Phi-3.5-Vision and 100% for LLaVA-OneVision-7B, using each model’s base-correct subset.
15.1 ppAttribute 静态平分下的 RA 差异RA gap at an exact Attribute static tie

Attribute:两模型静态准确率均为 80.5%;RA 分别按各自原图正确子集计算。此汇总对比与上面的 Molmo 单例使用不同模型。Attribute: both judges score 80.5% static accuracy; RA uses each judge’s own base-correct subset. This aggregate comparison uses different models from the Molmo example above.

物理 AIPhysical AI

让机器人利用记忆寻找目标,通过观察验证判断,并在环境变化时恢复与重规划。SpatialMind 连接这些能力,用可复核的仿真与对照实验检验它们。Help robots use memory to find targets, verify decisions through observation, and recover when the environment changes. SpatialMind connects these capabilities and tests them in documented simulation experiments.

空间记忆与机器人智能体Spatial memory and robot agents

机器人决策仿真原型Robot-decision simulation prototype

SpatialMindSpatialMind

独立设计融合持久空间记忆、主动感知与自主纠错的机器人决策智能体,在仿真中验证搜索、目标确认和失败恢复。Independently designed a robot decision agent with persistent spatial memory, active perception, and recovery, evaluated through search and verification tasks in simulation.

336 次度量仿真任务:Full 81/84 成功、平均 20.869 仿真米;No-Memory 78/84、20.619;Static-Memory 81/84、20.869;Nearest-Search 82/84、19.167。使用 4 个固定拓扑,不是 Gazebo 或真机结果。 336 metric-simulation missions: Full 81/84 successes, 20.869 simulated metres; No-Memory 78/84, 20.619; Static-Memory 81/84, 20.869; Nearest-Search 82/84, 19.167. Four fixed topologies; not Gazebo or physical hardware.
336 missions12 种子 × 7 干预 × 4 策略 · 度量仿真12 seeds × 7 interventions × 4 policies · metric simulation

336 次任务、4 个固定拓扑;Nearest-Search 在成功次数和平均路程上优于 Full,不代表真机表现。336 missions on four fixed topologies; Nearest-Search beats Full on success count and mean travel. These are not physical-robot results.

更多工程与研究Further work

上方重点项目均可在本站阅读完整案例。以下是其他工程仓库和研究原型;尚未制作完整案例页的项目会明确标注跳往 GitHub。The featured projects above have detailed on-site case studies. Other engineering repositories and research prototypes are clearly labeled when they open GitHub instead.

◫ 原型验证 prototype

FitGround FitGround

以人体与服装测量约束检验多模态模型是否真正理解合身度,而非依赖视觉或数据集捷径。 A measurement-grounded study of whether multimodal models understand garment fit rather than visual or dataset shortcuts.

GitHub 仓库 ↗GitHub repository ↗
Python · Multimodal AI 2026
{} 原型验证 prototype

API Test Platform API Test Platform

结合变更影响分析、OpenAPI 生成、契约校验与报告的 Agent 辅助 API 测试系统。 Agent-assisted API testing with change-impact analysis, OpenAPI generation, contract validation, and reporting.

GitHub 仓库 ↗GitHub repository ↗
Python · API Testing 2026
⌁ 学习项目 learning

AI Agent Engineering Lab AI Agent Engineering Lab

以可运行项目和闯关检查构成的 Agent 工程学习路径。 An Agent-engineering learning path built from runnable projects and gated checks.

GitHub 仓库 ↗GitHub repository ↗
Python 2026
⌁ 已归档 archived

Financial Asset QA System Financial Asset QA System

早期金融问答原型,保留为架构与边界复盘材料。 An earlier financial-QA prototype retained for architecture and boundary retrospectives.

GitHub 仓库 ↗GitHub repository ↗
Python · FastAPI · React 2026
↗ 持续构建 active

SalesBoost SalesBoost

销售赋能案例,结合客户对话模拟、教练反馈、商机管理、混合检索与会话评估。 A sales-enablement case study combining customer simulations, coaching, pipeline management, hybrid retrieval, and session evaluation.

GitHub 仓库 ↗GitHub repository ↗
Python · FastAPI · React 2026
◎ 原型验证 prototype

Atlas Research Workspace Atlas Research Workspace

AI 与机器人产业研究工作台的前端原型,组织证据、反证、研究判断和人工审核后的版本化简报。 A frontend prototype for AI and robotics research, organizing evidence, counter-evidence, theses, and human-reviewed living briefs.

GitHub 仓库 ↗GitHub repository ↗
Next.js · TypeScript 2026
{} 持续构建 active

AI Engineering Project OS AI Engineering Project OS

面向代码仓库的工程任务系统,连接项目审计、任务规划、受控执行、验证、失败恢复与再次审计。 A repository-level engineering system connecting audits, planning, controlled execution, verification, recovery, and re-audit.

GitHub 仓库 ↗GitHub repository ↗
Agent Harness · Engineering Tools 2026
◌ 已归档 archived

StartShift-VLA StartShift-VLA

关于 VLA 策略初始化敏感性的研究归档,保留仿真基线、证据复核工具和未完成部分。 A research archive on VLA initialization sensitivity, preserving simulation baselines, evidence checks, and unfinished work.

站内完整案例 →Read full case study →
Python · SmolVLA · LIBERO 2026

从具体问题开始交流Start with a concrete question

欢迎讨论工程合作、研究方法、授课邀请与职业机会。Get in touch about engineering collaboration, research methods, teaching invitations, or career opportunities.

联系我Contact me