Update knowledge base with recent forum insights and clarifications
- Added new sections on missing data handling and experimental variables in data and signal semantics (2026-09-25). - Included clarifications on clustering representatives and candidate evaluations in portfolio and correlation optimization (2026-09-25). - Updated README to reflect the latest forum synchronization and new post counts, including significant additions and revisions across multiple topics (2026-09-25).
This commit is contained in:
yuxuanhui
@@ -1,6 +1,6 @@
|
||||
# 来源、覆盖范围与验证记录
|
||||
|
||||
首次采集日期：2026-09-07；最近论坛同步：2026-09-18。下列初轮与扩展轮数字保留为历史记录，最新覆盖见文末周同步记录。时间边界按 Asia/Shanghai 的 2026-01-01 00:00 至整理时点；原始索引时间使用 UTC/带偏移的 ISO 8601。日历日简写通常取原来源 UTC 日期，未把它伪装成本地精确时刻。
|
||||
首次采集日期：2026-09-07；最近论坛同步：2026-09-25（有访问缺口）。下列初轮与扩展轮数字保留为历史记录，最新覆盖见文末周同步记录。时间边界按 Asia/Shanghai 的 2026-01-01 00:00 至整理时点；原始索引时间使用 UTC/带偏移的 ISO 8601。日历日简写通常取原来源 UTC 日期，未把它伪装成本地精确时刻。
|
||||
|
||||
## 邮箱
|
||||
|
||||
@@ -108,3 +108,17 @@ SPC 7 篇官方帮助页按 ID 直接读取；另通过支持站搜索取得 Pyt
|
||||
本轮继续比较全部范围内评论的文本指纹，没有假定帖子更新时间或评论数量能完全反映评论编辑。评论指纹针对去除 HTML、规范化空白后的文字，不覆盖纯排版、链接目标或图片替换；因此“未见评论文本编辑”不能解释为所有媒体与格式均未变化。上周文本保留在本机 `.local/forum-sync/previous-2026-09-11/`，新候选仍由验证后才推进到相应成功基线，图片访问缺口另行保留；状态与采集文本不包含认证响应或会话材料。没有同步邮件、改变平台属性、预约、报名、回测、发帖或推送仓库。
|
||||
|
||||
验证结果：两个 CSV 各有 670 个唯一帖子 ID，评论合计 9,601；采集记录及候选指纹逐项一致，142 篇帖子被知识条目引用，论坛引用均在范围内，本地链接与差异空白检查通过。新增知识内容和本地 JSON/JSONL 状态的账号密码字面值及 JWT 形式扫描通过。实际 API 采集及本周内容比对已运行；社区回测与代码未执行，自动失败恢复、限流退避仍未经过故障演练。文本及索引同步完成，图片正文访问失败保留为独立缺口。
|
||||
|
||||
## 每周论坛同步：2026-09-25
|
||||
|
||||
实际采集时间为北京时间 09:12:33–09:16:29，随后完成筛读和知识整理。认证返回 201，支持站 SSO 落地 403，Community API 正常。完整取得 19 页、1,859 篇可见帖子，排除 1,101 篇早于年初边界的帖子；本次范围内实际取得 758 篇、10,141 条评论，逐帖分页计数一致，无评论抓取失败。
|
||||
|
||||
相对 9 月 18 日内容基线，新收录 89 篇，其中 72 篇发表于上次采集结束后，17 篇为历史补录。新收录帖带来 9 条评论，217 篇旧帖另有 540 个新可见评论 ID；这 549 条中，67 条发表于上次采集后、482 条创建时间更早，是本轮历史覆盖补齐。旧帖元数据更新时间变化 329 篇，但既有正文指纹无变化，可见帖既有评论没有文本编辑或缺失 ID；没有仅凭更新时间或评论数判断未变。
|
||||
|
||||
此前收录的 41208709211671（傅里叶变换在 Alpha 开发中的应用，2026-06-14）本次列表缺失，直接官方 API 请求也返回 404，原因未定。保留原文快照、引用、索引及其历史 9 条评论，不把 404 解释为已删除。因而当前索引有 759 个 ID：758 个本次可见，1 个历史保留；阅读索引评论数合计 10,150，其中 9 条未在本次重新取得，该帖 comments_complete 记为 False。本次实际取得评论比上次增加 540，等于新可见 549 减去未能重新取得的历史 9，不能将净增量称作新发表评论。
|
||||
|
||||
89 篇新收录帖完成标题及正文主旨筛查，专题目录只作导航，未沿目录扩充 2026 年前帖子；福利、收入展示和未答问题保留索引，不扩写为结论。新收录帖的 9 条评论及旧帖新可见的 540 条评论完成筛读，并针对实质纠错和机制建议精读。新增知识集中在冻结后验证、FFT 互补频带恒等式及修正版局限、PCA 窗口索引、聚类代表不能替代逐项 PC 终验、缺失值语义与 UNKNOWN 状态。社区数值仍为作者自述；本次没有复现回测、安装或执行社区代码，也没有将评论中的配额、评分、时区和阈值升级为官方规则。
|
||||
|
||||
图片帖 43287990820375 仍可取得元数据，正文含 12 张图片；本次抽查其中 1 个官方图片地址仍为 403，没有把抽查写成全部重试，继续保留 metadata_only 和待阅读项。评论指纹仍仅覆盖规范化文字，不检测纯格式、链接目标或图片替换。本次保留上周 670 篇文本快照于本机 previous-2026-09-18/；可见记录验证后推进相应基线，不可访问帖保留旧指纹与重试缺口。此次为可见文本及索引完成、来源与媒体仍有缺口的部分同步，不宣称全量无缺失。
|
||||
|
||||
验证结果：两个 CSV 均有 759 个唯一 ID；758 个本次采集记录与候选指纹、逐评论文本哈希及分页计数一致，另 1 个历史保留记录明确标为当前未完成。154 篇帖子被知识条目引用，引用均属于本次可见范围或明确保留的历史来源。本地链接、差异空白、新增内容及本地 JSON/JSONL 的账号密码字面值和 JWT 形式扫描通过。采集脚本语法检查通过；本轮只验证实际采集与静态内容比对，没有故障注入、策略回测或社区代码执行。
|
||||
|
||||
@@ -29,75 +29,295 @@
|
||||
"No source authentication material is included."
|
||||
],
|
||||
"latest_forum_sync": {
|
||||
"collected_at": "2026-09-18",
|
||||
"collected_at": "2026-09-25",
|
||||
"timezone": "Asia/Shanghai",
|
||||
"started_at": "2026-09-18T02:11:39.967012+00:00",
|
||||
"collection_finished_at": "2026-09-18T02:16:36.188053+00:00",
|
||||
"previous_successful_collection_finished_at": "2026-09-11T01:06:33.369594+00:00",
|
||||
"raw_visible_posts": 1771,
|
||||
"raw_list_pages": 18,
|
||||
"status": "partial_sync_with_source_and_media_gaps",
|
||||
"started_at": "2026-09-25T01:12:33.054002+00:00",
|
||||
"collection_finished_at": "2026-09-25T01:16:29.789990+00:00",
|
||||
"previous_successful_collection_finished_at": "2026-09-18T02:16:36.188053+00:00",
|
||||
"raw_visible_posts": 1859,
|
||||
"raw_list_pages": 19,
|
||||
"excluded_older_posts": 1101,
|
||||
"retained_posts": 670,
|
||||
"retained_comments": 9601,
|
||||
"newly_indexed_posts": 41,
|
||||
"newly_indexed_posts_created_after_previous_collection": 29,
|
||||
"historical_posts_newly_indexed": 12,
|
||||
"comments_on_newly_indexed_posts": 5,
|
||||
"newly_visible_comments_on_existing_posts": 9,
|
||||
"historical_comments_newly_visible": 7,
|
||||
"newly_visible_comments_created_after_previous_collection": 7,
|
||||
"comment_count_net_change": 14,
|
||||
"metadata_changed_existing_posts": 231,
|
||||
"body_changed_existing_post_ids": [
|
||||
"43320471694999",
|
||||
"43030071187479"
|
||||
],
|
||||
"retained_posts": 758,
|
||||
"retained_comments": 10141,
|
||||
"indexed_posts_including_unavailable": 759,
|
||||
"historical_comments_retained_for_unavailable_posts": 9,
|
||||
"newly_indexed_posts": 89,
|
||||
"newly_indexed_posts_created_after_previous_collection": 72,
|
||||
"historical_posts_newly_indexed": 17,
|
||||
"comments_on_newly_indexed_posts": 9,
|
||||
"newly_visible_comments_on_existing_posts": 540,
|
||||
"historical_comments_newly_visible": 482,
|
||||
"newly_visible_comments_created_after_previous_collection": 67,
|
||||
"comment_count_net_change": 540,
|
||||
"metadata_changed_existing_posts": 329,
|
||||
"body_changed_existing_post_ids": [],
|
||||
"comment_changed_existing_post_ids": [
|
||||
"42302637812503"
|
||||
"37427295710359",
|
||||
"37473718017175",
|
||||
"37759477785239",
|
||||
"37857879534487",
|
||||
"37858237686167",
|
||||
"38120459173143",
|
||||
"38151220803095",
|
||||
"38669179039255",
|
||||
"38767793594775",
|
||||
"39118594803095",
|
||||
"39183798681239",
|
||||
"39215982466071",
|
||||
"39225718749591",
|
||||
"39249078858647",
|
||||
"39304762113815",
|
||||
"39319955780887",
|
||||
"39367839107095",
|
||||
"39567420541079",
|
||||
"39729140385559",
|
||||
"39756841978519",
|
||||
"39845230299927",
|
||||
"39873247817495",
|
||||
"39922788056343",
|
||||
"40031467208983",
|
||||
"40089426663959",
|
||||
"40287368788375",
|
||||
"40373405530647",
|
||||
"40544447671959",
|
||||
"40734437350679",
|
||||
"40734489248151",
|
||||
"40737593669911",
|
||||
"40790666727575",
|
||||
"40847481080087",
|
||||
"40936186021271",
|
||||
"40962462282007",
|
||||
"40964044763031",
|
||||
"41020681850519",
|
||||
"41065497021335",
|
||||
"41138382717719",
|
||||
"41162636720919",
|
||||
"41236357050903",
|
||||
"41318082888343",
|
||||
"41320039211671",
|
||||
"41363895396247",
|
||||
"41391880122007",
|
||||
"41392995550231",
|
||||
"41396933582231",
|
||||
"41397704497303",
|
||||
"41417418697111",
|
||||
"41418196103191",
|
||||
"41420742165527",
|
||||
"41459028441623",
|
||||
"41510344038551",
|
||||
"41540700959639",
|
||||
"41550783184663",
|
||||
"41551045362071",
|
||||
"41551682155799",
|
||||
"41552805539991",
|
||||
"41553665016983",
|
||||
"41556669366551",
|
||||
"41567966789655",
|
||||
"41625263438999",
|
||||
"41651283176855",
|
||||
"41654205318807",
|
||||
"41655387004439",
|
||||
"41684104419095",
|
||||
"41692781472919",
|
||||
"41706827651991",
|
||||
"41719890581911",
|
||||
"41732813691287",
|
||||
"41801462727191",
|
||||
"41804720051607",
|
||||
"41825836449047",
|
||||
"41849925214231",
|
||||
"41854026316055",
|
||||
"41856507417623",
|
||||
"41877348653335",
|
||||
"41877985926423",
|
||||
"41878175264663",
|
||||
"41880799695127",
|
||||
"41881412101399",
|
||||
"41897133795479",
|
||||
"41898002651287",
|
||||
"41898564566167",
|
||||
"41903649174807",
|
||||
"41908323673111",
|
||||
"41909117583383",
|
||||
"41937689411479",
|
||||
"41939959839895",
|
||||
"41949669579031",
|
||||
"41974186627351",
|
||||
"41992899715607",
|
||||
"41993968062743",
|
||||
"41994809192215",
|
||||
"41995369186455",
|
||||
"41995684431767",
|
||||
"42007074836247",
|
||||
"42015743397655",
|
||||
"42018671130391",
|
||||
"42019010387479",
|
||||
"42019332809111",
|
||||
"42019924663319",
|
||||
"42020342676759",
|
||||
"42021244122775",
|
||||
"42021722069143",
|
||||
"42022555985047",
|
||||
"42029118285847",
|
||||
"42045578950551",
|
||||
"42047259261335",
|
||||
"42060935441943",
|
||||
"42061123738903",
|
||||
"42062231758103",
|
||||
"42064544905495",
|
||||
"42064574062359",
|
||||
"42065262268567",
|
||||
"42065802192023",
|
||||
"42078729821591",
|
||||
"42078917602455",
|
||||
"42160836246039",
|
||||
"42160945573271",
|
||||
"42161798745879",
|
||||
"42184733027991",
|
||||
"42185098677399",
|
||||
"42187744015767",
|
||||
"42187906212247",
|
||||
"42211897526295",
|
||||
"42215210781719",
|
||||
"42215740602135",
|
||||
"42216209199255",
|
||||
"42259186135831",
|
||||
"42274443124119",
|
||||
"42302637812503",
|
||||
"42359440646551",
|
||||
"42406158561943",
|
||||
"42407253630359",
|
||||
"42423399281815",
|
||||
"42423993843735",
|
||||
"42455010729367",
|
||||
"42460800447895",
|
||||
"42487308197783",
|
||||
"42509573118999",
|
||||
"42513455206423",
|
||||
"42513832186263",
|
||||
"42519002511767",
|
||||
"42549574041367",
|
||||
"42585946296855",
|
||||
"42587179348119",
|
||||
"42662873714711",
|
||||
"42686571665303",
|
||||
"42691768951447",
|
||||
"42714622464407",
|
||||
"42720875852439",
|
||||
"42721824181271",
|
||||
"42738237663639",
|
||||
"42740521405463",
|
||||
"42743732814999",
|
||||
"42756136847639",
|
||||
"42756641286295",
|
||||
"42757091114647",
|
||||
"42771962021143",
|
||||
"42772611660823",
|
||||
"42774450536343",
|
||||
"42775887653399",
|
||||
"42801904467607",
|
||||
"42945861800983",
|
||||
"42955680180247",
|
||||
"42972530812183",
|
||||
"42975079714839",
|
||||
"42981290349463",
|
||||
"43002825233687",
|
||||
"43006316208151",
|
||||
"43030071187479",
|
||||
"43031425132823",
|
||||
"43031577079575",
|
||||
"43058251853847",
|
||||
"43067045830679",
|
||||
"43085454784535",
|
||||
"43087031637527",
|
||||
"43147371557015",
|
||||
"43151729306647",
|
||||
"43178926004887",
|
||||
"43179521660823",
|
||||
"43179860065303",
|
||||
"43181411147287",
|
||||
"43208281917591",
|
||||
"43269155035799",
|
||||
"43287990820375",
|
||||
"43299585796247",
|
||||
"43309848501783",
|
||||
"43319649278359",
|
||||
"43319751480599",
|
||||
"43320365312023",
|
||||
"43320471694999",
|
||||
"43322521365143",
|
||||
"43322749748503",
|
||||
"43383826751127",
|
||||
"43410200668823",
|
||||
"43411841446423",
|
||||
"43438866840343",
|
||||
"43467733543319",
|
||||
"43477475833623",
|
||||
"43498120902807",
|
||||
"43499065604247",
|
||||
"43500671638551",
|
||||
"43501264459799",
|
||||
"43502970330647",
|
||||
"43508107778711",
|
||||
"43524498271895",
|
||||
"43524503109655",
|
||||
"43527309427863",
|
||||
"43527457608087",
|
||||
"43529198653719",
|
||||
"43529216017047",
|
||||
"43536370604567",
|
||||
"43541109631895",
|
||||
"43556223197335",
|
||||
"43561782887575"
|
||||
],
|
||||
"edited_existing_comments": 0,
|
||||
"missing_existing_comment_ids": 0,
|
||||
"missing_existing_comment_ids_on_visible_posts": 0,
|
||||
"failed_comment_records": 0,
|
||||
"missing_previously_indexed_posts": 0,
|
||||
"posts_cited_in_knowledge": 142,
|
||||
"missing_previously_indexed_posts": 1,
|
||||
"unavailable_posts": [
|
||||
{
|
||||
"post_id": "41208709211671",
|
||||
"direct_api_status": 404,
|
||||
"historical_comments_retained": 9
|
||||
}
|
||||
],
|
||||
"posts_cited_in_knowledge": 154,
|
||||
"groups": {
|
||||
"portfolio": 50,
|
||||
"ai": 154,
|
||||
"ideas": 30,
|
||||
"lessons": 134,
|
||||
"optimization": 62,
|
||||
"data": 20,
|
||||
"events": 41,
|
||||
"engineering": 75,
|
||||
"guides": 8,
|
||||
"general": 96
|
||||
"guides": 17,
|
||||
"ai": 160,
|
||||
"ideas": 40,
|
||||
"engineering": 86,
|
||||
"general": 137,
|
||||
"lessons": 141,
|
||||
"optimization": 65,
|
||||
"events": 42,
|
||||
"portfolio": 51,
|
||||
"data": 20
|
||||
},
|
||||
"new_post_texts_screened": 40,
|
||||
"new_post_texts_screened": 89,
|
||||
"metadata_only_post_ids": [
|
||||
"43287990820375"
|
||||
],
|
||||
"new_or_newly_visible_comments_read": 14,
|
||||
"official_articles_checked": [
|
||||
{
|
||||
"id": "41681208900759",
|
||||
"updated_at": "2026-09-13T15:38:21Z",
|
||||
"read_at": "2026-09-18"
|
||||
}
|
||||
],
|
||||
"new_or_newly_visible_comments_screened": 549,
|
||||
"official_articles_checked": [],
|
||||
"baseline_state_directory": ".local/forum-sync/",
|
||||
"limits": [
|
||||
"Newly visible records can predate the previous run; cause of historical visibility gaps is unknown.",
|
||||
"One new post is image-only and its body has not been visually reviewed; other images and attachments not fully verified.",
|
||||
"Community backtest claims not reproduced; code findings are static, not live platform tests.",
|
||||
"No simulations, submissions, email sync, public publishing, or credential/session persistence.",
|
||||
"Comment fingerprints cover normalized text only, not link destinations, formatting, or embedded media changes."
|
||||
],
|
||||
"unread_media": [
|
||||
{
|
||||
"post_id": "43287990820375",
|
||||
"image_count": 12,
|
||||
"images_retried_this_run": 1,
|
||||
"http_status": 403
|
||||
}
|
||||
],
|
||||
"limits": [
|
||||
"758 currently visible posts and 10141 freshly retrieved comments; indexes additionally retain one unavailable post with nine historical comments.",
|
||||
"One previously indexed post returned HTTP 404; its previous fingerprint and records are retained for retry, not deleted or marked freshly complete.",
|
||||
"Newly visible historical posts/comments are backfill; the reason for prior visibility gaps is unknown.",
|
||||
"One image-only post remains unread; one of its twelve official images was retried and returned HTTP 403.",
|
||||
"Comment fingerprints cover normalized text only, not link targets, formatting or media-only changes.",
|
||||
"Community claims and code were reviewed but not executed or backtested; no current platform rules were inferred from comments.",
|
||||
"No email sync, simulation, external publication, submission, credential/session persistence or Git commit/push."
|
||||
]
|
||||
},
|
||||
"forum_sync_history": [
|
||||
@@ -150,6 +370,78 @@
|
||||
"All scoped comments fetched, selective historical body reading; images and attachments not fully verified.",
|
||||
"No simulations, submissions, email sync, public publishing, or credential/session persistence."
|
||||
]
|
||||
},
|
||||
{
|
||||
"collected_at": "2026-09-18",
|
||||
"timezone": "Asia/Shanghai",
|
||||
"started_at": "2026-09-18T02:11:39.967012+00:00",
|
||||
"collection_finished_at": "2026-09-18T02:16:36.188053+00:00",
|
||||
"previous_successful_collection_finished_at": "2026-09-11T01:06:33.369594+00:00",
|
||||
"raw_visible_posts": 1771,
|
||||
"raw_list_pages": 18,
|
||||
"excluded_older_posts": 1101,
|
||||
"retained_posts": 670,
|
||||
"retained_comments": 9601,
|
||||
"newly_indexed_posts": 41,
|
||||
"newly_indexed_posts_created_after_previous_collection": 29,
|
||||
"historical_posts_newly_indexed": 12,
|
||||
"comments_on_newly_indexed_posts": 5,
|
||||
"newly_visible_comments_on_existing_posts": 9,
|
||||
"historical_comments_newly_visible": 7,
|
||||
"newly_visible_comments_created_after_previous_collection": 7,
|
||||
"comment_count_net_change": 14,
|
||||
"metadata_changed_existing_posts": 231,
|
||||
"body_changed_existing_post_ids": [
|
||||
"43320471694999",
|
||||
"43030071187479"
|
||||
],
|
||||
"comment_changed_existing_post_ids": [
|
||||
"42302637812503"
|
||||
],
|
||||
"edited_existing_comments": 0,
|
||||
"missing_existing_comment_ids": 0,
|
||||
"failed_comment_records": 0,
|
||||
"missing_previously_indexed_posts": 0,
|
||||
"posts_cited_in_knowledge": 142,
|
||||
"groups": {
|
||||
"portfolio": 50,
|
||||
"ai": 154,
|
||||
"ideas": 30,
|
||||
"lessons": 134,
|
||||
"optimization": 62,
|
||||
"data": 20,
|
||||
"events": 41,
|
||||
"engineering": 75,
|
||||
"guides": 8,
|
||||
"general": 96
|
||||
},
|
||||
"new_post_texts_screened": 40,
|
||||
"metadata_only_post_ids": [
|
||||
"43287990820375"
|
||||
],
|
||||
"new_or_newly_visible_comments_read": 14,
|
||||
"official_articles_checked": [
|
||||
{
|
||||
"id": "41681208900759",
|
||||
"updated_at": "2026-09-13T15:38:21Z",
|
||||
"read_at": "2026-09-18"
|
||||
}
|
||||
],
|
||||
"baseline_state_directory": ".local/forum-sync/",
|
||||
"limits": [
|
||||
"Newly visible records can predate the previous run; cause of historical visibility gaps is unknown.",
|
||||
"One new post is image-only and its body has not been visually reviewed; other images and attachments not fully verified.",
|
||||
"Community backtest claims not reproduced; code findings are static, not live platform tests.",
|
||||
"No simulations, submissions, email sync, public publishing, or credential/session persistence.",
|
||||
"Comment fingerprints cover normalized text only, not link destinations, formatting, or embedded media changes."
|
||||
],
|
||||
"unread_media": [
|
||||
{
|
||||
"post_id": "43287990820375",
|
||||
"image_count": 12,
|
||||
"http_status": 403
|
||||
}
|
||||
]
|
||||
}
|
||||
]
|
||||
}
|
||||
|
||||
File diff suppressed because it is too large
Load Diff
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user