{"components":[{"slug":"41-open-source-llms-evaluated-on-19-benchmarks","name":"41 Open-Source LLMs Evaluated on 19 Benchmarks","summary":"A repository of local benchmark evaluations comparing 41 open-source large language models across 19 tasks, with rankings, scripts, notebooks, results, and utilization logs.","publisher":"jayminbhan","homepage":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","kind":"eval","hasApi":false,"hasMcp":false,"costRange":"unknown","costNotes":"Pricing is not stated. Evaluations were performed locally on a personal computer, and compute costs are not provided.","functions":["rank","search","evaluate","generate","reason"],"slices":[{"functionId":"evaluate","label":"LLM benchmark evaluation","note":"Evaluates open-source language models across reasoning, math, commonsense, natural-language inference, knowledge, and reading tasks using lm-evaluation-harness.","cost":"Unknown"},{"functionId":"rank","label":"Model leaderboard ranking","note":"Provides overall and category rankings calculated from task scores, including mean scores and runtime fields.","cost":"Unknown"},{"functionId":"search","label":"search","note":"Inferred from executor","cost":"Unknown"},{"functionId":"generate","label":"generate","note":"Inferred from executor","cost":"Unknown"},{"functionId":"reason","label":"reason","note":"Inferred from executor","cost":"Unknown"}],"interfaces":[],"composabilityRationale":"The repository provides scripts, notebooks, CSV and Excel tables, JSON results, stdout logs, and GPU utilization logs that can serve as static evaluation artifacts. The page does not state an API or MCP interface.","signals":[],"functionProbabilities":[{"functionId":"rank","value":0.8,"source":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","method":"lexical","observedAt":"2026-11-04T06:16:15.272Z"},{"functionId":"search","value":0.8,"source":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","method":"lexical","observedAt":"2026-11-04T06:16:15.272Z"},{"functionId":"evaluate","value":0.72,"source":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","method":"lexical","observedAt":"2026-11-04T06:16:15.272Z"},{"functionId":"generate","value":0.72,"source":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","method":"lexical","observedAt":"2026-11-04T06:16:15.272Z"},{"functionId":"reason","value":0.72,"source":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","method":"lexical","observedAt":"2026-11-04T06:16:15.272Z"}],"claimVerification":[{"key":"mcp","status":"unverified","asserted":"false","evidenceSource":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","method":"fallback"},{"key":"api","status":"unverified","asserted":"false","evidenceSource":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","method":"fallback"},{"key":"cost","status":"unverified","asserted":"unknown","evidenceSource":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","method":"fallback"},{"key":"license","status":"unverified","asserted":"","evidenceSource":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","method":"fallback"}],"tweets":[],"notes":[],"origin":"intake","createdAt":"2026-11-04T06:16:18.195Z","updatedAt":"2026-11-04T06:16:18.195Z","sources":[{"kind":"web","label":"executor","url":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","excerpt":"BranchesTags\n\n## Latest commit\n\n## History\n\n20 Commits\n\n## Folders and files\n\n| Name | | Name | Last commit message | Last commit date |\n| --- | --- | --- | --- | --- |\n\n## Repository files navigation\n\n# 41 Open-Source LLMs Evaluated on 19 ","at":"2026-11-04T06:16:18.195Z"}],"recordId":"cmp_41-open-source-llms-evaluated-on-19-benchmarks","claims":{"name":"41 Open-Source LLMs Evaluated on 19 Benchmarks","summary":"A repository of local benchmark evaluations comparing 41 open-source large language models across 19 tasks, with rankings, scripts, notebooks, results, and utilization logs.","kind":"eval","publisher":"jayminbhan","homepage":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","costRange":"unknown","costNotes":"Pricing is not stated. Evaluations were performed locally on a personal computer, and compute costs are not provided.","functions":["rank","search","evaluate","generate","reason"],"slices":[{"functionId":"evaluate","label":"LLM benchmark evaluation","note":"Evaluates open-source language models across reasoning, math, commonsense, natural-language inference, knowledge, and reading tasks using lm-evaluation-harness.","cost":"Unknown"},{"functionId":"rank","label":"Model leaderboard ranking","note":"Provides overall and category rankings calculated from task scores, including mean scores and runtime fields.","cost":"Unknown"},{"functionId":"search","label":"search","note":"Inferred from executor","cost":"Unknown"},{"functionId":"generate","label":"generate","note":"Inferred from executor","cost":"Unknown"},{"functionId":"reason","label":"reason","note":"Inferred from executor","cost":"Unknown"}],"interfaces":[],"composabilityRationale":"The repository provides scripts, notebooks, CSV and Excel tables, JSON results, stdout logs, and GPU utilization logs that can serve as static evaluation artifacts. The page does not state an API or MCP interface."},"relations":[{"from":"41-open-source-llms-evaluated-on-19-benchmarks","to":"minimax","kind":"fills-same-slot-as","note":"Shared functions generate, reason. Can fill the same function slot."},{"from":"41-open-source-llms-evaluated-on-19-benchmarks","to":"grok-xai","kind":"fills-same-slot-as","note":"Shared functions generate, reason, search. Can fill the same function slot."},{"from":"41-open-source-llms-evaluated-on-19-benchmarks","to":"alibaba-model-studio","kind":"fills-same-slot-as","note":"Shared functions generate, reason. Can fill the same function slot."},{"from":"41-open-source-llms-evaluated-on-19-benchmarks","to":"byteplus-modelark","kind":"fills-same-slot-as","note":"Shared functions generate, reason. Can fill the same function slot."},{"from":"41-open-source-llms-evaluated-on-19-benchmarks","to":"hunter","kind":"fills-same-slot-as","note":"Shared functions evaluate, search. Can fill the same function slot."},{"from":"41-open-source-llms-evaluated-on-19-benchmarks","to":"typesafe-jev","kind":"fills-same-slot-as","note":"Shared functions evaluate, reason. Can fill the same function slot."},{"from":"41-open-source-llms-evaluated-on-19-benchmarks","to":"toloka","kind":"fills-same-slot-as","note":"Shared functions evaluate, generate. Can fill the same function slot."},{"from":"41-open-source-llms-evaluated-on-19-benchmarks","to":"kogiqa-mcp-web-browser","kind":"fills-same-slot-as","note":"Shared functions generate, search. Can fill the same function slot."}],"explain":{"score":3,"formula":"100 × sum(weight × value) over observed factors only. Unobserved factors are omitted, not zeroed.","factors":[{"id":"github_health","label":"GitHub health","weight":0.18,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"agent_use","label":"Agent use","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"human_notes","label":"Human notes","weight":0.14,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"composability","label":"Composability","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"checklist","label":"Checklist","weight":0.1,"value":0,"contribution":0,"why":"No MCP surface is declared. No API is declared. Cost is unknown. 0 of 3 checklist fields are complete.","sources":[],"evidence":"observed"},{"id":"evidence_quality","label":"Evidence quality","weight":0.14,"value":0.18107144632819594,"contribution":0.025350002485947435,"why":"1 sources cover 1 evidence types. The latest dated evidence is 2026-11-04. Freshness is omitted unless observed as a signal.","sources":[{"kind":"web","label":"executor","url":"https://github.com/jayminbhan/41-llms-evaluated-on-19-benchmarks","excerpt":"BranchesTags\n\n## Latest commit\n\n## History\n\n20 Commits\n\n## Folders and files\n\n| Name | | Name | Last commit message | Last commit date |\n| --- | --- | --- | --- | --- |\n\n## Repository files navigation\n\n# 41 Open-Source LLMs Evaluated on 19 ","at":"2026-11-04T06:16:18.195Z"}],"evidence":"observed"},{"id":"benchmark","label":"Benchmarks","weight":0.12,"why":"insufficient evidence","sources":[],"evidence":"insufficient"}],"missing":["GitHub health: insufficient evidence","Agent use: insufficient evidence","Human notes: insufficient evidence","Composability: insufficient evidence","Benchmarks: insufficient evidence"]},"score":3},{"slug":"langsmith","name":"LangSmith","summary":"Tracing and evals for LLM apps. Observe and evaluate slices that feed Score later.","kind":"eval","homepage":"https://www.langchain.com/langsmith","docsUrl":"https://docs.smith.langchain.com","publisher":"LangChain","license":"proprietary","hasMcp":false,"hasApi":true,"costRange":"freemium","composabilityRationale":"API for traces and datasets. Ties to LangChain can over-box the slice; the eval plane is the useful part.","functions":["observe","evaluate","monitor"],"slices":[{"functionId":"evaluate","label":"Dataset evals","note":"Score a category of runs","cost":"freemium"},{"functionId":"observe","label":"Observe","note":"Tracing and evals for LLM apps. Observe and evaluate slices that feed Score later.","cost":"freemium"},{"functionId":"monitor","label":"Monitor","note":"Tracing and evals for LLM apps. Observe and evaluate slices that feed Score later.","cost":"freemium"}],"tweets":[],"sources":[{"kind":"docs","label":"LangSmith docs","url":"https://docs.smith.langchain.com","at":"2026-09-12T00:00:00Z"}],"origin":"seed","sector":"eval-bench","notes":[],"score":15,"explain":{"score":15,"formula":"100 × sum(weight × value) over observed factors only. Unobserved factors are omitted, not zeroed.","factors":[{"id":"github_health","label":"GitHub health","weight":0.18,"value":0.3,"contribution":0.054,"why":"A licence is declared. Documentation is available.","sources":[],"evidence":"observed"},{"id":"agent_use","label":"Agent use","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"human_notes","label":"Human notes","weight":0.14,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"composability","label":"Composability","weight":0.16,"why":"insufficient evidence","sources":[{"kind":"docs","label":"LangSmith docs","url":"https://docs.smith.langchain.com","at":"2026-09-12T00:00:00Z"}],"evidence":"insufficient"},{"id":"checklist","label":"Checklist","weight":0.1,"value":0.6666666666666666,"contribution":0.06666666666666667,"why":"No MCP surface is declared. An API is declared. Cost is freemium. 2 of 3 checklist fields are complete.","sources":[{"kind":"docs","label":"LangSmith docs","url":"https://docs.smith.langchain.com","at":"2026-09-12T00:00:00Z"}],"evidence":"observed"},{"id":"evidence_quality","label":"Evidence quality","weight":0.14,"value":0.18107144632819594,"contribution":0.025350002485947435,"why":"1 sources cover 1 evidence types. The latest dated evidence is 2026-09-12. Freshness is omitted unless observed as a signal.","sources":[{"kind":"docs","label":"LangSmith docs","url":"https://docs.smith.langchain.com","at":"2026-09-12T00:00:00Z"}],"evidence":"observed"},{"id":"benchmark","label":"Benchmarks","weight":0.12,"why":"insufficient evidence","sources":[],"evidence":"insufficient"}],"missing":["Agent use: insufficient evidence","Human notes: insufficient evidence","Composability: insufficient evidence","Benchmarks: insufficient evidence"]},"createdAt":"2026-09-11T16:33:39.690Z","updatedAt":"2026-09-13T08:56:02.857Z","recordId":"cmp_langsmith","claims":{"name":"LangSmith","summary":"Tracing and evals for LLM apps. Observe and evaluate slices that feed Score later.","kind":"eval","publisher":"LangChain","homepage":"https://www.langchain.com/langsmith","docsUrl":"https://docs.smith.langchain.com","license":"proprietary","costRange":"freemium","functions":["observe","evaluate","monitor"],"slices":[{"functionId":"evaluate","label":"Dataset evals","note":"Score a category of runs","cost":"freemium"},{"functionId":"observe","label":"Observe","note":"Tracing and evals for LLM apps. Observe and evaluate slices that feed Score later.","cost":"freemium"},{"functionId":"monitor","label":"Monitor","note":"Tracing and evals for LLM apps. Observe and evaluate slices that feed Score later.","cost":"freemium"}],"interfaces":[{"kind":"http"}],"composabilityRationale":"API for traces and datasets. Ties to LangChain can over-box the slice; the eval plane is the useful part."},"interfaces":[{"kind":"http"}],"relations":[{"from":"langsmith","to":"toloka","kind":"fills-same-slot-as","note":"Shared functions evaluate, observe. Can fill the same function slot."}],"signals":[{"key":"has_license","value":1,"source":"component-record","method":"declared-license","observedAt":"2026-09-13T08:56:02.857Z"},{"key":"has_docs","value":1,"source":"component-record","method":"declared-docs","observedAt":"2026-09-13T08:56:02.857Z"}],"functionProbabilities":[],"claimVerification":[]},{"slug":"awesome","name":"awesome","summary":"139 lines (106 loc) · 17.5 KB","publisher":"github.com","homepage":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","kind":"eval","hasApi":true,"hasMcp":true,"costRange":"unknown","costNotes":"Unknown: pricing was not stated in the intake evidence.","functions":["memory","code","evaluate","index","policy","search","store","compose","connect"],"slices":[{"functionId":"memory","label":"memory","note":"Inferred from executor","cost":"Unknown"},{"functionId":"code","label":"code","note":"Inferred from executor","cost":"Unknown"},{"functionId":"evaluate","label":"evaluate","note":"Inferred from executor","cost":"Unknown"},{"functionId":"index","label":"index","note":"Inferred from executor","cost":"Unknown"},{"functionId":"policy","label":"policy","note":"Inferred from executor","cost":"Unknown"},{"functionId":"search","label":"search","note":"Inferred from executor","cost":"Unknown"},{"functionId":"store","label":"store","note":"Inferred from executor","cost":"Unknown"},{"functionId":"compose","label":"compose","note":"Inferred from executor","cost":"Unknown"},{"functionId":"connect","label":"Connect","note":"139 lines (106 loc) · 17.5 KB","cost":"unknown"}],"interfaces":[{"kind":"mcp"},{"kind":"http"}],"composabilityRationale":"Heuristic from executor evidence. Grok pass was unavailable or incomplete. No usage metrics were observed.","signals":[],"functionProbabilities":[{"functionId":"memory","value":0.92,"source":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"lexical","observedAt":"2026-10-15T16:29:31.900Z"},{"functionId":"code","value":0.8,"source":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"lexical","observedAt":"2026-10-15T16:29:31.900Z"},{"functionId":"evaluate","value":0.8,"source":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"lexical","observedAt":"2026-10-15T16:29:31.900Z"},{"functionId":"index","value":0.8,"source":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"lexical","observedAt":"2026-10-15T16:29:31.900Z"},{"functionId":"policy","value":0.8,"source":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"lexical","observedAt":"2026-10-15T16:29:31.900Z"},{"functionId":"search","value":0.8,"source":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"lexical","observedAt":"2026-10-15T16:29:31.900Z"},{"functionId":"store","value":0.8,"source":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"lexical","observedAt":"2026-10-15T16:29:31.900Z"},{"functionId":"compose","value":0.72,"source":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"lexical","observedAt":"2026-10-15T16:29:31.900Z"},{"functionId":"connect","value":0.72,"source":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"lexical","observedAt":"2026-10-15T16:29:31.900Z"},{"functionId":"retrieve","value":0.72,"source":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"lexical","observedAt":"2026-10-15T16:29:31.900Z"},{"functionId":"tool-call","value":0.72,"source":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"lexical","observedAt":"2026-10-15T16:29:31.900Z"}],"claimVerification":[{"key":"mcp","status":"unverified","asserted":"true","evidenceSource":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"fallback"},{"key":"api","status":"unverified","asserted":"true","evidenceSource":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"fallback"},{"key":"cost","status":"unverified","asserted":"unknown","evidenceSource":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"fallback"},{"key":"license","status":"unverified","asserted":"","evidenceSource":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","method":"fallback"}],"tweets":[],"notes":[],"origin":"intake","createdAt":"2026-10-15T16:29:32.774Z","updatedAt":"2026-10-15T16:29:32.774Z","sources":[{"kind":"web","label":"executor","url":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","excerpt":"##\n\n# README.md\n\n## Latest commit\n\n## History\n\nHistory\n\n139 lines (106 loc) · 17.5 KB\n\n# README.md\n\n## File metadata and controls\n\n139 lines (106 loc) · 17.5 KB\n\nRaw\n\n# Awesome Company Brain\n\n> Give every AI agent your company context.\n\nA c","at":"2026-10-15T16:29:32.774Z"}],"recordId":"cmp_awesome","claims":{"name":"awesome","summary":"139 lines (106 loc) · 17.5 KB","kind":"eval","publisher":"github.com","homepage":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","costRange":"unknown","costNotes":"Unknown: pricing was not stated in the intake evidence.","functions":["memory","code","evaluate","index","policy","search","store","compose","connect"],"slices":[{"functionId":"memory","label":"memory","note":"Inferred from executor","cost":"Unknown"},{"functionId":"code","label":"code","note":"Inferred from executor","cost":"Unknown"},{"functionId":"evaluate","label":"evaluate","note":"Inferred from executor","cost":"Unknown"},{"functionId":"index","label":"index","note":"Inferred from executor","cost":"Unknown"},{"functionId":"policy","label":"policy","note":"Inferred from executor","cost":"Unknown"},{"functionId":"search","label":"search","note":"Inferred from executor","cost":"Unknown"},{"functionId":"store","label":"store","note":"Inferred from executor","cost":"Unknown"},{"functionId":"compose","label":"compose","note":"Inferred from executor","cost":"Unknown"},{"functionId":"connect","label":"Connect","note":"139 lines (106 loc) · 17.5 KB","cost":"unknown"}],"interfaces":[{"kind":"mcp"},{"kind":"http"}],"composabilityRationale":"Heuristic from executor evidence. Grok pass was unavailable or incomplete. No usage metrics were observed."},"relations":[{"from":"awesome","to":"memini","kind":"fills-same-slot-as","note":"Shared functions code, compose, connect, memory, policy, search, store. Can fill the same function slot."},{"from":"awesome","to":"local-faiss-mcp-server","kind":"fills-same-slot-as","note":"Shared functions code, connect, index, memory, search, store. Can fill the same function slot."},{"from":"awesome","to":"casdoor","kind":"fills-same-slot-as","note":"Shared functions code, compose, connect, policy, search. Can fill the same function slot."},{"from":"awesome","to":"self","kind":"fills-same-slot-as","note":"Shared functions code, compose, connect, index, search. Can fill the same function slot."},{"from":"awesome","to":"lore","kind":"fills-same-slot-as","note":"Shared functions connect, evaluate, memory, search, store. Can fill the same function slot."},{"from":"awesome","to":"agentmemory","kind":"fills-same-slot-as","note":"Shared functions code, connect, memory. Can fill the same function slot."},{"from":"awesome","to":"invisible-playwright-mcp","kind":"fills-same-slot-as","note":"Shared functions code, connect, policy, search. Can fill the same function slot."},{"from":"awesome","to":"tinyfish-search-api","kind":"fills-same-slot-as","note":"Shared functions code, compose, search, store. Can fill the same function slot."}],"explain":{"score":9,"formula":"100 × sum(weight × value) over observed factors only. Unobserved factors are omitted, not zeroed.","factors":[{"id":"github_health","label":"GitHub health","weight":0.18,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"agent_use","label":"Agent use","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"human_notes","label":"Human notes","weight":0.14,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"composability","label":"Composability","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"checklist","label":"Checklist","weight":0.1,"value":0.6666666666666666,"contribution":0.06666666666666667,"why":"An MCP surface is declared. An API is declared. Cost is unknown. 2 of 3 checklist fields are complete.","sources":[],"evidence":"observed"},{"id":"evidence_quality","label":"Evidence quality","weight":0.14,"value":0.18107144632819594,"contribution":0.025350002485947435,"why":"1 sources cover 1 evidence types. The latest dated evidence is 2026-10-15. Freshness is omitted unless observed as a signal.","sources":[{"kind":"web","label":"executor","url":"https://github.com/gurusup/awesome-company-brain/blob/main/README.md","excerpt":"##\n\n# README.md\n\n## Latest commit\n\n## History\n\nHistory\n\n139 lines (106 loc) · 17.5 KB\n\n# README.md\n\n## File metadata and controls\n\n139 lines (106 loc) · 17.5 KB\n\nRaw\n\n# Awesome Company Brain\n\n> Give every AI agent your company context.\n\nA c","at":"2026-10-15T16:29:32.774Z"}],"evidence":"observed"},{"id":"benchmark","label":"Benchmarks","weight":0.12,"why":"insufficient evidence","sources":[],"evidence":"insufficient"}],"missing":["GitHub health: insufficient evidence","Agent use: insufficient evidence","Human notes: insufficient evidence","Composability: insufficient evidence","Benchmarks: insufficient evidence"]},"score":9},{"slug":"toloka","name":"Toloka","summary":"Human-in-the-loop training data, RL environments, and evaluation for AI agents and LLMs.","kind":"resource","homepage":"https://toloka.ai","publisher":"Toloka","hasMcp":false,"hasApi":true,"costRange":"enterprise","composabilityRationale":"Toloka is a data and evaluation vendor, not an agent runtime; it feeds training and eval loops rather than composing as an in-agent tool.","functions":["evaluate","classify","generate","observe"],"slices":[{"functionId":"evaluate","label":"RL environments and model evaluation","note":"Complex multi-step RL environments used to test and improve agent behavior."},{"functionId":"classify","label":"Human annotation and labeling","note":"Expert labeling and annotation for training and safety datasets."},{"functionId":"generate","label":"Training data generation","note":"Human-plus-tech pipelines that produce agentic, coding, and safety data."},{"functionId":"observe","label":"Human expertise feedback","note":"Expert review that surfaces model failure modes and improvement signals."}],"tweets":[],"sources":[{"kind":"web","label":"web","url":"https://toloka.ai","excerpt":"Apr 15, 2026 — The definitive list: 20 production-ready MCP servers across developer tools, productivity, data, search, design, SEO, and human expertise ...","at":"2026-09-11T16:37:36.852Z"},{"kind":"crawl","label":"TinyFish fetch","url":"https://toloka.ai","excerpt":"# Training data for AI agents and LLMs\n\nFrom agentic skills to coding and AI safety — we build data solutions integrating human expertise and technology to accelerate AI development.\n\nTalk to an expert\n\nTrusted by Leading AI Teams\n\n# What o","at":"2026-09-11T16:37:36.853Z"}],"origin":"intake","notes":[{"authorKind":"agent","body":"Intake via web.","at":"2026-09-11T16:37:36.853Z"}],"costNotes":"Enterprise data-collection engagements; no public self-serve MCP or list pricing on the homepage evidence.","score":12,"explain":{"score":12,"formula":"100 × sum(weight × value) over observed factors only. Unobserved factors are omitted, not zeroed.","factors":[{"id":"github_health","label":"GitHub health","weight":0.18,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"agent_use","label":"Agent use","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"human_notes","label":"Human notes","weight":0.14,"value":0.0867528411160754,"contribution":0.012145397756250557,"why":"1 stored human notes (component-record).","sources":[],"evidence":"observed"},{"id":"composability","label":"Composability","weight":0.16,"why":"insufficient evidence","sources":[{"kind":"crawl","label":"TinyFish fetch","url":"https://toloka.ai","excerpt":"# Training data for AI agents and LLMs\n\nFrom agentic skills to coding and AI safety — we build data solutions integrating human expertise and technology to accelerate AI development.\n\nTalk to an expert\n\nTrusted by Leading AI Teams\n\n# What o","at":"2026-09-11T16:37:36.853Z"}],"evidence":"insufficient"},{"id":"checklist","label":"Checklist","weight":0.1,"value":0.6666666666666666,"contribution":0.06666666666666667,"why":"No MCP surface is declared. An API is declared. Cost is enterprise. 2 of 3 checklist fields are complete.","sources":[{"kind":"crawl","label":"TinyFish fetch","url":"https://toloka.ai","excerpt":"# Training data for AI agents and LLMs\n\nFrom agentic skills to coding and AI safety — we build data solutions integrating human expertise and technology to accelerate AI development.\n\nTalk to an expert\n\nTrusted by Leading AI Teams\n\n# What o","at":"2026-09-11T16:37:36.853Z"}],"evidence":"observed"},{"id":"evidence_quality","label":"Evidence quality","weight":0.14,"value":0.3284952023094184,"contribution":0.04598932832331858,"why":"2 sources cover 2 evidence types. The latest dated evidence is 2026-09-11. Freshness is omitted unless observed as a signal.","sources":[{"kind":"web","label":"web","url":"https://toloka.ai","excerpt":"Apr 15, 2026 — The definitive list: 20 production-ready MCP servers across developer tools, productivity, data, search, design, SEO, and human expertise ...","at":"2026-09-11T16:37:36.852Z"},{"kind":"crawl","label":"TinyFish fetch","url":"https://toloka.ai","excerpt":"# Training data for AI agents and LLMs\n\nFrom agentic skills to coding and AI safety — we build data solutions integrating human expertise and technology to accelerate AI development.\n\nTalk to an expert\n\nTrusted by Leading AI Teams\n\n# What o","at":"2026-09-11T16:37:36.853Z"}],"evidence":"observed"},{"id":"benchmark","label":"Benchmarks","weight":0.12,"why":"insufficient evidence","sources":[],"evidence":"insufficient"}],"missing":["GitHub health: insufficient evidence","Agent use: insufficient evidence","Composability: insufficient evidence","Benchmarks: insufficient evidence"]},"createdAt":"2026-09-11T16:37:36.854Z","updatedAt":"2026-09-13T08:56:02.862Z","tags":["agents"],"recordId":"cmp_toloka","claims":{"name":"Toloka","summary":"Human-in-the-loop training data, RL environments, and evaluation for AI agents and LLMs.","kind":"resource","publisher":"Toloka","homepage":"https://toloka.ai","costRange":"enterprise","costNotes":"Enterprise data-collection engagements; no public self-serve MCP or list pricing on the homepage evidence.","functions":["evaluate","classify","generate","observe"],"slices":[{"functionId":"evaluate","label":"RL environments and model evaluation","note":"Complex multi-step RL environments used to test and improve agent behavior."},{"functionId":"classify","label":"Human annotation and labeling","note":"Expert labeling and annotation for training and safety datasets."},{"functionId":"generate","label":"Training data generation","note":"Human-plus-tech pipelines that produce agentic, coding, and safety data."},{"functionId":"observe","label":"Human expertise feedback","note":"Expert review that surfaces model failure modes and improvement signals."}],"interfaces":[{"kind":"http"}],"composabilityRationale":"Toloka is a data and evaluation vendor, not an agent runtime; it feeds training and eval loops rather than composing as an in-agent tool."},"interfaces":[{"kind":"http"}],"relations":[{"from":"toloka","to":"langsmith","kind":"fills-same-slot-as","note":"Shared functions evaluate, observe. Can fill the same function slot."},{"from":"toloka","to":"openrouter","kind":"fills-same-slot-as","note":"Shared functions generate, observe. Can fill the same function slot."},{"from":"toloka","to":"typesafe-jev","kind":"fills-same-slot-as","note":"Shared functions classify, evaluate. Can fill the same function slot."},{"from":"toloka","to":"41-open-source-llms-evaluated-on-19-benchmarks","kind":"fills-same-slot-as","note":"Shared functions evaluate, generate. Can fill the same function slot."}],"signals":[{"key":"human_note_count","value":1,"source":"component-record","method":"stored-notes","observedAt":"2026-09-13T08:56:02.862Z"}],"functionProbabilities":[],"claimVerification":[]},{"slug":"hunter","name":"Hunter","publisher":"Hunter","kind":"app","summary":"Searches business contacts and domains, finds and verifies email addresses, and enriches records.","homepage":"https://hunter.io/","docsUrl":"https://hunter.io/api-documentation/v2","functions":["search","enrich","evaluate"],"costRange":"unknown","recordId":"cmp_hunter","hasMcp":true,"hasApi":true,"costNotes":"API key and endpoint-specific credits or access are required; data accuracy was not measured.","composabilityRationale":"Use its declared http, mcp surface for the listed capability slices. Source review does not establish integration success or observed usage.","interfaces":[{"kind":"http","specUrl":"https://hunter.io/api-documentation/v2"},{"kind":"mcp","specUrl":"https://hunter.io/api-documentation/v2"}],"origin":"intake","tweets":[],"notes":[],"sources":[{"kind":"docs","label":"Hunter official documentation","url":"https://hunter.io/api-documentation/v2","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"}],"slices":[{"functionId":"search","label":"Search","note":"API key and endpoint-specific credits or access are required; data accuracy was not measured.","cost":"unknown"},{"functionId":"enrich","label":"Enrich","note":"API key and endpoint-specific credits or access are required; data accuracy was not measured.","cost":"unknown"},{"functionId":"evaluate","label":"Evaluate","note":"API key and endpoint-specific credits or access are required; data accuracy was not measured.","cost":"unknown"}],"claims":{"name":"Hunter","summary":"Searches business contacts and domains, finds and verifies email addresses, and enriches records.","kind":"app","publisher":"Hunter","homepage":"https://hunter.io/","docsUrl":"https://hunter.io/api-documentation/v2","costRange":"unknown","costNotes":"API key and endpoint-specific credits or access are required; data accuracy was not measured.","functions":["search","enrich","evaluate"],"slices":[{"functionId":"search","label":"Search","note":"API key and endpoint-specific credits or access are required; data accuracy was not measured.","cost":"unknown"},{"functionId":"enrich","label":"Enrich","note":"API key and endpoint-specific credits or access are required; data accuracy was not measured.","cost":"unknown"},{"functionId":"evaluate","label":"Evaluate","note":"API key and endpoint-specific credits or access are required; data accuracy was not measured.","cost":"unknown"}],"interfaces":[{"kind":"http","specUrl":"https://hunter.io/api-documentation/v2"},{"kind":"mcp","specUrl":"https://hunter.io/api-documentation/v2"}],"composabilityRationale":"Use its declared http, mcp surface for the listed capability slices. Source review does not establish integration success or observed usage."},"relations":[{"from":"hunter","to":"contactout","kind":"alternative-to","note":"Shared functions enrich, search. Same kind and overlapping capability."},{"from":"hunter","to":"akta-pro","kind":"alternative-to","note":"Shared functions enrich, search. Same kind and overlapping capability."},{"from":"hunter","to":"apollo","kind":"alternative-to","note":"Shared functions enrich, search. Same kind and overlapping capability."},{"from":"hunter","to":"crunchbase","kind":"alternative-to","note":"Shared functions enrich, search. Same kind and overlapping capability."},{"from":"hunter","to":"ploid","kind":"alternative-to","note":"Shared functions enrich, search. Same kind and overlapping capability."},{"from":"hunter","to":"tendata","kind":"alternative-to","note":"Shared functions enrich, search. Same kind and overlapping capability."},{"from":"hunter","to":"anyapi","kind":"fills-same-slot-as","note":"Shared functions enrich, search. Can fill the same function slot."},{"from":"hunter","to":"context-dev","kind":"fills-same-slot-as","note":"Shared functions enrich, search. Can fill the same function slot."}],"signals":[],"functionProbabilities":[],"claimVerification":[],"explain":{"score":9,"formula":"100 × sum(weight × value) over observed factors only. Unobserved factors are omitted, not zeroed.","factors":[{"id":"github_health","label":"GitHub health","weight":0.18,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"agent_use","label":"Agent use","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"human_notes","label":"Human notes","weight":0.14,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"composability","label":"Composability","weight":0.16,"why":"insufficient evidence","sources":[{"kind":"docs","label":"Hunter official documentation","url":"https://hunter.io/api-documentation/v2","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"}],"evidence":"insufficient"},{"id":"checklist","label":"Checklist","weight":0.1,"value":0.6666666666666666,"contribution":0.06666666666666667,"why":"An MCP surface is declared. An API is declared. Cost is unknown. 2 of 3 checklist fields are complete.","sources":[{"kind":"docs","label":"Hunter official documentation","url":"https://hunter.io/api-documentation/v2","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"}],"evidence":"observed"},{"id":"evidence_quality","label":"Evidence quality","weight":0.14,"value":0.18107144632819594,"contribution":0.025350002485947435,"why":"1 sources cover 1 evidence types. The latest dated evidence is undated. Freshness is omitted unless observed as a signal.","sources":[{"kind":"docs","label":"Hunter official documentation","url":"https://hunter.io/api-documentation/v2","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"}],"evidence":"observed"},{"id":"benchmark","label":"Benchmarks","weight":0.12,"why":"insufficient evidence","sources":[],"evidence":"insufficient"}],"missing":["GitHub health: insufficient evidence","Agent use: insufficient evidence","Human notes: insufficient evidence","Composability: insufficient evidence","Benchmarks: insufficient evidence"]},"score":9},{"slug":"typesafe-jev","name":"TypeSafe Jev","publisher":"TypeSafe","kind":"model","summary":"Returns typed judgments and probabilities from software state and narrowly defined questions.","homepage":"https://typesafe.ai/","docsUrl":"https://docs.typesafe.ai/llms.txt","functions":["classify","evaluate","reason"],"costRange":"unknown","recordId":"cmp_typesafe-jev","hasMcp":false,"hasApi":true,"costNotes":"Images and Box localization are experimental, off by default and require the documented danger-zone header; request format and accuracy may change.","composabilityRationale":"Use its declared http surface for the listed capability slices. Source review does not establish integration success or observed usage.","interfaces":[{"kind":"http","specUrl":"https://docs.typesafe.ai/llms.txt"}],"origin":"intake","tweets":[],"notes":[],"sources":[{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/llms.txt","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"},{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/images","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"},{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/primitives/box","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"}],"slices":[{"functionId":"classify","label":"Classify","note":"Images and Box localization are experimental, off by default and require the documented danger-zone header; request format and accuracy may change.","cost":"unknown"},{"functionId":"evaluate","label":"Evaluate","note":"Images and Box localization are experimental, off by default and require the documented danger-zone header; request format and accuracy may change.","cost":"unknown"},{"functionId":"reason","label":"Reason","note":"Images and Box localization are experimental, off by default and require the documented danger-zone header; request format and accuracy may change.","cost":"unknown"}],"claims":{"name":"TypeSafe Jev","summary":"Returns typed judgments and probabilities from software state and narrowly defined questions.","kind":"model","publisher":"TypeSafe","homepage":"https://typesafe.ai/","docsUrl":"https://docs.typesafe.ai/llms.txt","costRange":"unknown","costNotes":"Images and Box localization are experimental, off by default and require the documented danger-zone header; request format and accuracy may change.","functions":["classify","evaluate","reason"],"slices":[{"functionId":"classify","label":"Classify","note":"Images and Box localization are experimental, off by default and require the documented danger-zone header; request format and accuracy may change.","cost":"unknown"},{"functionId":"evaluate","label":"Evaluate","note":"Images and Box localization are experimental, off by default and require the documented danger-zone header; request format and accuracy may change.","cost":"unknown"},{"functionId":"reason","label":"Reason","note":"Images and Box localization are experimental, off by default and require the documented danger-zone header; request format and accuracy may change.","cost":"unknown"}],"interfaces":[{"kind":"http","specUrl":"https://docs.typesafe.ai/llms.txt"}],"composabilityRationale":"Use its declared http surface for the listed capability slices. Source review does not establish integration success or observed usage."},"relations":[{"from":"typesafe-jev","to":"toloka","kind":"fills-same-slot-as","note":"Shared functions classify, evaluate. Can fill the same function slot."},{"from":"typesafe-jev","to":"41-open-source-llms-evaluated-on-19-benchmarks","kind":"fills-same-slot-as","note":"Shared functions evaluate, reason. Can fill the same function slot."}],"signals":[],"functionProbabilities":[],"claimVerification":[],"explain":{"score":7,"formula":"100 × sum(weight × value) over observed factors only. Unobserved factors are omitted, not zeroed.","factors":[{"id":"github_health","label":"GitHub health","weight":0.18,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"agent_use","label":"Agent use","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"human_notes","label":"Human notes","weight":0.14,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"composability","label":"Composability","weight":0.16,"why":"insufficient evidence","sources":[{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/llms.txt","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"},{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/images","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"},{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/primitives/box","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"}],"evidence":"insufficient"},{"id":"checklist","label":"Checklist","weight":0.1,"value":0.3333333333333333,"contribution":0.03333333333333333,"why":"No MCP surface is declared. An API is declared. Cost is unknown. 1 of 3 checklist fields are complete.","sources":[{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/llms.txt","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"},{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/images","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"},{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/primitives/box","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"}],"evidence":"observed"},{"id":"evidence_quality","label":"Evidence quality","weight":0.14,"value":0.26214289265639185,"contribution":0.036700004971894865,"why":"3 sources cover 1 evidence types. The latest dated evidence is undated. Freshness is omitted unless observed as a signal.","sources":[{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/llms.txt","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"},{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/images","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"},{"kind":"docs","label":"TypeSafe Jev official documentation","url":"https://docs.typesafe.ai/primitives/box","checkedAt":"2026-11-07T13:46:44.976Z","basis":"vendor-claim"}],"evidence":"observed"},{"id":"benchmark","label":"Benchmarks","weight":0.12,"why":"insufficient evidence","sources":[],"evidence":"insufficient"}],"missing":["GitHub health: insufficient evidence","Agent use: insufficient evidence","Human notes: insufficient evidence","Composability: insufficient evidence","Benchmarks: insufficient evidence"]},"score":7},{"slug":"lore","name":"Lore","summary":"Open-source shared persistent memory for AI agents, backed by Notion. A Lore vault is a Notion page with Projects, Topics, Memories, Entities, and Facts databases so later sessions and people can reuse experiential knowledge, follow-up tasks, decision records, and procedures. Age","publisher":"Notion","homepage":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","kind":"mcp","hasApi":false,"hasMcp":true,"costRange":"unknown","costNotes":"Unknown: The page states Lore is open source under the MIT license and stored in Notion. It does not state a price, usage fee, seat cost, or whether a paid Notion plan is required.","functions":["memory","extract","search","store","connect","evaluate","retrieve","tool-call"],"slices":[{"functionId":"memory","label":"Shared agent memory vault","note":"Persistent shared memory for experiential knowledge, follow-up tasks, decision records, and procedures, stored as related Notion pages.","cost":"Unknown"},{"functionId":"store","label":"Background memory write","note":"Hooks prompt agents to store information and save it in the background. Facts expire unless reinforced and can be linked with supersedes, scoped, or conflicts_with.","cost":"Unknown"},{"functionId":"retrieve","label":"Session context retrieval","note":"Sessions can start with relevant vault context, and agents can fetch and expand stored memories through Lore tools.","cost":"Unknown"},{"functionId":"search","label":"Structured vault search","note":"Projects, Topics, Memories, Entities, and Facts are related so agents have a predictable search structure, including fuzzy search across those relations.","cost":"Unknown"},{"functionId":"extract","label":"extract","note":"Inferred from executor","cost":"Unknown"},{"functionId":"connect","label":"connect","note":"Inferred from executor","cost":"Unknown"},{"functionId":"evaluate","label":"evaluate","note":"Inferred from executor","cost":"Unknown"},{"functionId":"tool-call","label":"tool-call","note":"Inferred from executor","cost":"Unknown"}],"interfaces":[{"kind":"mcp"}],"composabilityRationale":"The page states any MCP-compatible agent harness can reference the vault through lore-* MCP tools, while humans can use the same Notion pages or a Lore CLI. It contrasts this with harness-local, model-provider, and single-machine file memory. Exact tool schemas, authentication, and any non-MCP HTTP API are not specified in the retrieved text.","signals":[],"functionProbabilities":[{"functionId":"memory","value":0.92,"source":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"lexical","observedAt":"2026-10-16T00:14:10.454Z"},{"functionId":"extract","value":0.8,"source":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"lexical","observedAt":"2026-10-16T00:14:10.454Z"},{"functionId":"search","value":0.8,"source":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"lexical","observedAt":"2026-10-16T00:14:10.454Z"},{"functionId":"store","value":0.8,"source":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"lexical","observedAt":"2026-10-16T00:14:10.454Z"},{"functionId":"connect","value":0.72,"source":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"lexical","observedAt":"2026-10-16T00:14:10.454Z"},{"functionId":"evaluate","value":0.72,"source":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"lexical","observedAt":"2026-10-16T00:14:10.454Z"},{"functionId":"retrieve","value":0.72,"source":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"lexical","observedAt":"2026-10-16T00:14:10.454Z"},{"functionId":"tool-call","value":0.72,"source":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"lexical","observedAt":"2026-10-16T00:14:10.454Z"}],"claimVerification":[{"key":"mcp","status":"unverified","asserted":"true","evidenceSource":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"fallback"},{"key":"api","status":"unverified","asserted":"false","evidenceSource":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"fallback"},{"key":"cost","status":"unverified","asserted":"unknown","evidenceSource":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"fallback"},{"key":"license","status":"unverified","asserted":"","evidenceSource":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","method":"fallback"}],"tweets":[],"notes":[],"origin":"intake","createdAt":"2026-10-16T00:14:11.348Z","updatedAt":"2026-10-16T00:14:11.348Z","sources":[{"kind":"web","label":"executor","url":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","excerpt":"All posts\n\nAll posts\n\nPublished August 18, 2026 in Tech\n\n# Building Shared Memory for AI Agents in Notion\n\nBy Hesham Salman\n\nEngineering, Notion\n\nAs software engineering changes, tribal knowledge is increasingly concentrated not only in a s","at":"2026-10-16T00:14:11.348Z"}],"recordId":"cmp_lore","claims":{"name":"Lore","summary":"Open-source shared persistent memory for AI agents, backed by Notion. A Lore vault is a Notion page with Projects, Topics, Memories, Entities, and Facts databases so later sessions and people can reuse experiential knowledge, follow-up tasks, decision records, and procedures. Age","kind":"mcp","publisher":"Notion","homepage":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","costRange":"unknown","costNotes":"Unknown: The page states Lore is open source under the MIT license and stored in Notion. It does not state a price, usage fee, seat cost, or whether a paid Notion plan is required.","functions":["memory","extract","search","store","connect","evaluate","retrieve","tool-call"],"slices":[{"functionId":"memory","label":"Shared agent memory vault","note":"Persistent shared memory for experiential knowledge, follow-up tasks, decision records, and procedures, stored as related Notion pages.","cost":"Unknown"},{"functionId":"store","label":"Background memory write","note":"Hooks prompt agents to store information and save it in the background. Facts expire unless reinforced and can be linked with supersedes, scoped, or conflicts_with.","cost":"Unknown"},{"functionId":"retrieve","label":"Session context retrieval","note":"Sessions can start with relevant vault context, and agents can fetch and expand stored memories through Lore tools.","cost":"Unknown"},{"functionId":"search","label":"Structured vault search","note":"Projects, Topics, Memories, Entities, and Facts are related so agents have a predictable search structure, including fuzzy search across those relations.","cost":"Unknown"},{"functionId":"extract","label":"extract","note":"Inferred from executor","cost":"Unknown"},{"functionId":"connect","label":"connect","note":"Inferred from executor","cost":"Unknown"},{"functionId":"evaluate","label":"evaluate","note":"Inferred from executor","cost":"Unknown"},{"functionId":"tool-call","label":"tool-call","note":"Inferred from executor","cost":"Unknown"}],"interfaces":[{"kind":"mcp"}],"composabilityRationale":"The page states any MCP-compatible agent harness can reference the vault through lore-* MCP tools, while humans can use the same Notion pages or a Lore CLI. It contrasts this with harness-local, model-provider, and single-machine file memory. Exact tool schemas, authentication, and any non-MCP HTTP API are not specified in the retrieved text."},"relations":[{"from":"lore","to":"exa","kind":"fills-same-slot-as","note":"Shared functions connect, extract, retrieve, search, tool-call. Can fill the same function slot."},{"from":"lore","to":"local-faiss-mcp-server","kind":"fills-same-slot-as","note":"Shared functions connect, extract, memory, retrieve, search, store. Can fill the same function slot."},{"from":"lore","to":"awesome","kind":"fills-same-slot-as","note":"Shared functions connect, evaluate, memory, search, store. Can fill the same function slot."},{"from":"lore","to":"dataforseo","kind":"fills-same-slot-as","note":"Shared functions extract, retrieve, search. Can fill the same function slot."},{"from":"lore","to":"litescrape","kind":"fills-same-slot-as","note":"Shared functions extract, retrieve, search. Can fill the same function slot."},{"from":"lore","to":"tikhub","kind":"fills-same-slot-as","note":"Shared functions extract, retrieve, search. Can fill the same function slot."},{"from":"lore","to":"pulsemcp","kind":"fills-same-slot-as","note":"Shared functions connect, retrieve, search, tool-call. Can fill the same function slot."},{"from":"lore","to":"memini","kind":"fills-same-slot-as","note":"Shared functions connect, memory, retrieve, search, store. Can fill the same function slot."}],"explain":{"score":6,"formula":"100 × sum(weight × value) over observed factors only. Unobserved factors are omitted, not zeroed.","factors":[{"id":"github_health","label":"GitHub health","weight":0.18,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"agent_use","label":"Agent use","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"human_notes","label":"Human notes","weight":0.14,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"composability","label":"Composability","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"checklist","label":"Checklist","weight":0.1,"value":0.3333333333333333,"contribution":0.03333333333333333,"why":"An MCP surface is declared. No API is declared. Cost is unknown. 1 of 3 checklist fields are complete.","sources":[],"evidence":"observed"},{"id":"evidence_quality","label":"Evidence quality","weight":0.14,"value":0.18107144632819594,"contribution":0.025350002485947435,"why":"1 sources cover 1 evidence types. The latest dated evidence is 2026-10-16. Freshness is omitted unless observed as a signal.","sources":[{"kind":"web","label":"executor","url":"https://www.notion.com/blog/building-shared-memory-for-ai-agents-in-notion","excerpt":"All posts\n\nAll posts\n\nPublished August 18, 2026 in Tech\n\n# Building Shared Memory for AI Agents in Notion\n\nBy Hesham Salman\n\nEngineering, Notion\n\nAs software engineering changes, tribal knowledge is increasingly concentrated not only in a s","at":"2026-10-16T00:14:11.348Z"}],"evidence":"observed"},{"id":"benchmark","label":"Benchmarks","weight":0.12,"why":"insufficient evidence","sources":[],"evidence":"insufficient"}],"missing":["GitHub health: insufficient evidence","Agent use: insufficient evidence","Human notes: insufficient evidence","Composability: insufficient evidence","Benchmarks: insufficient evidence"]},"score":6,"tags":["agents"]},{"slug":"petergyang-no-ai-slop","name":"petergyang/no-ai-slop","summary":"Portable agent skill that edits drafts to remove 20+ AI-slop patterns (min effective edit + self-check via eval.md) or detects patterns with quoted lines — without claiming AI-authorship detectors.","kind":"skill","homepage":"https://creatoreconomy.so/p/use-my-no-ai-slop-skill-to-remove-20-ai-slop-patterns","repoUrl":"https://github.com/petergyang/no-ai-slop","publisher":"Peter Yang","license":"MIT","hasMcp":false,"hasApi":false,"costRange":"unknown","composabilityRationale":"","functions":["evaluate"],"functionProbabilities":[{"functionId":"evaluate","value":0.72,"source":"06 Knowledge Library/Resources/coding/2026-07-23-petergyang-no-ai-slop.md","method":"lexical","observedAt":"2026-07-23T00:00:00.000Z"}],"slices":[{"functionId":"evaluate","label":"Evaluate","note":"Portable agent skill that edits drafts to remove 20+ AI-slop patterns (min effective edit + self-check via eval.md) or detects patterns with quoted lines — without claiming AI-authorship detectors.","cost":"unknown"}],"tweets":[],"sources":[{"kind":"human","label":"Catalogue resource card","excerpt":"06 Knowledge Library/Resources/coding/2026-07-23-petergyang-no-ai-slop.md\nPortable agent skill that edits drafts to remove 20+ AI-slop patterns (min effective edit + self-check via eval.md) or detects patterns with quoted lines — without claiming AI-authorship detectors.","at":"2026-07-23T00:00:00.000Z"},{"kind":"human","label":"Catalogue resource card","excerpt":"Portable agent skill that edits drafts to remove 20+ AI-slop patterns (min effective edit + self-check via eva","at":"2026-07-23T00:00:00.000Z"}],"interfaces":[{"kind":"skill"}],"origin":"seed","notes":[],"createdAt":"2026-07-23T00:00:00.000Z","updatedAt":"2026-07-23T00:00:00.000Z","stagingSeed":"leyline-0.3.0-staging","recordId":"cmp_petergyang-no-ai-slop","claims":{"name":"petergyang/no-ai-slop","summary":"Portable agent skill that edits drafts to remove 20+ AI-slop patterns (min effective edit + self-check via eval.md) or detects patterns with quoted lines — without claiming AI-authorship detectors.","kind":"skill","publisher":"Peter Yang","homepage":"https://creatoreconomy.so/p/use-my-no-ai-slop-skill-to-remove-20-ai-slop-patterns","repoUrl":"https://github.com/petergyang/no-ai-slop","license":"MIT","costRange":"unknown","functions":["evaluate"],"slices":[{"functionId":"evaluate","label":"Evaluate","note":"Portable agent skill that edits drafts to remove 20+ AI-slop patterns (min effective edit + self-check via eval.md) or detects patterns with quoted lines — without claiming AI-authorship detectors.","cost":"unknown"}],"interfaces":[{"kind":"skill"}],"composabilityRationale":""},"relations":[],"signals":[{"key":"has_license","value":1,"source":"component-record","method":"declared-license","observedAt":"2026-07-23T00:00:00.000Z"}],"claimVerification":[],"explain":{"score":6,"formula":"100 × sum(weight × value) over observed factors only. Unobserved factors are omitted, not zeroed.","factors":[{"id":"github_health","label":"GitHub health","weight":0.18,"value":0.15,"contribution":0.027,"why":"A licence is declared.","sources":[],"evidence":"observed"},{"id":"agent_use","label":"Agent use","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"human_notes","label":"Human notes","weight":0.14,"why":"insufficient evidence","sources":[{"kind":"human","label":"Catalogue resource card","excerpt":"06 Knowledge Library/Resources/coding/2026-07-23-petergyang-no-ai-slop.md\nPortable agent skill that edits drafts to remove 20+ AI-slop patterns (min effective edit + self-check via eval.md) or detects patterns with quoted lines — without claiming AI-authorship detectors.","at":"2026-07-23T00:00:00.000Z"},{"kind":"human","label":"Catalogue resource card","excerpt":"Portable agent skill that edits drafts to remove 20+ AI-slop patterns (min effective edit + self-check via eva","at":"2026-07-23T00:00:00.000Z"}],"evidence":"insufficient"},{"id":"composability","label":"Composability","weight":0.16,"why":"insufficient evidence","sources":[],"evidence":"insufficient"},{"id":"checklist","label":"Checklist","weight":0.1,"value":0,"contribution":0,"why":"No MCP surface is declared. No API is declared. Cost is unknown. 0 of 3 checklist fields are complete.","sources":[],"evidence":"observed"},{"id":"evidence_quality","label":"Evidence quality","weight":0.14,"value":0.22849520230941842,"contribution":0.031989328323318585,"why":"2 sources cover 1 evidence types. The latest dated evidence is 2026-07-23. Freshness is omitted unless observed as a signal.","sources":[{"kind":"human","label":"Catalogue resource card","excerpt":"06 Knowledge Library/Resources/coding/2026-07-23-petergyang-no-ai-slop.md\nPortable agent skill that edits drafts to remove 20+ AI-slop patterns (min effective edit + self-check via eval.md) or detects patterns with quoted lines — without claiming AI-authorship detectors.","at":"2026-07-23T00:00:00.000Z"},{"kind":"human","label":"Catalogue resource card","excerpt":"Portable agent skill that edits drafts to remove 20+ AI-slop patterns (min effective edit + self-check via eva","at":"2026-07-23T00:00:00.000Z"}],"evidence":"observed"},{"id":"benchmark","label":"Benchmarks","weight":0.12,"why":"insufficient evidence","sources":[],"evidence":"insufficient"}],"missing":["Agent use: insufficient evidence","Human notes: insufficient evidence","Composability: insufficient evidence","Benchmarks: insufficient evidence"]},"score":6}]}