References
-
Yehuda Koren, Robert Bell, Chris Volinsky. Matrix Factorization Techniques for Recommender Systems. IEEE Computer, 2009. The Netflix-Prize-era reference for MF (our SGD version).
-
Yifan Hu, Yehuda Koren, Chris Volinsky. Collaborative Filtering for Implicit Feedback Datasets. ICDM 2008. Implicit ALS: preference + confidence (our
ImplicitALS). -
Steffen Rendle et al. BPR: Bayesian Personalized Ranking from Implicit Feedback. UAI 2009. Pairwise learning-to-rank with negative sampling (our
BPR). -
Greg Linden, Brent Smith, Jeremy York. Amazon.com Recommendations: Item-to-Item Collaborative Filtering. IEEE Internet Computing, 2003. The item-item neighborhood method at scale.
-
Paul Covington, Jay Adams, Emre Sargin. Deep Neural Networks for YouTube Recommendations. RecSys 2016. The canonical two-stage (candidate generation + ranking) deep architecture.
-
Xiangnan He et al. Neural Collaborative Filtering. WWW 2017. Neural generalization of matrix factorization.
-
Maurizio Ferrari Dacrema, Paolo Cremonesi, Dietmar Jannach. Are We Really Making Much Progress? A Worrying Analysis of Recent Neural Recommendation Approaches. RecSys 2019. Why strong, well-tuned baselines matter (and often win).
-
Cai-Nicolas Ziegler, Sean M. McNee, Joseph A. Konstan, Georg Lausen. Improving Recommendation Lists Through Topic Diversification. WWW 2005. Intra-list similarity: the diversity criterion in our slate rubric.
-
Lianmin Zheng et al. Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena. NeurIPS 2023. LLM judges, plus the position and verbosity biases our rubric chapter guards against.
-
Moses Charikar. Similarity Estimation Techniques from Rounding Algorithms. STOC 2002. SimHash, the fingerprint behind our ingest-time story clustering.
-
Gurmeet Singh Manku, Arvind Jain, Anish Das Sarma. Detecting Near-Duplicates for Web Crawling. WWW 2007. SimHash + Hamming search at Google scale; the production version of our LSH banding.
-
Adith Swaminathan et al. Off-Policy Evaluation for Slate Recommendation. NeurIPS 2017. The "slate" as the unit of recommendation and evaluation; where the term in our rubric chapters comes from.
The research arc (Chapters 30 to 35)
-
Aditya Pal et al. PinnerSage: Multi-Modal User Embedding Framework for Recommendations at Pinterest. KDD 2020. The argument against a single averaged profile vector (cluster the user's items, keep a medoid per cluster) plus exponential time-decayed cluster importance; the finding our walkthrough rides into a PRD.
-
Yi Ding, Xue Li. Time Weight Collaborative Filtering. CIKM 2005. Recency-decayed weighting of interactions; the ancestor of our EMA half-life.
-
Ruining He, Julian McAuley. VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback. AAAI 2016. The canonical "fold pretrained image features into ranking" result.
-
Andrew Zhai et al. Learning a Unified Embedding for Visual Search at Pinterest. KDD 2019. One production image embedding, validated offline, in user studies, and in online A/B: the full evaluation ladder in one paper.
-
Alec Radford et al. Learning Transferable Visual Models From Natural Language Supervision. ICML 2021. CLIP: images and text in one embedding space.
-
Lihong Li, Wei Chu, John Langford, Robert E. Schapire. A Contextual-Bandit Approach to Personalized News Article Recommendation. WWW 2010. LinUCB on Yahoo's front page: bandits running inside a production news recommender.
-
William R. Thompson. On the Likelihood that One Unknown Probability Exceeds Another in View of the Evidence of Two Samples. Biometrika, 1933. Thompson sampling, the scheduler in our sprint-allocation lab.
-
Ronald A. Howard. Information Value Theory. IEEE Transactions on Systems Science and Cybernetics, 1966. EVPI: pricing an experiment before running it.
-
Leslie Pack Kaelbling, Michael L. Littman, Anthony R. Cassandra. Planning and Acting in Partially Observable Stochastic Domains. Artificial Intelligence, 1998. POMDPs: the setting where gathering information is itself part of an optimal policy; the serious version of our research-MDP cartoon.
-
Burr Settles. Active Learning Literature Survey. University of Wisconsin-Madison, TR 1648, 2009. Query what is most informative; directly useful for golden-set labeling.
-
Jasper Snoek, Hugo Larochelle, Ryan P. Adams. Practical Bayesian Optimization of Machine Learning Algorithms. NIPS 2012. Expensive experiments chosen by expected improvement; see also Frazier's tutorial (arXiv:1807.02811) for the value-of-information view.
-
Olivier Chapelle, Thorsten Joachims, Filip Radlinski, Yisong Yue. Large-Scale Validation and Analysis of Interleaved Search Evaluation. ACM TOIS, 2012. Interleaving: rank-sensitive online evaluation that needs far less traffic than A/B; Netflix's TechBlog describes using it to prune rankers in days.
-
Ron Kohavi, Diane Tang, Ya Xu. Trustworthy Online Controlled Experiments: A Practical Guide to A/B Testing. Cambridge University Press, 2020. The book on not fooling yourself once research graduates to A/B.
-
Darren Edge et al. From Local to Global: A Graph RAG Approach to Query-Focused Summarization. arXiv:2404.16130, 2024. GraphRAG: entity/claim graphs plus Leiden community summaries for corpus-wide questions.
-
Shunyu Yao et al. Tree of Thoughts. NeurIPS 2023; Andy Zhou et al. Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models. ICML 2024. Tree search over model reasoning: MDP thinking inside deliberation.
-
David Wadden et al. Fact or Fiction: Verifying Scientific Claims. EMNLP 2020. SciFact: SUPPORTS/REFUTES claim verification, the benchmarked form of adversarial claim-checking.
-
Ihsan Gunes, Cihan Kaleli, Alper Bilge, Huseyin Polat. Shilling Attacks Against Recommender Systems: A Comprehensive Survey. Artificial Intelligence Review 42, 2014. Fake-profile attacks on collaborative filtering; why click feedback is not ground truth (Chapter 35).
-
FutureSearch. Deep Research Bench: Evaluating AI Web Research Agents. arXiv:2506.06287, 2025. The frozen-web benchmark behind Chapter 34's finding that the "deep research" label is not a capability guarantee.
Methods, tools & engines (Chapters 30 to 35)
- BMAD-METHOD: source repository, v6 workflow map, skill reference, Deep Recon, installation, customization, established projects, and the v6 changelog (documentation snapshot checked 2026-07-23; MIT). The research and pipeline skills plus the internals/tooling model of Chapters 30, 31, and 33.
- GitHub spec-kit (official docs), AWS Kiro (Specs docs), OpenSpec (source repository), PRP (source repository) the spec-driven siblings compared in Chapter 30.
- Anthropic engineering, "How we built our multi-agent research system" (2025): the orchestrator-worker architecture, the 90.2% multi-agent eval win, and the ~15x token cost cited in Chapter 32.
- Netflix TechBlog: Artwork Personalization at Netflix (2017, contextual bandits in production) and Innovating Faster on Personalization Algorithms at Netflix Using Interleaving (2017).
- Semantic Scholar API / OpenAlex / Connected Papers: citation-graph services (about 214M papers with 2.5B citation edges; 320M+ works; co-citation similarity maps, respectively, as of mid-2026).
- Deep-research engines: Claude (Research), ChatGPT deep research, Gemini Deep Research, Perplexity, NotebookLM, Elicit, Consensus (Chapter 30's table).
- Provider data-use policies (Chapter 34): Anthropic (consumer terms update, training policy), OpenAI (enterprise privacy, data controls), Google (Gemini Apps privacy, Workspace generative AI privacy), Perplexity (data collection, enterprise retention). Policy snapshots checked July 2026; re-verify before relying.
Regulation, licensing & security (Chapter 35)
- EU Digital Services Act (Regulation 2022/2065, Arts. 27, 34-35, 38) EUR-Lex full text; the Commission's 2026 preliminary findings on addictive design (TikTok, Feb 2026).
- GDPR (Regulation 2016/679, Arts. 4(4), 17, 21, 22), EUR-Lex full text; EDPB Opinion 28/2024 on AI models (models are not automatically anonymous); EDPB Guidelines 2/2019 on contractual necessity.
- EU AI Act (Regulation 2024/1689), EUR-Lex; timeline and Annex III via artificialintelligenceact.eu; the June 2026 Digital Omnibus (Council press release).
- China CAC Algorithmic Recommendation Provisions (effective 2022-03-01) Stanford DigiChina translation (Arts. 17, 18, 21, 24: opt-out, minors, pricing, filing).
- US minors' rules: FTC COPPA amendments (Federal Register, Apr 2025); California SB 976 (Ninth Circuit, Sept 2025); New York SAFE for Kids Act (proposed rules, Sept 2025).
- Licensing & IP: MIND dataset terms (research purposes, Microsoft Research License); DSM Directive 2019/790 Art. 15 (press publishers' right); CJEU C-392/19 VG Bild-Kunst (embedding and thumbnails, 2021); European Accessibility Act.
- Security: OWASP Top 10 for LLM Applications: LLM01 Prompt Injection; ePrivacy Directive Art. 5(3) (device storage consent).
Tools & libraries
- implicit: fast ALS / BPR (Cython).
- imagehash (Pillow), production perceptual hashes (pHash/dHash) for the thumbnail dedupe in the rubric chapter.
- LightFM: hybrid content + collaborative (WARP/BPR).
- FAISS / HNSW / ScaNN: ANN serving for candidate generation.
- OpenSearch / Milvus / Qdrant / Pinecone: vector databases with kNN search.
- TensorFlow Recommenders / TorchRec: two-tower and deep ranking models.
Companion books here
- HNSW from Scratch, the graph-based ANN that serves candidate generation.
- IVF & Product Quantization, compressed ANN for billion-scale catalogs.
- KTS from Scratch, kernel temporal segmentation.
This book's code
code/recsys.py, all algorithms + metrics.code/demo.py, the leaderboard.code/recommend_cli.py, the article-recommender CLI.code/capstone/scripts/rubric_eval.py,thumb_dedup.py,judge_pairs.pythe slate rubric, image dedupe, and LLM judge.code/capstone/scripts/profile_store.py,story_clusters.pythe O(1) DynamoDB profile item and the SimHash/LSH story clustering.code/capstone/scripts/rubric_framework.py,rubric_validation.py,judge_prompts.pythe one-file end-to-end framework, its golden-set validation harness, and the versioned prompt registry.code/research/recon_kit_lab.pya from-scratch miniature of BMAD'srecon_kit.py: tally a memlog ledger, compute a staleness work order, and check citations against the appendix.code/research/research_graph.py,research_bandit.py,research_mdp.pythe research knowledge graph (coverage, contradictions, read-next), the sprint bandit + EVPI calculator, and the research MDP solved by value iteration.
All depend only on NumPy and the standard library (the judge optionally uses the Anthropic SDK when an API key is set).