Free, visual guide to becoming an AI product engineer: product discovery, LLM trade-offs, AI UX, prototyping, evals, shipping, safety and unit economics.https://ai-product-engineer-wiki.netlify.app/enhttps://ai-product-engineer-wiki.netlify.app/projects/ai-writing-assistant/https://ai-product-engineer-wiki.netlify.app/projects/ai-writing-assistant/Add an AI writing assistant to an existing app with editable suggestions, accept and reject controls, and tracking of what users keep.Sun, 18 Oct 2026 00:00:00 GMTprojectsbeginnerhttps://ai-product-engineer-wiki.netlify.app/projects/catalog-search-with-rag/https://ai-product-engineer-wiki.netlify.app/projects/catalog-search-with-rag/Build natural-language search over a product catalog with retrieval, cited answers and a relevance eval set that proves it beats keyword search.Sun, 18 Oct 2026 00:00:00 GMTprojectsintermediatehttps://ai-product-engineer-wiki.netlify.app/projects/onboarding-agent-with-approvals/https://ai-product-engineer-wiki.netlify.app/projects/onboarding-agent-with-approvals/Build an agent that sets up a new account through tools, asks for approval before risky actions, and logs every step it takes.Sun, 18 Oct 2026 00:00:00 GMTprojectsintermediatehttps://ai-product-engineer-wiki.netlify.app/projects/feedback-driven-prompt-improvement/https://ai-product-engineer-wiki.netlify.app/projects/feedback-driven-prompt-improvement/Capture how users edit AI output, mine the edits for patterns, improve the prompt, and measure the lift with evals and product metrics.Sun, 18 Oct 2026 00:00:00 GMTprojectsadvancedhttps://ai-product-engineer-wiki.netlify.app/projects/ab-tested-ai-feature/https://ai-product-engineer-wiki.netlify.app/projects/ab-tested-ai-feature/Ship an AI feature behind flags, A/B test two variants with analytics events, and build a dashboard of cost per successful task.Sun, 18 Oct 2026 00:00:00 GMTprojectsadvancedhttps://ai-product-engineer-wiki.netlify.app/projects/capstone-paid-ai-saas-feature/https://ai-product-engineer-wiki.netlify.app/projects/capstone-paid-ai-saas-feature/Take a paid AI feature from spec to launch with UX, evals, staged rollout, pricing, a metrics review and a written case study.Sun, 18 Oct 2026 00:00:00 GMTprojectsexperthttps://ai-product-engineer-wiki.netlify.app/start-here/what-is-an-ai-product-engineer/https://ai-product-engineer-wiki.netlify.app/start-here/what-is-an-ai-product-engineer/An AI product engineer owns an AI feature end to end, from the user problem and UX to evals, launch metrics and cost. What the role covers and why it exists.Sat, 17 Oct 2026 00:00:00 GMTstart-herebeginnerhttps://ai-product-engineer-wiki.netlify.app/start-here/ai-product-engineer-vs-other-roles/https://ai-product-engineer-wiki.netlify.app/start-here/ai-product-engineer-vs-other-roles/How the AI product engineer differs from AI engineers, ML engineers, product managers and full-stack engineers, and the path into the role from each.Sat, 17 Oct 2026 00:00:00 GMTstart-herebeginnerhttps://ai-product-engineer-wiki.netlify.app/start-here/the-ai-product-lifecycle/https://ai-product-engineer-wiki.netlify.app/start-here/the-ai-product-lifecycle/The six-step loop every AI feature goes through, from user problem to shipping and learning, with the artifact and exit criterion for each step.Sat, 17 Oct 2026 00:00:00 GMTstart-herebeginnerhttps://ai-product-engineer-wiki.netlify.app/start-here/choose-your-path/https://ai-product-engineer-wiki.netlify.app/start-here/choose-your-path/Pick a 3, 6 or 12-month plan to become an AI product engineer, check the prerequisites, and set up a weekly routine you can keep.Sat, 17 Oct 2026 00:00:00 GMTstart-herebeginnerhttps://ai-product-engineer-wiki.netlify.app/product-foundations/problem-discovery-for-ai-features/https://ai-product-engineer-wiki.netlify.app/product-foundations/problem-discovery-for-ai-features/Find AI feature ideas worth building by starting from frequent, painful user jobs instead of model capabilities, using data you already have.Sat, 17 Oct 2026 00:00:00 GMTproduct-foundationsbeginnerhttps://ai-product-engineer-wiki.netlify.app/product-foundations/user-interviews-for-engineers/https://ai-product-engineer-wiki.netlify.app/product-foundations/user-interviews-for-engineers/Run short, useful user interviews as an engineer, from recruiting to asking about real behavior, avoiding leading questions and turning notes into decisions.Sat, 17 Oct 2026 00:00:00 GMTproduct-foundationsbeginnerhttps://ai-product-engineer-wiki.netlify.app/product-foundations/jobs-to-be-done-for-ai-products/https://ai-product-engineer-wiki.netlify.app/product-foundations/jobs-to-be-done-for-ai-products/Use jobs-to-be-done to frame AI features around the progress users want to make, write job statements, and spot where AI changes the job.Sat, 17 Oct 2026 00:00:00 GMTproduct-foundationsbeginnerhttps://ai-product-engineer-wiki.netlify.app/product-foundations/writing-a-one-page-ai-feature-spec/https://ai-product-engineer-wiki.netlify.app/product-foundations/writing-a-one-page-ai-feature-spec/Write a one-page spec for an AI feature covering the user and job, success metric, quality bar, failure states, cost estimate and the non-AI alternative.Sat, 17 Oct 2026 00:00:00 GMTproduct-foundationsbeginnerhttps://ai-product-engineer-wiki.netlify.app/product-foundations/defining-success-metrics/https://ai-product-engineer-wiki.netlify.app/product-foundations/defining-success-metrics/Choose success metrics for an AI feature before you build it, from task success and adoption to guardrails and cost per success, with code to compute them.Sat, 17 Oct 2026 00:00:00 GMTproduct-foundationsbeginnerhttps://ai-product-engineer-wiki.netlify.app/product-foundations/when-not-to-use-ai/https://ai-product-engineer-wiki.netlify.app/product-foundations/when-not-to-use-ai/Recognize problems where AI is the wrong tool, where rules, search, templates or better UX solve it more cheaply, reliably and safely than a model.Sat, 17 Oct 2026 00:00:00 GMTproduct-foundationsbeginnerhttps://ai-product-engineer-wiki.netlify.app/llm-capabilities/what-llms-are-good-and-bad-at/https://ai-product-engineer-wiki.netlify.app/llm-capabilities/what-llms-are-good-and-bad-at/A product-focused map of LLM strengths and weaknesses, from language tasks to tool use, and where models still fail, so you scope features realistically.Sat, 17 Oct 2026 00:00:00 GMTllm-capabilitiesintermediatehttps://ai-product-engineer-wiki.netlify.app/llm-capabilities/latency-budgets-and-perceived-speed/https://ai-product-engineer-wiki.netlify.app/llm-capabilities/latency-budgets-and-perceived-speed/Set latency budgets for AI features, measure time to first token and total time, and use streaming and UX to make responses feel fast.Sat, 17 Oct 2026 00:00:00 GMTllm-capabilitiesintermediatehttps://ai-product-engineer-wiki.netlify.app/llm-capabilities/estimating-cost-per-task/https://ai-product-engineer-wiki.netlify.app/llm-capabilities/estimating-cost-per-task/Estimate what an AI feature costs per task and per successful task, from token counts and model prices to retries and caching, with a reusable cost calculator.Sat, 17 Oct 2026 00:00:00 GMTllm-capabilitiesintermediatehttps://ai-product-engineer-wiki.netlify.app/llm-capabilities/context-windows-retrieval-and-memory/https://ai-product-engineer-wiki.netlify.app/llm-capabilities/context-windows-retrieval-and-memory/Decide what goes into the model's context, from long context versus retrieval to conversation memory, and the cost, latency and quality trade-offs of each.Sat, 17 Oct 2026 00:00:00 GMTllm-capabilitiesintermediatehttps://ai-product-engineer-wiki.netlify.app/llm-capabilities/choosing-a-model/https://ai-product-engineer-wiki.netlify.app/llm-capabilities/choosing-a-model/Choose the right model for each AI feature with a repeatable framework that weighs quality on your evals, latency, cost per success, limits and effort settings.Sat, 17 Oct 2026 00:00:00 GMTllm-capabilitiesintermediatehttps://ai-product-engineer-wiki.netlify.app/llm-capabilities/build-buy-or-fine-tune/https://ai-product-engineer-wiki.netlify.app/llm-capabilities/build-buy-or-fine-tune/Decide whether to build on a model API, buy an existing AI product, or fine-tune a model, with the costs, risks and evidence each option needs.Sat, 17 Oct 2026 00:00:00 GMTllm-capabilitiesintermediatehttps://ai-product-engineer-wiki.netlify.app/ai-ux/streaming-and-loading-states/https://ai-product-engineer-wiki.netlify.app/ai-ux/streaming-and-loading-states/Design streaming responses and loading states for AI features, from when to stream to skeletons, progress, stop buttons and handling a stream that ends early.Sat, 17 Oct 2026 00:00:00 GMTai-uxintermediatehttps://ai-product-engineer-wiki.netlify.app/ai-ux/editable-outputs-and-undo/https://ai-product-engineer-wiki.netlify.app/ai-ux/editable-outputs-and-undo/Make AI output editable and reversible with inline editing, accept and reject controls, version history and undo, so users stay in control of the result.Sat, 17 Oct 2026 00:00:00 GMTai-uxintermediatehttps://ai-product-engineer-wiki.netlify.app/ai-ux/citations-and-showing-sources/https://ai-product-engineer-wiki.netlify.app/ai-ux/citations-and-showing-sources/Show where AI answers come from with citations, quoted passages and source links that let users verify claims, built with the Claude citations feature.Sat, 17 Oct 2026 00:00:00 GMTai-uxintermediatehttps://ai-product-engineer-wiki.netlify.app/ai-ux/communicating-confidence-and-uncertainty/https://ai-product-engineer-wiki.netlify.app/ai-ux/communicating-confidence-and-uncertainty/Communicate uncertainty in AI features honestly: when to hedge, when to abstain, and why raw confidence scores usually confuse users more than they help.Sat, 17 Oct 2026 00:00:00 GMTai-uxintermediatehttps://ai-product-engineer-wiki.netlify.app/ai-ux/human-in-the-loop-and-approval-flows/https://ai-product-engineer-wiki.netlify.app/ai-ux/human-in-the-loop-and-approval-flows/Design approval flows for AI actions, deciding which actions need a human, how to present a proposed action clearly, and how to keep approvals fast.Sat, 17 Oct 2026 00:00:00 GMTai-uxintermediatehttps://ai-product-engineer-wiki.netlify.app/ai-ux/error-refusal-and-empty-states/https://ai-product-engineer-wiki.netlify.app/ai-ux/error-refusal-and-empty-states/Design the unhappy paths of AI features, from API errors and refusals to truncated answers, empty results and timeouts, with copy and recovery for each.Sat, 17 Oct 2026 00:00:00 GMTai-uxintermediatehttps://ai-product-engineer-wiki.netlify.app/ai-ux/onboarding-and-setting-expectations/https://ai-product-engineer-wiki.netlify.app/ai-ux/onboarding-and-setting-expectations/Introduce AI features so users know what they can do, where they fall short and how to get good results, without long tutorials.Sat, 17 Oct 2026 00:00:00 GMTai-uxintermediatehttps://ai-product-engineer-wiki.netlify.app/rapid-prototyping/prompt-first-prototyping/https://ai-product-engineer-wiki.netlify.app/rapid-prototyping/prompt-first-prototyping/Prototype an AI feature with nothing but prompts and real inputs before writing app code, and learn whether the core idea works in an afternoon.Sat, 17 Oct 2026 00:00:00 GMTrapid-prototypingintermediatehttps://ai-product-engineer-wiki.netlify.app/rapid-prototyping/wizard-of-oz-tests/https://ai-product-engineer-wiki.netlify.app/rapid-prototyping/wizard-of-oz-tests/Test an AI feature with real users before building it by having a human play the AI, and learn what people actually need from the experience.Sat, 17 Oct 2026 00:00:00 GMTrapid-prototypingintermediatehttps://ai-product-engineer-wiki.netlify.app/rapid-prototyping/day-one-demo-in-nextjs/https://ai-product-engineer-wiki.netlify.app/rapid-prototyping/day-one-demo-in-nextjs/Build a working AI feature demo in one day with Next.js and the Anthropic SDK, with a server route, streaming UI and handling for every stop reason.Sat, 17 Oct 2026 00:00:00 GMTrapid-prototypingintermediatehttps://ai-product-engineer-wiki.netlify.app/rapid-prototyping/structured-outputs-and-tool-calls/https://ai-product-engineer-wiki.netlify.app/rapid-prototyping/structured-outputs-and-tool-calls/Get reliable JSON and actions from a model in prototypes, with schema-based structured outputs, simple tool calls and validation of what the model returns.Sat, 17 Oct 2026 00:00:00 GMTrapid-prototypingintermediatehttps://ai-product-engineer-wiki.netlify.app/rapid-prototyping/turning-a-prototype-into-a-spec/https://ai-product-engineer-wiki.netlify.app/rapid-prototyping/turning-a-prototype-into-a-spec/Turn what a prototype taught you into a buildable spec, with findings, decisions, the first eval cases and the open risks before engineering starts.Sat, 17 Oct 2026 00:00:00 GMTrapid-prototypingintermediatehttps://ai-product-engineer-wiki.netlify.app/evals/why-evals-are-product-metrics/https://ai-product-engineer-wiki.netlify.app/evals/why-evals-are-product-metrics/Evals measure how often an AI feature is good enough for users. Learn why they belong with product metrics, not only in an ML notebook.Sat, 17 Oct 2026 00:00:00 GMTevalsadvancedhttps://ai-product-engineer-wiki.netlify.app/evals/golden-datasets-from-real-user-tasks/https://ai-product-engineer-wiki.netlify.app/evals/golden-datasets-from-real-user-tasks/Build a golden dataset from real user tasks, covering sampling, coverage of hard cases, writing reference answers, privacy, and keeping the set fresh.Sat, 17 Oct 2026 00:00:00 GMTevalsadvancedhttps://ai-product-engineer-wiki.netlify.app/evals/rubrics-and-human-grading/https://ai-product-engineer-wiki.netlify.app/evals/rubrics-and-human-grading/Write rubrics that make AI output gradeable, run human grading sessions, and measure agreement between graders before trusting the scores.Sat, 17 Oct 2026 00:00:00 GMTevalsadvancedhttps://ai-product-engineer-wiki.netlify.app/evals/llm-as-judge/https://ai-product-engineer-wiki.netlify.app/evals/llm-as-judge/Use a model to grade AI output at scale, with judge prompts, rubrics, calibration against human grades, and the biases to guard against.Sat, 17 Oct 2026 00:00:00 GMTevalsadvancedhttps://ai-product-engineer-wiki.netlify.app/evals/regression-eval-suites-in-ci/https://ai-product-engineer-wiki.netlify.app/evals/regression-eval-suites-in-ci/Run evals in CI so prompt and model changes can't silently make an AI feature worse, with thresholds, flakiness handling, cost control and reporting.Sat, 17 Oct 2026 00:00:00 GMTevalsadvancedhttps://ai-product-engineer-wiki.netlify.app/evals/linking-eval-scores-to-business-kpis/https://ai-product-engineer-wiki.netlify.app/evals/linking-eval-scores-to-business-kpis/Connect offline eval scores to the business metrics they should move, check that the link holds, and report AI quality in terms leadership understands.Sat, 17 Oct 2026 00:00:00 GMTevalsadvancedhttps://ai-product-engineer-wiki.netlify.app/shipping/feature-flags-and-staged-rollouts/https://ai-product-engineer-wiki.netlify.app/shipping/feature-flags-and-staged-rollouts/Ship AI features gradually with feature flags, covering staged exposure, kill switches, flagging prompts and models, and rollback plans that work in minutes.Sat, 17 Oct 2026 00:00:00 GMTshippingadvancedhttps://ai-product-engineer-wiki.netlify.app/shipping/ab-testing-ai-features/https://ai-product-engineer-wiki.netlify.app/shipping/ab-testing-ai-features/Run A/B tests on AI features, from choosing metrics and sample sizes to novelty effects, cost as a metric, and reading results when output quality varies.Sat, 17 Oct 2026 00:00:00 GMTshippingadvancedhttps://ai-product-engineer-wiki.netlify.app/shipping/product-analytics-events-for-ai/https://ai-product-engineer-wiki.netlify.app/shipping/product-analytics-events-for-ai/Instrument AI features with product analytics, with an event schema for requests, outcomes, edits and costs, and the questions it lets you answer.Sat, 17 Oct 2026 00:00:00 GMTshippingadvancedhttps://ai-product-engineer-wiki.netlify.app/shipping/capturing-feedback/https://ai-product-engineer-wiki.netlify.app/shipping/capturing-feedback/Collect useful feedback on AI output, from explicit ratings to implicit signals in edits and retries, and turn both into improvements.Sat, 17 Oct 2026 00:00:00 GMTshippingadvancedhttps://ai-product-engineer-wiki.netlify.app/shipping/tracing-and-observability/https://ai-product-engineer-wiki.netlify.app/shipping/tracing-and-observability/Trace every LLM call in production, from what to record to linking traces with users and outcomes, reviewing traces, and monitoring cost and latency.Sat, 17 Oct 2026 00:00:00 GMTshippingadvancedhttps://ai-product-engineer-wiki.netlify.app/shipping/the-iteration-loop/https://ai-product-engineer-wiki.netlify.app/shipping/the-iteration-loop/Turn production feedback into measured improvements by finding failure patterns, changing prompts or design, verifying with evals and shipping safely.Sat, 17 Oct 2026 00:00:00 GMTshippingadvancedhttps://ai-product-engineer-wiki.netlify.app/trust-safety-economics/prompt-injection-and-tool-use-risks/https://ai-product-engineer-wiki.netlify.app/trust-safety-economics/prompt-injection-and-tool-use-risks/Understand prompt injection and the risks of giving AI features tools, including attack paths, realistic threat models and defenses that limit the damage.Sat, 17 Oct 2026 00:00:00 GMTtrust-safety-economicsexperthttps://ai-product-engineer-wiki.netlify.app/trust-safety-economics/data-privacy-and-retention/https://ai-product-engineer-wiki.netlify.app/trust-safety-economics/data-privacy-and-retention/Handle user data responsibly in AI features, including what you send to model providers, retention, consent, regulated data and telling users plainly.Sat, 17 Oct 2026 00:00:00 GMTtrust-safety-economicsexperthttps://ai-product-engineer-wiki.netlify.app/trust-safety-economics/abuse-misuse-and-rate-limiting/https://ai-product-engineer-wiki.netlify.app/trust-safety-economics/abuse-misuse-and-rate-limiting/Protect AI features from abuse with rate limits, quotas, misuse detection and cost-attack defenses, and handle users who push a feature beyond its purpose.Sat, 17 Oct 2026 00:00:00 GMTtrust-safety-economicsexperthttps://ai-product-engineer-wiki.netlify.app/trust-safety-economics/guardrails-for-inputs-outputs-and-actions/https://ai-product-engineer-wiki.netlify.app/trust-safety-economics/guardrails-for-inputs-outputs-and-actions/Add guardrails around AI features with input checks, output validation, action limits and refusal handling, and keep them from blocking real users.Sat, 17 Oct 2026 00:00:00 GMTtrust-safety-economicsexperthttps://ai-product-engineer-wiki.netlify.app/trust-safety-economics/unit-economics-of-ai-features/https://ai-product-engineer-wiki.netlify.app/trust-safety-economics/unit-economics-of-ai-features/Work out the unit economics of an AI feature, from cost per successful task and value per user to margins by plan and the levers that improve them.Sat, 17 Oct 2026 00:00:00 GMTtrust-safety-economicsexperthttps://ai-product-engineer-wiki.netlify.app/trust-safety-economics/pricing-ai-features/https://ai-product-engineer-wiki.netlify.app/trust-safety-economics/pricing-ai-features/Price AI features with bundling, usage-based pricing, credits and tiers, protecting margins from heavy users and communicating limits fairly.Sat, 17 Oct 2026 00:00:00 GMTtrust-safety-economicsexperthttps://ai-product-engineer-wiki.netlify.app/trust-safety-economics/cost-dashboards-and-budgets/https://ai-product-engineer-wiki.netlify.app/trust-safety-economics/cost-dashboards-and-budgets/Track and control AI spend with cost dashboards by feature, model and customer, budgets and alerts, and spend reviewed as a product metric.Sat, 17 Oct 2026 00:00:00 GMTtrust-safety-economicsexperthttps://ai-product-engineer-wiki.netlify.app/projects-and-career/building-an-ai-product-portfolio/https://ai-product-engineer-wiki.netlify.app/projects-and-career/building-an-ai-product-portfolio/Build a portfolio that shows AI product engineering skill, choosing projects, showing evidence, and presenting outcomes rather than just code.Sat, 17 Oct 2026 00:00:00 GMTprojects-and-careerexperthttps://ai-product-engineer-wiki.netlify.app/projects-and-career/writing-a-product-case-study/https://ai-product-engineer-wiki.netlify.app/projects-and-career/writing-a-product-case-study/Write a case study of an AI feature that shows how you think, covering context, problem, decisions and trade-offs, evals, results and what you would change.Sat, 17 Oct 2026 00:00:00 GMTprojects-and-careerexperthttps://ai-product-engineer-wiki.netlify.app/projects-and-career/ai-product-sense-interviews/https://ai-product-engineer-wiki.netlify.app/projects-and-career/ai-product-sense-interviews/Prepare for AI product sense interviews with a framework for open-ended questions, evaluating AI features, trade-off questions and practice prompts.Sat, 17 Oct 2026 00:00:00 GMTprojects-and-careerexperthttps://ai-product-engineer-wiki.netlify.app/projects-and-career/career-paths-and-leveling/https://ai-product-engineer-wiki.netlify.app/projects-and-career/career-paths-and-leveling/Plan your career as an AI product engineer, including what changes from mid-level to senior and staff, adjacent paths, and how to grow scope and impact.Sat, 17 Oct 2026 00:00:00 GMTprojects-and-careerexpert