[小技巧] chrome开启本地模型local ai - gemini nano

Problem & Summary

• chrome://flags/#prompt-api-for-gemini-nano

Solution

• https://docs.google.com/document/d/1VG8HIyz361zGduWgNG7R_R8Xkv0OOJ8b5C9QKeCjU0c/edit?pli=1&tab=t.0

下载Dev版本

Enable Gemini Nano and the Prompt API

1. Go to chrome://flags/#prompt-api-for-gemini-nano

2. Select Enabled

3. Relaunch Chrome.

BypassPerfRequirement

下载模型

allow pasting
await window.ai.createTextSession()
await ai.summarizer.create();
await ai.summarizer.capabilities();

# check
(await ai.languageModel.capabilities()).available;

Confirm availability of Gemini Nano

1. Open DevTools and send (await ai.languageModel.capabilities()).available; in the console.

Test

• https://chrome.dev/web-ai-demos/prompt-api-playground/

• in devtools console:

const canSummarize = await ai.summarizer.capabilities();
let summarizer;
if (canSummarize && canSummarize.available !== 'no') {
  if (canSummarize.available === 'readily') {
    // The summarizer can immediately be used.
    summarizer = await ai.summarizer.create();
  } else {
    // The summarizer can be used after the model download.
    summarizer = await ai.summarizer.create();
    summarizer.addEventListener('downloadprogress', (e) => {
      console.log(e.loaded, e.total);
    });
    await summarizer.ready;
  }
} else {
    // The summarizer can't be used at all.
}

check model download:

if “Uncaught NotSupportedError: The model attempted to output text in an untested language, and was prevented from doing so.”